[groestl]

Maybe someone can correct me, but my understanding is that you would calculate the embeddings of code chunks, and the embedding of the prompt, and take those chunks that are most similar to the embedding of the prompt as context.

Edit: This, btw, is also the reason why I think that this here popped up on the hackernews frontpage a short while ago: https://github.com/pgvector/pgvector

[michaelmior]

This sounds like a reasonable start. Eventually we need to get to the point where we can expose an API for models to request additional information on their own.

[samstave]

Exactly, but this has some scary implications in the future - imagine when it is common pratice to allow AIs API access as a matter of course...

When giving a prompt, the prompt causes the crawling of many APIs to build the response - the power of such activity/features, will be scary power-to-authoratarian goals.

Imagine if the prompt is "Select all users who have political beliefs, posts, comments, links from APIs A, B, C, etc where sentiment appears to dissent from [party line]"

[groestl]

Imagine that these prompts are not triggered by humans anymore, but by the AI invoking itself.

Sam Altman takes comfort in the thought that their AI does nothing without a human prompting it, so it has a human in the loop, as a circuit breaker if you will.

This assumption is rapidly becoming a mere hope, as right now probably hundreds of developers are working on systems which, when put into production and connected to other systems, might just come down to: the AI is calling itself, and giving itself orders.

[samstave]

Imagine that you just out-did me on how dystopian this AI cyberpunk future could get.

Imagine I want you to shoot me.'

Imagine I Want [whatever]GPT to make a cyberpunk Anime based on such...