[alexjplant]

> What do you think?

I know that I've had Copilot make up non-existent methods in the AWS Golang v2 SDK. It also routinely fabricates IAM Actions, AWS managed policies, and Terraform attributes for AWS resources. In a similar vein Claude also made up non-existent kwargs for LlamaIndex methods when I was building a toy RAG implementation last weekend. LLMs are force multipliers but still require supervision because they hallucinate; I see no reason why they couldn't be told about new frameworks on the fly and perform similarly "good enough". They clearly aren't perfect at leveraging the knowledge contained in their weights from their training corpus.

I suspect that as LLM coding tools mature it'll get easier to incorporate framework documentation into queries and mitigate these issues. The last time I used Continue earlier this year it let you add React docs to chat queries so I don't think we're far off.