[mritchie712]

This was too perfect of a setup, had to record a video[0] showing how we do this.

Yes, you definitely need need for a codification layer.

I think a semantic layer is the best way to do that for analytics. Having an LLM write bespoke SQL to answer every question will fail fast.

e.g. if you ask for "revenue by month" against a Snowflake warehouse with hundreds of tables, you are guaranteed to get different answers over multiple attempts.

We[1] use an agent to build a semantic layer over time at Definite so you get consistent results.

0 - https://www.loom.com/share/2da829dd440e489a8f7e3906c7083048

1 - https://www.definite.app/

[chenglong-hn]

This is incredibly cool! A lot of times the user query can be ambiguous enough to make it consistent across runs. The semantic layer is essential to reduce ambiguity, either built by AI or engineers.