Hacker News new | ask | show | jobs
by meta_x_ai 567 days ago
None of those matters (except multimodal). If you are running a business, the only thing that matters is

a) How does it perform on my set of evals

b) What is the cost/latency of serving it to my consumers.

It shouldn't matter to me how many parameters, corpus it is trained on, whether it's LLM or Transformer or something else

1 comments

> How does it perform on my set of evals

What kinds of eval? Personally, I have no idea what kind of data you can throw at a "foundation model" and what kind of response you will get.

The only thing it says is that there's machine learning involved... Once you get enough context to understand it's not a spin-off of a TV series.

"Foundation model" is not Amazon lingo, though, but pretty standard industry term at this point. If you're doing any sort of AI in prod, you know what it means.