Hacker News new | ask | show | jobs
by satyrun 340 days ago
I am an American but the idea of Germany not having a competitive LLM right now is pretty sad and embarrassing.

As an American, It is really hard to understand how this can be for a country with such an incredible intellectual and engineering tradition.

2 comments

It's not a lack of local talent. It's a combination of two governance problems:

1. Europe has no large data centers. It has no such datacenters because the Green movement is much more powerful in Europe than in America, and they have systematically blocked the expansion of gas turbine power in favor of over-builds of renewables. The result is Germany having the most expensive electricity in the world. It just isn't affordable to train an LLM in the EU. Notice how Elon Musk has imported gas turbines from around the world to power the xAI datacenter; that just wouldn't be allowed in the EU.

But, still, a German company could do so using US datacenters. Mistral in France has probably done it this way. But then you hit:

2. Copyright laws in Europe are more restrictive. Even in the US it's very unclear whether training an LLM on copyrighted works is actually legal, but the US courts are fairly efficient and US law has the concept of fair use, which is flexible enough to give them the leeway to decide it's legal. In Europe the fair use equivalents are either more restrictive or don't exist at all, and courts follow the local culture of being much less business friendly, so it's much riskier to attempt this. The EU as a set of institutions is much more in hoc to the press than people realize, and MUCH more so than US administrations are. They regularly side with copyright holders over tech companies in disputes in a mostly successful attempt to curry positive PR for the EU project.

It won't win me any friends on HN but both of these factors boil down to a lack of a strong Republican Party equivalent in Europe. I don't think Americans appreciate the extent to which their economic success is dependent on the strength of the Republicans, and they really should. If American conservatism collapsed or was taken over by the left, as has happened in parts of Europe, you'd be seeing the EU-ification of America very quickly.

> I am an American but the idea of Germany not having a competitive LLM right now is pretty sad and embarrassing.

> As an American, It is really hard to understand how this can be for a country with such an incredible intellectual and engineering tradition.

As a German, I would claim that getting Germans on a hype train is incredibly hard.

I also cannot see anything that is "intellectual" about these LLMs. To me, the whole LLM scene is rather like "rich alpha tech bros are tech-broing; a lot of sycophants in the inner circle of these tech bros attempts to use the dictate of the moment to become rich fast; and a lot of real or feign AI fanbois attempts to rid the hype wave to make easy money".

I think the hype train was the polymath omniscient oracle. With agents sanity seems pretty much restored.

With the absorption of entire markets the sober European view should be that the US approach was correct. Throw things at the wall until you have a wall full of things that stick. It looked pretty stupid until it didn't.

> With the absorption of entire markets the sober European view should be that the US approach was correct. Throw things at the wall until you have a wall full of things that stick. It looked pretty stupid until it didn't.

This approach only works if you have an insane amount of capital to waste ...

You don't know if it works, that's the whole point. European investors are like: How do I know 100% for sure this company will be a success? Why do I need this product? I have a car with chauffeur, why do I need a taxi app? I have a cook and a butler, why do I need a food delivery app? Pitching the LLM would be outright offending.
> You don't know if it works, that's the whole point.

I am aware of that, and this is actually my point:

Since you don't know what will work, you can easily have a long phase of "duds" in your investments until you get one big hit. If you don't have a huge mount of additional capital lying around, as an investor you will go bust during such a long "starvation period".

That is why I wrote that this kind of investment approach only works if you have an insane amount of capital to waste.

I think one can be more selective. Skip the unlikely long shots. Being first has its advantage and disadvantages, doing something reasonably early is good enough.

With an insane amount of capital you do get a more reliable % of success but with a single lottery ticket you still have odds to win.

If you are not in the game at all you certainly wont.