Hacker News new | ask | show | jobs
by leaving 1161 days ago
Well that was a trip.

I asked StableLM-Tuned-Alpha-7b to translate the Swedish phrase "Skaplig bögpulka” into English (because ChatGPT and New Bing refuse to do so as a result of their puritannical US censorship) and it confabulated wildly.

It made up an Estonian folk song and somehow we ended up on the etymology of the well-known Swedish word "Skeletor".

This one is not ready for prime-time, but I have hopes. Someone please make a model that doesn't censor. I won't be paying one thin dime for this stuff until it is censorship-free.

1 comments

It's trained on English corpus exclusively AFAIK.

As for whether it is ready for prime-time, it is an "Alpha" of an uncompleted training run. So it's not finished cooking.

Also, that is the 7B model. They're cooking 15B, 30B, and 65B right now and planning to start 175B soon.

For comparison, 15B is already larger than GPT-3.5 (which is likely a finetune of Curie 13B) while 175B is the same as full size GPT-3 v1 175B which 13B LLaMA already beat on benchmarks. So we can expect all four models larger than 7B to be better than GPT-3 when they are done training (at least in English).