Hacker News new | ask | show | jobs
by mrtksn 1201 days ago
Unlike Stable Diffusion, I don't stumble upon people who actually use it. Are there examples of the output this can generate? What happens once you manage to run the model?
7 comments

I've been playing around with LLMs recently and it's definitely interesting stuff. I've mostly focused on roleplay/MUD applications and it's not quuitteee there but it's pretty good, and it's idiosyncrasies are often hilarious.

(when fed the leaked bing prompt, my AI decided it was Australian and started tossing in random shit like "but here in Australia, we'd call it limey green" when asked about chartreuse, i assume because the codename for bing chat is 'sydney')

This is very new, give it a few days. Here's one from Shawn: https://twitter.com/theshawwn/status/1632595934839177216
I have been using similar models like LLM for helping draft fictional stories. The community fine tuned models are geared towards SFW and/or NSFW story competition.

https://github.com/KoboldAI/KoboldAI-Client To read more about current popular models.

https://koboldai.net/ is a way to run some of these models in the "cloud". There's no account required and the prompts are run on other people's hardware, with priority weighting based on how much compute you have used or donated. There's an anonymous api key and there's no expectation that the output can't be logged.

The models that run on hardware locally are very basic in the quality of output. Here's an example of a 6B output used to try to emulate chatgpt. https://mobile.twitter.com/Knaikk/status/1629711223863345154 The model was finetuned on story completion so it's not meaningfully comparable.

It's less popular because the hardware required for the great output is still above the top of line consumer specs. 24 gb vram is closer to a bare minimum to get meaningful output, and fine-tuning is still out of reach. There's some development with using services like runpod.

On /g/ there's always a very active AI chatbot general that focuses on these models.
What's /g/?
https://4chan.org/g/

(enter at your own risk? I think it's kinda safe but still 4chan)

Better to direct people to the catalog: https://boards.4channel.org/g/catalog

Browsing page by page is not a good idea.

Search for "aicg" or visit https://boards.4channel.org/g/catalog#s=aicg to see the AI Chatbot General thread (a new one is created every time the previous one hits the reply limit).

Message boards like this are so unreadable unless you have hours upon hours of spare time.
We just need some better GUIs

Stable Diffusion was in the same place as this in the same time frame of the model getting released. Its only been a few days.

Pretty sure you wouldn’t see anyone using it commercially as IIRC it’s only public due to a leak.
It's not a leak, it's a shortcut.

You can download it from Facebook, but it's behind "apply for access" form. Magnet links floating around are just a workaround around that form.

That said, commercial use is forbidden by the license specified in the form: https://docs.google.com/forms/d/e/1FAIpQLSfqNECQnMkycAp2jP4Z...

I wasn't looking for a commercial use but its an Interesting point. Would it be possible to prove that someone is using it commercially?

1) Spin it up on a cluster in Belarus

2) ???

3) Profit?

4) Lukashenka grabs your profits and kicks you out ;-)
Why would he do that? More likely scenario would be "gets his share as a an apartment in London".
That's the oldest authoritarian trick in the book, pretty much any successful business in russia got the same fate for example. They even tried it with nginx.
It could be watermarked
how?
That emoji attack is hilarious, who would have thought that twitter-speak is watermark resistant.
cool, thanks
ive used LLMS a lot for filling out details in my dnd worlds. Both openai products but also the open source GPT-J from euluther Things like writing the text of some books for players to read, of I have to curate just like people do with stable diffusion. Also used it to write songs, its surprisingly good at taking things like chord progressions written in notation and rolling with variations on them