[bioemerl]

The strongest one right now is a project called koboldai. However, instructing models like chat GPT are not open source yet, so it only runs stuff that writes books for you.

The problem with running a chat GPT sized system at home is that you need like 15 graphics cards to do it, and very few people have the equipment to manage something like that.

On a 24 gig graphics card you can run maybe 13 billion parameters, and stuff like chat GPT gets up above 200 billion.

I'm trying to set up a server at home with a bunch of old Tesla 40 series cards which have 24 gigs of vram and cost $200 each. A server that is a 2U super micro GPU server can hold six cards.

At the lovely power consumption of 1800 watts, about what your wall can deliver, you can hit about 96 gigs of VRAM for one to $2,000.

If you really wanted to go crazy you can get the v100 card, which are about $1,000 each, with 32 gigs . Trouble is, Nvidia starting to switch all these cards to their fuck you regular old business practice of making the connectors owned by Nvidia and changing the connector you need every single generation, so it's getting harder and harder to get these cards on the used market.

[hanniabu]

> However, instructing models like chat GPT are not open source yet

Closed source AI built by OpenAI, another oxymoron just like the Patriot Act and countless others meant to subvert public goodwill