Hacker News new | ask | show | jobs
by filenox 1180 days ago
As with other OpenAI based applications, I don't feel comfortable sharing my private API key with an application I don't know. Especially when the webpage isn't telling me what this app is about. I suggest adding a small demo video or at least adding some bullets on what this app is trying to solve.
4 comments

I get that fear and it's fair. SlickGPT is OS, self-hostable and just runs locally, so you can check the code and run your own instance if you don't trust that ours running on Vercel is on-par with the one in the repo. You can also put a soft and hard cap on your API quota on the OpenAI page and monitor it to verify that only you are using it.

The key is passed (see https://github.com/ShipBit/slickgpt/blob/main/src/lib/ChatIn...) to a Vercel edge function (see https://github.com/ShipBit/slickgpt/blob/main/src/routes/api...) that does the actual call to the OpenAI API. This function is stateless and doesn't store anything. I also put it in your localStorage using a store (see https://github.com/ShipBit/slickgpt/blob/main/src/misc/store...) so that you don't have to enter it over and over again.

As for the "what is this trying to solve" - read our documentation in the GitHub repo over at https://github.com/ShipBit/slickgpt.

It's a self-hostable chat interface for the OpenAI GPT API.

From their Github Readme:

SlickGPT allows you to run your own local ChatGPT instance, host it yourself or just use our instance if you like. Users bring their own OpenAI API keys. SlickGPT offers them a very fancy user interface with a rich feature set like managing a local chat history (in the localStorage), a userless "Share" function for chats, a prominent context editor, and token cost calculation and distribution.

https://github.com/ShipBit/slickgpt

> SlickGPT allows you to run your own local ChatGPT instance

I find it interesting that so many projects claim to be "run your own ChatGPT", when they're in fact "run your own web UI". Are people really so ignorant of how this works that they're equating these concepts, or believing that the web UI is anything more than a razor thin veneer?

I guess maybe people use ChatGPT to refer to the interface, and GPT-N to refer to the models, but that's not very accurate given the amount of tuning, it's much more accurate to say that ChatGPT is a productised GPT instance, with a web UI.

It's just a hot marketing strategy, it has a totally different reception outside of HN. There are already people making 5k+ MRR with apps that are just a chatGPT wrapper that passes user input with some additional context and prompts.

I could easily see a wave of small startups that are just a few inputs and the context needed to generate documents people currently write by hand. Like subpoenas, doctors letters to insurance companies, etc. You can stand one up with a bit of industry knowledge and a couple 100 LOC.

I expect this, too. Scammers are gonna scam.
> I find it interesting that so many projects claim to be "run your own ChatGPT", when they're in fact "run your own web UI". Are people really so ignorant of how this works that they're equating these concepts, or believing that the web UI is anything more than a razor thin veneer?

Perhaps, but also there is a huge incentive to blur that line, obviously from the developers of these UIs, but also from the people at media outlets covering them. If they told the truth, it wouldn't be as big of a story. And I'm just waiting for the "7 year old makes their own GPT" story. For a long time now, the overwhelming majority of tech journalism has been just uncritically rephrasing press releases.

For it to be good, it should also have a specific system prompt and chat history, which is fed to the model. With langchain this isn’t too difficult to build, but it’s not just a web ui.

This one doesn’t appear to use a custom prompt, so I’m guessing it doesn’t perform as well as ChatGPT, but it does look like it passes message history.

SlickGPT passes message history including a "context" or "system" message which it clearly explains to the user at the start of every chat. This is probably the most important thing the official chat.openai.com client fails to explain or expose to users directly.
But you can do all that with the OpenAI Playground for the chat API, and it supports GPT-4. I don't really see what your service adds to that.
You can use the same model that ChatGPT uses through the API, and it isn't called 'ChatGPT' it's called 'GPT-4'. So at least officially ChatGPT refers to the webUI not the model.
I'm not sure that's true though. The first line of the ChatGPT blog post is:

> We’ve trained a model called ChatGPT which interacts in a conversational way

It really seems that GPT-3/3.5/4/etc are the generic models, and that ChatGPT is the fine tuning, a safety layer, and so on. This is also why ChatGPT and Bing don't provide the same or even remotely equivalent answers despite both running on GPT-4.

As far as I know the current chatGPT running on the chat.openai website is specifically gpt3.5-turbo .
Its like when everything became an 'app' all of a sudden.
ChatGPT Plus is like $10/mo but bring your own interface and its fractions of a penny per API call. So for most, this will be cheaper.
In this case it is.

Lot of others posted are other models that people could use.

100% agreed! I don't feel like sharing my API key either! Too bad, I wanted to see if it can understand Simplified Chinese.
OpenAI’s API key page lets you issue new keys, see when they were last used, and withdraw them at any time.

So this seems a bit paranoid.

Stripe's dashboard lets you do the same thing but like hell I'm giving you my secret key.
This is a standard way to grant API access in literally every piece of software that's provided an API access I've ever used in the last 5-10 years. I'm not sure what informs such paranoia.
True, but it is still weird to paste your credentials into an unknown service.
Yes of course, it certainly is. So before you do that, you should make the service not be unknown to you.

Good thing this is open source!

I’m not sure if there is any way to tell if an open source service is actually using the open source code. It still comes down to trusting the url.