Hacker News new | ask | show | jobs
by FinNerd 829 days ago
In theory couldn’t you download the application but then it just makes API calls to OpenAI?

I am trying to use HuggingFace and suspect I will get similar answers to GPT-4. Can someone who knows how to download it ask for example which country Justin Trudeau is the president of?

5 comments

It is not an application, it's a model.

It claims to be llama-compatible, so you can reuse the same ecosystem, like ollama for inference.

It will not run random code on your behalf and call OpenAI API like you fear.

An AI model takes a specific input and gives a specific output. In the case of a language model, it takes in text and outputs text. They can not just execute arbitary code

When you download from huggingface, you are downloading the parameters of the model. The parameters are basically just a bunch of numbers, and they had to find the parameters by training the model

Since you haven't had a response to the second part, here it is:

PreviewJSON

Justin Trudeau is not the president of any country. He is, however, the Prime Minister of Canada, which he has been since November 4, 2015. The prime minister is the head of government in Canada's federal parliamentary democracy and constitutional monarchy.

I’m sorry, but you really need to read up on the fundamentals of what a model is, how weights work, and so on before making comments like this. No, the model weights are not secretly making calls to the OpenAI API.
I really like the fact that he is saying nonsense and his about is :”C-suite exec at fintech” I don’t doubt that hahaha
I don't think this is an appropriate comment on HN. He was asking a question. Not fully grasping a technical topic (that most people don't really understand), shouldn't be mocked.
Preview

Justin Trudeau is not the president of any country. He is, however, the Prime Minister of Canada, which he has been since November 4, 2015. The prime minister is the head of government in Canada's federal parliamentary democracy and constitutional monarchy.