|
|
|
|
|
by vfalbor
46 days ago
|
|
I have tried it and I use it. I think it's going to become the standard way of operating, especially when they start charging us an API fee, which is supposedly the real cost. But of course, with how much they charge for the token and depending on the model, there are so many factors that I think the future is heading towards local models. I believe there are good models out there, and the key is the concept of "pruning," where you select the layers that interest you most and try to reduce the hardware cost of these types of models. The Qwen and Gemma models have been discussed here, but Kimi, which is a fairly powerful model with an efficient pruning system, could be your perfect free co-pilot in terms of coding, and could coexist with the more powerful Opus or Gemini models. The key concept is skills that make this process transparent. |
|