|
|
|
|
|
by macwhisperer
46 days ago
|
|
I code with like a slew of 20+ custom baked models of all sizes, in various fully custom multi-model harnesses that use different bindings... the harnesses themselves are just as important as the models...different harnesses give different responses with the same prompt, same model... if you have the 20/mnth claude sub or codex, you really should be using that to build a good local harness for yourself... claude won't be 20$ forever build the stack first! when you get that new comp with massive ram, youre already set, just run a larger model! big cloud models are incredibly good at building and teaching about local ai! have fun in the rabbit hole! if you are memory constrained like me, check out my custom models https://huggingface.co/macwhisperer |
|