Hacker News new | ask | show | jobs
by kristianp 101 days ago
> Instruct models are already so tuned that they could not be tuned

Some models have the base model available, that is before instruction tuning. For example llama 3 comes in "pre-trained and instruction tuned variants" [1]. I'm guessing you already know that though.

[1] https://huggingface.co/meta-llama/Meta-Llama-3-8B

1 comments

Llama-3-8B is a coprolite at this point.