Y
Hacker News
new
|
ask
|
show
|
jobs
by
skrblr
1173 days ago
It's in the name of the model - "Vicuna-13B" implies there are 13 billion parameters.
1 comments
MuffinFlavored
1172 days ago
the way these LLMs work, there is a weight for each parameter? 13 billion weights? what is an example of a parameter?
link
dragonwriter
1172 days ago
A parameter is a variable for which a weight (a floating point value) is the concrete value.
link
kragen
1172 days ago
a weight is an example of a parameter
so is a bias, and presumably the biases are also in the same file with the weights
link