|
|
|
|
|
|
by data_maan
1100 days ago
|
|
|
Awesome, thanks for letting me know! I'm still not sure though about some nitpicky things:
- do you change all the weights, or just the ones from the last layer when fine-tuning?
- do you just train on the _code_ field from the JSON file with the self-instruct data, or do you also use the other fields to train (or do you use the other fields just for downstream evaluation purposes)? I think it could be a major selling point of your paper if on Github (or in an appendix to your preprint, if you update it on arxiv), you had a section where you document the training process in detail |
|
|