[getwiththeprog]

This is a great idea. I want to make a 'pet' for my kid. I can't get them a real dog, so why not a tinyLLM?

Training on guttenberg data is a great idea. What I would do is train it on all the e-books I have that are suitable for kids (I managed to find quite a lot online).

The dad jokes idea is great, please keep doing things along this line.

[disconnection]

Cheers! Yes, I recommend it - it's a lot of fun.

There are probably easier to install and better LLM models than mine for home use. But my project should work if you have enough Python knowledge to install all the libraries. Just throw a bunch of text files into the "data" folder and uncomment "train()" in main.py, and it will save checkpoints of the model parameters into the "models" folder.