Hacker News new | ask | show | jobs
by sveinek 771 days ago
How did you get CrewAI working with Llama3? I have got it working by adding "num_predict=128" to the model ChatOllama(), but it's so slow! Any tricks or tips?
1 comments

hey! I've started a repository here: https://github.com/neural-maze/crewai_llama3_arduino

I'll be refactoring it during this week and then I'll create an article in my blog and a video in my Youtube channel talking about it, in case you are interested :)

https://www.youtube.com/channel/UCaixkLsW_TWWe_0yZNmvPaw

https://neural-maze.github.io/blog/

Thank you for sharing, absolutely interested!