Hacker News new | ask | show | jobs
by arisAlexis 2 hours ago
I did consider it at one point the problem is that the prompt and instruction following for formating and extracting tags, nouns etc and the json returns are unreliable if you switch models and especially if it's an older model. right now i'm using Gemma 4 and works smoothly so it would need to be BYOK for gemma only which is doable. If more people ask I could do it sure.
1 comments

I would not use a personal journaling app that didn't give me that type of control, so here's one more asking :)
the best would be on device inference only but we need maybe 6 months for a small model to match capabilities yet. I wanted to do it like that but even my pixel 10 suffered.