[amiantos]

I agree with the other commenters, this post does not explain why you would not just run Ollama or Koboldcpp on Windows. What exactly makes running Ollama within virtualized NixOS in WSL in some way better than running natively?

If it's just the novelty aspect of it or some idealogical reason, that's fine, but it should be explained in the blog post before someone thinks this is a sane and logical way to run Ollama on a gaming PC.

[neuroelectron]

Reproducability and security. You're getting the managed security of a Windows install plus your isolating it from Windows telementry.

[benterix]

> your isolating it from Windows telementry

1. Maybe, 2. For now

[neuroelectron]

Yes that's true but that's how it always is.

[throwawayqqq11]

Not if you can migrate to linux on a whim.

[csdreamer7]

^This. People act so helpless to big tech, and especially Windows. Linux is still more effort for normies, but it should not be an issue for most people on this sub to want learn it-you are doing things already on Windows that would not be much different than Linux. AI w/ Nividia alone justifies Linux because Windows has performance issues. Then you have the freedom of leaving Windows if it continues to get hostile.

[rad_gruchalski]

Unless you're working for a company where you have no choice. Then you have no freedom to leave Windows. You have, obviously, the freedom to leave your job, but let's be adult.

[neuroelectron]

Brave to assume linux is more secure than Windows. I didn't read the rest of your comment.