Hacker News new | ask | show | jobs
by mark_l_watson 12 days ago
I was blown away by how effective their latest model drop that works with their own coding harness pool is. I tested it extensively with Haskell, Python, and TypeScript for small coding projects. The functionality is good but the inference speed is too slow for most of my work: I would set up a problem, take a walk, then return later to evaluate the results. Note that I have an old mac mini with 32B memory; a fast modern home system would be much better.

EDIT: their business model is interesting, aiming for supporting organizations with privacy and security concerns.

1 comments

Yeah, they’re focused on selling to government and defense contractors. I first encountered poolside at my aerospace internship.
That is a nice business niche, but I would hope that companies might also care about security. There are just a few inference providers who I trust to not save data outside the scope of maintaining inference cache, but I do use untrusted providers sine everything I work on is open source or open content.