Hacker News new | ask | show | jobs
by alexjurkiewicz 23 days ago
AI training uses wildly more compute than most companies, who are generally building domain specific CRUD apps.

Compare AI costs per-engineer-salary-dollar, because more expensive engineers probably need more expensive AI.

1 comments

> Compare AI costs per-engineer-salary-dollar, because more expensive engineers probably need more expensive AI.

Let's see how this works out in the long run. For a historical analog, more expensive engineers don't use more expensive computers (by and large).

Which is probably a backwards anti-pattern companies have built.

Your most expensive engineer's time is most valuable, so if you give them standard issue which is half the speed, you are throttling the value you can get from your engineer. Not to mention the mental drain of your cursor barely being able to move due to all the bloated virtual networking systemization.

It would seem to make sense to give more valuable employees faster equipment, so that their time isn't spent toiling with the slow machine, but rather actually producing value.

Eh, computers are so (comparatively) cheap, that you can give all your employees top-of-the-line equipment by that logic.

(Well, for this to make sense, you need good computers to be cheap, but the returns to diminish quickly after that. Which used to be the case until fairly recently: single core performance was pretty much capped, and after your whole compile is parallelised adding more cores to a machine didn't really help your best engineer either. Similarly for RAM.)

Meh - our dev machines are over-provisioned cloud pc's from MS, that run as fast a laptop from 2005. And I'm sure they are paying a premium for the privledge.

My 10 year old desktop sitting next to me is a lot faster, but alas, I can't BYOD.

> more expensive engineers don't use more expensive computers

They don't? If you give your best engineers substandard hardware to work on, you're going to get worse output from them compared to if you give them more expensive computers to work with.

> you're going to get worse output from them

Not completely true. Giving developers hardware that is too beefy is the main reason why so much software breaks down when run on users' machines, which are generally old, on spotty Internet connections, and RAM-starved. Devs just don't need to think about performance unless it's really asymptotically bad, while the users bear the full brunt of inefficiencies.

I agree, but good computers are so comparatively cheap and engineers so expensive that this logic applies to (nearly?) every one of your engineers, not just the most expensive ones.