[dilyevsky]

Depends on what you ask, i suppose. I’m sure i can come up with something that can’t simply be one shot or the result would be bad if you do. A bit more difficult on logistics tho as you’d have to arrange for an environment with some prepaid llm access

[HenriTEL]

Without a way to estimate "AI power" used for the task I don't see how you can fairly rate home assignments.

[dilyevsky]

Like i said either use pre-baked env or give a candidate an auth token with something like $100-200 quota from the provider your company already uses