[ozim]

If someone is smart enough to go away with it is enough that I know but it doesn’t bother me much- I don’t mind.

Had an interview take home assignment done by GPT and it was easy to spot after seeing dozens of solutions. Downside for the guy was - it didn’t work.

[godelski]

You probably should because this is a person demonstrating that they can and will hack metrics rather than consider what you're proxying.

[ozim]

In my current setting it doesn’t work like that.

We have a small team of developers and you cannot hack metrics. You build and deliver what is in requirements or not.

If you don’t deliver we don’t even have to have a discussion because team reviews code, tests features and gives feedback quickly if someone is slacking.

[godelski]

All metrics can be hacked.

[ozim]

Not going to write too much but I think this is best reply:

https://xkcd.com/810/

[godelski]

Well you did say that your metrics "cannot be hacked."

The XKCD one can actually be easily hacked. Just spam the system and rate every comment as helpful. Classifier learns to accept everything. There's dozens of way to hack this one and undermine the actual goal. But it is a comic, and it is funny. Doesn't need to be realistic.