Hacker News new | ask | show | jobs
by paxys 1203 days ago
The performance metric is meaningless. As you yourself acknowledge, this is way too dependent on underlying business logic to be able to compare objectively. A 100ms API response may as well be "slower" than a 500ms one depending on what the calls are actually achieving.

Say service A has an API:

- GET /users/<id> - 100ms

Service B has multiple APIs:

- GET /users/<id> - 100ms

- GET /users - 250ms

- GET / - 500ms

Which service is faster according to your algorithms?

I'm also a bit skeptical of your other metrics. "P J S Paul Ministries API" is 5/5 in popularity while Adyen is 3/5?

1 comments

This is an experimental research we did mostly because we thought it was cool and new.

There are limitations indeed, though if you compare similar APIs with similar business intent, their structure should also have similarity, unlike your example.

For the popularity metrics, I will take a look - I admit we can do better :)

What's the methodology? It's an interesting metric as long as there is some rationale attached.