Hacker News new | ask | show | jobs
by drowning_sushi 203 days ago
This is very subjective. Using Python influences your architecture in ways you would not encounter with other languages.

I maintain a critical service written in Python and hosted in AWS and with about 40 containers it can do 1K requests/sec with good reliability. But we see issues with http libraries and systemic pressure within the service.
3 comments
Nextgrid 203 days ago
1k requests/sec over 40 containers, meaning 25 RPS per container. Are you using synchronous threads by any chance (meaning if you're waiting on IO or a network call you are blocked yet your CPU is actually idle)? If so you might benefit from moving to gevent and handle that load with just a handful of containers.
link
nly 203 days ago
1K requests/sec doing what?

That's a really low rate in my world.

I write software handling a couple of million of messages per second on a single core on a single machine

link
tkfoss 203 days ago
We get 1K on a single small hetzner VPS, with Flask behind Nginx ¯\_(ツ)_/¯
link
Spivak 203 days ago
Yeah, 25 req/sec/process is abysmally slow. You can write slow in any language.

You don't end up seeing these kinds of complaints about Ruby backends and Ruby is the same order of magnitude in terms of speed.

link