Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I've seen this mistake first hand.

"API server not fast enough, how do we fix it?"

"More threads! More connections!"

The problem, of course, is that HTTP2 is behaves like having infinite connections, so the "more threads" on the server are almost always detrimental to performance.

Less is more is the mantra I have unsuccessfully tried to drill. If your API (assuming a basic rest like service) is running at 100% cpu utilization, you've likely over provisioned it.



If the api server is blocked on IO, more threads is a possibly fine solution.


Possibly, just depends on what you are doing and where you are going from/to.

For example, 200 threads with 200 connections to a single service is insane and likely causing you to be slow already. Increasing that will negatively impact performance.

Going from 16 -> 32? That's more reasonable.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: