I'm testing Stellar for a project where we want to be able to get ~4000 operations per second. Multiple sources ( including this question's answer: Scalability on Stellar network ) indicate that I should be able to achieve this on a private Stellar network, yet when I try to run tests with 100 ops/tx and 200 txs/ledger, I end up with lots of errors and failed transactions instead of the ahem stellar results I was hoping for.
Has anyone actually gotten this many ops/s to work? Do you have any tips?
I'm working on Linux, and the load testing program I'm using came from here: https://github.com/kinecosystem/stellar-load-testing
Using that program, I can get 100ops/tx to work if my number of accounts is low, but I end up with very low txs/s. I can get 40 txs/s, but only with a low number of ops/tx.
The errors I'm getting most often are:
"http post failed: Post http://localhost:8000/transactions: net/http: request canceled (Client.Timeout exceeded while awaiting headers)" -- I assume this is probably a timeout somewhere in my system, rather than a problem with Stellar, but I'm still trying to track down where it's coming from.
"Horizon error: \"Internal Server Error\". Check horizon.Error.Problem for more information.", followed by "failed to extract result codes from horizon response"
And just for the record: I'm still a bit green as an engineer, so don't hesitate to suggest if you think I missed something really basic!
UPDATE: I did end up finding a timeout that was set within the load test I was running, and got some better results. Will update more when I've done some further testing.