fastchat.serve.test_throughput

Benchmarking script to test the throughput of serving workers.