Glossary: LLMs in Production
How many requests a service completes per second. Used with the number of allowed requests to work out the worst wait.
GateLoad test