Glossary: LLMs in Production
Also written: per-IP limits
The proxy in front of your service, where per-IP limits can be applied to anonymous visitors.
Rate limitnginx