Token bucket

Also written: bucket

A rate limiter in which each user has a bucket holding a few request tokens that refills at a steady rate. It allows short bursts but caps the average, and these tokens are unrelated to the model's text tokens.