Skip to content

Glossary: AI System Design

Utilization

The share of capacity actually used. A rented GPU costs the same idle or busy, so low utilization makes self-hosting expensive.

Where the book teaches it

Related terms

Break-evenN+1