Timeout
Also written: first_token_timeout, timeouts
A limit after which a call is abandoned. complete() has one for the first token (10 s) and one for the whole reply (30 s), and a timeout becomes ModelError 408.
Also written: first_token_timeout, timeouts
A limit after which a call is abandoned. complete() has one for the first token (10 s) and one for the whole reply (30 s), and a timeout becomes ModelError 408.