Budget
Also written: character budget
The most source text, counted in characters, that a prompt may hold. `format_sources` stops adding chunks before the total passes it, so one huge chunk can't make every question slow and costly.
Also written: character budget
The most source text, counted in characters, that a prompt may hold. `format_sources` stops adding chunks before the total passes it, so one huge chunk can't make every question slow and costly.