ThreadPoolExecutor

Also written: threads

A Python tool that runs several tasks at once in threads. It is useful for making many model API calls in parallel, such as eight at a time, which speeds up a batch several times.