Continuous batching

Also written: static batching

Re-forming the batch at every decode step so a finished request is replaced at once by a waiting one. Static batching instead runs a group until all of its requests finish, leaving slots idle.