Chunked prefill

Splitting a long prompt's prefill into pieces mixed in between decode steps, so one huge document doesn't freeze everyone else's streaming.