Overlap
Also written: chunk overlap
Letting neighbouring fixed-size chunks share some characters so a sentence cut at one boundary survives in the next piece. It softens bad cuts but doesn't make pieces meaningful.
Also written: chunk overlap
Letting neighbouring fixed-size chunks share some characters so a sentence cut at one boundary survives in the next piece. It softens bad cuts but doesn't make pieces meaningful.