Skip to content

Glossary: Fine-tuning LLMs

Near-duplicates

Also written: near-duplicate

Examples that differ by only a word or two. They make the model over-learn those phrasings, and if one copy lands in the test set the score is inflated.

Where the book teaches it

Related terms

Jaccard similarityLeakage