Glossary: Fine-tuning LLMs

Leakage

Also written: leak, leaks

Information from the test set reaching training or decisions, which inflates scores. Near-duplicates across train and test are one cause.