Target modules
Also written: target_modules, all-linear
The layers of a model that get LoRA adapters. `"all-linear"` adapts every linear layer and usually learns better than adapting only the query and value projections.
Where the book teaches it
Related terms
LoRA (low-rank adaptation)Attention projections (q_proj, k_proj, v_proj, o_proj)