lora_dropout
Also written: dropout
A setting that randomly zeroes a fraction (5% here) of the adapter's inputs during training, a little protection against overfitting. `model.eval()` turns it off for generation.
Also written: dropout
A setting that randomly zeroes a fraction (5% here) of the adapter's inputs during training, a little protection against overfitting. `model.eval()` turns it off for generation.