Merging (an adapter)
Also written: merge, merged model, merge_and_unload
Adding the LoRA update into the base weights (W becomes W + (alpha/r)BA) to make an ordinary standalone model. Merge into a 16-bit base, not a 4-bit QLoRA one.
Also written: merge, merged model, merge_and_unload
Adding the LoRA update into the base weights (W becomes W + (alpha/r)BA) to make an ordinary standalone model. Merge into a 16-bit base, not a 4-bit QLoRA one.