Sep 15, 2023
You are right the PEFT model is what we are training and before we infer, we are merging the PEFT with the base model. We will need the collective weights and biases for inference.
You are right the PEFT model is what we are training and before we infer, we are merging the PEFT with the base model. We will need the collective weights and biases for inference.
IBM Fellow, Master Inventor, Mobile, RPi & Cloud Architect & Full-Stack Programmer