You are right the PEFT model is what we are training and before we infer, we are merging the PEFT with the base model. We will need the collective weights and biases for inference.