A B Vijay Kumar
Sep 15, 2023

You are right the PEFT model is what we are training and before we infer, we are merging the PEFT with the base model. We will need the collective weights and biases for inference.

A B Vijay Kumar

IBM Fellow, Master Inventor, Mobile, RPi & Cloud Architect & Full-Stack Programmer