LoRA: Low Rank Adaptation
Introduction Whenever we need to use a deep learning model for image or text generation, classification or any other task, we have two possibilities: Train the model from scratch Use a pre-trained model and fine tune it for the task we need. Training a model from scratch can be challenging and requires computational resources, time, and sometimes large quantity of data. On the other hand, using a pre-trained model is easier but might require some adaptation to the new task. ...