How to use detakarang/delphi-adapter with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("microsoft/phi-2") model = PeftModel.from_pretrained(base_model, "detakarang/delphi-adapter")
https://huggingface.co/detakarang/delphi-adapter/resolve/main/training_eval_loss.png
hf download hf://detakarang/delphi-adapter/training_eval_loss.png
curl -L -o training_eval_loss.png https://huggingface.co/detakarang/delphi-adapter/resolve/main/training_eval_loss.png
