Skip to content

v0.1.0 release: Multi Task Fintuning Framework for Multiple base modles

Choose a tag to compare

View all tags
@chencyudel chencyudel released this 27 Dec 08:20
· 78 commits to main since this release
v0.1.0
7946e4f
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
  1. We released MFTCoder which supports finetuning Code Llama, Llama, Llama2, StarCoder, ChatGLM2, CodeGeeX2, Qwen, and GPT-NeoX models with LoRA/QLoRA.
  2. mft_peft_hf is based on the HuggingFace Accelerate and deepspeed framework.
    mft_atorch is based on the ATorch frameworks, which is a fast distributed training framework of LLM.
Assets 2
Loading