cunliangkong/LlamaFactory
1
0
Fork 0
mirror of https://github.com/hiyouga/LlamaFactory.git synced 2026-03-23 02:16:02 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
9b97b23ce77cbcc4046952c0091aad6197d420c9
LlamaFactory/examples/merge_lora
History
hiyouga 056d2d956a support vllm 
Former-commit-id: 889f6e910e654d8ec3922c2185042d737ffbf1c3
2024-03-07 20:26:31 +08:00
..
merge.sh
support vllm
2024-03-07 20:26:31 +08:00
quantize.sh
support vllm
2024-03-07 20:26:31 +08:00
README.md
support vllm
2024-03-07 20:26:31 +08:00

README.md

Usage:

  • merge.sh: merge the lora weights
  • quantize.sh: quantize the model with AutoGPTQ (must after merge.sh, optional)
Reference in New Issue View Git Blame Copy Permalink