draff e6c631aea4 Replace --load-in-4bit with --llama-bits ...

Replaces --load-in-4bit with a more flexible --llama-bits arg to allow for 2 and 3 bit models as well. This commit also fixes a loading issue with .pt files which are not in the root of the models folder

2023-03-10 21:36:45 +00:00

9.1 KiB

Raw Blame History

View Raw