1704 and 1804 RAWrr Yi-34B-200K-xlctx loras came out bad, which I realized now. I had HDD drive failure and it was the one holding up Linux that training was happening on. Probably that's why.
Nah, it was transformers or peft python update that broke my merging process. I downgraded and it works. 1704/1804/3004 loras are fine, I think 1804 is the best one.
3004 is a re-train with 1804 config - higher lr than 1704.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support