v0.0.117
· One min read
What's Changed
- Update requirements.txt and setup.py, add new functions by @shouryashashank in https://github.com/Predacons/predacons/pull/20
- Update setup.py by @shouryashashank in https://github.com/Predacons/predacons/pull/21
- moved to SFTTrainer
-
added auto tokenizer
-
added auto peft config using laura
-
With this pr we can now train bigger model with very less memory
-
tested training gemma with 4gb vram
Full Changelog: https://github.com/Predacons/predacons/compare/v0.0.116...v0.0.117
Github Release Page: https://github.com/Predacons/predacons/releases/tag/v0.0.117