Skip to main content

v0.0.123

· One min read
Shourya Shashank
Shourya Shashank
Maintainer of Predacons
  • added support for gguf model files
model = predacons.load_model(model_path=model_id, gguf_file=gguf_file)
tokenizer = predacons.load_tokenizer(model_id, gguf_file=gguf_file)
<!-- truncate -->
chat = [
    {"role": "system", "content": "you are a travel planner who plans trips for people. and list down the places to visit at that place"},
    {"role": "user", "content": "I want to plan a trip to new delhi. Can you help me with that?"},
]
predacons.chat_generate(model = model,
        sequence = chat,
        max_length = 200,
        tokenizer = tokenizer,
        trust_remote_code = True,
        do_sample=True,
        )

What's Changed​

Full Changelog: https://github.com/Predacons/predacons/compare/v0.0.122...v0.0.123

Github Release Page: https://github.com/Predacons/predacons/releases/tag/v0.0.123