Shourya Shashank

What's Changed​

• updated pypdf by @shouryashashank in https://github.com/Predacons/predacons/pull/48

Full Changelog: https://github.com/Predacons/predacons/compare/v0.0.128...v0.0.129

• New Features

  • Introduced streaming capabilities for text and chat generation, allowing real-time output.
  • Added new functions: text_stream and chat_stream for enhanced streaming functionality.

• Bug Fixes

• New Features

  • Introduced streaming capabilities for text and chat generation, allowing real-time output.
  • Added new functions: text_stream and chat_stream for enhanced streaming functionality.

• Bug Fixes

New Features​

• Incremented version number of the predacons package to 0.0.126.
• Introduced the PredaconsEmbedding class for generating sentence embeddings using a pre-trained transformer model.
• Bug Fixes

Introduced a new keyword argument dont_print_output in the chat generation function for improved output management. Version Updates

• Added auto quantize for generation models reducing the max memory requirement by 4 folds

example​

# load model with auto_quantize
model = predacons.load_model(model_name,auto_quantize="4bit")

• added support for gguf model files

model = predacons.load_model(model_path=model_id, gguf_file=gguf_file)
tokenizer = predacons.load_tokenizer(model_id, gguf_file=gguf_file)

Added​

• Introduced a new chat generation feature.
  • Added predacons.chat_generate method to generate chat responses using trained models.
  • Example usage:

Added​

• Introduced a new chat generation feature.
  • Added predacons.chat_generate method to generate chat responses using trained models.
  • Example usage:

What's Changed​

• Create LICENSE-COMMERCIAL-PERPETUAL by @shouryashashank in https://github.com/Predacons/predacons/pull/29
• added read csv by @shouryashashank in https://github.com/Predacons/predacons/pull/23
• Feature/add csv support by @shouryashashank in https://github.com/Predacons/predacons/pull/30

New features​