Abilities
Introduction to Framework Capabilities
Multi-Models Supported
Support multiply LLMs, such as chatglm, vicuna, Qwen, and proxy of chatgpt and bard.
Real-Time Search
Support to obtain the latest data and news information from the website
Multiply Scenes
Support multiply scenes, generate images, videos and chapters.
Knowledge Based QA
support summary for multiply datasource, such as pdf, word, RDBMS, NoSQL, excel..etc.
Multi-Model Management
Support for managing multiple models, model registration, model deletion, model monitoring, and inference load balancing.
Framework
Introduction to Framework