XS Python Module
A Python module that generates inference endpoints for open-source LLMs.
A Python module that generates inference endpoints for open-source LLMs, with the help of NGrok.
xs makes you access
The XS module leverages Flask, Pyngrok, and Waitress to create a simple API endpoint for text generation using open-source LLMs.
🚀 Features
- 🌐 API Endpoint Creation: Easily generate an API endpoint for text generation.
- 🔀 Dynamic Port Allocation: Avoid conflicts with automatic port selection.
- 🚧 Ngrok Tunneling: Expose your local server to the internet securely.
- 🔄 Flush Tunnels: Clear previous Ngrok tunnels to prevent reaching the free tier’s tunnel limit.
📦 Installation
Install the XS module using the following command:
pip install 'git+https://github.com/xprabhudayal/xs.git'
📋 Tutorials and Usage
1. Watch Tutorials for Better Understanding
 Introduction |  Hindi Tutorial |  Use Case |