Pinned Loading

1. llm-pool llm-pool Public

   FastAPI LLM pool for local and OpenAI-compatible remote inference, with multimodal input, scheduling, replicas, metrics, and admin APIs.

   Python

2. omni-translate-app omni-translate-app Public

   Self-hosted translation app for text, live voice, images, and PDFs, with desktop and mobile web interfaces backed by dedicated ASR, LLM, TTS, and document services.

   Python

3. tts-pool tts-pool Public

   FastAPI TTS pool with Kokoro, VoxCPM2, and NanoVLLM-VoxCPM backends, a common synthesis API, queue scheduling, runtime model management, metrics, and GPU memory inspection.

   Python

4. image-pool image-pool Public

   FastAPI image generation/editing pool with Diffusers backends, queue scheduling, runtime model management, metrics, and GPU memory inspection.

   Python

5. llm-workbench llm-workbench Public

   Browser shell for local AI service consoles and workflow playgrounds, with LLM/TTS/Image pool management, image training, translation services, and replay tools.

   JavaScript

6. asr-pool asr-pool Public

   FastAPI ASR pool with SSE completions, warm WhisperX runner slots, queue scheduling, pending-status updates, and artifact endpoints.

   Python