Popular repositories Loading

1. llm-toolcall-proxy llm-toolcall-proxy Public

   Forked from ziozzang/llm-toolcall-proxy

   General Tool-calling API Proxy

   Python 4

2. llama-save-wrapper llama-save-wrapper Public

   A thin python wrapper over llama-server that serializes and deserializes slots on start and exit.

   Python 1

3. worker-vllm worker-vllm Public

   Forked from runpod-workers/worker-vllm

   The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

   Python

4. llama-runpod llama-runpod Public

   Forked from louisabraham/llama-runpod

   Run llama.cpp on RunPod

   Dockerfile

5. text-generation-webui text-generation-webui Public

   Forked from oobabooga/textgen

   A Gradio web UI for Large Language Models.

   Python

6. PicoMLXServer PicoMLXServer Public

   Forked from PicoMLX/PicoMLXServer

   The easiest way to run the fastest MLX-based LLMs locally

   Swift