Skip to content
@EmbeddedLLM

EmbeddedLLM

We are committed to making production-grade AI inference as accessible and reliable as electricity, powered by vLLM.

Pinned Loading

  1. JamAIBase JamAIBase Public

    The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate…

    Python 1.1k 47

  2. vllm vllm Public

    Forked from vllm-project/vllm

    vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 94 7

  3. embeddedllm embeddedllm Public

    EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

    Python 54 5

Repositories

Showing 10 of 85 repositories
  • vllm Public Forked from vllm-project/vllm

    vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

    EmbeddedLLM/vllm's past year of commit activity
    Python 94 Apache-2.0 22,549 1 10 Updated Sep 17, 2026
  • TokenVisor-recipes Public

    Inference recipes

    EmbeddedLLM/TokenVisor-recipes's past year of commit activity
    Python 0 0 0 0 Updated Sep 17, 2026
  • agentic-api Public Forked from vllm-project/agentic-api

    Stateful API logic for agentic applications using vLLM

    EmbeddedLLM/agentic-api's past year of commit activity
    Rust 1 Apache-2.0 73 0 0 Updated Sep 17, 2026
  • litellm Public Forked from BerriAI/litellm

    Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

    EmbeddedLLM/litellm's past year of commit activity
    Python 0 11,686 0 0 Updated Sep 17, 2026
  • wasm-tools Public Forked from bytecodealliance/wasm-tools

    CLI and Rust libraries for low-level manipulation of WebAssembly modules

    EmbeddedLLM/wasm-tools's past year of commit activity
    Rust 0 Apache-2.0 369 0 0 Updated Sep 15, 2026
  • eryx Public Forked from eryx-org/eryx

    A Python sandbox using Wasmtime

    EmbeddedLLM/eryx's past year of commit activity
    Rust 0 Apache-2.0 12 0 0 Updated Sep 15, 2026
  • mori Public Forked from ROCm/mori

    Modular RDMA Interface

    EmbeddedLLM/mori's past year of commit activity
    C++ 0 MIT 94 0 0 Updated Sep 14, 2026
  • TokenVisor-charts Public
    EmbeddedLLM/TokenVisor-charts's past year of commit activity
    Shell 0 0 0 0 Updated Sep 8, 2026
  • JamAIBase Public

    The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

    EmbeddedLLM/JamAIBase's past year of commit activity
    Python 1,103 Apache-2.0 47 1 1 Updated Sep 3, 2026
  • llm-d-router Public Forked from llm-d/llm-d-router

    llm-d Router: The intelligent entry point for inference requests

    EmbeddedLLM/llm-d-router's past year of commit activity
    Go 0 Apache-2.0 377 0 0 Updated Sep 1, 2026
View all repositories

Most used topics

llm llm-inference