Skip to content
@pegainfer-project

pegainfer-project

Popular repositories Loading

  1. pegainfer pegainfer Public

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Rust 730 121

  2. kern kern Public

    A model-agnostic GPU runtime for shipping models as verified programs.

    Rust 146 10

  3. pega-omni pega-omni Public

    OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one GPU.

    Rust 50 3

  4. kern-k3-pp-prefill kern-k3-pp-prefill Public

    Kimi-K3 prefill as pipeline-parallel stages for kern: manifests, kernel sources, build recipes

    Cuda 6 1

  5. website website Public

    Documentation website for openinfer — Astro Starlight on Cloudflare Workers

    MDX 4 1

  6. pegastore pegastore Public

    Placement-aware immutable large-object cache for AI workloads: multi-slot values across GPU / DRAM / SSD, shared across nodes.

    Rust 4

Repositories

Showing 9 of 9 repositories
  • pegainfer Public

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    pegainfer-project/pegainfer's past year of commit activity
    Rust 730 Apache-2.0 121 42 (7 issues need help) 24 Updated Oct 31, 2026
  • kern Public

    A model-agnostic GPU runtime for shipping models as verified programs.

    pegainfer-project/kern's past year of commit activity
    Rust 146 Apache-2.0 10 13 8 Updated Oct 30, 2026
  • kern-k3-pp-prefill Public

    Kimi-K3 prefill as pipeline-parallel stages for kern: manifests, kernel sources, build recipes

    pegainfer-project/kern-k3-pp-prefill's past year of commit activity
    Cuda 6 1 0 2 Updated Oct 29, 2026
  • infront Public

    Implement one Scheduler, get an OpenAI-compatible inference server (vLLM Rust frontend)

    pegainfer-project/infront's past year of commit activity
    Rust 1 Apache-2.0 0 1 0 Updated Oct 28, 2026
  • kern-dsv41-flash Public

    DeepSeek V4.1 Flash kernels for kern: sources, pinned upstreams, a reproducible build

    pegainfer-project/kern-dsv41-flash's past year of commit activity
    Python 1 Apache-2.0 0 0 0 Updated Oct 27, 2026
  • pega-omni Public

    OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one GPU.

    pegainfer-project/pega-omni's past year of commit activity
    Rust 50 3 3 3 Updated Sep 30, 2026
  • website Public

    Documentation website for openinfer — Astro Starlight on Cloudflare Workers

    pegainfer-project/website's past year of commit activity
    MDX 4 1 2 0 Updated Sep 23, 2026
  • pegastore Public

    Placement-aware immutable large-object cache for AI workloads: multi-slot values across GPU / DRAM / SSD, shared across nodes.

    pegainfer-project/pegastore's past year of commit activity
    Rust 4 Apache-2.0 0 0 0 Updated Aug 31, 2026
  • DeepGEMM Public Forked from deepseek-ai/DeepGEMM

    DeepGEMM: clean and efficient BLAS kernel library on GPU

    pegainfer-project/DeepGEMM's past year of commit activity
    Cuda 0 MIT 1,508 0 0 Updated Aug 13, 2026

People

This organization has no public members. You must be a member to see who’s a part of this organization.