inference-sim

Popular repositories Loading

1. inference-sim inference-sim Public

   Inference Platform Simulation

   Go 59 39

2. sdlc-plugins sdlc-plugins Public

   Plugins to accelerate the SDLC work for the ai-platform-opt team

   Shell 2 1

3. vllm-data-collection vllm-data-collection Public

   Benchmark different parameter sweeps from vllm

   Python 1

4. sim-to-real-accuracy-validation sim-to-real-accuracy-validation Public

   Validation of accuracy across multiple simulators and BLIS modes

   Python 1

5. blis blis Public

   BLIS: Blackbox Inference Simulator

   Python 1

6. config-recommender config-recommender Public

   Configuration exploration and recommendation for inference

   Python 2