Issues

• Points whose logs record no gpu_memory_utilization are priced at vLLM 0.32's default 0.92 though older-build servers defaulted to 0.9 (milestone 3)

  inference-sim/accuracy-dashboard#87 · Filter by author sriumcp opened on Nov 13, 2026

• Three test files run in no CI job: decide whether to run them (milestone 3)

  inference-sim/accuracy-dashboard#86 · Filter by author sriumcp opened on Nov 13, 2026

• Make the pull-request CI precise about which checks run, and faster (milestone 3)

  inference-sim/accuracy-dashboard#85 · Filter by author sriumcp opened on Nov 13, 2026

• Check the graded-point detail the substrate record does not model (acceptance, requests, kernel provenance, router) against a schema

  inference-sim/accuracy-dashboard#83 · Filter by author sriumcp opened on Nov 12, 2026

• Run the authorised held-out gates (admission split and Hopper dense MXFP8 ramp) and attach the verdicts

  inference-sim/accuracy-dashboard#82 · Filter by author sriumcp opened on Nov 12, 2026
  1

• Count the client's completion gap once: it is already the registry's host completion coefficient and is also named as a client difference on every single-turn point

  inference-sim/accuracy-dashboard#81 · Filter by author sriumcp opened on Nov 12, 2026

• Score the fixed-sequence speculative points whose server log has no acceptance lines, by stating what the client states (thinking mode) and naming the category as a fallback

  inference-sim/accuracy-dashboard#80 · Filter by author sriumcp opened on Nov 12, 2026

• Name the DeepSeek-V4-Pro points whose recorded indexer KV dtype the scored release does not accept, instead of sending them to the simulator to be refused

  inference-sim/accuracy-dashboard#79 · Filter by author sriumcp opened on Nov 12, 2026

• State the chat template for speculative fixed-sequence rows from the launcher script, and stop marking their prompt lengths as verified

  inference-sim/accuracy-dashboard#78 · Filter by author sriumcp opened on Nov 12, 2026

• Score the H200 points run on vLLM v0.33.0 at no higher than G4

  inference-sim/accuracy-dashboard#75 · Filter by author sriumcp opened on Nov 12, 2026

• Grade from version 2 reports and record undecided G1 conditions as unevaluated

  inference-sim/accuracy-dashboard#74 · Filter by author sriumcp opened on Nov 12, 2026

• Behavioural test cleanup

  inference-sim/accuracy-dashboard#73 · Filter by author sriumcp opened on Nov 11, 2026

• Apply the node-size rule for b200 and h200 so more points reach the simulator

  inference-sim/accuracy-dashboard#65 · Filter by author sriumcp opened on Nov 11, 2026
  1

• Agentic P/D with Dynamo kv routing (54 rows)

  inference-sim/accuracy-dashboard#64 · Filter by author sriumcp opened on Nov 11, 2026

• DeepSeek-V4-Pro NVFP4 value_conflict (23 points) and the gpt-oss removed environment variables (72 points)

  inference-sim/accuracy-dashboard#63 · Filter by author sriumcp opened on Nov 11, 2026

• Pass gpu_memory_utilization to the scenario

  inference-sim/accuracy-dashboard#62 · Filter by author sriumcp opened on Nov 11, 2026

• Write P/D scenarios, score throughput per GPU, and rank configurations

  inference-sim/accuracy-dashboard#61 · Filter by author sriumcp opened on Nov 11, 2026

• Read the run's realised acceptance length and the environment it launched with

  inference-sim/accuracy-dashboard#59 · Filter by author sriumcp opened on Nov 11, 2026

• Score on percentiles and report repeat noise (COV-10); check achieved concurrency

  inference-sim/accuracy-dashboard#58 · Filter by author sriumcp opened on Nov 11, 2026

• Single-turn points: name or read failed requests, client saturation and first-call cost

  inference-sim/accuracy-dashboard#57 · Filter by author sriumcp opened on Nov 11, 2026

• Agentic points drop the run's recorded idle-gap cap and warm-up

  inference-sim/accuracy-dashboard#56 · Filter by author sriumcp opened on Nov 11, 2026

• Evaluate the four G1 conditions from data and remove the unevaluated-condition substitutions (COV-4)

  inference-sim/accuracy-dashboard#53 · Filter by author sriumcp opened on Nov 9, 2026

• Read the field list, anchor units and metric definitions through blis fields, ledger and metrics in M2

  inference-sim/accuracy-dashboard#52 · Filter by author sriumcp opened on Nov 9, 2026

• Ideas from the InferenceX dashboard: charts, downloads, source links

  inference-sim/accuracy-dashboard#27 · Filter by author vishakha-ramani opened on Oct 22, 2026

• Design: make the dashboard readable for outside users

  inference-sim/accuracy-dashboard#23 · Filter by author vishakha-ramani opened on Oct 22, 2026
  1