Skip to content

docs: publication figures plan for sim-to-real evaluation - #36

Merged
sriumcp merged 1 commit into
inference-sim:mainfrom
susiejojo:docs/publication-figures-plan
Mar 17, 2026
Merged

sriumcp merged 1 commit into
inference-sim:mainfrom
susiejojo:docs/publication-figures-plan

Conversation

@susiejojo

Copy link
Copy Markdown
Contributor

Summary

  • Executive summary of the 5 figures + 1 table planned for the paper's sim-to-real accuracy evaluation section
  • Each figure includes: what it shows, why it matters for reviewers, and a draft caption
  • Paper narrative arc: Figs 1–4 systematically address generalization concerns, Fig 5 delivers the accuracy-speed punchline, Table 1 quantifies speedup for the abstract

Figures overview

Figure Question it answers
Fig 1 — Model Sensitivity "Does it work across different models?"
Fig 2 — Hardware Portability "Does it transfer to new hardware without re-profiling?"
Fig 3 — Workload Sensitivity "Does it handle diverse real-world workloads?"
Fig 4 — Config Generalization "Can I trust it when tuning serving configs?"
Fig 5 — Accuracy-Speed Pareto "Is there a catch — is it slow?"
Table 1 — Runtime Comparison "How much faster, exactly?"

Context

🤖 Generated with Claude Code

Executive summary of 5 figures + 1 table planned for the BLIS
paper's sim-to-real accuracy evaluation section. Covers model
sensitivity, hardware portability, workload sensitivity, config
generalization, and the accuracy-speed Pareto frontier.

Data: 55 experiments across 8 models, 3 GPUs, 4 workloads, 5 config
knobs. Collection tracked in inference-sim/inference-sim#598.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@sriumcp
sriumcp merged commit 1c42442 into inference-sim:main Mar 17, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants