Repository navigation
Document sub-minute H200 startup from a network volume - #69
Merged
Merged
Conversation
5 tasks done
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fresh H200 replica startup previously spent time re-extracting the Python environment and contending over network prefetch. Document the released deployment that reuses a verified runtime and snapshot on the network volume, uses 16 prefetch workers and sufficient CPU capacity, and returns the first external token in 52.14/52.94 seconds including test-only cache advice. An ordinary fresh pod with warm host cache completed in 32.93 seconds.
Include the local-build/verified-copy lifecycle, per-stage timing, failed attempts, cache/resource boundaries and the unresolved numerical canary and publication-recovery limitations. This changes documentation only; the measured binaries are warmctl v2.0.0-beta.17 and DMTCP v5.0.0-warmctl.1.
Validation: raw per-pod logs and monotonic-clock results checked; three final replicas passed weight fingerprints, streaming, tool calls and 32 concurrent requests each; cleanup verified through Runpod API; git diff --check.
Closes #68