Pinned Loading

1. llm-serving-platform llm-serving-platform Public

   Production-grade GPU LLM serving with vLLM, Kubernetes, full-stack observability, and cost/latency benchmarking.

   Python

2. ai-platform-infrastructure ai-platform-infrastructure Public

   AWS AI Cloud Infra — Terraform, EKS, OIDC-based CI/CD for deploying containerized apps.

   HCL

3. gpu-compute-management gpu-compute-management Public

   Hands-on single-GPU operations toolkit: hardware health, driver/CUDA audit, VRAM budgeting, KV cache, quantization, batching & troubleshooting playbook. Runs mostly on zero GPU cost via simulation …

   Python

4. llm-inference-platform llm-inference-platform Public

   Production-style LLM inference platform on AWS: Terraform, EKS, NVIDIA GPU Spot nodes, vLLM, FastAPI gateway, S3 + IRSA, EBS CSI, ECR and GitHub Actions CI/CD with cost-safety defaults.

   HCL