Pinned Loading

1. economize economize Public

   Composable efficiency techniques (speculative decoding, early exit, quantization, sparsity, KV compression) for Hugging Face models

   Python 2

2. GateSkip GateSkip Public

   Official Code Implementation for the Paper "What Layers When: Learning to Skip Compute in LLMs with Residual Gates"

   Python 6 2