ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models

This repository contains code to reproduce the experiments in the paper: ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models. For reproducing the accuracy figures, please go to llm-interpret. For reproducing the performance figures, please go to Dejavu.

Citation

If you find our work useful, please consider citing using the following: pending