Tag: LLM Efficiency

Stanford and Berkeley shrink the first pass over long prompts

TokenGate learns which tokens matter and drops the rest before attention runs in full.