논문해외
SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding
HF Daily Papers
Speculative decoding accelerates memory-bound LLM decoding with a lightweight drafter, and parallel drafters extend this speedup by drafting a whole block in one forward pass.
원문의 저작권은 HF Daily Papers에 있습니다. 위 발췌는 원문 확인을 돕기 위한 짧은 인용입니다.