Stars
Fast LLM inference with 2.8x speedup using speculative decoding
An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/pdf/2106.04718.pdf
{{ message }}
Fast LLM inference with 2.8x speedup using speculative decoding
An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/pdf/2106.04718.pdf