AIbase
Product LibraryTool Navigation

ngram-decoding

Public

(Re)-implementation of "Prompt Lookup Decoding" by Apoorv Saxena, with extended ideas from LLMA Decoding.

Creat2024-08-19T20:57:20
Update2024-08-23T14:47:31
https://www.jensenlwt.com/blog/understanding-speculative-decoding-for-llm-inference
0
Stars
0
Stars Increase