Speculative decoding that changes no output
A speculative path was admitted by confidence, verified against the ordinary path and rejected whenever it could not preserve the exact result.
Topic
Speculative decoding
Testing faster decoding paths that must preserve the output of the verified path.
1 entry