Multi-Token Prediction (MTP) drafter for Gemma-4-31b
I’d like to request the adoption of Multi-Token Prediction (MTP drafter for Gemma-4-31b, which can boost its throughput up to 3x without any loss in performance. It would be a game changer for a variety of use cases.
Log in to comment and vote
No comments yet
Be the first to share your thoughts.