Skip to main content

Multi-Token Prediction (MTP) drafter for Gemma-4-31b

I’d like to request the adoption of Multi-Token Prediction (MTP drafter for Gemma-4-31b, which can boost its throughput up to 3x without any loss in performance. It would be a game changer for a variety of use cases.

Log in to comment and vote

No comments yet

Be the first to share your thoughts.