Microsoft presents EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees - 20%-40% faster than EAGLE-1 (i.e. 3.05x - 4.26x faster than the baseline) - Ensures that the distribution of the generated text remains unchanged abs: https://t.co/tHAzfktLJ9 repo:… https://t.co/Lc3XpCjZiV