SAMBA: A New Chapter for State Models
Today I am diving into an AI technique recently announced by researchers at Princeton, the University of Illinois, Carnegie Mellon, and the University of Connecticut. The technique, known as Medusa, adds extra heads to LLMs to predict multiple future tokens simultaneously, resulting in upwards …
Read More >