Jakob Uszkoreit is a German computer scientist, researcher, and entrepreneur. He is best known for his role as a co-author of the seminal 2017 paper "Attention Is All You Need", which proposed the Transformer model that underpins almost all modern generative AI applications.
Google Career and Technical Contributions
Uszkoreit spent over a decade at Google, leading research teams focused on natural language processing, machine translation, and information retrieval. He played a key role in designing the mathematical concepts of the self-attention mechanism, arguing that sequential processing (such as in RNNs) could be entirely replaced with parallel attention mechanisms to dramatically accelerate training and model capacity.
Biotech and Inceptive
In 2021, Uszkoreit co-founded Inceptive, a biotechnology company that applies deep learning models to design novel, highly targeted RNA molecules. Inceptive aims to use AI-driven biological design to develop next-generation vaccines and therapeutics, applying the principles of generative language models to the "language" of genetics.
