Jürgen Schmidhuber：the Father of Generative AI Without Turing Award

Summary

In the sweltering heat of Shanghai, Jazzyear had the privilege of meeting Professor Jürgen Schmidhuber, a distinguished guest at the 2024 World Artificial Intelligence Conference (WAIC). Based on years of earlier research, Schmidhuber and his student Sepp Hochreiter published the architecture and training algorithms for Long Short-Term Memory (LSTM) networks in 1997 in a journal. This type of RNN (Recurrent Neural Network) is widely used by tech giants for applications in natural language processing, speech recognition, video games, and more, including Apple’s Siri and Google’s translation services. Prior to the advent of ChatGPT, LSTM was heralded as “the most commercially valuable achievement in AI.” The 1997 LSTM paper is the most cited AI paper of the 20th century, perhaps even the most cited computer science paper of the century. Even earlier, in his “Annus Mirabilis” 1990-1991, Schmidhuber laid the foundations for Generative AI, by introducing the principles of what ‘s now called GANs (Generative Adversarial Networks), non-normalized linear Transformers, and self-supervised Pretraining. These 3 contributions correspond to the “G,” “P,” and “T” in ChatGPT, where GPT stands for Generative Pre-Trained Transformer. Long before the so-called “Deep Learning Trio” shared a Turing Award, Schmidhuber was already being hailed as the “Father of Mature AI” by The New York Times. Elon Musk also praised him on X, stating, “Schmidhuber invented it all.” In 2013, the International Neural Network Society (INNS) awarded Schmidhuber the Helmholtz Award. In 2016, he received the IEEE Neural Network Pioneer Award in recognition of his "pioneering contributions to deep learning and neural networks." Currently, he serves as Scientific Director at the Swiss AI Lab IDSIA and heads the AI initiative at King Abdullah University of Science and Technology (KAUST) in Saudi Arabia. He is also involved with several AI companies. Therefore, this 61-year-old German luminary has sparked a disco...