Listen Top Shows Blog

#30: Language Models, Active Inference and Latent Variables with Alejandro Daniel Noel

#30: Language Models, Active Inference and Latent Variables with Alejandro Daniel Noel

Update: 2022-09-01

Share

Description

In this episode, our host Manuel Brenner is joined by Alejandro Daniel Noel. Alejandro got his masters from TU Delft working with Acitive Inference and the Free Energy Principle, and is now a full time software engineer at Google in Zürich, specializing on machine learning engineering of language models for conversational AI.

We discuss the free energy principle, active inference, the role of uncertainty, latent variable models, language and tokenization, causality, diffusion models, DALL-E, paths towards AGI, JEPA, language and consciousness, attention, self-attention, and many more topics.

Stay tuned for more episodes: https://mailchi.mp/0346443b6ddf/acit-global-signup

Comments

In Channel

#35: Bridging Modalities: Vision, Language, and AI with Letitia Parcalabescu

#35: Bridging Modalities: Vision, Language, and AI with Letitia Parcalabescu

2023-08-0701:14:58

#34: The Biology of Aging: From Mechanisms to Interventions with Christoph Benner

#34: The Biology of Aging: From Mechanisms to Interventions with Christoph Benner

2023-04-2601:22:35

#33: AI for Climate Change with Priya Donti

#33: AI for Climate Change with Priya Donti

2023-01-0247:33

#32: Transformers, Puns and Rap Battles: A Conversation With ChatGPT

#32: Transformers, Puns and Rap Battles: A Conversation With ChatGPT

2022-12-1615:38

#31: Deep Metric Learning, Generalization and Transformers with Karsten Roth

#31: Deep Metric Learning, Generalization and Transformers with Karsten Roth

2022-11-2702:23:09

#30: Language Models, Active Inference and Latent Variables with Alejandro Daniel Noel

#30: Language Models, Active Inference and Latent Variables with Alejandro Daniel Noel

2022-09-0101:42:30

#29: Memory, Dynamics and AI Ethics with Leonard Bereska

#29: Memory, Dynamics and AI Ethics with Leonard Bereska

2022-07-2001:50:17

#28: Blockchains and Cryptocurrencies with Ingo Fiedler

#28: Blockchains and Cryptocurrencies with Ingo Fiedler

2022-06-0501:46:29

#27: Super Pollutants with Jonathan Banks

#27: Super Pollutants with Jonathan Banks

2022-05-3156:23

#26: The Future of Nuclear Energy with Carlos Leipner

#26: The Future of Nuclear Energy with Carlos Leipner

2022-04-1701:04:14

#25: Tackling Climate Change through Carbon Capture with Lee Beck

#25: Tackling Climate Change through Carbon Capture with Lee Beck

2022-03-2301:05:46

#24: The Clean Air Task Force with Armond Cohen

#24: The Clean Air Task Force with Armond Cohen

2022-02-1801:09:56

#23: The Hidden Spring of Consciousness with Mark Solms

#23: The Hidden Spring of Consciousness with Mark Solms

2022-02-1101:28:40

#22: Psychotherapy and Psychedelics with Henrik Jungaberle

#22: Psychotherapy and Psychedelics with Henrik Jungaberle

2022-01-1849:35

#21: International Criminal Law and Human Rights with Amal Ounali

#21: International Criminal Law and Human Rights with Amal Ounali

2021-11-2501:20:36

#20: (Post) World Music Experimentalism with Rim Jasmin Irscheid

#20: (Post) World Music Experimentalism with Rim Jasmin Irscheid

2021-11-0701:07:17

#19: Viruses, Pandemics and Effective Altruism with Jasper Götting

#19: Viruses, Pandemics and Effective Altruism with Jasper Götting

2021-09-1501:50:41

#18: AI for Drug Discovery and Longevity with Noah Weber

#18: AI for Drug Discovery and Longevity with Noah Weber

2021-09-1102:09:20

#17: The Mathematics of Deep Learning with Julius Berner

#17: The Mathematics of Deep Learning with Julius Berner

2021-08-0101:24:53

#16: The Origins of Computer Science & Verifying Code With Logic with Marcel Moosbrugger

#16: The Origins of Computer Science & Verifying Code With Logic with Marcel Moosbrugger

2021-06-1301:33:14

00:00

00:00

x

#30: Language Models, Active Inference and Latent Variables with Alejandro Daniel Noel

#30: Language Models, Active Inference and Latent Variables with Alejandro Daniel Noel

Manuel Brenner