Foundation Models: The term and its origins
Description
Today Ankush Garg is speaking with Rishi Bommasani, PhD student at Stanford and one of the originator of the term Foundation Models.
They’re talking about the origins of the term Foundation Model, which he and his group advanced, in the paper "On the Opportunities and Risks of Foundation Models".
They’ll talk about self-supervision, issues of scale, the motivation behind the terminology, the origins of the Research for Foundation Models Institute at Stanford, outcome homogenization, emergence and phase transitions, and some of the social consequences to look out for.
Thank you both for this conversation. As the world is coming to terms with GPT-4, this will be increasingly relevant.
Paper: On the Opportunities and Risks of Foundation Models.
Rishi's twitter: @RishiBommasani
Center for Research on Foundation Models (CRFM)
United States
