In this conversation, this research team discusses their innovative project that combines social cognition, crowd dynamics, and machine learning. They explore how to utilize body tracking technology and infrared cameras to gather data on audience behavior during live performances. The team aims to understand the relationship between crowd dynamics and environmental factors, ultimately seeking to predict crowd behavior and enhance audience engagement. In this conversation, the speakers delve into the complexities of extracting data from crowd dynamics, particularly in the context of music performances. They discuss the challenges of video data extraction compared to audio, the inspiration behind their project, and the ethical implications of using technology for crowd surveillance. The conversation also touches on the potential for real-time integration of audience behavior into performances, the future of brain-computer interfaces, and the exploration of life beyond Earth through advanced technology.

Michael Schnebly is an Applied Physics PhD student at Harvard University, where he studies the mechanics of proteins. He is also the creator of Stepwise (@stepwise.xyz), an experimental artist project using body-tracking technology to build new musical instruments and ways of performing. His work bridges scientific research, live performance, and social experimentation.

Michael is one of the co-creators of “Calibration,” a new collaborative research-performance series alongside neuroscientist Landry Bulls and electronic music artist Supertask. Calibration is a scientific study of group synchrony, embodiment, and the neural basis of musical experience through body-tracking in live concert crowds. It launches at Cervantes’ Other Side in Denver this summer.

Michael Schnelby Links

Landry Bulls is a PhD student in the Department of Psychological and Brain Sciences at Dartmouth College. As part of the Social Computation, Representation, and Prediction (SCRAP) Lab working with Dr. Mark Thornton, he uses computational methods to study social signaling of human groups and crowds. 

Landry Bulls Links

For the people who love to experience music, look no further than Supertask. With deep roots in hip-hop and a focus towards immersion, Supertask creates sonic landscapes that dance between the intensity and stillness of the human consciousness. His offerings of musical escapism are consumed by the concept of infinity, and with a background in IT, Supertask often utilizes code and programming in his artistic vision. A vision that his loyal community, the Dev Team, are directly involved in.

Blending both analog and digital sound design, his unique approach has proven to be a driving force in the forward progression of electronic music. Through soundscapes that feel sentient, interactive live streams, and mind-bending visuals, Supertask is changing the way that we consume art.

Supertask links

Mr. Bills Links