A unifying computational account of temporal context effects in language across the human cortex
Update: 2023-08-04
Description
Link to bioRxiv paper:
http://biorxiv.org/cgi/content/short/2023.08.03.551886v1?rss=1
Authors: Vo, V. A., Jain, S., Beckage, N., Chien, H.-Y. S., Obinwa, C., Huth, A. G.
Abstract:
Deep learning advances have revolutionized computational modeling approaches in neuroscience. However, their black-box nature makes it challenging to use deep learning models to discover new insights about brain function. Focusing on human language processing, we propose a new framework to improve the quality and interpretability of the inferences we make from deep learning-based models. First, we add interpretable components to a deep language model and use it to build a predictive encoding model. Then, we use the model's predictive abilities to simulate brain responses to controlled stimuli from published experiments. We find that our model, based on a multi-timescale recurrent neural network, captures many previously reported temporal context effects in human cortex. Its failure to capture other effects also highlights important gaps in current language models. Finally, we use this new framework to generate model-based evidence that supports the proposal that different linguistic features are represented at different timescales across cortex.
Copy rights belong to original authors. Visit the link for more info
Podcast created by Paper Player, LLC
http://biorxiv.org/cgi/content/short/2023.08.03.551886v1?rss=1
Authors: Vo, V. A., Jain, S., Beckage, N., Chien, H.-Y. S., Obinwa, C., Huth, A. G.
Abstract:
Deep learning advances have revolutionized computational modeling approaches in neuroscience. However, their black-box nature makes it challenging to use deep learning models to discover new insights about brain function. Focusing on human language processing, we propose a new framework to improve the quality and interpretability of the inferences we make from deep learning-based models. First, we add interpretable components to a deep language model and use it to build a predictive encoding model. Then, we use the model's predictive abilities to simulate brain responses to controlled stimuli from published experiments. We find that our model, based on a multi-timescale recurrent neural network, captures many previously reported temporal context effects in human cortex. Its failure to capture other effects also highlights important gaps in current language models. Finally, we use this new framework to generate model-based evidence that supports the proposal that different linguistic features are represented at different timescales across cortex.
Copy rights belong to original authors. Visit the link for more info
Podcast created by Paper Player, LLC
Comments
In Channel
Download from Google Play
Download from App Store
United States00:00
00:00
x
