no code implementations • 8 Nov 2023 • Subba Reddy Oota, Emin Çelik, Fatma Deniz, Mariya Toneva
We investigate this question via a direct approach, in which we eliminate information related to specific low-level stimulus features (textual, speech, and visual) in the language model representations, and observe how this intervention affects the alignment with fMRI brain recordings acquired while participants read versus listened to the same naturalistic stories.