The different brain areas occupied for integrating information of hierarchical linguistic units: a study based on EEG and TMS.

Pei, C; Qiu, Y; Li, F; Huang, X; Si, Y; Li, Y; Zhang, X; Chen, C; Liu, Q; Cao, Z; Ding, N; Gao, S; Alho, K; Yao, D; Xu, P

The different brain areas occupied for integrating information of hierarchical linguistic units: a study based on EEG and TMS.

Pei, C Qiu, Y Li, F Huang, X Si, Y Li, Y Zhang, X Chen, C Liu, Q Cao, Z

Ding, N Gao, S Alho, K Yao, D Xu, P

Permalink

Publisher:: OXFORD UNIV PRESS INC
Publication Type:: Journal Article
Citation:: Cereb Cortex, 2022, pp. bhac376
Issue Date:: 2022-09-30

Closed Access

	Filename	Description	Size
	The different brain areas occupied for integrating information of hierarchical linguistic unit a study based on EEG and TMS.pdf	Published version	1.6 MB	Adobe PDF	View/Open

Copyright Clearance Process

Recently Added
In Progress
Closed Access

This item is closed access and not available.

Full metadata record

Field	Value	Language
dc.contributor.author	Pei, C
dc.contributor.author	Qiu, Y
dc.contributor.author	Li, F
dc.contributor.author	Huang, X
dc.contributor.author	Si, Y
dc.contributor.author	Li, Y
dc.contributor.author	Zhang, X
dc.contributor.author	Chen, C
dc.contributor.author	Liu, Q
dc.contributor.author	Cao, Z https://orcid.org/0000-0003-3656-0328
dc.contributor.author	Ding, N
dc.contributor.author	Gao, S
dc.contributor.author	Alho, K
dc.contributor.author	Yao, D
dc.contributor.author	Xu, P
dc.date.accessioned	2023-04-20T04:09:54Z
dc.date.available	2022-08-30
dc.date.available	2023-04-20T04:09:54Z
dc.date.issued	2022-09-30
dc.identifier.citation	Cereb Cortex, 2022, pp. bhac376
dc.identifier.issn	1047-3211
dc.identifier.issn	1460-2199
dc.identifier.uri	http://hdl.handle.net/10453/170028
dc.description.abstract	Human language units are hierarchical, and reading acquisition involves integrating multisensory information (typically from auditory and visual modalities) to access meaning. However, it is unclear how the brain processes and integrates language information at different linguistic units (words, phrases, and sentences) provided simultaneously in auditory and visual modalities. To address the issue, we presented participants with sequences of short Chinese sentences through auditory, visual, or combined audio-visual modalities while electroencephalographic responses were recorded. With a frequency tagging approach, we analyzed the neural representations of basic linguistic units (i.e. characters/monosyllabic words) and higher-level linguistic structures (i.e. phrases and sentences) across the 3 modalities separately. We found that audio-visual integration occurs in all linguistic units, and the brain areas involved in the integration varied across different linguistic levels. In particular, the integration of sentences activated the local left prefrontal area. Therefore, we used continuous theta-burst stimulation to verify that the left prefrontal cortex plays a vital role in the audio-visual integration of sentence information. Our findings suggest the advantage of bimodal language comprehension at hierarchical stages in language-related information processing and provide evidence for the causal role of the left prefrontal regions in processing information of audio-visual sentences.
dc.format	Print-Electronic
dc.language	eng
dc.publisher	OXFORD UNIV PRESS INC
dc.relation.ispartof	Cereb Cortex
dc.relation.isbasedon	10.1093/cercor/bhac376
dc.rights	info:eu-repo/semantics/closedAccess
dc.subject	1109 Neurosciences, 1701 Psychology, 1702 Cognitive Sciences
dc.subject.classification	Experimental Psychology
dc.title	The different brain areas occupied for integrating information of hierarchical linguistic units: a study based on EEG and TMS.
dc.type	Journal Article
utslib.location.activity	United States
utslib.for	1109 Neurosciences
utslib.for	1701 Psychology
utslib.for	1702 Cognitive Sciences
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology/School of Computer Science
utslib.copyright.status	closed_access	*
dc.date.updated	2023-04-20T04:09:52Z
pubs.publication-status	Published online

Abstract:

Human language units are hierarchical, and reading acquisition involves integrating multisensory information (typically from auditory and visual modalities) to access meaning. However, it is unclear how the brain processes and integrates language information at different linguistic units (words, phrases, and sentences) provided simultaneously in auditory and visual modalities. To address the issue, we presented participants with sequences of short Chinese sentences through auditory, visual, or combined audio-visual modalities while electroencephalographic responses were recorded. With a frequency tagging approach, we analyzed the neural representations of basic linguistic units (i.e. characters/monosyllabic words) and higher-level linguistic structures (i.e. phrases and sentences) across the 3 modalities separately. We found that audio-visual integration occurs in all linguistic units, and the brain areas involved in the integration varied across different linguistic levels. In particular, the integration of sentences activated the local left prefrontal area. Therefore, we used continuous theta-burst stimulation to verify that the left prefrontal cortex plays a vital role in the audio-visual integration of sentence information. Our findings suggest the advantage of bimodal language comprehension at hierarchical stages in language-related information processing and provide evidence for the causal role of the left prefrontal regions in processing information of audio-visual sentences.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/170028