从字形到语义：跨语言Stroop效应的ERP研究

According to the influential dual-route model of reading (Coltheart, Rastle et al. 2001), there are two routes to access the meaning of visual words: one directly by orthography (orthography-semantic) and the other indirectly via the phonology (phonology-semantic). Because of the dramatic difference between written Chinese and alphabetical languages, it is still on debate whether Chinese readers have the same semantic activation processes as readers of alphabetical languages. In this study, the semantic activation processes in alphabetical German and logographic Chinese were compared. Since the N450 for incongruent color words in the Stroop tasks was induced by the semantic conflict between the meaning of the incongruent color words and color naming, this component could be taken as an index for semantic activation of incongruent color words in Stroop tasks. Two cross-script Stroop experiments were adopted to investigate the semantic activation processes in Chinese and German. The first experiment focused on the the role of phonology, while the second one focused on the realative importance of orthography. Cultural differences in cognitive processing between individuals in western and eastern countries have been found (Nisbett & Miyamoto, 2005). In order to exclude potential differences in basic cognitive processes like visual discrimination capabilities during reading, a visual Oddball experiment with non-lexical materials was conducted with all participants. However, as indicated by the P300 elicited by deviant stimuli in both groups, no group difference was observed. In the first Stroop experiments, color words (e.g., “green”), color-word associates (e.g., “grass”), and homophones of color words were used. These words were embedded into color patches with either congruent color (e.g. word “green” in green color patch) or incongruent colors (e.g. word “green” in either red or yellow or blue color patch). The key point is to observe whether homophones in both languages could induce similar behavioral and ERP Stroop effects to that induced by color words. It was also interesting to observe to which extent the N450 was related to the semantic conflicts. Nineteen Chinese adult readers and twenty German adult readers were asked to respond to the back color of these words in the Stroop experiment in their native languages by pressing the corresponding keys. In the behavioral data, incongruent conditions (incongruent color words, incongruent color-word associates, incongruent homophones) had significantly longer reaction times as compared to corresponding congruent conditions. All incongruent conditions in the Geman group elicited an N450 in the 400 to 500 ms time window. In the Chinese group, the N450 in the same time window was also observed for the incongruent color words and incongruent color-word associates. These results indicated that the N450 was very sensitive to semantic conflict-even words with semantic association to colors (e.g. “grass”) could elicite similar N450. However, the N450 was absent for incongruent homophones of color words in the Chinese group. Instead, in a later time window (600-800 ms), incongruent homophones elicited a positivity over left posterior regions as compared to congruent homophones. Similar positivity was also observed for color words in the 700 to 1000 ms time window in the Chinese group and 600 to 1000 ms time window for incongruent color words and homophones in the Geman group. These results indicate that phonology plays an important role in Geman semantic activation processes, but not in Chinese. In the second Stroop experiment, color words and pseudowords which had similiar visual shape to color words in both languages were used as materials. Another group of eighteen Chinese and twenty Germans were involved in the Stroop experiment in their native languages.The ERPs were recorded during their performance. In the behavioral data, strong and comparable Stroop effects (as counted by substract the reaction times in the congruent conditions from reaction times in the incongruent conditions) were observed. In the ERP data, both incongruent color words and incongruent pseudowords elicited an N450 over the whole brain scalp in both groups. These results indicated that orthography played an equally important role in semantic activation processes in both languages. The results of the two Stroop experiments support the view that the semantic activation process in Chiense readers differs significantly from that in German readers. The former rely mainly on the direct route (orthography-semantic), while the latter use both direct route and incirect route (phonology-semantic). These findings also indicate that the characteritics of different languages shape the semantic activation processes.

左侧梭状回内文字的字形加工：中文正常阅读者，中文文盲、非中文母语被试的对比研究

Reading is an important human-specific skill obtained through extensive learning experience and is reliance on the ability to rapidly recognize single words. According to the behavioral studies, the most important stage of reading is the representation of “visual word form”, which is independent on surface visual features of the reading materials. The prelexical visual word form representation is characterized by the abstractive and highly effective and precise processing. Neuroimaging and neuropsychological studies have investigated the neural basis underlying the visual word form processing. On the basis of summary of the existing literature, the current thesis aimed to address three fundamental questions involving neural basis of word recognition. First, is there a dedicated neural network that is specialized for word recognition? Second, is the orthographic information represented in the putative word/character selective region (VWFA)? Third, what is the role of reading experience in the genesis of the VWFA, is experience a main driver to shape VWFA instead of evolutionary selectivity? Nineteen Chinese literate volunteers, 5 Chinese illiterates and 4 native English speakers participated in this study, and performed perceptual tasks during fMRI scanning. To address the first question, we compared the differential responses to three categories of visual objects, i.e., faces, line drawings of objects and Chinese characters, and defined the region of interesting (ROI) for the next experiment. To address the second question, Chinese character orthography was manipulated to reveal possible differential responses to real characters, false characters, radical combinations, and stroke combinations in the regions defined by the first experiment. To examine the role of reading experience in genesis of specialization for character, the responses for unfamiliar Chinese characters in Chinese illiterates and native English speakers were compared with that in the Chinese literates, and tracked the change in cortical activation after a short-term reading training in the illiterates. Data were analyzed in two dimensions. Both BOLD signal amplitude and spatial distribution pattern among multi-voxels were used to systematically investigate the responsiveness of the left fusiform gyrus to Chinese characters. Our results provide strong and clear evidence for the existence of functionally specialized regions in the human ventral occipital-temporal cortex. In the skilled readers a region specialized for written words could be consistently found in the lateral part of the left fusiform gyrus, line drawings in the median part and faces in the middle. Our results further show that spatial distribution analysis, a method that was not commonly used in neuroimaging of reading, appears to be a more effective measurement for category specialization for visual objects processing. Although we failed to provide evidence that VWFA processes orthographic information in terms of signal intensitiy, we do show that response pattern of real characters and radical collections in this area is different from that of false characters and random stroke combinations. Our last set of experiments suggests that the selective bias to reading material is clearly experience dependent. The response to unknown characters in both English speakers/readers and Chinese illiterates is fundamentally different from that of the skilled Chinese readers. The response pattern for unknown characters is more similar to that for line drawings rather as a weak version of character in skilled Chinese readers. Short-term training is not sufficient to produce VWFA bias even when tested with learned characters, rather the learned characters generated a overall upward shift of the activation of the left fusiform region. Formation of a dedicated region specialized for visual word/character might depend on long-term extensive reading experience, or there might be a critical period for reading acquisition.

汉字形音义加工时间进程的事件相关电位（ERP）研究

The time-courses of orthographic, phonological and semantic processing of Chinese characters were investigated systematically with multi-channel event-related potentials (ERPs). New evidences concerning whether phonology or semantics is processed first and whether phonology mediates semantic access were obtained, supporting and developing the new concept of repetition, overlapping, and alternating processing in Chinese character recognition. Statistic parameter mapping based on physiological double dissociation has been developed. Seven experiments were conducted: I) deciding which type of structure, left-right or non-left-right, the character displayed on the screen was; 2) deciding whether or not there was a vowel/a/in the pronunciation of the character; 3) deciding which classification, natural object or non-natural object, the character was; 4) deciding which color, red or green, the character was; 5) deciding which color, red or green, the non-character was; 6) fixing on the non-character; 7) fixing on the crosslet. The main results are: 1. N240 and P240:N240 and P240 localized at occipital and prefrontal respectively were found in experiments 1, 2, 3, and 4, but not in experiments 5, 6, or 7. The difference between the former 4 and the latter 3 experiments was only their stimuli: the former's were true Chinese characters while the latter's were non-characters or crosslet. Thus Chinese characters were related to these two components, which reflected unique processing of Chinese characters peaking at about 240 msec. 2. Basic visual feature analysis: In comparison with experiment 7 there was a common cognitive process in experiments 1, 2, 4, and 6 - basic visual feature analysis. The corresponding ERP amplitude increase in most sites started from about 60 msec. 3. Orthography: The ERP differences located at the main processing area of orthography (occipital) between experiments 1, 2, 3, 4 and experiment 5 started from about 130 msec. This was the category difference between Chinese characters and non-characters, which revealed that orthographic processing started from about 130 msec. The ERP differences between the experiments 1, 2, 3 and the experiment 4 occurred in 210-250, 230-240, and 190-250 msec respectively, suggesting orthography was processed again. These were the differences between language and non-language tasks, which revealed a higher level processing than that in the above mentioned 130 msec. All the phenomena imply that the orthographic processing does not finished in one time of processing; the second time of processing is not a simple repetition, but a higher level one. 4. Phonology: The ERPs of experiment 2 (phonological task) were significantly stronger than those of experiment 3 (semantic task) at the main processing areas of phonology (temporal and left prefrontal) starting from about 270 msec, which revealed phonologic processing. The ERP differences at left frontal between experiment 2 and experiment 1 (orthographic task) started from about 250 msec. When comparing phonological task with experiment 4 (character color decision), the ERP differences at left temporal and prefrontal started from about 220 msec. Thus phonological processing may start before 220 msec. 5. Semantic: The ERPs of experiment 3 (semantic task) were significantly stronger than those of experiment 2 (phonological task) at the main processing areas of semantics (parietal and occipital) starting from about 290 msec, which revealed semantic processing. The ERP differences at these areas between experiment 3 and experiment 4 (character color decision) started from about 270 msec. The ERP differences between experiment 3 and experiment 1 (orthographic task) started from about 260 msec. Thus semantic processing may start before 260 msec. 6. Overlapping of phonological and semantic processing: From about 270 to 350 msec, the ERPs of experiment 2 (phonological task) were significantly larger than those of experiment 3 (semantic task) at the main processing areas of phonology (temporal and left prefrontal); while from about 290-360 msec, the ERPs of experiment 3 were significantly larger than those of experiment 2 at the main processing areas of semantics (frontal, parietal, and occipital). Thus phonological processing may start earlier than semantic and their time-courses may alternate, which reveals parallel processing. 7. Semantic processing needs part phonology: When experiment 1 (orthographic task) served as baseline, the ERPs of experiment 2 and 3 (phonological and semantic tasks) significantly increased at the main processing areas of phonology (left temporal and frontal) starting from about 250 msec. The ERPs of experiment 3, besides, increased significantly at the main processing areas of semantics (parietal and frontal) starting from about 260 msec. When experiment 4 (character color decision) served as baseline, the ERPs of experiment 2 and 3 significantly increased at phonological areas (left temporal and frontal) starting from about 220 msec. The ERPs of experiment 3, similarly, increased significantly at semantic areas (parietal and frontal) starting from about270 msec. Hence, before semantic processing, a part of phonological information may be required. The conclusion could be got from above results in the present experimental conditions: 1. The basic visual feature processing starts from about 60 msec; 2. Orthographic processing starts from about 130 msec, and repeats at about 240 msec. The second processing is not simple repetition of the first one, but a higher level processing; 3. Phonological processing begins earlier than semantic, and their time-courses overlap; 4. Before semantic processing, a part of phonological information may be required; 5. The repetition, overlapping, and alternating of the orthographic, phonological and semantic processing of Chinese characters could exist in cognition. Thus the problem of whether phonology mediates semantics access is not a simple, but a complicated issue.