13 resultados para Multimodal
em Chinese Academy of Sciences Institutional Repositories Grid Portal
Resumo:
This paper focuses on the study of carrier channels of multimodal-sized quantum dots formed on patterned substrate by a rate-equation-based model. Surface-mediated indium adatom migration is revealed by a direct comparison between quantum dot wetting layer, which acts as carrier channel, formed on a flat substrate and on a patterned substrate. For the assessment of suitability, the carrier channel of the dot-in-well structure has also been studied by the present model, and the transition energies of the carrier channel (e.g., InGaAs quantum well) obtained from theoretical simulation agree fairly well with those obtained from the reflectance measurements.
Resumo:
We have used Deep Level Transient Spectroscopy to investigate self-organized InAs/GaAs quantum dots. The existence of different dot families is confirmed by the deconvolution of the spectra in Gaussian components with full width at half maximum of 60-70meV. The strain of quantum dots is responsible for the relaxation of large quantum dots leading to generation of dislocations. (C) 1998 Academic Press.
Resumo:
In recognition-based user interface, users’ satisfaction is determined not only by recognition accuracy but also by effort to correct recognition errors. In this paper, we introduce a crossmodal error correction technique, which allows users to correct errors of Chinese handwriting recognition by speech. The focus of the paper is a multimodal fusion algorithm supporting the crossmodal error correction. By fusing handwriting and speech recognition, the algorithm can correct errors in both character extraction and recognition of handwriting. The experimental result indicates that the algorithm is effective and efficient. Moreover, the evaluation also shows the correction technique can help users to correct errors in handwriting recognition more efficiently than the other two error correction techniques.
Resumo:
将多通道交互用于虚拟环境,研究自然和谐的交互方式已经成为虚拟现实的一个重要研究方向.文中以城市规划为应用背景,融合跟踪器、语音和笔输入,提出概率合一的任务制导多通道整合,并辅以上下文语义;以此为基础,有针对性地设计了多通道交互技术,并依据多通道交互的特性分别进行阐述,实现了自然、高效的多通道虚拟城市规划.
Resumo:
在基于识别的界面中,用户的满意度不但由识别准确度决定,而且还受识别错误的纠正过程的影响.提出一种基于多通道融合的连续手写笔迹识别错误的纠正方法.该方法允许用户通过口述书写内容纠正手写识别中的字符提取和识别的错误.该纠错方法的核心是一种多通道融合算法.该算法通过利用语音输入约束最优手写识别结果的搜索,可纠正手写字符的切分错和识别错.实验评估结果表明,该融合算法能够有效纠正错误,计算效率高.与另外两种手写识别错误纠正方法相比,该方法具有更高的纠错效率.
Resumo:
多通道界面是利用多个输入通道进行人机交互的新一代人机界面,旨在提高人机交互的自然性和高效性.本文首先阐述了多通道界面的概念和研究问题,然后提出评价多通道界面人机交互效率的一种机制.结合面向任务的观点提出一种多通道界面的软件结构模型,在此基础上实现了一个具有多通道界面特点的原型系统(MMI-PRO),并给出了相应的通道整合算法.最后利用提出的评价机制对MMI_PRO交互效率进行了定量评价.
Resumo:
提出的多通道交互通用开发框架可以快速地开发出支持多通道交互的应用,也可以将已经存在的应用快速更改为多通道交互应用;基于此理论,设计和实现了一种支持手写笔和语音输入的多通道家电开关控制系统。具体地阐明了实际开发中应该重点注意的环节,希望能够对当前手持移动设备的多通道交互化有所借鉴。
Resumo:
多通道交互已经成为人机交互领域一个重要的研究方向,对多通道输入的信息进行语义融合是其中的关键问题。提出了一种将上下文与传统语义融合相结合的方法,并将这一方法应用在面向儿童使用的讲故事原型系统中。儿童通过受限的自然语言、笔的勾画等方式进行故事创作。结果表明,笔和语音结合的多通道交互方式能够使得儿童更方便、自然地与计算机进行交互,结合上下文的语义融合方法能够在一定程度上修正输入错误。
Resumo:
Solutions for fiber-optical parametric amplifiers (FOPAs) with dispersion fluctuations are derived using matrix operators. On the basis of the propagation matrix product and the hybrid genetic algorithm, we have optimized and compared single- and dual-pump FOPAs with zero-dispersion-wavelength variations. The simulations prove that the design of FOPAs involves multimodal function optimization problems. The numerical results show that dual-pump FOPAs are highly sensitive to dispersion fluctuations whereas dispersion variations have less impact on the gain of single-pump FOPAs. To increase signal gain and reduce ripple, dual-pump FOPAs, instead of single-pump FOPAs, have to be carefully optimized with a suitable multisegment fiber structure rather than a one-segment fiber structure. The different combinations of multisegment fibers can provide highly different gain properties. The increase in gain is at the cost of the ripple.
Resumo:
Different chemical mechanical polishing (CMP) slurries are used to obtain single-damascene Cu-wires with different surface fluctuations as well as pre-existing surface-defects in wires with rougher surfaces. The presence of such pre-existing defects strongly increases the rate of early failures to almost 100%, reduces electromigration lifetime rapidly to the level of early failures, and changes the multimodal failure distribution into monomodal. The activation energy (0. 74±0.02eV) for the failure mechanism associated with these pre-existing defects confirms a dominant surface diffusion. It shows how a weakest link approximation analysis can he applied to a single wire by dividing the wire into relevant segments and assigning different failure mechanisms to the various segments. The analysis confirms that, although surface-defects are not the fastest early failure mechanism, the ten times higher surface-defectdensity in the rougher wires is responsible for the observed high early-failure rate and unreliable performance.
Resumo:
By using high-resolution laser grain size instrument Mastersizer 2000, the grain size distribution of windblown depositions (loess and sandy dunes), aqueous sediments (lake, river, riverside and foreshore sand), weathering crust, sloping materials and other fine-grain sediments are systemically measured. The multimodal characteristics of grain size distribution of these sediments are carefully studied. The standard patterns and their grain size characteristics of various sediments are systemically summarized. The discrepancies of multimodal distribution among windblown depositions, aqueous sediments and other sediments are concluded and the physical mechanisms of grain size multimodal distribution of various sediments are also discussed in this paper. The major conclusions are followed: 1. The multimodal characteristic of grain size distribution is a common feature in all sediments and results from properties of transportation medium, dynamic intensity, transportation manner and other factors. 2. The windblown depositions are controlled by aerodynamic forcing, resulting in that the median size of the predominant mode gradually decreases form sandy dunes to loess. Similarly, the aqueous sediments are impacted by dynamic forces of water currents and the median grain size of the predominant mode decreases gradually from river to lake sediments. Because the kinetic viscidity of air is lower than of water, the grain size of modes of windblown depositions is usually finer than that of corresponding modes of aqueous sediments. Typical characteristics of sediments grain size distribution of various sediments have been summarized in the paper: (1) Suspended particles which diameters are less than 75μm are dominant in loess and dust. There are three modes in loess’ grain size distribution: fine, median and coarse (the median size is <1μm、1-10μm、10-75μm, respectively). The coarse mode which percentage is larger than that of others is controlled by source distance and aerodynamic intensity of dust source areas. Some samples also have a saltation mode which median size is about 300-500μm. Our analysis demonstrates that the interaction of wind, atmospheric turbulence, and dust grain gravity along the dust transportation path results in a multimodal grain size distribution for suspended dust. Changes in the median sizes of the coarse and medium modes are related to variation in aerodynamic forcing (lift force related to vertical wind and turbulence) during dust entrainment in the source area and turbulence intensity in the depositional area. (2) There is a predominant coarse saltation mode in grain size distribution of sandy dunes, which median size is about 100-300μm and the content is larger than that of other modes. The grain size distribution curve is near axis symmetric as a standard logarithm normal function. There are some suspended particles in some samples of sandy dunes, which distribution of the fine part is similar to that of loess. Comparing with sandy samples of river sediments, the sorting property of sandy dunes is better than of river samples although both they are the saltation mode. Thus, the sorting property is a criterion to distinguish dune sands and river sands. (3) There are 5~6 modes (median size are <1μm, 1-10μm, 10-70μm, 70-150μm, 150-400μm, >400μm respectively) in grain size distribution of lacustrine sediments. The former 4 modes are suspensive and others are saltated. Lacustrine sediments can be divided into three types: lake shore facies, transitional facies and central lake facies. The grain size distributions of the three facies are distinctly different and, at the same time, the transition among three modes is also clear. In all these modes, the third mode is a criteria to identify the windblown deposition in the watershed. In lake shore sediments, suspended particles are dominant, a saltation mode sometimes occurs and the fourth mode is the most important mode. In the transitional facies, the percentage of the fourth mode decreases and that of the second mode increases from lake shore to central lake. In the central lake facies, the second mode is dominant. A higher content of the second mode indicates its position more close to the central lake. (4) The grain size distribution of river sediments is the most complex. It consist of suspension, saltation and rolling modes. In most situations, the percentage of the saltation mode is larger than that of other modes. The percentage of suspension modes of river sediments is more than of sandy dunes. The grain size distribution of river sediments indicates dynamic strength of river currents. If the fourth mode is dominant, the dynamic forcing of river is weaker, such as in river floodplain. If the five or sixth mode is dominant, the water dynamic forcing of rivers is strong. (5) Sediments can be changed by later forcing in different degree to form some complicated deposition types. In the paper, the grain size distribution of aqueous sediments of windblown deposition, windblown sediments of aqueous deposition, weathering crust and slope materials are discussed and analyzed. 3. The grain size distribution characteristics of different sediments are concluded: (1) Modal difference: Usually there are suspended and saltation modes in the windblown deposition. The third mode is dominant in loess dust and the fifth mode is predominant in sandy dunes. There are suspended, saltation and rolling particles in aqueous sediments. In lacustrine sediments, the second and fourth mode are predominant for central lake facies or lake shore facies, respectively. In river sediments, the fourth, or fifth, or sixth mode is predominant. Suspended modes: the grain size of suspended particles of windblown depositions usually is less than 75μm. The content of suspended particles is lower or none in sandy dunes. However, suspended particles of aqueous sediments may reach 150μm. Difference in grain size of suspended modes represents difference between transitional mediums and the strength of dynamic forcing. Saltation modes: the median size of saltation mode of sandy dunes fluctuates less than that of river sediments. (2) Loess dust and lacustrine sediment: Their suspended particles are clearly different. There is an obvious pit between the second and the third modes in grain size distribution of lacustrine sediments. The phenomenon doesn’t occur in loess dust. In lacustrine sediments, the second mode can be a dominant mode, such as central lake facies, and contents of the second and the third modes change reversely. However, the percentage of the third mode is always the highest in loess dust. (3) Dune Sand and fluvial sand: In these two depositions, the saltation particles are dominant and the median sizes of their saltation modes overlay in distribution range. The fifth mode of dune sand fluctuates is sorted better than that of fluvial sand. (4) Lacustrine and fluvial sediments: In lacustrine sediments, there are 5-6 modes and suspended particles can be predominant. The second mode is dominant in central lake facies and the third mode is dominant in lake shore facies. Saltation or roll modes occurred in central lake facies may indicate strong precipitation events. In fluvial sediments, saltation particles (or rolling particles) usually dominant. 4. A estimation model of lake depth is firstly established by using contents of the second, the third and the fourth modes. 5. The paleoenvironmental history of the eastern part of SongLiao basin is also discussed by analyzing the grain size distribution of Yushu loess-like sediments in Jilin. It was found that there is a tectonic movement before 40ka B.P. in SongLiao basin. After the movement, loess dust deposited in Yushu area as keerqin desert developed. In recent 2000 years, the climate became drier and more deserts activated in the eastern part of Song-Liao basin.
Resumo:
One of the most important functions in the individual development is the interaction and integration of each sensory input. There exist two competing theories, i.e. the deficiency theory and the compensatory theory, regarding the origin and nature of changes in visual functions observed after auditory deprivation. The deficiency theory proposed that integrative processes are essential for normal development. In contrast, the compensatory theory stated that the loss of one sense may be met by a greater reliance upon, therefore an enhancement of the remaining senses. Given that hearing impaired children’s learning depends primarily on visual information, it is important to recognize the differences of visual attention between them and their hearing age-mates. Differences among age groups could exist in either selectivity or sustained attention. Study 1 and study 2 explored the selective and sustained attention development of hearing impaired and hearing students with average cognitive ability, aged from 7 years to college students. The analysis and discussion of the results are based on the visual attention development as well as deficiency theory and compensatory theory. According to the results of the study 1 and study 2, the spatial distribution and controlling of the visual attention between hearing impaired and hearing students were also investigated in the study 3 and study 4. The present work showed that: Firstly, both hearing impaired and hearing participants had the similar developmental trajectory of the sustained attention. The ability of children’s sustained attention appeared to improve with age, and in adolescence it reached the peak. The hearing impaired participants had the comparable sustained attention skills to the matched hearing ones. Besides, the results of the hearing impaired participants showed that they could maintain their attention and vigilance on the current task over the observation period. Secondly, group differences of visual attention development were found between hearing impaired and hearing participants. In the childhood, the visual attention developmental speed of the hearing impaired children was slower than that of the hearing ones. The selective attention skill of the hearing impaired were not comparable to the hearing ones, however, their selective skill improved with age, so in the adulthood, hearing impaired students showed the slight advantage in the selective attention skill over the hearing ones. Thirdly, hearing impaired and hearing participants showed the similar spatial distribution in the attention resources. In the low perceptual load condition, both participants were suffered great interference of the distrator at the fixation. In contrast, in the high perceptual load condition, hearing impaired adults were suffered more interference of the peripheral distractor, which suggested that they distributed more attention resources to the peripheral field when faced difficult tasks. Fourthly, both groups showed similar processing in the visual attention tasks. That is, they both searched the target with only the color feature in a parallel way, but in a serial way while processing orientation feature and the features with the combination of the color and orientation. Furthermore, the results indicated that two groups show similar ways in the attention controlling. In summary, the present study showed that visual attention development was dependent upon the integration of multimodal sensory information. Because of the interaction and integration of the input from various sensory, it has a negative impact on the intact sensory at the early stage of one sensory loss, however, it can better the functions of other intact sensory gradually with development and practice.
Resumo:
Recently,Handheld Communication Devices is developing very fast, extending in users and spreading in application fields, and has an promising future. This study investigated the acceptance of the multimodal text entry method and the behavioral characteristics when using it. Based on the general information process model of a bimodal system and the human factor studies about the multimodal map system, the present study mainly focused on the hand-speech bimodal text entry method. For acceptance, the study investigated the subjective perception of the accuracy of speech recognition by Wizard of Oz (WOz) experiment and a questionnaire. Results showed that there was a linear relationship between the speech recognition accuracy and the subjective accuracy. Furthermore, as the familiarity increasing, the difference between the acceptable accuracy and the subjective accuracy gradually decreased. In addition, the similarity of meaning between the outcome of speech recognition and the correct sentences was an important referential criterion. The second study investigated three aspects of the bimodal text entry method, including input, error recovery and modal shifts. The first experiment aimed to find the behavioral characteristics of user when doing error recovery task. Results indicated that participants preferred to correct the error by handwriting, which had no relationship with the input modality. The second experiment aimed to discover the behavioral characteristics of users when doing text entry in various types of text. Results showed that users preferred to speech input in both words and sentences conditions, which was highly consistent among individuals, while no significant difference was found between handwriting and speech input in the character condition. Participants used more direct strategy than jumping strategy to deal with mixed text, especially for the Chinese-English mixed type. The third experiment examined the cognitive load in the different modal shifts, results suggesting that there were significant differences between different shifts. Moreover, relevant little time was needed in the Shift from speech input to hand input. Based on the main findings, implications were discussed as follows: Firstly, when evaluating a speech recognition system, attention should be paid to the fact that the speech recognition accuracy was not equal to the subjective accuracy. Secondly, in order to make a speech input system more acceptable, a good method is to train and supply the feedback for the accuracy in training, which improving the familiarity and sensitivity to the system. Thirdly, both the universal and individual behavioral patterns were taken into consideration to improve the error recovery method. Fourthly, easing the study and the use of speech input, the operations of speech input should be simpler. Fifthly, more convenient text input method for non-Chinese text entry should be provided. Finally, the shifting time between hand input and speech input provides an important parameter for the design of automatic-evoked speech recognition system.