High-Level Modeling of Multimodal Interaction Techniques Using NiMMiT

The past few years, multimodal interaction has been gaining importance in virtual environments. Although multimodality renders interacting with an environment more natural and intuitive, the development cycle of such an application is often long and expensive. In our overall field of research, we investigate how modelbased design can facilitate the development process by designing environments through the use of highlevel diagrams. In this scope, we present ‘NiMMiT’, a graphical notation for expressing and evaluating multimodal user interaction; we elaborate on the NiMMiT primitives and demonstrate its use by means of a comprehensive example.

Thematic and Situational Features of Chinese BBS Texts

This study adopts the framework of Systemic Functional Grammar (SFG; Halliday, 1994/2000; Halliday & Matthiessen, 2004) to investigate thematic features in messages sent to an electronic bulletin board system (BBS) in mainland China. As a concept derived from the Prague School, theme in SFG has been identified as “the point of departure of the message; it is that which locates and orients the clause within its context” (Halliday & Matthiessen, 2004, p. 64). Thematic features in the Chinese data are found to relate to the situational features of the BBS, the analysis of which is based on the frameworks of Biber (1988) and Herring (2007). The relevant situational features are further generalized into the three components of context: field, tenor, and mode (Halliday & Hasan, 1985) in order to examine the relation between thematic features and situational features. The study’s findings show that thematic features are more closely related to the field (nature of the activity) than to the mode, contrary to Halliday’s (1978/2001) claim that theme, as a realization of the textual meaning, is determined by the mode (medium). In concluding, this discrepancy is explored.