scenario-focused development method for a pen-based user interface: model and applications

Pen-based user interface (PUI) has drawn significant interest, owing to its intuitiveness and convenience. While much of the research focuses on the technology, the usability of a PUI has been relatively low since human factors have not been considered sufficiently. Scenario-centric designs are ideal ways to improve usability. However, such designs possess some problems in practical use. To cope with these design issues, the concept of “interface scenarios” is proposed in to facilitate the interface design, and to help users understand the interaction process in such designs. The proposed scenario-focused development method for PUI is coupled with a practical application to show its effectiveness and usability.

Supermedia User Interface for Scanning Probe Microscopy

当利用扫描隧道显微镜(SPM)作为一种纳米操作工具时,由于其缺乏实时的传感器信息反馈,而大大阻碍了它的广泛应用.利用超媒体人机交互接口可以解决这个问题.在纳米操作过程中,超媒体接口不但可以为操作者提供可实时更新的仿真操作场景,还可以通过力反馈手柄让操作者实时地感受到探针受到的三维纳米操作力.除此之外,操作者还可以通过该手柄直接控制探针的三维运动.最后在聚碳酸酯上进行了超媒体人机接口的纳米刻画实验.实验结果验证了该系统的有效性和效率.

research on user-centered design and recognition pen gestures

Pen-based user interface has become a hot research field in recent years. Pen gesture plays an important role in Pen-based user interfaces. But it’s difficult for UI designers to design, and for users to learn and use. In this purpose, we performed a research on user-centered design and recognition pen gestures. We performed a survey of 100 pen gestures in twelve famous pen-bases systems to find problems of pen gestures currently used. And we conducted a questionnaire to evaluate the matching degree between commands and pen gestures to discover the characteristics that a good pen gestures should have. Then cognition theories were applied to analyze the advantages of those characteristics in helping improving the learnability of pen gestures. From these, we analyzed the pen gesture recognition effect and presented some improvements on features selection in recognition algorithm of pen gestures. Finally we used a couple of psychology experiments to evaluate twelve pen gestures designed based on the research. It shows those gestures is better for user to learn and use. Research results of this paper can be used for designer as a primary principle to design pen gestures in pen-based systems.

scenario-based interactive intention understanding in pen-based user interfaces

Interactive intention understanding is important for Pen-based User Interface (PUI). Many works on this topic are reported, and focus on handwriting or sketching recognition algorithms at the lexical layer. But these algorithms cannot totally solve the problem of intention understanding and can not provide the pen-based software with high usability. Hence, a scenario-based interactive intention understanding framework is presented in this paper, and is used to simulate human cognitive mechanisms and cognitive habits. By providing the understanding environment supporting the framework, we can apply the framework to the practical PUI system. The evaluation of the Scientific Training Management System for the Chinese National Diving Team shows that the framework is effective in improving the usability and enhancing the intention understanding capacity of this system.

一种笔式用户界面软件领域模型及其应用

笔式用户界面软件以其自然、高效的交互方式，在很多领域中有着广泛的应用笔式用户界面软件具有以交互为中心、用户个性化需求高的特点，由此也决定了用户在软件设计中的主导地位“用户为中心的设计的关键问题在于，如何使用户的思想如实地反映到设计中通过建立笔式用户界面软件特征模型PUIDM(the domain model for pen—based user interface software)，构造了一个连接用户与软件设计的平台．从上下文、软件实体、界面特征、体系结构等角度，对该模型的建立进行分析．并给出了相应的XML描述在此基础上，描述了用户使用该模型进行软件设计的过程实例表明，PUIDM能够正确引导用户进行设计，将用户意图充分地引入到软件设计和最终实现中，使软件满足可用性要求。

CoPenML:基于XML的笔式用户界面构件体系结构

笔式用户界面在许多领域得到了广泛应用，但现有的笔式界面技术不能支持高层次、多领域的可视化界面制作，很难实现面向软件构件的重用．因而提出一个新的解决方案，面向构件的体系结构CoPenML．该方案基于XML语言抽象描述了笔式界面的配置组成．可用于快速生成界面原型及二次开发接口，并且在系统实现级以及场景图级两个层面上实现软件构件的重用．设计了CoPenML的体系结构并给出了界面描述语言规范．最后开发了基于CoPenML的笔式界面制作环境以及相关工具．结果表明该方案对于笔式用户界面制作是十分有效的．

PIBG Toolkit:一个笔式界面工具箱的分析与设计

PIBG Toolkit是一个基于PIBG交互范式构造而成的笔式应用开发平台:PIBG Toolkit中包含了纸、框等多种交互组件，定义了纸、框和内容三个层次之间的静态结构和动态机制: 开发者开发笔式交互系统时，可以用PIBG Toolkit来建立整体的软件框架和交互机制，并有选择地在系统中添加Toolkit中所提供的交互组件.这样，开发者的精力将会集中在应用领域的内容上.目前，基于该平台已经开发出多个具有很好应用前景的笔式应用系统.

一种新的笔式交互范式的可用性评估

笔式用户界面是Post-WIMP界面的一种重要形态，具有自然、和谐的交互特性。尽管笔式用户界面广泛应用于无处不在计算环境中，但很少专门对它的可用性进行评估。针对笔式用户界面的特征，提出了一种新的笔式用户界面范式，基于此范式设计并实现了一个面向教学的笔式交互系统(PenOffice)，利用此系统对范式从易学性、效率、出错率和用户满意度这几个方面进行了可用性评估，从中分析了笔式用户界面以及这种新的界面范式的优点和不足。

Post-WIMP界面隐式交互特征研究

首先从认知心理学的角度对Post—WIMP界面下的隐式交互特征进行分析和描述。然后通过对传统界面的交互任务生成结构和Post—WIMP界面的交互任务生成结构进行比较,分析Post—WIMP界面交互任务的生成特点。根据这些特点提出了利用识别技术、上下文感知技术和用户修正技术(User Mediation)相结合的方法来支持Post—WIMP界面的隐式交互，并构造了Post—WIMP界面的交互任务生成框架。这些隐式交互特征的研究将为建立Post—WIMP界面软件框架和交互平台提供底层支持。

the tilt cursor: enhancing stimulus-response compatibility by providing 3d orientation cue of pen

In order to improve stimulus-response compatibility of touchpad in pen-based user interface, we present the tilt cursor, i.e. a cursor dynamically reshapes itself to providing the 3D orientation cue of pen. We also present two experiments that evaluate the tilt cursor’s performance in circular menu selection and specific marking menu selection tasks. Results show that in a specific marking menu selection task, the tilt cursor significantly outperforms the shape-fixed arrow cursor and the live cursor [4]. In addition, results show that by using the tilt cursor, the response latencies for adjusting drawing directions are smaller than that by using the other two kinds of cursors.

crossmodal error correction of continuous handwriting recognition by speech

In recognition-based user interface, users’ satisfaction is determined not only by recognition accuracy but also by effort to correct recognition errors. In this paper, we introduce a crossmodal error correction technique, which allows users to correct errors of Chinese handwriting recognition by speech. The focus of the paper is a multimodal fusion algorithm supporting the crossmodal error correction. By fusing handwriting and speech recognition, the algorithm can correct errors in both character extraction and recognition of handwriting. The experimental result indicates that the algorithm is effective and efficient. Moreover, the evaluation also shows the correction technique can help users to correct errors in handwriting recognition more efficiently than the other two error correction techniques.

基于场景方法的笔式界面软件设计工具

为缩短的笔式用户界面软件的开发周期,让设计人员对软件的整体构思在开发过程中得以保持,提高团队人员的交流效率,提出了有关笔式界面软件的文档描述规范PUIML(pen-based user interface modeling language),并设计实现了一个笔交互的笔式用户界面软件设计工具。以笔式操作平台为软件平台,以PUIML为数据模型,采用基于场景设计的开发方法,为设计人员和用户提供自然的纸笔交互方式,设计结果形成PUIML形式的文档,通过主控程序执行。实践结果表明,使用PUI Maker可以解决笔式用户界面开发中存在的以开发人员为中心,原始设计与开发结果不一致等问题,提高了笔式界面软件的开发效率。