GUI Inspection from Source Code Analysis

Graphical user interfaces (GUIs) are critical components of todays software. Given their increased relevance, correctness and usability of GUIs are becoming essential. This paper describes the latest results in the development of our tool to reverse engineer the GUI layer of interactive computing systems. We use static analysis techniques to generate models of the user interface behaviour from source code. Models help in graphical user interface inspection by allowing designers to concentrate on its more important aspects. One particularly type of model that the tool is able to generate is state machines. The paper shows how graph theory can be useful when applied to these models. A number of metrics and algorithms are used in the analysis of aspects of the user interface's quality. The ultimate goal of the tool is to enable analysis of interactive system through GUIs source code inspection.

GUI Behavior from Source Code Analysis

When developing interactive applications, considering the correctness of graphical user interfaces (GUIs) code is essential. GUIs are critical components of today's software, and contemporary software tools do not provide enough support for ensuring GUIs' code quality. GUIsurfer, a GUI reverse engineering tool, enables evaluation of behavioral properties of user interfaces. It performs static analysis of GUI code, generating state machines that can help in the evaluation of interactive applications. This paper describes the design, software architecture, and the use of GUIsurfer through an example. The tool is easily re-targetable, and support is available to Java/Swing, and WxHaskell. The paper sets the ground for a generalization effort to consider rich internet applications. It explores the GWT web applications' user interface programming toolkit.

The GUISurfer tool: towards a language independent approach to reverse engineering GUI code

Graphical user interfaces (GUIs) are critical components of today's software. Developers are dedicating a larger portion of code to implementing them. Given their increased importance, correctness of GUIs code is becoming essential. This paper describes the latest results in the development of GUISurfer, a tool to reverse engineer the GUI layer of interactive computing systems. The ultimate goal of the tool is to enable analysis of interactive system from source code.

A Generic Library for GUI Reasoning and Testing

Graphical user interfaces (GUIs) make software easy to use by providing the user with visual controls. Therefore, correctness of GUI's code is essential to the correct execution of the overall software. Models can help in the evaluation of interactive applications by allowing designers to concentrate on its more important aspects. This paper presents a generic model for language-independent reverse engineering of graphical user interface based applications, and we explore the integration of model-based testing techniques in our approach, thus allowing us to perform fault detection. A prototype tool has been constructed, which is already capable of deriving and testing a user interface behavioral model of applications written in Java/Swing.

Models for the Reverse Engineering of Java/Swing Applications

Abstract. Interest in design and development of graphical user interface (GUIs) is growing in the last few years. However, correctness of GUI's code is essential to the correct execution of the overall software. Models can help in the evaluation of interactive applications by allowing designers to concentrate on its more important aspects. This paper describes our approach to reverse engineering abstract GUI models directly from the Java/Swing code.

An approach for graphical user interface bad smells detection

In the context of an e ort to develop methodologies to support the evaluation of interactive system, this paper investigates an approach to detect graphical user interface bad smells. Our approach consists in detecting user interface bad smells through model-based reverse engineering from source code. Models are used to de ne which widgets are present in the interface, when can particular graphical user interface (GUI) events occur, under which conditions, which system actions are executed, and which GUI state is generated next.

Analysis of computing open source systems

Graphical user interfaces (GUIs) are critical components of today's open source software. Given their increased relevance, the correctness and usability of GUIs are becoming essential. This paper describes the latest results in the development of our tool to reverse engineer the GUI layer of interactive computing open source systems. We use static analysis techniques to generate models of the user interface behavior from source code. Models help in graphical user interface inspection by allowing designers to concentrate on its more important aspects. One particular type of model that the tool is able to generate is state machines. The paper shows how graph theory can be useful when applied to these models. A number of metrics and algorithms are used in the analysis of aspects of the user interface's quality. The ultimate goal of the tool is to enable analysis of interactive system through GUIs source code inspection.

Metodologia de Suporte à Utilização de Sistemas Interativos

Interactive systems users still face several challenge. Besides current improvements in usability and intuitiveness users have to adapt to the systems proposed to satisfy their needs. For instance, they must learn how to achieve tasks, how to interact with the system, etc. This paper proposes a methodology to improve this situation supporting the use of interactive systems by users. To achieve this goal the approach is based on enriched task models and picture-driven computing. An example based on a text editor illustrates the approach.

A Methodology for GUI Layer Redefinition Through Virtualization and Computer Vision

Nowadays despite improvements in usability and intuitiveness users have to adapt to the proposed systems to satisfy their needs. For instance, they must learn how to achieve tasks, how to interact with the system, and fulfill system's specifications. This paper proposes an approach to improve this situation enabling graphical user interface redefinition through virtualization and computer vision with the aim of increasing the system's usability. To achieve this goal the approach is based on enriched task models, virtualization and picture-driven computing.

The strategic management of creation process and of change: a theoretical contribute from the perspective of tourism

The entrepreneurship and innovation have been gradually gaining ground in the academic community as a field of study. However, the interpretations surrounding fragmented, without a univocal definition. In last decades, tourism has received greater attention from researchers in various sciences, varying only by the different emphases considered: economic, social, cultural and environmental. As other emerging sectors in a modern economy, tourism is a dynamic and ever-changing industry. The study has as purpose to provide a better understanding regarding the essence of entrepreneurship: theoretical and practical implications from the perspective of tourism. Regarding the methodology used here, this is a conceptual paper with a literature review that brings together the major components of entrepreneurship and its implications tourist perspective and conceptual model of the dynamic nature of the Triggering Process and innovation (e.g. iTravey, Interactive Stores, Tourist Transportable Tower).

Towards a Catalog of Usability Smells

This paper presents a catalog of smells in the context of interactive applications. These so-called usability smells are indicators of poor design on an application’s user interface, with the potential to hinder not only its usability but also its maintenance and evolution. To eliminate such usability smells we discuss a set of program/usability refactorings. In order to validate the presented usability smells catalog, and the associated refactorings, we present a preliminary empirical study with software developers in the context of a real open source hospital management application. Moreover, a tool that computes graphical user interface behavior models, giving the applications’ source code, is used to automatically detect usability smells at the model level.

Semi-automatic 3D Segmentation Of Costal Cartilage In CT Data From Pectus Excavatum Patients

One of the current frontiers in the clinical management of Pectus Excavatum (PE) patients is the prediction of the surgical outcome prior to the intervention. This can be done through computerized simulation of the Nuss procedure, which requires an anatomically correct representation of the costal cartilage. To this end, we take advantage of the costal cartilage tubular structure to detect it through multi-scale vesselness filtering. This information is then used in an interactive 2D initialization procedure which uses anatomical maximum intensity projections of 3D vesselness feature images to efficiently initialize the 3D segmentation process. We identify the cartilage tissue centerlines in these projected 2D images using a livewire approach. We finally refine the 3D cartilage surface through region-based sparse field level-sets. We have tested the proposed algorithm in 6 noncontrast CT datasets from PE patients. A good segmentation performance was found against reference manual contouring, with an average Dice coefficient of 0.75±0.04 and an average mean surface distance of 1.69±0.30mm. The proposed method requires roughly 1 minute for the interactive initialization step, which can positively contribute to an extended use of this tool in clinical practice, since current manual delineation of the costal cartilage can take up to an hour.

Criticismo Ludológico: Simulação ergódica (jogabilidade) vs ficção narrativa

Neste ensaio pretendemos reflectir sobre algumas das diferenças a estabelecer entre as noções de «jogabilidade ergódica» e de «ficção narrativa», essencialmente, por relação com as categorias de «simulação» e de «representação». Como acontece sempre em casos semelhantes, as primeiras investigações neste campo do saber (que se desenvolvem como uma das linhas de investigação do criticismo ludológico, sobretudo, a partir dos finais dos anos 90) consideram o estudo dos jogos no contexto das teorias já existentes, em especial, comparativamente às teorias narratológicas, o que não será de estranhar se se disser que, com efeito, enquanto o estudo sobre jogos tem perto de 40 anos, o sobre narrativas já leva vários séculos de avanço, sendo um dos mais influentes da nossa cultura Ocidental, iniciando-se, precisamente, com os estudos desenvolvidos a partir da Poética aristotélica. No entanto, se haverá, porventura, jogos em que a composição «narrativa» é por demais evidente (como é o caso, por exemplo, da maioria dos de aventura), contudo, haverá outros em que ela é (claramente) substituída pela componente «jogabilidade» e pelos mecanismos de (pura) simulação. Por exemplo, uma coisa é a «representação» (imagética) da cidade de Londres e outra, bem diferente, a «simulação» (maquínica) de uma cidade de Sim City, obedecendo a um «modelo» que inclui «regras» (de comportamento). Ou seja, enquanto uma narrativa descreve acontecimentos particulares, passíveis de serem generalizados para se inferirem as regras; os jogos, enquanto simulações, baseiam-se em regras gerais que podem ser aplicadas a casos particulares, possibilitando a «experimentação» e a possibilidade de se «modelar» as regras que governam o sistema. A questão que prima facie se coloca, e que já tem vindo a ser referida, com maior ou menor insistência e acutilância, por outros teóricos, é saber se este novo objecto de estudo, designado de «videojogo» ou de «jogo de electrónico/computador», enquanto objecto de estudo da Ludologia (mas que não se esgota nele!), não obriga à construção de novas categorias hermenêuticas, por implicar uma actividade, em termos de experiência, diferente daquela analisada, em termos formais, pelas metodologias descritivas em causa. É que, com efeito, a categoria da simulação ergódica/«jogabilidade» permite novas formas de experienciar/construir a mediação/imersão e, com ela, mais perto de nos retratarmos, lúdica e maquinicamente, do lado-de-lá do espelho/ecrã (diferente do espelho/papel) em que nos vemos transformar, quantas vezes heteronimicamente, numa qualquer Alice feita gente.

Realism in Gameplay: Digital Fiction and Embodiment

In this article we argue that digital simulations promote and explore complex relations between the player and the machines cybernetic system with which it relates through gameplay, that is, the real application of tactics and strategies used by participants as they play the game. We plan to show that the realism of simulation, together with the merger of artificial objects with the real world, can generate interactive empathy between players and their avatars. In this text, we intend to explore augmented reality as a means to visualise interactive communication projects. With ARToolkit, Virtools and 3ds Max applications, we aim to show how to create a portable interactive platform that resorts to the environment and markers for constructing the games scenario. Many of the conventional functions of the human eye are being replaced by techniques where images do not position themselves in the traditional manner that we observe them (Crary, 1998), or in the way we perceive the real world. The digitalization of the real world to a new informational layer over objects, people or environments, needs to be processed and mediated by tools that amplify the natural human senses.

Augmented Reality for Games

In this text, we intend to explore augmented reality as a means to visualise interactive communication projects. With ARToolkit, Virtools and 3ds Max applications, we aim to show how to create a portable interactive platform that resorts to the environment and markers for constructing the game’s scenario. We plan to show that the realism of simulation, together with the merger of artificial objects with the real world, can generate interactive empathy between players and their avatars.