Observational research and verbal protocol methods

This paper describes observational research and verbal protocols methods, how these methods are applied and integrated within different contexts, and how they complement each other. The first case study focuses on nurses’ interaction during bandaging of patients’ lower legs. To maintain research rigor a triangulation approach was applied that links observations of current procedures, ‘talk-aloud’ protocol during interaction and retrospective protocol. Maps of interactions demonstrated that some nurses bandage more intuitively than others. Nurses who bandage intuitively assemble long sequences of bandaging actions while nurses who bandage less intuitively ‘focus-shift’ in between bandaging actions. Thus different levels of expertise have been identified. The second case study consists of two laboratory experiments. It focuses on analysing and comparing software and product design teams and how they approached a design problem. It is based on the observational and verbal data analysis. The coding scheme applied evolved during the analysis of the activity of each team and is identical for all teams. The structure of knowledge captured from the analysis of the design team maps of interaction is identified. The significance of this work is within its methodological approach. The maps of interaction are instrumental for understanding the activities and interactions of the people observed. By examining the maps of interaction, it is possible to draw conclusions about interactions, structure of knowledge captured and level of expertise. This research approach is transferable to other design domains. Designers will be able to transfer the interaction maps outcomes to systems and services they design.

Observing documentary reading by verbal protocol

Verifies the applicability to research on indexers' reading strategies of the process observing technique known as Verbal Protocol or Thinking Aloud. This interpretative-qualitative data collecting technique allows the observation of different kinds of process during the progress of different kinds of tasks. Presents a theoretical investigation into reading and into formal methodological procedures to observe reading processes. Describes details of the methodological procedures adopted in five case studies with analysis of samples of data. The project adopted three kinds of parameters for data analysis: theoretical, normative, empirical (derived from observations made in the first case study). The results are compared, and important conclusions regarding documentary reading are drawn.

Evaluation of indexed language used in collective catalogues of university libraries: a socio-cognitive study using verbal protocol

The use of indexing language in university libraries collective catalogs and the socio-cognitive context of indexing and users were evaluated. The methodology consisted of a diagnostic study elaboration of the functioning and treatment procedures of the indexing information from nine libraries of the UNESP Network, representing the Civil Engineering, Pedagogy and Dentistry areas from a data collection using the Verbal Protocol introspective technique in the Individual and Group forms. The study conducted a reflection upon the statements issued by the seventy-two participating individuals whose the results revealed unsatisfactory results about the use of the Subject Headings List of the BIBLIODATA Network, indexing language utilizing by the UNESP Libraries Network, Brazil, in the representation and in the information retrieval process in the ATHENA catalog, about the sequent aspects of the language: lack of specialized vocabulary as well as updated; lack of remissives and of specific headings, and others. We have concluded that the adequate use of indexing languages of specialized scientific areas becomes by means of evaluation as to updating, specificity and compatibility in order to meet the needs of indexing and information retrieval.

On the Use of Regression and Verbal Protocol Analysis in Modeling Analysts’ Behavior in an Unstructured Task Environment: A Methodological Note

This paper discusses areas for future research opportunities by addressing accounting issues faced by management accountants practicing in hospitality organizations. Specifically, the article focuses on the use of the uniform system of accounts by operating properties, the usefulness of allocating support costs to operated departments, extending our understanding of operating costs and performance measurement systems and the certification of practicing accountants.

O uso de linguagem documentária em catálogos coletivos de bibliotecas universitárias: um estudo de avaliação sociocognitiva com protocolo verbal

Avaliou-se o uso de linguagem documentária alfabética de catálogos coletivos, na perspectiva das bibliotecas universitárias e no contexto sociocognitivo dos indexadores e dos usuários. Concluiu-se que o uso adequado de linguagens documentárias de áreas científicas especializadas faz-se por meio da avaliação quanto à atualização, especificidade e compatibilidade para atender às necessidades de indexação e recuperação da informação.

A importância da observação da estrutura textual durante a catalogação de assunto de livros científicos em bibliotecas universitárias: uma análise realizada a partir da técnica de Protocolo Verbal

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Avaliação de linguagem documentária em fonoaudiologia na perspectiva do usuário: estudo de observação da recuperação da informação com protocolo verbal

Pós-graduação em Ciência da Informação - FFC

O ensino do Modelo de Leitura Documentária como recurso pedagógico para indexação na perspectiva entre profissional experiente e aprendiz: a aplicação do Protocolo Verbal Interativo na avaliação do uso e da ação de aprendizagem

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Avaliação do uso de linguagem documentária em catálogos coletivos de bibliotecas universitárias: um estudo sociocognitivo com protocolo verbal

Pós-graduação em Ciência da Informação - FFC

A representação documentária no processo de indexação com o modelo de leitura documentária para textos científicos e livros: uma abordagem cognitiva com protocolo verbal

The documentary representation in indexing is carried out, at first, in the analysis of subjects to establish the intrinsic and extrinsic aboutness, and then, in the translation stage using the documentary language. The representation by concepts for determining the intrinsic aboutness during the subject analysis is shown by the Documentary Reading Model for indexing of scientific texts and books, Therefore, it was carried out a search on documentary reading for cataloguers for indexing books in academic libraries. A research on catalogers’ documentary reading for indexing books was carried out in nine university libraries. The application of the introspective technique of Individual Verbal Protocol with the catalogers allowed an analysis of subject cataloguing procedures, which made it possible to verify the textual structure parts of a book, as well as to locate the terms identified and selected. The results led to an adaptation of the Documentary Reading Model to book indexing.

Política de indexação na catalogação de assunto em bibliotecas universitárias: a visão sociocognitiva da atuação profissional com protocolo verbal

The indexing policy must be represented by means of a philosophy that reflects the system's aims. One of the aspects concerning the indexing policy is relating to the data retrospective conversion. The general aim is to discuss and make a profound study on indexing policy guidelines and to analyze the elements to set up an indexing policy, that should direct the indexing procedures carried out in university libraries using the methodology of verbal protocol. The results demonstrate that the indexing policy serves as a support for the knowledge organization in the catalog, acting as a guide for the librarian when determining the subjects of the documents described in the records. It is concluded that the indexing only will be carried out in the university library during the documentary information treatment by means of a well determined policy.

A classificação bibliográfica no contexto do tratamento temático da informação: um estudo com o protocolo verbal individual em bibliotecas do Instituto Federal de Educação, Ciência e Tecnologia (IF´s)

The discussions that underpin the process of bibliographic classification in documentaries systems should be designed with scientific basis and theoretical, rather than only be based on professional practice. The theoretical approaches, however, attention should also be involved in professional practice. From this, the present study seeks to demonstrate through the perception of catalogers professional, the importance of reflections on the activity of Thematic Treatment of Information, especially the bibliographic classification in order to engender the strengthening of the area and improvements in product quality and services resulting from libraries. In this context, was carried out a study in the libraries of two Federal Institutes of Education, Science and Technology (IF’s) located in two different states of southeastern Brazil. Technique was employed introspective data collection Verbal Protocol in Individual mode, having qualitative character.

Driver behaviour and decision making at railway level crossings : An exploratory on-road case study

Crashes at rail level crossings represent a significant problem, both in Australia and worldwide. Advances in driving assessment methods, such as the provision of on-road instrumented test vehicles, now provide researchers with the opportunity to further understand driver behaviour at rail level crossings in ways not previously possible. This paper gives an overview of a recent on-road pilot study of driver behaviour at rail level crossings in which 25 participants drove a pre-determined route, incorporating 4 rail level crossings, using MUARC's instrumented On-Road Test Vehicle (ORTeV). Drivers provided verbal commentary whilst driving the route, and a range of other data were collected, including eye fixations, forward, cockpit and driver video, and vehicle data (speed, braking, steering wheel angle, lane tracking etc). Participants also completed a post trial cognitive task analysis interview. Extracts from the wider analyses are used to examine in depth driver behaviour at one of the rail level crossings encountered during the study. The analysis presented, along with the overall analysis undertaken, gives insight into the driver and wider systems factors that shape behaviour at rail level crossings, and highlights the utility of using a multi-method, instrumented vehicle approach for gathering data regarding driver behaviour in different contexts.

To err (on the road) is human? An on-road study of driver errors

Human error, its causes and consequences, and the ways in which it can be prevented, remain of great interest to road safety practitioners. This paper presents the findings derived from an on-road study of driver errors in which 25 participants drove a pre-determined route using MUARC's On-Road Test Vehicle (ORTeV). In-vehicle observers recorded the different errors made, and a range of other data was collected, including driver verbal protocols, forward, cockpit and driver video, and vehicle data (speed, braking, steering wheel angle, lane tracking etc). Participants also completed a post trial cognitive task analysis interview. The drivers tested made a range of different errors, with speeding violations, both intentional and unintentional, being the most common. Further more detailed analysis of a sub-set of specific error types indicates that driver errors have various causes, including failures in the wider road 'system' such as poor roadway design, infrastructure failures and unclear road rules. In closing, a range of potential error prevention strategies, including intelligent speed adaptation and road infrastructure design, are discussed.

Multitasking, cognitive coordination and cognitive shifts during web searching

As Web searching becomes more prolific for information access worldwide, we need to better understand users’ Web searching behaviour and develop better models of their interaction with Web search systems. Web search modelling is a significant and important area of Web research. Searching on the Web is an integral element of information behaviour and human–computer interaction. Web searching includes multitasking processes, the allocation of cognitive resources among several tasks, and shifts in cognitive, problem and knowledge states. In addition to multitasking, cognitive coordination and cognitive shifts are also important, but are under-explored aspects of Web searching. During the Web searching process, beyond physical actions, users experience various cognitive activities. Interactive Web searching involves many users’ cognitive shifts at different information behaviour levels. Cognitive coordination allows users to trade off the dependences among multiple information tasks and the resources available. Much research has been conducted into Web searching. However, few studies have modelled the nature of and relationship between multitasking, cognitive coordination and cognitive shifts in the Web search context. Modelling how Web users interact with Web search systems is vital for the development of more effective Web IR systems. This study aims to model the relationship between multitasking, cognitive coordination and cognitive shifts during Web searching. A preliminary theoretical model is presented based on previous studies. The research is designed to validate the preliminary model. Forty-two study participants were involved in the empirical study. A combination of data collection instruments, including pre- and post-questionnaires, think-aloud protocols, search logs, observations and interviews were employed to obtain users’ comprehensive data during Web search interactions. Based on the grounded theory approach, qualitative analysis methods including content analysis and verbal protocol analysis were used to analyse the data. The findings were inferred through an analysis of questionnaires, a transcription of think-aloud protocols, the Web search logs, and notes on observations and interviews. Five key findings emerged. (1) Multitasking during Web searching was demonstrated as a two-dimensional behaviour. The first dimension was represented as multiple information problems searching by task switching. Users’ Web searching behaviour was a process of multiple tasks switching, that is, from searching on one information problem to searching another. The second dimension of multitasking behaviour was represented as an information problem searching within multiple Web search sessions. Users usually conducted Web searching on a complex information problem by submitting multiple queries, using several Web search systems and opening multiple windows/tabs. (2) Cognitive shifts were the brain’s internal response to external stimuli. Cognitive shifts were found as an essential element of searching interactions and users’ Web searching behaviour. The study revealed two kinds of cognitive shifts. The first kind, the holistic shift, included users’ perception on the information problem and overall information evaluation before and after Web searching. The second kind, the state shift, reflected users’ changes in focus between the different cognitive states during the course of Web searching. Cognitive states included users’ focus on the states of topic, strategy, evaluation, view and overview. (3) Three levels of cognitive coordination behaviour were identified: the information task coordination level, the coordination mechanism level, and the strategy coordination level. The three levels of cognitive coordination behaviour interplayed to support multiple information tasks switching. (4) An important relationship existed between multitasking, cognitive coordination and cognitive shifts during Web searching. Cognitive coordination as a management mechanism bound together other cognitive processes, including multitasking and cognitive shifts, in order to move through users’ Web searching process. (5) Web search interaction was shown to be a multitasking process which included information problems ordering, task switching and task and mental coordinating; also, at a deeper level, cognitive shifts took place. Cognitive coordination was the hinge behaviour linking multitasking and cognitive shifts. Without cognitive coordination, neither multitasking Web searching behaviour nor the complicated mental process of cognitive shifting could occur. The preliminary model was revisited with these empirical findings. A revised theoretical model (MCC Model) was built to illustrate the relationship between multitasking, cognitive coordination and cognitive shifts during Web searching. Implications and limitations of the study are also discussed, along with future research work.