Navigating the methodological mire : practical epistemology in design research

The field of design research is a marketplace of methodological diversity. It isn't just that there are many different research methods in the field, but that there are many different methodological 'foundations' - principles for how research can and should be done, for how contributions to knowledge ought to be pursued. This is not particularly surprising given how broadly 'design' is often conceptualised. Herbert Simon (1996) suggested "the proper study of mankind is the science of design"; Nigel Cross has identified a principal difference between humankind and the animal kingdom to be our ability to design. In light of such encompassing notions of design it is difficult to imagine how the field of design research should exhibit any less diversity than that found within and among the arts, humanities, the human and social sciences.

The Driver Behaviour Questionnaire as accident predictor: A methodological re-meta-analysis

Problem The Manchester Driver Behaviour Questionnaire (DBQ) is the most commonly used self-report tool in traffic safety research and applied settings. It has been claimed that the violation factor of this instrument predicts accident involvement, which was supported by a previous meta-analysis. However, that analysis did not test for methodological effects, or include contacting researchers to obtain unpublished results. Method The present study re-analysed studies on prediction of accident involvement from DBQ factors, including lapses, and many unpublished effects. Tests of various types of dissemination bias and common method variance were undertaken. Results Outlier analysis showed that some effects were probably not reliable data, but excluding them did not change the results. For correlations between violations and crashes, tendencies for published effects to be larger than unpublished ones and for effects to decrease over time were observed, but were not significant. Also, analysis using the proxy of the mean of accidents in studies indicated that studies where effects for violations are unknown have smaller effect sizes. These differences indicate dissemination bias. Studies using self-reported accidents as dependent variables had much larger effects than those using recorded accident data. Also, zero-order correlations were larger than partial correlations that controlled for exposure. Similarly, violations/accidents effects were strong only when there was also a strong correlation between accidents and exposure. Overall, the true effect is probably very close to zero (r<.07) for violations versus traffic accident involvement, depending upon which systematic tendencies in the data are controlled for. Conclusions: Methodological factors and dissemination bias have inflated the mean effect size of the DBQ in the published literature. Strong evidence of various artefactual effects is apparent. Practical Applications A greater level of care should be taken if the DBQ continues to be used in traffic safety research. Also, validation of self-reports should be more comprehensive in the future, taking into account the possibility of common method variance.

Disruptive innovations in complex product systems industries: A case study

We propose that disruptive changes pertaining to complex product systems (CoPS) will yield a different set of characteristics than those traditionally observed for commodity products, and seek evidence for this proposition in a case study of the Flash Converting technology, a disruptive CoPS innovation in the copper production industry. Our results show that unlike disruptions in commodity product industries, the incumbent CoPS technology does not overshoot mainstream market performance demand. Also, the disruptive CoPS innovation: (i) is not nurtured in low-end niche markets; (ii) initially satisfies mainstream market performance demand, and; (iii) has higher unit price than the incumbent technology.

Transportation disadvantage impedance indexing: A methodological approach to reduce policy shortcomings

Access to transport systems and the connection to such systems provided to essential economic and social activities are critical to determine households' transportation disadvantage levels. In spite of the developments in better identifying transportation disadvantaged groups, the lack of effective policies resulted in the continuum of the issue as a significant problem. This paper undertakes a pilot case investigation as test bed for a new approach developed to reduce transportation policy shortcomings. The approach, ‘disadvantage-impedance index’, aims to ease transportation disadvantages by employing representative parameters to measure the differences between policy alternatives run in a simulation environment. Implemented in the Japanese town of Arao, the index uses trip-making behaviour and resident stated preference data. The results of the index reveal that even a slight improvement in accessibility and travel quality indicators makes a significant difference in easing disadvantages. The index, integrated into a four-step model, proves to be highly robust and useful in terms of quick diagnosis in capturing effective actions, and developing potentially efficient policies.

Milling innovations at Rocky Point

This paper reviews the innovations that have been introduced in the milling train at Rocky Point mill since 2001 and provides some operational, performance and maintenance comparisons of the technologies in use. The decision to install BHEM mills in the #2 and #3 mill positions to complement the six-roll mills in the #1 and #4 mill positions has proven a good one. Satisfactory performance is being obtained by these mills while maintenance costs are significantly less. Very good #1 mill extraction and final bagasse moisture content are being achieved. The innovation of using Hägglunds hydraulic drives at higher speed…

New Curriculum History

"Rereading the historical record indicates that it is no longer so easy to argue that history is simply prior to its forms. Since the mid-1990s a new wave of research has formed around wider debates in the humanities and social sciences, such as decentering the subject, new analytics of power, reconsideration of one-dimensional time and three-dimensional space, attention to beyond-archival sources, alterity, Otherness, the invisible, and more. In addition, broader and contradictory impulses around the question of the nation - transnational, post-national, proto-national, and neo-national movements – have unearthed a new series of problematics and focused scholarly attention on traveling discourses, national imaginaries, and less formal processes of socialization, bonding, and subjectification. New Curriculum History challenges prior occlusions in the field, building upon and departing from previous waves of scholarship, extending the focus beyond the insularity of public schooling, the traditional framework of the self-contained nation-state, and the psychology of the schooled individual. Drawing on global studies, historical sociology, postcolonial studies, critical race theory, visual culture theory, disability studies, psychoanalytics, Cambridge school structuralisms, poststructuralisms, and infra- and transnational approaches the volume holds together not despite but because of differences and incommensurabilities in rereading historical records. Audience: Scholars and students in curriculum studies, history, education, philosophy, and cultural studies will be interested in these chapters for their methodological range, their innovations and their deterritorializations."--publisher website

A methodological survey of future mobility literature: Opportunities for design research

This research establishes that the study of mobility and transportation is multi-disciplinary and highly complex, involving the diverse interplay between infrastructural and psychological factors. Coincidently, a new paradigm in personal mobility is developing. A new generation of mobility solutions is becoming widely available in the form of car and ride sharing services. These services build on the assumption that customers no longer need ownership of a product in order to benefit from it. With the emergence of this new paradigm, this paper presents a methodological review of current practises used by the wider research community. Therefore, this research piece aims to explore methodological approaches involved in the study the effect of community on an individual’s attitudes, perceptions and behaviours of future mobility solutions. The results of this review indicate that the majority of published literature uses quantitative methods as opposed to qualitative and even fewer studies have sought to understand the human factors in these new mobility solutions. This gap in knowledge is a valuable opportunity for design. Inherently qualitative and human focused, design research can fill this gap in knowledge by applying distinctly user-centred methods such as persona design, narrative storytelling, and in-depth observations to discover deeper human insights.

Methodological innovation in precarious spaces: The case of Twitter

Social media analytics is a rapidly developing field of research at present: new, powerful ‘big data’ research methods draw on the Application Programming Interfaces (APIs) of social media platforms. Twitter has proven to be a particularly productive space for such methods development, initially due to the explicit support and encouragement of Twitter, Inc. However, because of the growing commercialisation of Twitter data, and the increasing API restrictions imposed by Twitter, Inc., researchers are now facing a considerably less welcoming environment, and are forced to find additional funding for paid data access, or to bend or break the rules of the Twitter API. This article considers the increasingly precarious nature of ‘big data’ Twitter research, and flags the potential consequences of this shift for academic scholarship.

Methodological and Empirical Advances in the Quantitative Analysis of Spontaneous Responses in Psychophysiological Time Series

The aim of the present study was to advance the methodology and use of time series analysis to quantify dynamic structures in psychophysiological processes and thereby to produce information on spontaneously coupled physiological responses and their behavioral and experiential correlates. Series of analyses using both simulated and empirical cardiac (IBI), electrodermal (EDA), and facial electromyographic (EMG) data indicated that, despite potential autocorrelated structures, smoothing increased the reliability of detecting response coupling from an interindividual distribution of intraindividual measures and that especially the measures of covariance produced accurate information on the extent of coupled responses. This methodology was applied to analyze spontaneously coupled IBI, EDA, and facial EMG responses and vagal activity in their relation to emotional experience and personality characteristics in a group of middle-aged men (n = 37) during the administration of the Rorschach testing protocol. The results revealed new characteristics in the relationship between phasic end-organ synchronization and vagal activity, on the one hand, and individual differences in emotional adjustment to novel situations on the other. Specifically, it appeared that the vagal system is intimately related to emotional and social responsivity. It was also found that the lack of spontaneously synchronized responses is related to decreased energetic arousal (e.g., depression, mood). These findings indicate that the present process analysis approach has many advantages for use in both experimental and applied research, and that it is a useful new paradigm in psychophysiological research. Keywords: Autonomic Nervous System; Emotion; Facial Electromyography; Individual Differences; Spontaneous Responses; Time Series Analysis; Vagal System

Assessing organizational culture in complex sociotechnical systems : Methodological evidence from studies in nuclear power plant maintenance organizations

Failures in industrial organizations dealing with hazardous technologies can have widespread consequences for the safety of the workers and the general population. Psychology can have a major role in contributing to the safe and reliable operation of these technologies. Most current models of safety management in complex sociotechnical systems such as nuclear power plant maintenance are either non-contextual or based on an overly-rational image of an organization. Thus, they fail to grasp either the actual requirements of the work or the socially-constructed nature of the work in question. The general aim of the present study is to develop and test a methodology for contextual assessment of organizational culture in complex sociotechnical systems. This is done by demonstrating the findings that the application of the emerging methodology produces in the domain of maintenance of a nuclear power plant (NPP). The concepts of organizational culture and organizational core task (OCT) are operationalized and tested in the case studies. We argue that when the complexity of the work, technology and social environment is increased, the significance of the most implicit features of organizational culture as a means of coordinating the work and achieving safety and effectiveness of the activities also increases. For this reason a cultural perspective could provide additional insight into the problem of safety management. The present study aims to determine; (1) the elements of the organizational culture in complex sociotechnical systems; (2) the demands the maintenance task sets for the organizational culture; (3) how the current organizational culture at the case organizations supports the perception and fulfilment of the demands of the maintenance work; (4) the similarities and differences between the maintenance cultures at the case organizations, and (5) the necessary assessment of the organizational culture in complex sociotechnical systems. Three in-depth case studies were carried out at the maintenance units of three Nordic NPPs. The case studies employed an iterative and multimethod research strategy. The following methods were used: interviews, CULTURE-survey, seminars, document analysis and group work. Both cultural analysis and task modelling were carried out. The results indicate that organizational culture in complex sociotechnical systems can be characterised according to three qualitatively different elements: structure, internal integration and conceptions. All three of these elements of culture as well as their interrelations have to be considered in organizational assessments or important aspects of the organizational dynamics will be overlooked. On the basis of OCT modelling, the maintenance core task was defined as balancing between three critical demands: anticipating the condition of the plant and conducting preventive maintenance accordingly, reacting to unexpected technical faults and monitoring and reflecting on the effects of maintenance actions and the condition of the plant. The results indicate that safety was highly valued at all three plants, and in that sense they all had strong safety cultures. In other respects the cultural features were quite different, and thus the culturally-accepted means of maintaining high safety also differed. The handicraft nature of maintenance work was emphasised as a source of identity at the NPPs. Overall, the importance of safety was taken for granted, but the cultural norms concerning the appropriate means to guarantee it were little reflected. A sense of control, personal responsibility and organizational changes emerged as challenging issues at all the plants. The study shows that in complex sociotechnical systems it is both necessary and possible to analyse the safety and effectiveness of the organizational culture. Safety in complex sociotechnical systems cannot be understood or managed without understanding the demands of the organizational core task and managing the dynamics between the three elements of the organizational culture.

Innovations in Knowledge and Learning for Competitive Higher Education in Asia and the Pacific

Competitive advantage in a knowledge economy is dependent on the ability to innovate and create new knowledge products and services, and to find innovative applications for them. Higher education institutions in Asia and the Pacific, modelled on industrial age thinking that demands excellence in routinized capacities, lack the ability to innovate and create new knowledge enterprises. The transition to a knowledge economy is affecting the purpose, content, pedagogy, and methodologies of higher education. Nontraditional stakeholders such as professional bodies, industry experts, think tanks, research institutes, and field experts/practitioners are now involved not only in planning but in providing higher education services. The traditional model of “knowledge versus skills” is no longer relevant. Higher education programs must consider lived experiences, contextual knowledge, and indigenous knowledge.

The importance of grasslands for animal production and other functions: a review on management and methodological progress in the tropics

The global importance of grasslands is indicated by their extent; they comprise some 26% of total land area and 80% of agriculturally productive land. The majority of grasslands are located in tropical developing countries where they are particularly important to the livelihoods of some one billion poor peoples. Grasslands clearly provide the feed base for grazing livestock and thus numerous high-quality foods, but such livestock also provide products such as fertilizer, transport, traction, fibre and leather. In addition, grasslands provide important services and roles including as water catchments, biodiversity reserves, for cultural and recreational needs, and potentially a carbon sink to alleviate greenhouse gas emissions. Inevitably, such functions may conflict with management for production of livestock products. Much of the increasing global demand for meat and milk, particularly from developing countries, will have to be supplied from grassland ecosystems, and this will provide difficult challenges. Increased production of meat and milk generally requires increased intake of metabolizable energy, and thus increased voluntary intake and/or digestibility of diets selected by grazing animals. These will require more widespread and effective application of improved management. Strategies to improve productivity include fertilizer application, grazing management, greater use of crop by-products, legumes and supplements and manipulation of stocking rate and herbage allowance. However, it is often difficult to predict the efficiency and cost-effectiveness of such strategies, particularly in tropical developing country production systems. Evaluation and on-going adjustment of grazing systems require appropriate and reliable assessment criteria, but these are often lacking. A number of emerging technologies may contribute to timely low-cost acquisition of quantitative information to better understand the soil-pasture-animal interactions and animal management in grassland systems. Development of remote imaging of vegetation, global positioning technology, improved diet markers, near IR spectroscopy and modelling provide improved tools for knowledge-based decisions on the productivity constraints of grazing animals. Individual electronic identification of animals offers opportunities for precision management on an individual animal basis for improved productivity. Improved outcomes in the form of livestock products, services and/or other outcomes from grasslands should be possible, but clearly a diversity of solutions are needed for the vast range of environments and social circumstances of global grasslands.

Methodological issues with older users as research participants

Researching with older participants presents many unique methodological challenges. One of the reasons for this is the greater variability in abilities among older than among younger people. Thus, the standard practice in user research of assuming homogeneity in a certain demographic group may not work with older adults. Designing experiments for users with diverse capabilities is challenging and calls for re-examination of existing experimental design methods. In this paper we will share our experience in researching with people with diverse capabilities and present its implications and possible way to address them.

Comprehensive Two-Dimensional Gas Chromatography: Instrumental and Methodological Development

Comprehensive two-dimensional gas chromatography (GC×GC) offers enhanced separation efficiency, reliability in qualitative and quantitative analysis, capability to detect low quantities, and information on the whole sample and its components. These features are essential in the analysis of complex samples, in which the number of compounds may be large or the analytes of interest are present at trace level. This study involved the development of instrumentation, data analysis programs and methodologies for GC×GC and their application in studies on qualitative and quantitative aspects of GC×GC analysis. Environmental samples were used as model samples. Instrumental development comprised the construction of three versions of a semi-rotating cryogenic modulator in which modulation was based on two-step cryogenic trapping with continuously flowing carbon dioxide as coolant. Two-step trapping was achieved by rotating the nozzle spraying the carbon dioxide with a motor. The fastest rotation and highest modulation frequency were achieved with a permanent magnetic motor, and modulation was most accurate when the motor was controlled with a microcontroller containing a quartz crystal. Heated wire resistors were unnecessary for the desorption step when liquid carbon dioxide was used as coolant. With use of the modulators developed in this study, the narrowest peaks were 75 ms at base. Three data analysis programs were developed allowing basic, comparison and identification operations. Basic operations enabled the visualisation of two-dimensional plots and the determination of retention times, peak heights and volumes. The overlaying feature in the comparison program allowed easy comparison of 2D plots. An automated identification procedure based on mass spectra and retention parameters allowed the qualitative analysis of data obtained by GC×GC and time-of-flight mass spectrometry. In the methodological development, sample preparation (extraction and clean-up) and GC×GC methods were developed for the analysis of atmospheric aerosol and sediment samples. Dynamic sonication assisted extraction was well suited for atmospheric aerosols collected on a filter. A clean-up procedure utilising normal phase liquid chromatography with ultra violet detection worked well in the removal of aliphatic hydrocarbons from a sediment extract. GC×GC with flame ionisation detection or quadrupole mass spectrometry provided good reliability in the qualitative analysis of target analytes. However, GC×GC with time-of-flight mass spectrometry was needed in the analysis of unknowns. The automated identification procedure that was developed was efficient in the analysis of large data files, but manual search and analyst knowledge are invaluable as well. Quantitative analysis was examined in terms of calibration procedures and the effect of matrix compounds on GC×GC separation. In addition to calibration in GC×GC with summed peak areas or peak volumes, simplified area calibration based on normal GC signal can be used to quantify compounds in samples analysed by GC×GC so long as certain qualitative and quantitative prerequisites are met. In a study of the effect of matrix compounds on GC×GC separation, it was shown that quality of the separation of PAHs is not significantly disturbed by the amount of matrix and quantitativeness suffers only slightly in the presence of matrix and when the amount of target compounds is low. The benefits of GC×GC in the analysis of complex samples easily overcome some minor drawbacks of the technique. The developed instrumentation and methodologies performed well for environmental samples, but they could also be applied for other complex samples.

Persistence is fertile: Pushing methodological potentialities in education research

As more is known about contemporary cultural shifts and the effect this has on the young, research must consider how children operate as global citizens. Children are innocent and vulnerable, but also actively participate in the world; research into early childhood must therefore refine ideas and conceptions and develop research methodologies that see children as superdiverse young citizens. Intergenerational collaborative drawing, which involves adult researchers and children drawing together, is a method that supports superdimensions. A group of researchers tested the method to consider the politics of research, particularly when researcher neutrality and the conventions around gathering ‘unsullied’ data are challenged.