The Mixed-Method Library: Qualitative Research and the Future of Assessment in Higher Education

This presentation was offered as part of the CUNY Library Assessment Conference, Reinventing Libraries: Reinventing Assessment, held at the City University of New York in June 2014.

Stability analysis of power system including facts (TCSC) effects by direct method approach

The problem of power system stability including the effects of a flexible alternating current transmission system (FACTS) is approached. First, the controlled series compensation is considered in the machine against infinite bar system and its effects are taken into account by means of construction of a Lyapunov function (LF). This simple system is helpful in order to understand the form the device affects dynamic and transient performance of the power system. After, the multimachine case is considered and it is shown that the single-machine results apply to multimachine systems. An energy-form Lyapunov function is derived for the power system including the FACTS device and it is used to analyse damping and synchronizing effects due to the FACTS device in single-machine as well as in multimachine power systems. © 2005 Elsevier Ltd. All rights reserved.

Simulation of the flow through automatic valves of hermetic compressors by the immersed boundary method approach

The main goal of the present work is to verify the applicability of the Immersed Boundary Method together with the Virtual Physical Model to solve the flow through automatic valves of hermetic compressors. The valve was simplified to a two-dimensional radial diffuser, with diameter ratio of D/d = 1.5, and simulated for a one cycle of opening and closing process with a imposed velocity of 3.0 cm/s for the reed, dimensionless gap between disks in the range of 0.07 < s/d < 0.10, and inlet Reynolds number equal to 1500. The good results obtained showed that the methodology has great potential as project tool for this type of valve systems. © The Authors, 2011.

Describing the Situational Contexts of Sweetened Product Consumption in a Middle Eastern Canadian Community: Application of a Mixed Method Design

Little is known about the situational contexts in which individuals consume processed sources of dietary sugars. This study aimed to describe the situational contexts associated with the consumption of sweetened food and drink products in a Catholic Middle Eastern Canadian community. A two-stage exploratory sequential mixed-method design was employed with a rationale of triangulation. In stage 1 (n = 62), items and themes describing the situational contexts of sweetened food and drink product consumption were identified from semi-structured interviews and were used to develop the content for the Situational Context Instrument for Sweetened Product Consumption (SCISPC). Face validity, readability and cultural relevance of the instrument were assessed. In stage 2 (n = 192), a cross-sectional study was conducted and exploratory factor analysis was used to examine the structure of themes that emerged from the qualitative analysis as a means of furthering construct validation. The SCISPC reliability and predictive validity on the daily consumption of sweetened products were also assessed. In stage 1, six themes and 40-items describing the situational contexts of sweetened product consumption emerged from the qualitative analysis and were used to construct the first draft of the SCISPC. In stage 2, factor analysis enabled the clarification and/or expansion of the instrument's initial thematic structure. The revised SCISPC has seven factors and 31 items describing the situational contexts of sweetened product consumption. Initial validation of the instrument indicated it has excellent internal consistency and adequate test-retest reliability. Two factors of the SCISPC had predictive validity for the daily consumption of total sugar from sweetened products (Snacking and Energy demands) while the other factors (Socialization, Indulgence, Constraints, Visual Stimuli and Emotional needs) were rather associated to occasional consumption of these products.

International Service-Learning and the Development of Civic Identity: Understanding the Role of Short-Term International Service-Learning and its Influence on the Development of Civic Identity in College Students Using a Mixed Methodological Approach

Higher education has a responsibility to educate a democratic citizenry and recent research indicates civic engagement is on the decline in the United States. Through a mixed methodological approach, I demonstrate that the potential exists for well structured short-term international service-learning programming to develop college students’ civic identities. Quantitative analysis of questionnaire data, collected from American college students immediately prior to their participation in a short-term service-learning experience in Northern Ireland and again upon their return to the United States, revealed increases in civic accountability, political efficacy, justice oriented citizenship, and service-learning. Subsequent qualitative analysis of interview transcripts, student journals, and field notes suggested that facilitated critical reflection before, during, and after the experience promoted transformational learning. Emergent themes included: (a) responsibilities to others, (b) the value of international service-learning, (c) crosspollination of ideas, (d) stepping outside the daily routine to facilitate divergent thinking, and (e) the necessity of precursory thinking for sustaining transformations in thinking. The first theme, responsibilities to others, was further divided into subthemes of thinking beyond oneself, raising awareness of responsibility to others, and voting responsibly.

Itineraries of pottery: a mixed methods approach to mobility

Neolithic wetland sites in the Swiss Plateau provide an extraordinary database for the study of mobilities, entanglements and transformations in material culture. Based on dendrochronologically dated settlements between 3900 and 3500 BC, two regional pottery styles and their local variations are well known, Pfyn and Cortaillod. The vessels share the same habitus and were made of local raw materials. However, some vessels specific to other pottery styles are also present in the sites. By focusing on itineraries of vessels and shifts in pottery knowledge, their appropriation in different contexts and the resulting material entanglements, we want to approach the multiple regimes of mobility: At Lake Constance - known for Pfyn pottery - specific Michelsberg vessels like tulip beakers and lugged jars occur in small numbers. These travelling objects were produced with exogenous raw materials and transported to the sites from Southern Germany. At Concise (Lake Neuchâtel) besides the local Cortaillod pottery the whole repertoire of NMB pottery, characteristic for Eastern France, was also produced. Further cases from the same space-time frame point to other regimes of mobility. In our two PhD-projects we compare pottery practices - styles, techniques, raw materials - from over 20 key sites in the region. Based on Bourdieu’s reflexive anthropology, we apply different qualitative and quantitative archaeological and archaeometrical methods, thus striving for a deeper understanding of habitus and the transformative potential of moving people, objects and ideas on local and regional scales and related social contexts.

Computer-based summative assessment of clinical reasoning in clerkships: A mixed-method comparison of key feature problems with case-based multiple choice questions

Background: It is yet unclear if there are differences between using electronic key feature problems (KFPs) or electronic case-based multiple choice questions (cbMCQ) for the assessment of clinical decision making. Summary of Work: Fifth year medical students were exposed to clerkships which ended with a summative exam. Assessment of knowledge per exam was done by 6-9 KFPs, 9-20 cbMCQ and 9-28 MC questions. Each KFP consisted of a case vignette and three key features (KF) using “long menu” as question format. We sought students’ perceptions of the KFPs and cbMCQs in focus groups (n of students=39). Furthermore statistical data of 11 exams (n of students=377) concerning the KFPs and (cb)MCQs were compared. Summary of Results: The analysis of the focus groups resulted in four themes reflecting students’ perceptions of KFPs and their comparison with (cb)MCQ: KFPs were perceived as (i) more realistic, (ii) more difficult, (iii) more motivating for the intense study of clinical reasoning than (cb)MCQ and (iv) showed an overall good acceptance when some preconditions are taken into account. The statistical analysis revealed that there was no difference in difficulty; however KFP showed a higher discrimination and reliability (G-coefficient) even when corrected for testing times. Correlation of the different exam parts was intermediate. Conclusions: Students perceived the KFPs as more motivating for the study of clinical reasoning. Statistically KFPs showed a higher discrimination and higher reliability than cbMCQs. Take-home messages: Including KFPs with long menu questions into summative clerkship exams seems to offer positive educational effects.

Computerbasierte Prüfung von klinischem Denken in der klinischen Ausbildung: Ein Mixed-Method Vergleich von Key Feature Problemen mit fallbasierten Multiple Choice Typ A Fragen

Fragestellung/Einleitung: Es ist unklar inwiefern Unterschiede bestehen im Einsatz von Key Feature Problemen (KFP) mit Long Menu Fragen und fallbasierten Typ A Fragen (FTA) für die Überprüfung des klinischen Denkens (Clinical Reasoning) in der klinischen Ausbildung von Medizinstudierenden. Methoden: Medizinstudierende des fünften Studienjahres nahmen an ihrer klinischen Pädiatrie-Rotation teil, die mit einer summativen Prüfung endete. Die Überprüfung des Wissen wurde pro Prüfung elektronisch mit 6-9 KFP [1], [3], 9-20 FTA und 9-28 nichtfallbasierten Multiple Choice Fragen (NFTA) durchgeführt. Jedes KFP bestand aus einer Fallvignette und drei Key Features und nutzen ein sog. Long Menu [4] als Antwortformat. Wir untersuchten die Perzeption der KFP und FTA in Focus Gruppen [2] (n of students=39). Weiterhin wurden die statistischen Kennwerte der KFP und FTA von 11 Prüfungen (n of students=377) verglichen. Ergebnisse: Die Analyse der Fokusgruppen resultierte in vier Themen, die die Perzeption der KFP und deren Vergleich mit FTA darstellten: KFP wurden als 1. realistischer, 2. schwerer, und 3. motivierender für das intensive Selbststudium des klinischen Denkens als FTA aufgenommen und zeigten 4. insgesamt eine gute Akzeptanz sofern gewisse Voraussetzungen berücksichtigt werden. Die statistische Auswertung zeigte keinen Unterschied im Schwierigkeitsgrad; jedoch zeigten die KFP eine höhere Diskrimination und Reliabilität (G-coefficient) selbst wenn für die Prüfungszeit korrigiert wurde. Die Korrelation der verschiedenen Prüfungsteile war mittel. Diskussion/Schlussfolgerung: Die Studierenden erfuhren die KFP als motivierenden für das Selbststudium des klinischen Denkens. Statistisch zeigten die KFP eine grössere Diskrimination und höhere Relibilität als die FTA. Der Einbezug von KFP mit Long Menu in Prüfungen des klinischen Studienabschnitts erscheint vielversprechend und einen „educational effect“ zu haben.

Multiple Perspectives on Academic Service-Learning Partnerships at the American University in Cairo: A Mixed Method Study

This mixed method study aimed to redress the gap in the literature on academic service-learning partnerships, especially in Eastern settings. It utilized Enos and Morton's (2003) theoretical framework to explore these partnerships at the American University in Cairo (AUC). Seventy-nine community partners, administrators, faculty members, and students from a diverse range of age, citizenship, racial, educational, and professional backgrounds participated in the study. Qualitative interviews were conducted with members of these four groups, and a survey with both close-ended and open-ended questions administered to students yielded 61 responses. Qualitative analyses revealed that the primary motivators for partners' engagement in service-learning partnerships included contributing to the community, enhancing students' learning and growth, and achieving the civic mission of the University. These partnerships were characterized by short-term relationships with partners' aspiring to progress toward long-term commitments. The challenges to these partnerships included issues pertaining to the institution, partnering organizations, culture, politics, pedagogy, students, and faculty members. Key strategies for improving these partnerships included institutionalizing service-learning in the University and cultivating an institutional culture supportive of community engagement. Quantitative analyses showed statistically significant relationships between students' scores on the Community Awareness and Interpersonal Effectiveness scales and their overall participation in community service activities inside and outside the classroom, as well as a statistically significant difference between their scores on the Community Awareness scale and department offering service-learning courses. The study's outcomes underscore the role of the local culture in shaping service-learning partnerships, as well as the role of both curricular and extracurricular activities in boosting students' awareness of their community and interpersonal effectiveness. Cultivating a culture of community engagement and building support mechanisms for engaged scholarship are among the critical steps required by public policy-makers in Egypt to promote service-learning in Egyptian higher education. Institutionalizing service-learning partnerships at AUC and enhancing the visibility of these partnerships on campus and in the community are essential to the future growth of these collaborations. Future studies should explore factors affecting community partners' satisfaction with these partnerships, top-down and bottom-up support to service-learning, the value of reflection to faculty members, and the influence of students' economic backgrounds on their involvement in service-learning partnerships.

Applying the WHO recommendations on health-sector response to violence against women to assess the Spanish health system. A mixed methods approach

This methodological note describes the development and application of a mixed-methods protocol to assess the responsiveness of Spanish health systems to violence against women in Spain, based on the World Health Organization (WHO) recommendations. Five areas for exploration were identified based on the WHO recommendations: policy environment, protocols, training, accountability/monitoring, and prevention/promotion. Two data collection instruments were developed to assess the situation of 17 Spanish regional health systems (RHS) with respect to these areas: 1) a set of indicators to guide a systematic review of secondary sources, and 2) an interview guide to be used with 26 key informants at the regional and national levels. We found differences between RHSs in the five areas assessed. The progress of RHSs on the WHO recommendations was notable at the level of policies, moderate in terms of health service delivery, and very limited in terms of preventive actions. Using a mixed-methods approach was useful for triangulation and complementarity during instrument design, data collection and interpretation.

If You Prohibit It, Bootleggers Will Come: A Mixed Method Study of the Landscape of College Basketball Betting

Over the past 25 years, betting on sports in the United States has grown dramatically with the majority of wagers being placed in illicit markets. Only 1% of an estimated 500 billion dollar sports betting industry in the United States is done legally. With this much at stake, the incentives to alter the outcome of the games are high. Corrupt gamblers can “fix” the match by offering payments to players to “throw the game,” that is, to predetermine the outcome in exchange for a payment (match fixing). This paper addresses whether match fixing in college basketball can be detected and contained with the current policies. A mixed method design will be used to identify possible “triggers” in Nevada Casino betting line movements that might warrant an investigation of cheating in the games. If match fixing can be detected at acceptable levels of probability, then current federal prohibitive law on sports betting might no longer be appropriate. Additionally, a survey will be administered to bettors in Nevada to analyze perceptions of the game’s integrity, further eroding the logic of current law.