Using automated text analysis to evaluate students’ conceptual understanding

Background: A major challenge for assessing students’ conceptual understanding of STEM subjects is the capacity of assessment tools to reliably and robustly evaluate student thinking and reasoning. Multiple-choice tests are typically used to assess student learning and are designed to include distractors that can indicate students’ incomplete understanding of a topic or concept based on which distractor the student selects. However, these tests fail to provide the critical information uncovering the how and why of students’ reasoning for their multiple-choice selections. Open-ended or structured response questions are one method for capturing higher level thinking, but are often costly in terms of time and attention to properly assess student responses. Purpose: The goal of this study is to evaluate methods for automatically assessing open-ended responses, e.g. students’ written explanations and reasoning for multiple-choice selections. Design/Method: We incorporated an open response component for an online signals and systems multiple-choice test to capture written explanations of students’ selections. The effectiveness of an automated approach for identifying and assessing student conceptual understanding was evaluated by comparing results of lexical analysis software packages (Leximancer and NVivo) to expert human analysis of student responses. In order to understand and delineate the process for effectively analysing text provided by students, the researchers evaluated strengths and weakness for both the human and automated approaches. Results: Human and automated analyses revealed both correct and incorrect associations for certain conceptual areas. For some questions, that were not anticipated or included in the distractor selections, showing how multiple-choice questions alone fail to capture the comprehensive picture of student understanding. The comparison of textual analysis methods revealed the capability of automated lexical analysis software to assist in the identification of concepts and their relationships for large textual data sets. We also identified several challenges to using automated analysis as well as the manual and computer-assisted analysis. Conclusions: This study highlighted the usefulness incorporating and analysing students’ reasoning or explanations in understanding how students think about certain conceptual ideas. The ultimate value of automating the evaluation of written explanations is that it can be applied more frequently and at various stages of instruction to formatively evaluate conceptual understanding and engage students in reflective

Financial Reserves : A Necessary Condition for Not-for-Profit Sustainability?

Should not-for-profit (NFP) organisations hold reserves to hedge uncertainty and protect mission delivery? This chapter outlines the nature and contxt of NFP reserves. many would accept that actors within NFP organisations have a broad accountability to ensure sustinability where an appropriate mission exists, and that sustinability is assisted or ensured through the purposeful accumulation of reserves. This chapter examins current relevant literature on reserves, reviews various approaches to reserves accumulation across jurisdictions and reports what is known about practice. We highlight the tension faced by NFP organisations, balancing mission spending against the need to hedge uncertainty. We investigate the role of reserves, and how an appropriate level is determined to ensure a NFP board's accountability for organisational sustinability. This issue is particularly significant in the period following the global financial crisis, and while practitioner interest is evident, there has been little academic attention paid to the topic of NFP reserves, and 'very few [articles] have even forcused on related topics' (Calabrese, 2011, p. 282).

Understanding empathy : its origins and measurement

The paper addresses the topic that was important at the World Economic Forum in Davos (Jan. 2014)namely 'Empathetic leadership in organisations'. Research is presented supporting the work of Cambridge researcher, Simon Baron-Cohen and his theory of Systemizers and Empathizers.An argument is made for the importance of world decision makers having an empathetic approach to international and national decision making. The article contends that their work will directly impact on the health and future of life on our planet.

Meta-analysis of prevalence

Meta-analysis is a method to obtain a weighted average of results from various studies. In addition to pooling effect sizes, meta-analysis can also be used to estimate disease frequencies, such as incidence and prevalence. In this article we present methods for the meta-analysis of prevalence. We discuss the logit and double arcsine transformations to stabilise the variance. We note the special situation of multiple category prevalence, and propose solutions to the problems that arise. We describe the implementation of these methods in the MetaXL software, and present a simulation study and the example of multiple sclerosis from the Global Burden of Disease 2010 project. We conclude that the double arcsine transformation is preferred over the logit, and that the MetaXL implementation of multiple category prevalence is an improvement in the methodology of the meta-analysis of prevalence.

Capturing natural-colour 3D models of insects for species discovery and diagnostics

Collections of biological specimens are fundamental to scientific understanding and characterization of natural diversity - past, present and future. This paper presents a system for liberating useful information from physical collections by bringing specimens into the digital domain so they can be more readily shared, analyzed, annotated and compared. It focuses on insects and is strongly motivated by the desire to accelerate and augment current practices in insect taxonomy which predominantly use text, 2D diagrams and images to describe and characterize species. While these traditional kinds of descriptions are informative and useful, they cannot cover insect specimens "from all angles" and precious specimens are still exchanged between researchers and collections for this reason. Furthermore, insects can be complex in structure and pose many challenges to computer vision systems. We present a new prototype for a practical, cost-effective system of off-the-shelf components to acquire natural-colour 3D models of insects from around 3 mm to 30 mm in length. ("Natural-colour" is used to contrast with "false-colour", i.e., colour generated from, or applied to, gray-scale data post-acquisition.) Colour images are captured from different angles and focal depths using a digital single lens reflex (DSLR) camera rig and two-axis turntable. These 2D images are processed into 3D reconstructions using software based on a visual hull algorithm. The resulting models are compact (around 10 megabytes), afford excellent optical resolution, and can be readily embedded into documents and web pages, as well as viewed on mobile devices. The system is portable, safe, relatively affordable, and complements the sort of volumetric data that can be acquired by computed tomography. This system provides a new way to augment the description and documentation of insect species holotypes, reducing the need to handle or ship specimens. It opens up new opportunities to collect data for research, education, art, entertainment, biodiversity assessment and biosecurity control. © 2014 Nguyen et al.

Visual narratives and counter-narratives in aged care : Centring the participant as photographer in social science research

As detailed by a number of scholars (Emmison & Smith, 2000, 2012; Harrison, 1996, 2002, 2004), photographs and the process of photographing can provide fertile ground for sociological investigation. Examining the production of photography can tell us much about inclusion/omission and power/knowledge in a variety of social settings. Recently, some researchers have begun to utilise the participatory action research methodology, PhotoVoice, where people take and share photographs as a means of communicating and advocating on a specific topic. While medical sociologists have used PhotoVoice to communicate the impacts of disease in vulnerable populations (eg Burles, 2010), little social research has been done that combines PhotoVoice and older persons. This is interesting given the world’s population is ageing and the general lack of research that examines what daily life is like for older people living in aged care (Timonen & O’Dwyer, 2009). In response, a recent project tracked 10 participants who recently transitioned into living in residential aged care (RAC). The project combined the use of PhotoVoice methodology with repeated in-depth interviews. Residents were asked to orally and visually describe the positives and negative aspects of their daily lives. In the first instance, they shared the use of a RAC owned camera and later had the opportunity to access a camera for their sole use. Photographic analysis emphasised the value of centring the participant as an autonomous photographer in social research. In the photographs captured on a shared use camera, the photographs tended to depict predominately positive life stories (e.g. weekly morning tea outings, social activities). In comparison, the photographs captured on the sole use camera also described intimate but everyday activities, spaces, objects and people that frequented in their daily lives. Shifting the responsibility of the camera and photography solely to the participants resulted in the residents disrupting conventions of ‘suitable’ subject matter to photograph (Harrison, 2004) and in doing so, provided a much richer insight into what daily life is like in aged care.

Public space for street-scape theatrics : guerrilla spatial tactics and methods of urban hacking in Brisbane, Australia

It could be argued that architecture has an inherent social responsibility to enrich the urban and spatial environments for the city’s occupants. However how we define quality, and how ‘places’ can be designed to be fair and equitable, catering for individuals on a humanistic and psychological level, is often not clearly addressed. Lefebvre discusses the idea of the ‘right to the city’; the belief that public space design should facilitate freedom of expression and incite a sense of spatial ownership for its occupants in public/commercial precincts. Lefebvre also points out the importance of sensory experience in the urban environment. “Street-scape theatrics” are performative activities that summarise these two concepts, advocating the ‘right to the city’ by way of art as well as providing sensual engagement for city users. Literature discusses the importance of Street-scape Theatrics however few sources attempt to discuss this topic in terms of how to design these spaces/places to enhance the city on both a sensory and political level. This research, grounded in political theory, investigates the case of street music, in particular busking, in the city of Brisbane, Australia. Street culture is a notion that already exists in Brisbane, but it is heavily controlled especially in central locations. The study discusses how sensory experience of the urban environment in Brisbane can be enriched through the design for busking; multiple case studies, interviews, observations and thematic mappings provide data to gather an understanding of how street performers see and understand the built form. Results are sometime surprisingly incongruous with general assumptions in regards to street artist as well as the established political and ideological framework, supporting the idea that the best and most effective way of urban hacking is working within the system. Ultimately, it was found that the Central Business District in Brisbane, Australia, could adopt certain political and design tactics which attempt to reconcile systematic quality control with freedom of expression into the public/commercial sphere, realism upheld. This can bridge the gap between the micro scale of the body and the macro of the political economy through freedom of expression, thus celebrating the idiosyncratic nature of the city.

Change in walking for transport : a longitudinal study of the influence of neighbourhood disadvantage and individual-level socioeconomic position in mid-aged adults

Background Unlike leisure time physical activity, knowledge of the socioeconomic determinants of active transport is limited, research on this topic has produced mixed and inconsistent findings, and it remains unknown if peoples’ engagement in active transport declines as they age. This longitudinal study examined relationships between neighbourhood disadvantage, individual-level socioeconomic position and walking for transport (WfT) during mid- and early old-age (40 – 70 years). Three questions were addressed: (i) which socioeconomic groups walk for transport, (ii) does the amount of walking change over time as people age, and (iii) is the change socioeconomically patterned? Methods The data come from the HABITAT study of physical activity, a bi-annual multilevel longitudinal survey of 11,036 residents of 200 neighbourhoods in Brisbane, Australia. At each wave (2007, 2009 and 2011) respondents estimated the duration (minutes) of WfT in the previous 7 days. Neighbourhood disadvantage was measured using a census-derived index comprising 17 different socioeconomic components, and individual-level socioeconomic position was measured using education, occupation, and household income. The data were analysed using multilevel mixed-effects logistic and linear regression. Results The odds of being defined as a ‘never walker’ were significantly lower for residents of disadvantaged neighbourhoods, but significantly higher for the less educated, blue collar employees, and members of lower income households. WfT declined significantly over time as people aged and the declines were more precipitous for older persons. Average minutes of WfT declined for all neighbourhoods and most socioeconomic groups; however, the declines were steeper for the retired and members of low income households. Conclusions Designing age-friendly neighbourhoods might slow or delay age-related declines in WfT and should be a priority. Steeper declines in WfT among residents of low income households may reflect their poorer health status and the impact of adverse socioeconomic exposures over the life course. Each of these declines represents a significant challenge to public health advocates, urban designers, and planners in their attempts to keep people active and healthy in their later years of life.

All Anglos are alike? A study of whinging Poms and bloody-minded Aussies

Cross-cultural service research is an important topic with a rich array of empirical evidence for differences in customer perceptions, attitudes and behaviours. However, the extant literature is almost exclusively focused on differences between cultures at each end of the diversity spectrum (most commonly East vs. West). Contemporary researchers have observed that existing studies fail to acknowledge the substantially greater levels of intra-cluster variation that exist. A cultural cluster is a group of countries that reflect values, attitudes and beliefs stemming from a common cultural ancestry. This seems surprising given the anecdotal evidence and stereotypes that are portrayed in popular culture, media and art. One area where intra-cluster variation may be evident is consumer complaint behaviour and in particular within the Anglo-cultural cluster in countries. A cultural cluster is a group of countries that reflect values, attitudes and beliefs stemming from a common cultural ancestry. The aim of this study is therefore to explore and elucidate the nature of differences in consumer complaint behaviour between cultures traditionally conceived and operationalised as identical. This study presents a qualitative study of 60 in-depth interviews with consumers in the United Kingdom and Australia and identifies differences in complaining styles, parental influence and the conceptualisation of complaining.

Interpreting discovered patterns in terms of ontology concepts

Semantic Web offers many possibilities for future Web technologies. Therefore, it is a need to search for ways that can bring the huge amount of unstructured documents from current Web to Semantic Web automatically. One big challenge in searching for such ways is how to understand patterns by both humans and machine. To address this issue, we present an innovative model which interprets patterns to high level concepts. These concepts can explain the patterns' meanings in a human understandable way while improving the information filtering performance. The model is evaluated by comparing it against one state-of-the-art benchmark model using standard Reuters dataset. The results show that the proposed model is successful. The significance of this model is three fold. It gives a way to interpret text mining output, provides a technique to find concepts relevant to the whole set of patterns which is an essential feature to understand the topic, and to some extent overcomes information mismatch and overload problems of existing models. This model will be very useful for knowledge based applications.

Gen Y recruitment: Understanding graduate intentions to join an organisation using the Theory of Planned Behaviour

Purpose Using the Theory of Planned Behaviour (TPB) framework, this study explored whether the standard TPB constructs explained variance in Gen Y individuals’ intentions to join their ideal organisation. Design/methodology/approach A mixed methods approach was used featuring qualitative and quantitative methods. Findings The overall TPB model accounted for a significant 51.6% of the variance in intention to join one’s ideal organisation in the next six months with the significant predictors in the model being subjective norm and perceived behaviour control but not attitude. Research limitations/implications Using graduating students from a single Australian university sample may mean that the current findings may not extend to all Gen Y individuals. The current study has demonstrated the explanatory utility of the TPB in relation to graduate Gen Y’s intention to join their ideal organisation, providing further evidence of the robustness of the TPB framework in an organisational setting. Practical implications These findings have implications for enhancing understanding of the most effective recruitment processes for Gen Y students entering the workforce. The findings could inform recruitment policies and strategies to attract Gen Y applicants. Originality/value To our knowledge this study is the first application of the TPB to this topic. The current research extends the recruitment literature with a theoretically-based investigation. Identification of factors which inform organisational recruitment strategies, allow organisations to stand out from their competitors and potentially achieve a larger application pool from which to select the best human capital and sustain competitive advantage.

Urban Form at the Edge : Proceedings from ISUF 2013 [Volume 1]

Urban morphology as a field of study has developed primarily in Europe and North America, and more recently emerging as a recurrent topic in China and South America. As a counterpoint to this centric view, the ISUF 2013 conference explored aspects of ‘urban form at the edge’. In particular the conference examined ‘off centre areas’ such as India, Africa, Middle East, Central Asia and Australasia which require innovative approaches to the study of traditional, as well as post-colonial and contemporary, morphologies. Broader interpretations of urban form at the edge focus on minor centres and suburbia, with their developing and transilient character; edge cities and regional centres; and new technologies and approaches that are developing alongside established methods, tools and theories of urban morphology...

Green urbanism and diffusion issues

This paper addresses the research question, ‘What are the diffusion determinants for green urbanism innovations in Australia?’ This is a significant topic given the global movement towards green urbanism. The study reported here is based on desktop research that provides new insights through (1) synthesis of the latest research findings on green urbanism innovations and (2) interpretation of diffusion issues through our innovation system model. Although innovation determinants have been studied extensively overseas and in Australia, there is presently a gap in the literature when it comes to these determinants for green urbanism in Australia. The current paper fills this gap. Using a conceptual framework drawn from the innovation systems literature, this paper synthesises and interprets the literature to map the current state of green urbanism innovations in Australia and to analyse the drivers for, and obstacles to, their optimal diffusion. The results point to the importance of collaboration between project-based actors in the implementation of green urbanism. Education, training and regulation across the product system is also required to improve the cultural and technical context for implementation. The results are limited by their exploratory nature and future research is planned to quantify barriers to green urbanism.

The learning capability of construction organisations engaged in collaborative contracting - Literature Review [industry report]

Background Value for money (VfM) on collaborative construction projects is dependent on the learning capabilities of the organisations and people involved. Within the context of infrastructure delivery, there is little research about the impact of organisational learning capability on project value. The literature contains a multiplicity of often un-testable definitions about organisational learning abilities. This paper defines learning capability as a dynamic capability that participant organisations purposely develop to add value to collaborative projects. The paper reports on a literature review that proposes a framework that conceptualises learning capability to explore the topic. This work is the first phase of a large-scale national survey funded by the Alliancing Association of Australasia and the Australian Research Council. Methodology Desk-top review of leading journals in the areas of strategic management, strategic alliances and construction management, as well as recent government documents and industry guidelines, was undertaken to synthesise, conceptualise and operationalise the concept of learning capability. The study primarily draws on the theoretical perspectives of the resource-based view of the firm (e.g. Barney 1991; Wernerfelt 1984), absorptive capacity (e.g. Cohen and Levinthal 1990; Zahra and George 2002); and dynamic capabilities (e.g. Helfat et al. 2007; Teece et al. 1997; Winter 2003). Content analysis of the literature was undertaken to identify key learning routines. Content analysis is a commonly used methodology in the social sciences area. It provides rich data through the systematic and objective review of literature (Krippendorff 2004). NVivo 9, a qualitative data analysis software package, was used to assist in this process. Findings and Future Research The review process resulted in a framework for the conceptualisation of learning capability that shows three phases of learning: (1) exploratory learning, (2) transformative learning and (3) exploitative learning. These phases combine both internal and external learning routines to influence project performance outcomes and thus VfM delivered under collaborative contracts. Sitting within these phases are eight categories of learning capability comprising knowledge articulation, identification, acquisition, dissemination, codification, internationalisation, transformation and application. The learning routines sitting within each category will be disaggregated in future research as the basis for measureable items in a large-scale survey study. The survey will examine the extent to which various learning routines influence project outcomes, as well as the relationships between them. This will involve identifying the routines that exist within organisations in the construction industry, their resourcing and rate of renewal, together with the extent of use and perceived value within the organisation. The target population is currently estimated to be around 1,000 professionals with experience in relational contracting in Australia. This future research will build on the learning capability framework to provide data that will assist construction organisations seeking to maximise VfM on construction projects.

The whole world shook : shifts in ethnic, national and heroic identities in children's fiction about 9/11

Like many other cataclysmic events September 11, a day now popularly believed to have 'changed the world', has become a topic taken up by children's writers. This thesis, titled The Whole World Shook: Ethnic, National and Heroic Identities in Children's Fiction About 9/11, examines how cultural identities are constructed within fictional texts for young people written about the attacks on the Twin Towers. It identifies three significant identity categories encoded in 9/11 books for children: ethnic identities, national identities, and heroic identities. The thesis argues that the identities formed within the selected children's texts are in flux, privileging performances of identities that are contingent on post-9/11 politics. This study is located within the field of children's literature criticism, which supports the understanding that children's books, like all texts, play a role in the production of identities. Children's literature is highly significant both in its pedagogical intent (to instruct and induct children into cultural practices and beliefs) and in its obscurity (in making the complex simple enough for children, and from sometimes intentionally shying away from difficult things). This literary criticism informed the study that the texts, if they were to be written at all, would be complex, varied and most likely as ambiguous and contradictory as the responses to the attacks on New York themselves. The theoretical framework for this thesis draws on a range of critical theories including literary theory, cultural studies, studies of performativity and postmodernism. This critical framework informs the approach by providing ways for: (i) understanding how political and ideological work is performed in children's literature; (ii) interrogating the constructed nature of cultural identities; (iii) developing a nuanced methodology for carrying out a close textual analysis. The textual analysis examines a representative sample of children's texts about 9/11, including picture books, young adult fiction, and a selection of DC Comics. Each chapter focuses on a different though related identity category. Chapter Four examines the performance of ethnic identities and race politics within a sample of picture books and young adult fiction; Chapter Five analyses the construction of collective, national identities in another set of texts; and Chapter Six does analytic work on a third set of texts, demonstrating the strategic performance of particular kinds of heroic identities. I argue that performances of cultural identities constructed in these texts draw on familiar versions of identities as well as contribute to new ones. These textual constructions can be seen as offering some certainties in increasingly uncertain times. The study finds, in its sample of books a co-mingling of xenophobia and tolerance; a binaried competition between good and evil and global harmony and national insularity; and a lauding of both the commonplace hero and the super-human. Being a recent corpus of texts about 9/11, these texts provide information on the kinds of 'selves' that appear to be privileged in the West since 2001. The thesis concludes that the shifting identities evident in texts that are being produced for children about 9/11 offer implicit and explicit accounts of what constitute good citizenship, loyalty to nation and community, and desirable attributes in a Western post-9/11 context. This thesis makes an original contribution to the field of children's literature by providing a focussed and sustained analysis of how texts for children about 9/11 contribute to formations of identity in these complex times of cultural unease and global unrest.