How difficult are exams? A framework for assessing the complexity of introductory programming exams

Student performance on examinations is influenced by the level of difficulty of the questions. It seems reasonable to propose therefore that assessment of the difficulty of exam questions could be used to gauge the level of skills and knowledge expected at the end of a course. This paper reports the results of a study investigating the difficulty of exam questions using a subjective assessment of difficulty and a purpose-built exam question complexity classification scheme. The scheme, devised for exams in introductory programming courses, assesses the complexity of each question using six measures: external domain references, explicitness, linguistic complexity, conceptual complexity, length of code involved in the question and/or answer, and intellectual complexity (Bloom level). We apply the scheme to 20 introductory programming exam papers from five countries, and find substantial variation across the exams for all measures. Most exams include a mix of questions of low, medium, and high difficulty, although seven of the 20 have no questions of high difficulty. All of the complexity measures correlate with assessment of difficulty, indicating that the difficulty of an exam question relates to each of these more specific measures. We discuss the implications of these findings for the development of measures to assess learning standards in programming courses.

Academics and activists in the policy process : engagement with Australian media inquiries 2011-13

After its narrow re-election in June 2010, the Australian Labor government undertook a series of public inquiries into reform of Australian media, communications and copyright laws. One important driver of policy reform was the government’s commitment to building a National Broadband Network (NBN), and the implications this had for existing broadcasting and telecommunications policy, as it would constitute a major driver of convergence of media and communications access devices and content platforms. These inquiries included: the Convergence Review of media and communications legislation; the Australian Law Reform Commission (ALRC) review of the National Classification Scheme; the Independent Media Inquiry (Finkelstein Review) into Media and Media Regulation; and the ALRC review of Copyright and the Digital Economy. One unusual feature of this review process, discussed in the paper, was the degree to which academics were involved in the process, not simply as providers of expert opinion, but as review chairs seconded from their universities. This paper considers the role played by activist groups in all of these inquiries and their relationship to the various participants in the inquiries, as well as the implications of academics being engaged in such inquiries, not simply as activist-scholars, but as those primarily responsible for delivering policy review outcomes. The latter brings to the forefront issues arising in from direct engagement with governments and state agencies themselves, which challenges traditional understandings of the academic community as “critical outsiders” towards such policy processes.

Reliability and validity of query intent assessments

In most intent recognition studies, annotations of query intent are created post hoc by external assessors who are not the searchers themselves. It is important for the field to get a better understanding of the quality of this process as an approximation for determining the searcher's actual intent. Some studies have investigated the reliability of the query intent annotation process by measuring the interassessor agreement. However, these studies did not measure the validity of the judgments, that is, to what extent the annotations match the searcher's actual intent. In this study, we asked both the searchers themselves and external assessors to classify queries using the same intent classification scheme. We show that of the seven dimensions in our intent classification scheme, four can reliably be used for query annotation. Of these four, only the annotations on the topic and spatial sensitivity dimension are valid when compared with the searcher's annotations. The difference between the interassessor agreement and the assessor-searcher agreement was significant on all dimensions, showing that the agreement between external assessors is not a good estimator of the validity of the intent classifications. Therefore, we encourage the research community to consider using query intent classifications by the searchers themselves as test data.

Convergent media policy : the Australian case

This chapter considers the implications of convergence for media policy from three perspectives. First, it discusses what have been the traditional concerns of media policy, and the challenges it faces, from the perspectives of public interest theories, economic capture theories, and capitalist state theories. Second, it looks at what media convergence involves, and some of the dilemmas arising from convergent media policy including: (1) determining who is a media company; (2) regulatory parity between ‘old’ and ‘new’ media; (3) treatment of similar media content across different platforms; (4) distinguishing ‘big media’ from user-created content, and: (5) maintaining a distinction between media regulation and censorship of personal communication. Finally, it discusses attempts to reform media policy in light of these changes, including Australian media policy reports from 2011-12 including the Convergence Review, the Finkelstein Review of News Media, and the Australian Law Reform Commission’s National Classification Scheme Review. It concludes by arguing that ‘public interest’ approaches to media policy continue to have validity, even as they grapple with the complex question of how to understand the concept of influence in a convergent media environment.

Academics in the policy process : engagement with Australian media policy inquiries 2011-2013

This paper critically evaluates the series of inquires that the Australian Labor government undertook during 2011-2013 into reform of Australian media, communications and copyright laws. One important driver of policy reform was the government’s commitment to building a National Broadband Network (NBN), and the implications this had for existing broadcasting and telecommunications policy, as it would constitute a major driver of convergence of media and communications access devices and content platforms. These inquiries included: the Convergence Review of media and communications legislation; the Australian Law Reform Commission (ALRC) review of the National Classification Scheme; and the Independent Media Inquiry (Finkelstein Review) into Media and Media Regulation. One unusual feature of this review process was the degree to which academics were involved in the process, not simply as providers of expert opinion, but as review chairs seconded from their universities. This paper considers the role played by activist groups in all of these inquiries and their relationship to the various participants in the inquiries, as well as the implications of academics being engaged in such inquiries, not simply as activist-scholars, but as those primarily responsible for delivering policy review outcomes. The paper draws upon the concept of "policy windows" in order to better understand the context in which the inquiries took place, and their relative lack of legislative impact.

Convergent Media Policy

This chapter considers the implications of convergence for media policy from three perspectives. First, it discusses what have been the traditional concerns of media policy, and the challenges it faces, from the perspectives of public interest theories, economic capture theories, and capitalist state theories. Second, it looks at what media convergence involves, and some of the dilemmas arising from convergent media policy including: (1) determining who is a media company; (2) regulatory parity between ‘old’ and ‘new’ media; (3) treatment of similar media content across different platforms; (4) distinguishing ‘big media’ from user-created content; and (5) maintaining a distinction between media regulation and censorship of personal communication. Finally, it discusses attempts to reform media policy in light of these changes, including Australian media policy reports from 2011-12 including the Convergence Review, the Finkelstein Review of News Media, and the Australian Law Reform Commission’s National Classification Scheme Review. It concludes by arguing that ‘public interest’ approaches to media policy continue to have validity, even as they grapple with the complex question of how to understand the concept of influence in a convergent media environment.

Bitboard methods for games

Bitboards allow the efficient encoding of games for computer play and the application of fast bitwiseparallel algorithms for common game-related operations. This article describes: (1) a selection of bitboard techniques including an introduction to bitboards and bitwise operations; (2) a classification scheme that distinguishes filter, query and update methods, and; (3) a sampling of bitboard algorithms for a range of games other than chess, with notes on their performance and practical application.

Individual process management: A first step towards the conceptualization of individual activities

Understanding activities of individuals is of major importance because their actions are the main foundation of economic activity. However, there is a lack of understanding with regard to how individual activities are characterised. Thus, we develop a first conceptual classification for individual activities extending the view on business processes. The classification scheme contains personal care, education, professional work, domestic work, leisure and travel as primary activities and individual organization, procurement, information gathering and self-expression as secondary activities. We extend mainly prior literature on customer management by structuring processes of individuals independently from their status as customer. This enables new theoretical insights in the way companies can design their offers from a strategic point of view. Companies can use IPM to systematically analyze individual processes independent from specific products and services which is assumed to foster the development of innovative product and service offers.

Human parvovirus B19: tissue persistence and prevalence of prototypic and new variants

Human parvovirus B19 is a minute ssDNA virus causing a wide variety of diseases, including erythema infectiosum, arthropathy, anemias, and fetal death. After primary infection, genomic DNA of B19 has been shown to persist in solid tissues of not only symptomatic but also of constitutionally healthy, immunocompetent individuals. In this thesis, the viral DNA was shown to persist as an apparently intact molecule of full length, and without persistence-specific mutations. Thus, although the mere presence of B19 DNA in tissue can not be used as a diagnostic criterion, a possible role in the pathogenesis of diseases e.g. through mRNA or protein production can not be excluded. The molecular mechanism, the host-cell type and the possible clinical significance of B19 DNA tissue persistence are yet to be elucidated. In the beginning of this work, the B19 genomic sequence was considered highly conserved. However, new variants were found: V9 was detected in 1998 in France, in serum of a child with aplastic crisis. This variant differed from the prototypic B19 sequences by ~10 %. In 2002 we found, persisting in skin of constitutionally healthy humans, DNA of another novel B19 variant, LaLi. Genetically this variant differed from both the prototypic sequences and the variant V9 also by ~10%. Simultaneously, B19 isolates with DNA sequences similar to LaLi were introduced by two other groups, in the USA and France. Based on phylogeny, a classification scheme based on three genotypes (B19 types 1-3) was proposed. Although the B19 virus is mainly transmitted via the respiratory route, blood and plasma-derived products contaminated with high levels of B19 DNA have also been shown to be infectious. The European Pharmacopoeia stipulates that, in Europe, from the beginning of 2004, plasma pools for manufacture must contain less than 104 IU/ml of B19 DNA. Quantitative PCR screening is therefore a prerequisite for restriction of the B19 DNA load and obtaining of safe plasma products. Due to the DNA sequence variation among the three B19 genotypes, however, B19 PCR methods might fail to detect the new variants. We therefore examined the suitability of the two commercially available quantitative B19 PCR tests, LightCycler-Parvovirus B19 quantification kit (Roche Diagnostics) and RealArt Parvo B19 LC PCR (Artus), for detection, quantification and differentiation of the three B19 types known, including B19 types 2 and 3. The former method was highly sensitive for detection of the B19 prototype but was not suitable for detection of types 2 and 3. The latter method detected and differentiated all three B19 virus types. However, one of the two type-3 strains was detected at a lower sensitivity. Then, we assessed the prevalence of the three B19 virus types among Finnish blood donors, by screening pooled plasma samples derived from >140 000 blood-donor units: none of the pools contained detectable levels of B19 virus types 2 or 3. According to the results of other groups, B19 type 2 was absent also among Danish blood-donors, and extremely rare among symptomatic European patients. B19 type 3 has been encountered endemically in Ghana and (apparently) in Brazil, and sporadical cases have been detected in France and the UK. We next examined the biological characteristics of these virus types. The p6 promoter regions of virus types 1-3 were cloned in front of a reporter gene, the constructs were transfected into different cell lines, and the promoter activities were measured. As a result, we found that the activities of the three p6 promoters, although differing in sequence by >20%, were of equal strength, and most active in B19-permissive cells. Furthermore, the infectivity of the three B19 types was examined in two B19-permissive cell lines. RT-PCR revealed synthesis of spliced B19 mRNAs, and immunofluorescence verified the production of NS1 and VP proteins in the infected cells. These experiments suggested similar host-cell tropism and showed that the three virus types are strains of the same species, i.e. human parvovirus B19. Last but not least, the sera from subjects infected in the past either with B19 type 1 or type 2 (as evidenced by tissue persistence of the respective DNAs), revealed in VP1/2- and VP2-EIAs a 100 % cross-reactivity between virus types 1 and 2. These results, together with similar studies by others, indicate that the three B19 genotypes constitute a single serotype.

What is A Virtual Service?- Broadening the Perspective on Technology-Based Services

This article expands the discussion of the impact of technology on services and contributes to a broader comprehension of the nature of virtual services. This is done by discovering dimensions that distinguish physical services from virtual services, i.e. services that are distributed by electronic means and where the customer has no direct human interaction with the service provider. Differences in the core characteristics of services, servicescape and service delivery are discussed. Moreover, dimensions that differentiate between virtual services are analysed. A classification scheme for virtual services is proposed, including the origin of the service, the element of the service offering, the customisation process, stage of the service process performed, and the degree of mobility of the service.

Phylogenetics and biogeography of a spectacular Old World radiation of butterflies: the subtribe Mycalesina (Lepidoptera: Nymphalidae: Satyrini)

Background: Butterflies of the subtribe Mycalesina (Nymphalidae: Satyrinae) are important model organisms in ecology and evolution. This group has radiated spectacularly in the Old World tropics and presents an exciting opportunity to better understand processes of invertebrate rapid radiations. However, the generic-level taxonomy of the subtribe has been in a constant state of flux, and relationships among genera are unknown. There are six currently recognized genera in the group. Mycalesis, Lohora and Nirvanopsis are found in the Oriental region, the first of which is the most speciose genus among mycalesines, and extends into the Australasian region. Hallelesis and Bicyclus are found in mainland Africa, while Heteropsis is primarily Madagascan, with a few species in Africa. We infer the phylogeny of the group with data from three genes (total of 3139 bp) and use these data to reconstruct events in the biogeographic history of the group.,Results: The results indicate that the group Mycalesina radiated rapidly around the Oligocene-Miocene boundary. Basal relationships are unresolved, but we recover six well-supported clades. Some species of Mycalesis are nested within a primarily Madagascan clade of Heteropsis,while Nirvanopsis is nested within Lohora. The phylogeny suggests that the group had its origin either in Asia or Africa, and diversified through dispersals between the two regions, during the late Oligocene and early Miocene. The current dataset tentatively suggests that the Madagascan fauna comprises two independent radiations. The Australasian radiation shares a common ancestor derived from Asia. We discuss factors that are likely to have played a key role in the diversification of the group. Conclusions: We propose a significantly revised classification scheme for Mycalesina. We conclude that the group originated and radiated from an ancestor that was found either in Asia or Africa, with dispersals between the two regions and to Australasia. Our phylogeny paves the way for further comparative studies on this group that will help us understand the processes underlying diversification in rapid radiations of invertebrates.

Three Dimensional Line-Clipping by Systematic Enumeration

Three dimensional clipping is a critical component of the 3D graphics pipeline. A new 3D clipping algorithm is presented in this paper. An efficient 2D clipping routine reported earlier has been used as a submodule. This algorithm uses a new classification scheme for lines of all possible orientations with respect to a rectangular parallelopiped view volume. The performance of this algorithm has been evaluated using exact arithmetic operation counts. It is shown that our algorithm requires less arithmetic operations than the Cyrus-Beck 3D clipping algorithm in all cases. It is also shown that for lines that intersect the clipping volume, our algorithm performs better than the Liang-Barsky 3D clipping algorithm.

Molecular systematics and conservation of the langurs and leaf monkeys of South Asia

Numerous morphology-based classification schemes have been proposed for langurs and leaf monkeys of South Asia but there is very little agreement between them. An incorrect classification scheme when used as a basis for biogeographic studies can support erroneous hypotheses. Further, lack of taxonomic resolution will also confound conservation efforts, given that conservation biologists use traditional morphology-based-classification schemes to prioritize species for conservation. Here, I have revisited recent molecular phylogenetic studies done on langurs and leaf monkeys of South Asia. Results from these studies are in turn used to derive a rational and scientific basis for prioritizing species for conservation. Molecular data support the classification of langurs of the Indian subcontinent-Hanuman, Nilgiri and purple-faced langurs-in the genus Semnopithecus, whereas Phayre's leaf monkey along with other Southeast Asian leaf monkeys form another distinct clade (Trachypithecus). The phylogenetic position of capped and golden langurs remains unresolved. Molecular data suggest that they are closely related to each other but this group might have evolved through past hybridization between Semnopithecus and Trachypithecus. Additionally, genetic data also support the splitting of the so-called Hanuman langurs into at least three species. The scores for taxonomic uniqueness of langurs and leaf monkeys of South Asia were revised using this molecular phylogeny-based classification. According to the revised scores, Phayres leaf monkey and golden langur are priority species for conservation followed by capped and Nilgiri langurs.

Liquid alloy semiconductors revisited - Discussion

In 1990 Enderby and Barnes reviewed the electrical properties of liquid alloys which show features associated with semiconducting behaviour. They proposed an empirical classification scheme based on the notion that some liquid semiconductors are characterized by a finite gap in σ (E), the energy-dependent conductivity (narrow definition), whereas in others σ (E) is continuous (broad definition). Interesting behaviour occurs for systems at the narrow/broad boundary and further analysis of these liquid alloys will form the subject matter of this paper. Particular attention will be focused on liquid silver chalcogenides as these offer a severe test of current theories.

Amino acid interaction preferences in helical membrane proteins

Membrane proteins are involved in a number of important biological functions. Yet, they are poorly understood from the structure and folding point of view. The external environment being drastically different from that of globular proteins, the intra-protein interactions in membrane proteins are also expected to be different. Hence, statistical potentials representing the features of inter-residue interactions based exclusively on the structures of membrane proteins are much needed. Currently, a reasonable number of structures are available, making it possible to undertake such an analysis on membrane proteins. In this study we have examined the inter-residue interaction propensities of amino acids in the membrane spanning regions of the alpha-helical membrane (HM) proteins. Recently we have shown that valuable information can be obtained on globular proteins by the evaluation of the pair-wise interactions of amino acids by classifying them into different structural environments, based on factors such as the secondary structure or the number of contacts that a residue can make. Here we have explored the possible ways of classifying the intra-protein environment of HM proteins and have developed scoring functions based on different classification schemes. On evaluation of different schemes, we find that the scheme which classifies amino acids to different intra-contact environment is the most promising one. Based on this classification scheme, we also redefine the hydrophobicity scale of amino acids in HM proteins.