Designing for learner engagement with computer-based testing

The issues influencing student engagement with high-stakes computer-based exams were investigated, drawing on feedback from two cohorts of international MA Education students encountering this assessment method for the first time. Qualitative data from surveys and focus groups on the students’ examination experience were analysed, leading to the identification of engagement issues in the delivery of high-stakes computer-based assessments.The exam combined short-answer open-response questions with multiple-choice-style items to assess knowledge and understanding of research methods. The findings suggest that engagement with computer-based testing depends, to a lesser extent, on students’ general levels of digital literacy and, to a greater extent, on their information technology (IT) proficiency for assessment and their ability to adapt their test-taking strategies, including organisational and cognitive strategies, to the online assessment environment. The socialisation and preparation of students for computer-based testing therefore emerge as key responsibilities for instructors to address, with students requesting increased opportunities for practice and training to develop the IT skills and test-taking strategies necessary to succeed in computer-based examinations. These findings and their implications in terms of instructional responsibilities form the basis of a proposal for a framework for Learner Engagement with e-Assessment Practices.

A Generic Library for GUI Reasoning and Testing

Graphical user interfaces (GUIs) make software easy to use by providing the user with visual controls. Therefore, correctness of GUI's code is essential to the correct execution of the overall software. Models can help in the evaluation of interactive applications by allowing designers to concentrate on its more important aspects. This paper presents a generic model for language-independent reverse engineering of graphical user interface based applications, and we explore the integration of model-based testing techniques in our approach, thus allowing us to perform fault detection. A prototype tool has been constructed, which is already capable of deriving and testing a user interface behavioral model of applications written in Java/Swing.

XML-tekniikoihin perustuva ajurimalli LabView-pohjaiseen testausympäristöön

XML-muotoista tiedonesitystapaa hyödynnetään yhä enemmän esitettäessä rakenteellista tietoa. Tarkoituksena on antaa yleishyödyllinen ja uudelleenkäytettävä tapa jakaa yleistä tietoa erilaisten rajapintojen yli. XML-tekniikoita käytetään myös korjaamaan aiemmin tehdyissä sovellutuksissa esiintyneitä puutteita ja parantamaan niiden toimintaa. Tässä diplomityössä esitellään Telestelle LabView-pohjaiseen testaussovellusympäristöön suunniteltava ajuriuudistus. Työssä paranneltiin aiempaa ajurimallia soveltamalla siihen XML-tekniikoita hyödyntäviä toimintoja. Tarkoituksena oli vähentää testaussovelluskehityksessä vaadittavaa ohjelmointityötä korvaamalla sovelluksiin kovakoodatut ominaisuudet XML-pohjaisilla konfiguraatiotiedostoilla. Järjestelmän pohjana on yleiskäyttöinen ajuri, joka käyttää Telesten omaa EMS-protokollaa kommunikoinnissaan testattavien tuotteiden kanssa. Ajurimalli käyttää XML-pohjaisia konfiguraatiotiedostoja määrittelemään testattavien tuotteiden ominaisuuksia. XML-skeematiedostoilla esitetään ajurin käyttämän kommunikaatioprotokollan viestityypit ja niiden rakenteet. Työn tuloksena onnistuttiin luomaan uudenlainen XML-tekniikoita hyödyntävä ajurimalli. Yhteen yhteiseen ajuriin perustuva malli yhdenmukaistaa testaussovelluksien toteuttamista ja vähentää tarvittavaa ohjelmointityötä. Ajurin käyttöä helpotettiin toteuttamalla testaussovelluksien kehitysympäristöön erityinen editori, jolla voidaan helposti luoda ajuria käyttäviä toimintoja.

A web recommendation technique based on probabilistic latent semantic analysis

Web transaction data between Web visitors and Web functionalities usually convey user task-oriented behavior pattern. Mining such type of click-stream data will lead to capture usage pattern information. Nowadays Web usage mining technique has become one of most widely used methods for Web recommendation, which customizes Web content to user-preferred style. Traditional techniques of Web usage mining, such as Web user session or Web page clustering, association rule and frequent navigational path mining can only discover usage pattern explicitly. They, however, cannot reveal the underlying navigational activities and identify the latent relationships that are associated with the patterns among Web users as well as Web pages. In this work, we propose a Web recommendation framework incorporating Web usage mining technique based on Probabilistic Latent Semantic Analysis (PLSA) model. The main advantages of this method are, not only to discover usage-based access pattern, but also to reveal the underlying latent factor as well. With the discovered user access pattern, we then present user more interested content via collaborative recommendation. To validate the effectiveness of proposed approach, we conduct experiments on real world datasets and make comparisons with some existing traditional techniques. The preliminary experimental results demonstrate the usability of the proposed approach.

An online study combining the constructs from the theory of planned behaviour and protection motivation theory in predicting intention to test for chlamydia in two testing contexts

Chlamydia is a common sexually transmitted infection that has potentially serious consequences unless detected and treated early. The health service in the UK offers clinic-based testing for chlamydia but uptake is low. Identifying the predictors of testing behaviours may inform interventions to increase uptake. Self-tests for chlamydia may facilitate testing and treatment in people who avoid clinic-based testing. Self-testing and being tested by a health care professional (HCP) involve two contrasting contexts that may influence testing behaviour. However, little is known about how predictors of behaviour differ as a function of context. In this study, theoretical models of behaviour were used to assess factors that may predict intention to test in two different contexts: self-testing and being tested by a HCP. Individuals searching for or reading about chlamydia testing online were recruited using Google Adwords. Participants completed an online questionnaire that addressed previous testing behaviour and measured constructs of the Theory of Planned Behaviour and Protection Motivation Theory, which propose a total of eight possible predictors of intention. The questionnaire was completed by 310 participants. Sufficient data for multiple regression were provided by 102 and 118 respondents for self-testing and testing by a HCP respectively. Intention to self-test was predicted by vulnerability and self-efficacy, with a trend-level effect for response efficacy. Intention to be tested by a HCP was predicted by vulnerability, attitude and subjective norm. Thus, intentions to carry out two testing behaviours with very similar goals can have different predictors depending on test context. We conclude that interventions to increase self-testing should be based on evidence specifically related to test context.

Online MBPeT dashboard : enabling performance testing as a service in the cloud

In this thesis, tool support is addressed for the combined disciplines of Model-based testing and performance testing. Model-based testing (MBT) utilizes abstract behavioral models to automate test generation, thus decreasing time and cost of test creation. MBT is a functional testing technique, thereby focusing on output, behavior, and functionality. Performance testing, however, is non-functional and is concerned with responsiveness and stability under various load conditions. MBPeT (Model-Based Performance evaluation Tool) is one such tool which utilizes probabilistic models, representing dynamic real-world user behavior patterns, to generate synthetic workload against a System Under Test and in turn carry out performance analysis based on key performance indicators (KPI). Developed at Åbo Akademi University, the MBPeT tool is currently comprised of a downloadable command-line based tool as well as a graphical user interface. The goal of this thesis project is two-fold: 1) to extend the existing MBPeT tool by deploying it as a web-based application, thereby removing the requirement of local installation, and 2) to design a user interface for this web application which will add new user interaction paradigms to the existing feature set of the tool. All phases of the MBPeT process will be realized via this single web deployment location including probabilistic model creation, test configurations, test session execution against a SUT with real-time monitoring of user configurable metric, and final test report generation and display. This web application (MBPeT Dashboard) is implemented with the Java programming language on top of the Vaadin framework for rich internet application development. The Vaadin framework handles the complicated web communications processes and front-end technologies, freeing developers to implement the business logic as well as the user interface in pure Java. A number of experiments are run in a case study environment to validate the functionality of the newly developed Dashboard application as well as the scalability of the solution implemented in handling multiple concurrent users. The results support a successful solution with regards to the functional and performance criteria defined, while improvements and optimizations are suggested to increase both of these factors.

Normative reference values for the 20-meter shuttlerun test in a population-based sample of schoolchildren in Bogota, Colombia: The FUPRECOL Study

Our aim was to determine the normative reference values of cardiorespiratory fitness (CRF) and to establish the proportion of subjects with low CRF suggestive of future cardio-metabolic risk.

A simple data logger for student-designed rocket experiments.

The final-year project for Mechanical & Space Engineering students at UQ often involves the design and flight testing of an experiment. This report describes the design and use of a simple data logger that should be suitable for collecting data from the students' flight experiments. The exercise here was taken as far as the construction of a prototype device that is suitable for ground-based testing, say, the static firing of a hybrid rocket motor.

Uma Abordagem para a Geração de Casos de Teste Baseada em Modelos

Abstract — The analytical methods based on evaluation models of interactive systems were proposed as an alternative to user testing in the last stages of the software development due to its costs. However, the use of isolated behavioral models of the system limits the results of the analytical methods. An example of these limitations relates to the fact that they are unable to identify implementation issues that will impact on usability. With the introduction of model-based testing we are enable to test if the implemented software meets the specified model. This paper presents an model-based approach for test cases generation from the static analysis of source code.

Compaction quality control on site of earthworks - A comparative study

The capacity to use geologic materials (soil and rock) that are available in the surrounding environment is inherent to the human civilization and has contributed to the evolution of societies throughout the course of history. The use of these materials in the construction of structures such as houses, roads, railways or dams, stirred the improvement of socioeconomic and environmental conditions. Several reports of structural problems on embankments can be found throughout history. A considerable number of those registers can be linked to inadequate compaction, demonstrating the importance of guaranteeing a suitable quality of soil compaction. Various methodologies and specifications of compaction quality control on site of earthworks, based on the fill moisture content and dry unit weight, were developed during the 20th century. Two widely known methodologies are the conventional and nuclear techniques. The conventional methods are based on the use of the field sand cone test (or similar) and sampling of material for laboratory-based testing to evaluate the fill dry unit weight and water content. The nuclear techniques measure both parameters in the field using a nuclear density gauge. A topic under discussion in the geotechnical community, namely in Portugal, is the comparison between the accuracy of the nuclear gauge and sand cone test results for assessing the compaction and density ratio of earth fills, particularly for dams. The main purpose of this dissertation is to compare both of them. The data used were acquired during the compaction quality control operations at the Coutada/Tamujais dam trial embankment and core construction. This is a 25 m high earth dam located in Vila Velha de Rodão, Portugal. To analyse the spatial distribution of the compaction parameters (water content and compaction ratio), a 3D model was also developed. The main results achieved are discussed and finally some considerations are put forward on the suitability of both techniques to ensure fill compaction quality and on additional research to complement the conclusions obtained.

Early diagnosis of congenital toxoplasmosis in newborn infants using IgG subclasses against two Toxoplasma gondii recombinant proteins

The aim of this work was to evaluate the utility of ELISA-based testing of total IgG (IgGt) antibodies and its subclasses (IgG1, IgG2, IgG3 and IgG4) against soluble (STAg) and recombinant (rSAG1 and rMIC3) antigens of Toxoplasma gondii for diagnosing congenital toxoplasmosis. Sera from 217 newborns initially testing positive for specific IgM in filter paper dried blood spots were tested for specific IgM and IgG by ELFA-VIDAS®. Congenital toxoplasmosis was confirmed in 175 and ruled out in 42 infants. The validity of the ELISA tests was determined using the persistence of IgG antibodies (ELFA-VIDAS® kit) at the end of 12 months, which is considered the reference test for the diagnosis of congenital toxoplasmosis. The frequency of positivity with IgGt against STAg, rSAG1 and rMIC3 was found in 97.2%, 96.3% and 80.2%, respectively, of the newborns with confirmed congenital toxoplasmosis. IgG1 reacted with all three antigens, while IgG3 and IgG4 reacted preferentially with rMIC3. Higher mean values of reactivity (sample optical density/cut-off) were found for all subclasses when using rMIC3. All of the antigens showed high sensitivity and low specificity in detecting anti-T. gondii IgGt and IgG1 and low sensitivity and high specificity in detecting IgG3 and IgG4. In conclusion, the combined detection of IgG antibody subclasses against recombinant toxoplasmic antigens may be useful for the early diagnosis of congenital toxoplasmosis.

QuesTInSitu: from tests to routes for assessment in situ activities

Test-based assessment tools are mostly focused on the use of computers. However, advanced Information and Communication Technologies, such as handheld devices, opens up the possibilities of creating new assessment scenarios, increasing the teachers’ choices to design more appropriate tests for their subject areas. In this paper we use the term Computing-Based Testing (CBT) instead of Computer-Based Testing, as it captures better the emerging trends. Within the CBT context, the paper is centred on proposing an approach for “Assessment in situ” activities, where questions have to be answered in front of a real space/location (situ). In particular, we present the QuesTInSitu software implementation that includes both an editor and a player based on the IMS Question and Test Interoperability specification and GoogleMaps. With QuesTInSitu teachers can create geolocated questions and tests (routes), and students can answer the tests using mobile devices with GPS when following a route. Three illustrating scenarios and the results from the implementation of one of them in a real educational situation show that QuesTInSitu enables the creation of innovative, enriched and context-aware assessment activities. The results also indicate that the use of mobile devices and location-based systems in assessment activities facilitates students to put explorative and spatial skills into practice and fosters their motivation, reflection and personal observation.

On The Spot Damage Detection Methodology for Highway Bridges, July 2010

Vibration-based damage identification (VBDI) techniques have been developed in part to address the problems associated with an aging civil infrastructure. To assess the potential of VBDI as it applies to highway bridges in Iowa, three applications of VBDI techniques were considered in this study: numerical simulation, laboratory structures, and field structures. VBDI techniques were found to be highly capable of locating and quantifying damage in numerical simulations. These same techniques were found to be accurate in locating various types of damage in a laboratory setting with actual structures. Although there is the potential for these techniques to quantify damage in a laboratory setting, the ability of the methods to quantify low-level damage in the laboratory is not robust. When applying these techniques to an actual bridge, it was found that some traditional applications of VBDI methods are capable of describing the global behavior of the structure but are most likely not suited for the identification of typical damage scenarios found in civil infrastructure. Measurement noise, boundary conditions, complications due to substructures and multiple material types, and transducer sensitivity make it very difficult for present VBDI techniques to identify, much less quantify, highly localized damage (such as small cracks and minor changes in thickness). However, while investigating VBDI techniques in the field, it was found that if the frequency-domain response of the structure can be generated from operating traffic load, the structural response can be animated and used to develop a holistic view of the bridge’s response to various automobile loadings. By animating the response of a field bridge, concrete cracking (in the abutment and deck) was correlated with structural motion and problem frequencies (i.e., those that cause significant torsion or tension-compression at beam ends) were identified. Furthermore, a frequency-domain study of operational traffic was used to identify both common and extreme frequencies for a given structure and loading. Common traffic frequencies can be compared to problem frequencies so that cost-effective, preventative solutions (either structural or usage-based) can be developed for a wide range of IDOT bridges. Further work should (1) perfect the process of collecting high-quality operational frequency response data; (2) expand and simplify the process of correlating frequency response animations with damage; and (3) develop efficient, economical, preemptive solutions to common damage types.

Thin Bonded Overlay Evaluation, Construction Report, HR-559, 1999

In recent years, ultra-thin whitetopping (UTW) has evolved as a viable rehabilitation technique for deteriorated asphalt cement concrete (ACC) pavement. Numerous UTW projects have been constructed and tested, enabling researchers to identify key elements contributing to their successful performance. These elements include foundation support, the interface bonding condition, portland cement concrete (PCC) overlay thickness, synthetic fiber reinforcement usage, joint spacing, and joint sealing. The interface bonding condition is the most important of these elements. It enables the pavement to act as a composite structure, thus reducing tensile stresses and allowing an ultra-thin PCC overlay to perform as intended. Although the main factors affecting UTW performance have been identified in previous research, neither the impact that external variables have on the elements nor the element interaction have been thoroughly investigated. The objective of this research was to investigate the interface bonding condition between an ultra-thin PCC overlay and an ACC base over time, considering the previously mentioned variables. Laboratory testing and full scale field testing were planned to accomplish the research objective. Laboratory testing involved monitoring interface strains in fabricated PCC/ACC composite test beams subjected to either static or dynamic flexural loading. Variables investigated included ACC surface preparation, PCC thickness, and synthetic fiber reinforcement usage. Field testing involved monitoring PCC/ACC interface stains and temperatures, falling weight deflectometer (FWD) deflection responses, direct shear strengths, and distresses on a 7.2 mile Iowa Department of Transportation (Iowa DOT) UTW project (HR-559). The project was located on Iowa Highway 21 between Iowa Highway 212 and U.S. Highway 6 in Iowa County, near Belle Plaine, Iowa. Variables investigated included ACC surface preparation, PCC thickness, synthetic fiber reinforcement usage, joint spacing, and joint sealing. This report documents the planning, equipment selection, and construction of the project built in 1994.

Komposiittipakkausrakenteen valmistustekninen selvitys

Diplomityö on tehty Exel Oyj:lle tuotekehityprojektina. Tarkoituksena on kehittää Exel Oyj:n valmistamaa komposiittipakkausrakennetta. Työssä on keskitytty valmistustekniseen selvitykseen komposiittirakenteen teollisen mittakaavan tuotannossa. Työssä selvitettiin erilaisten tuoterakenteiden valmistettavuutta sekä suoritettiin kyseisen tuotteen vaatimusprofiilin mukaisia testejä valituille rakennevaihtoehdoille. Pakkausrakenteelle asetettuja vaatimuksia ovat mm. kuljetusvaatimukset, jotka määräytyvät lähinnä NATO standardien pohjalta. Lisäksi tuotteelta vaaditaan tiettyä pitkäaikaiskestoa käsittelyn kannalta sekä soveltuvuutta vallitseviin ilmasto-olosuhteisiin. Vaatimusten mukaisia ominaisuuksia tutkittiin lisäksi mm. ballistisilla ja mekaanisilla testeillä sekä kaasuläpäisytesteillä. Testien pohjalta voidaan todeta, etteivät perinteisen alipaineinjektoidun komposiittituotteen ballistiset ominaisuudet ole riittävällä tasolla suojatuotetta ajatellen. Ballististen ja mekaanisten testien kesken havaittiin joitain yhtäläisyyksiä ja tämä vaikuttaa olevan nimenomaan mekaanisesti optimoidun komposiitin ominaisuus. DI-työn lopputuloksena on saatu selkeä kuva pakkausrakenteen materiaalivaihtoehtojen soveltuvuudesta kyseiselle tuotteelle. Lisäksi pakkausrakenteelle on ehdotettu neljä erilaista tuotesuunnitelmaan, niiden valmistustekniikat sekä lopputuotteen kustannusarviointi.