Assessing the fit of unidimensional IRT models for binary data under model misspecification

Model misspecification affects the classical test statistics used to assess the fit of the Item Response Theory (IRT) models. Robust tests have been derived under model misspecification, as the Generalized Lagrange Multiplier and Hausman tests, but their use has not been largely explored in the IRT framework. In the first part of the thesis, we introduce the Generalized Lagrange Multiplier test to detect differential item response functioning in IRT models for binary data under model misspecification. By means of a simulation study and a real data analysis, we compare its performance with the classical Lagrange Multiplier test, computed using the Hessian and the cross-product matrix, and the Generalized Jackknife Score test. The power of these tests is computed empirically and asymptotically. The misspecifications considered are local dependence among items and non-normal distribution of the latent variable. The results highlight that, under mild model misspecification, all tests have good performance while, under strong model misspecification, the performance of the tests deteriorates. None of the tests considered show an overall superior performance than the others. In the second part of the thesis, we extend the Generalized Hausman test to detect non-normality of the latent variable distribution. To build the test, we consider a seminonparametric-IRT model, that assumes a more flexible latent variable distribution. By means of a simulation study and two real applications, we compare the performance of the Generalized Hausman test with the M2 limited information goodness-of-fit test and the Likelihood-Ratio test. Additionally, the information criteria are computed. The Generalized Hausman test has a better performance than the Likelihood-Ratio test in terms of Type I error rates and the M2 test in terms of power. The performance of the Generalized Hausman test and the information criteria deteriorates when the sample size is small and with a few items.

Physical activity and osseointegration: "step forward" to improve the quality of life of a trans-femoral amputee person

Lower limb amputation is an event that inevitably changes the lifestyle of the person with a significant impact on quality of life. The socket-type prosthesis entails that the residual limb is in direct contact with the socket which often implies numerous disadvantages. Osseointegrated prosthesis is a solution that avoids skin problems because not include the presence of the socket. In this type of prosthesis, a stem is surgically inserted inside the medullary canal and connected with the external prosthetic limb. Therefore, this thesis aims to highlight and explore the main strengths and problems of osseointegrated prostheses and to examine the role of physical activity, with attention to functional capacity and bone quality. The objectives of the thesis will be developed through 5 studies: (I) A gait analysis of a 44 years-old male patient who underwent surgery for the implantation of an osseointegrated prosthesis; (II) A systematic review to investigate the state of stump bone quality in patients with limb amputations; (III) A systematic review of the technologies involved in such devices has been carried out to identify the most fruitful ones in improving bone quality; (IV) A systematic review investigating the topic of physical activity and bone turnover biomarkers; (V) A systematic review to investigate the effects of physical activity interventions combined with drug treatments on bone biomarkers in people with osteopenia and osteoporosis. The integrated prosthesis is a good solution for people with lower limb amputation who cannot use their traditional socket-type prosthesis. Although many objectives have already been achieved, there are still many aspects that we can improve. These include the creation of a multidisciplinary path that support patients along their path, with particular attention to the pre-surgery and the post-rehabilitation phase that is still lacking even if of fundamental impact in determining the quality of life.

Governing the water conservation in the Urmia Lake Basin: addressing macro systems’ fit and micro users’ behavior

To change unadapted water governing systems, and water users’ traditional conducts in line with climate change, understanding of systems’ structures and users’ behaviors is necessary. To this aim, comprehensive and pragmatic research was designed and implemented in the Urmia Lake Basin where due to the severe droughts, and human-made influences, especially through the agricultural development, the lake has been shrunken drastically. To analyze the water governance and conservation issues in the basin, an innovative framework was developed based on mathematical physics concepts and pro-environmental behavior theories. Accordingly, in system level (macro/meso), the problem of fit of the early-shaped water governing system associating with the function of “political-security” and “political-economic” factors in the basin was identified through mean-field models. Furthermore, the effect of a “political-environmental” factor, the Urmia Lake Restoration Program (ULRP), on reforming the system structure and hence its fit was assessed. The analysis results revealed that by revising the provincial boundaries (horizontal alternation) for the entity of Kurdistan province to permit that interact with the headquarter of West Azerbaijan province for its water demand-supply initiatives, the system fit can increase. Also, the constitution of the ULRP (vertical arrangement) not only could increase the structural fit of the water governing system to the basin, but also significantly could enhance the system fit through its water-saving policy. Besides, in individual level (micro), the governing factors of water conservation behavior of the major users/farmers were identified through rational and moral socio-psychological models. In rational approach, incorporating PMT and TPB, the SEM results demonstrated that “Perceived Vulnerability”, “Self-Efficacy”, “Response Efficacy”, “Response Cost”, “Subjective Norms” and “Institutional Trust” significantly affect the water-saving intention/behavior. Likewise, NAM based analysis as a moral approach, uncovered the significant effects of “Awareness of Consequences”, “Appraisal of Responsibility”, “Personal Norms” as well as “Place Attachment” and “Emotions” on water-saving intention.

Response times in computerized adaptive testing: a method for cheating detection

In the field of educational and psychological measurement, the shift from paper-based to computerized tests has become a prominent trend in recent years. Computerized tests allow for more complex and personalized test administration procedures, like Computerized Adaptive Testing (CAT). CAT, following the Item Response Theory (IRT) models, dynamically generates tests based on test-taker responses, driven by complex statistical algorithms. Even if CAT structures are complex, they are flexible and convenient, but concerns about test security should be addressed. Frequent item administration can lead to item exposure and cheating, necessitating preventive and diagnostic measures. In this thesis a method called "CHeater identification using Interim Person fit Statistic" (CHIPS) is developed, designed to identify and limit cheaters in real-time during test administration. CHIPS utilizes response times (RTs) to calculate an Interim Person fit Statistic (IPS), allowing for on-the-fly intervention using a more secret item bank. Also, a slight modification is proposed to overcome situations with constant speed, called Modified-CHIPS (M-CHIPS). A simulation study assesses CHIPS, highlighting its effectiveness in identifying and controlling cheaters. However, it reveals limitations when cheaters possess all correct answers. The M-CHIPS overcame this limitation. Furthermore, the method has shown not to be influenced by the cheaters’ ability distribution or the level of correlation between ability and speed of test-takers. Finally, the method has demonstrated flexibility for the choice of significance level and the transition from fixed-length tests to variable-length ones. The thesis discusses potential applications, including the suitability of the method for multiple-choice tests, assumptions about RT distribution and level of item pre-knowledge. Also limitations are discussed to explore future developments such as different RT distributions, unusual honest respondent behaviors, and field testing in real-world scenarios. In summary, CHIPS and M-CHIPS offer real-time cheating detection in CAT, enhancing test security and ability estimation while not penalizing test respondents.