Design and implementation of a Reinforcement Learning framework for iOS devices

Reinforcement Learning is an increasingly popular area of Artificial Intelligence. The applications of this learning paradigm are many, but its application in mobile computing is in its infancy. This study aims to provide an overview of current Reinforcement Learning applications on mobile devices, as well as to introduce a new framework for iOS devices: Swift-RL Lib. This new Swift package allows developers to easily support and integrate two of the most common RL algorithms, Q-Learning and Deep Q-Network, in a fully customizable environment. All processes are performed on the device, without any need for remote computation. The framework was tested in different settings and evaluated through several use cases. Through an in-depth performance analysis, we show that the platform provides effective and efficient support for Reinforcement Learning for mobile applications.

Collaborative technologies, higher order thinking and self-sufficient learning: A case study of adult learners

The inclusion of online elements in learning environments is becoming commonplace in Post Compulsory Education. A variety of research into the value of such elements is available, and this study aims to add further evidence by looking specifically at the use of collaborative technologies such as online discussion forums and wikis to encourage higher order thinking and self-sufficient learning. In particular, the research examines existing pedagogical models including Salmon’s five-stage model, along with other relevant literature. A case study of adult learners in community-based learning centres forms the basis of the research, and as a result of the findings, an arrow model is suggested as a framework for online collaboration that emphasises the learner, mentions pre-course preparation and then includes three main phases of activity: post, interact and critique. This builds on Salmon’s five-stage model and has the benefit of being flexible and responsive, as well as allowing for further development beyond the model, particularly in a blended learning environment.

Portfolios for learning; course design and platform choices

Presentation at M25 Learning Technology Group, FutureLearn, 15 November 2017

Integrated communication and learning towards autonomous mobile radio networks

The integration of distributed and ubiquitous intelligence has emerged over the last years as the mainspring of transformative advancements in mobile radio networks. As we approach the era of “mobile for intelligence”, next-generation wireless networks are poised to undergo significant and profound changes. Notably, the overarching challenge that lies ahead is the development and implementation of integrated communication and learning mechanisms that will enable the realization of autonomous mobile radio networks. The ultimate pursuit of eliminating human-in-the-loop constitutes an ambitious challenge, necessitating a meticulous delineation of the fundamental characteristics that artificial intelligence (AI) should possess to effectively achieve this objective. This challenge represents a paradigm shift in the design, deployment, and operation of wireless networks, where conventional, static configurations give way to dynamic, adaptive, and AI-native systems capable of self-optimization, self-sustainment, and learning. This thesis aims to provide a comprehensive exploration of the fundamental principles and practical approaches required to create autonomous mobile radio networks that seamlessly integrate communication and learning components. The first chapter of this thesis introduces the notion of Predictive Quality of Service (PQoS) and adaptive optimization and expands upon the challenge to achieve adaptable, reliable, and robust network performance in dynamic and ever-changing environments. The subsequent chapter delves into the revolutionary role of generative AI in shaping next-generation autonomous networks. This chapter emphasizes achieving trustworthy uncertainty-aware generation processes with the use of approximate Bayesian methods and aims to show how generative AI can improve generalization while reducing data communication costs. Finally, the thesis embarks on the topic of distributed learning over wireless networks. Distributed learning and its declinations, including multi-agent reinforcement learning systems and federated learning, have the potential to meet the scalability demands of modern data-driven applications, enabling efficient and collaborative model training across dynamic scenarios while ensuring data privacy and reducing communication overhead.

The Process of Simulation Authoring/Creation by Chemistry Teachers: A Service Learning Experience

Two case studies are presented to describe the process of public school teachers authoring and creating chemistry simulations. They are part of the Virtual Didactic Laboratory for Chemistry, a project developed by the School of the Future of the University of Sao Paulo. the documental analysis of the material produced by two groups of teachers reflects different selection process for both themes and problem-situations when creating simulations. The study demonstrates the potential for chemistry learning with an approach that takes students' everyday lives into account and is based on collaborative work among teachers and researches. Also, from the teachers' perspectives, the possibilities of interaction that a simulation offers for classroom activities are considered.

Students' collective knowledge construction in the virtual learning environment ""ToLigado - your school interactive newspaper""

Introduction. The ToLigado Project - Your School Interactive Newspaper is an interactive virtual learning environment conceived, developed, implemented and supported by researchers at the School of the Future Research Laboratory of the University of Sao Paulo, Brazil. Method. This virtual learning environment aims to motivate trans-disciplinary research among public school students and teachers in 2,931 schools equipped with Internet-access computer rooms. Within this virtual community, students produce collective multimedia research documents that are immediately published in the portal. The project also aims to increase students' autonomy for research, collaborative work and Web authorship. Main sections of the portal are presented and described. Results. Partial results of the first two years' implementation are presented and indicate a strong motivation among students to produce knowledge despite the fragile hardware and software infrastructure at the time. Discussion. In this new environment, students should be seen as 'knowledge architects' and teachers as facilitators, or 'curiosity managers'. The ToLigado portal may constitute a repository for future studies regarding student attitudes in virtual learning environments, students' behaviour as 'authors', Web authorship involving collective knowledge production, teachers' behaviour as facilitators, and virtual learning environments as digital repositories of students' knowledge construction and social capital in virtual learning communities.

Learning for fun: The unique contribution of educational leisure experiences

What do visitors want or expect from an educational leisure activity such as a visit to a museum, zoo, aquarium or other such experience? Is it to learn something or to experience learning? This paper uses the term 'learning for fun' to refer to the phenomenon in which visitors engage in a learning experience because they value and enjoy the process of learning itself. Five propositions regarding the nature of learning for fun are discussed, drawing on quantitative and qualitative data from visitors to a range of educational leisure activities. The commonalities between learning for fun and other theoretical constructs such as 'experience,' 'flow', 'intrinsic motivation', and 'curiosity' are explored. It is concluded that learning for fun is a unique and distinctive offering of educational leisure experiences, with implications for future research and experience design.

Fundamental Skills in Physics: Embedded Learning

Student attitudes towards a subject affect their learning. For students in physics service courses, relevance is emphasised by vocational applications. A similar strategy is being used for students who aspire to continued study of physics, in an introduction to fundamental skills in experimental physics – the concepts, computational tools and practical skills involved in appropriately obtaining and interpreting measurement data. An educational module is being developed that aims to enhance the student experience by embedding learning of these skills in the practicing physicist’s activity of doing an experiment (gravity estimation using a rolling pendulum). The group concentrates on particular skills prompted by challenges such as: • How can we get an answer to our question? • How good is our answer? • How can it be improved? This explicitly provides students the opportunity to consider and construct their own ideas. It gives them time to discuss, digest and practise without undue stress, thereby assisting them to internalise core skills. Design of the learning activity is approached in an iterative manner, via theoretical and practical considerations, with input from a range of teaching staff, and subject to trials of prototypes.

Undergraduate teaching of ideal and real fluid flows: The value of real-world experimental projects

This study describes the pedagogical impact of real-world experimental projects undertaken as part of an advanced undergraduate Fluid Mechanics subject at an Australian university. The projects have been organised to complement traditional lectures and introduce students to the challenges of professional design, physical modelling, data collection and analysis. The physical model studies combine experimental, analytical and numerical work in order to develop students’ abilities to tackle real-world problems. A first study illustrates the differences between ideal and real fluid flow force predictions based upon model tests of buildings in a large size wind tunnel used for research and professional testing. A second study introduces the complexity arising from unsteady non-uniform wave loading on a sheltered pile. The teaching initiative is supported by feedback from undergraduate students. The pedagogy of the course and projects is discussed with reference to experiential, project-based and collaborative learning. The practical work complements traditional lectures and tutorials, and provides opportunities which cannot be learnt in the classroom, real or virtual. Student feedback demonstrates a strong interest for the project phases of the course. This was associated with greater motivation for the course, leading in turn to lower failure rates. In terms of learning outcomes, the primary aim is to enable students to deliver a professional report as the final product, where physical model data are compared to ideal-fluid flow calculations and real-fluid flow analyses. Thus the students are exposed to a professional design approach involving a high level of expertise in fluid mechanics, with sufficient academic guidance to achieve carefully defined learning goals, while retaining sufficient flexibility for students to construct there own learning goals. The overall pedagogy is a blend of problem-based and project-based learning, which reflects academic research and professional practice. The assessment is a mix of peer-assessed oral presentations and written reports that aims to maximise student reflection and development. Student feedback indicated a strong motivation for courses that include a well-designed project component.

The clinical utility of the Hopkins Verbal Learning Test as a screening test for mild dementia

Objective. The purpose of this study was to determine whether the Hopkins Verbal Learning Test (HVLT) could be used as a valid and reliable screening test for mild dementia in older people, and to compare its performance to that of the Mini-Mental State Examination (MMSE). Method. Using a cross-sectional design, we studied three groups of older subjects recruited from a district geriatric psychiatry service: (1) 26 patients with DSM-IV dementia and MMSE scores of 18 or better; (2) 15 patients with psychiatric diagnoses other than dementia; and (3) 15 normal controls. The relationship of each potential cutting point on the HVLT and the MMSE was examined against the independently ascertained DSM-IV diagnoses of dementia using a Receiver Operating Characteristic (ROC) analysis. Results. The subjects consisted of 21 (37.5%) males and 35 (62.5%) females with a mean age of 74.7 (SD 6.1) years and a mean of 8.5 (SD 1.8) years of formal education. ROC analysis indicated that the optimal cutting point for detecting mild dementia in this group of subjects using the HVLT was 18/19 (sensitivity = 0.96, specificity = 0.80) and using the MMSE was 25/26 (sensitivity = 0.88, specificity = 0.93). Conclusions. The HVLT can be recommended as a valid and reliable screening test for mild dementia and as an adjunct in the clinical assessment of older people. The HVLT had better sensitivity than the MMSE in detecting patients with mild dementia, whereas the MMSE had better specificity. Copyright (C) 2000 John Wiley & Sons, Ltd.

Visualization of learning in multilayer perceptron networks using principal component analysis

This paper is concerned with the use of scientific visualization methods for the analysis of feedforward neural networks (NNs). Inevitably, the kinds of data associated with the design and implementation of neural networks are of very high dimensionality, presenting a major challenge for visualization. A method is described using the well-known statistical technique of principal component analysis (PCA). This is found to be an effective and useful method of visualizing the learning trajectories of many learning algorithms such as back-propagation and can also be used to provide insight into the learning process and the nature of the error surface.

Extinction of affective learning: No evidence for dual process accounts of human learning

The acquisition and extinction of affective valence to neutral geometrical shape conditional stimuli was investigated in three experiments. Experiment 1 employed a differential conditioning procedure with aversive shock USs. Differential electrodermal responding was evident during acquisition and lost during extinction. As indexed by verbal ratings, the CS1 acquired negative valence during acquisition,which was reduced after extinction. Affective priming, a reaction time based demand free measure of stimulus valence, failed to provide evidence for affective learning. Experiment 2 employed pictures of happy and angry faces as USs.Valence ratings after acquisitionweremore positive for theCS paired with happy faces (CS-H) and less positive for the CS paired with angry faces (CS-A) than during baseline. Extinction training reduced the extent of acquired valence significantly for both CSs, however, ratings of the CS-A remained different from baseline. Affective priming confirmed these results yielding differences between CS-A and CS-H after acquisition for pleasant and unpleasant targets, but for pleasant targets only after extinction. Experiment 3 replicated the design of Experiment 2, but presented the US pictures backwardly masked. Neither rating nor affective priming measures yielded any evidence for affective learning. The present results confirm across two different experimental procedures that, contrary to predictions from dual process accounts of human learning, affective learning is subject to extinction.

The Australian Universities Teaching Committee project in 'Learning Outcomes and Curriculum Development in Psychology'

The Australian Universities Teaching Committee (AUTC) funds projects intended to improve the quality of teaching and learning in specific disciplinary areas. The project brief for 'Learning Outcomes and Curriculum Development in Psychology' for 2004/2005 was to 'produce an evaluative overview of courses ... with a focus on the specification and assessment of learning outcomes and ... identify strategic directions for universities to enhance teaching and learning'. This project was awarded to a consortium from The University of Queensland, University of Tasmania, and Southern Cross University. The starting point for this project is an analysis of the scientist-practitioner model and its role in curriculum design, a review of current challenges at a conceptual level, and consideration of the implications of recent changes to universities relating to such things as intemationalisation of programs and technological advances. The project will seek to bring together stakeholders from around the country in order to survey the widest possible range of perspectives on the project brief requirements. It is hoped also to establish mechanisms for fiiture scholarly discussion of these issues, including the establishment of an Australian Society for the Teaching of Psychology and an annual conference.

Modulation of Mediotemporal and Ventrostriatal Function in Humans by Delta 9-Tetrahydrocannabinol A Neural Basis for the Effects of Cannabis sativa on Learning and Psychosis

Context: Cannabis sativa use can impair verbal learning, provoke acute psychosis, and increase the risk of schizophrenia. It is unclear where C sativa acts in the human brain to modulate verbal learning and to induce psychotic symptoms. Objectives: To investigate the effects of 2 main psychoactive constituents of C sativa, Delta 9-tetrahydrocannabinol (Delta 9-THC) and cannabidiol, on regional brain function during verbal paired associate learning. Design: Subjects were studied on 3 separate occasions using a block design functional magnetic resonance imaging paradigm while performing a verbal paired associate learning task. Each imaging session was preceded by the ingestion of Delta 9-THC (10 mg), cannabidiol (600 mg), or placebo in a double-blind, randomized, placebo-controlled, repeated-measures, within-subject design. Setting: University research center. Participants: Fifteen healthy, native English-speaking, right-handed men of white race/ethnicity who had used C sativa 15 times or less and had minimal exposure to other illicit drugs in their lifetime. Main Outcome Measures: Regional brain activation ( blood oxygen level-dependent response), performance in a verbal learning task, and objective and subjective ratings of psychotic symptoms, anxiety, intoxication, and sedation. Results: Delta 9-Tetrahydrocannabinol increased psychotic symptoms and levels of anxiety, intoxication, and sedation, whereas no significant effect was noted on these parameters following administration of cannabidiol. Performance in the verbal learning task was not significantly modulated by either drug. Administration of Delta 9-THC augmented activation in the parahippocampal gyrus during blocks 2 and 3 such that the normal linear decrement in activation across repeated encoding blocks was no longer evident. Delta 9-Tetrahydrocannabinol also attenuated the normal time-dependent change in ventrostriatal activation during retrieval of word pairs, which was directly correlated with concurrently induced psychotic symptoms. In contrast, administration of cannabidiol had no such effect. Conclusion: The modulation of mediotemporal and ventrostriatal function by Delta 9-THC may underlie the effects of C sativa on verbal learning and psychotic symptoms, respectively.

Organizational Learning in the Context of an Agri-Food Chain

This paper reports on the outcomes of the first stage of a longitudinal study that focused on the transformational change process being undertaken within the Supply Chain and Operations Area of a major Australian food manufacturing company. Organizational learning is an essential prerequisite for any successful change process and an organization's ability to learn is dependent on the existence of an environment within the organization that nurtures learning and the presence of key enablers that facilitate the learning process. An organization's capacity to learn can be enhanced through its ability to form and sustain collaborative relationships with its chain partners. The results show that an environment that supports organizational learning is being developed through consultative leadership and the empowerment of individuals within a culture that supports innovation and cross-functional teamwork but demands responsibility and accountability. The impact of these changes within the Supply Chain and Operations Area is evident in the significant improvement in the Area's productivity and efficiency levels over the past twelve months. The company's endeavours to engage its major supply chain partners in the learning process have been limited by the turmoil within the company. However the company has involved its supply chain partners in a series of mutually beneficial projects that have improved communication and built trust thereby laying the foundations for more collaborative chain relationships.