Semi-online neural-Q_leaming for real-time robot learning

Reinforcement learning (RL) is a very suitable technique for robot learning, as it can learn in unknown environments and in real-time computation. The main difficulties in adapting classic RL algorithms to robotic systems are the generalization problem and the correct observation of the Markovian state. This paper attempts to solve the generalization problem by proposing the semi-online neural-Q_learning algorithm (SONQL). The algorithm uses the classic Q_learning technique with two modifications. First, a neural network (NN) approximates the Q_function allowing the use of continuous states and actions. Second, a database of the most representative learning samples accelerates and stabilizes the convergence. The term semi-online is referred to the fact that the algorithm uses the current but also past learning samples. However, the algorithm is able to learn in real-time while the robot is interacting with the environment. The paper shows simulated results with the "mountain-car" benchmark and, also, real results with an underwater robot in a target following behavior

Occupational therapy and its relevance in social projects. relationships, learning and opportunities: collection of experiences of University of Alberta Mscot students in Bogotá, Colombia

Occupational therapists are equipped to promote wellbeing through occupation and to enable participation and meaningful engagement of people in their social and physical environments (WFOT, 2012). As such, the role of the occupational therapists is profoundly linked to the social, cultural and environmental characteristics of the contexts in which occupations take place. The central role that context plays in occupational performance creates an interesting dichotomy for the occupational therapist: on one hand, a profound understanding of cultural and social factors is required from the Occupational Therapy (OT) in order to develop a meaningful and successful collaboration with the person; on the other hand, the ability of the occupational therapists to recognize and explore the contextual factor of an occupation-person dyad transcends cultural and spatial barriers. As a result, occupational therapists are equipped to engage in international collaboration and practice, and as such face unique and enriching challenges. International fieldwork experiences have become a tool through which occupational therapists in training can develop the critical skills for understanding the impact of cultural and social factors on occupation. An OT student in an international fieldwork experience faces numerous challenges in leading a process that is both relevant and respectful to the characteristics of the local context: language, cultural perceptions of occupation and personhood, religious backgrounds, health care access, etc. These challenges stand out as ethical considerations that must be considered when navigating an international fieldwork experience (AOTA, 2009). For more than five years now, the Faculty of Rehabilitation Medicine (FRM) of the University of Alberta (UoFA) and the School of Medicine and Health Sciences at the Universidad del Rosario (UR), Bogota, Colombia, have sustained a productive and meaningful international collaboration. This collaboration includes a visit by Dr. Albert Cook, professor of the FRM and former dean, to the UR as the main guest speaker in the International Congress of Technologies for Disability Support (IBERDISCAP) in 2008. Furthermore, Dr. Cook was a speaker in the research seminar of the Assistive Technology Research Group of the Universidad del Rosario. Following Dr. Cook’s visit, Professors Liliana Álvarez and Adriana Ríos travelled to Edmonton and initiated collaboration with the FRM, resulting in the signing of an agreement between the FRM and the UR in 2009, agreement that has been maintained to this day. The main goal of this agreement is to increase academic and cultural cooperation between the UR and the UofA. Other activities have included the cooperation between Dr. Kim Adams (who has largely maintained interest and effort in supporting the capacity building of the UR rehabilitation programs in coordinating the provision of research placement opportunities for UR students at the UofA), an Assistive Technology course for clinicians and students led by Dr. Adams, and a research project that researched the use of basic cell phones to provide social interaction and health information access for people with disabilities in a low-income community in Colombia (led by Tim Barlott, OT, MSc, under the supervision of Dr. Adams). Since the beginning, the occupational therapy programs of the Universidad del Rosario and the University of Alberta have promoted this collaboration and have strived to engage in interactions that provide further development opportunities for students and staff. As part of this process, the international placement experience of UofA OT students was born under the leadership of: Claudia Rozo, OT program director at UR, placement and academic leadership of Elvis Castro and Angélica Monsalve, professors of the occupational therapy program at UR; and Dr. Lili Liu, OT department director at UofA, Cori Schmitz, Academic coordinator of clinical education at the UofA; and Tim Barlott and Liliana Álvarez leading the international and cross-cultural aspect of this collaboration.This publication summarizes and illustrates the process of international placement in community settings in Colombia, undertaken by occupational therapy students of the University of Alberta. It is our hope that this document can provide and document the ethical considerations of international fieldwork experience, the special characteristics of communities and the ways in which cultural and social competences are developed and help international students navigate the international setting. We also hope that this document will stimulate discussion among professional and academic communities about the importance and richness of international placement experiences and encourage staff and students to articulate their daily efforts with the global occupational therapy agenda.

Leadership and performance in multicultural business environments a qualitative study in German-Colombian teams

Multicultural leadership is a topic a great interest in nowadays globalized work environment. Colombia emerges as an attractive marketplace with appealing business opportunities, especially for German enterprises. After presenting Colombia’s current political, social and economic situation, the thesis elaborates the complex subject of cultural differences while focusing on the peculiarities of German and Colombian national cultures. The resulting implications for a team’s collaboration and leader effectiveness are theoretically supported with reference to the landmark studies of Hofstede and GLOBE. By utilizing semi-structured interview techniques, a qualitative research enriches the previous findings and gives an all-encompassing insight in German-Colombian teamwork. The investigation identifies distinctive behavioral patterns and relations, which imply challenges and factors of success for multicultural team leaders. Finally, a categorical analysis examines the influence of cultural traits on team performance and evaluates the effectiveness of the applied leadership style.

Vision 2020 - A whole life-cycle information management system for built environments

A whole life-cycle information management vision is proposed, the organizational requirements for the realization of the scenario is investigated. Preliminary interviews with construction professionals are reported. Discontinuities at information transfer throughout life-cycle of built environments are resulting from lack of coordination and multiple data collection/storage practices. A more coherent history of these activities can improve the work practices of various teams by augmenting decision making processes and creating organizational learning opportunities. Therefore, there is a need for unifying these fragmented bits of data to create a meaningful, semantically rich and standardized information repository for built environment. The proposed vision utilizes embedded technologies and distributed building information models. Two diverse construction project types (large one-off design, small repetitive design) are investigated for the applicability of the vision. A functional prototype software/hardware system for demonstrating the practical use of this vision is developed and discussed. Plans for case-studies for validating the proposed model at a large PFI hospital and housing association projects are discussed.

Estimation of distances in virtual environments using size constancy

It is reported in the literature that distances from the observer are underestimated more in virtual environments (VEs) than in physical world conditions. On the other hand estimation of size in VEs is quite accurate and follows a size-constancy law when rich cues are present. This study investigates how estimation of distance in a CAVETM environment is affected by poor and rich cue conditions, subject experience, and environmental learning when the position of the objects is estimated using an experimental paradigm that exploits size constancy. A group of 18 healthy participants was asked to move a virtual sphere controlled using the wand joystick to the position where they thought a previously-displayed virtual cube (stimulus) had appeared. Real-size physical models of the virtual objects were also presented to the participants as a reference of real physical distance during the trials. An accurate estimation of distance implied that the participants assessed the relative size of sphere and cube correctly. The cube appeared at depths between 0.6 m and 3 m, measured along the depth direction of the CAVE. The task was carried out in two environments: a poor cue one with limited background cues, and a rich cue one with textured background surfaces. It was found that distances were underestimated in both poor and rich cue conditions, with greater underestimation in the poor cue environment. The analysis also indicated that factors such as subject experience and environmental learning were not influential. However, least square fitting of Stevens’ power law indicated a high degree of accuracy during the estimation of object locations. This accuracy was higher than in other studies which were not based on a size-estimation paradigm. Thus as indirect result, this study appears to show that accuracy when estimating egocentric distances may be increased using an experimental method that provides information on the relative size of the objects used.

Cognitive and environmental factors influencing the process of spatial knowledge acquisition within virtual reality environments

As the fidelity of virtual environments (VE) continues to increase, the possibility of using them as training platforms is becoming increasingly realistic for a variety of application domains, including military and emergency personnel training. In the past, there was much debate on whether the acquisition and subsequent transfer of spatial knowledge from VEs to the real world is possible, or whether the differences in medium during training would essentially be an obstacle to truly learning geometric space. In this paper, the authors present various cognitive and environmental factors that not only contribute to this process, but also interact with each other to a certain degree, leading to a variable exposure time requirement in order for the process of spatial knowledge acquisition (SKA) to occur. The cognitive factors that the authors discuss include a variety of individual user differences such as: knowledge and experience; cognitive gender differences; aptitude and spatial orientation skill; and finally, cognitive styles. Environmental factors discussed include: Size, Spatial layout complexity and landmark distribution. It may seem obvious that since every individual's brain is unique - not only through experience, but also through genetic predisposition that a one size fits all approach to training would be illogical. Furthermore, considering that various cognitive differences may further emerge when a certain stimulus is present (e.g. complex environmental space), it would make even more sense to understand how these factors can impact spatial memory, and to try to adapt the training session by providing visual/auditory cues as well as by changing the exposure time requirements for each individual. The impact of this research domain is important to VE training in general, however within service and military domains, guaranteeing appropriate spatial training is critical in order to ensure that disorientation does not occur in a life or death scenario.

Student perceptions of iPads as mobile learning devices for fieldwork

This paper reports findings from six field courses about student’s perceptions of iPads as mobile learning devices for fieldwork. Data were collected through surveys and focus groups. The key findings suggest that the multi-tool nature of the iPads and their portability were the main strengths. Students had some concerns over the safety of the iPads in adverse weather and rugged environments, though most of these concerns were eliminated after using the devices with protective cases. Reduced connectivity was found to be one of the main challenges for mobile learning. Finally, students and practitioners views of why they used the mobile devices for fieldwork did not align.

Reducing defects through organizational learning within a Housing Association environment

Housing Associations (HAs) contribute circa 20% of the UK’s housing supply. HAs are however under increasing pressure as a result of funding cuts and rent reductions. Due to the increased pressure, a number of processes are currently being reviewed by HAs, especially how they manage and learn from defects. Learning from defects is considered a useful approach to achieving defect reduction within the UK housebuilding industry. This paper contributes to our understanding of how HAs learn from defects by undertaking an initial round table discussion with key HA stakeholders as part of an ongoing collaborative research project with the National House Building Council (NHBC) to better understand how house builders and HAs learn from defects to reduce their prevalence. The initial discussion shows that defect information runs through a number of groups, both internal and external of a HA during both the defects management process and organizational learning (OL) process. Furthermore, HAs are reliant on capturing and recording defect data as the foundation for the OL process. During the OL process defect data analysis is the primary enabler to recognizing a need for a change to organizational routines. When a need for change has been recognized, new options are typically pursued to design out defects via updates to a HAs Employer’s Requirements. Proposed solutions are selected by a review board and committed to organizational routine. After implementing a change, both structured and unstructured feedback is sought to establish the change’s success. The findings from the HA discussion demonstrates that OL can achieve defect reduction within the house building sector in the UK. The paper concludes by outlining a potential ‘learning from defects model’ for the housebuilding industry as well as describing future work.

A survey on wireless body area networks for eHealthcare systems in residential environments

The progress in wearable and implanted health monitoring technologies has strong potential to alter the future of healthcare services by enabling ubiquitous monitoring of patients. A typical health monitoring system consists of a network of wearable or implanted sensors that constantly monitor physiological parameters. Collected data are relayed using existing wireless communication protocols to the base station for additional processing. This article provides researchers with information to compare the existing low-power communication technologies that can potentially support the rapid development and deployment of WBAN systems, and mainly focuses on remote monitoring of elderly or chronically ill patients in residential environments.

Automatically linking live experiences captured with a ubiquitous infrastructure

Ubiquitous computing aims at providing services to users in everyday environments such as the home. One research theme in this area is that of building capture and access applications which support information to be recorded ( captured) during a live experience toward automatically producing documents for review (accessed). The recording demands instrumented environments with devices such as microphones, cameras, sensors and electronic whiteboards. Since each experience is usually related to many others ( e. g. several meetings of a project), there is a demand for mechanisms supporting the automatic linking among documents relative to different experiences. In this paper we present original results relative to the integration of our previous efforts in the Infrastructure for Capturing, Accessing, Linking, Storing and Presenting information (CALiSP). Ubiquitous computing aims at providing services to users in everyday environments such as the home. One research theme in this area is that of building capture and access applications which support information to be recorded (captured) during a live experience toward automatically producing documents for review (accessed). The recording demands instrumented environments with devices such as microphones, cameras, sensors and electronic whiteboards. Since each experience is usually related to many others (e.g. several meetings of a project), there is a demand for mechanisms supporting the automatic linking among documents relative to different experiences. In this paper we present original results relative to the integration of our previous efforts in the Infrastructure for Capturing, Accessing, Linking, Storing and Presenting information (CALiSP).

Ubiquitous computing in education : a SWOT analysis by students and teachers

Learning from anywhere anytime is a contemporary phenomenon in the field of education that is thought to be flexible, time and cost saving. The phenomenon is evident in the way computer technology mediates knowledge processes among learners. Computer technology is however, in some instances, faulted. There are studies that highlight drawbacks of computer technology use in learning. In this study we aimed at conducting a SWOT analysis on ubiquitous computing and computer-mediated social interaction and their affect on education. Students and teachers were interviewed on the mentioned concepts using focus group interviews. Our contribution in this study is, identifying what teachers and students perceive to be the strength, weaknesses, opportunities and threats of ubiquitous computing and computer-mediated social interaction in education. We also relate the findings with literature and present a common understanding on the SWOT of these concepts. Results show positive perceptions. Respondents revealed that ubiquitous computing and computer-mediated social interaction are important in their education due to advantages such as flexibility, efficiency in terms of cost and time, ability to acquire computer skills. Nevertheless disadvantages where also mentioned for example health effects, privacy and security issues, noise in the learning environment, to mention but a few. This paper gives suggestions on how to overcome threats mentioned.

Languaging in virtual learning sites : studies of online encounters in the language-focused classroom

This thesis focuses upon a series of empirical studies which examine communication and learning in online glocal communities within higher education in Sweden. A recurring theme in the theoretical framework deals with issues of languaging in virtual multimodal environments as well as the making of identity and negotiation of meaning in these settings; analyzing the activity, what people do, in contraposition to the study of how people talk about their activity. The studies arise from netnographic work during two online Italian for Beginners courses offered by a Swedish university. Microanalyses of the interactions occurring through multimodal video-conferencing software are amplified by the study of the courses’ organisation of space and time and have allowed for the identification of communicative strategies and interactional patterns in virtual learning sites when participants communicate in a language variety with which they have a limited experience. The findings from the four studies included in the thesis indicate that students who are part of institutional virtual higher educational settings make use of several resources in order to perform their identity positions inside the group as a way to enrich and nurture the process of communication and learning in this online glocal community. The sociocultural dialogical analyses also shed light on the ways in which participants gathering in discursive technological spaces benefit from the opportunity to go to class without commuting to the physical building of the institution providing the course. This identity position is, thus, both experienced by participants in interaction, and also afforded by the ‘spaceless’ nature of the online environment.

Learning-by-employing: the value of commitment

We analyze a dynamic principal–agent model where an infinitely-lived principal faces a sequence of finitely-lived agents who differ in their ability to produce output. The ability of an agent is initially unknown to both him and the principal. An agent’s effort affects the information on ability that is conveyed by performance. We characterize the equilibrium contracts and show that they display short–term commitment to employment when the impact of effort on output is persistent but delayed. By providing insurance against early termination, commitment encourages agents to exert effort, and thus improves on the principal’s ability to identify their talent. We argue that this helps explain the use of probationary appointments in environments in which there exists uncertainty about individual ability.

Learning in peer-to-peer markets: evidence from Airbnb

Peer-to-peer markets are highly uncertain environments due to the constant presence of shocks. As a consequence, sellers have to constantly adjust to these shocks. Dynamic Pricing is hard, especially for non-professional sellers. We study it in an accommodation rental marketplace, Airbnb. With scraped data from its website, we: 1) describe pricing patterns consistent with learning; 2) estimate a demand model and use it to simulate a dynamic pricing model. We simulate it under three scenarios: a) with learning; b) without learning; c) with full information. We have found that information is an important feature concerning rental markets. Furthermore, we have found that learning is important for hosts to improve their profits.