Towards vision-based deep reinforcement learning for robotic motion control

This paper introduces a machine learning based system for controlling a robotic manipulator with visual perception only. The capability to autonomously learn robot controllers solely from raw-pixel images and without any prior knowledge of configuration is shown for the first time. We build upon the success of recent deep reinforcement learning and develop a system for learning target reaching with a three-joint robot manipulator using external visual observation. A Deep Q Network (DQN) was demonstrated to perform target reaching after training in simulation. Transferring the network to real hardware and real observation in a naive approach failed, but experiments show that the network works when replacing camera images with synthetic images.

The moderating effects of job control and selection, optimization, and compensation strategies on the age-work ability relationship

Work ability describes employees' capability to carry out their work with respect to physical and psychological job demands. This study investigated direct and interactive effects of age, job control, and the use of successful aging strategies called selection, optimization, and compensation (SOC) in predicting work ability. We assessed SOC strategies and job control by using employee self-reports, and we measured employees' work ability using supervisor ratings. Data collected from 173 health-care employees showed that job control was positively associated with work ability. Additionally, we found a three-way interaction effect of age, job control, and use of SOC strategies on work ability. Specifically, the negative relationship between age and work ability was weakest for employees with high job control and high use of SOC strategies. These results suggest that the use of successful aging strategies and enhanced control at work are conducive to maintaining the work ability of aging employees. We discuss theoretical and practical implications regarding the beneficial role of the use of SOC strategies utilized by older employees and enhanced contextual resources at work for aging employees.

Focus on opportunities as a boundary condition of the relationship between job control and work engagement: A multi-sample, multi-method study

The concept of focus on opportunities describes how many new goals, options, and possibilities employees believe to have in their personal future at work. In this multi-sample, multi-method study, the authors investigated relationships between focus on opportunities and general and daily work engagement and the moderating role of focus on opportunities on between- and within-person relationships between job control and work engagement. Based on a social cognitive theory framework on the motivating potential of a future temporal focus, it was hypothesized that focus on opportunities is positively related to work engagement. Further, consistent with the notion of compensatory resources, it was expected that job control is not related to work engagement among employees with a high focus on opportunities, whereas job control, as an external resource of the work environment, is positively related to work engagement among employees with a low focus on opportunities. Both a cross-sectional survey study (N=174) and a daily diary study (N=64) supported the hypotheses. The study contributes to research on the job demands-resources model as it emphasizes the role of focus on opportunities as a motivational factor in the relationship between job control and work engagement.

Locus of control

The construct known as locus of control (LOC) was introduced by J. B. Rotter in 1966 and refers to individuals' beliefs about the underlying main causes of events happening in their lives. Individuals with an internal LOC believe that the outcomes they experience are the result of their own actions. They are often described as believing themselves to be the masters of their own fate and to be in control of their own destinies. In contrast, individuals with an external LOC believe that external factors—such as fate, luck, God, or powerful others—determine the outcomes that they experience in their lives. They are often described as taking a passive approach toward their lives.

Assessment and control of Bacillus cereus emetic toxin in food

Despite of improving levels of hygiene, the incidence of registered food borne disease has been at the same level for many years: there were 40 to 90 epidemics in which 1000-9000 persons contracted food poisoning through food or drinking water in Finland. Until the year 2004 salmonella and campylobacter were the most common bacterial causes of food borne diseases, but in years 2005-2006 Bacillus cereus was the most common. Similar developement has been published i.e. in Germany already in the 1990´s. One reason for this can be Bacillus cereus and its emetic toxin, cereulide. Bacillus cereus is a common environmental bacterium that contaminates raw materials of food. Otherwise than salmonella and campylobacter, Bacillus cereus is a heat resistant bacterium, capable of surviving most cooking procedures due to the production of highly thermo resistant spores. The food involved has usually been heat treated and surviving spores are the source of the food poisoning. The heat treatment induces germination of the spore and the vegetative cells then produce toxins. This doctoral thesis research focuses on developing methods for assessing and eliminating risks to food safety by cereulide producing Bacillus cereus. The biochemistry and physiology of cereulide production was investigated and the results were targeted to offer tools for minimizing toxin risk in food during the production. I developed methods for the extraction and quantitative analysis of cereulide directly from food. A prerequisite for that is knowledge of the chemical and physical properties of the toxin. Because cereulide is practically insoluble in water, I used organic solvents; methanol, ethanol and pentane for the extraction. For extraction of bakery products I used high temperature (100C) and pressure (103.4 bars). Alternaties for effective extraction is to flood the plain food with ethanol, followed by stationary equilibration at room temperature. I used this protocol for extracting cereulide from potato puree and penne. Using this extraction method it is also possible also extract cereulide from liquid food, like milk. These extraction methods are important improvement steps for studying of Bacillus cereus emetic food poisonings. Prior my work, cereulide extraction was done using water. As the result, the yield was poor and variable. To investigate suspected food poisonings, it is important to show actual toxicity of the incriminated food. Many toxins, but not cereulide, inactivate during food processing like heating. The next step is to identify toxin by chemical methods. I developed with my colleague Maria Andesson a rapid assay for the detection of cereulide toxicity, within 5 to 15 minutes. By applying this test it is possible to rapidly detect which food was causing the food poisoning. The chemical identification of cereulide was achieved using mass spectrometry. I used cereulide specific molecular ions, m/z (+/-0.3) 1153.8 (M+H+), 1171.0 (M+NH4+), 1176.0 (M+Na+) and 1191.7 (M+K+) for reliable identification. I investigated foods to find out their amenability to accumulate cereulide. Cereulide was formed high amounts (0.3 to 5.5 microg/g wet wt) when of cereulide producing B. cereus strains were present in beans, rice, rice-pastry and meat-pastry, if stored at non refrigerated temperatures (21-23C). Rice and meat pastries are frequently consumed under conditions where no cooled storage is available e.g. picnics and outdoor events. Bacillus cereus is a ubiquitous spore former and is therefore difficult to eliminate from foods. It is therefore important to know which conditions will affect the formation of cereulide in foods. My research showed that the cereulide content was strongly (10 to 1000 fold differences in toxin content) affected by the growth environment of the bacterium. Storage of foods under nitrogen atmosphere (> 99.5 %) prevented the production of cereulide. But when also carbon dioxide was present, minimizing the oxygen contant (< 1%) did not protect the food from formation of cereulide in preliminary experiments. Also food supplements affected cereulide production at least in the laboratory. Adding free amino acids, leucine and valine, stimulated cereulide production 10 to 20 fold. In peptide bonded form these amino acids are natural constituents in all proteins. Interestingly, adding peptide bonded leucine and valine had no significant effect on cereulide production. Free amino acids leucine and valine are approved food supplements and widely used as flawour modifiers in food technology. My research showed that these food supplements may increase food poisoning risk even though they are not toxic themselves.

Field Assessments of Control Agents for Lesser Mealworm (Coleoptera: Tenebrionidae) Using Litter Sampling

Spinosad, diatomaceous earth, and cyfluthrin were assessed on two broiler farms at Gleneagle and Gatton in southeastern Queensland, Australia in 2004-2005 and 2007-2009, respectively to determine their effectiveness in controlling lesser mealworm, Alphitobius diaperinus (Panzer) (Coleoptera: Tenebrionidae). Insecticide treatments were applied mostly to earth or 'hard' cement floors of broiler houses before the placement of new bedding. Efficacy of each agent was assessed by regular sampling of litter and counting of immature stages and adult beetles, and comparing insect counts in treatments to counts in untreated houses. Generally, the lowest numbers of lesser mealworm were recorded in the house with hard floors, these numbers equalling the most effective spinosad applications. The most effective treatment was a strategic application of spinosad under feed supply lines on a hard floor. In compacted earth floor houses, mean numbers of lesser mealworms for two under-feed-line spinosad treatments (i.e., 2-m-wide application at 0.18 g of active insecticide (g [AI]) in 100-ml water/m(2), and 1-m-wide application at 0.11 g ([AI] in 33-ml water/m(2)), and an entire floor spinosad treatment (0.07 g [AI] in 86-ml water/m2) were significantly lower (i.e., better control) than those numbers for cyfluthrin, and no treatment (controls). The 1-m-wide under-feed-line treatment was the most cost-effective dose, providing similar control to the other two most effective spinosad treatments, but using less than half the active component per broiler house. No efficacy was demonstrated when spinosad was applied to the surface of bedding in relatively large volumes of water. All applications of diatomaceous earth, applied with and without spinosad, and cyfluthrin at the label rate of 0.02 g (AI)/100-ml water/m(2) showed no effect, with insect counts not significantly different to untreated controls. Overall, the results of this field assessment indicate that cyfluthrin (the Australian industry standard) and diatomaceous earth were ineffective on these two farms and that spinosad can be a viable alternative for broiler house use.

Mitochondrial DNA diversity of Cleruchoides noackae (Hymenoptera: Mymaridae): a potential biological control agent for Thaumastocoris peregrinus (Hemiptera: Thaumastocoridae)

Carpintero and Dellap, (Hemiptera: Thaumastocoridae) is a native Australian sap-feeding insect that has become invasive and seriously damaging to commercially grown in the Southern Hemisphere. Lin and Huber (Hymenoptera: Mymaridae) was recently discovered as an egg parasitoid of the Thaumastocoridae in Australia. Mitochondrial DNA (mtDNA; cytochrome oxidase subunit I, COI) sequence diversity amongst 104 individuals from these native populations revealed 24 sequence haplotypes. The COI haplotypes of individuals collected from the Sydney and Southeast Queensland clustered in distinct groups, indicating limited spread of the insect between the regions. Individuals collected from Perth in Western Australia were represented by four COI haplotypes. Although this population is geographically more isolated from other populations, two COI haplotypes were identical to haplotypes found in the Sydney region. The results suggest that has recently been introduced into Perth, possibly from the Sydney area. The high mtDNA diversity and limited spread that is suggested for is in contrast to the lack of geographic associated mtDNA diversity and extensive spread of . If implemented as a biological control agent, this factor will need to be considered in collecting and releasing .

On Bit Steering in the Minimization of the Control Memory of Microprogrammed Processors

The microcommands constituting the microprogram of the control memory of a microprogrammed processor can be partitioned into a number of disjoint sets. Some of these sets are then encoded to minimize the word width of the ROM storing the microprogram. A further reduction in the width of the ROM words can be achieved by a technique known as bit steering where one or more bits are shared by two or more sets of microcommands. These sets are called the steerable sets. This correspondence presents a simple method for the detection and encoding of steerable sets. It has been shown that the concurrency matrix of two steerable sets exhibits definite patterns of clusters which can be easily recognized. A relation "connection" has been defined which helps in the detection of three-set steerability. Once steerable sets are identified, their encoding becomes a straightforward procedure following the location of the identifying clusters on the concurrency matrix or matrices.

Wild dog control impacts on calf wastage in extensive beef cattle enterprises

Wild dogs (Canis lupus dingo and hybrids) are routinely controlled to protect beef cattle from predation yet beef producers are sometimes ambivalent as to whether wild dogs are a significant problem or not. This paper reports the loss of calves between birth and weaning in pregnancy-tested herds located on two beef cattle properties in south-central and far north Queensland for up to 4 consecutive years. Comparisons of lactation failures (identified when dams that previously tested pregnant were found non-lactating at weaning) were made between adjoining test herds grazed in places with or without annual (or twice annual) wild dog poison baiting programs. No correlation between wild dog relative abundance and lactation failures was apparent. Calf loss was frequently higher (three in 7 site-years, 11–32%) in baited areas than in non-baited areas (9% in 1 of 7 site-years). Predation loss of calves (in either area) only occurred in seasons of below-average rainfall, but was not related to herd nutrition. These data suggest that controlling wild dogs to protect calves on extensive beef cattle enterprises is unnecessary in most years because wild dogs do not routinely prey on calves. In those seasons when wild dog predation might occur, baiting can be counter-productive. Baiting appears to produce perturbations that change the way surviving or re-colonising wild dog populations select and handle prey and/or how they interact with livestock.

Prospects for the classical biological control of Calotropis procera (Apocynaceae) using co-evolved insects

Calotropis procera (Apocynaceae), a native of tropical Africa, the Middle East and the Indian subcontinent, is a serious environmental and rangeland weed of Australia and Brazil. It is also a weed in Hawaii in USA, the Caribbean Islands, the Seychelles, Mexico, Thailand, Vietnam and many Pacific Islands. In the native range C. procera has many natural enemies, thus classical biological control could be the most cost-effective option for its long-term management. Based on field surveys in India and a literature search, some 65 species of insects and five species of mites have been documented on C. procera and another congeneric-invador C. gigantea in the native range. All the leaf-feeding and stem-boring agents recorded on Calotropis spp. have wide host range. Three pre-dispersal seed predators,the Aak weevil Paramecops farinosus and the Aak fruit fly Dacuspersicus in the Indian subcontinent, and the Sodom apple fruit fly Dacus longistylus in the Middle East have been identified as prospective biological control agents based on their field host range. In Australia and Brazil, where C. procera has the potential to spread across vast areas, pre-dispersal seed predators would help to limit the spread of the weed. While the fruits of C. procera vary in size and shape across its range, those from India are similar to the ones in Australia and Brazil. Hence, seed-feeding insects from India are more likely to be suitable due to adaptation to fruit size and morphology. Future survey efforts for potential biological control agents should focus on North Africa.

Development of cat’s claw creeper leaf-tying moth Hypocosmia pyrochroma (Lepidoptera: Pyralidae) at different temperatures: Implications for establishment as a biological control agent in Australia and South Africa

The leaf-tying moth Hypocosmia pyrochroma Jones (Lepidoptera: Pyralidae), a native of sub tropical South America, has been introduced as a biological control agent for cat’s claw creeper, Dolichandra unguis-cati (L.) Lohman (Bignoniaceae), in Australia and South Africa. So far there has been no evidence of its field establishment in either country. A narrow temperature tolerance is a potential limiting factor for the establishment of weed biological control insects in novel habitats. In this study, we evaluated the effect of seven constant temperatures (12–40 °C) on the survival and development of H. pyrochroma in temperature-controlled cabinets. Temperatures between 20 and 30 °C were the most favorable for adult survival, oviposition, egg hatching, and larval and pupal development. Adult survival (12–40 °C) and egg development (15–35 °C) showed tolerance for wider temperature ranges than oviposition, and larval and pupal development, which were all negatively affected by both high (>30 °C) and low (<20 °C) temperatures. The degree-day (DD) requirement to complete a generation was estimated as 877 above a threshold temperature of 12 °C. Based on DD requirements and an obligatory winter diapause of pupae from mid-autumn to mid-spring, the potential number of generations (egg to adult) the leaf-tying moth can complete in a year in Australia or South Africa range from one to three. A climate-matching model predicted that the inland regions of both Australia and South Africa are less favorable for H. pyrochroma than the coastal areas. The study suggested that H. pyrochroma is more likely to establish in the coastal areas of Australia where most of the cat’s claw creeper infestations occur, than in South Africa where most of the cat’s claw creeper infestations are inland.