Using the EM Algorithm to Train Neural Networks: Misconceptions and a New Algorithm for Multiclass Classification

The expectation-maximization (EM) algorithm has been of considerable interest in recent years as the basis for various algorithms in application areas of neural networks such as pattern recognition. However, there exists some misconceptions concerning its application to neural networks. In this paper, we clarify these misconceptions and consider how the EM algorithm can be adopted to train multilayer perceptron (MLP) and mixture of experts (ME) networks in applications to multiclass classification. We identify some situations where the application of the EM algorithm to train MLP networks may be of limited value and discuss some ways of handling the difficulties. For ME networks, it is reported in the literature that networks trained by the EM algorithm using iteratively reweighted least squares (IRLS) algorithm in the inner loop of the M-step, often performed poorly in multiclass classification. However, we found that the convergence of the IRLS algorithm is stable and that the log likelihood is monotonic increasing when a learning rate smaller than one is adopted. Also, we propose the use of an expectation-conditional maximization (ECM) algorithm to train ME networks. Its performance is demonstrated to be superior to the IRLS algorithm on some simulated and real data sets.

Pushing the Quality Level in Networked News Business: Semantic-Based Content Retrieval and Composition in International News Publishing

Electronic publishing exploits numerous possibilities to present or exchange information and to communicate via most current media like the Internet. By utilizing modern Web technologies like Web Services, loosely coupled services, and peer-to-peer networks we describe the integration of an intelligent business news presentation and distribution network. Employing semantics technologies enables the coupling of multinational and multilingual business news data on a scalable international level and thus introduce a service quality that is not achieved by alternative technologies in the news distribution area so far. Architecturally, we identified the loose coupling of existing services as the most feasible way to address multinational and multilingual news presentation and distribution networks. Furthermore we semantically enrich multinational news contents by relating them using AI techniques like the Vector Space Model. Summarizing our experiences we describe the technical integration of semantics and communication technologies in order to create a modern international news network.

Quality assessment of video transmission in heterogeneous networks as applied to real-time telecare

This work looks into video quality assessment applied to the field of telecare and proposes an alternative metric to the more traditionally used PSNR based on the requirements of such an application. We show that the Pause Intensity metric introduced in [1] is also relevant and applicable to heterogeneous networks with a wireless last hop connected to a wired TCP backbone. We demonstrate through our emulation testbed that the impairments experienced in such a network architecture are dominated by continuity based impairments rather than artifacts, such as motion drift or blockiness. We also look into the implication of using Pause Intensity as a metric in terms of the overall video latency, which is potentially problematic should the video be sent and acted upon in real-time. We conclude that Pause Intensity may be used alongside the video characteristics which have been suggested as a measure of the overall video quality. © 2012 IEEE.

The impact of friends on newly immigrant children's emotional and behavioral adjustment

Immigration disrupts an individual's support network; however, the stresses of the immigration process increase the need for social support. The presence of social support becomes essential for immigrant children and adolescents to cope with these important transitional circumstances. Friends are both sources of social support and models for behavior. Furthermore, friendship networks are known to have a significant influence on youths' functioning. Literature suggests that peer relations become more important in adolescence and friend support is related to child and adolescent well-being. Thus, friend relationships may be particularly important for immigrant youths who experience disruption in their friendship networks during the process of migration to another country. In addition to friendship networks and support, friend characteristics also need to be taken into consideration as important factors for immigrant youth adjustment. My study involved analyses of the effects of friend support and friend problem behaviors on emotional and behavioral functioning for elementary, middle, and high school age newly immigrant children and adolescents. ^ Immigrant children and adolescents (N = 503) were interviewed at schools by interviewers fluent in participants' languages. Structural Equation Modeling (SEM) analyses revealed that friend support and friend problem behaviors were related to children's self-esteem and externalizing behaviors. In addition, friend problem behavior alone predicted children's psychological symptoms and depression scores. Furthermore, age/grade was found to be a moderator for the relation between friend problem behavior and immigrant youth behavioral adjustment such that compared to elementary and high school cohorts, middle school youths showed more externalizing behaviors when they had friends performing problem behaviors. ^ Results supported the idea that both friend support and friend behavior are related to newly immigrant youths' emotional and behavioral adjustment. This study informs further research and interventions concerning the development of programs to facilitate immigrant youths' adjustment by revealing friendship factors related to their adaptation.^

Ethnicity and the prostate cancer experience: a qualitative metasynthesis

Mobility in vehicular networks with multiple access points to the infrastructure

Nowadays there is a huge evolution in the technological world and in the wireless networks. The electronic devices have more capabilities and resources over the years, which makes the users more and more demanding. The necessity of being connected to the global world leads to the arising of wireless access points in the cities to provide internet access to the people in order to keep the constant interaction with the world. Vehicular networks arise to support safety related applications and to improve the traffic flow in the roads; however, nowadays they are also used to provide entertainment to the users present in the vehicles. The best way to increase the utilization of the vehicular networks is to give to the users what they want: a constant connection to the internet. Despite of all the advances in the vehicular networks, there were several issues to be solved. The presence of dedicated infrastructure to vehicular networks is not wide yet, which leads to the need of using the available Wi-Fi hotspots and the cellular networks as access networks. In order to make all the management of the mobility process and to keep the user’s connection and session active, a mobility protocol is needed. Taking into account the huge number of access points present at the range of a vehicle for example in a city, it will be beneficial to take advantage of all available resources in order to improve all the vehicular network, either to the users and to the operators. The concept of multihoming allows to take advantage of all available resources with multiple simultaneous connections. This dissertation has as objectives the integration of a mobility protocol, the Network-Proxy Mobile IPv6 protocol, with a host-multihoming per packet solution in order to increase the performance of the network by using more resources simultaneously, the support of multi-hop communications, either in IPv6 or IPv4, the capability of providing internet access to the users of the network, and the integration of the developed protocol in the vehicular environment, with the WAVE, Wi-Fi and cellular technologies. The performed tests focused on the multihoming features implemented on this dissertation, and on the IPv4 network access for the normal users. The obtained results show that the multihoming addition to the mobility protocol improves the network performance and provides a better resource management. Also, the results show the correct operation of the developed protocol in a vehicular environment.

Provable Security for Cryptocurrencies

The past several years have seen the surprising and rapid rise of Bitcoin and other “cryptocurrencies.” These are decentralized peer-to-peer networks that allow users to transmit money, tocompose financial instruments, and to enforce contracts between mutually distrusting peers, andthat show great promise as a foundation for financial infrastructure that is more robust, efficientand equitable than ours today. However, it is difficult to reason about the security of cryptocurrencies. Bitcoin is a complex system, comprising many intricate and subtly-interacting protocol layers. At each layer it features design innovations that (prior to our work) have not undergone any rigorous analysis. Compounding the challenge, Bitcoin is but one of hundreds of competing cryptocurrencies in an ecosystem that is constantly evolving. The goal of this thesis is to formally reason about the security of cryptocurrencies, reining in their complexity, and providing well-defined and justified statements of their guarantees. We provide a formal specification and construction for each layer of an abstract cryptocurrency protocol, and prove that our constructions satisfy their specifications. The contributions of this thesis are centered around two new abstractions: “scratch-off puzzles,” and the “blockchain functionality” model. Scratch-off puzzles are a generalization of the Bitcoin “mining” algorithm, its most iconic and novel design feature. We show how to provide secure upgrades to a cryptocurrency by instantiating the protocol with alternative puzzle schemes. We construct secure puzzles that address important and well-known challenges facing Bitcoin today, including wasted energy and dangerous coalitions. The blockchain functionality is a general-purpose model of a cryptocurrency rooted in the “Universal Composability” cryptography theory. We use this model to express a wide range of applications, including transparent “smart contracts” (like those featured in Bitcoin and Ethereum), and also privacy-preserving applications like sealed-bid auctions. We also construct a new protocol compiler, called Hawk, which translates user-provided specifications into privacy-preserving protocols based on zero-knowledge proofs.

The first year: the support needs of parents caring for a child with an intellectual disability

AIM: To describe the support needs of parents caring for a child with an intellectual disability in the first year of life. BACKGROUND: Parents of children with intellectual disabilities face significant challenges during the first year of their child's life which is an important developmental period not previously addressed in the literature. The provision of support by health professionals, particularly nurses and midwives, during this crucial period can impact on parental well-being and on the health and developmental outcomes of their children. However, parents often feel unsupported. DESIGN: The study used a qualitative descriptive methodology. METHODS: Semi-structured interviews were conducted with parents of eleven children with an intellectual disability in Victoria, Australia, during 2014. Interviews were digitally recorded, transcribed verbatim and analysed using thematic data analysis. FINDINGS: Three key areas of support need were identified to assist parents to provide effective care for their child with an intellectual disability in the first year of life: (1) emotional support as parents adjusted to their role of caring for a child with an intellectual disability; (2) information support as they embarked on a quest for knowledge; and (3) support to facilitate their connection to peer networks. The findings highlighted inconsistent provision of support for parents. CONCLUSION: This study informs health professionals about how to provide holistic, timely support to parents of children with intellectual disabilities in the first year of life. There is an urgent need to review how nurses and midwives can provide relevant support that is responsive to parents' needs.

The Impact of Friends on Newly Immigrant Children’s Emotional and Behavioral Adjustment

Immigration disrupts an individual’s support network; however, the stresses of the immigration process increase the need for social support. The presence of social support becomes essential for immigrant children and adolescents to cope with these important transitional circumstances. Friends are both sources of social support and models for behavior. Furthermore, friendship networks are known to have a significant influence on youths’ functioning. Literature suggests that peer relations become more important in adolescence and friend support is related to child and adolescent well-being. Thus, friend relationships may be particularly important for immigrant youths who experience disruption in their friendship networks during the process of migration to another country. In addition to friendship networks and support, friend characteristics also need to be taken into consideration as important factors for immigrant youth adjustment. My study involved analyses of the effects of friend support and friend problem behaviors on emotional and behavioral functioning for elementary, middle, and high school age newly immigrant children and adolescents. Immigrant children and adolescents (N = 503) were interviewed at schools by interviewers fluent in participants’ languages. Structural Equation Modeling (SEM) analyses revealed that friend support and friend problem behaviors were related to children’s self-esteem and externalizing behaviors. In addition, friend problem behavior alone predicted children’s psychological symptoms and depression scores. Furthermore, age/grade was found to be a moderator for the relation between friend problem behavior and immigrant youth behavioral adjustment such that compared to elementary and high school cohorts, middle school youths showed more externalizing behaviors when they had friends performing problem behaviors. Results supported the idea that both friend support and friend behavior are related to newly immigrant youths’ emotional and behavioral adjustment. This study informs further research and interventions concerning the development of programs to facilitate immigrant youths’ adjustment by revealing friendship factors related to their adaptation.

A new look at leadership in collaborative networks : process catalysts

Collaborative networks have come to form a large part of the public sector’s strategy to address ongoing and often complex social problems. The relational power of networks, with its emphasis on trust, reciprocity and mutuality provides the mechanism to integrate previously dispersed and even competitive entities into a collective venture(Agranoff 2003; Agranoff and McGuire 2003; Mandell 1994; Mandell and Harrington 1999). It is argued that the refocusing of a single body of effort to a collective contributes to reducing duplication and overlap of services, maximizes increasingly scarce resources and contributes to solving intractable or 'wicked’problems (Clarke and Stewart 1997). Given the current proliferation of collaborative networks and the fact that they are likely to continue for some time, concerns with the management and leadership of such arrangements for optimal outcomes are increasingly relevant. This is especially important for public sector managers who are used to working in a top-down, hierarchical manner. While the management of networks (Agranoff and McGuire 2001, 2003), including collaborative or complex networks (Kickert et al. 1997; Koppenjan and Klijn 2004), has been the subject of considerable attention, there has been much less explicit discussion on leadership approaches in this context. It is argued in this chapter that the traditional use of the terms ‘leader’ or ‘leadership’ does not apply to collaborative networks. There are no ‘followers’ in collaborative networks or supervisor-subordinate relations. Instead there are equal, horizontal relationships that are focused on delivering systems change. In this way the emergent organizational forms such as collaborative networks challenge older models of leadership. However despite the questionable relevance of old leadership styles to the contemporary work environment, no clear alternative has come along to take its place.

Real-time performance modelling of a sustained attention to response task

Vigilance declines when exposed to highly predictable and uneventful tasks. Monotonous tasks provide little cognitive and motor stimulation and contribute to human errors. This paper aims to model and detect vigilance decline in real time through participant’s reaction times during a monotonous task. A lab-based experiment adapting the Sustained Attention to Response Task (SART) is conducted to quantify the effect of monotony on overall performance. Then relevant parameters are used to build a model detecting hypovigilance throughout the experiment. The accuracy of different mathematical models are compared to detect in real-time – minute by minute - the lapses in vigilance during the task. We show that monotonous tasks can lead to an average decline in performance of 45%. Furthermore, vigilance modelling enables to detect vigilance decline through reaction times with an accuracy of 72% and a 29% false alarm rate. Bayesian models are identified as a better model to detect lapses in vigilance as compared to Neural Networks and Generalised Linear Mixed Models. This modelling could be used as a framework to detect vigilance decline of any human performing monotonous tasks.

Paving for diverse pathways : using industry-linked learning to support Performing Arts students in their transition to protean careers

Statistics presented in Australia Council reports such as Don’t Give Up Your Day Job (2003), and Artswork: A Report On Australians Working in the Arts 1 and 2 (1997, 2005), and in other studies on destinations for Performing Arts graduates, demonstrate the diversity of post-graduation pathways for our students, the prevalence of protean careers, and the challenges in developing a sense of professional identity in a context where a portfolio of work across performance making, producing, administration and teaching can make it difficult for young artists to establish career status and capital in conventional terms (cf. Dawn Bennett, “Academy and the Real World: Developing Realistic Notions of Career in the Performing Arts”, Arts & Humanities in Higher Education, 8.3, 2009). In this panel, academics from around Australia will consider the ways in which Drama, Theatre and Performance Studies as a discipline is deploying a variety of practical, professional and work-integrated teaching and learning activities – including performance-making projects, industry projects, industry placements and student-initiated projects – to connect students with the networks, industries and professional pathways that will support their progression into their career. The panellists include Bree Hadley (Queensland University of Technology), Meredith Rogers (La Trobe University), Janys Hayes (Woolongong University) and Teresa Izzard (Curtin University). The panelists will present insights into the activities they have found successful, and address a range of questions, including: How do we introduce students to performance-making and / or producing models they will be able to employ in their future practice, particularly in light of the increasingly limited funds, time and resources available to support students’ participation in full-scale productions under the stewardship of professional artists?; How and when do we introduce students to industry networks?; How do we cater for graduates who will work as performers, writers, directors or administrators in the non-subsidised sector, the subsidised sector, community arts and education?; How do we category cater for graduates who will go on to pursue their work in a practice-as-research context in a Higher Degree?; How do we assist graduates in developing a professional identity? How do we assist graduates in developing physical, professional and personal resilience?; How do we retain our connections with graduates as part of their life-long learning?; Do practices and processes need to differ for city or regionally based / theoretically or practically based degree programs?; How do our teaching and learning activities align with emergent policy and industrial frameworks such as the shift to the “Producer Model” in Performing Arts funding, or the new mentorship, project, production and enterprise development opportunities under the Australia Council for the Arts’ new Opportunities for Young and Emerging Artists policy framework?

A people-to-people recommendation system using Tensor Space Models

Existing recommendation systems often recommend products to users by capturing the item-to-item and user-to-user similarity measures. These types of recommendation systems become inefficient in people-to-people networks for people to people recommendation that require two way relationship. Also, existing recommendation methods use traditional two dimensional models to find inter relationships between alike users and items. It is not efficient enough to model the people-to-people network with two-dimensional models as the latent correlations between the people and their attributes are not utilized. In this paper, we propose a novel tensor decomposition-based recommendation method for recommending people-to-people based on users profiles and their interactions. The people-to-people network data is multi-dimensional data which when modeled using vector based methods tend to result in information loss as they capture either the interactions or the attributes of the users but not both the information. This paper utilizes tensor models that have the ability to correlate and find latent relationships between similar users based on both information, user interactions and user attributes, in order to generate recommendations. Empirical analysis is conducted on a real-life online dating dataset. As demonstrated in results, the use of tensor modeling and decomposition has enabled the identification of latent correlations between people based on their attributes and interactions in the network and quality recommendations have been derived using the 'alike' users concept.

Multifractal characterisation and analysis of complex networks

Complex networks have been studied extensively due to their relevance to many real-world systems such as the world-wide web, the internet, biological and social systems. During the past two decades, studies of such networks in different fields have produced many significant results concerning their structures, topological properties, and dynamics. Three well-known properties of complex networks are scale-free degree distribution, small-world effect and self-similarity. The search for additional meaningful properties and the relationships among these properties is an active area of current research. This thesis investigates a newer aspect of complex networks, namely their multifractality, which is an extension of the concept of selfsimilarity. The first part of the thesis aims to confirm that the study of properties of complex networks can be expanded to a wider field including more complex weighted networks. Those real networks that have been shown to possess the self-similarity property in the existing literature are all unweighted networks. We use the proteinprotein interaction (PPI) networks as a key example to show that their weighted networks inherit the self-similarity from the original unweighted networks. Firstly, we confirm that the random sequential box-covering algorithm is an effective tool to compute the fractal dimension of complex networks. This is demonstrated on the Homo sapiens and E. coli PPI networks as well as their skeletons. Our results verify that the fractal dimension of the skeleton is smaller than that of the original network due to the shortest distance between nodes is larger in the skeleton, hence for a fixed box-size more boxes will be needed to cover the skeleton. Then we adopt the iterative scoring method to generate weighted PPI networks of five species, namely Homo sapiens, E. coli, yeast, C. elegans and Arabidopsis Thaliana. By using the random sequential box-covering algorithm, we calculate the fractal dimensions for both the original unweighted PPI networks and the generated weighted networks. The results show that self-similarity is still present in generated weighted PPI networks. This implication will be useful for our treatment of the networks in the third part of the thesis. The second part of the thesis aims to explore the multifractal behavior of different complex networks. Fractals such as the Cantor set, the Koch curve and the Sierspinski gasket are homogeneous since these fractals consist of a geometrical figure which repeats on an ever-reduced scale. Fractal analysis is a useful method for their study. However, real-world fractals are not homogeneous; there is rarely an identical motif repeated on all scales. Their singularity may vary on different subsets; implying that these objects are multifractal. Multifractal analysis is a useful way to systematically characterize the spatial heterogeneity of both theoretical and experimental fractal patterns. However, the tools for multifractal analysis of objects in Euclidean space are not suitable for complex networks. In this thesis, we propose a new box covering algorithm for multifractal analysis of complex networks. This algorithm is demonstrated in the computation of the generalized fractal dimensions of some theoretical networks, namely scale-free networks, small-world networks, random networks, and a kind of real networks, namely PPI networks of different species. Our main finding is the existence of multifractality in scale-free networks and PPI networks, while the multifractal behaviour is not confirmed for small-world networks and random networks. As another application, we generate gene interactions networks for patients and healthy people using the correlation coefficients between microarrays of different genes. Our results confirm the existence of multifractality in gene interactions networks. This multifractal analysis then provides a potentially useful tool for gene clustering and identification. The third part of the thesis aims to investigate the topological properties of networks constructed from time series. Characterizing complicated dynamics from time series is a fundamental problem of continuing interest in a wide variety of fields. Recent works indicate that complex network theory can be a powerful tool to analyse time series. Many existing methods for transforming time series into complex networks share a common feature: they define the connectivity of a complex network by the mutual proximity of different parts (e.g., individual states, state vectors, or cycles) of a single trajectory. In this thesis, we propose a new method to construct networks of time series: we define nodes by vectors of a certain length in the time series, and weight of edges between any two nodes by the Euclidean distance between the corresponding two vectors. We apply this method to build networks for fractional Brownian motions, whose long-range dependence is characterised by their Hurst exponent. We verify the validity of this method by showing that time series with stronger correlation, hence larger Hurst exponent, tend to have smaller fractal dimension, hence smoother sample paths. We then construct networks via the technique of horizontal visibility graph (HVG), which has been widely used recently. We confirm a known linear relationship between the Hurst exponent of fractional Brownian motion and the fractal dimension of the corresponding HVG network. In the first application, we apply our newly developed box-covering algorithm to calculate the generalized fractal dimensions of the HVG networks of fractional Brownian motions as well as those for binomial cascades and five bacterial genomes. The results confirm the monoscaling of fractional Brownian motion and the multifractality of the rest. As an additional application, we discuss the resilience of networks constructed from time series via two different approaches: visibility graph and horizontal visibility graph. Our finding is that the degree distribution of VG networks of fractional Brownian motions is scale-free (i.e., having a power law) meaning that one needs to destroy a large percentage of nodes before the network collapses into isolated parts; while for HVG networks of fractional Brownian motions, the degree distribution has exponential tails, implying that HVG networks would not survive the same kind of attack.

From 'Neighbours' to 'Packed to the Rafters': accounting for longevity in the evolution of Aussie soaps

If there is one television programming staple for which Australian television drama is known internationally, it is the long-running television soap, with Neighbours (originally produced by Grundy in 1985) lauded as 'the most outstanding example of Australian series export' (Cunningham and Jacka, 1996). Twenty-five years on, this program still airs on domestic and international TV schedules five days a week, despite waning popularity with local Australian audiences. Considering past interest in the success and longevity of this soap, it is apposite to look again at the continuing progress of Neighbours foremost as a global brand. In comparison, Packed to the Rafters is treated here as a contemporary version of familiar Aussie themes related to everyday middle-class suburbia, populated with blue skies and feel-good characters expressing wholesome family values, but with a stylistic innovation defined here as domestic realism. As part of the production ecology of the late 2000s, Packed to the Rafters demonstrates the considerable role for local drama productions as loss leaders and flagship programming for commercial free-to-air networks up against an increasingly difficult domestic market.