REGAL : a regularization based algorithm for reinforcement learning in weakly communicating MDPs

We provide an algorithm that achieves the optimal regret rate in an unknown weakly communicating Markov Decision Process (MDP). The algorithm proceeds in episodes where, in each episode, it picks a policy using regularization based on the span of the optimal bias vector. For an MDP with S states and A actions whose optimal bias vector has span bounded by H, we show a regret bound of ~ O(HS p AT ). We also relate the span to various diameter-like quantities associated with the MDP, demonstrating how our results improve on previous regret bounds.

Graphene-like nano-sheets for surface acoustic wave gas sensor applications

The gas sensing properties of graphene-like nano-sheets deposited on 36° YX lithium tantalate (LiTaO3) surface acoustic wave (SAW) transducers are reported. The thin graphene-like nano-sheets were produced via the reduction of graphite oxide which was deposited on SAW interdigitated transducers (IDTs). Their sensing performance was assessed towards hydrogen (H2) and carbon monoxide (CO) in a synthetic air carrier gas at room temperature (25 °C) and 40 °C. Raman and X-ray photoelectron spectroscopy (XPS) revealed that the deposited graphite oxide (GO) was not completely reduced creating small, graphitic nanocrystals ∼2.7 nm in size. © 2008 Elsevier B.V.

Preparation and characterisation of tri-calcium phosphate scaffolds with tunnel-like macro-pores for bone tissue engineering

Calcium Phosphate ceramics have been widely used in tissue engineering due to their excellent biocompatibility and biodegradability. In the physiological environment, they are able to gradually degrade, absorbed and promote bone growth. Ultimately, they are capable of replacing damaged bone with new tissue. However, their low mechanical properties limit calcium phosphate ceramics in load-bearing applications. To obtain sufficient mechanical properties as well as high biocompatibility is one of the main focuses in biomaterials research. Therefore, the current project focuses on the preparation and characterization of porous tri-calcium phosphate (TCP) ceramic scaffolds. Hydroxapatite (HA) was used as the raw material, and normal calcium phosphate bioglass was added to adjust the ratio between calcium and phosphate. It was found that when 20% bioglass was added to HA and sintered at 1400oC for 3 hours, the TCP scaffold was obtained and this was confirmed by X-ray diffraction (XRD) analysis. Test results have shown that by applying this method, TCP scaffolds have significantly higher compressive strength (9.98MPa) than those made via TCP powder (<3MPa). Moreover, in order to further increase the compressive strength of TCP scaffolds, the samples were then coated with bioglass. For normal bioglass coated TCP scaffold, compressive strength was 16.69±0.5MPa; the compressive strength for single layer mesoporous bioglass coated scaffolds was 15.03±0.63MPa. In addition, this project has also concentrated on sizes and shapes effects; it was found that the cylinder scaffolds have more mechanical property than the club ones. In addition, this project performed cell culture within scaffold to assess biocompatibility. The cells were well distributed in the scaffold, and the cytotoxicity test was performed by 3-(4,5)-dimethylthiahiazo(-z-y1)-3,5-di- phenytetrazoliumromide (MTT) assay. The Alkaline Phosphatase (Alp) activity of human bone marrow mesenchymal stem cell system (hBMSCs) seeded on scaffold expressed higher in vitro than that in the positive control groups in osteogenic medium, which indicated that the scaffolds were both osteoconductive and osteoinductive, showing potential value in bone tissue engineering.

What Could Socially-just Literacy Instruction Look Like?

Schools in Australia today are expected to improve student outcomes in an increasingly constrained context focused on accountability. At the same time as teachers work within these constraints, they are also working to ensure that all students are able to achieve quality outcomes from schooling while dealing with increasing diversity of the student population. So what is a teacher’s role in providing equitable possibilities for all of the students in their care? Teachers are left with the difficult task of balancing the many mandatory requirements placed on them, and on their students, such as gaining improvements on high stakes test scores, with the important work of dealing with individual students and student cohorts in equitable and socially just ways. This impacts on the work of all teachers, however for those teachers working in schools in contexts of complexity and duress these pressures are never greater.

i-vector based speaker recognition on short utterances

Robust speaker verification on short utterances remains a key consideration when deploying automatic speaker recognition, as many real world applications often have access to only limited duration speech data. This paper explores how the recent technologies focused around total variability modeling behave when training and testing utterance lengths are reduced. Results are presented which provide a comparison of Joint Factor Analysis (JFA) and i-vector based systems including various compensation techniques; Within-Class Covariance Normalization (WCCN), LDA, Scatter Difference Nuisance Attribute Projection (SDNAP) and Gaussian Probabilistic Linear Discriminant Analysis (GPLDA). Speaker verification performance for utterances with as little as 2 sec of data taken from the NIST Speaker Recognition Evaluations are presented to provide a clearer picture of the current performance characteristics of these techniques in short utterance conditions.

Performance control of distributed generation using digital estimation of signal parameters

The Queensland University of Technology (QUT) allows the presentation of a thesis for the Degree of Doctor of Philosophy in the format of published or submitted papers, where such papers have been published, accepted or submitted during the period of candidature. This thesis is composed of seven published/submitted papers, of which one has been published, three accepted for publication and the other three are under review. This project is financially supported by an Australian Research Council (ARC) Discovery Grant with the aim of proposing strategies for the performance control of Distributed Generation (DG) system with digital estimation of power system signal parameters. Distributed Generation (DG) has been recently introduced as a new concept for the generation of power and the enhancement of conventionally produced electricity. Global warming issue calls for renewable energy resources in electricity production. Distributed generation based on solar energy (photovoltaic and solar thermal), wind, biomass, mini-hydro along with use of fuel cell and micro turbine will gain substantial momentum in the near future. Technically, DG can be a viable solution for the issue of the integration of renewable or non-conventional energy resources. Basically, DG sources can be connected to local power system through power electronic devices, i.e. inverters or ac-ac converters. The interconnection of DG systems to power system as a compensator or a power source with high quality performance is the main aim of this study. Source and load unbalance, load non-linearity, interharmonic distortion, supply voltage distortion, distortion at the point of common coupling in weak source cases, source current power factor, and synchronism of generated currents or voltages are the issues of concern. The interconnection of DG sources shall be carried out by using power electronics switching devices that inject high frequency components rather than the desired current. Also, noise and harmonic distortions can impact the performance of the control strategies. To be able to mitigate the negative effect of high frequency and harmonic as well as noise distortion to achieve satisfactory performance of DG systems, new methods of signal parameter estimation have been proposed in this thesis. These methods are based on processing the digital samples of power system signals. Thus, proposing advanced techniques for the digital estimation of signal parameters and methods for the generation of DG reference currents using the estimates provided is the targeted scope of this thesis. An introduction to this research – including a description of the research problem, the literature review and an account of the research progress linking the research papers – is presented in Chapter 1. One of the main parameters of a power system signal is its frequency. Phasor Measurement (PM) technique is one of the renowned and advanced techniques used for the estimation of power system frequency. Chapter 2 focuses on an in-depth analysis conducted on the PM technique to reveal its strengths and drawbacks. The analysis will be followed by a new technique proposed to enhance the speed of the PM technique while the input signal is free of even-order harmonics. The other techniques proposed in this thesis as the novel ones will be compared with the PM technique comprehensively studied in Chapter 2. An algorithm based on the concept of Kalman filtering is proposed in Chapter 3. The algorithm is intended to estimate signal parameters like amplitude, frequency and phase angle in the online mode. The Kalman filter is modified to operate on the output signal of a Finite Impulse Response (FIR) filter designed by a plain summation. The frequency estimation unit is independent from the Kalman filter and uses the samples refined by the FIR filter. The frequency estimated is given to the Kalman filter to be used in building the transition matrices. The initial settings for the modified Kalman filter are obtained through a trial and error exercise. Another algorithm again based on the concept of Kalman filtering is proposed in Chapter 4 for the estimation of signal parameters. The Kalman filter is also modified to operate on the output signal of the same FIR filter explained above. Nevertheless, the frequency estimation unit, unlike the one proposed in Chapter 3, is not segregated and it interacts with the Kalman filter. The frequency estimated is given to the Kalman filter and other parameters such as the amplitudes and phase angles estimated by the Kalman filter is taken to the frequency estimation unit. Chapter 5 proposes another algorithm based on the concept of Kalman filtering. This time, the state parameters are obtained through matrix arrangements where the noise level is reduced on the sample vector. The purified state vector is used to obtain a new measurement vector for a basic Kalman filter applied. The Kalman filter used has similar structure to a basic Kalman filter except the initial settings are computed through an extensive math-work with regards to the matrix arrangement utilized. Chapter 6 proposes another algorithm based on the concept of Kalman filtering similar to that of Chapter 3. However, this time the initial settings required for the better performance of the modified Kalman filter are calculated instead of being guessed by trial and error exercises. The simulations results for the parameters of signal estimated are enhanced due to the correct settings applied. Moreover, an enhanced Least Error Square (LES) technique is proposed to take on the estimation when a critical transient is detected in the input signal. In fact, some large, sudden changes in the parameters of the signal at these critical transients are not very well tracked by Kalman filtering. However, the proposed LES technique is found to be much faster in tracking these changes. Therefore, an appropriate combination of the LES and modified Kalman filtering is proposed in Chapter 6. Also, this time the ability of the proposed algorithm is verified on the real data obtained from a prototype test object. Chapter 7 proposes the other algorithm based on the concept of Kalman filtering similar to those of Chapter 3 and 6. However, this time an optimal digital filter is designed instead of the simple summation FIR filter. New initial settings for the modified Kalman filter are calculated based on the coefficients of the digital filter applied. Also, the ability of the proposed algorithm is verified on the real data obtained from a prototype test object. Chapter 8 uses the estimation algorithm proposed in Chapter 7 for the interconnection scheme of a DG to power network. Robust estimates of the signal amplitudes and phase angles obtained by the estimation approach are used in the reference generation of the compensation scheme. Several simulation tests provided in this chapter show that the proposed scheme can very well handle the source and load unbalance, load non-linearity, interharmonic distortion, supply voltage distortion, and synchronism of generated currents or voltages. The purposed compensation scheme also prevents distortion in voltage at the point of common coupling in weak source cases, balances the source currents, and makes the supply side power factor a desired value.

Like two ships

In this video, the words animated on screen are sometimes the same and sometimes different from those spoken by a male voice. Both narratives, written and spoken, are constructed entirely from clichés and mixed metaphors. This work examines processes of signification. It emphasizes disruption and disconnection as fundamental and generative operations in making meaning. Extending on post-structural and deconstructionist ideas, this work questions the relationship between written and spoken words. It upsets the assumed efficacy of metaphors and clichés to question the sites and mechanisms of signification.

Modeling player-like behaviour for game Al design

The design of artificial intelligence in computer games is an important component of a player's game play experience. As games are becoming more life-like and interactive, the need for more realistic game AI will increase. This is particularly the case with respect to AI that simulates how human players act, behave and make decisions. The purpose of this research is to establish a model of player-like behavior that may be effectively used to inform the design of artificial intelligence to more accurately mimic a player's decision making process. The research uses a qualitative analysis of player opinions and reactions while playing a first person shooter video game, with recordings of their in game actions, speech and facial characteristics. The initial studies provide player data that has been used to design a model of how a player behaves.

The expression, regulation and function of kallikrein 4 in prostate cancer

Prostate cancer is a significant health problem faced by aging men. Currently, diagnostic strategies for the detection of prostate cancer are either unreliable, yielding high numbers of false positive results, or too invasive to be used widely as screening tests. Furthermore, the current therapeutic strategies for the treatment of the disease carry considerable side effects. Although organ confined prostate cancer can be curable, most detectable clinical symptoms occur in advanced disease when primary tumour cells have metastasised to distant sites - usually lymph nodes and bone. Many growth factors and steroids assist the continued growth and maintenance of prostatic tumour cells. Of these mitogens, androgens are important in the development of the normal prostate but are also required to sustain the growth of prostate cancer cells in the early stage of the disease. Not only are androgens required in the early stage of disease, but also many other growth factors and hormones interact to cause uncontrolled proliferation of malignant cells. The early, androgen sensitive phase of disease is followed by an androgen insensitive phase, whereby androgens are no longer required to stimulate the growth of the tumour cells. Growth factors such as transforming growth factor  and  (TGF/), epidermal growth factor (EGF), basic fibroblast growth factor (bFGF), insulin-like growth factors (IGFs), Vitamin D and thyroid hormone have been suggested to be important at this stage of disease. Interestingly, some of the kallikrein family of genes, including prostate specific antigen (PSA), the current serum diagnostic marker for prostate cancer, are regulated by androgens and many of the aforementioned growth factors. The kallikrein gene family is a group of serine proteases that are involved in a diverse range of physiological processes: regulation of local blood flow, angiogenesis, tissue invasion and mitogenesis. The earliest members of the kallikrein gene family (KLK1-KLK3) have been strongly associated with general disease states, such as hypertension, inflammation, pancreatitis and renal disease, but are also linked to various cancers. Recently, this family was extended to include 15 genes (KLK1-15). Several newer members of the kallikrein family have been implicated in the carcinogenesis and tumour metastasis of hormone-dependent cancers such as prostate, breast, endometrial and ovarian cancer. The aims of this project were to investigate the expression of the newly identified kallikrein, KLK4, in benign and malignant prostate tissues, and prostate cancer cell lines. This thesis has demonstrated the elevated expression of KLK4 mRNA transcripts in malignant prostate tissue compared to benign prostates. Additionally, expression of the full length KLK4 transcript was detected in the androgen dependent prostate cancer cell line, LNCaP. Based on the above finding, the LNCaP cell line was chosen to assess the potential regulation of full length KLK4 by androgen, thyroid hormone and epidermal growth factor. KLK4 mRNA and protein was found to be up-regulated by androgen and a combination of androgen and thyroid hormone. Thyroid hormone alone produced no significant change in KLK4 mRNA or protein over the control. Epidermal growth factor treatment also resulted in elevated expression levels of KLK4 mRNA and protein. To assess the potential functional role(s) of KLK4/hK4 in processes associated with tumour progression, full length KLK4 was transfected into PC-3 cells - a prostate cancer cell line originally derived from a secondary bone lesion. The KLK4/hK4 over-expressing cells were assessed for their proliferation, migration, invasion and attachment properties. The KLK4 over-expressing clones exhibited a marked change in morphology, indicative of a more aggressive phenotype. The KLK4 clones were irregularly shaped with compromised adhesion to the growth surface. In contrast, the control cell lines (parent PC-3 and empty vector clones) retained a rounded morphology with obvious cell to cell adhesion, as well as significant adhesion to their growth surface. The KLK4 clones exhibited significantly greater attachment to Collagen I and IV than native PC-3s and empty vector controls. Over a 12 hour period, in comparison to the control cells, the KLK4 clones displayed an increase in migration towards PC-3 native conditioned media, a 3 fold increase towards conditioned media from an osteoblastic cell line (Saos-2) and no change in migration towards conditioned media from neonatal foreskin fibroblast cells or 20% foetal bovine serum. Furthermore, the increase in migration exhibited by the KLK4 clones was partially blocked by the serine protease inhibitor, aprotinin. The data presented in this thesis suggests that KLK4/hK4 is important in prostate carcinogenesis due to its over-expression in malignant prostate tissues, its regulation by hormones and growth factors associated with prostate disease and the functional consequences of over-expression of KLK4/hK4 in the PC-3 cell line. These results indicate that KLK4/hK4 may play an important role in tumour invasion and bone metastasis via increased attachment to the bone matrix protein, Collagen I, and enhanced migration due to soluble factors produced by osteoblast cells. This suggestion is further supported by the morphological changes displayed by the KLK4 over-expressing cells. Overall, this data suggests that KLK4/hK4 should be further studied to more fully investigate the potential value of KLK4/hK4 as a diagnostic/prognostic biomarker or in therapeutic applications.

Quantum-like non-separability of concept combinations, emergent associates and abduction

Consider the concept combination ‘pet human’. In word association experiments, human subjects produce the associate ‘slave’ in relation to this combination. The striking aspect of this associate is that it is not produced as an associate of ‘pet’, or ‘human’ in isolation. In other words, the associate ‘slave’ seems to be emergent. Such emergent associations sometimes have a creative character and cognitive science is largely silent about how we produce them. Departing from a dimensional model of human conceptual space, this article will explore concept combinations, and will argue that emergent associations are a result of abductive reasoning within conceptual space, that is, below the symbolic level of cognition. A tensor-based approach is used to model concept combinations allowing such combinations to be formalized as interacting quantum systems. Free association norm data is used to motivate the underlying basis of the conceptual space. It is shown by analogy how some concept combinations may behave like quantum-entangled (non-separable) particles. Two methods of analysis were presented for empirically validating the presence of non-separable concept combinations in human cognition. One method is based on quantum theory and another based on comparing a joint (true theoretic) probability distribution with another distribution based on a separability assumption using a chi-square goodness-of-fit test. Although these methods were inconclusive in relation to an empirical study of bi-ambiguous concept combinations, avenues for further refinement of these methods are identified.

Weighted LDA techniques for I-vector based speaker verification

This paper introduces the Weighted Linear Discriminant Analysis (WLDA) technique, based upon the weighted pairwise Fisher criterion, for the purposes of improving i-vector speaker verification in the presence of high intersession variability. By taking advantage of the speaker discriminative information that is available in the distances between pairs of speakers clustered in the development i-vector space, the WLDA technique is shown to provide an improvement in speaker verification performance over traditional Linear Discriminant Analysis (LDA) approaches. A similar approach is also taken to extend the recently developed Source Normalised LDA (SNLDA) into Weighted SNLDA (WSNLDA) which, similarly, shows an improvement in speaker verification performance in both matched and mismatched enrolment/verification conditions. Based upon the results presented within this paper using the NIST 2008 Speaker Recognition Evaluation dataset, we believe that both WLDA and WSNLDA are viable as replacement techniques to improve the performance of LDA and SNLDA-based i-vector speaker verification.

Evolution of the extinct Sabretooths and the American cheetah-like cat

The sabretooths (Smilodon and Homotherium) and the American cheetah-like cat (Miracinonyx) were the top predators in Late Pleistocene America, but became extinct about 13 thousand years ago. As the evolutionary history of these taxa remains poorly understood , we analysed their phylogenetic relationship to extant felids. In contrast to previous molecular studies , our results show that the sabretooths diverge early and are not closely related to any living cats. This supports their morphological placement in a separate subfamily (Machairodontinae). Despite its remarkable morphological similarity to the African cheetah (Acinonyx jubatus), Miracinonyx appears to have evolved from a puma-like ancestor, presumably in response to similar ecological pressures.

Catalytic properties of 26 S and 20 S proteasomes and radiolabeling of MB1, LMP7, and C7 subunits associated with trypsin-like and chymotrypsin-like activities*

20 and 26 S proteasomes were isolated from rat liver. The procedure developed for the 26 S proteasome resulted in greatly improved yields compared with previously published methods. A comparison of the kinetic properties of 20 and 26 S proteasomes showed significant differences in the kinetic characteristics with certain substrates and differences in the effects of a protein substrate on peptidase activity. Observed differences in the kinetics of peptidylglutamyl peptide hydrolase activity suggest that the 26 S complex cannot undergo the conformational changes of 20 S proteasomes at high concentrations of the substrate benzyloxycarbonyl (Z) -Leu-Leu-Glu-b-naphthylamide. Various inhibitors that differentially affect the trypsin-like and chymotrypsin-like activities have been identified. Ala-Ala-Phe-chloromethyl (CH2Cl) inhibits chymotrypsin-like activity assayed with succinyl (Suc) -Leu-Leu-Val-Tyr-AMC, but surprisingly not hydrolysis of Ala-Ala-Phe-7-amido-4-methylcoumarin (AMC). Tyr-Gly-Arg-CH2Cl inhibits Suc-Leu-Leu-Val-Tyr-AMC hydrolysis as well as trypsinlike activity measured with t-butoxycarbonyl (Boc) -Leu-Ser-Thr-Arg-AMC, while Z-Phe-Gly-Tyr-diazomethyl (CHN2) was found to inhibit only the two chymotrypsin- like activities. Radiolabeled forms of peptidyl chloromethane and peptidyl diazomethane inhibitors, [3H]acetyl-Ala-Ala-Phe-CH2Cl, [3H]acetyland radioiodinated Tyr-Gly-Arg-CH2Cl, and Z-Phe-Gly- Tyr-(125I-CHN2), have been used to identify catalytic components associated with each of the three peptidase activities. In each case, incorporation of the label could be blocked by prior treatment of the proteasomes with known active site-directed inhibitors, calpain inhibitor 1 or 3,4-dichloroisocoumarin. Subunits of labeled proteasomes were separated either by reverse phase-HPLC and SDS-polyacrylamide gel electrophoresis or by twodimensional polyacrylamide gel electrophoresis followed by autoradiography/fluorography and immunoblotting with subunit-specific antibodies. In each case, label was found to be incorporated into subunits C7, MB1, and LMP7 but in different relative amounts depending on the inhibitor used, consistent with the observed effects on the different peptidase activities. The results strongly suggest a relationship between trypsin-like activity and chymotrypsin-like activity. They also help to relate the different subunits of the complex to the assayed multicatalytic endopeptidase activities