Meta-learning for informed model searches in Automated Machine Learning

Day by day, machine learning is changing our lives in ways we could not have imagined just 5 years ago. ML expertise is more and more requested and needed, though just a limited number of ML engineers are available on the job market, and their knowledge is always limited by an inherent characteristic of theirs: they are humans. This thesis explores the possibilities offered by meta-learning, a new field in ML that takes learning a level higher: models are trained on other models' training data, starting from features of the dataset they were trained on, inference times, obtained performances, to try to understand the relationship between a good model and the way it was obtained. The so-called metamodel was trained on data collected by OpenML, the largest ML metadata platform that's publicly available today. Datasets were analyzed to obtain meta-features that describe them, which were then tied to model performances in a regression task. The obtained metamodel predicts the expected performances of a given model type (e.g., a random forest) on a given ML task (e.g., classification on the UCI census dataset). This research was then integrated into a custom-made AutoML framework, to show how meta-learning is not an end in itself, but it can be used to further progress our ML research. Encoding ML engineering expertise in a model allows better, faster, and more impactful ML applications across the whole world, while reducing the cost that is inevitably tied to human engineers.

Ecosystem Engineering Effects On Species Diversity Across Ecosystems: A Meta-analysis.

Ecosystem engineering is increasingly recognized as a relevant ecological driver of diversity and community composition. Although engineering impacts on the biota can vary from negative to positive, and from trivial to enormous, patterns and causes of variation in the magnitude of engineering effects across ecosystems and engineer types remain largely unknown. To elucidate the above patterns, we conducted a meta-analysis of 122 studies which explored effects of animal ecosystem engineers on species richness of other organisms in the community. The analysis revealed that the overall effect of ecosystem engineers on diversity is positive and corresponds to a 25% increase in species richness, indicating that ecosystem engineering is a facilitative process globally. Engineering effects were stronger in the tropics than at higher latitudes, likely because new or modified habitats provided by engineers in the tropics may help minimize competition and predation pressures on resident species. Within aquatic environments, engineering impacts were stronger in marine ecosystems (rocky shores) than in streams. In terrestrial ecosystems, engineers displayed stronger positive effects in arid environments (e.g. deserts). Ecosystem engineers that create new habitats or microhabitats had stronger effects than those that modify habitats or cause bioturbation. Invertebrate engineers and those with lower engineering persistence (<1 year) affected species richness more than vertebrate engineers which persisted for >1 year. Invertebrate species richness was particularly responsive to engineering impacts. This study is the first attempt to build an integrative framework of engineering effects on species diversity; it highlights the importance of considering latitude, habitat, engineering functional group, taxon and persistence of their effects in future theoretical and empirical studies.

Censored Linear Regression Models For Irregularly Observed Longitudinal Data Using The Multivariate-t Distribution.

In acquired immunodeficiency syndrome (AIDS) studies it is quite common to observe viral load measurements collected irregularly over time. Moreover, these measurements can be subjected to some upper and/or lower detection limits depending on the quantification assays. A complication arises when these continuous repeated measures have a heavy-tailed behavior. For such data structures, we propose a robust structure for a censored linear model based on the multivariate Student's t-distribution. To compensate for the autocorrelation existing among irregularly observed measures, a damped exponential correlation structure is employed. An efficient expectation maximization type algorithm is developed for computing the maximum likelihood estimates, obtaining as a by-product the standard errors of the fixed effects and the log-likelihood function. The proposed algorithm uses closed-form expressions at the E-step that rely on formulas for the mean and variance of a truncated multivariate Student's t-distribution. The methodology is illustrated through an application to an Human Immunodeficiency Virus-AIDS (HIV-AIDS) study and several simulation studies.

Anxiety-like Effects Of Meta-chlorophenylpiperazine In Paradoxically Sleep-deprived Mice.

Chlorophenylpiperazines (CPP) are psychotropic drugs used in nightclub parties and are frequently used in a state of sleep deprivation, a condition which can potentiate the effects of psychoactive drugs. This study aimed to investigate the effects of sleep deprivation and sleep rebound (RB) on anxiety-like measures in mCPP-treated mice using the open field test. We first optimized our procedure by performing dose-effect curves and examining different pretreatment times in naïve male Swiss mice. Subsequently, a separate cohort of mice underwent paradoxical sleep deprivation (PSD) for 24 or 48h. In the last experiment, immediately after the 24h-PSD period, mice received an injection of saline or mCPP, but their general activity was quantified in the open field only after the RB period (24 or 48h). The dose of 5mgmL(-1) of mCPP was the most effective at decreasing rearing behavior, with peak effects 15min after injection. PSD decreased locomotion and rearing behaviors, thereby inhibiting a further impairment induced by mCPP. Plasma concentrations of mCPP were significantly higher in PSD 48h animals compared to the non-PSD control group. Twenty-four hours of RB combined with mCPP administration produced a slight reduction in locomotion. Our results show that mCPP was able to significantly change the behavior of naïve, PSD, and RB mice. When combined with sleep deprivation, there was a higher availability of drug in plasma levels. Taken together, our results suggest that sleep loss can enhance the behavioral effects of the potent psychoactive drug, mCPP, even after a period of rebound sleep.

Comparing Near-infrared Conventional Diffuse Reflectance Spectroscopy And Hyperspectral Imaging For Determination Of The Bulk Properties Of Solid Samples By Multivariate Regression: Determination Of Mooney Viscosity And Plasticity Indices Of Natural Rubber.

Conventional reflectance spectroscopy (NIRS) and hyperspectral imaging (HI) in the near-infrared region (1000-2500 nm) are evaluated and compared, using, as the case study, the determination of relevant properties related to the quality of natural rubber. Mooney viscosity (MV) and plasticity indices (PI) (PI0 - original plasticity, PI30 - plasticity after accelerated aging, and PRI - the plasticity retention index after accelerated aging) of rubber were determined using multivariate regression models. Two hundred and eighty six samples of rubber were measured using conventional and hyperspectral near-infrared imaging reflectance instruments in the range of 1000-2500 nm. The sample set was split into regression (n = 191) and external validation (n = 95) sub-sets. Three instruments were employed for data acquisition: a line scanning hyperspectral camera and two conventional FT-NIR spectrometers. Sample heterogeneity was evaluated using hyperspectral images obtained with a resolution of 150 × 150 μm and principal component analysis. The probed sample area (5 cm(2); 24,000 pixels) to achieve representativeness was found to be equivalent to the average of 6 spectra for a 1 cm diameter probing circular window of one FT-NIR instrument. The other spectrophotometer can probe the whole sample in only one measurement. The results show that the rubber properties can be determined with very similar accuracy and precision by Partial Least Square (PLS) regression models regardless of whether HI-NIR or conventional FT-NIR produce the spectral datasets. The best Root Mean Square Errors of Prediction (RMSEPs) of external validation for MV, PI0, PI30, and PRI were 4.3, 1.8, 3.4, and 5.3%, respectively. Though the quantitative results provided by the three instruments can be considered equivalent, the hyperspectral imaging instrument presents a number of advantages, being about 6 times faster than conventional bulk spectrometers, producing robust spectral data by ensuring sample representativeness, and minimizing the effect of the presence of contaminants.

Modeling The Effects Of Temperature And Ph On The Resistance Of Alicyclobacillus Acidoterrestris In Conventional Heat-treated Fruit Beverages Through A Meta-analysis Approach.

In this work, all publicly-accessible published findings on Alicyclobacillus acidoterrestris heat resistance in fruit beverages as affected by temperature and pH were compiled. Then, study characteristics (protocols, fruit and variety, °Brix, pH, temperature, heating medium, culture medium, inactivation method, strains, etc.) were extracted from the primary studies, and some of them incorporated to a meta-analysis mixed-effects linear model based on the basic Bigelow equation describing the heat resistance parameters of this bacterium. The model estimated mean D* values (time needed for one log reduction at a temperature of 95 °C and a pH of 3.5) of Alicyclobacillus in beverages of different fruits, two different concentration types, with and without bacteriocins, and with and without clarification. The zT (temperature change needed to cause one log reduction in D-values) estimated by the meta-analysis model were compared to those ('observed' zT values) reported in the primary studies, and in all cases they were within the confidence intervals of the model. The model was capable of predicting the heat resistance parameters of Alicyclobacillus in fruit beverages beyond the types available in the meta-analytical data. It is expected that the compilation of the thermal resistance of Alicyclobacillus in fruit beverages, carried out in this study, will be of utility to food quality managers in the determination or validation of the lethality of their current heat treatment processes.

Association Between Unilateral Tonsillar Enlargement And Lymphoma In Children: A Systematic Review And Meta-analysis.

Lymphoma is the most common head and neck malignancy in children, and palatine tonsils asymmetry is the most frequent clinical manifestation of tonsillar lymphoma. However, several studies with children with tonsillar asymmetry found no case of lymphoma, showing that the relationship of tonsillar asymmetry with lymphoma is unclear. In this review, we aimed to identify the association between tonsillar asymmetry and tonsillar lymphoma in children by conducting systematic reviews of the literature on children with palatine tonsil lymphoma and tonsillar asymmetry. Articles comprising the paediatric age group (up to 18 years) with information concerning clinical manifestations of tonsillar lymphoma or the diagnosis of the tonsillar asymmetry were included. The main cause of asymmetry of palatine tonsils was lymphoid hyperplasia, followed by lymphoma and nonspecific benign changes. The asymmetry of tonsils was present in 73.2% of cases of lymphoma. There was an association between asymmetric palatine tonsils and lymphoma, with a likelihood ratio of 43.5 for children with asymmetry of palatine tonsils and 8938.4 for children with asymmetry of tonsils and other signs of suspicion for malignancy. We also provide recommendations on the management of suspicious cases of palatine tonsil lymphoma.

Auto-eficácia docente e motivação para a realização do(a) professor(a) de Educação Física Adaptada

Universidade Estadual de Campinas . Faculdade de Educação Física

Correlation of meta 1 expression with culture stage, cell morphology and infectivity in Leishmania (Leishmania) amazonensis promastigotes

The parasitic protozoan Leishmania (Leishmania) amazonensis alternates between mammalian and insect hosts. In the insect host, the parasites proliferate as procyclic promastigotes andthen differentiate into metacyclic infective forms. The meta 1 gene is preferentially expressed during metacyclogenesis. Meta 1 expression profile determination along parasite growth curves revealed that the meta 1 mRNA level peaked at the early stationary phase then decreased to an intermediate level. No correlation was observed between meta 1 expression and infectivity. Conversely, infectivity correlated with the increase of apoptotic cells in the late stationary phase.

Reproductive behavior, development and eye regression in the cave armored catfish, Ancistrus cryptophthalmus Reis, 1987 (Siluriformes: Loricariidae), breed in laboratory

The troglobitic armored catfish, Ancistrus cryptophthalmus (Loricariidae, Ancistrinae) is known from four caves in the São Domingos karst area, upper rio Tocantins basin, Central Brazil. These populations differ in general body shape and degree of reduction of eyes and of pigmentation. The small Passa Três population (around 1,000 individuals) presents the most reduced eyes, which are not externally visible in adults. A small group of Passa Três catfish, one male and three females, reproduced spontaneously thrice in laboratory, at the end of summertime in 2000, 2003 and 2004. Herein we describe the reproductive behavior during the 2003 event, as well as the early development of the 2003 and 2004 offsprings, with focus on body growth and ontogenetic regression of eyes. The parental care by the male, which includes defense of the rock shelter where the egg clutch is laid, cleaning and oxygenation of eggs, is typical of many loricariids. On the other hand, the slow development, including delayed eye degeneration, low body growth rates and high estimated longevity (15 years or more) are characteristic of precocial, or K-selected, life cycles. In the absence of comparable data for close epigean relatives (Ancistrus spp.), it is not possible to establish whether these features are an autapomorphic specialization of the troglobitic A. cryptophthalmus or a plesiomorphic trait already present in the epigean ancestor, possibly favoring the adoption of the life in the food-poor cave environment. We briefly discuss the current hypotheses on eye regression in troglobitic vertebrates.

Impacto da adequação da oferta energética sobre a mortalidade em pacientes de UTI recebendo nutrição enteral

OBJETIVO: Investigar a relação entre adequação da oferta energética e mortalidade na unidade de terapia intensiva em pacientes sob terapia nutricional enteral exclusiva. MÉTODOS: Estudo observacional prospectivo conduzido em uma unidade de terapia intensiva em 2008 e 2009. Foram incluídos pacientes >18 anos que receberam terapia nutricional enteral por >72h. A adequação da oferta de energia foi estimada pela razão administrado/prescrito. Para a investigação da relação entre variáveis preditoras (adequação da oferta energética, escore APACHE II, sexo, idade e tempo de permanência na unidade de terapia intensiva e o desfecho mortalidade na unidade de terapia intensiva, utilizou-se o modelo de regressão logística não condicional. RESULTADOS: Foram incluídos 63 pacientes (média 58 anos, mortalidade 27%), 47,6% dos quais receberam mais de 90% da energia prescrita (adequação média 88,2%). O balanço energético médio foi de -190 kcal/dia. Observou-se associação significativa entre ocorrência de óbito e as variáveis idade e tempo de permanência na unidade de terapia intensiva, após a retirada das variáveis adequação da oferta energética, APACHE II e sexo durante o processo de modelagem. CONCLUSÃO: A adequação da oferta energética não influenciou a taxa de mortalidade na unidade de terapia intensiva. Protocolos de infusão de nutrição enteral seguidos criteriosamente, com adequação administrado/prescrito acima de 70%, parecem ser suficientes para não interferirem na mortalidade. Dessa forma, pode-se questionar a obrigatoriedade de atingir índices próximos a 100%, considerando a elevada frequência com que ocorrem interrupções no fornecimento de dieta enteral devido a intolerância gastrointestinal e jejuns para exames e procedimentos. Pesquisas futuras poderão identificar a meta ideal de adequação da oferta energética que resulte em redução significativa de complicações, mortalidade e custos.

Multi-trait and random regression mature weight heritability and breeding value estimates in Nelore cattle

Mature weight breeding values were estimated using a multi-trait animal model (MM) and a random regression animal model (RRM). Data consisted of 82 064 weight records from 8 145 animals, recorded from birth to eight years of age. Weights at standard ages were considered in the MM. All models included contemporary groups as fixed effects, and age of dam (linear and quadratic effects) and animal age as covariates. In the RRM, mean trends were modelled through a cubic regression on orthogonal polynomials of animal age and genetic maternal and direct and maternal permanent environmental effects were also included as random. Legendre polynomials of orders 4, 3, 6 and 3 were used for animal and maternal genetic and permanent environmental effects, respectively, considering five classes of residual variances. Mature weight (five years) direct heritability estimates were 0.35 (MM) and 0.38 (RRM). Rank correlation between sires' breeding values estimated by MM and RRM was 0.82. However, selecting the top 2% (12) or 10% (62) of the young sires based on the MM predicted breeding values, respectively 71% and 80% of the same sires would be selected if RRM estimates were used instead. The RRM modelled the changes in the (co) variances with age adequately and larger breeding value accuracies can be expected using this model.

A systematic review with procedural assessments and meta-analysis of Low Level Laser Therapy in lateral elbow tendinopathy (tennis elbow)

Background: Recent reviews have indicated that low level level laser therapy (LLLT) is ineffective in lateral elbow tendinopathy (LET) without assessing validity of treatment procedures and doses or the influence of prior steroid injections. Methods: Systematic review with meta-analysis, with primary outcome measures of pain relief and/or global improvement and subgroup analyses of methodological quality, wavelengths and treatment procedures. Results: 18 randomised placebo-controlled trials (RCTs) were identified with 13 RCTs (730 patients) meeting the criteria for meta-analysis. 12 RCTs satisfied half or more of the methodological criteria. Publication bias was detected by Egger's graphical test, which showed a negative direction of bias. Ten of the trials included patients with poor prognosis caused by failed steroid injections or other treatment failures, or long symptom duration or severe baseline pain. The weighted mean difference (WMD) for pain relief was 10.2 mm [95% CI: 3.0 to 17.5] and the RR for global improvement was 1.36 [1.16 to 1.60]. Trials which targeted acupuncture points reported negative results, as did trials with wavelengths 820, 830 and 1064 nm. In a subgroup of five trials with 904 nm lasers and one trial with 632 nm wavelength where the lateral elbow tendon insertions were directly irradiated, WMD for pain relief was 17.2 mm [95% CI: 8.5 to 25.9] and 14.0 mm [95% CI: 7.4 to 20.6] respectively, while RR for global pain improvement was only reported for 904 nm at 1.53 [95% CI: 1.28 to 1.83]. LLLT doses in this subgroup ranged between 0.5 and 7.2 Joules. Secondary outcome measures of painfree grip strength, pain pressure threshold, sick leave and follow-up data from 3 to 8 weeks after the end of treatment, showed consistently significant results in favour of the same LLLT subgroup (p < 0.02). No serious side-effects were reported. Conclusion: LLLT administered with optimal doses of 904 nm and possibly 632 nm wavelengths directly to the lateral elbow tendon insertions, seem to offer short-term pain relief and less disability in LET, both alone and in conjunction with an exercise regimen. This finding contradicts the conclusions of previous reviews which failed to assess treatment procedures, wavelengths and optimal doses.

Placebo Response of Non-Pharmacological and Pharmacological Trials in Major Depression: A Systematic Review and Meta-Analysis

Background: Although meta-analyses have shown that placebo responses are large in Major Depressive Disorder (MDD) trials; the placebo response of devices such as repetitive transcranial magnetic stimulation (rTMS) has not been systematically assessed. We proposed to assess placebo responses in two categories of MDD trials: pharmacological (antidepressant drugs) and non-pharmacological (device-rTMS) trials. Methodology/Principal Findings: We performed a systematic review and meta-analysis of the literature from April 2002 to April 2008, searching MEDLINE, Cochrane, Scielo and CRISP electronic databases and reference lists from retrieved studies and conference abstracts. We used the keywords placebo and depression and escitalopram for pharmacological studies; and transcranial magnetic stimulation and depression and sham for non-pharmacological studies. All randomized, double-blinded, placebo-controlled, parallel articles on major depressive disorder were included. Forty-one studies met our inclusion criteria-29 in the rTMS arm and 12 in the escitalopram arm. We extracted the mean and standard values of depression scores in the placebo group of each study. Then, we calculated the pooled effect size for escitalopram and rTMS arm separately, using Cohen's d as the measure of effect size. We found that placebo response are large for both escitalopram (Cohen's d-random-effects model-1.48; 95% C.I. 1.26 to 1.6) and rTMS studies (0.82; 95% C.I. 0.63 to 1). Exploratory analyses show that sham response is associated with refractoriness and with the use of rTMS as an add-on therapy, but not with age, gender and sham method utilized. Conclusions/Significance: We confirmed that placebo response in MDD is large regardless of the intervention and is associated with depression refractoriness and treatment combination (add-on rTMS studies). The magnitude of the placebo response seems to be related with study population and study design rather than the intervention itself.

Residuals for log-Burr XII regression models in survival analysis

In this paper, we compare three residuals to assess departures from the error assumptions as well as to detect outlying observations in log-Burr XII regression models with censored observations. These residuals can also be used for the log-logistic regression model, which is a special case of the log-Burr XII regression model. For different parameter settings, sample sizes and censoring percentages, various simulation studies are performed and the empirical distribution of each residual is displayed and compared with the standard normal distribution. These studies suggest that the residual analysis usually performed in normal linear regression models can be straightforwardly extended to the modified martingale-type residual in log-Burr XII regression models with censored data.