Biomedical Event Extraction with Machine Learning

Biomedical natural language processing (BioNLP) is a subfield of natural language processing, an area of computational linguistics concerned with developing programs that work with natural language: written texts and speech. Biomedical relation extraction concerns the detection of semantic relations such as protein-protein interactions (PPI) from scientific texts. The aim is to enhance information retrieval by detecting relations between concepts, not just individual concepts as with a keyword search. In recent years, events have been proposed as a more detailed alternative for simple pairwise PPI relations. Events provide a systematic, structural representation for annotating the content of natural language texts. Events are characterized by annotated trigger words, directed and typed arguments and the ability to nest other events. For example, the sentence “Protein A causes protein B to bind protein C” can be annotated with the nested event structure CAUSE(A, BIND(B, C)). Converted to such formal representations, the information of natural language texts can be used by computational applications. Biomedical event annotations were introduced by the BioInfer and GENIA corpora, and event extraction was popularized by the BioNLP'09 Shared Task on Event Extraction. In this thesis we present a method for automated event extraction, implemented as the Turku Event Extraction System (TEES). A unified graph format is defined for representing event annotations and the problem of extracting complex event structures is decomposed into a number of independent classification tasks. These classification tasks are solved using SVM and RLS classifiers, utilizing rich feature representations built from full dependency parsing. Building on earlier work on pairwise relation extraction and using a generalized graph representation, the resulting TEES system is capable of detecting binary relations as well as complex event structures. We show that this event extraction system has good performance, reaching the first place in the BioNLP'09 Shared Task on Event Extraction. Subsequently, TEES has achieved several first ranks in the BioNLP'11 and BioNLP'13 Shared Tasks, as well as shown competitive performance in the binary relation Drug-Drug Interaction Extraction 2011 and 2013 shared tasks. The Turku Event Extraction System is published as a freely available open-source project, documenting the research in detail as well as making the method available for practical applications. In particular, in this thesis we describe the application of the event extraction method to PubMed-scale text mining, showing how the developed approach not only shows good performance, but is generalizable and applicable to large-scale real-world text mining projects. Finally, we discuss related literature, summarize the contributions of the work and present some thoughts on future directions for biomedical event extraction. This thesis includes and builds on six original research publications. The first of these introduces the analysis of dependency parses that leads to development of TEES. The entries in the three BioNLP Shared Tasks, as well as in the DDIExtraction 2011 task are covered in four publications, and the sixth one demonstrates the application of the system to PubMed-scale text mining.

Pressurized hot water flow-through extraction of birch wood

Effective processes to fractionate the main compounds in biomass, such as wood, are a prerequisite for an effective biorefinery. Water is environmentally friendly and widely used in industry, which makes it a potential solvent also for forest biomass. At elevated temperatures over 100 °C, water can readily hydrolyse and dissolve hemicelluloses from biomass. In this work, birch sawdust was extracted using pressurized hot water (PHWE) flow-through systems. The hypothesis of the work was that it is possible to obtain polymeric, water-soluble hemicelluloses from birch sawdust using flow-through PHW extractions at both laboratory and large scale. Different extraction temperatures in the range 140–200 °C were evaluated to see the effect of temperature to the xylan yield. The yields and extracted hemicelluloses were analysed to obtain sugar ratios, the amount of acetyl groups, furfurals and the xylan yields. Higher extraction temperatures increased the xylan yield, but decreased the molar mass of the dissolved xylan. As the extraction temperature increased, more acetic acid was released from the hemicelluloses, thus further decreasing the pH of the extract. There were only trace amounts of furfurals present after the extractions, indicating that the treatment was mild enough not to degrade the sugars further. The sawdust extraction density was increased by packing more sawdust in the laboratory scale extraction vessel. The aim was to obtain extracts with higher concentration than in typical extraction densities. The extraction times and water flow rates were kept constant during these extractions. The higher sawdust packing degree decreased the water use in the extractions and the extracts had higher hemicellulose concentrations than extractions with lower sawdust degrees of packing. The molar masses of the hemicelluloses were similar in higher packing degrees and in the degrees of packing that were used in typical PHWE flow-through extractions. The structure of extracted sawdust was investigated using small angle-(SAXS) and wide angle (WAXS) x-ray scattering. The cell wall topography of birch sawdust and extracted sawdust was compared using x-ray tomography. The results showed that the structure of the cell walls of extracted birch sawdust was preserved but the cell walls were thinner after the extractions. Larger pores were opened inside the fibres and cellulose microfibrils were more tightly packed after the extraction. Acetate buffers were used to control the pH of the extracts during the extractions. The pH control prevented excessive xylan hydrolysis and increased the molar masses of the extracted xylans. The yields of buffered extractions were lower than for plain water extractions at 160–170 °C, but at 180 °C yields were similar to those from plain water and pH buffers. The pH can thus be controlled during extraction with acetate buffer to obtain xylan with higher molar mass than those obtainable using plain water. Birch sawdust was extracted both in the laboratory and pilot scale. The performance of the PHWE flow-through system was evaluated in the laboratory and the pilot scale using vessels with the same shape but different volumes, with the same relative water flow through the sawdust bed, and in the same extraction temperature. Pre-steaming improved the extraction efficiency and the water flow through the sawdust bed. The extracted birch sawdust and the extracted xylan were similar in both laboratory and pilot scale. The PHWE system was successfully scaled up by a factor of 6000 from the laboratory to pilot scale and extractions performed equally well in both scales. The results show that a flow-through system can be further scaled up and used to extract water-soluble xylans from birch sawdust. Extracted xylans can be concentrated, purified, and then used in e.g. films and barriers, or as building blocks for novel material applications.

Dental fear in adolescents' transition to early adulthood

The aims of the study were to assess the validity of a clinical dental fear question (Short Dental Fear Question, SDFQ) and an instrument measuring interaction between adolescents and dental staff (Patient Dental Staff Interaction Questionnaire, PDSIQ). Also, adolescents’ subjective perception of interaction with dental staff, the association with adolescents’ dental fear and sense of coherence as well as a multi-professional small-group intervention model for decreasing high dental fear were assessed. The study sample comprised Finnish adolescents in transition to early adulthood, aged 18–26 years (n = 777, n = 773, n = 5), except for a sample of 15-year-old adolescents (n = 27). Dental fear, sense of coherence (SOC) and the adolescents’ perceived interaction with dental staff were assessed with questionnaires. The principles of fear treatment such as gradual exposure, relaxation, encouragement and cornerstones of the reteaming method based on a solution-focused framework to maintain motivation and peer support were used to decrease fear in the intervention study. The SDFQ was found to be a valid dental fear instrument and the PDSIQ a valid interaction instrument with five factors of interaction retrieved: ‘kind atmosphere and mutual communication’, ‘roughness’, ‘insecurity’, ‘trust and safety’, and ‘shame and guilt’. Highly fearful young adults more often perceived their interaction with dental staff as negative, more often felt insecure and had a weaker sense of coherence compared to their peers with no to moderate dental fear. The results of the intervention study showed that young adults’ high dental fear decreased and their commitment to dental treatment increased. The SDFQ is clinically feasible and informative instrument in measuring dental fear. Knowledge of the level of fear enables dental staff to better consider an adolescent’s fear. Dental staff should be aware that a supportive interaction style, creating trust and safety, is especially beneficial for highly dentally fearful young adults. A weak SOC may affect young adults’ high dental fear in that they would not have enough tools to manage their fear. A multi-professional small therapeutic group seems to increase fearful young adults’ resources for confronting dental treatment.

Intensification of hemicellulose hot-water extraction from spruce wood by parameter tuning

The growing population on earth along with diminishing fossil deposits and the climate change debate calls out for a better utilization of renewable, bio-based materials. In a biorefinery perspective, the renewable biomass is converted into many different products such as fuels, chemicals, and materials, quite similar to the petroleum refinery industry. Since forests cover about one third of the land surface on earth, ligno-cellulosic biomass is the most abundant renewable resource available. The natural first step in a biorefinery is separation and isolation of the different compounds the biomass is comprised of. The major components in wood are cellulose, hemicellulose, and lignin, all of which can be made into various end-products. Today, focus normally lies on utilizing only one component, e.g., the cellulose in the Kraft pulping process. It would be highly desirable to utilize all the different compounds, both from an economical and environmental point of view. The separation process should therefore be optimized. Hemicelluloses can partly be extracted with hot-water prior to pulping. Depending in the severity of the extraction, the hemicelluloses are degraded to various degrees. In order to be able to choose from a variety of different end-products, the hemicelluloses should be as intact as possible after the extraction. The main focus of this work has been on preserving the hemicellulose molar mass throughout the extraction at a high yield by actively controlling the extraction pH at the high temperatures used. Since it has not been possible to measure pH during an extraction due to the high temperatures, the extraction pH has remained a “black box”. Therefore, a high-temperature in-line pH measuring system was developed, validated, and tested for hot-water wood extractions. One crucial step in the measurements is calibration, therefore extensive efforts was put on developing a reliable calibration procedure. Initial extractions with wood showed that the actual extraction pH was ~0.35 pH units higher than previously believed. The measuring system was also equipped with a controller connected to a pump. With this addition it was possible to control the extraction to any desired pH set point. When the pH dropped below the set point, the controller started pumping in alkali and by that the desired set point was maintained very accurately. Analyses of the extracted hemicelluloses showed that less hemicelluloses were extracted at higher pH but with a higher molar-mass. Monomer formation could, at a certain pH level, be completely inhibited. Increasing the temperature, but maintaining a specific pH set point, would speed up the extraction without degrading the molar-mass of the hemicelluloses and thereby intensifying the extraction. The diffusion of the dissolved hemicelluloses from the wood particle is a major part of the extraction process. Therefore, a particle size study ranging from 0.5 mm wood particles to industrial size wood chips was conducted to investigate the internal mass transfer of the hemicelluloses. Unsurprisingly, it showed that hemicelluloses were extracted faster from smaller wood particles than larger although it did not seem to have a substantial effect on the average molar mass of the extracted hemicelluloses. However, smaller particle sizes require more energy to manufacture and thus increases the economic cost. Since bark comprises 10 – 15 % of a tree, it is important to also consider it in a biorefinery concept. Spruce inner and outer bark was hot-water extracted separately to investigate the possibility to isolate the bark hemicelluloses. It was showed that the bark hemicelluloses comprised mostly of pectic material and differed considerably from the wood hemicelluloses. The bark hemicelluloses, or pectins, could be extracted at lower temperatures than the wood hemicelluloses. A chemical characterization, done separately on inner and outer bark, showed that inner bark contained over 10 % stilbene glucosides that could be extracted already at 100 °C with aqueous acetone.

Evaluation of novel programs in health counseling – their effectiveness in the oral health of young children, and their acceptance by parents and professionals in public dental service.

Aim and design: To evaluate family-based health counseling for young children, and to study the significance of adding parental self-care or the training of professionals to the programs. The effectiveness and acceptability of the programs were evaluated by comparing two new programs with an earlier one. Subjects and methods: The study was carried out in Vantaa, which was divided into three study areas. The subjects consisted of children born in 2008, particularly fi rstborn children, while children born in 2006 formed the historical control. The fi rst of the new programs emphasized oral hygiene and use of fl uoride, and the second program focused on proper diet and use of xylitol. The main outcome measure was mutansstreptococci (MS) in the dental biofi lm of two-year-olds, and the opinions of parents and dental professionals were evaluated using questionnaires. Results: The programs found wide acceptance among dental professionals. There were no group-related differences found in the MS scores of the two-year-olds. However, all groups combined, father’s advanced level of education and child’s proper use of xylitol were associated with negative MS scores. In the opinion of parents, the oral healthcare guidance at least somewhat met their expectations. Conclusions: The present fi ndings suggest that providing training and support for professionals in health education is important. The addition of parental self-care to supplement programs aimed at young children does not improve the program, although it may improve parental readiness to change their own health habits. Counseling for families might be best carried out through a routine patient-centered program.

Fiber-reinforced composite fixed dental prostheses: Studies of the materials used as pontics

Fiber-reinforced composite fixed dental prostheses – Studies of the materials used as pontics University of Turku, Faculty of Medicine, Institute of Dentistry, Department of Biomaterials Science, Finnish Doctoral Program in Oral Sciences – FINDOS, Annales Universitatis Turkuensis, Turku, Finland 2015 Fiber-reinforced composites (FRC), a non-metallic biomaterial, represent a suitable alternative in prosthetic dentistry when used as a component of fixed dental prostheses (FDPs). Some drawbacks have been identified in the clinical performance of FRC restorations, such as delamination of the veneering material and fracture of the pontic. Therefore, the current series of studies were performed to investigate the possibilities of enhancing the mechanical and physical properties of FRC FDPs by improving the materials used as pontics, to then heighten their longevity. Four experiments showed the importance of the pontic design and surface treatment in the performance of FRC FDPs. In the first, the load-bearing capacities of inlay-retained FRC FDPs with pontics of various materials and thicknesses were evaluated. Three different pontic materials were assessed with different FRC framework vertical positioning. Thicker pontics showed increased load-bearing capacities, especially ceramic pontics. A second study was completed investigating the influence of the chemical conditioning of the ridge-lap surface of acrylic resin denture teeth on their bonding to a composite resin. Increased shear bond strength demonstrated the positive influence of the pretreatment of the acrylic surfaces, indicating dissolution of the denture surfaces, and suggesting potential penetration of the monomer systems into the surface of denture teeth. A third study analyzed the penetration depth of different monomer systems on the acrylic resin denture teeth surfaces. The possibility of establishing a durable bond between acrylic pontics and FRC frameworks was demonstrated by the ability of monomers to penetrate the surface of acrylic resin denture teeth, measured by a confocal scanning type microscope. A fourth study was designed to evaluate the load-bearing capacities of FRC FDPs using the findings of the previous three studies. In this case, the performance of pre-shaped acrylic resin denture teeth used as pontics with different composite resins as filling materials was evaluated. The filling material influenced the load-bearing capacities, providing more durable FRC FDPs. It can be concluded that the mechanical and physical properties of FRC FDPs can be improved as has been shown in the development of this thesis. The improvements reported then might provide long lasting prosthetic solutions of this kind, positioning them as potentially permanent rehabilitation treatments. Key words: fiber-reinforced composite, fixed dental prostheses, inlay-retained bridges, adhesion, acrylic resin denture teeth, dental material.

Continuous Counter-current Solvent Extraction of Magnesium and Calcium from Lithium-rich Brine

Solvent extraction of calcium and magnesium impurities from a lithium-rich brine (Ca ~ 2,000 ppm, Mg ~ 50 ppm, Li ~ 30,000 ppm) was investigated using a continuous counter-current solvent extraction mixer-settler set-up. The literature review includes a general review about resources, demands and production methods of Li followed by basics of solvent extraction. Experimental section includes batch experiments for investigation of pH isotherms of three extractants; D2EHPA, Versatic 10 and LIX 984 with concentrations of 0.52, 0.53 and 0.50 M in kerosene respectively. Based on pH isotherms LIX 984 showed no affinity for solvent extraction of Mg and Ca at pH ≤ 8 while D2EHPA and Versatic 10 were effective in extraction of Ca and Mg. Based on constructed pH isotherms, loading isotherms of D2EHPA (at pH 3.5 and 3.9) and Versatic 10 (at pH 7 and 8) were further investigated. Furthermore based on McCabe-Thiele method, two extraction stages and one stripping stage (using HCl acid with concentration of 2 M for Versatic 10 and 3 M for D2EHPA) was practiced in continuous runs. Merits of Versatic 10 in comparison to D2EHPA are higher selectivity for Ca and Mg, faster phase disengagement, no detrimental change in viscosity due to shear amount of metal extraction and lower acidity in stripping. On the other hand D2EHPA has less aqueous solubility and is capable of removing Mg and Ca simultaneously even at higher Ca loading (A/O in continuous runs > 1). In general, shorter residence time (~ 2 min), lower temperature (~23 °C), lower pH values (6.5-7.0 for Versatic 10 and 3.5-3.7 for D2EHPA) and a moderately low A/O value (< 1:1) would cause removal of 100% of Ca and nearly 100% of Mg while keeping Li loss less than 4%, much lower than the conventional precipitation in which 20% of Li is lost.

Excavation-drier method of energy-peat extraction reduces long-term climatic impact

Climatic impacts of energy-peat extraction are of increasing concern due to EU emissions trading requirements. A new excavation-drier peat extraction method has been developed to reduce the climatic impact and increase the efficiency of peat extraction. To quantify and compare the soil GHG fluxes of the excavation drier and the traditional milling methods, as well as the areas from which the energy peat is planned to be extracted in the future (extraction reserve area types), soil CO2, CH4 and N2O fluxes were measured during 2006–2007 at three sites in Finland. Within each site, fluxes were measured from drained extraction reserve areas, extraction fields and stockpiles of both methods and additionally from the biomass driers of the excavation-drier method. The Life Cycle Assessment (LCA), described at a principal level in ISO Standards 14040:2006 and 14044:2006, was used to assess the long-term (100 years) climatic impact from peatland utilisation with respect to land use and energy production chains where utilisation of coal was replaced with peat. Coal was used as a reference since in many cases peat and coal can replace each other in same power plants. According to this study, the peat extraction method used was of lesser significance than the extraction reserve area type in regards to the climatic impact. However, the excavation-drier method seems to cause a slightly reduced climatic impact as compared with the prevailing milling method.

Utilizing hemicelluloses – the first step : controlled extraction with hot water

Människor utnyttjar ofta kemi mångsidigt i sitt vardagliga liv utan att närmare tänka på detaljerna. Nuförtiden kan man framställa en ökande mängd av produkter ur förnybara råmaterial och en av de mest mångsidiga nybara råmaterialet i Norden är barrträd. Den lyriska lägerelden eller spiselden och möbler av ved samt papper är en väsentlig del av vardagen. Också livsmedel och läkemedel kan innehålla föreningar ur ved. Ved som råmaterial består av tre huvudkomponenten: cellulosa, som är uppbyggd av druvsockermolekyler är en långkedjad, oförgrenad polymer; lignin, som sammanhåller fibrerna i vedmaterialet som lim samt hemicellulosor, som ofta är uppbyggda av olika sockerarter och är en förgrenad polymer. Följaktligen består vedmaterialet av 70 % socker. I detta arbete har vi koncentrerat på i hemicellulosa och dess extraktion ur gran, samt bestämning av hemicellulosans egenskaper. Den slutliga målsättningen i forskningen var att skapa nya produkter ur gran. Forskning i extraktionens hemligheter eller hur hemicellulosa kan effektivt extraheras i den önskade formen kräver nya typers experimentellasanläggningar och experiment samt matematisk modellering. Den långkedjade hemicellulosan är lämplig för att användas t.ex. i skyddshinnor eller i livsmedel. Medel- och småmolekylär hemicellulosa kan användas som utgångsämne för framställning av bränslen, smörjmedel, sockersyror och alkoholer, av vilka xylitol är mest känd för alla pga hälsobefrämjande effekter. Det är utomordentligt viktigt ur miljöns och energiekonomins synvinkel att sträva efter effektivering av utnyttjandet av den värdefullaste och största naturtillgången, skogen i vårt land, med alla möjliga sätt. Resultaten av denna forskning utnyttjar avsevärt den växande, nya, på skogen baserande biobaseradeindustrin, som framställer nya spetsprodukter samt skapar nya arbetsplatser. ----------------------------------------------------- Ihmiset hyödyntävät usein huomaamattaan kemiaa monipuolisesti jokapäiväisessä elämässä. Nykyään kasvava määrä tuotteista kyetään valmistamaan uusiutuvista raaka-aineista ja yksi monipuolisimmista uusiutuvista luonnonvaroistamme pohjolassa ovat havupuut. Tunnelmallinen nuotio tai takkatuli ja puiset huonekalut sekä paperi ovat olennainen osa arkea. Myös elintarvikkeet ja lääkkeet voivat sisältää puusta peräisin olevia yhdisteitä. Puu materiaalina koostuu rakenteeltaan pääosin kolmesta osasta; selluloosasta, joka on rypälesokerista koostuva pitkäketjuinen haaroittumaton polymeeri, ligniinistä, joka toimii puun koossa pitävänä liima-aineena ja hemiselluloosasta, joka on useista eri sokereista rakentunut haaroittunut polymeeri. Näin ollen puusta 70 % on sokeria. Tässä työssä olemme keskittyneet hemiselluloosaan ja sen uuttamiseen kuusesta, sekä ominaisuuksien kartoittamiseen. Tutkimusaiheen lopullinen tavoite on luoda uusia tuotteita kuusesta. Uuton salojen tutkiminen eli miten hemiselluloosa saadaan tehokkaasti uutettua halutunlaisena vaatii uudenlaisia koelaitteistoja ja kokeita, sekä matemaattista mallintamista. Suurikokoinen hemiselluloosa on sopivaa käytettäväksi esimerkiksi suojakalvoissa tai elintarvikkeissa. Keskikokoista ja pienimolekyylistä hemiselluloosaa voidaan käyttää lähtöaineena valmistettaessa polttoaineita, voiteluaineita, sokerihappoja ja sokerialkoholeja, joista xylitoli on terveysvaikutustensa vuoksi kaikille tuttu. Niin ympäristömme kuin myös energiataloutemme kannalta on ensiarvoisen tärkeää pyrkiä kaikin keinoin tehostamaan maallemme arvokkaan, sekä luonnonvaroistamme yhden suurimman, metsän, vastuullista hyödyntämistä. Tämän tutkimuksen tulokset hyödyntävät merkittävästi maahamme nousevaa uutta metsään pohjautuvaa biojalostusteollisuutta, joka valmistaa uusia huipputuotteita sekä luo työpaikkoja.