Model-based testing of software systems : functionality and performance

Software is a key component in many of our devices and products that we use every day. Most customers demand not only that their devices should function as expected but also that the software should be of high quality, reliable, fault tolerant, efficient, etc. In short, it is not enough that a calculator gives the correct result of a calculation, we want the result instantly, in the right form, with minimal use of battery, etc. One of the key aspects for succeeding in today's industry is delivering high quality. In most software development projects, high-quality software is achieved by rigorous testing and good quality assurance practices. However, today, customers are asking for these high quality software products at an ever-increasing pace. This leaves the companies with less time for development. Software testing is an expensive activity, because it requires much manual work. Testing, debugging, and verification are estimated to consume 50 to 75 per cent of the total development cost of complex software projects. Further, the most expensive software defects are those which have to be fixed after the product is released. One of the main challenges in software development is reducing the associated cost and time of software testing without sacrificing the quality of the developed software. It is often not enough to only demonstrate that a piece of software is functioning correctly. Usually, many other aspects of the software, such as performance, security, scalability, usability, etc., need also to be verified. Testing these aspects of the software is traditionally referred to as nonfunctional testing. One of the major challenges with non-functional testing is that it is usually carried out at the end of the software development process when most of the functionality is implemented. This is due to the fact that non-functional aspects, such as performance or security, apply to the software as a whole. In this thesis, we study the use of model-based testing. We present approaches to automatically generate tests from behavioral models for solving some of these challenges. We show that model-based testing is not only applicable to functional testing but also to non-functional testing. In its simplest form, performance testing is performed by executing multiple test sequences at once while observing the software in terms of responsiveness and stability, rather than the output. The main contribution of the thesis is a coherent model-based testing approach for testing functional and performance related issues in software systems. We show how we go from system models, expressed in the Unified Modeling Language, to test cases and back to models again. The system requirements are traced throughout the entire testing process. Requirements traceability facilitates finding faults in the design and implementation of the software. In the research field of model-based testing, many new proposed approaches suffer from poor or the lack of tool support. Therefore, the second contribution of this thesis is proper tool support for the proposed approach that is integrated with leading industry tools. We o er independent tools, tools that are integrated with other industry leading tools, and complete tool-chains when necessary. Many model-based testing approaches proposed by the research community suffer from poor empirical validation in an industrial context. In order to demonstrate the applicability of our proposed approach, we apply our research to several systems, including industrial ones.

Attitudes About Predictive MEN1 Genetic Testing in Minors

Multiple Endocrine Neoplasia type 1 (MEN1) is a hereditary cancer syndrome characterized by tumors of the endocrine system. Tumors most commonly develop in the parathyroid glands, pituitary gland, and the gastro-entero pancreatic tract. MEN1 is a highly penetrant condition and age of onset is variable. Most patients are diagnosed in early adulthood; however, rare cases of MEN1 present in early childhood. Expert consensus opinion is that predictive genetic testing should be offered at age 5 years, however there are no evidence-based studies that clearly establish that predictive genetic testing at this age would be beneficial since most symptoms do not present until later in life. This study was designed to explore attitudes about the most appropriate age for predictive genetic testing from individuals at risk of having a child with MEN1. Participants who had an MEN1 mutation were invited to complete a survey and were asked to invite their spouses to participate as well. The survey included several validated measures designed to assess participants’ attitudes about predictive testing in minors. Fifty-eight affected participants and twenty-two spouses/partners completed the survey. Most participants felt that MEN1 genetic testing was appropriate in healthy minors. Younger age and increased knowledge of MEN1 genetics and inheritance predicted genetic testing at a younger age. Additionally, participants who saw more positive than negative general outcomes from genetic testing were more likely to favor genetic testing at younger ages. Overall, participants felt genetic testing should be offered at a younger age than most adult onset conditions and most felt the appropriate time for testing was when a child could understand and participate in the testing process. Psychological concerns seemed to be the primary focus of participants who favored later ages for genetic testing, while medical benefits were more commonly cited for younger age. This exploratory study has implications for counseling patients whose children are at risk of developing MEN1 and illustrates issues that are important to patients and their spouses when considering testing in children.

Formal verification and testing of software architectural models

Ensuring the correctness of software has been the major motivation in software research, constituting a Grand Challenge. Due to its impact in the final implementation, one critical aspect of software is its architectural design. By guaranteeing a correct architectural design, major and costly flaws can be caught early on in the development cycle. Software architecture design has received a lot of attention in the past years, with several methods, techniques and tools developed. However, there is still more to be done, such as providing adequate formal analysis of software architectures. On these regards, a framework to ensure system dependability from design to implementation has been developed at FIU (Florida International University). This framework is based on SAM (Software Architecture Model), an ADL (Architecture Description Language), that allows hierarchical compositions of components and connectors, defines an architectural modeling language for the behavior of components and connectors, and provides a specification language for the behavioral properties. The behavioral model of a SAM model is expressed in the form of Petri nets and the properties in first order linear temporal logic.^ This dissertation presents a formal verification and testing approach to guarantee the correctness of Software Architectures. The Software Architectures studied are expressed in SAM. For the formal verification approach, the technique applied was model checking and the model checker of choice was Spin. As part of the approach, a SAM model is formally translated to a model in the input language of Spin and verified for its correctness with respect to temporal properties. In terms of testing, a testing approach for SAM architectures was defined which includes the evaluation of test cases based on Petri net testing theory to be used in the testing process at the design level. Additionally, the information at the design level is used to derive test cases for the implementation level. Finally, a modeling and analysis tool (SAM tool) was implemented to help support the design and analysis of SAM models. The results show the applicability of the approach to testing and verification of SAM models with the aid of the SAM tool.^

Formal verification and testing of software architectural models

Ensuring the correctness of software has been the major motivation in software research, constituting a Grand Challenge. Due to its impact in the final implementation, one critical aspect of software is its architectural design. By guaranteeing a correct architectural design, major and costly flaws can be caught early on in the development cycle. Software architecture design has received a lot of attention in the past years, with several methods, techniques and tools developed. However, there is still more to be done, such as providing adequate formal analysis of software architectures. On these regards, a framework to ensure system dependability from design to implementation has been developed at FIU (Florida International University). This framework is based on SAM (Software Architecture Model), an ADL (Architecture Description Language), that allows hierarchical compositions of components and connectors, defines an architectural modeling language for the behavior of components and connectors, and provides a specification language for the behavioral properties. The behavioral model of a SAM model is expressed in the form of Petri nets and the properties in first order linear temporal logic. This dissertation presents a formal verification and testing approach to guarantee the correctness of Software Architectures. The Software Architectures studied are expressed in SAM. For the formal verification approach, the technique applied was model checking and the model checker of choice was Spin. As part of the approach, a SAM model is formally translated to a model in the input language of Spin and verified for its correctness with respect to temporal properties. In terms of testing, a testing approach for SAM architectures was defined which includes the evaluation of test cases based on Petri net testing theory to be used in the testing process at the design level. Additionally, the information at the design level is used to derive test cases for the implementation level. Finally, a modeling and analysis tool (SAM tool) was implemented to help support the design and analysis of SAM models. The results show the applicability of the approach to testing and verification of SAM models with the aid of the SAM tool.

Actuador linear para teste de teclas na indústria automóvel

As indústrias de componentes e acessórios automóveis são um elo fundamental no processo produtivo da indústria automóvel. Neste leque industrial encontra-se a Preh Portugal, Lda, como empresa fornecedora de componentes electrónicos, mais concretamente, painéis de controlo de climatização. Os painéis fornecidos pela Preh aos seus clientes encontram-se sujeitos a rigorosos testes de qualidade e funcionalidade. Neste sentido o teste funcional das teclas surge, relacionando o curso da tecla em função de uma força actuante. Esta relação está comprometida com uma curva característica padrão para o tipo de tecla. Para além destes compromissos, também é necessário que a tecla feche e abra o seu contacto eléctrico. Esta tese foca-se no desenvolvimento do teste de teclas, apresentando uma alteração ao sistema actual com a introdução de um sistema embebido, no intuito de flexibilizar o sistema de teste e reduzindo custos. O sistema embebido pretende dar capacidade de processamento ao teste e, desta forma, substituir o actual computador como elemento de processamento. A solução implementada consistiu numa mudança estrutural, através da inclusão do sistema embebido entre o computador e o sistema de deslocamento. Passando o foco central do processo de teste a residir no sistema embebido, este tem de estabelecer comunicações com os restantes elementos intervenientes no teste. Estabelece comunicações série RS-232 com o sistema de deslocamento (leitura do curso e força na tecla), Ethernet com o computador (comandos, parâmetros e resultados) e CAN com o painel de controlo de climatização (fecho/abertura do contacto eléctrico). A concretização deste projecto resultou numa nova estrutura e aplicação, a qual é facilmente integrada na linha de produção com as vantagens de ser menos onerosa e mais flexível, conforme o pretendido.

O impacto da fase pré-analítica nos resultados : de que modo a fase pré-analítica pode interferir nos resultados de um trabalho de investigação

RESUMO: O impacto da fase pré-analítica nos resultados é o objectivo do nosso trabalho. Considera-se que esta fase é a mais importante no procedimento do teste no laboratório e que as variáveis independentes do laboratório são difíceis de controlar porque existem várias condicionantes quer dos profissionais, quer do doente, que por vezes não possibilita atribuir a importância desejada para que os resultados sejam fiáveis. De que modo a fase pré-analítica pode interferir nos resultados de um trabalho de investigação. Para podermos avaliar este processo é necessário considerar outra condicionante, nomeadamente, o facto de o teste ser realizado em laboratórios específicos com a qualidade certificada mas que não intervêm na colheita, manuseamento, armazenamento e transporte da amostra, procedimentos importantes que traduzem uma boa gestão da amostra na fase pré-analítica, necessária para a fiabilidade dos resultados dos estudos de investigação clínica.------------------ABSTRACT: The impact of pre-analytical phase in the results is the objective of our work Knowing that, this is the most important stage in the procedure of testing in the laboratory and because the independent variables the laboratory are difficult to control because these are several limitations of both the professional and the patient, sometimes does not assign importance to that desired result are reliable. How the pre-analytical phase can interfere with the result of a research work, there is another constraint to consider the testing process to be performed in individual laboratory with certified quality, but not involved in harvesting, handing, storage and transport of the sample, important procedures that translate a good sample management in the preanalytical phase, necessary for the reliability of results of clinical research studies.

Shaking table tests of a two-storey log house

This paper presents the findings of an experimental campaign that was conducted to investigate the seismic behaviour of log houses. A two-storey log house designed by the Portuguese company Rusticasa® was subjected to a series of shaking table tests at LNEC, Lisbon, Portugal. The paper contains the description of the geometry and construction of the house and all the aspects related to the testing procedure, namely the pre-design, the setup, instrumentation and the testing process itself. The shaking table tests were carried out with a scaled spectrum of the Montenegro (1979) earthquake, at increasing levels of PGA, starting from 0.07g, moving on to 0.28g and finally 0.5g. The log house did not suffer any major damage and remained in working condition throughout the entire process. The preliminary analysis of the overall behaviour of the log house is also discussed.

Análise de complexidade de programas em ferramentas de apoio à decisão

Dissertação de mestrado em Engenharia de Sistemas

Aplicación para la gestión de un sistema de incidencias de un almacén robotizado

Aquest projecte té com objectiu fer un sistema d’incidències pel control d’un magatzem robotitzat i del cost que comporta la resolució d’aquestes. D’aquesta manera es pretén canviar un mètode de treball rudimentari, passant a un altre totalment estructurat que serveixi per millorar el actual. Per això s’ha creat una aplicació basada en la tecnologia JSF, què permet aconseguir els nostres objectius. L’aplicació inclou una base de dades feta en PostGres SQL on es guardarà tota la informació que s’utilitza en la nostra aplicació. En aquesta memòria s’ha volgut explicar quins han estat els diferents passos que es van donar per poder assolir tots els nostres objectius. En la primera part realitzem una introducció a la situació del problema que es vol solucionar i descriurem els objectius que en hem marcat. Seguidament s’analitzen els requeriments i es detalla com s’implementen les diferents parts de l’aplicació. Per acabar parlem sobre el procés de testing realitzat que ens assegura el correcte funcionament del programa. Resumint, el objectiu principal d’aquest projecte consisteix en crear una eina que a la vegada que facilita la feina dels treballadors del magatzem, serveixi per al control de tot el sistema de treball als directius de l’empresa.

ATS3-testausjärjestelmän evaluointi

Työ tehtiin Nokia Technology Platforms S60 Mobile Runtime-yksikölle. Työn tavoitteena oli evaluoida ATS3-testausjärjestelmä. ATS3-järjestelmällä voidaan automatisoida ohjelmistotestausta. Evaluoinnilla pyrittiin selvittämään voidaanko tuotekehitysvaiheessa oleva järjestelmä ottaa jo käyttöön vai vaatiiko se vielä lisäkehitystä. Työssä kerrotaan aluksi yleisesti ohjelmistotestauksesta. Siinä käydään läpi myös testausprosessin vaiheet sekä kerrotaan lyhyesti avuksi kehitetyistä työkaluista. Työssä kerrotaan myös ATS3-järjestelmän edeltäjien ominaisuuksista, sekä miten ne eroavat tarkastelun kohteena olevasta järjestelmästä. Varsinainen evaluointi alkoi tutustumalla ja asentamalla järjestelmä. Tämän jälkeen suoritettiin samat testit sekä ATS2.x-järjestelmässä että ATS3-järjestelmäss. Testauksen jälkeen analysoitiin testitulosten yhdenmukaisuuden perusteella, voidaanko siirtyä käyttömään ATS3-järjestelmää. Testitulokset olivat käytännässä yhdenmukaiset suoritettaessa testejä matkapuhelimessa, mutta emulaattoritestaus täytyi jättää väliin. Lukuisista yrityksistä sekä järjestelmän kehittäjän avusta huolimatta testejä ei onnistuttu suorittamaan ATS3-järjestelmän emulaattoriympäristössä. Näin ollen päädyttiin tulokseen, ettei järjestelmää voida ottaa vielä käytöön emulaattoritestauksessa, vaan se vaatii lisätutkimusta sekä perehtymistä järjestelmään.

Projecto de sensibilização e educação ambiental na área da prevenção da produção dos resíduos urbanos : proposta de integração da temática nos currícula do ensino básico de Cabo Verde

This research project has as main objective the design of a project to raise awareness and environmental education in the area of prevention of the urban waste production by focusing on the presentation of a methodological proposal to incorporate this theme in the Course Curriculum of the Basic Education in Cape Verde. The study aimed beyond the project design, the preparation of a guide and a set of activities, instruments to be used by the educational community and more directly by the teachers of the Basic Education (EB) of Cape Verde for knowledge construction in study area and promove the development of skills of those teachers in terms of planning activities for waste prevention. The realized work included visits to various sources of information considered relevant, the application and validation of some activities in the population testing process using the technique of participant observation. This research involved the collaboration of the educational community of Praia namely the BE teachers, Pedagogical team teaching and Promoters of the new BE Curriculum. The study made a contribution in the view of the definition of the methodology of the work project and the assessment tool in order to reflect on the work process and its subsequent correction / improvement of future operations. We also present a proposal of monitoring and evaluation instrument of the project which will be applied during the implementation phase. Its use will enable the school community to improve their practices and will facilitate the involvement of the educational community taking into consideration an environmental sustainability

Projecto de sensibilização e educação ambiental na área da prevenção da produção dos resíduos urbanos : proposta de integração da temática nos currícula do ensino básico de Cabo Verde

O presente trabalho de projecto tem como principal objectivo a concepção de um projecto de sensibilização e educação ambiental na área da prevenção da produção dos resíduos urbanos com enfoque na apresentação de uma proposta metodológica de integração desta temática nos Currícula do Ensino Básico de Cabo Verde. Do estudo desenvolvido resultou, além da concepção do projecto, a elaboração de um guia, bem como um caderno de actividades, instrumentos a serem utilizados pela comunidade educativa e mais directamente pelos professores do Ensino Básico (EB) de Cabo Verde visando o reforço de conhecimentos na área de estudo identificada e o desenvolvimento de competências juntos dos referidos professores, para a planificação de actividades de prevenção da produção dos resíduos urbanos. O trabalho realizado compreendeu visitas a várias fontes de informação consideradas pertinentes assim como a aplicação e validação de algumas actividades numa população-teste com utilização da técnica de observação participante. Deste modo, o estudo contou com a colaboração da comunidade educativa da Cidade da Praia nomeadamente professores do EB, Equipa pedagógica e Promotores do novo Currículo do EB. O estudo permitiu dar um contributo na perspectiva da definição da metodologia do trabalho do projecto e instrumento de avaliação, visando uma reflexão sobre o trabalho desenvolvido e sua consequente correcção/melhoria de futuras acções. Apresentamos ainda uma proposta de instrumentos de acompanhamento e avaliação do projecto cuja aplicação se propõe no decorrer da implementação do mesmo. A sua utilização permitirá à comunidade escolar melhorar as suas práticas e facilitará o envolvimento da comunidade educativa tendo em vista a sustentabilidade ambiental.

Projecto de sensibilização e educação ambiental na área da prevenção da produção dos resíduos urbanos : proposta de integração da temática nos currícula do ensino básico de Cabo Verde

This research project has as main objective the design of a project to raise awareness and environmental education in the area of prevention of the urban waste production by focusing on the presentation of a methodological proposal to incorporate this theme in the Course Curriculum of the Basic Education in Cape Verde. The study aimed beyond the project design, the preparation of a guide and a set of activities, instruments to be used by the educational community and more directly by the teachers of the Basic Education (EB) of Cape Verde for knowledge construction in study area and promove the development of skills of those teachers in terms of planning activities for waste prevention. The realized work included visits to various sources of information considered relevant, the application and validation of some activities in the population testing process using the technique of participant observation. This research involved the collaboration of the educational community of Praia namely the BE teachers, Pedagogical team teaching and Promoters of the new BE Curriculum. The study made a contribution in the view of the definition of the methodology of the work project and the assessment tool in order to reflect on the work process and its subsequent correction / improvement of future operations. We also present a proposal of monitoring and evaluation instrument of the project which will be applied during the implementation phase. Its use will enable the school community to improve their practices and will facilitate the involvement of the educational community taking into consideration an environmental sustainability

Taajuusmuuttajan ohjelmiston testaus

Tämän diplomityön tavoitteena oli kehittää menetelmiä ja ohjeitataajuusmuuttajan sulautetun ohjelmiston kehityksen aikaiseen testaukseen. Soveltuvia menetelmiä etsittiin tutkimalla laajasti kirjallisuutta sekä selvittämälläyrityksen testauskäytäntöä. Tutkittuja kirjallisuudesta löytyneitä menetelmä olivat testauskehykset, simulointi ja staattinen sekä automaattinen testaus. Kirjallisuudesta etsittiin myös menetelmiä, joiden avulla testausprosessia voidaan helpottaa tai muuten parantaa. Tällaisista menetelmistä tutkittiin muun muassa testidatan valintaa, testauslähtöistä kehitystä sekä testattavuuden parantamista. Lisäksi selvitettiin uudelleenkäytettävien testien ohjelmointiin soveltuvia ohjelmointikieliä. Haastatteluiden ja dokumentaation avulla saatiin hyvä käsitys yrityksessä vallitsevasta testauskäytännöstä sekä sen ongelmakohdista. Testauksen ongelmiksi havaittiin testausprosessin järjestelmällisyyden puute sekä tarve suunnittelijoiden testauskoulutukseen. Testausprosessin parantamiseksi esitetään moduulitestauskehyksen käyttöönottoa. Lisäksi suunnittelijoiden testauskoulutuksella arvioidaan olevan suuri vaikutus koko testausprosessiin. Testitapausten suunnitteluun esitetään menetelmiä, joiden avulla voidaan suunnitella kattavampia testejä.

Mangaaniseosteisen duplex-teräksen hitsattavuus

Diplomityön tavoitteena oli selvittää mangaaniseosteisen LDX2101 duplex-teräksen ja LDX2101 hitsauslisäaineiden hitsausparametrit puikkohitsaus-, MAG-täytelankahitsaus- ja plasmahitsausprosessilla. Toisena tavoitteena oli selvittää lämmöntuonnin vaikutuksia hit-sausliitosten mekaanisiin ominaisuuksiin, iskusitkeyteen (-40 °C) ja ferriitti- / austeniittipitoi-suuksien jakaantumiseen. Tutkittavat hitsit olivat päittäishitsejä ja koelevyjen aineenpaksuus oli 6 mm. Koetulosten perusteella tehtiin hitsausohjeet kyseisille hitsausprosesseille. Työn kirjallisessa osassa on selvitetty yleisesti duplex-terästen käyttökohteita, mekaanisia ja kemiallisia ominaisuuksia sekä duplex-terästen korroosio-ominaisuuksia. Lisäksi on käsitelty eri hitsausprosesseja ja duplex-terästen hitsattavuutta, jossa selvitetään mm. terästen jähmet-tymistä, erkaumia ja faaseja, lämmöntuonnin vaikutuksia ja hitsausliitosten korroosionkestä-vyyttä. Teoriaosassa on kerrottu myös hitsausliitosten tarkastuksesta ja hitsiluokista. Työn kokeellisessa osassa esitellään kokeiden suoritus sekä ainetta rikkova ja ainetta rikko-maton tarkastus. Liitoksille suoritettava koestusohjelma noudatti pääosin menetelmäkoestan-dardin SFS-EN 15614-1 ohjetta. Hitseille tehtiin ainetta rikkomaton tarkastus, joka käsittää silmämääräisen tarkastuksen, pintatarkastuksen ja röntgentarkastuksen. Rikkovaa aineen-koetusta tehtiin sisältäen kovuusmittaukset, vetokokeet, taivutuskokeet jaiskusitkeyskokeet. Lisäksi valmistettiin metallografiset hieet, joita tutkimalla selvitettiin hitsausliitoksen metal-lurgiaa ja määriteltiin ferriitti- ja austeniittipitoisuudet. Kokeiden perusteella on laadittu hit-sausohjeet kullekin hitsausprosessille. Lisäksi kokeellisessa osassa on esitelty tulokset syö-pymäkokeesta, jossa selvitettiin eri materiaalien syöpymiskestävyyttä valkolipeäliuoksessa. Tutkimustuloksien perusteella LDX2102 duplex-materiaali onhyvin hitsattavaa laajalla hit-sausparametrialueella. Mekaaniset ominaisuudet, kuten lujuus- ja iskusitkeysarvot täyttävät materiaalistandardin SFS-EN10028-7 niille asettamat vaatimukset. Taivutussitkeys ja murto-venymät jäivät kuitenkin osalla koekappaleista vaatimustasoa alhaisemmiksi. Austeniitti- ja ferriittipitoisuudet vastaavat materiaalistandardin vaatimuksia.