Data Accuracy in Medical Record Abstraction

Clinical Research Data Quality Literature Review and Pooled Analysis We present a literature review and secondary analysis of data accuracy in clinical research and related secondary data uses. A total of 93 papers meeting our inclusion criteria were categorized according to the data processing methods. Quantitative data accuracy information was abstracted from the articles and pooled. Our analysis demonstrates that the accuracy associated with data processing methods varies widely, with error rates ranging from 2 errors per 10,000 files to 5019 errors per 10,000 fields. Medical record abstraction was associated with the highest error rates (70–5019 errors per 10,000 fields). Data entered and processed at healthcare facilities had comparable error rates to data processed at central data processing centers. Error rates for data processed with single entry in the presence of on-screen checks were comparable to double entered data. While data processing and cleaning methods may explain a significant amount of the variability in data accuracy, additional factors not resolvable here likely exist. Defining Data Quality for Clinical Research: A Concept Analysis Despite notable previous attempts by experts to define data quality, the concept remains ambiguous and subject to the vagaries of natural language. This current lack of clarity continues to hamper research related to data quality issues. We present a formal concept analysis of data quality, which builds on and synthesizes previously published work. We further posit that discipline-level specificity may be required to achieve the desired definitional clarity. To this end, we combine work from the clinical research domain with findings from the general data quality literature to produce a discipline-specific definition and operationalization for data quality in clinical research. While the results are helpful to clinical research, the methodology of concept analysis may be useful in other fields to clarify data quality attributes and to achieve operational definitions. Medical Record Abstractor’s Perceptions of Factors Impacting the Accuracy of Abstracted Data Medical record abstraction (MRA) is known to be a significant source of data errors in secondary data uses. Factors impacting the accuracy of abstracted data are not reported consistently in the literature. Two Delphi processes were conducted with experienced medical record abstractors to assess abstractor’s perceptions about the factors. The Delphi process identified 9 factors that were not found in the literature, and differed with the literature by 5 factors in the top 25%. The Delphi results refuted seven factors reported in the literature as impacting the quality of abstracted data. The results provide insight into and indicate content validity of a significant number of the factors reported in the literature. Further, the results indicate general consistency between the perceptions of clinical research medical record abstractors and registry and quality improvement abstractors. Distributed Cognition Artifacts on Clinical Research Data Collection Forms Medical record abstraction, a primary mode of data collection in secondary data use, is associated with high error rates. Distributed cognition in medical record abstraction has not been studied as a possible explanation for abstraction errors. We employed the theory of distributed representation and representational analysis to systematically evaluate cognitive demands in medical record abstraction and the extent of external cognitive support employed in a sample of clinical research data collection forms. We show that the cognitive load required for abstraction in 61% of the sampled data elements was high, exceedingly so in 9%. Further, the data collection forms did not support external cognition for the most complex data elements. High working memory demands are a possible explanation for the association of data errors with data elements requiring abstractor interpretation, comparison, mapping or calculation. The representational analysis used here can be used to identify data elements with high cognitive demands.

Evaluación de características de interés agronómico de damascos cv. Modesto

El cultivar de damascos Modesto es de introducción relativamente reciente en Mendoza (Argentina). El objetivo del trabajo fue evaluar las siguientes características de interés agronómico: la época de floración y la calidad de los frutos en cosecha y en postcosecha. El estudio se realizó en un monte comercial durante 2007 y 2008. Se registraron tres estados fenológicos: "D" (corola visible), "F" (flor abierta) y "H" (fruto cuajado). Se estableció el inicio de la floración, la plena floración y el fin de la misma. En los frutos las evaluaciones y mediciones se realizaron en el momento de la recolección y después del período de maduración de la fruta conservada en cámara frigorífica. Se determinó: color de fondo, peso, diámetro, firmeza de pulpa, contenido de sólidos solubles, pH, acidez titulable, presencia de hongos y desórdenes fisiológicos. Los resultados muestran que el cultivar Modesto florece en una época intermedia en la zona E de la provincia de Mendoza. La fecha de plena floración en los dos años del estudio fue el 8 de setiembre. En los estados de madurez evaluados los frutos reúnen los atributos de calidad demandados por el consumidor: alto CSS, color anaranjado en la madurez, buena firmeza de pulpa; sin embargo, el rápido, descenso de la firmeza durante la maduración en poscosecha obliga a una comercialización acelerada. Después del almacenamiento en cámara frigorífica durante treinta días y un período de maduración de dos días, la futa presentó el desorden harinosidad con una incidencia superior al 60%; esto señala que el cv. Modesto no puede almacenarse por un período tan prolongado.

GEMS-GLORI world river discharge database

The GEMS-GLORI register, circulated by UNEP for review in 1996, lists 555 world major rivers discharging to oceans (Q > 10 km**3/year, or A > 10 000 km**2, or sediment discharge > 5Mt/year, or basin population >5M people). Up to 48 river attributes are listed, including major ions and nutrients (C, N, P) in both dissolved, particulate, organic and inorganic forms. For many rivers, two or three sets of data are provided with relevant periods of records and references. Although half of the selected rivers are not yet documented for water quality, most of the first 40 rivers are well described (Irrawady, Zambezi, Ogooue, Magdalena, are noted exceptions). Altogether about 10 000 individual data from 500 references are listed. The global coverage in terms of river discharge and/or drainage area ranges from 40 to 67% for most major water quality attributes but drops to 25% for some organic and/or particulate forms of N and P. Planned development of the register includes collection of information on particulate chemistry and data on endorheic rivers and selected tributaries.

MRI texture analysis as means for addressing rehydration and milk diffusion of cereals

Cereals microstructure is one of the primary quality attributes of cereals. Cereals rehydration and milk diffusion depends on such microstructure and thus, the crispiness and the texture, which will make it more palatable for the final consumer. Magnetic Resonance Imaging (MRI) is a very powerful topographic tool since acquisition parameter leads to a wide possibility for identifying textures, structures and liquids mobility. It is suited for non-invasive imaging of water and fats. Rehydration and diffusion cereals processes were measured by MRI at different times and using two different kinds of milk, varying their fat level. Several images were obtained. A combination of textural analysis (based on the analysis of histograms) and segmentation methods (in order to understand the rehydration level of each variety of cereals) were performed. According to the rehydration level, no advisable clustering behavior was found. Nevertheless, some differences were noticeable between the coating, the type of milk and the variety of cereals

Towards data-aware resource analysis for service orchestrations

Compile-time program analysis techniques can be applied to Web service orchestrations to prove or check various properties. In particular, service orchestrations can be subjected to resource analysis, in which safe approximations of upper and lower resource usage bounds are deduced. A uniform analysis can be simultaneously performed for different generalized resources that can be directiy correlated with cost- and performance-related quality attributes, such as invocations of partners, network traffic, number of activities, iterations, and data accesses. The resulting safe upper and lower bounds do not depend on probabilistic assumptions, and are expressed as functions of size or length of data components from an initiating message, using a finegrained structured data model that corresponds to the XML-style of information structuring. The analysis is performed by transforming a BPEL-like representation of an orchestration into an equivalent program in another programming language for which the appropriate analysis tools already exist.

Metamodelo para la definición de metodologías de desarrollo software centradas en documentos y la mejora de la calidad de la documentación software

La documentación en los proyectos software presenta una serie de problemas que afectan a la calidad del producto y al proceso software. Con frecuencia, la documentación es considerada sólo como un volumen adicional de información disponible para la organización y el equipo de desarrollo, que ralentiza la ejecución del proyecto. En este sentido, el papel de la documentación en un proyecto se concibe como una de las actividades más costosas y que consumen más tiempo y que luego no se utiliza de forma extensiva. La documentación queda, en muchos casos, relegada a un segundo plano y es poco valorada frente a la comunicación cara a cara. Existe además una relación entre la calidad de la documentación y el proceso software. Se plantean dificultades en la adopción de buenas prácticas de proceso software y el impacto del exceso de documentación percibido por parte de los gestores de proyectos en los que se quiere abordad un programa de mejora del proceso software. Recordemos que la calidad de la documentación está muy relacionada con la utilización de la misma que puedan hacer los desarrolladores. Esta tesis aborda el problema planteando un cambio de punto de vista en el proceso software, en el que la documentación pasa de ser un sub producto de las actividades y tareas del proceso a ser el elemento que vertebra el propio proceso. En este nuevo punto de vista, la definición de los propios documentos, sus propiedades y relaciones permiten establecer y guiar procesos software de cualquier tipo. Para ello, desarrolla un metamodelo para definición de metodologías centradas en documentos. Este metamodelo se confronta con una serie atributos de calidad de la documentación software para comprobar que existe una mejora sobre estos, y, por consiguiente se mejora la calidad de la documentación software en general. Por último se utiliza este metamodelo centrado en documentos para describir una metodología ágil (Scrum) y validar la capacidad y flexibilidad del metamodelo utilizando el cambio de punto de vista sobre el proceso software planteado en esta tesis. ABSTRACT The documentation in software projects has a number of problems affecting the quality of the product and the software process. Often, documentation is considered only as an additional volume of information available to the organization and development team, which slows project execution. In this sense, the role of documentation in a project is conceived as one of the most expensive activities and more time-consuming and then not used extensively. The documentation is, in many cases, relegated to the background and is undervalued compared to face-to-face communication. There is also a relationship between the quality of the documentation and software process. There are difficulties in adopting good practices of software process and the impact of excess documentation perceived by project managers in Software Process Improvement activities. We have to remember that quality of the documentation is closely related to the use of it that can make developers. This thesis addresses the problem considering a change of view on the software process, in which the documentation happens to be a by-product of the activities and tasks of the process to be the element that structures the process itself. Through this new view, the definition of the documents themselves, their properties and relationships, allow us to establish processes and guidance for develop software of any kind. To achieve this target, a metamodel for defining document-centric methodologies has been developed. This metamodel confronts a number of quality attributes software documentation to prove that there is an improvement on these, and therefore the quality of the software documentation is improved. Finally this document-centric metamodel is used to describe an agile methodology (Scrum) to validate the capability and flexibility of the metamodel, using the proposed change of view on the software process described in this thesis.

Caracterización y análisis del coste de mejora de la calidad de servicio en transporte urbano en autobús, basado en la metodología ABC (activity based costing)

El estudio de la calidad de servicio en transporte público ha tenido distintos enfoques, tanto en la investigación como en sus aplicaciones prácticas, tales como el desarrollo del método SERVQUAL, los proyectos QUATTRO y EQUIP de la Comisión Europea, el Transit Capacity and Quality of Service Manual y finalmente el estándar EN 13816, siendo la consideración principal la calidad desde el punto de vista del usuario, es decir, la calidad percibida, cuyo objetivo en la práctica trata de obtener un Índice de Satisfacción del Cliente como medida de la calidad global. Esta aproximación deja de lado aspectos tanto sobre calidad suministrada como sobre los suministradores del servicio, las administraciones y los operadores, particularmente en cuanto a las implicaciones económicas. El objetivo principal de la presente tesis es la estimación del impacto económico real de la mejora de atributos de calidad para un operador de autobús urbano. En el capítulo 2, se lleva a cabo un análisis del estado del arte sobre el estudio de la calidad, tanto de los métodos de estudio, como de su aplicación al campo de transporte público, y, específicamente, del estudio de costes. En los capítulos 3 y 4 se propone la aplicación de la metodología ABC (Activity Based Costing) para el caso de un contrato de servicio de transporte público en autobús en la Comunidad de Madrid, concretamente la conexión de Tres Cantos. Para ello se utilizan datos de encuestas de calidad esperada y percibida por los usuarios, junto con información económica y de actividad, así como entrevistas a personal de la empresa, conformando todo ello una metodología compacta de investigación y análisis. Los resultados de las encuestas y los análisis posteriores identificaron la frecuencia de servicio, la puntualidad de los autobuses y la seguridad de la conducción como las tres variables mas importantes desde el punto de vista del usuario, y ha sido en referencia a estas tres variables sobre las que se ha desarrollado la aplicación del método ABC contenida en el capítulo 5. Los resultados descritos en el capítulo 6 muestran la consistencia y la aplicabilidad de esta metodología, superando las simplificaciones de los procedimientos tradicionales contables. En cuanto a los resultados obtenidos, se ha comprobado que una aproximación tradicional basada en costes por kilometro puede llegar a sobrevalorar los costes asociados a mejoras de calidad hasta tres veces los costes calculados según el método ABC. Finalmente en el capítulo 7 se recogen las principales conclusiones y se apuntan algunas líneas futuras de investigación basadas en mejoras sobre la aplicación y transferibilidad de los resultados. The study of service quality and its implication for transport contracts has several approaches in research and practical applications, such as the development of the SERVQUAL method, the UE QUATTRO and EQUIP research projects, the Transit Capacity and Quality of Service Manual and finally the EN 13816 standard. In all cases the main stream is the consideration of quality from the user’s point of view, thus obtaining a Customer Satisfaction Index as a measurement of the overall service quality. This approach ignores quality consequences for transport providers, authorities and operators, particularly economic implications. The main target of this thesis is to estimate the real economic impact of improving quality attributes for a bus operator. Chapter 2 includes a thorough analysis of the state of the art of general methodologies on service quality, their applications for public transport, and particularly for quality costing. In chapters 3 and 4, the Activity Based Costing (ABC) methodology is proposed for a suburban bus contract in Madrid, Tres Cantos. Perceived and expected quality surveys are used together with economic and performance information, as well as interviews with key staff from the operator. The whole set of surveys, interviews and ABC methodology puts together a comprehensive approach for analysis and research. Surveys and subsequent analysis shows service headway, punctuality and safety as the three most important service attributes from the user’s point of view. The proposed methodology has been applied to these three variables, as described in chapter 5. Results obtained in chapter 6 show the consistency and practicality of this methodology, overcoming simplifications from traditional accounting procedures. According to the latter, a calculation of costs based on mileage can overvalue quality improvements up to three times the results following ABC methodology. Finally, in chapter 7, the main conclusions are highlighted and some future research is suggested in terms of application improvements as well as results transferability.

Goat meat production: Present status and future possibilities

The bulk of the world's goat population is found in South-East Asia and Africa, where goats are the major source of meat production. Unfortunately, lack of an organized goat meat industry and marketing structure in developing countries is primarily responsible for their poor export earnings compared to those in developed countries such as Australia and New Zealand. Goat meat is leaner than meat from other domestic red meat species as well as being comparable in terms of its nutritional constituents. Furthermore, there are few, if any, religious or cultural taboos limiting the consumption of goat meat. Development of a carcass grading system and a suitable infrastructure in developing countries are some of the key requirements needed to establish a sustainable goat meat industry in the world. With an increase in demand by consumers for low-fat red meat alternatives, the future of the goat meat industry looks promising.

Characteristics of banana fruit from nearby organic versus conventional plantations: A case study

This case study reports the post-harvest qualities of conventionally versus organically grown banana fruit from nearby plantations in the Dominican Republic. The comparison involved six repeated harvests over the transition from cooler to hotter seasons. Green mature Cavendish 'Grande Naine' banana fruit were shipped to the UK. They were triggered to ripen with ethylene gas and kept under simulated retail conditions. Fruit mass, colour, firmness and flavour parameters were measured every second day over 12 d of shelf life. Sensory comparisons were conducted on four of the six harvest times. Significant differences (P<0.05) in measured quality attributes between conventionally and organically grown fruit were few and marginal. Moreover, any differences were inconsistent across harvest-times and during shelf life. Thus, organically and conventionally grown product had almost identical qualities. Sensory comparison confirmed that there was no flavour difference. This case study provides data that challenge a general perception that organic bananas have better flavour than conventional bananas.

Audit of consultant physicians' reply letters for referrals to clinics in a tertiary teaching hospital

Background: Doctors referring patients to consultant physicians seek reply letters which both educate and assist in ongoing patient management. Highly desirable attributes in specialist letters include clearly stated and justified: (i) diagnostic formulations, (ii) management regimens, (iii) use of clinical investigations, (iv) prog-nostic statements, (v) contingency plans and (vi) follow-up arrangements. Aim: To explicitly evaluate the quality of reply letters for new patients referred to clinics at a tertiary teaching hospital. Methods: Letters were sampled from outpatient clinics of 10 different medical specialties at Princess Alexandra Hospital in Brisbane, Australia. Reply letters for new patient referrals between 1 August 2000 and 31 October 2000 were retrieved, from which data were abstracted to calculate the proportion of letters satisfying prespecified quality attributes. Results: Of 297 new patient referrals, reply letters were retrieved for 204 (69%). Of these, 147 (72%) referrals were accompanied by a referral letter, mostly (113/147; 77%) from general practitioners. For 120 referrals involving diagnostic issues, 69 (56%) letters stated a diagnostic formulation. Of 114 letters recommending further clinical investigations, 61 (53%) described a rationale for such testing. In 125 cases where therapy was a key issue, 83 (66%) letters recommended changes to current treatment for which reasons were specified in 46 (55%) cases, and contingency plans provided in 13 (16%). Prognosis was mentioned in only 18 (9%) cases. Follow-up arrangements were detailed in 123 (60%) letters. Assessments of patient understanding and likely adherence to therapy were stated in less than 15% of -letters. Conclusions: Opportunities exist for improving quality of consultant physicians' reply letters in terms of greater use of problem lists, contingency plans, prognostic statements and patient-centred assessments, as well as more frequent enunciation of consultants' reasoning behind requests for further tests and changes to current management. Use of structured letter templates may facilitate more consistent inclusion of key information to referring doctors.

Evaluating the impact of institutional logic on the corporate Internet reporting by Egyptian listed companies

This study explores the institutional logic(s) governing the Corporate Internet Reporting (CIR) by Egyptian listed companies. In doing so, a mixed methods approach was followed. The qualitative part seeks to understand the perceptions, believes, values, norms, that are commonly shared by Egyptian companies which engaged in these practices. Consequently, seven cases of large listed Egyptian companies operating in different industries have been examined. Other stakeholders and stockholders have been interviewed in conjunction with these cases. The quantitative part consists of two studies. The first one is descriptive aiming to specify whether the induced logic(s) from the seven cases are commonly embraced by other Egyptian companies. The second study is explanatory aiming to investigate the impact of several institutional and economic factors on the extent of CIR, types of the online information, quality of the websites as well as the Internet facilities. Drawing on prior CIR literature, four potential types of logics could be inferred: efficiency, legitimacy, technical and marketing based logics. In Egypt, legitimacy logic was initially embraced in the earlier years after the Internet inception. latter, companies confronted radical challenges in their internal and external environments which impelled them to raise their websites potentialities to defend their competitive position; either domestically or internationally. Thus, two new logics emphasizing marketing and technical perspectives have emerged, in response. Strikingly, efficiency based logic is not the most prevalent logic driving CIR practices in Egypt as in the developed countries. The empirical results support this observation and show that almost half of Egyptian listed companies 115 as on December 2010 possessed an active website, half of them 62 disclosed part of their financial and accounting information, during December 2010 to February 2011. Less than half of the websites 52 offered latest annual financial statements. Fewer 33(29%) websites provided shareholders and stock information or included a separate section for corporate governance 25 (22%) compared to 50 (44%) possessing a section for news or press releases. Additionally, the variations in CIR practices, as well as timeliness and credibility were also evident even at industrial level. After controlling for firm size, profitability, leverage, liquidity, competition and growth, it was realized that industrial companies and those facing little competition tend to disclose less. In contrast, management size, foreign investors, foreign listing, dispersion of shareholders and firm size provided significant and positive impact individually or collectively. In contrast, neither audit firm, nor most of performance indicators (i.e. profitability, leverage, and liquidity) did exert an influence on the CIR practices. Thus, it is suggested that CIR practices are loosely institutionalised in Egypt, which necessitates issuing several regulative and processional rules to raise the quality attributes of Egyptian websites, especially, timeliness and credibility. Beside, this study highlights the potency of assessing the impact of institutional logic on CIR practices and suggests paying equal attention to the institutional and economic factors when comparing the CIR practices over time or across different institutional environments in the future.

Assessing aviation e-marketplaces:a multi-criteria approach

After a proliferation of logistics e-Marketplaces during the dot.com boom of 1998-2000, there has been a high rate of failure and survivals are developing much more slowly than expected. This is the case in the aviation industry where a large number of B2B e-Marketplaces emerged according to the focus of aviation companies’ strategies on electronic B2B in the late 1990s. However, the current use of e-Marketplaces in the industry is low and many of them have ceased trading. The traditional e-Marketplaces model has been characterised by poor quality portals and a lack of technical standards. Such an approach is unsustainable in today’s competitive scenario. Improvements in website quality attributes may strongly contribute to the simplification of website functionality by users and speed up communication with all supply chain partners. In this context, it appears critical to develop models for the evaluation of e-Marketplace web sites. This chapter, after a discussion about the development of e-Marketplaces in the transport and logistics service industry and its application in the aviation industry, proposes a multi-criteria model for assessing different types of aeronautic B2B e-Marketplaces.

Agitation conditions for the culture and detachment of hMSCs from microcarriers in multiple bioreactor platforms

In our recent work in different bioreactors up to 2.5L in scale, we have successfully cultured hMSCs using the minimum agitator speed required for complete microcarrier suspension, N JS. In addition, we also reported a scaleable protocol for the detachment from microcarriers in spinner flasks of hMSCs from two donors. The essence of the protocol is the use of a short period of intense agitation in the presence of enzymes such that the cells are detached; but once detachment is achieved, the cells are smaller than the Kolmogorov scale of turbulence and hence not damaged. Here, the same approach has been effective for culture at N JS and detachment in-situ in 15mL ambr™ bioreactors, 100mL spinner flasks and 250mL Dasgip bioreactors. In these experiments, cells from four different donors were used along with two types of microcarrier with and without surface coatings (two types), four different enzymes and three different growth media (with and without serum), a total of 22 different combinations. In all cases after detachment, the cells were shown to retain their desired quality attributes and were able to proliferate. This agitation strategy with respect to culture and harvest therefore offers a sound basis for a wide range of scales of operation.

Análise estratégica das Instituições de Ensino Superior privadas da cidade do Natal

Private Higher Education Institutions are embedded in a market where competitiveness is a key factor. To remain competitive, HEIs needs to have proactive and innovative strategies, especially to understand their main customers, students, with regard to their expectations about the quality of HEI. This study is to evaluate the overall private institutions of higher education in the city of Natal / RN, as the strategies adopted to remain on the market , based on the perceived quality of students. For conduct this research, it has developed two private institutions in the city of Natal, through the application using exploratory research to guide the survey for data collection with questionnaire to apply the overview with students, being directed to senior students courses in Bussiness, Accounting and Law. This research tool addresses aspects relevant to map the dimensions: (1) teaching, perspectives related to methods and teaching tools; ( 2 ) teachers, specifies the quality attributes related to teachers; (3 ) Infrastructure, describes the environment of the HEI; ( 4 ) services , evaluates the quality processes that attach to the HEI; and ( 5 ) intangible relates aspects with student satisfaction. The results were analyzed using descriptive statistical techniques using the Statistical Package Tool for Social Sciences (SPSS). The first stage of results characterizes the descriptive analysis of the overall sample and by HEI and course, plus a build univariate analysis of the HEI and also bivariate analysis shows that correlation of the factors through Spearman correlation coefficient. The results were used to compose a matrix of importance versus performance that compare with the contents of the Ministry of Education and Culture (MEC). Finally, these comparisons allowed identification of the most important factors for the quality of the HEI and the level of performance from institutions in the development of each attributes of quality dimensions.

An automated approach for performance deviation analysis of evolving software systems

A manutenção e evolução de sistemas de software tornou-se uma tarefa bastante crítica ao longo dos últimos anos devido à diversidade e alta demanda de funcionalidades, dispositivos e usuários. Entender e analisar como novas mudanças impactam os atributos de qualidade da arquitetura de tais sistemas é um pré-requisito essencial para evitar a deterioração de sua qualidade durante sua evolução. Esta tese propõe uma abordagem automatizada para a análise de variação do atributo de qualidade de desempenho em termos de tempo de execução (tempo de resposta). Ela é implementada por um framework que adota técnicas de análise dinâmica e mineração de repositório de software para fornecer uma forma automatizada de revelar fontes potenciais – commits e issues – de variação de desempenho em cenários durante a evolução de sistemas de software. A abordagem define quatro fases: (i) preparação – escolher os cenários e preparar os releases alvos; (ii) análise dinâmica – determinar o desempenho de cenários e métodos calculando seus tempos de execução; (iii) análise de variação – processar e comparar os resultados da análise dinâmica para releases diferentes; e (iv) mineração de repositório – identificar issues e commits associados com a variação de desempenho detectada. Estudos empíricos foram realizados para avaliar a abordagem de diferentes perspectivas. Um estudo exploratório analisou a viabilidade de se aplicar a abordagem em sistemas de diferentes domínios para identificar automaticamente elementos de código fonte com variação de desempenho e as mudanças que afetaram tais elementos durante uma evolução. Esse estudo analisou três sistemas: (i) SIGAA – um sistema web para gerência acadêmica; (ii) ArgoUML – uma ferramenta de modelagem UML; e (iii) Netty – um framework para aplicações de rede. Outro estudo realizou uma análise evolucionária ao aplicar a abordagem em múltiplos releases do Netty, e dos frameworks web Wicket e Jetty. Nesse estudo foram analisados 21 releases (sete de cada sistema), totalizando 57 cenários. Em resumo, foram encontrados 14 cenários com variação significante de desempenho para Netty, 13 para Wicket e 9 para Jetty. Adicionalmente, foi obtido feedback de oito desenvolvedores desses sistemas através de um formulário online. Finalmente, no último estudo, um modelo de regressão para desempenho foi desenvolvido visando indicar propriedades de commits que são mais prováveis a causar degradação de desempenho. No geral, 997 commits foram minerados, sendo 103 recuperados de elementos de código fonte degradados e 19 de otimizados, enquanto 875 não tiveram impacto no tempo de execução. O número de dias antes de disponibilizar o release e o dia da semana se mostraram como as variáveis mais relevantes dos commits que degradam desempenho no nosso modelo. A área de característica de operação do receptor (ROC – Receiver Operating Characteristic) do modelo de regressão é 60%, o que significa que usar o modelo para decidir se um commit causará degradação ou não é 10% melhor do que uma decisão aleatória.