A review of project evaluation methodologies to address net impacts and risks of toll road projects to the community

Project evaluation is a process of measuring costs, benefits, risks and uncertainties for the purpose of decision-making by estimating and assessing impacts of the project to the community. The effects of impacts of toll roads are similar but different from the general non-tolled roads. Project evaluation methodologies are extensively studied and applied to various transport infrastructure projects. However, there is no definitive methodology to evaluate toll roads. This review discusses the impacts of toll roads then reviews the limitations of existing project evaluation methodologies when evaluating toll road impacts. The review identified gaps of knowledge of toll evaluations. First, the treatment of toll in project evaluation, particularly in Cost-Benefit Analysis requires further study to explore the appropriate methodology. Secondly, the project evaluation methodology needs to place strong emphasis on empirically based risk and uncertainty assessment. Addressing the limitations of the existing project evaluation methodologies leads to improvements of the methodology in practical level as well as fills the gap of knowledge of project evaluation for toll roads with respect to net impacts to the community.

A review of project evaluation methodologies for toll road projects

Project evaluation is a process of measuring costs, benefits, risks and uncertainties for the purpose of decision-making by estimating and assessing impacts of the project to the community. The effects of impacts of toll roads are similar but different from the general non-tolled roads. Project evaluation methodologies are extensively studied and applied to various transport infrastructure projects. However, there is no definitive methodology to evaluate toll roads. This review discusses the impacts of toll roads then reviews the limitations of existing project evaluation methodologies when evaluating toll road impacts. The review identified gaps of knowledge of toll evaluations. First, the treatment of toll in project evaluation, particularly in Cost-Benefit Analysis requires further study to explore the appropriate methodology. Secondly, the project evaluation methodology needs to place strong emphasis on empirically based risk and uncertainty assessment. Addressing the limitations of the existing project evaluation methodologies leads to improvements of the methodology in practical level as well as fills the gap of knowledge of project evaluation for toll roads with respect to net impacts to the community.

Usefulness of DARPA dataset for intrusion detection system evaluation

The MIT Lincoln Laboratory IDS evaluation methodology is a practical solution in terms of evaluating the performance of Intrusion Detection Systems, which has contributed tremendously to the research progress in that field. The DARPA IDS evaluation dataset has been criticized and considered by many as a very outdated dataset, unable to accommodate the latest trend in attacks. Then naturally the question arises as to whether the detection systems have improved beyond detecting these old level of attacks. If not, is it worth thinking of this dataset as obsolete? The paper presented here tries to provide supporting facts for the use of the DARPA IDS evaluation dataset. The two commonly used signature-based IDSs, Snort and Cisco IDS, and two anomaly detectors, the PHAD and the ALAD, are made use of for this evaluation purpose and the results support the usefulness of DARPA dataset for IDS evaluation.

Blood pressure evaluation using sphygmomanometry assisted by arterial pulse waveform detection by fiber Bragg grating pulse device

We report a blood pressure evaluation methodology by recording the radial arterial pulse waveform in real time using a fiber Bragg grating pulse device (FBGPD). Here, the pressure responses of the arterial pulse in the form of beat-to-beat pulse amplitude and arterial diametrical variations are monitored. Particularly, the unique signatures of pulse pressure variations have been recorded in the arterial pulse waveform, which indicate the systolic and diastolic blood pressure while the patient is subjected to the sphygmomanometric blood pressure examination. The proposed method of blood pressure evaluation using FBGPD has been validated with the auscultatory method of detecting the acoustic pulses (Korotkoff sounds) by an electronic stethoscope. (C) 2013 Society of Photo-Optical Instrumentation Engineers (SPIE)

Formalised peer mentoring pilot evaluation

Over the past ten years, mentoring of children and young people has become an increasingly important feature of social policy in the UK. This has been mirrored in the rapid growth in the number of mentoring schemes operating. However, it is widely acknowledged that no one single definition or model of mentoring exists; rather there are a number of different models providing support to young people in a range of settings. This research was undertaken during the autumn term of 2006 and the summer term of 2007. The methodology comprised an analysis of mentoring models in the 180 participating schools; questionnaires sent to all co-ordinators and to mentors/proteges in 40 schools; interviews with co-ordinators, pupils and support agents in 8 case study schools. Includes: •Introduction •Evaluation methodology •Analysis of school pilot application forms •Evaluation results •Conclusions •Recommendations •Bibliography •Appendices

D8.1 - RAGE Evaluation Framework and Guidelines

This document presents the RAGE evaluation methodology. It provides the framework and accompanying guidelines for the evaluation and validation of the quality and effectiveness of the project outputs. Formative and summative evaluations of the different RAGE technologies and their underlying methodologies – the assets, the Ecosystem, and the applied games – will be carried out on the basis of this common framework.

Participação ativa no desenvolvimento de comunidades online

Esta tese tem como objetivos identificar e caraterizar os modos de Comunicação Mediada por Computador (CMC) utilizados nas Comunidades Online (CO), relevantes para a prática de criação visual, contextualizando-os na produção de Type Design (TD). E concetualizar um modelo de CO de prática, desenvolvida segundo uma metodologia participativa, avaliando as estratégias de dinamização e viabilização no contexto nacional. Atualmente, com a disseminação das tecnologias de informação e comunicação a prática de TD, uma atividade isolada e individual, está sujeita a um paradigma de mudança—tornar-se uma atividade de partilha cada vez maior. A investigação dividiu-se em três fases. Na primeira fase procura perceber os modos relevantes de CMC para a prática de TD. Para isso, observa-se as motivações e comportamentos dos utilizadores nestas plataformas, apoiado pela recolha de dados sobre o uso destas plataformas no contexto académico. Juntamente com o desenvolvimento e avaliação de uma experiência preliminar numa plataforma online existente. Na segunda fase, apresenta-se o modelo concetual de uma CO para a produção de TD apoiado na identificação e caraterização das Virtual Community of Practice de TD existentes. E o respetivo desenvolvimento e implementação de um protótipo funcional. Na terceira fase o protótipo foi avaliado recorrendo à participação dos utilizadores—uma amostra de Type Designers profissionais portugueses—no desenvolvimento das estratégias comunitárias segundo uma abordagem participativa de Community-Centered Development. A utilização de um Focus Group de dimensões reduzidas, e as limitações temporais da investigação prática não permitem generalizar os resultados encontrados. No entanto, os resultados revelam que quanto mais específica for a atividade da prática partilhada na CO, mais especializados e restritos devem ser os modos de CMC implementados para a comunicação e interação dos membros online. A integração dos modos de CMC sobre a comunicação assíncrona através de artefactos visuais tem um potencial de comunicação mais eficaz e satisfatório para estes utilizadores. E as barreiras à participação, apesar de poderem ser minimizadas através da inovação nos modos implementados, são um desafio de sociabilização que devem ser geridos, equilibrando a comunicação explícita, os usos, perceções e expectativas dos diferentes papéis dos membros da comunidade.

Agricultura urbana en Bogotá. Una evaluación externa-participativa.

En la última década, uno de los problemas considerados más relevantes de la política pública colombiana es la Seguridad Alimentaria y Nutricional, que contempla no sólo la disponibilidad y el acceso a los alimentos, sino también la utilización y estabilidad (disponibilidad continua) de alimentos sanos, limpios e inocuos para el consumo humano. En este marco, el gobierno de Garzón dio inicio política pública “Bogotá sin indiferencia”, junto con el programa “Bogotá sin Hambre”, que pretendía a través de diversos proyectos garantizar el derecho a la alimentación de la población de escasos recursos; uno de ellos es el proyecto 319 de Agricultura Urbana, el cual presenta continuidad hasta el momento. La presente investigación, realiza una evaluación externa y participativa al proyecto, desentrañando a través de la metodología del marco lógico, los objetivos y metas de dicho proyecto, para seguidamente evaluarlo apoyándose en la propuesta de Cohen y Franco (1992) y García y Ramírez (1994); bajo el supuesto de que su sostenibilidad depende del tipo de huerta, del apoyo institucional y del empoderamiento de los beneficiarios. Desde la mirada de los beneficiarios, se adelantó la evaluación de tres Estudios de Caso que permitieron desvelar los principios que regulan la política pública, las dificultades y problemas estructurales existentes a la misma.

Codification vs personalisation: A study of the information evaluation practice between aerospace and construction industries

In the emerging digital economy, the management of information in aerospace and construction organisations is facing a particular challenge due to the ever-increasing volume of information and the extensive use of information and communication technologies (ICTs). This paper addresses the problems of information overload and the value of information in both industries by providing some cross-disciplinary insights. In particular it identifies major issues and challenges in the current information evaluation practice in these two industries. Interviews were conducted to get a spectrum of industrial perspectives (director/strategic, project management and ICT/document management) on these issues in particular to information storage and retrieval strategies and the contrasting approaches to knowledge and information management of personalisation and codification. Industry feedback was collected by a follow-up workshop to strengthen the findings of the research. An information-handling agenda is outlined for the development of a future Information Evaluation Methodology (IEM) which could facilitate the practice of the codification of high-value information in order to support through-life knowledge and information management (K&IM) practice.

Knowledge and information evaluation practice: an exploratory study in a construction firm

There are a number of challenges associated with managing knowledge and information in construction organizations delivering major capital assets. These include the ever-increasing volumes of information, losing people because of retirement or competitors, the continuously changing nature of information, lack of methods on eliciting useful knowledge, development of new information technologies and changes in management and innovation practices. Existing tools and methodologies for valuing intangible assets in fields such as engineering, project management and financial, accounting, do not address fully the issues associated with the valuation of information and knowledge. Information is rarely recorded in a way that a document can be valued, when either produced or subsequently retrieved and re-used. In addition there is a wealth of tacit personal knowledge which, if codified into documentary information, may prove to be very valuable to operators of the finished asset or future designers. This paper addresses the problem of information overload and identifies the differences between data, information and knowledge. An exploratory study was conducted with a leading construction consultant examining three perspectives (business, project management and document management) by structured interviews and specifically how to value information in practical terms. Major challenges in information management are identified. An through-life Information Evaluation methodology (IEM) is presented to reduce information overload and to make the information more valuable in the future.

Mid-term evaluation of African Technology Policy Studies Network Phase VI Strategic Plan: for the period January 1, 2009 to December 31, 2010

The African Technology Policy Studies Network (ATPS) is a multidisciplinary network of researchers, private sector actors, policymakers and civil society. ATPS has the vision to become the leading international centre of excellence and reference in science, technology and innovation (STI) systems research, training and capacity building, communication and sensitization, knowledge brokerage, policy advocacy and outreach in Africa. It has a Regional Secretariat in Nairobi Kenya, and operates through national chapters in 29 countries (including 27 in Africa and two Chapters in the United Kingdom and USA for Africans in the Diaspora) with an expansion plan to cover the entire continent by 2015. The ATPS Phase VI Strategic Plan aims to improve the understanding and functioning of STI processes and systems to strengthen the learning capacity, social responses, and governance of STI for addressing Africa's development challenges, with a specific focus on the Millennium Development Goals (MDGs). A team of external evaluators carried out a midterm review to assess the effectiveness and efficiency of the implementation of the Strategic Plan for the period January 1, 2009 to December 31, 2010. The evaluation methodology involved multiple quantitative and qualitative methods to assess the qualitative and quantitative inputs (human resources, financial resources, time, etc.) into ATPS activities (both thematic and facilitative) and their tangible and intangible outputs, outcomes and impacts. Methods included a questionnaire survey of ATPS members and stakeholders, key informant interviews, and focus group discussions (FGDs) with members in six countries. Effectiveness of Programmes Under all six strategic goals, very good progress has been made towards planned outputs and outcomes. This is evidenced by key performance indicators (KPIs) generated from desk review, ratings from the survey respondents, and the themes that run through the FGDs. Institutional and Programme Cost Effectiveness Institutional Effectiveness: assessment of institutional effectiveness suggests that adequate management frameworks are in place and are being used effectively and transparently. Also technical and financial accounting mechanisms are being followed in accordance with grant agreements and with global good practice. This is evidenced by KPIs generated from desk review. Programme Cost Effectiveness: assessment of cost-effectiveness of execution of programmes shows that organisational structure is efficient, delivering high quality, relevant research at relatively low cost by international standards. The evidence includes KPIs from desk review: administrative costs to programme cost ratio has fallen steadily, to around 10%; average size of research grants is modest, without compromising quality. There is high level of pro bono input by ATPS members. ATPS Programmes Strategic Evaluation ATPS research and STI related activities are indeed unique and well aligned with STI issues and needs facing Africa and globally. The multi-disciplinary and trans-boundary nature of the research activities are creating a unique group of research scientists. The ATPS approach to research and STI issues is paving the way for the so called Third Generation University (3GU). Understanding this unique positioning, an increasing number of international multilateral agencies are seeking partnership with ATPS. ATPS is seeing an increasing level of funding commitments by Donor Partners. Recommendations for ATPS Continued Growth and Effectiveness On-going reform of ATPS administrative structure to continue The on-going reforms that have taken place within the Board, Regional Secretariat, and at the National Chapter coordination levels are welcomed. Such reform should continue until fully functional corporate governance policy and practices are fully established and implemented across the ATPS governance structures. This will further strengthen ATPS to achieve the vision of being the leading STI policy brokerage organization in Africa. Although training in corporate governance has been carried out for all sectors of ATPS leadership structure in recent time, there is some evidence that these systems have not yet been fully implemented effectively within all the governance structures of the organization, especially at the Board and National chapter levels. Future training should emphasize practical application with exercises relevant to ATPS leadership structure from the Board to the National Chapter levels. Training on Transformational Leadership - Leading a Change Though a subject of intense debate amongst economists and social scientists, it is generally agreed that cultural mindsets and attitudes could enhance and/or hinder organizational progress. ATPS’s vision demands transformational leadership skills amongst its leaders from the Board members to the National Chapter Coordinators. To lead such a change, ATPS leaders must understand and avoid personal and cultural mindsets and value systems that hinder change, while embracing those that enhance it. It requires deliberate assessment of cultural, behavioural patterns that could hinder progress and the willingness to be recast into cultural and personal habits that make for progress. Improvement of relationship amongst the Board, Secretariat, and National Chapters A large number of ATPS members and stakeholders feel they do not have effective communications and/or access to Board, National Chapter Coordinators and Regional Secretariat activities. Effort should be made to improve the implementation of ATPS communication strategy to improve on information flows amongst the ATPS management and the members. The results of the survey and the FGDs suggest that progress has been made during the past two years in this direction, but more could be done to ensure effective flow of pertinent information to members following ATPS communications channels. Strategies for Increased Funding for National Chapters There is a big gap between the fundraising skills of the Regional Secretariat and those of the National Coordinators. In some cases, funds successfully raised by the Secretariat and disbursed to national chapters were not followed up with timely progress and financial reports by some national chapters. Adequate training in relevant skills required for effective interactions with STI key policy players should be conducted regularly for National Chapter coordinators and ATPS members. The ongoing training in grant writing should continue and be made continent-wide if funding permits. Funding of National Chapters should be strategic such that capacity in a specific area of research is built which, with time, will not only lead to a strong research capacity in that area, but also strengthen academic programmes. For example, a strong climate change programme is emerging at University of Nigeria Nsukka (UNN), with strong collaborations with Universities from neighbouring States. Strategies to Increase National Government buy-in and support for STI Translating STI research outcomes into policies requires a great deal of emotional intelligence, skills which are often lacking in the first and second generation universities. In the epoch of the science-based or 2GUs, governments were content with universities carrying out scientific research and providing scientific education. Now they desire to see universities as incubators of new science- or technology-based commercial activities, whether by existing firms or start-ups. Hence, governments demand that universities take an active and leading role in the exploitation of their knowledge and they are willing to make funds available to support such activities. Thus, for universities to gain the attention of national leadership they must become centres of excellence and explicit instruments of economic development in the knowledge-based economy. The universities must do this while working collaboratively with government departments, parastatals, and institutions and dedicated research establishments. ATPS should anticipate these shifting changes and devise programmes to assist both government and universities to relate effectively. New administrative structures in member organizations to sustain and manage the emerging STI multidisciplinary teams Second Generation universities (2GUs) tend to focus on pure science and often do not regard the application of their know-how as their task. In contrast, Third Generation Universities (3GUs) objectively stimulate techno-starters – students or academics – to pursue the exploitation or commercialisation of the knowledge they generate. They view this as being equal in importance to the objectives of scientific research and education. Administratively, research in the 2GU era was mainly monodisciplinary and departments were structured along disciplines. The emerging interdisciplinary scientific teams with focus on specific research areas functionally work against the current mono-disciplinary faculty-based, administrative structure of 2GUs. For interdisciplinary teams, the current faculty system is an obstacle. There is a need for new organisational forms for university management that can create responsibilities for the task of know-how exploitation. ATPS must anticipate this and begin to strategize solutions for their member institutions to transition to 3Gus administrative structure, otherwise ATPS growth will plateau, and progress achieved so far may be stunted.

Economic experiments used for the evaluation of building users’ energy-saving behavior

Different treatments that could be implemented in the home environ-ment are evaluated with the objective of reaching a more rational and efficient use of energy. We consider that a detailed knowledge of energy-consuming behaviour is paramount for the development and implementation of new technologies, services and even policies that could result in more rational energy use. The proposed evaluation methodology is based on the development of economic experiments implemented in an experimental economics laboratory, where the behaviour of individuals when making decisions related to energy use in the domestic environment can be tested.

Evaluation of marginal microleakage in Class II cavities: Effect of microhybrid, flowable, and compactable resins

Objective: The goal of the present study was to evaluate the microleakage on the cementum/dentin and enamel surfaces in Class II restorations, using different kinds of resin composite (microhybrid, flowable, and compactable). Method and materials: Forty human caries-free molars were extracted and selected. Eighty Class II standardized cavities were made in the cervical wall at the cementoenamel junction (CEJ) and at the mesial and distal surfaces. The teeth were divided into four groups: G1 - adhesive system + microhybrid resin composite Z100; G2 - adhesive system + compactable resin composite Prodigy Condensable; G3 - adhesive system + flowable resin composite Revolution + Z100 resin composite; G4 - adhesive system + Revolution fluid resin + compactable resin composite Prodigy Condensable. The adhesive system used in this study was Scotchbond Multi-Purpose Plus. The specimens were thermocycled in baths of 5°C and 55°C for 1,000 cycles and immersed in 50% silver nitrate solution. The specimens then were sectioned and evaluated on degree of dye penetration. Results: The results were evaluated using the nonparametric Kruskall-Wallis test, which showed a statistically significant difference between groups G1 and G4, G2 and G4, and G3 and G4. Conclusions: None of the materials was able to eliminate the marginal microleakage at the cervical wall; the application of a low-viscosity resin composite combined with a compactable resin composite significantly decreased the microleakage.

Adhesion between fiber post and root dentin: evaluation of post surface conditioning for bond strength improvement.

The aim of this paper was to evaluate two surface conditioning methods associated with the application of adhesive on the post surface for improving the bond to resin cement. Sixty single-rooted bovine teeth were sectioned at 16 mm in length, prepared (9 mm depth), embedded in a PVC cylinder using acrylic resin, and allocated into 3 groups (N.=20) according to post surface treatment: cleaning with ethanol (control group); etching with hydrogen peroxide; etching with hydrofluoric acid. Ten posts for each group were silanized and other 10 posts were silanized and received an adhesive agent. The posts were cemented with self-adhesive resin cement (RelyX U100 resin cement). All teeth were sectioned perpendicularly to the long axis (2 mm thickness per slice), submitted to push out bond strength testing and the type of failure was recorded. The obtained data were submitted to two-way ANOVA and Turkey's test, with the level of significance set at 5%. Neither the hydrofluoric acid or hydrogen peroxide post surface treatment, nor the adhesive application, had an influence on bond strength values. The main type of failure was adhesive between cement and dentin. Etching and the application of an adhesive on the post surface did not presented a significant influence on the bond strength results for the fiber post resin cement-root dentin assembly. The cement appears to adhere very well to the fiber post surface rather than the dentin surface.

Can prospective usability evaluation predict data errors?

Increasing amounts of clinical research data are collected by manual data entry into electronic source systems and directly from research subjects. For this manual entered source data, common methods of data cleaning such as post-entry identification and resolution of discrepancies and double data entry are not feasible. However data accuracy rates achieved without these mechanisms may be higher than desired for a particular research use. We evaluated a heuristic usability method for utility as a tool to independently and prospectively identify data collection form questions associated with data errors. The method evaluated had a promising sensitivity of 64% and a specificity of 67%. The method was used as described in the literature for usability with no further adaptations or specialization for predicting data errors. We conclude that usability evaluation methodology should be further investigated for use in data quality assurance.