Ownership structure and business evaluation practices in family SMEs : evidence from empirical research in Italy

This paper presents early results from a pilot project which aims to investigate the relationship between proprietary structure of small and medium- sized Italian family firms and their owners’ orientation towards a “business evaluation process”. Evidence from many studies point out the importance of family business in a worldwide economic environment: in Italy 93% of the businesses are represented by family firms; 98% of them have less than 50 employees (Italian Association of Family Firms, 2004) so we judged family SMEs as a relevant field of investigation. In this study we assume a broad definition of family business as “a firm whose control (50% of shares or voting rights) is closely held by the members of the same family” (Corbetta,1995). “Business evaluation process” is intended here both as “continuous evaluation process” (which is the expression of a well developed managerial attitude) or as an “immediate valuation” (i.e. in the case of new shareholder’s entrance, share exchange among siblings, etc). We set two hypotheses to be tested in this paper: the first is “quantitative” and aims to verify whether the number of owners (independent variable) in a family firm is positively correlated to the business evaluation process. If a family firm is led by only one subject, it is more likely that personal values, culture and feelings may affect his choices more than “purely economic opportunities”; so there is less concern about monitoring economic performance or about the economic value of the firm. As the shareholders’ number increases, economic aspects in managing the firm grow in importance over the personal values and "value orientation" acquires a central role. The second hypothesis investigates if and to what extent the presence of “non- family members” among the owners affects their orientation to the business evaluation process. The “Cramer’s V” test has been used to test the hypotheses; both were not confirmed from these early results; next steps will lead to make an inferential analysis on a representative sample of the population.

Evaluation practices in participatory arts in international development: findings of a systematic literature review

Participatory arts initiatives are increasingly used in development contexts to contribute to desired outcomes. This chapter explores evaluation practices employed in such initiatives, drawing from a systematic review of 151 articles on arts in development. Findings indicate that evaluation is undertaken infrequently, with only 23 of those articles including, or primarily consisting of, evaluations. Qualitative methodologies were most prevalent, with fewer mixed methods and quantitative studies. Claims about outcomes were ubiquitous, but evidence of theories of change or systematic data analysis to support these assertions was not strong overall. The chapter concludes with recommendations for more effective arts in development work through stronger evaluation practice.

Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

REFRAME : a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

REFRAME: a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

Exploring the Possibilities and Methodological Challenges of Evaluation Practice : A Democratic Question

In our exploration of the methodological possibilities and challenges of evaluation practice that foregrounds a democratic approach, we argue that having sensitivity to participants’ different positions, ideological perspectives, and values, and an understanding of the existing power relationships are paramount for the evaluators if the evaluation is to achieve its goals. This chapter draws on our experiences as evaluators in Australia, where school leaders and teachers are currently experiencing significant curriculum and assessment changes, and now work in a context of heightened accountability. Our evaluation practices with schools are used to illustrate how democratic practices can be incorporated into evaluation in ways that provide opportunities and support for school self-evaluation. It is paramount to recognise that evaluation is a political and ideological practice, and therefore is not a neutral process. Our argument is that it remains the responsibility of evaluators to design spaces that build sustainable relationships with participants and the targets of the programmes being evaluated; ensure that dialogue and deliberation are valued between all stakeholders; represent a range of interests; and give a service back to the evaluated communities by offering understandings and promoting reflective practice and informed decision-making throughout programme implementation.

Facilitating local stories in post-disaster regional communities : evaluation in narrative-driven oral history projects

Cyclone Yasi struck the Cassowary Coast of Northern Queensland, Australia, in the early hours of February 3, 2011, destroying many homes and property, including the destruction of the Cardwell and district historical society’s premises. With their own homes flattened, many residents were forced to live in mobile accommodation, with extended family, or leave the area altogether. The historical society members seemed, however, particularly devastated by their flattened foreshore museum and loss of their precious collection of material. A call for assistance was made through the Oral History Association of Australia’s Queensland branch (OHAA Qld), which along with a Queensland University of Technology (QUT) research team sponsored a trip to best plan how they could start to pick up the pieces to rebuild the museum. This chapter highlights the need for communities to gather, preserve and present their own stories, in a way that is sustainable and meaningful to them – whether that be because of a disaster, or as they go about life in their contemporary communities – the key being that good advice, professional support and embedded evaluation practices at crucial moments along the way can be critically important.

Evaluation system in the European Commission : DEVCO’S evaluation methodology

Mestrado em Economia e Políticas Públicas

Accommodating College ESL Learner Communication Needs: Perceptions, Policies, and Practices

The purpose of this qualitative inquiry was to determine how the Practical Nursing and Pharmacy Technician programs in one southern Ontario community college could more effectively accommodate ESL learners' communication needs. The literature review examined (a) linguistic issues, such as language testing and second-language learning theories, (b) organizational matters, such as ESL curriculum and teacher training, and (c) affective issues, such as motivation for second-language learning, learning styles, and the student-teacher relationship. I gathered perceptual data from the programs' administrators, faculty members, and ESL learners. Eleven participants took part in individual interviews or a focus group session. The results suggest that ESL learners need assistance with discipline-specific vocabulary and cultural nuances. College ESL learners' weak communicative competence, together with misleading acceptance standards for ESL learners and limited support available to faculty members and to students, decrease opportunities for successful completion of the programs. The results point to re-assessment of the college's admission policies and procedures, program evaluation practices that consider the needs of ESL learners, discipline-specific language support, and strategies to enhance the ESL student-teacher relationship. The study highlights theory relating to ESL learners' self-perception and engagement, as well as the importance of including the voice of college ESL learners in educational research. The results suggest that despite ESL learners' perseverance in completing their studies, power imbalances remain. The college has yet to implement organizational strategies such as discipline-specific communications and ESL courses and extended language support that could meet the communication needs of ESL learners in the two programs.

Beyond satisfaction surveys: the development of an evaluation process for a postgraduate transferable skills program

Leadership, professional and other transferable skills are embedded in the expected attributes of Australian research postgraduates at the successful completion of their degrees. This paper reports on the development of an evaluation process for a postgraduate transferable skills program at The University of Melbourne, Australia. Existing and emerging evaluation practices and processes are examined in light of the literature on what constitutes 'good' evaluation of the type of program under consideration. The development of the process to go beyond the commonly used participant satisfaction surveys and to improve evaluation practices is described in detail. The results of the evaluation to date are provided and discussed in terms of their usefulness in incorporating particular improvements to the program. The implications for the evaluation of other programs of this type are considered.

Theorizing accounting and other [calculative] practices in private equity:Experimenting with Schatzki’s ‘site’ ontology

This thesis contributes to social studies of finance and accounting (Vollmer, Mennicken, & Preda, 2009) and the practice theory literatures (Feldman & Orlikowski, 2011) by experimenting (Baxter & Chua, 2008) with concepts developed by Theodore Schatzki and demonstrating their relevance and usefulness in theorizing and explaining accounting and other organizational phenomena. Influenced by Schatzki, I have undertaken a sociological investigation of the practices, arrangements, and nexuses forming (part of) the social ‘site’ of private equity (PE). I have examined and explained the organization of practices within the PE industry. More specifically, I have sought to throw light on the practice organizations animating various PE practices. I have problematized a particular aspect of Schatzki’s practice organization framework: ‘general understanding’, which has so far been poorly understood and taken for granted in the accounting literature. I have tried to further explore the concept to clarify important definitional issues surrounding its empirical application. In investigating the forms of accounting and control practices in PE firms and how they link with other practices forming part of the ‘site’, I have sought to explain how the ‘situated functionality’ of accounting is ‘prefigured’ by its ‘dispersed’ nature. In doing so, this thesis addresses the recent calls for research on accounting and control practices within financial services firms. This thesis contributes to the social studies of finance and accounting literature also by opening the blackbox of investment [e]valuation practices prevalent in the PE industry. I theorize the due diligence of PE funds as a complex of linked calculative practices and bring to fore the important aspects of ‘practical intelligibility’ of the investment professionals undertaking investment evaluation. I also identify and differentiate the ‘causal’ and ‘prefigurational’ relations between investment evaluation practices and the material entities ‘constituting’ those practices. Moreover, I demonstrate the role of practice memory in those practices. Finally, the thesis also contributes to the practice theory literature by identifying and attempting to clarify and/or improve the poorly defined and/or underdeveloped concepts of Schatzki’s ‘site’ ontology framework.

TEACHNJ: An Evaluation of Two Years Implementation

The Teacher Effectiveness and Accountability for the Children of New Jersey (TEACHNJ) Act was adopted by the New Jersey legislature in August 2012 with the intent to raise student achievement by improving the overall quality of instruction. As a result of this act, new teacher evaluation systems are being introduced in school districts across the state in an effort to more accurately assess teacher performance. The new teacher evaluations will be based on multiple classroom observations as well as the academic achievement of their students as measured on standardized tests. In addition, professional development opportunities are likely to change under this legislation, with schools customizing professional development programs to more effectively meet the needs of their teachers. The overarching question that informs our research is what impact will TEACH NJ have on the overall value of teacher evaluations and the quality of professional development opportunities offered to teachers. Data collected through survey research presents the pre-implementation practices (2011-2012 school year) as well as one year post-implementation practices (2013-2014) taking place in school districts throughout New Jersey. The findings reflect teachers’ perceptions of the value of the current teacher evaluation practices, the quality of the current professional development opportunities and the value the school administration places on teacher evaluations.

A comparative approach to web evaluation and website evaluation methods.

There is still a lack of an engineering approach for building Web systems, and the field of measuring the Web is not yet mature. In particular, there is an uncertainty in the selection of evaluation methods, and there are risks of standardizing inadequate evaluation practices. It is important to know whether we are evaluating the Web or specific website(s). We need a new categorization system, a different focus on evaluation methods, and an in-depth analysis that reveals the strengths and weaknesses of each method. As a contribution to the field of Web evaluation, this study proposes a novel approach to view and select evaluation methods based on the purpose and platforms of the evaluation. It has been shown that the choice of the appropriate evaluation method(s) depends greatly on the purpose of the evaluation.