Methodological rigour in assessing participatory development

There have been few rigorous assessments of the effectiveness of participatory processes for natural resource management. In Bangladesh an approach known as Participatory Action Plan Development (PAPD) has been developed and applied. By combining problem identification and solution analysis by separate stakeholder groups with plenary sessions it is claimed to result in consensus and more effective community based management. Methodological issues in assessing the effectiveness of such development are discussed and good practice illustrated. Under the same project there were sites where PAPD had been used and others without its use so a comparative assessment could be made. However, for an appropriate assessment it is important to identify clear testable hypotheses regarding the expected benefits, appropriate measures, and other factors which may affect or confound the outcome. The paper illustrates how participatory assessment involving both individual opinions and focus groups can be systematically recorded, quantified and used with other data in statistical analysis. By using statistical modelling methods at an appropriate level of aggregation and controlling for other factors, benefits from PAPD were found to be significant. The systematic approaches and practices recommended from this example can be applied in similar situations to test the effectiveness of participatory processes using participatory assessments.

Evolution or extinction? Reflections on the future of research in educational leadership and management

Consideration of the quality, relevance and utility of research in educational leadership and management has been a growing concern of researchers, policy-makers and practitioners, but there is little agreement about its current state or priorities for development. The article reflects on the key criticisms that have been made of research in educational leadership and management in this issue, and elsewhere. It considers how we might begin to devise better ways of understanding its audiences, judging its quality and identifying priorities for the future. It argues that the research reflects its capture by those with particular interests or values, and impacts in ways which are complex and indirect. If educational leadership and management research is to be secure in its perceived value and contribution in the future, several developments are needed, including a greater emphasis on interdisciplinarity, an expansion of the range of methodologies, particularly qualtitative studies; and these shifts must be evident in training researchers as well as in the conduct of research.

Second language listening strategy research: methodological challenges and perspectives

This paper explores methodological issues related to research into second language listening strategies. We argue that a number of central questions regarding research methodology in this line of enquiry are underexamined, and we engage in the discussion of three key methodological questions: (1) To what extent is a verbal report a valid and reliable way of eliciting information about strategies? (2) Should we control for learners' level of linguistic knowledge when examining their listening strategy use? and (3) What are the problems surrounding the analysis of data gained through verbal reports? We discuss each of these three methodological issues within the framework of a research project investigating listening strategies deployed by learners of French in secondary schools in England. Implications from these findings for future research are discussed.

Room reflections and constancy in speech-like sounds: within-band effects

The experiment asks whether constancy in hearing precedes or follows grouping. Listeners heard speech-like sounds comprising 8 auditory-filter shaped noise-bands that had temporal envelopes corresponding to those arising in these filters when a speech message is played. The „context‟ words in the message were “next you‟ll get _to click on”, into which a “sir” or “stir” test word was inserted. These test words were from an 11-step continuum that was formed by amplitude modulation. Listeners identified the test words appropriately and quite consistently, even though they had the „robotic‟ quality typical of this type of 8-band speech. The speech-like effects of these sounds appears to be a consequence of auditory grouping. Constancy was assessed by comparing the influence of room reflections on the test word across conditions where the context had either the same level of reflections, or where it had a much lower level. Constancy effects were obtained with these 8-band sounds, but only in „matched‟ conditions, where the room reflections were in the same bands in both the context and the test word. This was not the case in a comparison „mismatched‟ condition, and here, no constancy effects were found. It would appear that this type of constancy in hearing precedes the across-channel grouping whose effects are so apparent in these sounds. This result is discussed in terms of the ubiquity of grouping across different levels of representation.

Constancy in the perception of speech when the level of room-reflections varies

A speech message played several metres from the listener in a room is usually heard to have much the same phonetic content as it does when played nearby, even though the different amounts of reflected sound make the temporal envelopes of these signals very different. To study this ‘constancy’ effect, listeners heard speech messages and speech-like sounds comprising 8 auditory-filter shaped noise-bands that had temporal envelopes corresponding to those in these filters when the speech message is played. The ‘contexts’ were “next you’ll get _to click on”, into which a “sir” or “stir” test word was inserted. These test words were from an 11-step continuum, formed by amplitude modulation. Listeners identified the test words appropriately, even in the 8-band conditions where the speech had a ‘robotic’ quality. Constancy was assessed by comparing the influence of room reflections on the test word across conditions where the context had either the same level of room reflections (i.e. from the same, far distance), or where it had a much lower level (i.e. from nearby). Constancy effects were obtained with both the natural- and the 8-band speech. Results are considered in terms of the degree of ‘matching’ between the context’s and test-word’s bands.