A Systems-level approach to building sustainable assessment cultures : moderation, quality task design and dependability of judgement

This paper considers the conditions that are necessary at system and local levels for teacher assessment to be valid, reliable and rigorous. With sustainable assessment cultures as a goal, the paper examines how education systems can support local level efforts for quality learning and dependable teacher assessment. This is achieved through discussion of relevant research and consideration of a case study involving an evaluation of a cross-sectoral approach to promoting confidence in school-based assessment in Queensland, Australia. Building on the reported case study, essential characteristics for developing sustainable assessment cultures are presented, including: leadership in learning; alignment of curriculum, pedagogy and assessment; the design of quality assessment tasks and accompanying standards, and evidence-based judgement and moderation. Taken together, these elements constitute a new framework for building assessment capabilities and promoting quality assurance.

Why the construction quality of design-build projects is not satisfactory : a Queensland study

Design-build (DB) system is well-known to be a popular and effective delivery method of construction work worldwide. It has been demonstrated as superior to the traditional delivery system in regards to time and cost performance. However, it suffers a major flaw, in that the performance of project quality cannot be guaranteed. This paper aims to investigate the underlying factors attributing to the poor quality performance of design-build projects in Queensland. Five major factors were first identified through a comprehensive literature review, which relate to (1) project briefing and scope definition, (2) client’s role and responsibility, (3) procurement selection, (4) contractor’s incentive, and (5) design document quality. A questionnaire survey with 127 DB professionals was conducted to determine how these factors affect various quality criteria, i.e. functional quality, architectural quality, technical quality, workmanship quality, client satisfaction and overall quality. With the architectural quality reduced greatly, the research findings reveal that the DB projects in Queensland have the reduced overall quality compared with traditional projects. The impacts of different factors on the quality performance of DB projects have been closely examined and summarized. The research findings will facilitate project stakeholder’s better understanding of the delivery process of the DB system and provide guidelines to improve the quality performance.

The need for ‘representative task design’ in evaluating efficacy of skills tests in sport : a comment on Russell, Benton and Kingsley (2010)

Russell, Benton and Kingsley (2010) recently suggested a new association football test comprising three different tasks for the evaluation of players' passing, dribbling and shooting skills. Their stated intention was to enhance ‘ecological validity’ of current association football skills tests allowing generalisation of results from the new protocols to performance constraints that were ‘representative’ of experiences during competitive game situations. However, in this comment we raise some concerns with their use of the term ‘ecological validity’ to allude to aspects of ‘representative task design’. We propose that in their paper the authors confused understanding of environmental properties, performance achievement and generalisability of the test and its outcomes. Here, we argue that the tests designed by Russell and colleagues did not include critical sources of environmental information, such as the active role of opponents, which players typically use to organise their actions during performance. Static tasks which are not representative of the competitive performance environment may lead to different emerging patterns of movement organisation and performance outcomes, failing to effectively evaluate skills performance in sport.

Modeling and simulation of spray drying processes based on quality by design principles

Tese de doutoramento, Farmácia (Tecnologia Farmacêutica), Universidade de Lisboa, Faculdade de Farmácia, 2014

Using crises, feedback, and fading for online task design

Resumen basado en el de la publicaci??n

Assessing L2 task performance: understanding effects of task design

The overarching aim of the research reported here was to investigate the effects of task structure and storyline complexity of oral narrative tasks on second language task performance. Participants were 60 Iranian language learners of English who performed six narrative tasks of varying degree of structure and storyline complexity in an assessment setting. A number of analytic detailed measures were employed to examine whether there were any differences in the participants’ performances elicited by the different tasks in terms of their accuracy, fluency, syntactic complexity and lexical diversity. Results of the data analysis showed that performance in the more structured tasks was more accurate and to a great extent more fluent than that in the less structured tasks. The results further revealed that syntactic complexity of L2 performance was related to the storyline complexity, i.e. more syntactic complexity was associated with narratives that had both foreground and background storylines. These findings strongly suggest that there is some unsystematic variance in the participants’ performance triggered by the different aspects of task design.

Task design and second language performance: the effect of narrative type on learner output

This article reports on a detailed empirical study of the way narrative task design influences the oral performance of second-language (L2) learners. Building on previous research findings, two dimensions of narrative design were chosen for investigation: narrative complexity and inherent narrative structure. Narrative complexity refers to the presence of simultaneous storylines; in this case, we compared single-story narratives with dual-story narratives. Inherent narrative structure refers to the order of events in a narrative; we compared narratives where this was fixed to others where the events could be reordered without loss of coherence. Additionally, we explored the influence of learning context on performance by gathering data from two comparable groups of participants: 60 learners in a foreign language context in Teheran and 40 in an L2 context in London. All participants recounted two of four narratives from cartoon pictures prompts, giving a between-subjects design for narrative complexity and a within-subjects design for inherent narrative structure. The results show clearly that for both groups, L2 performance was affected by the design of the task: Syntactic complexity was supported by narrative storyline complexity and grammatical accuracy was supported by an inherently fixed narrative structure. We reason that the task of recounting simultaneous events leads learners into attempting more hypotactic language, such as subordinate clauses that follow, for example, while, although, at the same time as, etc. We reason also that a tight narrative structure allows learners to achieve greater accuracy in the L2 (within minutes of performing less accurately on a loosely structured narrative) because the tight ordering of events releases attentional resources that would otherwise be spent on finding connections between the pictures. The learning context was shown to have no effect on either accuracy or fluency but an unexpectedly clear effect on syntactic complexity and lexical diversity. The learners in London seem to have benefited from being in the target language environment by developing not more accurate grammar but a more diverse resource of English words and syntactic choices. In a companion article (Foster & Tavakoli, 2009) we compared their performance with native-speaker baseline data and see that, in terms of nativelike selection of vocabulary and phrasing, the learners in London are closing in on native-speaker norms. The study provides empirical evidence that L2 performance is affected by task design in predictable ways. It also shows that living within the target language environment, and presumably using the L2 in a host of everyday tasks outside the classroom, confers a distinct lexical advantage, not a grammatical one.

Task design and second language performance: the effect of narrative type on learner output

This article presents a study examining how narrative structure and narrative complexity might influence the performance of second language learners. Forty learners of English in London and sixty learners in Teheran were asked to retell cartoon stories from picture prompts. Each performed two of four narrative tasks that had different degrees of narrative structure (loose or tight) and of storyline complexity (with or without background events). Results support the findings of previous research that tight task structure is connected to increased accuracy and that narratives involving background information give rise to more complex syntax. A comparison of the data from the London and Teheran cohorts showed that the learners in London used significantly more complex syntax and diverse vocabulary even though they did not differ from the Teheran learners in other performance dimensions.

Task design and interaction in collaborative writing: the students’ story

This article investigates student behaviour on collaborative assignments, looking at the relationship between task type and interaction, and considers the implications for task design. Students reported on interactions in a year-long workplace-focussed group communication project, comparing these with interactions on other academy based group assignments. Differences were seen in the amount of brainstorming, the criteria for dividing up work, the intensity of editing, and how conflict was managed. Contributing factors to these differences included the presence or absence of a creative element, the instrumental nature of the task, and the need for a collective approach inherent in the task design.

Guidelines on building design and operation to minimize air quality impacts from major roads in transit oriented development

Poor air quality has a huge detrimental effect, both economic and on the quality of life, in Australia. Transit oriented design (TOD), which aims to minimise urban sprawl and lower dependency on vehicles, leads to an increasing number of buildings close to transport corridors. This project aims at providing guidelines that are appropriate to include within City Plan to inform future planning along road corridors, and provide recommendations on when mitigation measures should be utilised.

Evaluating the Quality of Student Web Design Projects

Иван Шотлеков, Асен Рахнев - В настоящата работа се представя набор от критерии за оценяване на качеството на студентски проекти за уеб дизайн. Критериите са подходящи за разработване, самооценяване, колегиално оценяване и оценка на уеб сайтове, проектирани от студенти. Тази оценъчна скала е апробирана по време на курс “Английски език в информационните технологии”, проведен със студенти от първи курс по информатика във Факултета по математика и информатика на Пловдивски университет “Паисий Хилендарски”. Тя помага на студентите при разработването на мултидисциплинарен проект за уеб дизайн да придобият не само технически умения, свързани с проектирането на качествени уеб сайтове, но и някои процесуални умения, които ще им бъдат необходими в реалната практика.