The reliability and validity of Freud's methods of free association and interpretation.

Presents a response of the author on the reliability and validity of Freud's method of free association and interpretation. Data gathering in clinical setting of psychoanalysis; Claims for reliability and validity; View of Freud on determinism.

Reliability of performance in repeated sprint cycling tests

We have estimated the reliability of performance in a commonly employed exercise test consisting of repeated sprints on a cycle ergometer. Eight recreationally active young men completed a practice trial and three more trials at 3- to 6-day intervals. Each trial consisted of two bouts of 30-s maximal-effort cycling on an electromagnetically braked cycle ergometer; the bouts were separated by 4 min of rest. The typical (standard) errors of measurement for peak and mean power between trials 2 to 4 were 2.5 and 1.7% respectively for the first bout and 1.9 and 1.8% for the second bout. These errors are substantially less than those in previous reliability studies of single 30-s sprint tests, probably because of differences in quality of ergometer. The typical errors for the difference between bouts (i.e., fatigue) for peak power and mean power were 3.0 and 2.5%, respectively. Typical errors for the average of the two bouts were 1.6 and 1.2% for peak and mean power respectively, which are small enough to give adequate precision for moderate treatment effects in studies with modest sample sizes.

Validity and reliability of a voice-recognition game analysis system for field sports

The purpose of this study was to assess the ability of observers to use voice-recognition analysis to accurately classify gait transitions and quantify gait durations typical of team games. Inter-rater and intra-rater reliability was also determined. Four males were filmed performing pre-determined gait protocols, each comprising different sequences of walking, jogging. running and sprinting. Two operators independently classified gait transitions and the time spent in each gait was determined by the voice recognition system. All gait modes as measured by trained observers demonstrated statistically significant correlations (p<O.O I) to predetermined measurement criteria. The mean absolute error for all gait transitions was less than half a second (0.32-0.36 5) with the maximum percentage error being approximately 4% for the walk, jog and run gaits and 10% for sprinting. Gait classification error was low at 1-9%. The intra-rater and inter-rater reliability was consistently high ranging from r =' 0.87 to 0.99. In conclusion, observers using voice-recognition software provided valid measures of time spent in each of the four gait categories with 90% or better accuracy achieved.

Validity and reliability of a physical activity recall instrument among overweight and non-overweight men and women

This study examined the validity and reliability of survey items measuring one-week recall of physical activity (PA) and examined differences by weight status. A sub-aim of the study was to objectively assess the intensity of activity that most closely matches self-report. A questionnaire was administered to adults twice, three days apart. It was again administered after subjects wore a MTI/CSA accelerometer for seven days (n = 118). Several metabolic equivalent (MET) thresholds were applied to the accelerometer data. Agreement between test and re- test estimates of sufficient physical activity for health benefits (150 min/week) was high (% agreement > 90%). Correlations (rho) between total reported PA (mins/day) and accelerometer data were 0.29 (p < 0.05) among men and 0.25 (p < 0.05) among women. Among men, self- reported duration of moderate PA (3-5.9 METS) and accelerometer data were significantly correlated (rho = 0.40, p < 0.01), with no differences by weight status. Among women, a significant relationship was found only for those who were not overweight (rho = 0.52, p < 0.001). A significant correlation between self-reported duration of vigorous PA (6+ METS) and accelerometer data was only found for overweight men (rho = 0.40, p < 0.05). When lower MET thresholds were applied to the accelerometer data, women's reported duration of moderate-intensity PA was most strongly correlated with moderate PA (accelerometer) defined as 2.0-5.9 METS (rho = 0.39, p < 0.01). The recall instrument provides a consistent measure of physical activity and validation coefficients were similar to those obtained for other physical activity recall questionnaires. However, the ability to measure PA by self-report may vary by weight status.

The reliability, validity, discriminant and predictive properties of the social Phobia Inventory (SoPhI)

This paper reports on the psychometric properties of the Social Phobic Inventory (SoPhI) a 21-item scale that was designed to measure social anxiety according to the criteria of DSM-IV (American Psychiatric Association, APA (1994) Diagnostic and Statistical Manual of Mental Disorder , 4th Edn., Washington). Factor analysis of the SoPhI using data from a clinical sample of respondents with social phobia revealed one factor which explained approximately 59% of variance and which demonstrated strong internal reliability ( agr= 0.93). The SoPhI demonstrated concurrent validity with the SPAI ( r = 0.86) and convergent validity with the Fear of Negative Evaluations-Revised ( r = 0.68). The predictive utility of the scale was demonstrated in a sample of university students classified as extroverted, normal, shy/introverted, and phobic/withdrawn ( -2 57%). Multivariate Analysis of Variance (MANOVA) revealed that the combined university sample differed from the clinical sample on the summated scores on the SoPhI and that 43% ( -2 ) of this difference was attributable to group membership. This figure rose to 58% attributable to group membership when these same groups were compared for differences on the 21 individual items. Scores of the SoPhI that are indicative of concern and of possible diagnostic criteria, as well as suggestions for future research, are discussed.

Furthering the use of the strengths and difficulties questionnaire: reliability with younger child respondents

A sample of 917 children, aged 7 to 17 years, their parents, and their teachers each completed the appropriate version of the Strengths and Difficulties Questionnaire (SDQ), and 120 from each group did so again 2 weeks later. The results indicate that the SDQ demonstrates sound interinformant and test-retest reliability. Younger children, whose self-reports have not been assessed in previous studies, were reliable in their responding, although not as reliable as older children by these measures. However, the internal reliability of the various subscales, in particular, the peer problems subscale, is questionable for both older and younger child respondents. Overall the findings suggest that the SDQ's use may be extended cautiously to include self-report from younger children.

The test-retest reliability of the child-initiated pretend play assessment

OBJECTIVE: The purpose of this study is to establish the test–retest reliability of the Child-Initiated Pretend Play Assessment (ChIPPA) (Stagnitti, 2002a; Stagnitti, Unsworth, & Rodger, 2000).

METHOD: The first author rated 38 preschool children ages 4 and 5 years (4 with developmental delay and 34 typically developing) on the ChIPPA. The ChIPPA employs conventional play materials and unstructured play materials to assess three qualities of a child's play ability: elaborateness of play action, ability to substitute objects during play, and the child's need to imitate the modelled actions of the examiner. The ChIPPA was administered twice, at a 2-week interval, to each participant.

RESULTS: Test–retest intraclass correlation coefficients (ICCs) (Type 2,1) calculated for each of the three elaborate play measures ranged from .73 to .84. A test–retest ICC of .56 was obtained for object substitution with unstructured play materials. The test–retest ICC obtained for the combined score for unstructured and conventional play materials was .57. Percentage agreement figures ranging from 63.2% to 84.2% were obtained on test–retest of the object substitution with conventional toys and imitated actions measures. There was no significant difference between test and retest scores for these measures based on a Wilcoxon Matched Pairs Signed-Ranks Test (Wilcoxon Sign Test).

CONCLUSION: Elaborate play scores, object substitution with conventional toys score, and imitation scores on the ChIPPA showed stability over time. Object substitution scores using unstructured materials were the least stable play measures and appeared to be related to the child's play themes. Since play is the primary occupation of children, it is essential that therapists have a reliable measure of play behavior. The test–retest reliability results from the ChIPPA provide evidence that this assessment produces a stable measure of play behavior that can then guide therapists when planning intervention strategies for children.

The reliability of clinical indicators of oxygenation: a literature review

Despite oxygen being one of the most frequently administered substances in the hospital environment, there is little empirical data regarding its use. Review of the literature regarding the clinical assessment of hypoxia and hypoxaemia reveals inconsistency in the definition of terms and raises questions as to the reliability of the clinical indicators currently used to assess the need for supplemental oxygen. Assessment of the need for supplemental oxygen and continued re-evaluation of the patient's oxygen requirements is a nursing responsibility. Physical assessment, in combination with pulse oximetry, is the most common method used by nurses to assess oxygenation status. This paper critically appraises the literature to examine the reliability of clinical indicators of oxygenation used by nurses in acute care settings.

Design, format, validity and reliability of mutiple choice questions for use in nursing research and education

Multiple choice questions are used extensively in nursing research and education and play a fundamental role in the design of research studies or educational programs. Despite their widespread use, there is a lack of evidence-based guidelines relating to design and use of multiple choice questions. Little is written about their format, structure, validity and reliability of in the context of nursing research and/or education and most of the current literature in this area is based on opinion or consensus. Systematic multiple choice question design and use of valid and reliable multiple choice questions are vital if the results of research or educational testing are to be considered valid. Content and face validity schould be established by expert panel review and construct validity should be established using ‘key check’, item discrimination and item difficulty analyses. Reliability measures include internal consistency and equivalence. Internal consistency should be established by determination of internal consistency using reliability coefficients while equivalence should be established using alternate form correlation. This paper reviews literature related to the use of multiple choice questions, current design recommendations and processes to establish reliability and validity, and discusses implications for their use in nursing research and education.

Improving the reliability of child witness testimony in court : the importance of focusing on questioning techniques

Considerable discussion during recent years has focused on ways to increase the reliability of child witness evidence, and reduce the negative impact of the courtroom environment on children's credibility and their psychological well-being. A large proportion of this discussion has focused on removing child witnesses from the courtroom and developing alternative arrangements by which children can give evidence (e.g., videotaped statements used as evidence-in-chief, closed-circuit television). There is no doubt that these arrangements have played a major role in reducing children's feelings of uncertainty and intimidation, and they have increased the ability of children 10 tell their stories and answer questions reliably (Cashmore 2002; Eastwood & Patton 2002). However, there are many
other factors. apart from the physical environment in which a child's evidence is elicited, that impact on the quality and accuracy of a child witness's evidence.

This contemporary comment focuses on one of the most important factors that impacts on the quality and accuracy of a child's evidence; the questioning techniques. It offers four recommendations for improving the reliability of child witness evidence in court. along with justifications for these recommendations and suggestions for bow these recommendations might be implemented. Each suggestion focuses on the impact of questioning techniques, from pre-trial questioning to questioning during the trial. It does not focus on the rules of evidence regarding child statements or the physical environment in which children's evidence is elicited.

Development and reliability of a self-report questionnaire to examine children's perceptions of the physical activity environment at home and in the neighbourhood

Background: Environmental factors are increasingly being implicated as key influences on children's physical activity. Few studies have comprehensively examined children's perceptions of their environment, and there is a paucity of literature on acceptable and reliable scales for measuring these. This study aimed to develop and test the acceptability and reliability of a scale which examined a broad range of environmental perceptions among children.
Methods: Based on constructs from ecological models, a survey incorporating items on children's perceptions of the physical and social environment at home and in the neighbourhood was developed. This was administered on two occasions, nine days apart, to a sample of 39 children aged 11 years (54% boys), attending a metropolitan Australian elementary school. The acceptability of the survey was determined by the proportion of missing responses to each item. The test-retest reliability of individual items, scores and scales were determined using Kappa statistics and percent agreement for categorical variables, and intraclass correlation coefficients (ICC) for continuous variables.
Results: There were few missing responses to each question, with only 4% of all responses missing. Although some Kappa values were low, all categorical variables showed acceptable reliability when examined for percent agreement between test and retest (range 68%–100% agreement). Continuous variables all showed moderate to good ICC values (range 0.72–0.92).
Conclusion: Findings suggest this questionnaire is reliable and acceptable to children for assessing environmental perceptions relevant to physical activity among 11-year-old children.

Calibration and reliability of a school food checklist: a new tool for assessing school food and beverage consumption

There is a pressing need in Australia and other countries to develop systems for monitoring secular trends in childhood obesity and related behavioural and environmental determinants. Energy from foods and beverages consumed at school is an accessible indicator of children’s eating patterns and we have developed a school food checklist (SFC) to measure this. The SFC records the number of serves and source (home, canteen, vending machine) of 20 food and beverage categories. This study aims to assess the accuracy and to calibrate the SFC by comparing it to a weighed record (WR) and to evaluate inter-recorder reliability. Participants were 910 primary school children aged 5 to 12 years from a rural township in Victoria, Australia. WR were collected from a nonrandom sub-sample of 106 and a second sub-sample (n=46) had intake measured twice using the SFC to assess inter-recorder reliability. Mean energy values were 2992 kJ ± 924 and 3008 kJ ± 952 for the SFC and WR respectively and the correlation coefficient was strong (Pearson r = 0.77). The mean difference between the WR and SFC methods was 15 kJ (95% CI, -107 kJ to 138 kJ) and the limits of agreement (+2 standard deviations) were ± 1270 kJ. The SFC overestimated the energy/serve of breads and fruit drinks and under-estimated energy/serve from fat spreads, biscuits/crackers, muesli/fruit bars and fruit. Inter-recorder reliability was good (kappa 0.51). The SFC was designed to measure energy from food and beverages in schools. It has good accuracy and reliability and the revised version should further improve accuracy of the instrument.

Reliability of moderate-intensity and vigorous physical activity stage of change measures for young adults.

Background
The purpose of this study was to examine the reliability of stage of change (SOC) measures for moderate-intensity and vigorous physical activity in two separate samples of young adults. Staging measures have focused on vigorous exercise, but current public health guidelines emphasize moderate-intensity activity.
Method
For college students in the USA (n = 105) and in Australia (n = 123), SOC was assessed separately on two occasions for moderate-intensity activity and for vigorous activity. Test–retest repeatability was determined, using Cohen’s kappa coefficient.
Results
In both samples, the reliability scores for the moderate-intensity physical activity staging measure were lower than the scores for the vigorous exercise staging measure. Weighted kappa values for the moderate-intensity staging measure were in the “fair to good” range for both studies (0.50 and 0.45); for the vigorous staging measure kappa values were “excellent” and “fair to good” (0.76 and 0.72).
Conclusions
There is a need to standardize and improve methods for staging moderate-intensity activity, given that such measures are used in public health interventions targeting HEPA (health-enhancing physical activity).

Development, reliability and validity of an instrument measuring the attitudes and knowledge of emergency department staff regarding the emergency nurse practitioner role

Introduction: The Emergency Department (ED) at The Northern Hospital is currently participating in the Victorian Department of Human Services funded Emergency Nurse Practitioner Project. This project aims to develop, implement and evaluate the Emergency Nurse Practitioner role in Victorian EDs. This led to a need to develop a specific data collection tool called The Northern Emergency Nurse Practitioner Staff Survey to examine the knowledge and attitudes of ED medical and nursing staff. This paper describes the development of The Northern Emergency Nurse Practitioner Staff Survey and presents the results of reliability and validity studies. Method: Twenty-five items were developed and piloted on a sample of 58 ED medical and nursing staff. Content and face validity were established by expert panel review. Reliability was established by tests of unidimensionality, exploratory factor analysis and internal consistency. Results: Four items were discarded because of low item to total correlation. Exploratory factor analysis of the remaining items revealed five factors with eigenvalues >1 and acceptable correlation coefficients that explained 76.7% of the variance. Cronbach’s coefficent α for these items was 0.926 indicating a high degree of internal consistency. The factors were titled to reflect the content domain of the items in each factor and the factors arranged in a logical sequence to form the final version of The Northern Emergency Nurse Practitioner Survey.