Commentary on the article by Swanenburg et al. ‘Validity and reliability of a German version of the Neck Disability Index (NDI-G)’

We commend Swanenburg et al. (2013) on translation, development, and clinimetric analysis of the NDI-G. However, the dual-factor structure with factor analysis and the high level of internal consistency (IC) highlighted in their discussion were not emphasized in the abstract or conclusion. These points may imply some inconsistencies with the final conclusions since determination of stable point estimates with the study's small sample are exceedingly difficult.

Development of a new ultrasound-based system for tracking motion of the human lumbar spine: Reliability, stability and repeatability during forward bending movement trials

The aim of this study was to develop a new method for quantifying intersegmental motion of the spine in an instrumented motion segment L4–L5 model using ultrasound image post-processing combined with an electromagnetic device. A prospective test–retest design was employed, combined with an evaluation of stability and within- and between-day intra-tester reliability during forward bending by 15 healthy male patients. The accuracy of the measurement system using the model was calculated to be ± 0.9° (standard deviation = 0.43) over a 40° range and ± 0.4 cm (standard deviation = 0.28) over 1.5 cm. The mean composite range of forward bending was 15.5 ± 2.04° during a single trial (standard error of the mean = 0.54, coefficient of variation = 4.18). Reliability (intra-class correlation coefficient = 2.1) was found to be excellent for both within-day measures (0.995–0.999) and between-day measures (0.996–0.999). Further work is necessary to explore the use of this approach in the evaluation of biomechanics, clinical assessments and interventions.

The modified card sorting test: Test-retest stability and relationships with demographic variables in a healthy older adult sample

Objectives. To investigate the test-retest stability of a standardized version of Nelson's (1976) Modified Card Sorting Test (MCST) and its relationships with demographic variables in a sample of healthy older adults. Design. A standard card order and administration were devised for the MCST and administered to participants at an initial assessment, and again at a second session conducted a minimum of six months later in order to examine its test-retest stability. Participants were also administered the WAIS-R at initial assessment in order to provide a measure of psychometric intelligence. Methods. Thirty-six (24 female, 12 male) healthy older adults aged 52 to 77 years with mean education 12.42 years (SD = 3.53) completed the MCST on two occasions approximately 7.5 months (SD = 1.61) apart. Stability coefficients and test-retest differences were calculated for the range of scores. The effect of gender on MCST performance was examined. Correlations between MCST scores and age, education and WAIS-R IQs were also determined. Results. Stability coefficients ranged from .26 for the percent perseverative errors measure to .49 for the failure to maintain set measure. Several measures were significantly correlated with age, education and WAIS-R IQs, although no effect of gender on MCST performance was found. Conclusions. None of the stability coefficients reached the level required for clinical decision making. The results indicate that participants' age, education, and intelligence need to be considered when interpreting MCST performance. Normative studies of MCST performance as well as further studies with patients with executive dysfunction are needed.

Impact of electric energy storage scheduling on reliability of distribution system

The development of Electric Energy Storage (EES) integrated with Renewable Energy Resources (RER) has increased use of optimum scheduling strategy in distribution systems. Optimum scheduling of EES can reduce cost of purchased energy by retailers while improve the reliability of customers in distribution system. This paper proposes an optimum scheduling strategy for EES and the evaluation of its impact on reliability of distribution system. Case study shows the impact of the proposed strategy on reliability indices of a distribution system.

Reliability control of GNSS carrier-phase integer ambiguity resolution

This research investigates how to obtain accurate and reliable positioning results with global navigation satellite systems (GNSS). The work provides a theoretical framework for reliability control in GNSS carrier phase ambiguity resolution, which is the key technique for precise GNSS positioning in centimetre levels. The proposed approach includes identification and exclusion procedures of unreliable solutions and hypothesis tests, allowing the reliability of solutions to be controlled in the aspects of mathematical models, integer estimation and ambiguity acceptance tests. Extensive experimental results with both simulation and observed data sets effectively demonstrate the reliability performance characteristics based on the proposed theoretical framework and procedures.

Agreement between physiotherapists rating scapular posture in multiple planes in patients with neck pain: Reliability study

Objective Evaluation of scapular posture is an integral component of the clinical assessment of painful neck disorders. The aim of this study was to evaluate agreement between therapist judgements of scapula posture in multiple biomechanical planes in individuals with neck pain. Design Inter-therapist reliability study. Setting Research laboratory. Participants Fifteen participants with chronic neck pain. Main outcome measures Four physiotherapists recorded ratings of scapular orientation (relative to the thorax) in five different scapula postural planes (plane of scapula, sagittal plane, transverse plane, horizontal plane, and vertical plane) under four test conditions (at rest, and during three isometric shoulder conditions) in all participants. Inter-therapist reliability was expressed using both generalized and paired kappa coefficient. Results Following adjustment for expected agreement and the high prevalence of neutral ratings (81%), on average both the generalised kappa (0.37) as well as Cohen's Kappa for the two therapist pairs (0.45 and 0.42) demonstrated only slight to moderate inter-therapist reliability. Conclusions The findings suggest that ratings of scapular posture in individuals with neck pain by visual inspection has only slight to moderate reliability and should only be used in conjunction with other clinical tests when judging scapula function in these patients.

Validation and reliability of a Spanish version of Simple Shoulder Test (SST-Sp)

Background: The Simple Shoulder Test (SST-Sp) is a widely used outcome measure. Objective: The purpose of this study was to develop and validate a Spanish-version SST (SST-Sp). Methods: A two-stage observational study was conducted. The SST was initially cross-culturally adapted to Spanish through double forward and backward translation and then validated for its psychometric characteristics. Participants (n = 66) with several shoulder disorders completed the SST-Sp, DASH, VAS and SF-12. The full sample was employed to determine factor structure, internal consistency and concurrent criterion validity. Reliability was determined in the first 24–48 h in a subsample of 21 patients. Results: The SST-Sp showed three factors that explained the 56.1 % of variance, and the internal consistency for each factor was α = 0.738, 0.723 and 0.667, and reliability was ICC = 0.687–0.944. The factor structure was three-dimensional and supported construct validity. Criterion validity determined from the relationship between the SST-Sp and DASH was strong (r = −0.73; p < 0.001) and fair for VAS (r = −0.537; p < 0.001). Relationships between SST-Sp and SF-12 were weak for both physical (r = −0.47; p < 0.001) and mental (r = −0.43; p < 0.001) dimensions. Conclusions: The SST-Sp supports the findings of the original English version as being a valid shoulder outcome measure with similar psychometric properties to the original English version.

Development and validation of a questionnaire to measure health professionals' attitudes toward identification of female victimes of domestic violence

Background Domestic violence against women is a major public health problem and violations of women’s human rights. Health professionals could play an important role in screening for the victims. From the evidence to date, it is unclear whether health professionals do play an active role in identification of the victims. Objectives To develop a reliable and valid instrument to measure health professionals’ attitude to identifying female victims of domestic violence. Methods A primary questionnaire was constructed in accordance with established guidelines using the Theory of Planned Behaviour Ajzen (1975) to develop an instrument to measure health professionals’ attitudes in identifying female victim of DV. An expert panel was used to establish content validity. Focus groups amongst a group of health professionals (N = 5) of the target population were performed to confirm face validity. A pilot study (N = 30 nurses and doctors) was undertaken to elicit the feasibility and reliability of the questionnaire. The questionnaire was also administered a second time after one week to check the stability of the tests. Results Feedbacks of the expert panel’s and group discussion confirmed that the questionnaire had the content and face validity. Cronbach’s alpha values for all the items were greater than 0.7. Strong correlations between the direct and indirect measures confirmed that the indirect measures were well constructed. High test-retest correlations confirmed that the measures were reliable in the sense of temporal stability. Significance This tool has the potential to be used by researchers in expanding the knowledge base in this important area.

Palliative care problem severity score: Reliability and acceptability in a national study

Background The Palliative Care Problem Severity Score is a clinician-rated tool to assess problem severity in four palliative care domains (pain, other symptoms, psychological/spiritual, family/carer problems) using a 4-point categorical scale (absent, mild, moderate, severe). Aim To test the reliability and acceptability of the Palliative Care Problem Severity Score. Design: Multi-centre, cross-sectional study involving pairs of clinicians independently rating problem severity using the tool. Setting/participants Clinicians from 10 Australian palliative care services: 9 inpatient units and 1 mixed inpatient/community-based service. Results A total of 102 clinicians participated, with almost 600 paired assessments completed for each domain, involving 420 patients. A total of 91% of paired assessments were undertaken within 2 h. Strength of agreement for three of the four domains was moderate: pain (Kappa = 0.42, 95% confidence interval = 0.36 to 0.49); psychological/spiritual (Kappa = 0.48, 95% confidence interval = 0.42 to 0.54); family/carer (Kappa = 0.45, 95% confidence interval = 0.40 to 0.52). Strength of agreement for the remaining domain (other symptoms) was fair (Kappa = 0.38, 95% confidence interval = 0.32 to 0.45). Conclusion The Palliative Care Problem Severity Score is an acceptable measure, with moderate reliability across three domains. Variability in inter-rater reliability across sites and participant feedback indicate that ongoing education is required to ensure that clinicians understand the purpose of the tool and each of its domains. Raters familiar with the patient they were assessing found it easier to assign problem severity, but this did not improve inter-rater reliability.

A randomized trial of fellowships for early career researchers finds a high reliability in funding decisions

Objectives Funding for early career researchers in Australia's largest medical research funding scheme is determined by a competitive peer-review process using a panel of four reviewers. The purpose of this experiment was to appraise the reliability of funding by duplicating applications that were considered by separate grant review panels. Study Design and Methods Sixty duplicate applications were considered by two independent grant review panels that were awarding funding for Australia's National Health and Medical Research Council. Panel members were blinded to which applications were included in the experiment and to whether it was the original or duplicate application. Scores were compared across panels using Bland–Altman plots to determine measures of agreement, including whether agreement would have impacted on actual funding. Results Twenty-three percent of the applicants were funded by both panels and 60 percent were not funded by both, giving an overall agreement of 83 percent [95% confidence interval (CI): 73%, 92%]. The chance-adjusted agreement was 0.75 (95% CI: 0.58, 0.92). Conclusion There was a comparatively high level of agreement when compared with other types of funding schemes. Further experimental research could be used to determine if this higher agreement is due to nature of the application, the composition of the assessment panel, or the characteristics of the applicants.

Improved Algorithms for Reservoir Capacity Calculation Incorporating Storage-Dependent Losses and Reliability Norm

Two algorithms that improve upon the sequent-peak procedure for reservoir capacity calculation are presented. The first incorporates storage-dependent losses (like evaporation losses) exactly as the standard linear programming formulation does. The second extends the first so as to enable designing with less than maximum reliability even when allowable shortfall in any failure year is also specified. Together, the algorithms provide a more accurate, flexible and yet fast method of calculating the storage capacity requirement in preliminary screening and optimization models.

The effect of row configuration on yield reliability in grain sorghum: II. Modelling the effects of row configuration

In recent years many sorghum producers in the more marginal (<600 mm annual rainfall) cropping areas of Qld and northern NSW have utilised skip row configurations in an attempt to improve yield reliability and reduce sorghum production risk. But will this work in the long run? What are the trade-offs between productivity and risk of crop failure? This paper describes a modelling and simulation approach to study the long-term effects of skip row configurations. Detailed measurements of light interception and water extraction from sorghum crops grown in solid, single and double skip row configurations were collected from three on-farm participatory research trials established in southern Qld and northern NSW. These measurements resulted in changes to the model that accounted for the elliptical water uptake pattern below the crop row and reduced total light interception associated with the leaf area reduction of the skip configuration. Following validation of the model, long-term simulation runs using historical weather data were used to determine the value of skip row sorghum production as a means of maintaining yield reliability in the dryland cropping regions of southern Qld and northern NSW.

The reliability of supply of feed grains in the northern region

Reliability of supply of feed grain has become a high priority issue for industry in the northern region. Expansion by major intensive livestock and industrial users of grain, combined with high inter-annual variability in seasonal conditions, has generated concern in the industry about reliability of supply. This paper reports on a modelling study undertaken to analyse the reliability of supply of feed grain in the northern region. Feed grain demand was calculated for major industries (cattle feedlots, pigs, poultry, dairy) based on their current size and rate of grain usage. Current demand was estimated to be 2.8Mt. With the development of new industrial users (ethanol) and by projecting the current growth rate of the various intensive livestock industries, it was estimated that demand would grow to 3.6Mt in three years time. Feed grain supply was estimated using shire scale yield prediction models for wheat and sorghum that had been calibrated against recent ABS production data. Other crops that contribute to a lesser extent to the total feed grain pool (barley, maize) were included by considering their production relative to the major winter and summer grains, with estimates based on available production records. This modelling approach allowed simulation of a 101-year time series of yield that showed the extent of the impact of inter-annual climate variability on yield levels. Production estimates were developed from this yield time series by including planted crop area. Area planted data were obtained from ABS and ABARE records. Total production amounts were adjusted to allow for any export and end uses that were not feed grain (flour, malt etc). The median feed grain supply for an average area planted was about 3.1Mt, but this varied greatly from year to year depending on seasonal conditions and area planted. These estimates indicated that supply would not meet current demand in about 30% of years if a median area crop were planted. Two thirds of the years with a supply shortfall were El Nino years. This proportion of years was halved (i.e. 15%) if the area planted increased to that associated with the best 10% of years. Should demand grow as projected in this study, there would be few years where it could be met if a median crop area was planted. With area planted similar to the best 10% of years, there would still be a shortfall in nearly 50% of all years (and 80% of El Nino years). The implications of these results on supply/demand and risk management and investment in research and development are briefly discussed.

Modelling the impact of traffic incidents on travel time reliability

Traffic incidents are recognised as one of the key sources of non-recurrent congestion that often leads to reduction in travel time reliability (TTR), a key metric of roadway performance. A method is proposed here to quantify the impacts of traffic incidents on TTR on freeways. The method uses historical data to establish recurrent speed profiles and identifies non-recurrent congestion based on their negative impacts on speeds. The locations and times of incidents are used to identify incidents among non-recurrent congestion events. Buffer time is employed to measure TTR. Extra buffer time is defined as the extra delay caused by traffic incidents. This reliability measure indicates how much extra travel time is required by travellers to arrive at their destination on time with 95% certainty in the case of an incident, over and above the travel time that would have been required under recurrent conditions. An extra buffer time index (EBTI) is defined as the ratio of extra buffer time to recurrent travel time, with zero being the best case (no delay). A Tobit model is used to identify and quantify factors that affect EBTI using a selected freeway segment in the Southeast Queensland, Australia network. Both fixed and random parameter Tobit specifications are tested. The estimation results reveal that models with random parameters offer a superior statistical fit for all types of incidents, suggesting the presence of unobserved heterogeneity across segments. What factors influence EBTI depends on the type of incident. In addition, changes in TTR as a result of traffic incidents are related to the characteristics of the incidents (multiple vehicles involved, incident duration, major incidents, etc.) and traffic characteristics.

Seismic reliability assessment of external stability of reinforced soil walls using pseudo-dynamic method

The paper presents a method for the evaluation of external stability of reinforced soil walls subjected to earthquakes in the framework of the pseudo-dynamic method. The seismic reliability of the wall is evaluated by considering the different possible failure modes such as sliding along the base, overturning about the toe point of the wall, bearing capacity and the eccentricity of the resultant force. The analysis is performed considering properties of the reinforced backfill, foundation soil below the base of the wall, length of the geosynthetic reinforcement and characteristics of earthquake ground motions such as shear wave and primary wave velocity as random variables. The optimum length of reinforcement needed to maintain stability against four modes of failure by targeting various component reliability indices is obtained. Differences between pseudo-static and pseudo-dynamic methods are clearly highlighted in the paper. A complete analysis of pseudo-static and pseudo-dynamic methodologies shows that the pseudodynamic method results in realistic design values for the length of geosynthetic reinforcement under earthquake conditions.