Towards a standard methodology to evaluate internal cluster validity indices

The evaluation and comparison of internal cluster validity indices is a critical problem in the clustering area. The methodology used in most of the evaluations assumes that the clustering algorithms work correctly. We propose an alternative methodology that does not make this often false assumption. We compared 7 internal cluster validity indices with both methodologies and concluded that the results obtained with the proposed methodology are more representative of the actual capabilities of the compared indices.

Using a brief questionnaire to assess the overall perception of basketball spectators

Purpose – The purpose of this paper is twofold. The first aim is to obtain a valid and reliable instrument for the holistic analysis of sporting events, and the second is to test a causal model in which future intentions depend on spectators’ perceptions of quality, satisfaction, and value of these events. Design/methodology/approach – A total of 493 spectators of a professional basketball team in the Spanish ACB league responded to a survey to measure the overall performance of the sporting event service. Exploratory factor analysis and further confirmatory factor analysis using structural equation models provides the methodology for testing the reliability and validity of the instrument. Findings – The scales have adequate reliability and validity indices. The path model explains 35.8 percent of the variance in future intentions, 54.0 percent in perceived value, and 49.5 percent in spectators’ satisfaction. Quality proves a better predictor of perceived value than satisfaction. Both perceived value and satisfaction have a similar weight in predicting spectators’ future intentions. The data indicate that quality has an effect on spectators’ future intentions, by altering their perceptions of value and satisfaction. Research limitations/implications – The research findings are somewhat limited, due to the sample consisting entirely of spectators of a single team in the Spanish ACB league. Practical implications – Managers can use these findings to develop loyalty strategies by creating service value and increasing spectators’ satisfaction through quality improvements. Originality/value – This study contributes to the literature on service quality by providing an overall measure to assess service in professional sporting events in a Latin-American context.

Typical load profiles in the smart grid context – a clustering methods comparison

The present research paper presents five different clustering methods to identify typical load profiles of medium voltage (MV) electricity consumers. These methods are intended to be used in a smart grid environment to extract useful knowledge about customer’s behaviour. The obtained knowledge can be used to support a decision tool, not only for utilities but also for consumers. Load profiles can be used by the utilities to identify the aspects that cause system load peaks and enable the development of specific contracts with their customers. The framework presented throughout the paper consists in several steps, namely the pre-processing data phase, clustering algorithms application and the evaluation of the quality of the partition, which is supported by cluster validity indices. The process ends with the analysis of the discovered knowledge. To validate the proposed framework, a case study with a real database of 208 MV consumers is used.

A Data Mining Framework for Electric Load Profiling

This paper consists in the characterization of medium voltage (MV) electric power consumers based on a data clustering approach. It is intended to identify typical load profiles by selecting the best partition of a power consumption database among a pool of data partitions produced by several clustering algorithms. The best partition is selected using several cluster validity indices. These methods are intended to be used in a smart grid environment to extract useful knowledge about customers’ behavior. The data-mining-based methodology presented throughout the paper consists in several steps, namely the pre-processing data phase, clustering algorithms application and the evaluation of the quality of the partitions. To validate our approach, a case study with a real database of 1.022 MV consumers was used.

A Data-mining-based Methodology to support MV Electricity Customers' Characterization

This paper presents an electricity medium voltage (MV) customer characterization framework supportedby knowledge discovery in database (KDD). The main idea is to identify typical load profiles (TLP) of MVconsumers and to develop a rule set for the automatic classification of new consumers. To achieve ourgoal a methodology is proposed consisting of several steps: data pre-processing; application of severalclustering algorithms to segment the daily load profiles; selection of the best partition, corresponding tothe best consumers’ segmentation, based on the assessments of several clustering validity indices; andfinally, a classification model is built based on the resulting clusters. To validate the proposed framework,a case study which includes a real database of MV consumers is performed.

Load Profiling Tool to Support Smart Grid Operation Scenarios

This paper presents the characterization of high voltage (HV) electric power consumers based on a data clustering approach. The typical load profiles (TLP) are obtained selecting the best partition of a power consumption database among a pool of data partitions produced by several clustering algorithms. The choice of the best partition is supported using several cluster validity indices. The proposed data-mining (DM) based methodology, that includes all steps presented in the process of knowledge discovery in databases (KDD), presents an automatic data treatment application in order to preprocess the initial database in an automatic way, allowing time saving and better accuracy during this phase. These methods are intended to be used in a smart grid environment to extract useful knowledge about customers’ consumption behavior. To validate our approach, a case study with a real database of 185 HV consumers was used.

Collaborative fuzzy clustering algorithms: some refinements and design guidelines

There are some variants of the widely used Fuzzy C-Means (FCM) algorithm that support clustering data distributed across different sites. Those methods have been studied under different names, like collaborative and parallel fuzzy clustering. In this study, we offer some augmentation of the two FCM-based clustering algorithms used to cluster distributed data by arriving at some constructive ways of determining essential parameters of the algorithms (including the number of clusters) and forming a set of systematically structured guidelines such as a selection of the specific algorithm depending on the nature of the data environment and the assumptions being made about the number of clusters. A thorough complexity analysis, including space, time, and communication aspects, is reported. A series of detailed numeric experiments is used to illustrate the main ideas discussed in the study.

The Decent Work Questionnaire (DWQ): Development and validation in two samples of knowledge workers

This research aimed to develop a questionnaire measure of workers’ perceptions of decent work. The initial pool of 72 items covered the substantive elements used by the International Labour Organization to characterize decent work. It was administered to workers from Portugal (N = 636) and Brazil (N = 1039) and submitted to exploratory and confirmatory factor analysis. The final 31-item version yields seven factor scores in addition to the global decent work score. With good reliability, convergent and discriminant validity indices, the DWQ could open new avenues for empirical studies of the decent work concept.

The development and validation of Australian indices of child development - Part II : validity support

The two outcome indices described in a companion paper (Sanson et al., Child Indicators Research, 2009) were developed using data from the Longitudinal Study of Australian Children (LSAC). These indices, one for infants and the other for 4 year to 5 year old children, were designed to fill the need for parsimonious measures of children’s developmental status to be used in analyses by a broad range of data users and to guide government policy and interventions to support young children’s optimal development. This paper presents evidence from Wave 1data from LSAC to support the validity of these indices and their three domain scores of Physical, Social/Emotional, and Learning. Relationships between the indices and child, maternal, family, and neighborhood factors which are known to relate concurrently to child outcomes were examined. Meaningful associations were found with the selected variables, thereby demonstrating the usefulness of the outcome indices as tools for understanding children’s development in their family and socio-cultural contexts. It is concluded that the outcome indices are valuable tools for increasing understanding of influences on children’s development, and for guiding policy and practice to optimize children’s life chances.

The development and validation of Australian Indices of Child Development — Part I: conceptualisation and development

The Longitudinal Study of Australian Children (LSAC) is a major national study examining the lives of Australian children, using a cross-sequential cohort design and data from parents, children, and teachers for 5,107 infants (3–19 months) and 4,983 children (4–5 years). Its data are publicly accessible and are used by researchers from many disciplinary backgrounds. It contains multiple measures of children’s developmental outcomes as well as a broad range of information on the contexts of their lives. This paper reports on the development of summary outcome indices of child development using the LSAC data. The indices were developed to fill the need for indicators suitable for use by diverse data users in order to guide government policy and interventions which support young children’s optimal development. The concepts underpinning the indices and the methods of their development are presented. Two outcome indices (infant and child) were developed, each consisting of three domains—health and physical development, social and emotional functioning, and learning competency. A total of 16 measures are used to make up these three domains in the Outcome Index for the Child Cohort and six measures for the Infant Cohort. These measures are described and evidence supporting the structure of the domains and their underlying latent constructs is provided for both cohorts. The factorial structure of the Outcome Index is adequate for both cohorts, but was stronger for the child than infant cohort. It is concluded that the LSAC Outcome Index is a parsimonious measure representing the major components of development which is suitable for non-specialist data users. A companion paper (Sanson et al. 2010) presents evidence of the validity of the Index.

Age related differences in the validity of the OMNI perceived exertion scale during lifestyle activities

PURPOSE The OMNI Perceived Exertion Scale was developed for children to report perceived effort while performing physical activity; however no studies have formally examined age-related differences in validity. This study evaluated the validity of the OMNI-RPE in four age groups performing a range of lifestyle activities. METHODS 206 participants were stratified into four age groups: 6-8 years (n = 42), 9-10 years (n = 46), 11-12 years (n = 47), and 13-15 years (n = 71). Heart rate and VO2 were measured during 11 activity trials ranging in intensity from sedentary to vigorous. After each trial, participants reported effort from the OMNI walk/run scale. Concurrent validity was assessed by calculating within-subject correlations between OMNI ratings and the two physiological indices. RESULTS The average correlation between OMNI ratings and VO2 was 0.67, 0.77, 0.85 and 0.87 for the 6-8, 9-10, 11-12 and 13-15 y age groups, respectively. CONCLUSION The OMNI RPE scale demonstrated fair to good evidence of validity across a range of lifestyle activities among 6-15 year old children. The validity of the scale appears to be developmentally related with RPE reports closely reflecting physiological responses among children older than 8 years.

The validity of personal disturbance scale (DSSI/sAD) in people with diabetes mellitus, using longitudinal data

Despite being used since 1976, Delusions-Symptoms-States-Inventory/states of Anxiety and Depression (DSSI/sAD) has not yet been validated for use among people with diabetes. The aim of this study was to examine the validity of the personal disturbance scale (DSSI/sAD) among women with diabetes using Mater-University of Queensland Study of Pregnancy (MUSP) cohort data. The DSSI subscales were compared against DSM-IV disorders, the Mental Component Score of the Short Form 36 (SF-36 MCS), and Center for Epidemiologic Studies Depression Scale (CES-D). Factor analyses, odds ratios, receiver operating characteristic (ROC) analyses and diagnostic efficiency tests were used to report findings. Exploratory factor analysis and fit indices confirmed the hypothesized two-factor model of DSSI/sAD. We found significant variations in the DSSI/sAD domain scores that could be explained by CES-D (DSSI-Anxiety: 55%, DSSI-Depression: 46%) and SF-36 MCS (DSSI-Anxiety: 66%, DSSI-Depression: 56%). The DSSI subscales predicted DSM-IV diagnosed depression and anxiety disorders. The ROC analyses show that although the DSSI symptoms and DSM-IV disorders were measured concurrently the estimates of concordance remained only moderate. The findings demonstrate that the DSSI/sAD items have similar relationships to one another in both the diabetes and non-diabetes data sets which therefore suggest that they have similar interpretations.

Can perceptual indices estimate physiological strain across a range of environments and metabolic workloads when wearing explosive ordnance disposal and chemical protective clothing?

Objective Explosive ordnance disposal (EOD) often requires technicians to wear multiple protective garments in challenging environmental conditions. The accumulative effect of increased metabolic cost coupled with decreased heat dissipation associated with these garments predisposes technicians to high levels of physiological strain. It has been proposed that a perceptual strain index (PeSI) using subjective ratings of thermal sensation and perceived exertion as surrogate measures of core body temperature and heart rate, may provide an accurate estimation of physiological strain. Therefore, this study aimed to determine if the PeSI could estimate the physiological strain index (PSI) across a range of metabolic workloads and environments while wearing heavy EOD and chemical protective clothing. Methods Eleven healthy males wore an EOD and chemical protective ensemble while walking on a treadmill at 2.5, 4 and 5.5 km·h− 1 at 1% grade in environmental conditions equivalent to wet bulb globe temperature (WBGT) 21, 30 and 37 °C. WBGT conditions were randomly presented and a maximum of three randomised treadmill walking trials were completed in a single testing day. Trials were ceased at a maximum of 60-min or until the attainment of termination criteria. A Pearson's correlation coefficient, mixed linear model, absolute agreement and receiver operating characteristic (ROC) curves were used to determine the relationship between the PeSI and PSI. Results A significant moderate relationship between the PeSI and the PSI was observed [r = 0.77; p < 0.001; mean difference = 0.8 ± 1.1 a.u. (modified 95% limits of agreement − 1.3 to 3.0)]. The ROC curves indicated that the PeSI had a good predictive power when used with two, single-threshold cut-offs to differentiate between low and high levels of physiological strain (area under curve: PSI three cut-off = 0.936 and seven cut-off = 0.841). Conclusions These findings support the use of the PeSI for monitoring physiological strain while wearing EOD and chemical protective clothing. However, future research is needed to confirm the validity of the PeSI for active EOD technicians operating in the field.

Validity of the OMNI rating of perceived exertion scale for children and adolescents with cerebral palsy

Aim This study evaluated the validity of the OMNI Walk/Run Rating of Perceived Exertion (OMNI-RPE) scores with heart rate and oxygen consumption (VO2) for children and adolescents with cerebral palsy (CP). Method Children and adolescents with CP, aged 6 to 18 years and Gross Motor Function Classification System (GMFCS) levels I to III completed a physical activity protocol with seven trials ranging in intensity from sedentary to moderate-to-vigorous. VO2 and heart rate were recorded during the physical activity trials using a portable indirect calorimeter and heart rate monitor. Participants reported OMNI-RPE scores for each trial. Concurrent validity was assessed by calculating the average within-subject correlation between OMNI-RPE ratings and the two physiological indices. Results For the correlational analyses, 48 participants (22 males, 26 females; age 12y 6mo, SD 3y 4mo) had valid bivariate data for VO2 and OMNI-RPE, while 40 participants (21 males, 19 females; age 12y 5mo, SD 2y 9mo) had valid bivariate data for heart rate and OMNI-RPE. VO2 (r=0.80; 95% CI 0.66–0.88) and heart rate (r=0.83; 95% CI 0.70–0.91) were moderately to highly correlated to OMNI-RPE scores. No difference was found for the correlation of physiological data and OMNI-RPE scores across the three GMFCS levels. The OMNI-RPE scores increased significantly in a dose-response manner (F6,258=116.1, p<0.001) as exercise intensity increased from sedentary to moderate-to-vigorous. Interpretation OMNI-RPE is a clinically feasible option to monitor exercise intensity in ambulatory children and adolescents with CP.

Entorhinal cortex volume in older adults: reliability and validity considerations for three published measurement protocols.

Measuring the entorhinal cortex (ERC) is challenging due to lateral border discrimination from the perirhinal cortex. From a sample of 39 nondemented older adults who completed volumetric image scans and verbal memory indices, we examined reliability and validity concerns for three ERC protocols with different lateral boundary guidelines (i.e., Goncharova, Dickerson, Stoub, & deToledo-Morrell, 2001; Honeycutt et al., 1998; Insausti et al., 1998). We used three novice raters to assess inter-rater reliability on a subset of scans (216 total ERCs), with the entire dataset measured by one rater with strong intra-rater reliability on each technique (234 total ERCs). We found moderate to strong inter-rater reliability for two techniques with consistent ERC lateral boundary endpoints (Goncharova, Honeycutt), with negligible to moderate reliability for the technique requiring consideration of collateral sulcal depth (Insausti). Left ERC and story memory associations were moderate and positive for two techniques designed to exclude the perirhinal cortex (Insausti, Goncharova), with the Insausti technique continuing to explain 10% of memory score variance after additionally controlling for depression symptom severity. Right ERC-story memory associations were nonexistent after excluding an outlier. Researchers are encouraged to consider challenges of rater training for ERC techniques and how lateral boundary endpoints may impact structure-function associations.