Customer information system data pre-processing with feature selection techniques for non-technical losses prediction in an electricity market

Non-technical losses (NTL) identification and prediction are important tasks for many utilities. Data from customer information system (CIS) can be used for NTL analysis. However, in order to accurately and efficiently perform NTL analysis, the original data from CIS need to be pre-processed before any detailed NTL analysis can be carried out. In this paper, we propose a feature selection based method for CIS data pre-processing in order to extract the most relevant information for further analysis such as clustering and classifications. By removing irrelevant and redundant features, feature selection is an essential step in data mining process in finding optimal subset of features to improve the quality of result by giving faster time processing, higher accuracy and simpler results with fewer features. Detailed feature selection analysis is presented in the paper. Both time-domain and load shape data are compared based on the accuracy, consistency and statistical dependencies between features.

Inequitable distribution of general practitioners in Australia: estimating need through the Robin Hood Index

Objective: From Census data, to document the distribution of general practitioners in Australia and to estimate the number of general practitioners needed to achieve an equitable distribution accounting for community health need. Methods: Data on location of general practitioners, population size and crude mortality by statistical division (SD) were obtained from the Australian Bureau of Statistics. The number of patients per general practitioner by SD was calculated and plotted. Using crude mortality to estimate community health need, a ratio of the number of general practitioners per person:mortality was calculated for all Australia and for each SD (the Robin Hood Index). From this, the number of general practitioners needed to achieve equity was calculated. Results: In all, 26,290 general practitioners were identified in 57 SDs. The mean number of people per general practitioner is 707, ranging from 551 to 1887. Capital city SDs have most favourable ratios. The Robin Hood Index for Australia is 1, and ranges from 0.32 (relatively under-served) to 2.46 (relatively over-served). Twelve SDs (21%) including all capital cities and 65% of all Australians, have a Robin Hood Index > 1. To achieve equity per capita 2489 more general practitioners (10% of the current workforce) are needed. To achieve equity by the Robin Hood Index 3351 (13% of the current workforce) are needed. Conclusions: The distribution of general practitioners in Australia is skewed. Nonmetropolitan areas are relatively underserved. Census data and the Robin Hood Index could provide a simple means of identifying areas of need in Australia.

Perceived need for mental health care, findings from the Australian National Survey of Mental Health and Well-being

Background. The Australian National Survey of Mental Health and Well-being was designed to detect and describe psychiatric morbidity, associated disability, service use and perceived need for care. The survey employed a single-phase interview methodology, delivering a field questionnaire to a clustered probability sample of 10641 Australians. Perceived need was sampled with an instrument designed for this survey, the Perceived Need for Care Questionnaire (PNCQ). This questionnaire gathers information about five categories of perceived need, assigning each to one of four levels of perceived need. Reliability and validity studies showed satisfactory performance of the instrument. Methods. Perceived need for mental health care in the Australian population has been analysed using PNCQ data, relating this to diagnostic and service utilization data from the above survey. Results. The survey findings indicate that an estimated 13.8 % of the Australian population have perceived need for mental health care. Those who met interview criteria for a psychiatric diagnosis and also expressed perceived need make up 9.9 % of the population. An estimated 11.0% of the population are cases of untreated prevalence, a minority (3.6% of the population) of whom expressed perceived need for mental health care. Among persons using services, those without a psychiatric diagnosis based on interview criteria (4.4% of the population), showed high levels of perceived met need. Conclusions. The overall rate of perceived need found by this methodology lies between those found in the USA and Canada. The findings suggest that service use in the absence of diagnosis elicited by survey questionnaires may often represent successful intervention. In the survey, untreated prevalence was commonly not accompanied by perceived need for mental health care.

Assessing perceived need for mental health care in a community survey: development of the Perceived Need for Care Questionnaire (PNCQ)

Background: The Perceived Need for Care Questionnaire (PNCQ) was designed for the Australian National Survey of Mental Health and Wellbeing. The PNCQ complemented collection of data on diagnosis and disability with the survey participants' perceptions of their needs for mental health care and the meeting of those needs. The four-stage design of the PNCQ mimics a conversational exploration of the topic of perceived needs. Five categories of perceived need are each assigned to one of four levels of perceived need (no need, unmet need, partially met need and met need). For unmet need and partially met need, information on barriers to care is collected, Methods: Inter-rater reliabilities of perceived needs assessed by the PNCQ were examined in a study of 145 anxiety clinic attenders. Construct validity of these items was tested, using a multi-trait multi-method approach and hypotheses regarding extreme groups, in a study with a sample of 51 general practice and community psychiatric service patients. Results: The instrument is brief to administer and has proved feasible for use in various settings. Inter-rater reliabilities for major categories, measured by the kappa statistic, exceeded 0.60 in most cases; for the summary category of all perceived needs, inter-rater reliability was 0.62. The multi-trait multi-method approach lent support to the construct validity of the instrument, as did findings in extreme groups. Conclusions: The PNCQ shows acceptable feasibility, reliability and validity, adding to the range of assessment tools available for epidemiological and health services research.

Review of "Comorbidity, disability and the need for treatment for DSM-IV psychiatric disorders in an insured population"

Background: This study presents estimates of 12 month and current prevalences of DSM-IV disorders, and the related comor-bidity, disability and service utilization, derived from a national probability sample in Australia. Methods: The DSM-IV psychiatric disorders among persons aged 18 and over in the Australian population were assessed with data collected by lay interviewers using the Composite International Diagnostic Interview, other screening interviews and measures of disability and service utilization. The response rate was 78.1% and the final sample size was 10,641 adults. Results: Close to 20% reported at least one twelve month disorder and 13% a disorder current within the past 30 days. ICD-10 diagnoses were also derived, DSM-IV was the more conservative classification whether or not the new clinical significance criteria was applied. Major depression, any personality disorder, and alcohol dependence were the three most common twelve month disorders, generalized anxiety disorder replaced alcohol dependence as the third most common current disorder. The sexes has similar rates of any disorder, but women had higher rates of affective and anxiety disorders, men higher rates of substance use disorders. Prevalence of most disorders declined with age and education, and were lower among those employed or married. Respondents whose symptoms met criteria for three or more disorders in the past year had greatly increased rates of disability and of mental health consultations. The affective and somatoform disorders were associated with the highest rates of disability. Only 36% of people with a mental disorder this year had consulted for a mental problem, and most had seen a general practitioner. We identified those with a current disorder who were disabled or multiply comorbid - only half had consulted and of those who had not, more than half said they did not need treatment. Conclusions: The 12 month prevalence was lower than reported in the US National Comorbidity Survey but method factors might account for this. The relationships between prevalence and demographic variables, and between comorbidity, disability and service utilization were similar to those found in the US survey. Australia has a national health insurance scheme with total coverage and access to medical help is available to all, commonly at little or no cost. We identify the high rate of not consulting among those with a current disorder, and additional disability or multiple comorbidity, as an important public health problem. Kessler argued for more research on barriers to professional help seeking. This report reinforces his conclusion and shows that economic barriers are not the dominant issue.

Perceived need for mental health care: influences of diagnosis, demography and disability

Background. Recent major epidemiological studies have adopted increasingly multidimensional approaches to assessment. Several of these have included some assessment of perceived need for mental health care. The Australian National Survey of Mental Health and Wellbeing, conducted in 1997, included a particularly detailed examination of this construct, with an instrument with demonstrated reliability and validity. Methods. A clustered probability sample of 10641 Australians responded to the field questionnaire for this survey, including questions on perceived need either where there had been service utilization, or where a disorder was detected by administration of sections of the Composite International Diagnostic Interview. The confidentialized unit record file generated from the survey was analysed for determinants of perceived need. Results. Perceived need is increased in females, in people in the middle years of adulthood, and in those who have affective disorders or co-morbidity. Effects of diagnosis and disability can account for most of the differences in gender specific rates. With correction for these effects through regression, there is less perceived need for social interventions and possibly more for counselling in females; disability is confirmed as strongly positively associated with perceived need, as are the presence of affective disorders or co-morbidity. Conclusions. The findings of this study underscore the imperative for mental health services to be attentive and responsive to consumer perceived need. The substantial majority of people who are significantly disabled by mental health problems are among those who see themselves as having such needs.

Reaching those most in need: a review of diabetes self-management interventions in disadvantaged populations

There has been increased recognition of the importance of developing diabetes self-management education (DSME) interventions that are effective with under-served and minority populations. Despite several recent studies in this area, there is to our knowledge no systematic review or synthesis of what has been learned from this research. An electronic literature search identified five formative evaluations and ten controlled DSME intervention trials focused on under-served (low-income, minority or aged) populations. The RE-AIM (Reach, Efficacy, Adoption, Implementation, Maintenance) evaluation framework was used to evaluate the controlled studies on the dimensions of reach, efficacy, adoption, implementation, and maintenance. Fifty percent of the studies identified reported on the percentage of patients who participated, and the percentages were highly variable. The methodological quality of the articles was generally good and the short-term results were encouraging, especially on behavioral outcomes. Data on adoption (representativeness of settings and clinicians who participate) and implementation were almost never reported. Studies of modalities in addition to group meetings are needed to increase the reach of DSME with under-served populations. The promising formative evaluation work that has been conducted needs to be extended for more systematic study of the process of intervention implementation and adaptation with special populations. Studies that explicitly address the community context and that address multiple issues related to public health impact of DSME interventions are recommended to enhance long-term results. Copyright (C) 2002 John Wiley Sons, Ltd.