Análisis y preparación estadística de variables para el diseño de un modelo credit score de gestión de riesgo de crédito

El presente estudio busca enfatizar la labor previa a la construcción de cualquier modelo de gestión de riesgo crediticio basado en un sistema tipo scoring. Esta importante fase inicial involucra la identificación de las fuentes de información, la verificación de la cantidad y calidad de los datos, la determinación y tipificación de variables cualitativas, cuantitativas, demográficas, así como la verificación y cuantificación del poder discriminante de dichas variables respecto el objetivo planteado. Con este fin se profundiza en el análisis estadístico a nivel descriptivo, en forma individual y conjunta de los datos, además de bosquejar los pasos esenciales en la arquitectura de un modelo credit score de gestión de riesgo crediticio.

El riesgo de crédito: Construcción de un modelo de score de calificación de cartera para los afiliados del ISSFA

El Instituto de Seguridad Social de las Fuerzas Armadas ISSFA, dentro de su misión de servicio social otorga a sus afiliados, militares activos y pasivos, sus dependientes y derechohabientes, diferentes tipos de prestaciones y servicios, dentro de los cuales se encuentran los préstamos quirografarios e hipotecarios, los mismos que, a pesar de contar con una eficiente administración por procesos y el retorno a través del descuento por rol de pagos, mantiene un cierto porcentaje de cartera vencida, debido a la inadecuada calificación del sujeto de crédito, ocasionando que por definición no se puedan trasladar las pérdidas generadas del incumplimiento de pago y sean absorbidas consecuentemente por el patrimonio de la Institución. El objetivo de este trabajo es lograr por tanto, que el ISSFA, a través de la implementación de un modelo de Score de Calificación de Cartera para sus afiliados, logre en primer lugar, identificar las variables y factores de riesgo de crédito que alteran el normal funcionamiento del negocio, a través de un análisis estadístico minucioso de la base de datos institucional, con el fin de que se tomen las medidas necesarias para la identificación, medición, mitigación y control del riesgo crediticio, y, en segundo lugar, ponderar las diferentes características de un prestatario, un prestamista y un préstamo, a fin de minimizar las pérdidas esperadas y dar cumplimiento a lo establecido y normado por la Superintendencia de Bancos y Seguros como su entidad de control.

Gestión de riesgo de crédito de la Cooperativa de Ahorro y Crédito Maquita Cushunchic: análisis y preparación estadística de variables para el diseño de un modelo Credit Score de cartera de consumo

El presente estudio busca analizar y preparar estadísticamente un conjunto de variables para el diseño de un modelo de aprobación CREDIT SCORE de cartera de consumo, tipo probabilístico, que apoye al oficial de crédito en la toma de la decisión antes de conceder o no un crédito de consumo; para que la decisión no sea subjetiva sino objetiva, medible (probabilística) apoyada en una ecuación que contenga sustento teórico y empírico dado por la base de datos histórica de la Cooperativa de ahorro y crédito Maquita Cushunchic. En la presente tesis partimos con fundamentación teórica que sustenta nuestro trabajo de investigación. En el segundo capítulo se realiza un diagnostico situacional de la empresa, donde se define la visión, la misión y definición de temas estratégicos. En el tercer capítulo realizaremos un análisis y preparación estadística de variables para el diseño de un modelo de aprobación CREDIT SCORE de cartera de consumo, esta fase involucra “la identificación de las fuentes de información, la verificación de cantidad y calidad de los datos, la determinación y tipificación de variables cualitativas, cuantitativas y demográficas, así como la verificación y cuantificación del poder discriminante de dichas variables respecto al objetivo planteado” 1, todo esto se lo realiza con el objetivo de aplicar un concepto de sistemas de calificación de crédito que se define de la siguiente manera: “la calificación supone que el desempeño de los prestamos futuros con características dadas, será parecido al desempeño de los prestamos pasados con características similares"2. Lo que se busca finalmente es que el modelo sea una herramienta de apoyo empírico que ayude a la toma de decisiones antes de conceder o no un credito. Finalmente termina este trabajo formulando conclusiones y recomendaciones.

Desarrollo de un Score de crédito para el financiamiento automotríz, con base en el análisis estadístico de variables

El mercado automotriz en el Ecuador es uno de los sectores que dinamiza la economía; a través de la producción e importación de vehículos y la comercialización de estos. El crecimiento de este sector en los últimos años ha sido constante y sostenido, al igual que el incremento de financiamientos otorgados a los consumidores o sujetos de crédito para la compra de un vehículo. El presente trabajo tiene como propósito el desarrollo de un score de crédito para el financiamiento automotriz que permita identificar a los buenos y malos solicitantes y así decidir entre otorgar o no el crédito. Para ello se han desarrollado cuatro capítulos. En el primer capítulo se realiza una introducción sobre el mercado automotriz su producción, niveles de importación, cadena de distribución, y otros; además de la composición del parque automotor y problemas de movilidad y el comportamiento de compra y los niveles de crédito automotriz. En el segundo capítulo se trata sobre la base de datos de las organizaciones y los tipos de variables que pueden contener y se explica los tipos de modelos de regresiones que se pueden realizar. En el tercer capítulo se define al modelo de score de crédito y los pasos a seguir para la construcción de este. En el cuarto capítulo se desarrollan todos los pasos para la construcción del score de crédito y en quinto capítulo se encuentran las conclusiones y recomendaciones del presente trabajo.

The binding site distance test score: a robust method for the assessment of predicted protein binding sites

We propose a novel method for scoring the accuracy of protein binding site predictions – the Binding-site Distance Test (BDT) score. Recently, the Matthews Correlation Coefficient (MCC) has been used to evaluate binding site predictions, both by developers of new methods and by the assessors for the community wide prediction experiment – CASP8. Whilst being a rigorous scoring method, the MCC does not take into account the actual 3D location of the predicted residues from the observed binding site. Thus, an incorrectly predicted site that is nevertheless close to the observed binding site will obtain an identical score to the same number of nonbinding residues predicted at random. The MCC is somewhat affected by the subjectivity of determining observed binding residues and the ambiguity of choosing distance cutoffs. By contrast the BDT method produces continuous scores ranging between 0 and 1, relating to the distance between the predicted and observed residues. Residues predicted close to the binding site will score higher than those more distant, providing a better reflection of the true accuracy of predictions. The CASP8 function predictions were evaluated using both the MCC and BDT methods and the scores were compared. The BDT was found to strongly correlate with the MCC scores whilst also being less susceptible to the subjectivity of defining binding residues. We therefore suggest that this new simple score is a potentially more robust method for future evaluations of protein-ligand binding site predictions.

The sequential analysis of repeated binary responses: a score test for the case of three time points

In this paper a robust method is developed for the analysis of data consisting of repeated binary observations taken at up to three fixed time points on each subject. The primary objective is to compare outcomes at the last time point, using earlier observations to predict this for subjects with incomplete records. A score test is derived. The method is developed for application to sequential clinical trials, as at interim analyses there will be many incomplete records occurring in non-informative patterns. Motivation for the methodology comes from experience with clinical trials in stroke and head injury, and data from one such trial is used to illustrate the approach. Extensions to more than three time points and to allow for stratification are discussed. Copyright © 2005 John Wiley & Sons, Ltd.

A score test for binary data with patient non-compliance

A score test is developed for binary clinical trial data, which incorporates patient non-compliance while respecting randomization. It is assumed in this paper that compliance is all-or-nothing, in the sense that a patient either accepts all of the treatment assigned as specified in the protocol, or none of it. Direct analytic comparisons of the adjusted test statistic for both the score test and the likelihood ratio test are made with the corresponding test statistics that adhere to the intention-to-treat principle. It is shown that no gain in power is possible over the intention-to-treat analysis, by adjusting for patient non-compliance. Sample size formulae are derived and simulation studies are used to demonstrate that the sample size approximation holds. Copyright © 2003 John Wiley & Sons, Ltd.

Sparse kernel density construction using orthogonal forward regression with leave-one-out test score and local regularization

This paper presents an efficient construction algorithm for obtaining sparse kernel density estimates based on a regression approach that directly optimizes model generalization capability. Computational efficiency of the density construction is ensured using an orthogonal forward regression, and the algorithm incrementally minimizes the leave-one-out test score. A local regularization method is incorporated naturally into the density construction process to further enforce sparsity. An additional advantage of the proposed algorithm is that it is fully automatic and the user is not required to specify any criterion to terminate the density construction procedure. This is in contrast to an existing state-of-art kernel density estimation method using the support vector machine (SVM), where the user is required to specify some critical algorithm parameter. Several examples are included to demonstrate the ability of the proposed algorithm to effectively construct a very sparse kernel density estimate with comparable accuracy to that of the full sample optimized Parzen window density estimate. Our experimental results also demonstrate that the proposed algorithm compares favorably with the SVM method, in terms of both test accuracy and sparsity, for constructing kernel density estimates.

A combined score test for binary and ordinal endpoints from clinical trials

There is growing interest, especially for trials in stroke, in combining multiple endpoints in a single clinical evaluation of an experimental treatment. The endpoints might be repeated evaluations of the same characteristic or alternative measures of progress on different scales. Often they will be binary or ordinal, and those are the cases studied here. In this paper we take a direct approach to combining the univariate score statistics for comparing treatments with respect to each endpoint. The correlations between the score statistics are derived and used to allow a valid combined score test to be applied. A sample size formula is deduced and application in sequential designs is discussed. The method is compared with an alternative approach based on generalized estimating equations in an illustrative analysis and replicated simulations, and the advantages and disadvantages of the two approaches are discussed.

Equitability revisited: why the “equitable threat score” is not equitable

In the forecasting of binary events, verification measures that are “equitable” were defined by Gandin and Murphy to satisfy two requirements: 1) they award all random forecasting systems, including those that always issue the same forecast, the same expected score (typically zero), and 2) they are expressible as the linear weighted sum of the elements of the contingency table, where the weights are independent of the entries in the table, apart from the base rate. The authors demonstrate that the widely used “equitable threat score” (ETS), as well as numerous others, satisfies neither of these requirements and only satisfies the first requirement in the limit of an infinite sample size. Such measures are referred to as “asymptotically equitable.” In the case of ETS, the expected score of a random forecasting system is always positive and only falls below 0.01 when the number of samples is greater than around 30. Two other asymptotically equitable measures are the odds ratio skill score and the symmetric extreme dependency score, which are more strongly inequitable than ETS, particularly for rare events; for example, when the base rate is 2% and the sample size is 1000, random but unbiased forecasting systems yield an expected score of around −0.5, reducing in magnitude to −0.01 or smaller only for sample sizes exceeding 25 000. This presents a problem since these nonlinear measures have other desirable properties, in particular being reliable indicators of skill for rare events (provided that the sample size is large enough). A potential way to reconcile these properties with equitability is to recognize that Gandin and Murphy’s two requirements are independent, and the second can be safely discarded without losing the key advantages of equitability that are embodied in the first. This enables inequitable and asymptotically equitable measures to be scaled to make them equitable, while retaining their nonlinearity and other properties such as being reliable indicators of skill for rare events. It also opens up the possibility of designing new equitable verification measures.

A method for the economic valuation of animal welfare benefits using a single welfare score

Unless the benefits to society of measures to protect and improve the welfare of animals are made transparent by means of their valuation they are likely to go unrecognised and cannot easily be weighed against the costs of such measures as required, for example, by policy-makers. A simple single measure scoring system, based on the Welfare Quality® index, is used, together with a choice experiment economic valuation method, to estimate the value that people place on improvements to the welfare of different farm animal species measured on a continuous (0-100) scale. Results from using the method on a survey sample of some 300 people show that it is able to elicit apparently credible values. The survey found that 96% of respondents thought that we have a moral obligation to safeguard the welfare of animals and that over 72% were concerned about the way farm animals are treated. Estimated mean annual willingness to pay for meat from animals with improved welfare of just one point on the scale was £5.24 for beef cattle, £4.57 for pigs and £5.10 for meat chickens. Further development of the method is required to capture the total economic value of animal welfare benefits. Despite this, the method is considered a practical means for obtaining economic values that can be used in the cost-benefit appraisal of policy measures intended to improve the welfare of animals.

Estimating reliability and resolution of probability forecasts through decomposition of the empirical score

References (20)Cited By (1)Export CitationAboutAbstract Proper scoring rules provide a useful means to evaluate probabilistic forecasts. Independent from scoring rules, it has been argued that reliability and resolution are desirable forecast attributes. The mathematical expectation value of the score allows for a decomposition into reliability and resolution related terms, demonstrating a relationship between scoring rules and reliability/resolution. A similar decomposition holds for the empirical (i.e. sample average) score over an archive of forecast–observation pairs. This empirical decomposition though provides a too optimistic estimate of the potential score (i.e. the optimum score which could be obtained through recalibration), showing that a forecast assessment based solely on the empirical resolution and reliability terms will be misleading. The differences between the theoretical and empirical decomposition are investigated, and specific recommendations are given how to obtain better estimators of reliability and resolution in the case of the Brier and Ignorance scoring rule.