Unified framework for construction of rule based classification systems

Automatic generation of classification rules has been an increasingly popular technique in commercial applications such as Big Data analytics, rule based expert systems and decision making systems. However, a principal problem that arises with most methods for generation of classification rules is the overfit-ting of training data. When Big Data is dealt with, this may result in the generation of a large number of complex rules. This may not only increase computational cost but also lower the accuracy in predicting further unseen instances. This has led to the necessity of developing pruning methods for the simplification of rules. In addition, classification rules are used further to make predictions after the completion of their generation. As efficiency is concerned, it is expected to find the first rule that fires as soon as possible by searching through a rule set. Thus a suit-able structure is required to represent the rule set effectively. In this chapter, the authors introduce a unified framework for construction of rule based classification systems consisting of three operations on Big Data: rule generation, rule simplification and rule representation. The authors also review some existing methods and techniques used for each of the three operations and highlight their limitations. They introduce some novel methods and techniques developed by them recently. These methods and techniques are also discussed in comparison to existing ones with respect to efficient processing of Big Data.

Categorization and construction of rule based systems

Expert systems have been increasingly popular for commercial importance. A rule based system is a special type of an expert system, which consists of a set of ‘if-then‘ rules and can be applied as a decision support system in many areas such as healthcare, transportation and security. Rule based systems can be constructed based on both expert knowledge and data. This paper aims to introduce the theory of rule based systems especially on categorization and construction of such systems from a conceptual point of view. This paper also introduces rule based systems for classification tasks in detail.

Rule-based morphological processing in a second language: a behavioural investigation

According to dual-system accounts of English past-tense processing, regular forms are decomposed into their stem and affix (played=play+ed) based on an implicit linguistic rule, whereas irregular forms (kept) are retrieved directly from the mental lexicon. In second language (L2) processing research, it has been suggested that L2 learners do not have rule-based decomposing abilities, so they process regular past-tense forms similarly to irregular ones (Silva & Clahsen 2008), without applying the morphological rule. The present study investigates morphological processing of regular and irregular verbs in Greek-English L2 learners and native English speakers. In a masked-priming experiment with regular and irregular prime-target verb pairs (playedplay/kept-keep), native speakers showed priming effects for regular pairs, compared to unrelated pairs, indicating decomposition; conversely, L2 learners showed inhibitory effects. At the same time, both groups revealed priming effects for irregular pairs. We discuss these findings in the light of available theories on L2 morphological processing.

Computationally efficient rule-based classification for continuous streaming data

Advances in hardware and software technologies allow to capture streaming data. The area of Data Stream Mining (DSM) is concerned with the analysis of these vast amounts of data as it is generated in real-time. Data stream classification is one of the most important DSM techniques allowing to classify previously unseen data instances. Different to traditional classifiers for static data, data stream classifiers need to adapt to concept changes (concept drift) in the stream in real-time in order to reflect the most recent concept in the data as accurately as possible. A recent addition to the data stream classifier toolbox is eRules which induces and updates a set of expressive rules that can easily be interpreted by humans. However, like most rule-based data stream classifiers, eRules exhibits a poor computational performance when confronted with continuous attributes. In this work, we propose an approach to deal with continuous data effectively and accurately in rule-based classifiers by using the Gaussian distribution as heuristic for building rule terms on continuous attributes. We show on the example of eRules that incorporating our method for continuous attributes indeed speeds up the real-time rule induction process while maintaining a similar level of accuracy compared with the original eRules classifier. We termed this new version of eRules with our approach G-eRules.

Quantitative single-molecule localization microscopy combined with rule-based modeling reveals ligand-induced TNF-R1 reorganization toward higher-order oligomers

We report on the assembly of tumor necrosis factor receptor 1 (TNF-R1) prior to ligand activation and its ligand-induced reorganization at the cell membrane. We apply single-molecule localization microscopy to obtain quantitative information on receptor cluster sizes and copy numbers. Our data suggest a dimeric pre-assembly of TNF-R1, as well as receptor reorganization toward higher oligomeric states with stable populations comprising three to six TNF-R1. Our experimental results directly serve as input parameters for computational modeling of the ligand-receptor interaction. Simulations corroborate the experimental finding of higher-order oligomeric states. This work is a first demonstration how quantitative, super-resolution and advanced microscopy can be used for systems biology approaches at the single-molecule and single-cell level.

Measuring moral judgement and the implications of cooperative education and rule-based learning

The Defining Issues Test (DIT), developed by Rest (1986), measures a person's level of moral development using hypothetical social dilemmas. Although the DIT is useful for measuring moral development in social settings, it might not adequately capture an individual's moral judgement abilities in solving work-related problems (Weber, 1990; Trevino, 1992; Welton et al., 1994). In the present study, the moral judgement levels of 97 accounting students were measured over a 1 year period using two separate test instruments, the DIT and a context-specific instrument developed by Welton et al. (1994). The test scores are significantly higher on the DIT than the Welton instrument (between the instruments and over time), suggesting that accounting students use higher levels of moral reasoning in resolving hypothetical social dilemmas and lower levels of moral reasoning in resolving context-specific dilemmas. The difference in test scores was highest during cooperative education (work placement programme), implying that the environment is a significant determinant on students' test scores.

Rule-based dependency models for security protocol analysis

Security protocol analysis has been discussed for quite some time in the past few years. Although formal methods have been widely used to identify various vulnerabilities, mainly susceptibility to freshness attacks and impersonation, the arisen inconsistent data between principals and collusion attacks held by a group of dishonest principals have been largely ignored. Moreover, the previous methods focus on reasoning about certain security-related properties and detecting known attacks against secure message, whereas there have been insufficient efforts to handle the above hidden but powerful attacks. In this paper, we address these critical issues and prove the efficiency and intuitiveness of rule-based dependency models in defending a protocol against the attacks. This is able to provide a numerical estimation to measure he occurrence of these attacks. It will be useful in enhancing the current protocol analysis.

A rule-based intelligent energy management system for an internal combustion engine vehicle

An intelligent energy management system (IEMS) is developed to improve fuel efficiency of an internal combustion engine vehicle. It helps determine the best approach to run the engine system through dynamically analysing various factors relating to vehicle. The energy balance technique is implemented and utilised. The simulation outcome of the IEMS is compared against that of a conventional system under the same driving factors. The results show that the IEMS reduces the fuel consumption around 5.6% for the tested conditions.

The application of a fuzzy rule based system in an exposition of the antecedents of sedge warbler song flight

The utilization of a fuzzy aspect within data analysis attempts to move from a quantitative to a more qualitative investigative environment. As such, this may allow the more non-quantitative researchers results they can use, based on sets of linguistic terms. In this paper an inductive fuzzy decision tree approach is utilized to construct a fuzzy-rule-based system for the first time in a biological setting. The specific biological problem considered attempts to identify the antecedents (conditions in the fuzzy decision rules) which characterize the length of song flight of the male sedge warbler when attempting to attract a mate. Hence, for a non-quantitative investigator the resultant set of fuzzy rules allows an insight into the linguistic interpretation on the relationship between associated characteristics and the respective song flight duration.

Potential applications of discrete-event simulation and fuzzy rule-based systems to structural reliability and availability

This chapter discusses and illustrates some potential applications of discrete-event simulation (DES) techniques in structural reliability and availability analysis, emphasizing the convenience of using probabilistic approaches in modern building and civil engineering practices. After reviewing existing literature on the topic, some advantages of probabilistic techniques over analytical ones are highlighted. Then, we introduce a general framework for performing structural reliability and availability analysis through DES. Our methodology proposes the use of statistical distributions and techniques – such as survival analysis – to model component-level reliability. Then, using failure- and repair-time distributions and information about the structural logical topology (which allows determination of the structural state from their components’ state), structural reliability, and availability information can be inferred. Two numerical examples illustrate some potential applications of the proposed methodology to achieving more reliable and structural designs. Finally, an alternative approach to model uncertainty at component level is also introduced as ongoing work. This new approach is based on the use of fuzzy rule-based systems and it allows the introduction of experts’ opinions and evaluations in our methodology.

Rule pruning in a fuzzy rule-based classification system

In this paper, we purpose a rule pruning strategy to reduce the number of rules in a fuzzy rule-based classification system.A confidence factor, which is formulated based on the compatibility of the rules with the input patterns is under deployed for rule pruning.The pruning strategy aims at reducing the complexity of the fuzzy classification system and, at the same time, maintaining the accuracy rate at a good level.To evaluate the effectiveness of the pruning strategy, two benchmark data sets are first tested. Then, a fault classification problem with real senor measurements collected from a power generation plant is evaluated.The results obtained are analyzed and explained, and implications of the proposed rule pruning strategy to the fuzzy classification system are discussed.

A new monotonicity index for fuzzy rule-based systems

A search in the literature reveals that mathematical conditions (usually sufficient conditions) for the Fuzzy Inference System (FIS) models to satisfy the monotonicity property have been developed. A monotonically-ordered fuzzy rule base is important to maintain the monotonicity property of an FIS. However, it may difficult to obtain a monotonically-ordered fuzzy rule base in practice. We have previously introduced the idea of fuzzy rule relabeling to tackle this problem. In this paper, we further propose a monotonicity index for the FIS system, which serves as a metric to indicate the degree of a fuzzy rule base fulfilling the monotonicity property. The index is useful to provide an indication whether a fuzzy rule base should (or should not) be used in practice, even with fuzzy rule relabeling. To illustrate the idea, the zero-order Sugeno FIS model is exemplified. We add noise as errors into the fuzzy rule base to formulate a set of non-monotone fuzzy rules. As such, the metric also acts as a measure of noise in the fuzzy rule base. The results show that the proposed metric is useful to indicate the degree of a fuzzy rule base fulfilling the monotonicity property.