Improving the performance of model-order selection criteria by partial-model selection search

The traditional searching method for model-order selection in linear regression is a nested full-parameters-set searching procedure over the desired orders, which we call full-model order selection. On the other hand, a method for model-selection searches for the best sub-model within each order. In this paper, we propose using the model-selection searching method for model-order selection, which we call partial-model order selection. We show by simulations that the proposed searching method gives better accuracies than the traditional one, especially for low signal-to-noise ratios over a wide range of model-order selection criteria (both information theoretic based and bootstrap-based). Also, we show that for some models the performance of the bootstrap-based criterion improves significantly by using the proposed partial-model selection searching method. Index Terms— Model order estimation, model selection, information theoretic criteria, bootstrap 1. INTRODUCTION Several model-order selection criteria can be applied to find the optimal order. Some of the more commonly used information theoretic-based procedures include Akaike’s information criterion (AIC) [1], corrected Akaike (AICc) [2], minimum description length (MDL) [3], normalized maximum likelihood (NML) [4], Hannan-Quinn criterion (HQC) [5], conditional model-order estimation (CME) [6], and the efficient detection criterion (EDC) [7]. From a practical point of view, it is difficult to decide which model order selection criterion to use. Many of them perform reasonably well when the signal-to-noise ratio (SNR) is high. The discrepancies in their performance, however, become more evident when the SNR is low. In those situations, the performance of the given technique is not only determined by the model structure (say a polynomial trend versus a Fourier series) but, more importantly, by the relative values of the parameters within the model. This makes the comparison between the model-order selection algorithms difficult as within the same model with a given order one could find an example for which one of the methods performs favourably well or fails [6, 8]. Our aim is to improve the performance of the model order selection criteria in cases where the SNR is low by considering a model-selection searching procedure that takes into account not only the full-model order search but also a partial model order search within the given model order. Understandably, the improvement in the performance of the model order estimation is at the expense of additional computational complexity.

Modal parameter estimation in the presence of non-linearities

This paper investigates the use of time-frequency techniques to assist in the estimation of power system modes which are resolvable by a Digital Fourier Transform (DFT). The limitations of linear estimation techniques in the presence of large disturbances which excite system non-linearities, particularly the swing equation non-linearity are shown. Where a nonlinearity manifests itself as time varying modal frequencies the Wigner-Ville Distribution (WVD) is used to describe the variation in modal frequencies and construct a window over which standard linear estimation techniques can be used. The error obtained even in the presence of multiple resolvable modes is better than 2%.

Linear stern waves in finite depth channels

This paper formulates an analytically tractable problem for the wake generated by a long flat bottom ship by considering the steady free surface flow of an inviscid, incompressible fluid emerging from beneath a semi-infinite rigid plate. The flow is considered to be irrotational and two-dimensional so that classical potential flow methods can be exploited. In addition, it is assumed that the draft of the plate is small compared to the depth of the channel. The linearised problem is solved exactly using a Fourier transform and the Wiener-Hopf technique, and it is shown that there is a family of subcritical solutions characterised by a train of sinusoidal waves on the downstream free surface. The amplitude of these waves decreases as the Froude number increases. Supercritical solutions are also obtained, but, in general, these have infinite vertical velocities at the trailing edge of the plate. Consideration of further terms in the expansions suggests a way of canceling the singularity for certain values of the Froude number.

The delta-phase spectrum with application to voice activity detection and speaker recognition

For several reasons, the Fourier phase domain is less favored than the magnitude domain in signal processing and modeling of speech. To correctly analyze the phase, several factors must be considered and compensated, including the effect of the step size, windowing function and other processing parameters. Building on a review of these factors, this paper investigates a spectral representation based on the Instantaneous Frequency Deviation, but in which the step size between processing frames is used in calculating phase changes, rather than the traditional single sample interval. Reflecting these longer intervals, the term delta-phase spectrum is used to distinguish this from instantaneous derivatives. Experiments show that mel-frequency cepstral coefficients features derived from the delta-phase spectrum (termed Mel-Frequency delta-phase features) can produce broadly similar performance to equivalent magnitude domain features for both voice activity detection and speaker recognition tasks. Further, it is shown that the fusion of the magnitude and phase representations yields performance benefits over either in isolation.

Free surface flow into a horizontal slot with zero gravity

The two-dimensional free surface flow of a finite-depth fluid into a horizontal slot is considered. For this study, the effects of viscosity and gravity are ignored. A generalised Schwarz-Christoffel mapping is used to formulate the problem in terms of a linear integral equation, which is solved exactly with the use of a Fourier transform. The resulting free surface profile is given explicitly in closed-form.

Digital image processing techniques for pavement macro-texture analysis

Road surface macro-texture is an indicator used to determine the skid resistance levels in pavements. Existing methods of quantifying macro-texture include the sand patch test and the laser profilometer. These methods utilise the 3D information of the pavement surface to extract the average texture depth. Recently, interest in image processing techniques as a quantifier of macro-texture has arisen, mainly using the Fast Fourier Transform (FFT). This paper reviews the FFT method, and then proposes two new methods, one using the autocorrelation function and the other using wavelets. The methods are tested on pictures obtained from a pavement surface extending more than 2km's. About 200 images were acquired from the surface at approx. 10m intervals from a height 80cm above ground. The results obtained from image analysis methods using the FFT, the autocorrelation function and wavelets are compared with sensor measured texture depth (SMTD) data obtained from the same paved surface. The results indicate that coefficients of determination (R2) exceeding 0.8 are obtained when up to 10% of outliers are removed.

Thermal behavior and decomposition of kaolinite-potassium acetate intercalation composite

A series of kaolinite-potassium acetate intercalation composite was prepared. The thermal behavior and decomposition of these composites were investigated by simultaneous differential scanning calorimetry-thermogravimetric analysis (DSC-TGA), X-ray diffraction (XRD) and Fourier-transformation infrared (FT-IR). The XRD pattern at room temperature indicated that intercalation of potassium acetate into kaolinite causes an increase of the basal spacing from 0.718 to 1.428nm. The peak intensity of the expanded phase of the composite decreased with heating above 300°C, and the basal spacing reduced to 1.19nm at 350°C and 0.718nm at 400°C. These were supported by DSC-TGA and FT-IR measurements, where the endothermic reactions are observed between 300 and 600°C. These reactions can be divided into two stages: 1) Removal of the intercalated molecules between 300-400°C. 2) Dehydroxylation of kaolinite between 400-600°C. Significant changes were observed in the infrared bands assigned to outer surface hydroxyl, inner surface hydroxyl, inner hydroxyl and hydrogen bands.

Characterisation of organoclays and adsorption of p-nitrophenol : environmental application

Organoclays were synthesised through ion exchange of a single surfactant for sodium ions, and characterised by a range of method including X-ray diffraction (XRD), BET, X-ray photoelectron spectroscopy (XPS), thermogravimetric analysis (TGA), Fourier transform infrared spectroscopy (FT-IR), and transmission electron microscopy (TEM). The change in surface properties of montmorillonite and organoclays intercalated with the surfactant, tetradecyltrimethylammonium bromide (TDTMA) were determined using XRD through the change in basal spacing and the expansion occurred by the adsorbed p-nitrophenol. The changes of interlayer spacing were observed in TEM. In addition, the surface measurement such as specific surface area and pore volume was measured and calculated using BET method, this suggested the loaded surfactant is highly important to determine the sorption mechanism onto organoclays. The collected results of XPS provided the chemical composition of montmorillonite and organoclays, and the high-resolution XPS spectra offered the chemical states of prepared organoclays with binding energy. Using TGA and FT-IR, the confirmation of intercalated surfactant was investigated. The collected data from various techniques enable an understanding of the changes in structure and surface properties. This study is of importance to provide mechanisms for the adsorption of organic molecules, especially in contaminated environmental sites and polluted waters.

A hybrid approach for resolving the electromagnetic fields inside a waveguide loaded with a lossy medium

In this work a novel hybrid approach is presented that uses a combination of both time domain and frequency domain solution strategies to predict the power distribution within a lossy medium loaded within a waveguide. The problem of determining the electromagnetic fields evolving within the waveguide and the lossy medium is decoupled into two components, one for computing the fields in the waveguide including a coarse representation of the medium (the exterior problem) and one for a detailed resolution of the lossy medium (the interior problem). A previously documented cell-centred Maxwell’s equations numerical solver can be used to resolve the exterior problem accurately in the time domain. Thereafter the discrete Fourier transform can be applied to the computed field data around the interface of the medium to estimate the frequency domain boundary condition in-formation that is needed for closure of the interior problem. Since only the electric fields are required to compute the power distribution generated within the lossy medium, the interior problem can be resolved efficiently using the Helmholtz equation. A consistent cell-centred finite-volume method is then used to discretise this equation on a fine mesh and the underlying large, sparse, complex matrix system is solved for the required electric field using the iterative Krylov subspace based GMRES iterative solver. It will be shown that the hybrid solution methodology works well when a single frequency is considered in the evaluation of the Helmholtz equation in a single mode waveguide. A restriction of the scheme is that the material needs to be sufficiently lossy, so that any penetrating waves in the material are absorbed.

High performance additive manufactured scaffolds for bone tissue engineering application

This study demonstrates the feasibility of additive manufactured poly(3-caprolactone)/silanized tricalcium phosphate (PCL/TCP(Si)) scaffolds coated with carbonated hydroxyapatite (CHA)-gelatin composite for bone tissue engineering. In order to reinforce PCL/TCP scaffolds to match the mechanical properties of cancellous bone, TCP has been modified with 3-glycidoxypropyl trimethoxysilane (GPTMS) and incorporated into PCL to synthesize a PCL/TCP(Si) composite. The successful modification is confirmed by X-ray photoelectron spectroscopy (XPS) and Fourier transform infrared spectroscopy (FTIR) analysis. Additive manufactured PCL/TCP(Si) scaffolds have been fabricated using a screw extrusion system (SES). Compression testing demonstrates that both the compressive modulus and compressive yield strength of the developed PCL/TCP(Si) scaffolds fall within the lower ranges of mechanical properties for cancellous bone, with a compressive modulus and compressive yield strength of 6.0 times and 2.3 times of those of PCL/TCP scaffolds, respectively. To enhance the osteoconductive property of the developed PCL/TCP(Si) scaffolds, a CHA-gelatin composite has been coated onto the scaffolds via a biomimetic co-precipitation process, which is verified by using scanning electron microscopy (SEM) and XPS. Confocal laser microscopy and SEM images reveal a most uniform distribution of porcine bone marrow stromal cells (BMSCs) and cellsheet accumulation on the CHA-gelatin composite coated PCL/TCP(Si) scaffolds. The proliferation rate of BMSCs on the CHA-gelatin composite coated PCL/TCP(Si) scaffolds is 2.0 and 1.4 times higher compared to PCL/TCP(Si) and CHA coated PCL/TCP(Si) scaffolds, respectively, by day 10. Furthermore, the reverse transcription polymerase chain reaction (RT-PCR) and western blot analyses reveal that CHA-gelatin composite coated PCL/TCP(Si) scaffolds stimulate osteogenic differentiation of BMSCs the most compared to the other scaffolds. In vitro results of SEM, confocal microscopy and proliferation rate also show that there is no detrimental effect of GPTMS modification on biocompatibility of the scaffolds.