Matching of catalogues by probabilistic pattern classification

We consider the statistical problem of catalogue matching from a machine learning perspective with the goal of producing probabilistic outputs, and using all available information. A framework is provided that unifies two existing approaches to producing probabilistic outputs in the literature, one based on combining distribution estimates and the other based on combining probabilistic classifiers. We apply both of these to the problem of matching the HI Parkes All Sky Survey radio catalogue with large positional uncertainties to the much denser SuperCOSMOS catalogue with much smaller positional uncertainties. We demonstrate the utility of probabilistic outputs by a controllable completeness and efficiency trade-off and by identifying objects that have high probability of being rare. Finally, possible biasing effects in the output of these classifiers are also highlighted and discussed.

Machine learning for matching astronomy catalogues

An emerging issue in the field of astronomy is the integration, management and utilization of databases from around the world to facilitate scientific discovery. In this paper, we investigate application of the machine learning techniques of support vector machines and neural networks to the problem of amalgamating catalogues of galaxies as objects from two disparate data sources: radio and optical. Formulating this as a classification problem presents several challenges, including dealing with a highly unbalanced data set. Unlike the conventional approach to the problem (which is based on a likelihood ratio) machine learning does not require density estimation and is shown here to provide a significant improvement in performance. We also report some experiments that explore the importance of the radio and optical data features for the matching problem.

Intercluster filaments of galaxies programme: Pilot study survey and results

We present results from a pilot study of a new wide-field, multicolour (BVR) CCD imaging project, designed to examine galaxy evolution along large-scale filaments that connect clusters of galaxies at intermediate redshifts (0.07 < z < 0.20). Our pilot data set is based on 0.56 deg(2) of observations targeted on Abell 1079 and Abell 1084 using the Wide Field Imager on the Anglo-Australian Telescope. We describe our data reduction pipeline and show that our photometric error is 0.04 mag. By selecting galaxies that lie on the colour-magnitude relation of the two clusters we verify the existence of a low-density (similar to3-4 Mpc(-2)) filament population, conjoining them at a distance of > 3r(Abell) from either cluster. By applying a simple field correction, we characterize this filament population by examining their colour distribution on a (V-R)-(B-V) plane. We confirm the galaxian filament detection at a 7.5 sigma level using a cut at M-V = -18 and we discuss their broad properties.

The HIPASS catalogue - I. Data presentation

The H I Parkes All-Sky Survey (HIPASS) catalogue forms the largest uniform catalogue of H I sources compiled to date, with 4315 sources identified purely by their H I content. The catalogue data comprise the southern region delta < + 2&DEG; of HIPASS, the first blind H I survey to cover the entire southern sky. The rms noise for this survey is 13 mJy beam(-1) and the velocity range is -1280 to 12 700 km s(-1). Data search, verification and parametrization methods are discussed along with a description of measured quantities. Full catalogue data are made available to the astronomical community including positions, velocities, velocity widths, integrated fluxes and peak flux densities. Also available are on-sky moment maps, position-velocity moment maps and spectra of catalogue sources. A number of local large-scale features are observed in the space distribution of sources, including the super-Galactic plane and the Local Void. Notably, large-scale structure is seen at low Galactic latitudes, a region normally obscured at optical wavelengths.

The HIPASS catalogue - III. Optical counterparts and isolated dark galaxies

We present the largest catalogue to date of optical counterparts for H I radio-selected galaxies, HOPCAT. Of the 4315 H I radio-detected sources from the H I Parkes All Sky Survey (HIPASS) catalogue, we find optical counterparts for 3618 (84 per cent) galaxies. Of these, 1798 (42 per cent) have confirmed optical velocities and 848 (20 per cent) are single matches without confirmed velocities. Some galaxy matches are members of galaxy groups. From these multiple galaxy matches, 714 (16 per cent) have confirmed optical velocities and a further 258 (6 per cent) galaxies are without confirmed velocities. For 481 (11 per cent), multiple galaxies are present but no single optical counterpart can be chosen and 216 (5 per cent) have no obvious optical galaxy present. Most of these 'blank fields' are in crowded fields along the Galactic plane or have high extinctions. Isolated 'dark galaxy' candidates are investigated using an extinction cut of A(Bj) < 1 mag and the blank-fields category. Of the 3692 galaxies with an A(Bj) extinction < 1 mag, only 13 are also blank fields. Of these, 12 are eliminated either with follow-up Parkes observations or are in crowded fields. The remaining one has a low surface brightness optical counterpart. Hence, no isolated optically dark galaxies have been found within the limits of the HIPASS survey.

Applying machine learning to catalogue matching in astrophysics

We present the results of applying automated machine learning techniques to the problem of matching different object catalogues in astrophysics. In this study, we take two partially matched catalogues where one of the two catalogues has a large positional uncertainty. The two catalogues we used here were taken from the H I Parkes All Sky Survey (HIPASS) and SuperCOSMOS optical survey. Previous work had matched 44 per cent (1887 objects) of HIPASS to the SuperCOSMOS catalogue. A supervised learning algorithm was then applied to construct a model of the matched portion of our catalogue. Validation of the model shows that we achieved a good classification performance (99.12 per cent correct). Applying this model to the unmatched portion of the catalogue found 1209 new matches. This increases the catalogue size from 1887 matched objects to 3096. The combination of these procedures yields a catalogue that is 72 per cent matched.

Calibrating photometric redshifts of luminous red galaxies

We discuss the construction of a photometric redshift catalogue of luminous red galaxies (LRGs) from the Sloan Digital Sky Survey (SDSS), emphasizing the principal steps necessary for constructing such a catalogue: (i) photometrically selecting the sample, (ii) measuring photometric redshifts and their error distributions, and (iii) estimating the true redshift distribution. We compare two photometric redshift algorithms for these data and find that they give comparable results. Calibrating against the SDSS and SDSS-2dF (Two Degree Field) spectroscopic surveys, we find that the photometric redshift accuracy is sigma similar to 0.03 for redshifts less than 0.55 and worsens at higher redshift (similar to 0.06 for z < 0.7). These errors are caused by photometric scatter, as well as systematic errors in the templates, filter curves and photometric zero-points. We also parametrize the photometric redshift error distribution with a sum of Gaussians and use this model to deconvolve the errors from the measured photometric redshift distribution to estimate the true redshift distribution. We pay special attention to the stability of this deconvolution, regularizing the method with a prior on the smoothness of the true redshift distribution. The methods that we develop are applicable to general photometric redshift surveys.

Galaxy groups : Proceedings from a Swinburne University workshop

We present the proceedings from a two-day workshop held at Swinburne University on 2005 May 24-25. The workshop participants highlighted current Australian research on both theoretical and observational aspects of galaxy groups. These proceedings include short one-page summaries of a number of the talks presented at the workshop. The talks presented ranged from reconciling N-body simulations with observations, to the Hi content of galaxies in groups and the existence of 'dark galaxies'. The formation and existence of ultra-compact dwarfs in groups, and a new supergroup in Eridanus were also discussed.

The 2dF-SDSS LRG and QSO (2SLAQ) luminous red galaxy survey

We present a spectroscopic survey of almost 15 000 candidate intermediate-redshift luminous red galaxies (LRGs) brighter than i = 19.8, observed with 2dF on the Anglo-Australian Telescope. The targets were selected photometrically from the Sloan Digital Sky Survey (SDSS) and lie along two narrow equatorial strips covering 180 deg(2). Reliable redshifts were obtained for 92 per cent of the targets and the selection is very efficient: over 90 per cent have 0.45 < z < 0.8. More than 80 per cent of the similar to 11 000 red galaxies have pure absorption-line spectra consistent with a passively evolving old stellar population. The redshift, photometric and spatial distributions of the LRGs are described. The 2SLAQ data will be released publicly from mid-2006, providing a powerful resource for observational cosmology and the study of galaxy evolution.

The abundance of short proteins in the mammalian proteome

Short proteins play key roles in cell signalling and other processes, but their abundance in the mammalian proteome is unknown. Current catalogues of mammalian proteins exhibit an artefactual discontinuity at a length of 100 aa, so that protein abundance peaks just above this length and falls off sharply below it. To clarify the abundance of short proteins, we identify proteins in the FANTOM collection of mouse cDNAs by analysing synonymous and nonsynonymous substitutions with the computer program CRITICA. This analysis confirms that there is no real discontinuity at length 100. Roughly 10% of mouse proteins are shorter than 100 aa, although the majority of these are variants of proteins longer than 100 aa. We identify many novel short proteins, including a dark matter'' subset containing ones that lack detectable homology to other known proteins. Translation assays confirm that some of these novel proteins can be translated and localised to the secretory pathway.

The large peculiar velocity of the cD galaxy in Abell 3653

We present a catalogue of galaxies in Abell 3653 from observations made with the 2-degree field (2dF) spectrograph at the Anglo-Australian Telescope. Of the 391 objects observed, we find 111 are bona fide members of Abell 3653. We show that the cluster has a velocity of cz= 32 214 +/- 83 km s(-1) (z= 0.10 738 +/- 0.00 027), with a velocity dispersion typical of rich, massive clusters of sigma(cz)= 880(-54)(+66). We find that the cD galaxy has a peculiar velocity of 683 +/- 96 km s(-1) in the cluster rest frame - some 7 sigma away from the mean cluster velocity, making it one of the largest and most significant peculiar velocities found for a cD galaxy to date. We investigate the cluster for signs of substructure, but do not find any significant groupings on any length scale. We consider the implications of our findings on cD formation theories.

The Las Campanas/Anglo-Australian Telescope Rich Cluster Survey - III. Spectroscopic studies of X-ray bright galaxy clusters at z similar to 0.1

We present the analysis of the spectroscopic and photometric catalogues of 11 X-ray luminous clusters at 0.07 < z < 0.16 from the Las Campanas/Anglo-Australian Telescope Rich Cluster Survey. Our spectroscopic data set consists of over 1600 galaxy cluster members, of which two-thirds are outside r(200). These spectra allow us to assign cluster membership using a detailed mass model and expand on our previous work on the cluster colour-magnitude relation ( CMR) where membership was inferred statistically. We confirm that the modal colours of galaxies on the CMR become progressively bluer with increasing radius d( B - R)/dr(p) = - 0.011 +/- 0.003 and with decreasing local galaxy density d( B - R)/dlog ( Sigma)= - 0.062 +/- 0.009. Interpreted as an age effect, we hypothesize that these trends in galaxy colour should be reflected in mean H delta equivalent width. We confirm that passive galaxies in the cluster increase in Hd line strength as dH delta/dr(p) = 0.35 +/- 0.06. Therefore, those galaxies in the cluster outskirts may have younger luminosity-weighted stellar populations; up to 3 Gyr younger than those in the cluster centre assuming d( B - R)/dt = 0.03 mag per Gyr. A variation of star formation rate, as measured by [ O II]lambda 3727 angstrom, with increasing local density of the environment is discernible and is shown to be in broad agreement with previous studies from the 2dF Galaxy Redshift Survey and the Sloan Digital Sky Survey. We divide our spectra into a variety of types based upon the MORPHs classification scheme. We find that clusters at z similar to 0.1 are less active than their higher-redshift analogues: about 60 per cent of the cluster galaxy population is non-star forming, with a further 20 per cent in the post-starburst class and 20 per cent in the currently active class, demonstrating that evolution is visible within the past 2 - 3 Gyr. We also investigate unusual populations of blue and very red non-star forming galaxies and we suggest that the former are likely to be the progenitors of galaxies which will lie on the CMR, while the colours of the latter possibly reflect dust reddening. We show that the cluster galaxies at large radii consist of both backsplash ones and those that are infalling to the cluster for the first time. We make a comparison to the field population at z similar to 0.1 and examine the broad differences between the two populations. Individually, the clusters show significant variation in their galaxy populations which we suggest reflects their recent infall histories.

The Northern HIPASS catalogue - data presentation, completeness and reliability measures

The Northern HIPASS catalogue (NHICAT) is the northern extension of the HIPASS catalogue, HICAT. This extension adds the sky area between the declination (Dec.) range of +2 degrees < delta < +25 degrees 30' to HICAT's Dec. range of -90 degrees < delta < +2 degrees. HIPASS is a blind H I survey using the Parkes Radio Telescope covering 71 per cent of the sky (including this northern extension) and a heliocentric velocity range of - 1280 to 12 700 km s(-1). The entire Virgo Cluster region has been observed in the Northern HIPASS. The galaxy catalogue, NHICAT, contains 1002 sources with nu(hel) > 300 km s(-1). Sources with -300 < nu(hel) < 300 km s(-1) were excluded to avoid contamination by Galactic emission. In total, the entire HIPASS survey has found 5317 galaxies identified purely by their HI content. The full galaxy catalogue is publicly available at http://hipass.aus-vo.org.