Applying machine learning to catalogue matching in astrophysics

We present the results of applying automated machine learning techniques to the problem of matching different object catalogues in astrophysics. In this study, we take two partially matched catalogues where one of the two catalogues has a large positional uncertainty. The two catalogues we used here were taken from the H I Parkes All Sky Survey (HIPASS) and SuperCOSMOS optical survey. Previous work had matched 44 per cent (1887 objects) of HIPASS to the SuperCOSMOS catalogue. A supervised learning algorithm was then applied to construct a model of the matched portion of our catalogue. Validation of the model shows that we achieved a good classification performance (99.12 per cent correct). Applying this model to the unmatched portion of the catalogue found 1209 new matches. This increases the catalogue size from 1887 matched objects to 3096. The combination of these procedures yields a catalogue that is 72 per cent matched.

Galaxy groups : Proceedings from a Swinburne University workshop

We present the proceedings from a two-day workshop held at Swinburne University on 2005 May 24-25. The workshop participants highlighted current Australian research on both theoretical and observational aspects of galaxy groups. These proceedings include short one-page summaries of a number of the talks presented at the workshop. The talks presented ranged from reconciling N-body simulations with observations, to the Hi content of galaxies in groups and the existence of 'dark galaxies'. The formation and existence of ultra-compact dwarfs in groups, and a new supergroup in Eridanus were also discussed.

Matching of catalogues by probabilistic pattern classification

We consider the statistical problem of catalogue matching from a machine learning perspective with the goal of producing probabilistic outputs, and using all available information. A framework is provided that unifies two existing approaches to producing probabilistic outputs in the literature, one based on combining distribution estimates and the other based on combining probabilistic classifiers. We apply both of these to the problem of matching the HI Parkes All Sky Survey radio catalogue with large positional uncertainties to the much denser SuperCOSMOS catalogue with much smaller positional uncertainties. We demonstrate the utility of probabilistic outputs by a controllable completeness and efficiency trade-off and by identifying objects that have high probability of being rare. Finally, possible biasing effects in the output of these classifiers are also highlighted and discussed.

The effect of local galaxy surface density on star formation for HI selected galaxies

We present the result of investigations into two theories to explain the star formation rate (SFR)-density relationship. For regions of high galaxy density, either there are fewer star-forming galaxies or galaxies capable of forming stars are present but some physical process is suppressing their star formation. We use H I Parkes All-Sky Survey's (HIPASS) HI detected galaxies and infrared and radio fluxes to investigate SFRs and efficiencies with respect to local surface density. For nearby (vel < 10 000 km s(-1)) H I galaxies, we find a strong correlation between H I mass and SFR. The number of H I galaxies decreases with increasing local surface density. For H I galaxies (1000 < vel < 6000 km s(-1)), there is no significant change in the SFR or the efficiency of star formation with respect to local surface density. We conclude that the SFR-density relation is due to a decrease in the number of H I star-forming galaxies in regions of high galaxy density and not to the suppression of star formation.

The 1000 brightest hipass galaxies: The H I mass function and Omega(H I)

We present a new, accurate measurement of the H I mass function of galaxies from the HIPASS Bright Galaxy Catalog, a sample of 1000 galaxies with the highest H I peak flux densities in the southern (delta

The 1000 brightest HIPASS galaxies H I properties

We present the HIPASS Bright Galaxy Catalog (BGC), which contains the 1000 H I brightest galaxies in the southern sky as obtained from the H i Parkes All-Sky Survey ( HIPASS). The selection of the brightest sources is based on their H I peak flux density (S-peak greater than or similar to116 mJy) as measured from the spatially integrated HIPASS spectrum. The derived H I masses range from similar to10(7) to 4 x 10(10) M-.. While the BGC ( z< 0.03) is complete in S-peak, only a subset of &SIM;500 sources can be considered complete in integrated H I flux density (F-H I &GSIM;25 Jy km s(-1)). The HIPASS BGC contains a total of 158 new redshifts. These belong to 91 new sources for which no optical or infrared counterparts have previously been cataloged, an additional 51 galaxies for which no redshifts were previously known, and 16 galaxies for which the cataloged optical velocities disagree. Of the 91 newly cataloged BGC sources, only four are definite H I clouds: while three are likely Magellanic debris with velocities around 400 km s(-1), one is a tidal cloud associated with the NGC 2442 galaxy group. The remaining 87 new BGC sources, the majority of which lie in the zone of avoidance, appear to be galaxies. We identified optical counterparts to all but one of the 30 new galaxies at Galactic latitudes > 10degrees. Therefore, the BGC yields no evidence for a population of free-floating'' intergalactic H I clouds without associated optical counterparts. HIPASS provides a clear view of the local large-scale structure. The dominant features in the sky distribution of the BGC are the Supergalactic Plane and the Local Void. In addition, one can clearly see the Centaurus Wall, which connects via the Hydra and Antlia Clusters to the Puppis Filament. Some previously hardly noticable galaxy groups stand out quite distinctly in the H I sky distribution. Several new structures, including some not behind the Milky Way, are seen for the first time.

The Hi content of compact groups of galaxies

The Hi content of Hickson Compact Groups in the southern hemisphere is measured using data from the Hi Parkes All-Sky Survey (HIPASS), and dedicated observations using the narrow band filter on the Multibeam instrument on the Parkes telescope. The expected Hi mass of these groups was estimated using the luminosity, diameter, and morphological types of the member galaxies, calibrated from published data. Taking careful account of non-detection limits, the results show that the compact group population that has been detected by these observations has an Hi content similar to that of galaxies in the reference field sample. The upper limits for the undetected groups lie within the normal range; improvement of these limits will require a large increase in sensitivity.

The HIPASS catalogue - I. Data presentation

The H I Parkes All-Sky Survey (HIPASS) catalogue forms the largest uniform catalogue of H I sources compiled to date, with 4315 sources identified purely by their H I content. The catalogue data comprise the southern region delta < + 2&DEG; of HIPASS, the first blind H I survey to cover the entire southern sky. The rms noise for this survey is 13 mJy beam(-1) and the velocity range is -1280 to 12 700 km s(-1). Data search, verification and parametrization methods are discussed along with a description of measured quantities. Full catalogue data are made available to the astronomical community including positions, velocities, velocity widths, integrated fluxes and peak flux densities. Also available are on-sky moment maps, position-velocity moment maps and spectra of catalogue sources. A number of local large-scale features are observed in the space distribution of sources, including the super-Galactic plane and the Local Void. Notably, large-scale structure is seen at low Galactic latitudes, a region normally obscured at optical wavelengths.

The HIPASS catalogue - II. Completeness reliability and parameter accuracy

The H I Parkes All Sky Survey (HIPASS) is a blind extragalactic H I 21-cm emission-line survey covering the whole southern sky from declination -90degrees to +25degrees. The HIPASS catalogue (HICAT), containing 4315 H I-selected galaxies from the region south of declination +2degrees, is presented in Meyer et al. (Paper I). This paper describes in detail the completeness and reliability of HICAT, which are calculated from the recovery rate of synthetic sources and follow-up observations, respectively. HICAT is found to be 99 per cent complete at a peak flux of 84 mJy and an integrated flux of 9.4 Jy km. s(-1). The overall reliability is 95 per cent, but rises to 99 per cent for sources with peak fluxes >58 mJy or integrated flux >8.2 Jy km s(-1). Expressions are derived for the uncertainties on the most important HICAT parameters: peak flux, integrated flux, velocity width and recessional velocity. The errors on HICAT parameters are dominated by the noise in the HIPASS data, rather than by the parametrization procedure.

The HIPASS catalogue - III. Optical counterparts and isolated dark galaxies

We present the largest catalogue to date of optical counterparts for H I radio-selected galaxies, HOPCAT. Of the 4315 H I radio-detected sources from the H I Parkes All Sky Survey (HIPASS) catalogue, we find optical counterparts for 3618 (84 per cent) galaxies. Of these, 1798 (42 per cent) have confirmed optical velocities and 848 (20 per cent) are single matches without confirmed velocities. Some galaxy matches are members of galaxy groups. From these multiple galaxy matches, 714 (16 per cent) have confirmed optical velocities and a further 258 (6 per cent) galaxies are without confirmed velocities. For 481 (11 per cent), multiple galaxies are present but no single optical counterpart can be chosen and 216 (5 per cent) have no obvious optical galaxy present. Most of these 'blank fields' are in crowded fields along the Galactic plane or have high extinctions. Isolated 'dark galaxy' candidates are investigated using an extinction cut of A(Bj) < 1 mag and the blank-fields category. Of the 3692 galaxies with an A(Bj) extinction < 1 mag, only 13 are also blank fields. Of these, 12 are eliminated either with follow-up Parkes observations or are in crowded fields. The remaining one has a low surface brightness optical counterpart. Hence, no isolated optically dark galaxies have been found within the limits of the HIPASS survey.

The Northern HIPASS catalogue - data presentation, completeness and reliability measures

The Northern HIPASS catalogue (NHICAT) is the northern extension of the HIPASS catalogue, HICAT. This extension adds the sky area between the declination (Dec.) range of +2 degrees < delta < +25 degrees 30' to HICAT's Dec. range of -90 degrees < delta < +2 degrees. HIPASS is a blind H I survey using the Parkes Radio Telescope covering 71 per cent of the sky (including this northern extension) and a heliocentric velocity range of - 1280 to 12 700 km s(-1). The entire Virgo Cluster region has been observed in the Northern HIPASS. The galaxy catalogue, NHICAT, contains 1002 sources with nu(hel) > 300 km s(-1). Sources with -300 < nu(hel) < 300 km s(-1) were excluded to avoid contamination by Galactic emission. In total, the entire HIPASS survey has found 5317 galaxies identified purely by their HI content. The full galaxy catalogue is publicly available at http://hipass.aus-vo.org.

Transcript annotation in FANTOM3: Mouse gene catalog based on physical cDNAs

T he international FANTOM consortium aims to produce a comprehensive picture of the mammalian transcriptome, based upon an extensive cDNA collection and functional annotation of full-length enriched cDNAs. The previous dataset, FANTOM(2), comprised 60,770 full- length enriched cDNAs. Functional annotation revealed that this cDNA dataset contained only about half of the estimated number of mouse protein- coding genes, indicating that a number of cDNAs still remained to be collected and identified. To pursue the complete gene catalog that covers all predicted mouse genes, cloning and sequencing of full- length enriched cDNAs has been continued since FANTOM2. In FANTOM3, 42,031 newly isolated cDNAs were subjected to functional annotation, and the annotation of 4,347 FANTOM2 cDNAs was updated. To accomplish accurate functional annotation, we improved our automated annotation pipeline by introducing new coding sequence prediction programs and developed a Web- based annotation interface for simplifying the annotation procedures to reduce manual annotation errors. Automated coding sequence and function prediction was followed with manual curation and review by expert curators. A total of 102,801 full- length enriched mouse cDNAs were annotated. Out of 102,801 transcripts, 56,722 were functionally annotated as protein coding ( including partial or truncated transcripts), providing to our knowledge the greatest current coverage of the mouse proteome by full- length cDNAs. The total number of distinct non- protein- coding transcripts increased to 34,030. The FANTOM3 annotation system, consisting of automated computational prediction, manual curation, and. nal expert curation, facilitated the comprehensive characterization of the mouse transcriptome, and could be applied to the transcriptomes of other species.