PAC-Bayes-empirical-Bernstein inequality
Data(s) |
2013
|
---|---|
Resumo |
We present PAC-Bayes-Empirical-Bernstein inequality. The inequality is based on combination of PAC-Bayesian bounding technique with Empirical Bernstein bound. It allows to take advantage of small empirical variance and is especially useful in regression. We show that when the empirical variance is significantly smaller than the empirical loss PAC-Bayes-Empirical-Bernstein inequality is significantly tighter than PAC-Bayes-kl inequality of Seeger (2002) and otherwise it is comparable. PAC-Bayes-Empirical-Bernstein inequality is an interesting example of application of PAC-Bayesian bounding technique to self-bounding functions. We provide empirical comparison of PAC-Bayes-Empirical-Bernstein inequality with PAC-Bayes-kl inequality on a synthetic example and several UCI datasets. |
Formato |
application/pdf |
Identificador | |
Relação |
http://eprints.qut.edu.au/70845/1/70845.pdf http://papers.nips.cc/paper/4903-pac-bayes-empirical-bernstein-inequality Tolstikhin, Ilya & Seldin, Yevgeny (2013) PAC-Bayes-empirical-Bernstein inequality. In Advances in Neural Information Processing Systems, 5-10 Decmber 2013, Lake Tahoe, Nevada. http://purl.org/au-research/grants/ARC/FL110100281 |
Direitos |
Copyright 2013 [please consult the author] |
Fonte |
Science & Engineering Faculty |
Tipo |
Conference Paper |