Empirische Inferenz Conference Paper 2002

Some Local Measures of Complexity of Convex Hulls and Generalization Bounds

PDF PostScript
no image
Empirische Inferenz

We investigate measures of complexity of function classes based on continuity moduli of Gaussian and Rademacher processes. For Gaussian processes, we obtain bounds on the continuity modulus on the convex hull of a function class in terms of the same quantity for the class itself. We also obtain new bounds on generalization error in terms of localized Rademacher complexities. This allows us to prove new results about generalization performance for convex hulls in terms of characteristics of the base class. As a byproduct, we obtain a simple proof of some of the known bounds on the entropy of convex hulls.

Author(s): Bousquet, O. and Koltchinskii, V. and Panchenko, D.
Links:
Journal: Proceedings of the 15th annual conference on Computational Learning Theory
Year: 2002
Day: 0
Bibtex Type: Conference Paper (inproceedings)
Event Name: Proceedings of the 15th annual conference on Computational Learning Theory
Digital: 0
Electronic Archiving: grant_archive
Organization: Max-Planck-Gesellschaft
School: Biologische Kybernetik

BibTex

@inproceedings{1443,
  title = {Some Local Measures of Complexity of Convex Hulls and Generalization Bounds},
  journal = {Proceedings of the 15th annual conference on Computational Learning Theory},
  abstract = {We investigate measures of complexity of function classes based on
  continuity moduli of Gaussian and Rademacher processes.
  For Gaussian processes, we obtain bounds on the continuity modulus on the
  convex hull of a function class in terms of the same quantity for the class
  itself.
  We also obtain new bounds on generalization error in terms of localized
  Rademacher complexities. This allows us to prove new results about
  generalization performance for convex hulls in terms of characteristics of
  the base class.
  As a byproduct, we obtain a simple proof of some of the known bounds on the
  entropy of convex hulls.},
  organization = {Max-Planck-Gesellschaft},
  school = {Biologische Kybernetik},
  year = {2002},
  slug = {1443},
  author = {Bousquet, O. and Koltchinskii, V. and Panchenko, D.}
}