Header logo is

Bayesian Online Multitask Learning of Gaussian Processes




Standard single-task kernel methods have recently been extended to the case of multitask learning in the context of regularization theory. There are experimental results, especially in biomedicine, showing the benefit of the multitask approach compared to the single-task one. However, a possible drawback is computational complexity. For instance, when regularization networks are used, complexity scales as the cube of the overall number of training data, which may be large when several tasks are involved. The aim of this paper is to derive an efficient computational scheme for an important class of multitask kernels. More precisely, a quadratic loss is assumed and each task consists of the sum of a common term and a task-specific one. Within a Bayesian setting, a recursive online algorithm is obtained, which updates both estimates and confidence intervals as new data become available. The algorithm is tested on two simulated problems and a real data set relative to xenobiotics administration in human patients.

Author(s): Pillonetto, G. and Dinuzzo, F. and De Nicolao, G.
Journal: IEEE Transactions on Pattern Analysis and Machine Intelligence
Volume: 32
Number (issue): 2
Pages: 193-205
Year: 2010
Month: February
Day: 0

Department(s): Empirical Inference
Bibtex Type: Article (article)

Digital: 0
DOI: 10.1109/TPAMI.2008.297


  title = {Bayesian Online Multitask Learning of Gaussian Processes},
  author = {Pillonetto, G. and Dinuzzo, F. and De Nicolao, G.},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  volume = {32},
  number = {2},
  pages = {193-205},
  month = feb,
  year = {2010},
  month_numeric = {2}