Header logo is



Active Uncertainty Calibration in Bayesian ODE Solvers
Active Uncertainty Calibration in Bayesian ODE Solvers

Kersting, H., Hennig, P.

Proceedings of the 32nd Conference on Uncertainty in Artificial Intelligence (UAI), pages: 309-318, (Editors: Ihler, A. and Janzing, D.), AUAI Press, June 2016 (conference)

Abstract
There is resurging interest, in statistics and machine learning, in solvers for ordinary differential equations (ODEs) that return probability measures instead of point estimates. Recently, Conrad et al.~introduced a sampling-based class of methods that are `well-calibrated' in a specific sense. But the computational cost of these methods is significantly above that of classic methods. On the other hand, Schober et al.~pointed out a precise connection between classic Runge-Kutta ODE solvers and Gaussian filters, which gives only a rough probabilistic calibration, but at negligible cost overhead. By formulating the solution of ODEs as approximate inference in linear Gaussian SDEs, we investigate a range of probabilistic ODE solvers, that bridge the trade-off between computational cost and probabilistic calibration, and identify the inaccurate gradient measurement as the crucial source of uncertainty. We propose the novel filtering-based method Bayesian Quadrature filtering (BQF) which uses Bayesian quadrature to actively learn the imprecision in the gradient measurement by collecting multiple gradient evaluations.

ei pn

link (url) Project Page Project Page [BibTex]

link (url) Project Page Project Page [BibTex]


Automatic {LQR} Tuning Based on {G}aussian Process Global Optimization
Automatic LQR Tuning Based on Gaussian Process Global Optimization

Marco, A., Hennig, P., Bohg, J., Schaal, S., Trimpe, S.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pages: 270-277, IEEE, IEEE International Conference on Robotics and Automation, May 2016 (inproceedings)

Abstract
This paper proposes an automatic controller tuning framework based on linear optimal control combined with Bayesian optimization. With this framework, an initial set of controller gains is automatically improved according to a pre-defined performance objective evaluated from experimental data. The underlying Bayesian optimization algorithm is Entropy Search, which represents the latent objective as a Gaussian process and constructs an explicit belief over the location of the objective minimum. This is used to maximize the information gain from each experimental evaluation. Thus, this framework shall yield improved controllers with fewer evaluations compared to alternative approaches. A seven-degree- of-freedom robot arm balancing an inverted pole is used as the experimental demonstrator. Results of a two- and four- dimensional tuning problems highlight the method’s potential for automatic controller tuning on robotic platforms.

am ics pn

Video PDF DOI Project Page [BibTex]

Video PDF DOI Project Page [BibTex]


no image
Batch Bayesian Optimization via Local Penalization

González, J., Dai, Z., Hennig, P., Lawrence, N.

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics (AISTATS), 51, pages: 648-657, JMLR Workshop and Conference Proceedings, (Editors: Gretton, A. and Robert, C. C.), May 2016 (conference)

ei pn

link (url) Project Page [BibTex]

link (url) Project Page [BibTex]


Probabilistic Approximate Least-Squares
Probabilistic Approximate Least-Squares

Bartels, S., Hennig, P.

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics (AISTATS), 51, pages: 676-684, JMLR Workshop and Conference Proceedings, (Editors: Gretton, A. and Robert, C. C. ), May 2016 (conference)

Abstract
Least-squares and kernel-ridge / Gaussian process regression are among the foundational algorithms of statistics and machine learning. Famously, the worst-case cost of exact nonparametric regression grows cubically with the data-set size; but a growing number of approximations have been developed that estimate good solutions at lower cost. These algorithms typically return point estimators, without measures of uncertainty. Leveraging recent results casting elementary linear algebra operations as probabilistic inference, we propose a new approximate method for nonparametric least-squares that affords a probabilistic uncertainty estimate over the error between the approximate and exact least-squares solution (this is not the same as the posterior variance of the associated Gaussian process regressor). This allows estimating the error of the least-squares solution on a subset of the data relative to the full-data solution. The uncertainty can be used to control the computational effort invested in the approximation. Our algorithm has linear cost in the data-set size, and a simple formal form, so that it can be implemented with a few lines of code in programming languages with linear algebra functionality.

ei pn

link (url) Project Page Project Page [BibTex]

link (url) Project Page Project Page [BibTex]


no image
Robust calibration marker detection in powder bed images from laser beam melting processes

zur Jacobsmühlen, J., Achterhold, J., Kleszczynski, S., Witt, G., Merhof, D.

In 2016 IEEE International Conference on Industrial Technology (ICIT), pages: 910-915, March 2016 (inproceedings)

ev

DOI [BibTex]

DOI [BibTex]


no image
Sustainable effects of simulator-based training on ecological driving

Lüderitz, C., Wirzberger, M., Karrer-Gauß, K.

In Advances in Ergonomic Design of Systems, Products and Processes. Proceedings of the Annual Meeting of the GfA 2015, pages: 463-475, Springer, 2016 (inbook)

Abstract
Simulation-based driver training offers a promising way to teach ecological driving behavior under controlled, comparable conditions. In a study with 23 professional drivers, we tested the effectiveness of such training. The driving behavior of a training group in a simulated drive with and without instructions were compared. Ten weeks later, a repetition drive tested the long-term effect training. Driving data revealed reduced fuel consumption by ecological driving in both the guided and repetition drives. Driving time decreased significantly in the training and did not differ from driving time after 10 weeks. Results did not achieve significance for transfer to test drives in real traffic situations. This may be due to the small sample size and biased data as a result of unusual driving behavior. Finally, recent and promising approaches to support drivers in maintaining eco-driving styles beyond training situations are outlined.

re

DOI [BibTex]

DOI [BibTex]


no image
Direct Visual-Inertial Odometry with Stereo Cameras

Usenko, V., Engel, J., Stueckler, J., Cremers, D.

In IEEE International Conference on Robotics and Automation (ICRA), 2016 (inproceedings)

ev

[BibTex]

[BibTex]


no image
CPA-SLAM: Consistent Plane-Model Alignment for Direct RGB-D SLAM

Ma, L., Kerl, C., Stueckler, J., Cremers, D.

In IEEE International Conference on Robotics and Automation (ICRA), 2016 (inproceedings)

ev

[BibTex]

[BibTex]


no image
Examining load-inducing factors in instructional design: An ACT-R approach

Wirzberger, M., Rey, G. D.

In Proceedings of the 14th International Conference on Cognitive Modeling (ICCM 2016), pages: 223-224, University Park, PA, Penn State, 2016 (inproceedings)

re

[BibTex]

[BibTex]


no image
Helping people make better decisions using optimal gamification

Lieder, F., Griffiths, T. L.

In Proceedings of the 38th Annual Conference of the Cognitive Science Society, 2016 (inproceedings)

re

Project Page [BibTex]

Project Page [BibTex]


no image
CLT meets ACT-R: Modeling load-inducing factors in instructional design

Wirzberger, M., Rey, G. D.

In Abstracts of the 58th Conference of Experimental Psychologists, pages: 377, Pabst Science Publishers, Lengerich, 2016 (inproceedings)

re

[BibTex]

[BibTex]


no image
Unsupervised Learning of Shape-Motion Patterns for Objects in Urban Street Scenes

Klostermann, D., Osep, A., Stueckler, J., Leibe, B.

In British Machine Vision Conference (BMVC), 2016 (inproceedings)

ev

[BibTex]

[BibTex]


no image
Modeling load factors in multimedia learning: An ACT-R approach

Wirzberger, M.

In Dagstuhl 2016. Proceedings of the 10th Joint Workshop of the German Research Training Groups in Computer Science, pages: 98, Universitätsverlag Chemnitz, Chemnitz, 2016 (inproceedings)

re

[BibTex]

[BibTex]


no image
Scene Flow Propagation for Semantic Mapping and Object Discovery in Dynamic Street Scenes

Kochanov, D., Osep, A., Stueckler, J., Leibe, B.

In IEEE/RSJ Int. Conference on Intelligent Robots and Systems, IROS, 2016 (inproceedings)

ev

[BibTex]

[BibTex]


no image
Separating cognitive load facets in a working memory updating task: An experimental approach

Wirzberger, M., Beege, M., Schneider, S., Nebel, S., Rey, G. D.

In International Meeting of the Psychonomic Society, Granada – Spain, May 5-8, 2016, Abstract Book, pages: 211-212, 2016 (inproceedings)

re

[BibTex]

[BibTex]


no image
Joint Object Pose Estimation and Shape Reconstruction in Urban Street Scenes Using 3D Shape Priors

Engelmann, F., Stueckler, J., Leibe, B.

In Proc. of the German Conference on Pattern Recognition (GCPR), 2016 (inproceedings)

ev

[BibTex]

[BibTex]


no image
CLT meets WMU: Simultaneous experimental manipulation of load factors in a basal working memory task

Wirzberger, M., Beege, M., Schneider, S., Nebel, S., Rey, G. D.

In 9th International Cognitive Load Theory Conference, June 22nd to 24th, 2016, Bochum, Germany, Abstracts, pages: 19, 2016 (inproceedings)

re

[BibTex]

[BibTex]


no image
Bedingt räumliche Nähe bessere Lernergebnisse? Die Rolle der Distanz und Integration beim Lernen mit multiplen Informationsquellen

Beege, M., Nebel, S., Schneider, S., Wirzberger, M., Schmidt, N., Rey, G. D.

In 50th Conference of the German Psychological Society. Abstracts, pages: 540, Pabst Science Publishers, Lengerich, 2016 (inproceedings)

re

[BibTex]

[BibTex]

2014


Probabilistic Progress Bars
Probabilistic Progress Bars

Kiefel, M., Schuler, C., Hennig, P.

In Conference on Pattern Recognition (GCPR), 8753, pages: 331-341, Lecture Notes in Computer Science, (Editors: Jiang, X., Hornegger, J., and Koch, R.), Springer, GCPR, September 2014 (inproceedings)

Abstract
Predicting the time at which the integral over a stochastic process reaches a target level is a value of interest in many applications. Often, such computations have to be made at low cost, in real time. As an intuitive example that captures many features of this problem class, we choose progress bars, a ubiquitous element of computer user interfaces. These predictors are usually based on simple point estimators, with no error modelling. This leads to fluctuating behaviour confusing to the user. It also does not provide a distribution prediction (risk values), which are crucial for many other application areas. We construct and empirically evaluate a fast, constant cost algorithm using a Gauss-Markov process model which provides more information to the user.

ei ps pn

website+code pdf DOI [BibTex]

2014


website+code pdf DOI [BibTex]


Probabilistic Solutions to Differential Equations and their Application to Riemannian Statistics
Probabilistic Solutions to Differential Equations and their Application to Riemannian Statistics

Hennig, P., Hauberg, S.

In Proceedings of the 17th International Conference on Artificial Intelligence and Statistics, 33, pages: 347-355, JMLR: Workshop and Conference Proceedings, (Editors: S Kaski and J Corander), Microtome Publishing, Brookline, MA, AISTATS, April 2014 (inproceedings)

Abstract
We study a probabilistic numerical method for the solution of both boundary and initial value problems that returns a joint Gaussian process posterior over the solution. Such methods have concrete value in the statistics on Riemannian manifolds, where non-analytic ordinary differential equations are involved in virtually all computations. The probabilistic formulation permits marginalising the uncertainty of the numerical solution such that statistics are less sensitive to inaccuracies. This leads to new Riemannian algorithms for mean value computations and principal geodesic analysis. Marginalisation also means results can be less precise than point estimates, enabling a noticeable speed-up over the state of the art. Our approach is an argument for a wider point that uncertainty caused by numerical calculations should be tracked throughout the pipeline of machine learning algorithms.

ei ps pn

pdf Youtube Supplements Project page link (url) [BibTex]

pdf Youtube Supplements Project page link (url) [BibTex]


no image
Probabilistic ODE Solvers with Runge-Kutta Means

Schober, M., Duvenaud, D., Hennig, P.

In Advances in Neural Information Processing Systems 27, pages: 739-747, (Editors: Z. Ghahramani, M. Welling, C. Cortes, N.D. Lawrence and K.Q. Weinberger), Curran Associates, Inc., 28th Annual Conference on Neural Information Processing Systems (NIPS), 2014 (inproceedings)

ei pn

Web link (url) [BibTex]

Web link (url) [BibTex]


no image
Active Learning of Linear Embeddings for Gaussian Processes

Garnett, R., Osborne, M., Hennig, P.

In Proceedings of the 30th Conference on Uncertainty in Artificial Intelligence, pages: 230-239, (Editors: NL Zhang and J Tian), AUAI Press , Corvallis, Oregon, UAI2014, 2014, another link: http://arxiv.org/abs/1310.6740 (inproceedings)

ei pn

PDF Web [BibTex]

PDF Web [BibTex]


no image
Probabilistic Shortest Path Tractography in DTI Using Gaussian Process ODE Solvers

Schober, M., Kasenburg, N., Feragen, A., Hennig, P., Hauberg, S.

In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2014, Lecture Notes in Computer Science Vol. 8675, pages: 265-272, (Editors: P. Golland, N. Hata, C. Barillot, J. Hornegger and R. Howe), Springer, Heidelberg, MICCAI, 2014 (inproceedings)

ei pn

DOI [BibTex]

DOI [BibTex]


no image
Sampling for Inference in Probabilistic Models with Fast Bayesian Quadrature

Gunter, T., Osborne, M., Garnett, R., Hennig, P., Roberts, S.

In Advances in Neural Information Processing Systems 27, pages: 2789-2797, (Editors: Z. Ghahramani, M. Welling, C. Cortes, N.D. Lawrence and K.Q. Weinberger), Curran Associates, Inc., 28th Annual Conference on Neural Information Processing Systems (NIPS), 2014 (inproceedings)

ei pn

Web link (url) [BibTex]

Web link (url) [BibTex]


no image
Adaptive Tool-Use Strategies for Anthropomorphic Service Robots

Stueckler, J., Behnke, S.

In Proc. of the 14th IEEE-RAS International Conference on Humanoid Robots (Humanoids), 2014 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Local Multi-Resolution Surfel Grids for MAV Motion Estimation and 3D Mapping

Droeschel, D., Stueckler, J., Behnke, S.

In Proc. of the 13th International Conference on Intelligent Autonomous Systems (IAS), 2014 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Active Recognition and Manipulation for Mobile Robot Bin Picking

Holz, D., Nieuwenhuisen, M., Droeschel, D., Stueckler, J., Berner, A., Li, J., Klein, R., Behnke, S.

In Gearing Up and Accelerating Cross-fertilization between Academic and Industrial Robotics Research in Europe: Technology Transfer Experiments from the ECHORD Project, pages: 133-153, Springer, 2014 (inbook)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Combining the Strengths of Sparse Interest Point and Dense Image Registration for RGB-D Odometry

Stueckler, J., Gutt, A., Behnke, S.

In Proc. of the Joint 45th International Symposium on Robotics (ISR) and 8th German Conference on Robotics (ROBOTIK), 2014 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Incremental Local Gaussian Regression

Meier, F., Hennig, P., Schaal, S.

In Advances in Neural Information Processing Systems 27, pages: 972-980, (Editors: Z. Ghahramani, M. Welling, C. Cortes, N.D. Lawrence and K.Q. Weinberger), 28th Annual Conference on Neural Information Processing Systems (NIPS), 2014, clmc (inproceedings)

am ei pn

PDF link (url) [BibTex]

PDF link (url) [BibTex]


no image
Increasing Flexibility of Mobile Manipulation and Intuitive Human-Robot Interaction in RoboCup@Home

Stueckler, J., Droeschel, D., Gräve, K., Holz, D., Schreiber, M., Topaldou-Kyniazopoulou, A., Schwarz, M., Behnke, S.

In RoboCup 2013, Robot Soccer World Cup XVII, pages: 135-146, Springer, 2014 (inbook)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Efficient Bayesian Local Model Learning for Control

Meier, F., Hennig, P., Schaal, S.

In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, pages: 2244 - 2249, IROS, 2014, clmc (inproceedings)

Abstract
Model-based control is essential for compliant controland force control in many modern complex robots, like humanoidor disaster robots. Due to many unknown and hard tomodel nonlinearities, analytical models of such robots are oftenonly very rough approximations. However, modern optimizationcontrollers frequently depend on reasonably accurate models,and degrade greatly in robustness and performance if modelerrors are too large. For a long time, machine learning hasbeen expected to provide automatic empirical model synthesis,yet so far, research has only generated feasibility studies butno learning algorithms that run reliably on complex robots.In this paper, we combine two promising worlds of regressiontechniques to generate a more powerful regression learningsystem. On the one hand, locally weighted regression techniquesare computationally efficient, but hard to tune due to avariety of data dependent meta-parameters. On the other hand,Bayesian regression has rather automatic and robust methods toset learning parameters, but becomes quickly computationallyinfeasible for big and high-dimensional data sets. By reducingthe complexity of Bayesian regression in the spirit of local modellearning through variational approximations, we arrive at anovel algorithm that is computationally efficient and easy toinitialize for robust learning. Evaluations on several datasetsdemonstrate very good learning performance and the potentialfor a general regression learning tool for robotics.

am ei pn

PDF link (url) DOI [BibTex]

PDF link (url) DOI [BibTex]


no image
Mobile Teleoperation Interfaces with Adjustable Autonomy for Personal Service Robots

Schwarz, M., Stueckler, J., Behnke, S.

In Proceedings of the 2014 ACM/IEEE International Conference on Human-robot Interaction, pages: 288-289, HRI ’14, ACM, 2014 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Algorithm selection by rational metareasoning as a model of human strategy selection

Lieder, F., Plunkett, D., Hamrick, J. B., Russell, S. J., Hay, N. J., Griffiths, T. L.

In Advances in Neural Information Processing Systems 27, 2014 (inproceedings)

re

Project Page [BibTex]

Project Page [BibTex]


no image
"I don’t need it!" – Modeling ad-induced interruption while using a Smartphone-app

Wirzberger, M., Russwinkel, N.

CrossWorlds 2014: Theory, Development and Evaluation of Social Technology, 2014 (conference)

re

DOI [BibTex]

DOI [BibTex]


no image
"Keep green!" – Nachhaltige Förderung ökologischen Fahrens durch Simulatortraining? ["Keep green!" – Promoting ecological driving through simulator training in a sustainable manner?]

Wirzberger, M., Lüderitz, C., Rohrer, S., Karrer-Gauß, K.

In 49th Conference of the German Psychological Society. Abstracts, pages: 570, Pabst Science Publishers, Lengerich, 2014 (inproceedings)

re

[BibTex]

[BibTex]


no image
Efficient deformable registration of multi-resolution surfel maps for object manipulation skill transfer

Stueckler, J., Behnke, S.

In Proc. of the IEEE International Conference on Robotics and Automation (ICRA), pages: 994-1001, May 2014 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
The high availability of extreme events serves resource-rational decision-making

Lieder, F., Hsu, M., Griffiths, T. L.

In Proceedings of the 36th Annual Conference of the Cognitive Science Society, 2014 (inproceedings)

re

[BibTex]

[BibTex]


no image
Local multi-resolution representation for 6D motion estimation and mapping with a continuously rotating 3D laser scanner

Droeschel, D., Stueckler, J., Behnke, S.

In Proc. of the IEEE Int. Conf. on Robotics and Automation (ICRA), pages: 5221-5226, May 2014 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Layers of Abstraction: (Neuro)computational models of learning local and global statistical regularities

Diaconescu, A., Lieder, F., Mathys, C., Stephan, K. E.

In 20th Annual Meeting of the Organization for Human Brain Mapping, 2014 (inproceedings)

re

[BibTex]

[BibTex]

2007


no image
Hierarchical reactive control for a team of humanoid soccer robots

Behnke, S., Stueckler, J., Schreiber, M., Schulz, H., Böhnert, M., Meier, K.

In Proc. of the IEEE-RAS Int. Conf. on Humanoid Robots (Humanoids), pages: 622-629, November 2007 (inproceedings)

ev

link (url) DOI [BibTex]

2007


link (url) DOI [BibTex]

2006


no image
See, walk, and kick: Humanoid robots start to play soccer

Behnke, S., Schreiber, M., Stueckler, J., Renner, R., Strasdat, H.

In Proc. of the IEEE-RAS Int. Conf. on Humanoid Robots (Humanoids), pages: 497-503, December 2006 (inproceedings)

ev

link (url) DOI [BibTex]

2006


link (url) DOI [BibTex]