Header logo is


2019


no image
Limitations of the empirical Fisher approximation for natural gradient descent

Kunstner, F., Hennig, P., Balles, L.

Advances in Neural Information Processing Systems 32, pages: 4158-4169, (Editors: H. Wallach and H. Larochelle and A. Beygelzimer and F. d’Alché-Buc and E. Fox and R. Garnett), Curran Associates, Inc., 33rd Annual Conference on Neural Information Processing Systems, December 2019 (conference)

ei pn

link (url) [BibTex]

2019


link (url) [BibTex]


no image
Convergence Guarantees for Adaptive Bayesian Quadrature Methods

Kanagawa, M., Hennig, P.

Advances in Neural Information Processing Systems 32, pages: 6234-6245, (Editors: H. Wallach and H. Larochelle and A. Beygelzimer and F. d’Alché-Buc and E. Fox and R. Garnett), Curran Associates, Inc., 33rd Annual Conference on Neural Information Processing Systems, December 2019 (conference)

ei pn

link (url) [BibTex]

link (url) [BibTex]


no image
DeepOBS: A Deep Learning Optimizer Benchmark Suite

Schneider, F., Balles, L., Hennig, P.

7th International Conference on Learning Representations (ICLR), May 2019 (conference)

ei pn

link (url) [BibTex]

link (url) [BibTex]


no image
Fast and Robust Shortest Paths on Manifolds Learned from Data

Arvanitidis, G., Hauberg, S., Hennig, P., Schober, M.

Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS), 89, pages: 1506-1515, (Editors: Kamalika Chaudhuri and Masashi Sugiyama), PMLR, April 2019 (conference)

ei pn

PDF link (url) [BibTex]

PDF link (url) [BibTex]


Active Probabilistic Inference on Matrices for Pre-Conditioning in Stochastic Optimization
Active Probabilistic Inference on Matrices for Pre-Conditioning in Stochastic Optimization

de Roos, F., Hennig, P.

Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS), 89, pages: 1448-1457, (Editors: Kamalika Chaudhuri and Masashi Sugiyama), PMLR, April 2019 (conference)

Abstract
Pre-conditioning is a well-known concept that can significantly improve the convergence of optimization algorithms. For noise-free problems, where good pre-conditioners are not known a priori, iterative linear algebra methods offer one way to efficiently construct them. For the stochastic optimization problems that dominate contemporary machine learning, however, this approach is not readily available. We propose an iterative algorithm inspired by classic iterative linear solvers that uses a probabilistic model to actively infer a pre-conditioner in situations where Hessian-projections can only be constructed with strong Gaussian noise. The algorithm is empirically demonstrated to efficiently construct effective pre-conditioners for stochastic gradient descent and its variants. Experiments on problems of comparably low dimensionality show improved convergence. In very high-dimensional problems, such as those encountered in deep learning, the pre-conditioner effectively becomes an automatic learning-rate adaptation scheme, which we also empirically show to work well.

pn ei

PDF link (url) [BibTex]

PDF link (url) [BibTex]

2011


no image
Optimal Reinforcement Learning for Gaussian Systems

Hennig, P.

In Advances in Neural Information Processing Systems 24, pages: 325-333, (Editors: J Shawe-Taylor and RS Zemel and P Bartlett and F Pereira and KQ Weinberger), Twenty-Fifth Annual Conference on Neural Information Processing Systems (NIPS), 2011 (inproceedings)

Abstract
The exploration-exploitation trade-off is among the central challenges of reinforcement learning. The optimal Bayesian solution is intractable in general. This paper studies to what extent analytic statements about optimal learning are possible if all beliefs are Gaussian processes. A first order approximation of learning of both loss and dynamics, for nonlinear, time-varying systems in continuous time and space, subject to a relatively weak restriction on the dynamics, is described by an infinite-dimensional partial differential equation. An approximate finitedimensional projection gives an impression for how this result may be helpful.

ei pn

PDF Web [BibTex]

2011


PDF Web [BibTex]


no image
Amorphous grain boundary layers in the ferromagnetic nanograined ZnO films

Straumal, B. B., Mazilkin, A. A., Protasova, S. G., Myatiev, A. A., Straumal, P. B., Goering, E., Baretzky, B.

In 520, pages: 1192-1194, Hersonissos, Greece, 2011 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
Inversed solid-phase grain boundary wetting in the Al-Zn system

Protasova, S. G., Kogtenkova, O. A., Straumal, B. B., Zieba, P., Baretzky, B.

In 46, pages: 4349-4353, Mie, Japan, 2011 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
First measurement of the heat effect of the grain boundary wetting phase transition

Straumal, B. B., Kogtenkova, O. A., Protasova, S. G., Zieba, P., Czeppe, T., Baretzky, B., Valiev, R. Z.

In 46, pages: 4243, Mie, Japan, 2011 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
Transmission electron microscopy investigation of boundaries between amorphous "grains" in Ni50Nb20Y30 alloy

Mazilkin, A. A., Abrosimova, G. E., Protasova, S. G., Straumal, B. B., Schütz, G., Dobatkin, S. V., Bakai, A. S.

In 46, pages: 4336-4342, Mie, Japan, 2011 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]

2004


no image
High-speed dynamics of magnetization processes in hard magnetic particles and thin platelets

Goll, D., Kronmüller, H.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 465-469, Laboratoire de Cristallographie/Laboratoire Louis Neel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

2004


[BibTex]


no image
High-speed dynamics of magnetization processes in hard magnetic particles and thin platelets

Goll, D., Kronmüller, H.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 465-469, Laboratoire de Cristallographie/Laboratoire Louis Neel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Modern nanocrystalline/nanostructured hard magnetic materials

Kronmüller, H., Goll, D.

In 272-276, pages: e319-e320, Rome [Italy], 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Modern nanostructured high-temperature permanent magnets

Goll, D., Kronmüller, H., Stadelmaier, H. H.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 578-583, Laboratoire de Cristallographie/Laboratoire Louis Néel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Imaging sub-ns spin dynamics in magnetic nanostructures with magnetic transmission X-ray microscopy

Fischer, P., Stoll, H., Puzic, A., Van Waeyenberge, B., Raabe, J., Haug, T., Denbeaux, G., Pearson, A., Höllinger, R., Back, C. H., Weiss, D., Schütz, G.

In Synchrotron Radiation Instrumentation, 705, pages: 1291-1294, AIP Conference Proceedings, American Institute of Physics, San Francisco, California (USA), 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Modern nanostructured high-temperature permanent magnets

Goll, D., Kronmüller, H., Stadelmaier, H. H.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 578-583, Laboratoire de Cristallographie/Laboratoire Louis Néel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Existence of transient temperature spike induced by SHI: evidence by ion beam analysis

Avasthi, D. K., Ghosh, S., Srivastava, S. K., Assmann, W.

In 219-220, pages: 206-214, Albuquerque, NM [USA], 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Hard magnetic hollow nanospheres

Goll, D., Berkowitz, A. E., Bertram, H. N.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 704-707, Laboratoire de Cristallographie/Laboratoire Louis Neel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

[BibTex]