Publications | Max Planck Institute for Intelligent Systems

2015

mms Hug, S., Stegbauer, L., Oh, H., Hirscher, M., Lotsch, B. V. Nitrogen-rich covalent triazine frameworks as high-performance platforms for selective carbon capture and storage {Chemistry of Materials}, 27(23):8001-8010, American Chemical Society, Washington, D.C., 2015 (article)

link (url) DOI Project Page [BibTex]

Novel plasticity rule can explain the development of sensorimotor intelligence

Der, R., Martius, G.

Proceedings of the National Academy of Sciences, 112(45):E6224-E6232, 2015 (article)

Abstract

Grounding autonomous behavior in the nervous system is a fundamental challenge for neuroscience. In particular, self-organized behavioral development provides more questions than answers. Are there special functional units for curiosity, motivation, and creativity? This paper argues that these features can be grounded in synaptic plasticity itself, without requiring any higher-level constructs. We propose differential extrinsic plasticity (DEP) as a new synaptic rule for self-learning systems and apply it to a number of complex robotic systems as a test case. Without specifying any purpose or goal, seemingly purposeful and adaptive rhythmic behavior is developed, displaying a certain level of sensorimotor intelligence. These surprising results require no system-specific modifications of the DEP rule. They rather arise from the underlying mechanism of spontaneous symmetry breaking, which is due to the tight brain body environment coupling. The new synaptic rule is biologically plausible and would be an interesting target for neurobiological investigation. We also argue that this neuronal mechanism may have been a catalyst in natural evolution.

al Der, R., Martius, G. Novel plasticity rule can explain the development of sensorimotor intelligence Proceedings of the National Academy of Sciences, 112(45):E6224-E6232, 2015 (article)

link (url) DOI Project Page [BibTex]

Multilayer Fresnel zone plates for X-ray microscopy

Sanli, U. T., Keskinbora, K., Grévent, C., Szeghalmi, A., Knez, M., Schütz, G.

{Microscopy and Microanalysis}, 21(Suppl 3):1987-1988, Springer-Verlag New York, New York, NY, 2015 (article)

mms

mms Sanli, U. T., Keskinbora, K., Grévent, C., Szeghalmi, A., Knez, M., Schütz, G. Multilayer Fresnel zone plates for X-ray microscopy {Microscopy and Microanalysis}, 21(Suppl 3):1987-1988, Springer-Verlag New York, New York, NY, 2015 (article)

Interfacial dominated ferromagnetism in nanograined ZnO: a \muSR and DFT study

Tietze, T., Audehm, P., Chen, Y., Schütz, G., Straumal, B. B., Protasova, S. G., Mazilkin, A. A., Straumal, P. B., Prokscha, T., Luetkens, H., Salman, Z., Suter, A., Baretzky, B., Fink, K., Wenzel, W., Danilov, D., Goering, E.

{Scientific Reports}, 5, pages: 8871-8876, Nature Publishing Group, London, UK, 2015 (article)

mms

mms Tietze, T., Audehm, P., Chen, Y., Schütz, G., Straumal, B. B., Protasova, S. G., Mazilkin, A. A., Straumal, P. B., Prokscha, T., Luetkens, H., Salman, Z., Suter, A., Baretzky, B., Fink, K., Wenzel, W., Danilov, D., Goering, E. Interfacial dominated ferromagnetism in nanograined ZnO: a \muSR and DFT study {Scientific Reports}, 5, pages: 8871-8876, Nature Publishing Group, London, UK, 2015 (article)

Preparation of a ferromagnetic barrier in YBa2Cu3O7-delta thinner than the coherence length

Soltan, S., Albrecht, J., Goering, E., Schütz, G., Mustafa, L., Keimer, B., Habermeier, H.

{Journal of Applied Physics}, 118(22), AIP Publishing, New York, NY, 2015 (article)

mms

mms Soltan, S., Albrecht, J., Goering, E., Schütz, G., Mustafa, L., Keimer, B., Habermeier, H. Preparation of a ferromagnetic barrier in YBa2Cu3O7-delta thinner than the coherence length {Journal of Applied Physics}, 118(22), AIP Publishing, New York, NY, 2015 (article)

Microanalytical methods for in-situ high-resolution analysis of rock varnish at the micrometer to nanometer scale

Macholdt, D. S., Jochum, K. P., Pöhlker, C., Stoll, B., Weis, U., Weber, B., Müller, M., Kapl, M., Buhre, S., Kilcoyne, A. L. D., Weigand, M., Scholz, D., Al-Amri, A. M., Andreae, M. O.

{Chemical Geology}, 411, pages: 57-68, Elsevier, Amsterdam, 2015 (article)

mms

mms Macholdt, D. S., Jochum, K. P., Pöhlker, C., Stoll, B., Weis, U., Weber, B., Müller, M., Kapl, M., Buhre, S., Kilcoyne, A. L. D., Weigand, M., Scholz, D., Al-Amri, A. M., Andreae, M. O. Microanalytical methods for in-situ high-resolution analysis of rock varnish at the micrometer to nanometer scale {Chemical Geology}, 411, pages: 57-68, Elsevier, Amsterdam, 2015 (article)

Chemical composition, microstructure, and hygroscopic properties of aerosol particles at the Zotino Tall Tower Observatory (ZOTTO), Siberia, during a summer campaign

Mikhailov, E. F., Mironov, G. N., Pöhlker, C., Chi, X., Krüger, M., Shiraiwa, M., Förster, J., Pöschl, U., Vlasenko, S. S., Ryshkevich, T. I., Weigand, M., Kilcoyne, A. L. D., Andreae, M.

{Atmospheric Chemistry and Physics}, 15(15):8847-8869, European Geosciences Union, Katlenburg-Lindau, Germany, 2015 (article)

mms

mms Mikhailov, E. F., Mironov, G. N., Pöhlker, C., Chi, X., Krüger, M., Shiraiwa, M., Förster, J., Pöschl, U., Vlasenko, S. S., Ryshkevich, T. I., Weigand, M., Kilcoyne, A. L. D., Andreae, M. Chemical composition, microstructure, and hygroscopic properties of aerosol particles at the Zotino Tall Tower Observatory (ZOTTO), Siberia, during a summer campaign {Atmospheric Chemistry and Physics}, 15(15):8847-8869, European Geosciences Union, Katlenburg-Lindau, Germany, 2015 (article)

Orbital reflectometry of PrNiO3/PrAlO3 superlattices

Wu, M., Benckiser, E., Audehm, P., Goering, E., Wochner, P., Christiani, G., Logvenov, G., Habermeier, H., Keimer, B.

{Physical Review B}, 91(19), American Physical Society, Woodbury, NY, 2015 (article)

mms

mms Wu, M., Benckiser, E., Audehm, P., Goering, E., Wochner, P., Christiani, G., Logvenov, G., Habermeier, H., Keimer, B. Orbital reflectometry of PrNiO3/PrAlO3 superlattices {Physical Review B}, 91(19), American Physical Society, Woodbury, NY, 2015 (article)

Dynamic domain wall chirality rectification by rotating magnetic fields

Bisig, A., Mawass, M., Stärk, M., Moutafis, C., Rhensius, J., Heidler, J., Gliga, S., Weigand, M., Tyliszczak, T., Van Waeyenberge, B., Stoll, H., Schütz, G., Kläui, M.

{Applied Physics Letters}, 106(12), American Institute of Physics, Melville, NY, 2015 (article)

mms

mms Bisig, A., Mawass, M., Stärk, M., Moutafis, C., Rhensius, J., Heidler, J., Gliga, S., Weigand, M., Tyliszczak, T., Van Waeyenberge, B., Stoll, H., Schütz, G., Kläui, M. Dynamic domain wall chirality rectification by rotating magnetic fields {Applied Physics Letters}, 106(12), American Institute of Physics, Melville, NY, 2015 (article)

Imaging spin dynamics on the nanoscale using X-ray microscopy

Stoll, H., Noske, M., Weigand, M., Richter, K., Krüger, B., Reeve, R. M., Hänze, M., Adolff, C. F., Stein, F., Meier, G., Kläui, M., Schütz, G.

{Frontiers in Physics}, 3, Frontiers Media, Lausanne, 2015 (article)

mms

mms Stoll, H., Noske, M., Weigand, M., Richter, K., Krüger, B., Reeve, R. M., Hänze, M., Adolff, C. F., Stein, F., Meier, G., Kläui, M., Schütz, G. Imaging spin dynamics on the nanoscale using X-ray microscopy {Frontiers in Physics}, 3, Frontiers Media, Lausanne, 2015 (article)

Structure Learning in Bayesian Sensorimotor Integration

Genewein, T, Hez, E, Razzaghpanah, Z, Braun, DA

PLoS Computational Biology, 11(8):1-27, August 2015 (article)

Abstract

Previous studies have shown that sensorimotor processing can often be described by Bayesian learning, in particular the integration of prior and feedback information depending on its degree of reliability. Here we test the hypothesis that the integration process itself can be tuned to the statistical structure of the environment. We exposed human participants to a reaching task in a three-dimensional virtual reality environment where we could displace the visual feedback of their hand position in a two dimensional plane. When introducing statistical structure between the two dimensions of the displacement, we found that over the course of several days participants adapted their feedback integration process in order to exploit this structure for performance improvement. In control experiments we found that this adaptation process critically depended on performance feedback and could not be induced by verbal instructions. Our results suggest that structural learning is an important meta-learning component of Bayesian sensorimotor integration.

ei Genewein, T, Hez, E, Razzaghpanah, Z, Braun, DA Structure Learning in Bayesian Sensorimotor Integration PLoS Computational Biology, 11(8):1-27, August 2015 (article)

Voltage-induced magnetic manipulation of a microstructured iron gold multilayer system

Sittig, Robert

Universität Stuttgart, Stuttgart, 2015 (mastersthesis)

mms

mms Sittig, Robert Voltage-induced magnetic manipulation of a microstructured iron gold multilayer system Universität Stuttgart, Stuttgart, 2015 (mastersthesis)

Unique high-temperature performance of highly consensed MnBi permanent magnets

Chen, Y., Gregori, G., Leineweber, A., Qu, F., Chen, C., Tietze, T., Kronmüller, H., Schütz, G., Goering, E.

{Scripta Materialia}, 107, pages: 131-135, Pergamon, Tarrytown, NY, 2015 (article)

mms

mms Chen, Y., Gregori, G., Leineweber, A., Qu, F., Chen, C., Tietze, T., Kronmüller, H., Schütz, G., Goering, E. Unique high-temperature performance of highly consensed MnBi permanent magnets {Scripta Materialia}, 107, pages: 131-135, Pergamon, Tarrytown, NY, 2015 (article)

Quantifying Emergent Behavior of Autonomous Robots

Martius, G., Olbrich, E.

Entropy, 17(10):7266, 2015 (article)

al Martius, G., Olbrich, E. Quantifying Emergent Behavior of Autonomous Robots Entropy, 17(10):7266, 2015 (article)

Ion beam lithographic and multilayer Fresnel zone plates for soft and hard X-rays: Nanofabrication and characterization

Keskinbora, K.

Universität Stuttgart, Stuttgart, 2015 (phdthesis)

mms

mms Keskinbora, K. Ion beam lithographic and multilayer Fresnel zone plates for soft and hard X-rays: Nanofabrication and characterization Universität Stuttgart, Stuttgart, 2015 (phdthesis)

Electrical determination of vortex state in submicron magnetic elements

Gangwar, A., Bauer, H. G., Chauleau, J., Noske, M., Weigand, M., Stoll, H., Schütz, G., Back, C. H.

{Physical Review B}, 91(9), American Physical Society, Woodbury, NY, 2015 (article)

mms

mms Gangwar, A., Bauer, H. G., Chauleau, J., Noske, M., Weigand, M., Stoll, H., Schütz, G., Back, C. H. Electrical determination of vortex state in submicron magnetic elements {Physical Review B}, 91(9), American Physical Society, Woodbury, NY, 2015 (article)

Mechanisms for the symmetric and antisymmetric switching of a magnetic vortex core: Differences and common aspects

Noske, M., Stoll, H., Fähnle, M., Hertel, R., Schütz, G.

{Physical Review B}, 91(1), American Physical Society, Woodbury, NY, 2015 (article)

mms

mms Noske, M., Stoll, H., Fähnle, M., Hertel, R., Schütz, G. Mechanisms for the symmetric and antisymmetric switching of a magnetic vortex core: Differences and common aspects {Physical Review B}, 91(1), American Physical Society, Woodbury, NY, 2015 (article)

High resolution, high efficiency mulitlayer Fresnel zone plates for soft and hard X-rays

Sanli, U., Keskinbora, K., Gregorczyk, K., Leister, J., Teeny, N., Grévent, C., Knez, M., Schütz, G.

{Proceedings of SPIE}, 9592, SPIE, Bellingham, Washington, 2015 (article)

mms

mms Sanli, U., Keskinbora, K., Gregorczyk, K., Leister, J., Teeny, N., Grévent, C., Knez, M., Schütz, G. High resolution, high efficiency mulitlayer Fresnel zone plates for soft and hard X-rays {Proceedings of SPIE}, 9592, SPIE, Bellingham, Washington, 2015 (article)

Macroscopic drift current in the inverse Faraday effect

Hertel, R., Fähnle, M.

{Physical Review B}, 91(2), American Physical Society, Woodbury, NY, 2015 (article)

mms

mms Hertel, R., Fähnle, M. Macroscopic drift current in the inverse Faraday effect {Physical Review B}, 91(2), American Physical Society, Woodbury, NY, 2015 (article)

Single-step 3D nanofabrication of kinoform optics via gray-scale focused ion beam lithography for efficient X-ray focusing

Keskinbora, K., Grévent, C., Hirscher, M., Weigand, M., Schütz, G.

{Advanced Optical Materials}, 3, pages: 792-800, WILEY-VCH Verlag GmbH Co. KGaA, Weinheim, 2015 (article)

mms

mms Keskinbora, K., Grévent, C., Hirscher, M., Weigand, M., Schütz, G. Single-step 3D nanofabrication of kinoform optics via gray-scale focused ion beam lithography for efficient X-ray focusing {Advanced Optical Materials}, 3, pages: 792-800, WILEY-VCH Verlag GmbH Co. KGaA, Weinheim, 2015 (article)

Band structure engineering of two-dimensional magnonic vortex crystals

Behncke, C., Hänze, M., Adolff, C. F., Weigand, M., Meier, G.

{Physical Review B}, 91(22), American Physical Society, Woodbury, NY, 2015 (article)

mms

mms Behncke, C., Hänze, M., Adolff, C. F., Weigand, M., Meier, G. Band structure engineering of two-dimensional magnonic vortex crystals {Physical Review B}, 91(22), American Physical Society, Woodbury, NY, 2015 (article)

Towards denoising XMCD movies of fast magnetization dynamics using extended Kalman filter

Kopp, M., Harmeling, S., Schütz, G., Schölkopf, B., Fähnle, M.

{Ultramicroscopy}, 148, pages: 115-122, North-Holland, Amsterdam, 2015 (article)

mms

mms Kopp, M., Harmeling, S., Schütz, G., Schölkopf, B., Fähnle, M. Towards denoising XMCD movies of fast magnetization dynamics using extended Kalman filter {Ultramicroscopy}, 148, pages: 115-122, North-Holland, Amsterdam, 2015 (article)

A Reward-Maximizing Spiking Neuron as a Bounded Rational Decision Maker

Leibfried, F, Braun, DA

Neural Computation, 27(8):1686-1720, July 2015 (article)

Abstract

Rate distortion theory describes how to communicate relevant information most efficiently over a channel with limited capacity. One of the many applications of rate distortion theory is bounded rational decision making, where decision makers are modeled as information channels that transform sensory input into motor output under the constraint that their channel capacity is limited. Such a bounded rational decision maker can be thought to optimize an objective function that trades off the decision maker's utility or cumulative reward against the information processing cost measured by the mutual information between sensory input and motor output. In this study, we interpret a spiking neuron as a bounded rational decision maker that aims to maximize its expected reward under the computational constraint that the mutual information between the neuron's input and output is upper bounded. This abstract computational constraint translates into a penalization of the deviation between the neuron's instantaneous and average firing behavior. We derive a synaptic weight update rule for such a rate distortion optimizing neuron and show in simulations that the neuron efficiently extracts reward-relevant information from the input by trading off its synaptic strengths against the collected reward.

ei Leibfried, F, Braun, DA A Reward-Maximizing Spiking Neuron as a Bounded Rational Decision Maker Neural Computation, 27(8):1686-1720, July 2015 (article)

Magnetic moments induce strong phonon renormalization in FeSi

Krannich, S., Sidis, Y., Lamago, D., Heid, R., Mignot, J., von Löhneysen, H., Ivanov, A., Steffens, P., Keller, T., Wang, L., Goering, E., Weber, F.

{Nature Communications}, 6, Nature Publishing Group, London, 2015 (article)

mms

mms Krannich, S., Sidis, Y., Lamago, D., Heid, R., Mignot, J., von Löhneysen, H., Ivanov, A., Steffens, P., Keller, T., Wang, L., Goering, E., Weber, F. Magnetic moments induce strong phonon renormalization in FeSi {Nature Communications}, 6, Nature Publishing Group, London, 2015 (article)

Transfer of angular momentum from the spin system to the lattice during ultrafast magnetization

Tsatsoulis, T.

Universität Stuttgart, Stuttgart, 2015 (mastersthesis)

mms

mms Tsatsoulis, T. Transfer of angular momentum from the spin system to the lattice during ultrafast magnetization Universität Stuttgart, Stuttgart, 2015 (mastersthesis)

What is epistemic value in free energy models of learning and acting? A bounded rationality perspective

Ortega, PA, Braun, DA

Cognitive Neuroscience, 6(4):215-216, December 2015 (article)

Abstract

Free energy models of learning and acting do not only care about utility or extrinsic value, but also about intrinsic value, that is, the information value stemming from probability distributions that represent beliefs or strategies. While these intrinsic values can be interpreted as epistemic values or exploration bonuses under certain conditions, the framework of bounded rationality offers a complementary interpretation in terms of information-processing costs that we discuss here.

ei Ortega, PA, Braun, DA What is epistemic value in free energy models of learning and acting? A bounded rationality perspective Cognitive Neuroscience, 6(4):215-216, December 2015 (article)

Quantum kinetic theory of ultrafast demagnetization by electron-phonon scattering

Briones Paz, J. Z.

Universität Stuttgart, Stuttgart, 2015 (mastersthesis)

mms

mms Briones Paz, J. Z. Quantum kinetic theory of ultrafast demagnetization by electron-phonon scattering Universität Stuttgart, Stuttgart, 2015 (mastersthesis)

DOI Project Page [BibTex]

Perpendicular magnetisation from in-plane fields in nano-scaled antidot lattices

Gräfe, J., Haering, F., Tietze, T., Audehm, P., Weigand, M., Wiedwald, U., Ziemann, P., Gawronski, P., Schütz, G., Goering, E. J.

{Nanotechnology}, 26(22), IOP Pub., Bristol, UK, 2015 (article)

mms

mms Gräfe, J., Haering, F., Tietze, T., Audehm, P., Weigand, M., Wiedwald, U., Ziemann, P., Gawronski, P., Schütz, G., Goering, E. J. Perpendicular magnetisation from in-plane fields in nano-scaled antidot lattices {Nanotechnology}, 26(22), IOP Pub., Bristol, UK, 2015 (article)

DOI Project Page [BibTex]

Theory of ultrafast demagnetization after femtosecond laser pulses

Fähnle, M., Illg, C., Haag, M., Teeny, N.

{Acta Physica Polonica A}, 127(2):170-175, Państwowe Wydawnictwo Naukowe, Warszawa, 2015 (article)

mms

mms Fähnle, M., Illg, C., Haag, M., Teeny, N. Theory of ultrafast demagnetization after femtosecond laser pulses {Acta Physica Polonica A}, 127(2):170-175, Państwowe Wydawnictwo Naukowe, Warszawa, 2015 (article)

Non-linear radial spinwave modes in thin magnetic disks

Helsen, M., Gangwar, Ajay, De Clercq, J., Vansteenkiste, A., Weigand, M., Back, C. H., Van Waeyenberge, B.

{Applied Physics Letters}, 106(3), American Institute of Physics, Melville, NY, 2015 (article)

mms

mms Helsen, M., Gangwar, Ajay, De Clercq, J., Vansteenkiste, A., Weigand, M., Back, C. H., Van Waeyenberge, B. Non-linear radial spinwave modes in thin magnetic disks {Applied Physics Letters}, 106(3), American Institute of Physics, Melville, NY, 2015 (article)

Hydrogen isotope separation in metal-organic frameworks: Kinetic or chemical affinity quantum-sieving?

Savchenko, I., Mavrandonakis, A., Heine, T., Oh, H., Teufel, J., Hirscher, M.

{Microporous and Mesoporous Materials}, 216, pages: 133-137, Elsevier, Amsterdam, 2015 (article)

mms

mms Savchenko, I., Mavrandonakis, A., Heine, T., Oh, H., Teufel, J., Hirscher, M. Hydrogen isotope separation in metal-organic frameworks: Kinetic or chemical affinity quantum-sieving? {Microporous and Mesoporous Materials}, 216, pages: 133-137, Elsevier, Amsterdam, 2015 (article)

High-resolution dichroic imaging of magnetic flux distributions in superconductors with scanning x-ray microscopy

Ruoß, S., Stahl, C., Weigand, M., Schütz, G., Albrecht, J.

{Applied Physics Letters}, 106, American Institute of Physics, Melville, NY, 2015 (article)

mms

mms Ruoß, S., Stahl, C., Weigand, M., Schütz, G., Albrecht, J. High-resolution dichroic imaging of magnetic flux distributions in superconductors with scanning x-ray microscopy {Applied Physics Letters}, 106, American Institute of Physics, Melville, NY, 2015 (article)

Preparation and characterisation of epitaxial Pt/Cu/FeMn/Co thin films on (100)-oriented MgO single crystals

Schmidt, M., Gräfe, J., Audehm, P., Phillipp, F., Schütz, G., Goering, E.

{Physica Status Solidi A}, 212(10):2114-2123, Wiley-VCH, Weinheim, 2015 (article)

mms

mms Schmidt, M., Gräfe, J., Audehm, P., Phillipp, F., Schütz, G., Goering, E. Preparation and characterisation of epitaxial Pt/Cu/FeMn/Co thin films on (100)-oriented MgO single crystals {Physica Status Solidi A}, 212(10):2114-2123, Wiley-VCH, Weinheim, 2015 (article)

Probing the magnetic moments of [MnIII6CrIII]3+ single-molecule magnets - A cross comparison of XMCD and spin-resolved electron spectroscopy

Helmstedt, A., Dohmeier, N., Müller, N., Gryzia, A., Brechling, A., Heinzmann, U., Hoeke, V., Krickemeyer, E., Glaser, T., Leicht, P., Fonin, M., Tietze, T., Joly, L., Kuepper, K.

{Journal of Electron Spectroscopy and Related Phenomena}, 198, pages: 12-19, Elsevier B.V., Amsterdam, 2015 (article)

mms

mms Helmstedt, A., Dohmeier, N., Müller, N., Gryzia, A., Brechling, A., Heinzmann, U., Hoeke, V., Krickemeyer, E., Glaser, T., Leicht, P., Fonin, M., Tietze, T., Joly, L., Kuepper, K. Probing the magnetic moments of [MnIII6CrIII]3+ single-molecule magnets - A cross comparison of XMCD and spin-resolved electron spectroscopy {Journal of Electron Spectroscopy and Related Phenomena}, 198, pages: 12-19, Elsevier B.V., Amsterdam, 2015 (article)

2010

Causal relationships between frequency bands of extracellular signals in visual cortex revealed by an information theoretic analysis

Besserve, M., Schölkopf, B., Logothetis, N., Panzeri, S.

Journal of Computational Neuroscience, 29(3):547-566, December 2010 (article)

PDF DOI [BibTex]

2010

ei Besserve, M., Schölkopf, B., Logothetis, N., Panzeri, S. Causal relationships between frequency bands of extracellular signals in visual cortex revealed by an information theoretic analysis Journal of Computational Neuroscience, 29(3):547-566, December 2010 (article)

PDF DOI [BibTex]

Tackling Box-Constrained Optimization via a New Projected Quasi-Newton Approach

Kim, D., Sra, S., Dhillon, I.

SIAM Journal on Scientific Computing, 32(6):3548-3563 , December 2010 (article)

Abstract

Numerous scientific applications across a variety of fields depend on box-constrained convex optimization. Box-constrained problems therefore continue to attract research interest. We address box-constrained (strictly convex) problems by deriving two new quasi-Newton algorithms. Our algorithms are positioned between the projected-gradient [J. B. Rosen, J. SIAM, 8 (1960), pp. 181–217] and projected-Newton [D. P. Bertsekas, SIAM J. Control Optim., 20 (1982), pp. 221–246] methods. We also prove their convergence under a simple Armijo step-size rule. We provide experimental results for two particular box-constrained problems: nonnegative least squares (NNLS), and nonnegative Kullback–Leibler (NNKL) minimization. For both NNLS and NNKL our algorithms perform competitively as compared to well-established methods on medium-sized problems; for larger problems our approach frequently outperforms the competition.

ei Kim, D., Sra, S., Dhillon, I. Tackling Box-Constrained Optimization via a New Projected Quasi-Newton Approach SIAM Journal on Scientific Computing, 32(6):3548-3563 , December 2010 (article)

Algorithmen zum Automatischen Erlernen von Motorfähigkeiten

Peters, J., Kober, J., Schaal, S.

at - Automatisierungstechnik, 58(12):688-694, December 2010 (article)

Abstract

Robot learning methods which allow autonomous robots to adapt to novel situations have been a long standing vision of robotics, artificial intelligence, and cognitive sciences. However, to date, learning techniques have yet to fulfill this promise as only few methods manage to scale into the high-dimensional domains of manipulator robotics, or even the new upcoming trend of humanoid robotics. If possible, scaling was usually only achieved in precisely pre-structured domains. In this paper, we investigate the ingredients for a general approach policy learning with the goal of an application to motor skill refinement in order to get one step closer towards human-like performance. For doing so, we study two major components for such an approach, i. e., firstly, we study policy learning algorithms which can be applied in the general setting of motor skill learning, and, secondly, we study a theoretically well-founded general approach to representing the required control structures for task representation and execution.

ei Peters, J., Kober, J., Schaal, S. Algorithmen zum Automatischen Erlernen von Motorfähigkeiten at - Automatisierungstechnik, 58(12):688-694, December 2010 (article)

PAC-Bayesian Analysis of Co-clustering and Beyond

Seldin, Y., Tishby, N.

Journal of Machine Learning Research, 11, pages: 3595-3646, December 2010 (article)

PDF PDF [BibTex]

ei Seldin, Y., Tishby, N. PAC-Bayesian Analysis of Co-clustering and Beyond Journal of Machine Learning Research, 11, pages: 3595-3646, December 2010 (article)

PDF PDF [BibTex]

Gaussian Processes for Machine Learning (GPML) Toolbox

Rasmussen, C., Nickisch, H.

Journal of Machine Learning Research, 11, pages: 3011-3015, November 2010 (article)

Abstract

The GPML toolbox provides a wide range of functionality for Gaussian process (GP) inference and prediction. GPs are specified by mean and covariance functions; we offer a library of simple mean and covariance functions and mechanisms to compose more complex ones. Several likelihood functions are supported including Gaussian and heavy-tailed for regression as well as others suitable for classification. Finally, a range of inference methods is provided, including exact and variational inference, Expectation Propagation, and Laplace's method dealing with non-Gaussian likelihoods and FITC for dealing with large regression tasks.

Web [BibTex]

ei Rasmussen, C., Nickisch, H. Gaussian Processes for Machine Learning (GPML) Toolbox Journal of Machine Learning Research, 11, pages: 3011-3015, November 2010 (article)

Web [BibTex]

Cryo-EM structure and rRNA model of a translating eukaryotic 80S ribosome at 5.5-Å resolution

Armache, J-P., Jarasch, A., Anger, AM., Villa, E., Becker, T., Bhushan, S., Jossinet, F., Habeck, M., Dindar, G., Franckenberg, S., Marquez, V., Mielke, T., Thomm, M., Berninghausen, O., Beatrix, B., Söding, J., Westhof, E., Wilson, DN., Beckmann, R.

Proceedings of the National Academy of Sciences of the United States of America, 107(46):19748-19753, November 2010 (article)

Abstract

Protein biosynthesis, the translation of the genetic code into polypeptides, occurs on ribonucleoprotein particles called ribosomes. Although X-ray structures of bacterial ribosomes are available, high-resolution structures of eukaryotic 80S ribosomes are lacking. Using cryoelectron microscopy and single-particle reconstruction, we have determined the structure of a translating plant (Triticum aestivum) 80S ribosome at 5.5-Å resolution. This map, together with a 6.1-Å map of a Saccharomyces cerevisiae 80S ribosome, has enabled us to model ∼98% of the rRNA. Accurate assignment of the rRNA expansion segments (ES) and variable regions has revealed unique ES–ES and r-protein–ES interactions, providing insight into the structure and evolution of the eukaryotic ribosome.

ei Armache, J-P., Jarasch, A., Anger, AM., Villa, E., Becker, T., Bhushan, S., Jossinet, F., Habeck, M., Dindar, G., Franckenberg, S., Marquez, V., Mielke, T., Thomm, M., Berninghausen, O., Beatrix, B., Söding, J., Westhof, E., Wilson, DN., Beckmann, R. Cryo-EM structure and rRNA model of a translating eukaryotic 80S ribosome at 5.5-Å resolution Proceedings of the National Academy of Sciences of the United States of America, 107(46):19748-19753, November 2010 (article)

Policy gradient methods

Peters, J.

Scholarpedia, 5(11):3698, November 2010 (article)

Abstract

Policy gradient methods are a type of reinforcement learning techniques that rely upon optimizing parametrized policies with respect to the expected return (long-term cumulative reward) by gradient descent. They do not suffer from many of the problems that have been marring traditional reinforcement learning approaches such as the lack of guarantees of a value function, the intractability problem resulting from uncertain state information and the complexity arising from continuous states & actions.

ei Peters, J. Policy gradient methods Scholarpedia, 5(11):3698, November 2010 (article)

Localization of eukaryote-specific ribosomal proteins in a 5.5-Å cryo-EM map of the 80S eukaryotic ribosome

Proceedings of the National Academy of Sciences of the United States of America, 107(46):19754-19759, November 2010 (article)

Abstract

Protein synthesis in all living organisms occurs on ribonucleoprotein particles, called ribosomes. Despite the universality of this process, eukaryotic ribosomes are significantly larger in size than their bacterial counterparts due in part to the presence of 80 r proteins rather than 54 in bacteria. Using cryoelectron microscopy reconstructions of a translating plant (Triticum aestivum) 80S ribosome at 5.5-Å resolution, together with a 6.1-Å map of a translating Saccharomyces cerevisiae 80S ribosome, we have localized and modeled 74/80 (92.5%) of the ribosomal proteins, encompassing 12 archaeal/eukaryote-specific small subunit proteins as well as the complete complement of the ribosomal proteins of the eukaryotic large subunit. Near-complete atomic models of the 80S ribosome provide insights into the structure, function, and evolution of the eukaryotic translational apparatus.

ei Armache, J-P., Jarasch, A., Anger, AM., Villa, E., Becker, T., Bhushan, S., Jossinet, F., Habeck, M., Dindar, G., Franckenberg, S., Marquez, V., Mielke, T., Thomm, M., Berninghausen, O., Beatrix, B., Söding, J., Westhof, E., Wilson, DN., Beckmann, R. Localization of eukaryote-specific ribosomal proteins in a 5.5-Å cryo-EM map of the 80S eukaryotic ribosome Proceedings of the National Academy of Sciences of the United States of America, 107(46):19754-19759, November 2010 (article)

Camps-Valls, G., Shervashidze, N., Borgwardt, K.

Spatio-Spectral Remote Sensing Image Classification With Graph Kernels

IEEE Geoscience and Remote Sensing Letters, 7(4):741-745, October 2010 (article)

Abstract

This letter presents a graph kernel for spatio-spectral remote sensing image classification with support vector machines (SVMs). The method considers higher order relations in the neighborhood (beyond pairwise spatial relations) to iteratively compute a kernel matrix for SVM learning. The proposed kernel is easy to compute and constitutes a powerful alternative to existing approaches. The capabilities of the method are illustrated in several multi- and hyperspectral remote sensing images acquired over both urban and agricultural areas.

ei Camps-Valls, G., Shervashidze, N., Borgwardt, K. Spatio-Spectral Remote Sensing Image Classification With Graph Kernels IEEE Geoscience and Remote Sensing Letters, 7(4):741-745, October 2010 (article)

Janzing, D., Schölkopf, B.

Causal Inference Using the Algorithmic Markov Condition

IEEE Transactions on Information Theory, 56(10):5168-5194, October 2010 (article)

Abstract

Inferring the causal structure that links $n$ observables is usually based upon detecting statistical dependences and choosing simple graphs that make the joint measure Markovian. Here we argue why causal inference is also possible when the sample size is one. We develop a theory how to generate causal graphs explaining similarities between single objects. To this end, we replace the notion of conditional stochastic independence in the causal Markov condition with the vanishing of conditional algorithmic mutual information and describe the corresponding causal inference rules. We explain why a consistent reformulation of causal inference in terms of algorithmic complexity implies a new inference principle that takes into account also the complexity of conditional probability densities, making it possible to select among Markov equivalent causal graphs. This insight provides a theoretical foundation of a heuristic principle proposed in earlier work. We also sketch some ideas on how to replace Kolmogorov complexity with decidable complexity criteria. This can be seen as an algorithmic analog of replacing the empirically undecidable question of statistical independence with practical independence tests that are based on implicit or explicit assumptions on the underlying distribution.

ei Janzing, D., Schölkopf, B. Causal Inference Using the Algorithmic Markov Condition IEEE Transactions on Information Theory, 56(10):5168-5194, October 2010 (article)

Recurrent Policy Gradients

Wierstra, D., Förster, A., Peters, J., Schmidhuber, J.

Logic Journal of the IGPL, 18(5):620-634, October 2010 (article)

Abstract

Reinforcement learning for partially observable Markov decision problems (POMDPs) is a challenge as it requires policies with an internal state. Traditional approaches suffer significantly from this shortcoming and usually make strong assumptions on the problem domain such as perfect system models, state-estimators and a Markovian hidden system. Recurrent neural networks (RNNs) offer a natural framework for dealing with policy learning using hidden state and require only few limiting assumptions. As they can be trained well using gradient descent, they are suited for policy gradient approaches. In this paper, we present a policy gradient method, the Recurrent Policy Gradient which constitutes a model-free reinforcement learning method. It is aimed at training limited-memory stochastic policies on problems which require long-term memories of past observations. The approach involves approximating a policy gradient for a recurrent neural network by backpropagating return-weighted characteristic eligibilities through time. Using a Long Short-Term Memory RNN architecture, we are able to outperform previous RL methods on three important benchmark tasks. Furthermore, we show that using history-dependent baselines helps reducing estimation variance significantly, thus enabling our approach to tackle more challenging, highly stochastic environments.

ei Wierstra, D., Förster, A., Peters, J., Schmidhuber, J. Recurrent Policy Gradients Logic Journal of the IGPL, 18(5):620-634, October 2010 (article)

Discriminative frequent subgraph mining with optimality guarantees

Thoma, M., Cheng, H., Gretton, A., Han, J., Kriegel, H., Smola, A., Song, L., Yu, P., Yan, X., Borgwardt, K.

Journal of Statistical Analysis and Data Mining, 3(5):302–318, October 2010 (article)

Abstract

The goal of frequent subgraph mining is to detect subgraphs that frequently occur in a dataset of graphs. In classification settings, one is often interested in discovering discriminative frequent subgraphs, whose presence or absence is indicative of the class membership of a graph. In this article, we propose an approach to feature selection on frequent subgraphs, called CORK, that combines two central advantages. First, it optimizes a submodular quality criterion, which means that we can yield a near-optimal solution using greedy feature selection. Second, our submodular quality function criterion can be integrated into gSpan, the state-of-the-art tool for frequent subgraph mining, and help to prune the search space for discriminative frequent subgraphs even during frequent subgraph mining.

ei Thoma, M., Cheng, H., Gretton, A., Han, J., Kriegel, H., Smola, A., Song, L., Yu, P., Yan, X., Borgwardt, K. Discriminative frequent subgraph mining with optimality guarantees Journal of Statistical Analysis and Data Mining, 3(5):302–318, October 2010 (article)

Bayesian Inference and Experimental Design for Large Generalised Linear Models

Nickisch, H.

Biologische Kybernetik, Technische Universität Berlin, Berlin, Germany, September 2010 (phdthesis)

PDF Web [BibTex]

ei Nickisch, H. Bayesian Inference and Experimental Design for Large Generalised Linear Models Biologische Kybernetik, Technische Universität Berlin, Berlin, Germany, September 2010 (phdthesis)

PDF Web [BibTex]

Combining active learning and reactive control for robot grasping

Kroemer, O., Detry, R., Piater, J., Peters, J.

Robotics and Autonomous Systems, 58(9):1105-1116, September 2010 (article)

Abstract

Grasping an object is a task that inherently needs to be treated in a hybrid fashion. The system must decide both where and how to grasp the object. While selecting where to grasp requires learning about the object as a whole, the execution only needs to reactively adapt to the context close to the grasps location. We propose a hierarchical controller that reflects the structure of these two sub-problems, and attempts to learn solutions that work for both. A hybrid architecture is employed by the controller to make use of various machine learning methods that can cope with the large amount of uncertainty inherent to the task. The controllers upper level selects where to grasp the object using a reinforcement learner, while the lower level comprises an imitation learner and a vision-based reactive controller to determine appropriate grasping motions. The resulting system is able to quickly learn good grasps of a novel object in an unstructured environment, by executing smooth reaching motions and preshapin g the hand depending on the objects geometry. The system was evaluated both in simulation and on a real robot.

ei Kroemer, O., Detry, R., Piater, J., Peters, J. Combining active learning and reactive control for robot grasping Robotics and Autonomous Systems, 58(9):1105-1116, September 2010 (article)

Nonparametric Regression between General Riemannian Manifolds

Steinke, F., Hein, M., Schölkopf, B.

SIAM Journal on Imaging Sciences, 3(3):527-563, September 2010 (article)

Abstract

We study nonparametric regression between Riemannian manifolds based on regularized empirical risk minimization. Regularization functionals for mappings between manifolds should respect the geometry of input and output manifold and be independent of the chosen parametrization of the manifolds. We define and analyze the three most simple regularization functionals with these properties and present a rather general scheme for solving the resulting optimization problem. As application examples we discuss interpolation on the sphere, fingerprint processing, and correspondence computations between three-dimensional surfaces. We conclude with characterizing interesting and sometimes counterintuitive implications and new open problems that are specific to learning between Riemannian manifolds and are not encountered in multivariate regression in Euclidean space.

ei Steinke, F., Hein, M., Schölkopf, B. Nonparametric Regression between General Riemannian Manifolds SIAM Journal on Imaging Sciences, 3(3):527-563, September 2010 (article)

Hybrid PET/MRI of Intracranial Masses: Initial Experiences and Comparison to PET/CT

Boss, A., Bisdas, S., Kolb, A., Hofmann, M., Ernemann, U., Claussen, C., Pfannenberg, C., Pichler, B., Reimold, M., Stegger, L.

Journal of Nuclear Medicine, 51(8):1198-1205, August 2010 (article)

ei Boss, A., Bisdas, S., Kolb, A., Hofmann, M., Ernemann, U., Claussen, C., Pfannenberg, C., Pichler, B., Reimold, M., Stegger, L. Hybrid PET/MRI of Intracranial Masses: Initial Experiences and Comparison to PET/CT Journal of Nuclear Medicine, 51(8):1198-1205, August 2010 (article)