Header logo is


2006


no image
Learning operational space control

Peters, J., Schaal, S.

In Robotics: Science and Systems II (RSS 2006), pages: 255-262, (Editors: Gaurav S. Sukhatme and Stefan Schaal and Wolfram Burgard and Dieter Fox), Cambridge, MA: MIT Press, RSS , 2006, clmc (inproceedings)

Abstract
While operational space control is of essential importance for robotics and well-understood from an analytical point of view, it can be prohibitively hard to achieve accurate control in face of modeling errors, which are inevitable in complex robots, e.g., humanoid robots. In such cases, learning control methods can offer an interesting alternative to analytical control algorithms. However, the resulting learning problem is ill-defined as it requires to learn an inverse mapping of a usually redundant system, which is well known to suffer from the property of non-covexity of the solution space, i.e., the learning system could generate motor commands that try to steer the robot into physically impossible configurations. A first important insight for this paper is that, nevertheless, a physically correct solution to the inverse problem does exits when learning of the inverse map is performed in a suitable piecewise linear way. The second crucial component for our work is based on a recent insight that many operational space controllers can be understood in terms of a constraint optimal control problem. The cost function associated with this optimal control problem allows us to formulate a learning algorithm that automatically synthesizes a globally consistent desired resolution of redundancy while learning the operational space controller. From the view of machine learning, the learning problem corresponds to a reinforcement learning problem that maximizes an immediate reward and that employs an expectation-maximization policy search algorithm. Evaluations on a three degrees of freedom robot arm illustrate the feasability of our suggested approach.

am ei

link (url) [BibTex]

2006


link (url) [BibTex]


no image
Reinforcement Learning for Parameterized Motor Primitives

Peters, J., Schaal, S.

In Proceedings of the 2006 International Joint Conference on Neural Networks, pages: 73-80, IJCNN, 2006, clmc (inproceedings)

Abstract
One of the major challenges in both action generation for robotics and in the understanding of human motor control is to learn the "building blocks of movement generation", called motor primitives. Motor primitives, as used in this paper, are parameterized control policies such as splines or nonlinear differential equations with desired attractor properties. While a lot of progress has been made in teaching parameterized motor primitives using supervised or imitation learning, the self-improvement by interaction of the system with the environment remains a challenging problem. In this paper, we evaluate different reinforcement learning approaches for improving the performance of parameterized motor primitives. For pursuing this goal, we highlight the difficulties with current reinforcement learning methods, and outline both established and novel algorithms for the gradient-based improvement of parameterized policies. We compare these algorithms in the context of motor primitive learning, and show that our most modern algorithm, the Episodic Natural Actor-Critic outperforms previous algorithms by at least an order of magnitude. We demonstrate the efficiency of this reinforcement learning method in the application of learning to hit a baseball with an anthropomorphic robot arm.

am ei

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Statistical Learning of LQG controllers

Theodorou, E.

Technical Report-2006-1, Computational Action and Vision Lab University of Minnesota, 2006, clmc (techreport)

am

PDF [BibTex]

PDF [BibTex]


no image
Ab-initio calculations: I. Basic principles of the density functional electron theory and combination with phenomenological theories

Fähnle, M.

In Structural defects in ordered alloys and intermetallics. Characterization and modelling, pages: IX-1-IX-10, COST and CNRS, Bonascre [Ariege, France], 2006 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Influence of the substrate on the magnetic anisotropy of monatomic wires

Komelj, M., Steiauf, D., Fähnle, M.

{Physical Review B}, 73, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Mechanical properties of single-walled carbon nanotubes based on higher order Cauchy-Born rule

Guo, X., Wang, J. B., Zhang, H. W.

{International Journal of Solids and Structures}, 43, pages: 1276-1290, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Vanishing Fe 3d orbital moments in single-crystalline magnetite

Goering, E., Gold, S., Lafkioti, M., Schütz, G.

{Europhysics Letters}, 73(1):97-103, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Enhancement of L10 phase formation in FePt nanoparticles by nitrogenization

Dmitrieva, O., Acet, M., Dumpich, G., Kästner, J., Antoniak, C., Farle, M., Fauth, K.

{Journal of Physics D}, 39, pages: 4741-4745, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Hard magnetic FePt thin films and nanostructures in L1(0) phases

Goll, D., Breitling, A., Goo, N. H., Sigle, W., Hirscher, M., Schütz, G.

In 13, pages: 97-101, Beijing, PR China, 2006 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Structure of historical brass tonques and shallots from baroque organs

Baretzky, B., Friesel, M., Petelin, A., Mazilkin, A., Straumal, B.

{Defect and Diffusion Forum}, 249, pages: 275-280, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Three-dimensional modeling of mechanical forces in the extra-cellular matrix during epithelial lumen formation

Zeng, D., Ferrari, A., Ulmer, J., Veligodskiy, A., Fischer, P., Spatz, J. P., Ventikos, Y., Poulikakos, D., Kroschewski, R.

{Biophysical Journal}, 90(12):4380-4391, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Theoretical justification of ground-state moment analysis of magnetic dichroic x-ray absorption spectra for 3d transition metals

Dörfler, F., Fähnle, M.

{Physical Review B}, 74, 2006 (article)

Abstract
{(6 pages)}

mms

[BibTex]


no image
Ab-initio calculations: II. Application to atomic defects, phase diagrams, dislocations

Fähnle, M.

In Structural defects in ordered alloys and intermetallics. Characterization and modelling, pages: XIV-1-XIV-11, COST and CNRS, Bonascre [Ariege, France], 2006 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Vortex dynamics in coupled ferromagnetic multilayer structures

Chou, K., Puzic, A., Stoll, H., Schütz, G., Van Waeyenberge, B., Tyliszczak, T., Rott, K., Reiss, G., Brückl, H., Neudecker, I., Weiss, D., Back, C. H.

{Journal of Applied Physics}, 99, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Electrical transport, magnetic and thermal properties of icosahedral Al-Pd-Mn quasicrystals

Poddar, A., Das, S., Plachke, D., Carstanjen, H.D.

{Journal of Magnetism and Magnetic Materials}, 300(2):263-272, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Elektronentheorie der magnetischen EXAFS

Gü\ssmann, M.

Universität Stuttgart, Stuttgart, 2006 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Aqueous solution deposition of indium hydroxide and indium oxide columnar type thin films

Qiu, Y., Gerstel, P., Jiang, L., Lipowsky, P., Pitta Bauermann, L., Bill, J.

{International Journal of Materials Research}, 97(6):808-811, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Enhanced orbital magnetism in Fe50Pt50 nanoparticles

Antoniak, C., Lindner, J., Spasova, M., Sudfeld, D., Acet, M., Farle, M., Fauth, K., Wiedwald, U., Boyen, H.-G., Ziemann, P., Wilhelm, F., Rogalev, A., Sun, S.

{Physical Review Letters}, 97, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Approximate nearest neighbor regression in very high dimensions

Vijayakumar, S., DSouza, A., Schaal, S.

In Nearest-Neighbor Methods in Learning and Vision, pages: 103-142, (Editors: Shakhnarovich, G.;Darrell, T.;Indyk, P.), Cambridge, MA: MIT Press, 2006, clmc (inbook)

am

link (url) [BibTex]

link (url) [BibTex]


no image
Converting polycrystals into single crystals - Selective grain growth by high-energy ion bombardment

Olliges, S., Gruber, P., Bardill, A., Ehrler, D., Carstanjen, H. D., Spolenak, R.

{Acta Materialia}, 54(20):5393-5399, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Topological k-space refinement of the configurational energy of alloys

Shchyglo, O., Bugaev, V.N., Drautz, R., Udyanskyy, A., Reichert, H., Dosch, H.

{Physical Review B}, 72, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Elektronenspektroskopie an Übergangsmetallclustern

He\ssler, M.

Bayerische Julius-Maximilians-Universität, Würzburg, 2006 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Synthesis of MgB2 films in Mg vapour flow and their characterization

Matveev, A. T., Albrecht, J., Konuma, M., Christiani, G., Krockenberger, Y., Starke, U., Schütz, G., Habermeier, H.

{Superconductor Science and Technology}, 19, pages: 299-305, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Analysis of switching times of inhomogeneous magnetization processes in thin platelets

Goll, D., Schütz, G., Kronmüller, H.

{Physica B: Condensed Matter}, 372(1-2):273-276, 2006 (article)

mms

[BibTex]

[BibTex]


no image
The initial oxidation of magnesium: an in situ study with XPS, HERDA and ellipsometry.

Kurth, M., Graat, P. C. J., Carstanjen, H. D., Mittemeijer, E. J.

{Surface and Interface Analysis}, 38, pages: 931-940, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Temperature influence of the faceting of \sum3 and \sum9 grain boundaries in Cu

Straumal, B. B., Polyakov, S. A., Mittemeijer, E. J.

{Acta Materialia}, 54, pages: 167-172, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Coercivity of 2 : 17 based permanent magnets

Kronmüller, H., Goll, D.

{Journal of the Iron and Steel Research International}, 13(Suppl. 1):39-47, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Hydrogen adsorption in a nickel based coordination polymer with open metal sites in the cylindrical cavities of the desolvated framework

Dietzel, P. D. C., Panella, B., Hirscher, M., Blom, R., Fjellvag, H.

{Chemical Communications}, [2006], pages: 959-961, 2006 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetic ground states and the role of vortices in ferromagnetic hollow nanospheres

Goll, D., Macke, S., Berkowitz, A., Bertram, H. N.

{Physica B: Condensed Matter}, 372(1-2):282-285, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Pulsed-field-gradient NMR study of hydrogen diffusivity in random b.c.c. alloys VyTa1-y

Grinberg, F., Majer, G., Skripov, A. N.

{Journal of Alloys and Compounds}, 425(1-2):24-27, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Hydrogen storage by physisorption on porous materials

Panella, B.

Universität Stuttgart, Stuttgart, 2006 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Breathing Fermi surface model for noncollinear magnetization: a generalization of the Gilbert equation

Fähnle, M., Steiauf, D.

{Physical Review B}, 73, 2006 (article)

mms

[BibTex]


no image
Reconstruction of brass for tongues and shallots from baroque organs

Baretzky, B., Friesel, M., Petelin, A., Shotanov, A., Straumal, B.

{Defect and Diffusion Forum}, 258-260, pages: 397-402, 2006 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Softening of nanostructured Al-Zn and Al-Mg alloys after severe plastic deformation

Mazilkin, A.A., Straumal, B.B., Rabkin, E., Baretzky, B., Enders, S., Protasova, S.G., Kogtenkova, O.A., Valiev, R.Z.

{Acta Materialia}, 54, pages: 3933-3939, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Theory of magnetic x-ray reflectometry on the Co2Pt7 multilayer system

Martosiswoyo, L.

Universität Stuttgart, Stuttgart, 2006 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Comment on "Spin and orbital magnetic moments of Fe3O4

Goering, E., Lafkioti, M., Gold, S.

{Physical Review Letters}, 96(3), 2006 (article)

mms

[BibTex]

[BibTex]


no image
Residual stress analysis in reed pipe brass tongues of historic organs

Manescu, A., Giuliani, A., Fiori, F., Baretzky, B.

In Residual Stresses VII. 7th Europen Conference on Residual Stresses (ECRS7), pages: 969-974, Trans Tech, Berlin [Germany], 2006 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Effect of magnetic interaction on thermally activated reversal in a magnet with a distribution of energy barriers

Zhang, H. W., Zhang, S., Sun, J. R., Shen, B. G., Goll, D., Kronmüller, H.

{Journal of the Iron and Steel Research International}, 13(Suppl. 1):60-66, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Magnetic vortex core reversal by excitation with short bursts of an alternating field

Van Waeyenberge, B., Puzic, A., Stoll, H., Chou, K. W., Tyliszczak, T., Hertel, R., Fähnle, M., Bruckl, H., Rott, K., Reiss, G., Neudecker, I., Weiss, D., Back, C. H., Schütz, G.

{Nature}, 444(7118):461-464, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Structure and magnetism in bcc-based iron-cobalt alloys

Diaz-Ortiz, A., Drautz, R., Fähnle, M., Dosch, H., Sanchez, J. M.

{Physical Review B}, 73, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Role of nonequilibrium conduction electrons on the magnetization dynamics of ferromagnets in the s-d model

Fähnle, M., Singer, R., Steiauf, D., Antropov, V. P.

{Physical Review B}, 73, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Hydrogen adsorption in metal-organic frameworks: Cu-MOFs and Zn-MOFs compared

Panella, B., Hirscher, M., Pütter, H., Müller, U.

{Advanced Functional Materials}, 16, pages: 520-524, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Hardness of nanostructured Al-Zn, Al-Mg and Al-Zn-Mg alloys obtained by high-pressure torsion

Mazilkin, A.A., Baretzky, B., Enders, S., Kogtenkova, O.A., Straumal, B.B., Rabkin, E., Valiev, R.Z.

{Defect and Diffusion Forum}, 249, pages: 155-160, 2006 (article)

mms

[BibTex]

[BibTex]


no image
Magnetischer zirkularer Röntgendichroismus an Übergangsmetalloxiden

Lafkioti, M.

Universität Stuttgart, Stuttgart, 2006 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
High-pressure influence on the kinetics of grain boundary segregation in the Cu-Bi system

Chang, L.-S., Straumal, B., Rabkin, E., Lojkowski, W., Gust, W.

In 258-260, pages: 390-396, Aveiro (Portugal), 2006 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Contributions to the theory of x-ray magnetic dichroism

Dörfler, F.

Universität Stuttgart, Stuttgart, 2006 (mastersthesis)

mms

[BibTex]

[BibTex]