Header logo is


2018


no image
Kernel Recursive ABC: Point Estimation with Intractable Likelihood

Kajihara, T., Kanagawa, M., Yamazaki, K., Fukumizu, K.

Proceedings of the 35th International Conference on Machine Learning, pages: 2405-2414, PMLR, July 2018 (conference)

Abstract
We propose a novel approach to parameter estimation for simulator-based statistical models with intractable likelihood. Our proposed method involves recursive application of kernel ABC and kernel herding to the same observed data. We provide a theoretical explanation regarding why the approach works, showing (for the population setting) that, under a certain assumption, point estimates obtained with this method converge to the true parameter, as recursion proceeds. We have conducted a variety of numerical experiments, including parameter estimation for a real-world pedestrian flow simulator, and show that in most cases our method outperforms existing approaches.

pn

Paper [BibTex]

2018


Paper [BibTex]


Dissecting Adam: The Sign, Magnitude and Variance of Stochastic Gradients
Dissecting Adam: The Sign, Magnitude and Variance of Stochastic Gradients

Balles, L., Hennig, P.

In Proceedings of the 35th International Conference on Machine Learning (ICML), 2018 (inproceedings) Accepted

Abstract
The ADAM optimizer is exceedingly popular in the deep learning community. Often it works very well, sometimes it doesn't. Why? We interpret ADAM as a combination of two aspects: for each weight, the update direction is determined by the sign of stochastic gradients, whereas the update magnitude is determined by an estimate of their relative variance. We disentangle these two aspects and analyze them in isolation, gaining insight into the mechanisms underlying ADAM. This analysis also extends recent results on adverse effects of ADAM on generalization, isolating the sign aspect as the problematic one. Transferring the variance adaptation to SGD gives rise to a novel method, completing the practitioner's toolbox for problems where ADAM fails.

pn

link (url) Project Page [BibTex]

link (url) Project Page [BibTex]

2007


no image
Single lamella crystals of polyethylene accessible by catalytic emulsion-polymerization

Weber, C. H. M., Chiche, A., Krausch, G., Rosenfeldt, S., Ballauff, M., Goettker-Schnetmann, I., Tong, Q., Mecking, S., Harnau, L.

In Polymeric Materials: Science \& Engineering, 97, pages: 133-134, 2007 (inproceedings)

icm

[BibTex]

2007


[BibTex]

2001


no image
Diffusion of implanted 195Au radiotracer atoms in amorphous silicon under irradiation with 1 MeV-N+ ions

Voss, T., Scharwaechter, P., Frank, W.

In Proceedings of DIMAT 2000, the Fifth International Conference on Diffusion in Materials, 194/199, pages: 659-665, Defect and Diffusion Forum, Scitec Publications Ltd., Paris, France, 2001 (inproceedings)

icm

[BibTex]

2001


[BibTex]


no image
Diffusion of gold in the amorphous ceramic Si28C36N36

Matics, S., Frank, W.

In Proceedings of DIMAT 2000, the Fifth International Conference on Diffusion in Materials, 194/199, pages: 947-952, Diffusion and Defect Forum, Scitec Publications Ltd., Paris, France, 2001 (inproceedings)

icm

[BibTex]

[BibTex]


no image
Diffusion of gold in germanium

Strohm, A., Matics, S., Frank, W.

In Proceedings of DIMAT 2000, the Fifth International Conference on Diffusion in Materials, 194/199, pages: 629-634, Defect and Diffusion Forum, Scitech Publ. Ltd., Paris, France, 2001 (inproceedings)

icm

[BibTex]

[BibTex]