DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Rationality Enhancement Conference Paper Promoting metacognitive learning through systematic reflection Becker, F., Lieder, F. Workshop on Metacognition in the Age of AI. Thirty-fifth Conference on Neural Information Processing Systems, 35th Conference on Neural Information Processing Systems (NeurIPS 2021), December 2021 (Published) DOI URL BibTeX

Robotic Materials Article Miniaturized Circuitry for Capacitive Self-sensing and Closed-loop Control of Soft Electrostatic Transducers Ly, K., Kellaris, N., McMorris, D., Johnson, B. K., Acome, E., Sundaram, V., Naris, M., Humbert, J. S., Rentschler, M. E., Keplinger, C., et al. Soft Robotics, 8(6):673-686, Mary Ann Liebert, Inc., publishers, December 2021 (Published) DOI URL BibTeX

Autonomous Vision Conference Paper Projected GANs Converge Faster Sauer, A. C. K. M. J. G. A. Advances in Neural Information Processing Systems 34 (NeurIPS 2021) , 34, (Editors: Ranzato, M; Beygelzimer, A; Dauphin, Y; Liang, PS; Vaughan, JW), NeuRIPS, 35th Conference on Neural Information Processing Systems (NeurIPS), December 2021 (Published) URL BibTeX

Autonomous Vision Conference Paper CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields Niemeyer, M. G. A. In Proceedings 2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), :951-961, 3DV, 3DV, December 2021 (Published) DOI BibTeX

Human-centric Vision & Learning Conference Paper Human Performance Capture from Monocular Video in the Wild Guo, C. C. X. S. J. H. O. 2021 International Conference on 3D Vision (3DV), :889-898, IEEE, International Conference on 3D Vision (3DV 2021), December 2021 (Published) DOI URL BibTeX

Empirical Inference Conference Paper A Probabilistic State Space Model for Joint Inference from Differential Equations and Data Schmidt, J., Kraemer, N., Hennig, P. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :12374-12385, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021 (Published) URL BibTeX

Rationality Enhancement Article A Rational Reinterpretation of Dual Process Theories Milli, S., Lieder, F., Griffiths, T. L. Cognition, 217, December 2021 (Published) DOI URL BibTeX

Movement Generation and Control Conference Paper A unified framework for walking and running of bipedal robots Boroujeni, M. G., Daneshmand, E., Righetti, L., Khadiv, M. 20th International Conference on Advanced Robotics (ICAR), December 2021, Accepted (Accepted) URL BibTeX

Autonomous Vision Conference Paper ATISS: Autoregressive Transformers for Indoor Scene Synthesis Paschalidou, D., Kar, A., Shugrina, M., Kreis, K., Geiger, A., Fidler, S. In Advances in Neural Information Processing Systems 34, 15:12013-12026, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P. S. Liang and J. Wortman Vaughan), Curran Associates, Inc., Red Hook, NY, 35th Conference on Neural Information Processing Systems (NeurIPS 2021), December 2021 (Published) URL BibTeX

Empirical Inference Conference Paper An Infinite-Feature Extension for Bayesian ReLU Nets That Fixes Their Asymptotic Overconfidence Kristiadi, A., Hein, M., Hennig, P. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :18789-18800, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021 (Published) URL BibTeX

Empirical Inference Conference Paper Analytic Insights into Structure and Rank of Neural Network Hessian Maps Singh, S. P., Bachmann, G., Hofmann, T. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :23914-23927, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021 (Published) URL BibTeX

Empirical Inference Article ArmSym: a virtual human-robot interaction laboratory for assistive robotics Bustamante, S., Peters, J., Schölkopf, B., Grosse-Wentrup, M., Jayaram, V. IEEE Transactions on Human-Machine Systems, 51(6):568-577, December 2021 (Published) DOI URL BibTeX

Empirical Inference Conference Paper Backward-Compatible Prediction Updates: A Probabilistic Approach Träuble, F., von Kügelgen, J., Kleindessner, M., Locatello, F., Schölkopf, B., Gehler, P. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :116-128, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems (NeurIPS), December 2021 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Bootstrap Your Flow Midgley, L. I., Stimper, V., Simm, G. N. C., Hernández-Lobato, J. M. 1st ELLIS Machine Learning for Molecule Discovery Workshop, 1st ELLIS Machine Learning for Molecule Discovery Workshop , December 2021 (Published) arXiv URL BibTeX

Autonomous Learning Empirical Inference Conference Paper Causal Influence Detection for Improving Efficiency in Reinforcement Learning Seitzer, M., Schölkopf, B., Martius, G. In Advances in Neural Information Processing Systems 34 (NeurIPS 2021), 34:22905-22918, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P. S. Liang and J. Wortman Vaughan), Curran Associates, Inc., Red Hook, NY, 35th Conference on Neural Information Processing Systems, December 2021 (Published) arXiv PDF Data Code URL BibTeX

Empirical Inference Conference Paper Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks Schneider, F., Dangel, F., Hennig, P. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :20825-20837, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems (NeurIPS), December 2021 (Published) URL BibTeX

Perceiving Systems Conference Paper Collaborative Regression of Expressive Bodies using Moderation Feng, Y., Choutas, V., Bolkart, T., Tzionas, D., Black, M. J. 2021 International Conference on 3D Vision (3DV 2021), :792-804, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2021), December 2021 (Published) arXiv project pdf suppl DOI BibTeX

Empirical Inference Conference Paper DiBS: Differentiable Bayesian Structure Learning Lorch, L., Rothfuss, J., Schölkopf, B., Krause, A. In Advances in Neural Information Processing Systems 34, 29:24111-24123, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P. S. Liang and J. Wortman Vaughan), Curran Associates, Inc., Red Hook, NY, 35th Annual Conference on Neural Information Processing Systems (NeurIPS 2021), December 2021 (Published) URL BibTeX

Embodied Vision Conference Paper DiffSDFSim: Differentiable Rigid-Body Dynamics With Implicit Shapes Strecke, M., Stückler, J. In 2021 International Conference on 3D Vision (3DV 2021) , :96-105 , International Conference on 3D Vision (3DV 2021) , December 2021 (Published) Project website Preprint Code DOI URL BibTeX

Empirical Inference Conference Paper Dynamic Inference with Neural Interpreters Rahaman*, N., Gondal*, M. W., Joshi, S., Gehler, P., Bengio, Y., Locatello, F., Schölkopf, B. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :10985-10998, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021, *equal contribution (Published) URL BibTeX

Empirical Inference Conference Paper Fine-Grained Zero-Shot Learning with DNA as Side Information Badirli, S., Akata, Z., Mohler, G., Picard, C., Dundar, M. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), 34:19352-19362, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Conference on Neural Information Processing Systems (NeurIPS 2021) , December 2021 (Published) URL BibTeX

Micro, Nano, and Molecular Systems Article Following molecular mobility during chemical reactions: no evidence for active propulsion Fillbrook, L. L., Günther, J., Majer, G., O’Leary, D. J. P. W. S., Van Ryswyk, H., Fischer, P., Beves, J. E. Journal of the American Chemical Society, 143(49):20884-20890, December 2021 () DOI URL BibTeX

Rationality Enhancement Conference Paper Have I done enough planning or should I plan more? He, R., Jain, Y. R., Lieder, F. Workshop on Metacognition in the Age of AI. Thirty-fifth Conference on Neural Information Processing Systems, Long Paper, Workshop on Metacognition in the Age of AI. Thirty-fifth Conference on Neural Information Processing Systems, December 2021, Accepted (Accepted) BibTeX

Empirical Inference Autonomous Learning Conference Paper Hierarchical Reinforcement Learning with Timed Subgoals Gürtler, N., Büchler, D., Martius, G. In Advances in Neural Information Processing Systems 34, 26:21732-21743, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P. S. Liang and J. Wortman Vaughan), Curran Associates, Inc., Red Hook, NY, 35th Conference on Neural Information Processing Systems (NeurIPS 2021), December 2021 (Published) video arXiv code URL BibTeX

Empirical Inference Conference Paper Independent mechanisms analysis, a new concept? Gresele*, L., von Kügelgen*, J., Stimper, V., Schölkopf, B., Besserve, M. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :28233-28248, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021, *equal contribution (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Iterative Teaching by Label Synthesis Liu, W., Liu, Z., Wang, H., Paull, L., Schölkopf, B., Weller, A. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :21681-21695, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021 (Published) URL BibTeX

Empirical Inference Conference Paper Laplace Redux — Effortless Bayesian Deep Learning Daxberger*, E., Kristiadi*, A., Immer*, A., Eschenhagen*, R., Bauer, M., Hennig, P. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :20089-20103, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021, *equal contribution (Published) URL BibTeX

Perceiving Systems Conference Paper Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentation Fan, Z., Spurr, A., Kocabas, M., Tang, S., Black, M. J., Hilliges, O. 2021 International Conference on 3D Vision (3DV 2021), :1-10, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2021), December 2021 (Published) arXiv project code video DOI BibTeX

Article Learning to solve sequential physical reasoning problems from a scene image Driess, D., Ha, J., Toussaint, M. The International Journal of Robotics Research, 40(12-14):1435-1466, December 2021 (Published) DOI BibTeX

Intelligent Control Systems Conference Paper Learning-enhanced robust controller synthesis with rigorous statistical and control-theoretic guarantees Fiedler, C., Scherer, C. W., Trimpe, S. In 60th IEEE Conference on Decision and Control (CDC), IEEE, December 2021, Accepted (Accepted) URL BibTeX

Empirical Inference Conference Paper Linear-Time Probabilistic Solution of Boundary Value Problems Kraemer, N., Hennig, P. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :11160-11171, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021 (Published) URL BibTeX

Intelligent Control Systems Conference Paper Local policy search with Bayesian optimization Müller, S., von Rohr, A., Trimpe, S. In Advances in Neural Information Processing Systems 34, 25:20708-20720, (Editors: Ranzato, M. and Beygelzimer, A. and Dauphin, Y. and Liang, P. S. and Wortman Vaughan, J.), Curran Associates, Inc., Red Hook, NY, 35th Conference on Neural Information Processing Systems (NeurIPS 2021) , December 2021 (Published) arXiv GitHub URL BibTeX

Empirical Inference Conference Paper Locality Sensitive Teaching Xu, Z., Chen, B., Li, C., Liu, W., Song, L., Lin, Y., Shrivastava, A. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :18049-18062, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021 (Published) URL BibTeX

Autonomous Vision Perceiving Systems Conference Paper MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images Wang, S., Mihajlovic, M., Ma, Q., Geiger, A., Tang, S. In Advances in Neural Information Processing Systems 34, 4:2810-2822, (Editors: Ranzato, M. and Beygelzimer, A. and Dauphin, Y. and Liang, P. S. and Wortman Vaughan, J.), Curran Associates, Inc., Red Hook, NY, 35th Conference on Neural Information Processing Systems (NeurIPS 2021), December 2021 (Published) Project page arXiv URL BibTeX

Autonomous Vision Conference Paper On the Frequency Bias of Generative Models Schwarz, K., Liao, Y., Geiger, A. In Advances in Neural Information Processing Systems 34, 22:18126-18136, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P. S. Liang and J. Wortman Vaughan), Curran Associates, Inc., Red Hook, NY, 35th Conference on Neural Information Processing Systems (NeurIPS 2021), December 2021 (Published) URL BibTeX

Autonomous Learning Conference Paper Planning from Pixels in Environments with Combinatorially Hard Search Spaces Bagatella, M., Olšák, M., Rolínek, M., Martius, G. In Advances in Neural Information Processing Systems 34, 30:24707-24718, Curran Associates, Inc., Red Hook, NY, 35th Conference on Neural Information Processing Systems (NeurIPS 2021), December 2021 (Published) URL BibTeX

Empirical Inference Article Real-time gravitational wave science with neural posterior estimation Dax, M., Green, S. R., Gair, J., Macke, J. H., Buonanno, A., Schölkopf, B. Physical Review Letters, 127(24), December 2021 (Published) arXiv DOI URL BibTeX

Empirical Inference Conference Paper Regret Bounds for Gaussian-Process Optimization in Large Domains Wüthrich, M., Schölkopf, B., Krause, A. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :7385-7396, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Robustness via Uncertainty-aware Cycle Consistency Upadhyay, U., Chen, Y., Akata, Z. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :28261-28273, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021 (Published) URL BibTeX

Micro, Nano, and Molecular Systems Article Rods in a lyotropic chromonic liquid crystal: emergence of chirality, symmetry-breaking alignment, and caged angular diffusion Ettinger, S., Dietrich, C. F., Mishra, C. K., Miksch, C., Beller, D. A., Collings, P. J., Yodh, A. G. Soft Matter, 18(3):487-495 , December 2021 (Published) DOI BibTeX

Article Section Patterns: Efficiently Solving Narrow Passage Problems in Multilevel Motion Planning Orthey, A., Toussaint, M. IEEE Transactions on Robotics, 37(6):1891-1905, December 2021 (Published) DOI BibTeX

Empirical Inference Conference Paper Self-supervised learning with data augmentations provably isolates content from style von Kügelgen*, J., Sharma*, Y., Gresele*, L., Brendel, W., Schölkopf, B., Besserve, M., Locatello, F. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :16451-16467, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021, *equal contribution (Published) arXiv URL BibTeX

Autonomous Vision Conference Paper Shape As Points: A Differentiable Poisson Solver Peng, S., Jiang, C. M., Liao, Y., Niemeyer, M., Pollefeys, M., Geiger, A. In Advances in Neural Information Processing Systems 34, 16:13032-13044, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P. S. Liang and J. Wortman Vaughan), Curran Associates, Inc., Red Hook, NY, 35th Conference on Neural Information Processing Systems (NeurIPS 2021), December 2021 (Published) Paper URL BibTeX

Autonomous Learning Conference Paper Sparsely Changing Latent States for Prediction and Planning in Partially Observable Domains Gumbsch, C., Butz, M. V., Martius, G. In Advances in Neural Information Processing Systems 34, 21:17518-17531, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P. S. Liang and J. Wortman Vaughan), Curran Associates, Inc., Red Hook, NY, 35th Conference on Neural Information Processing Systems (NeurIPS 2021), December 2021 (Published) arXiv Openreview URL BibTeX

Physical Intelligence Intelligent Control Systems Article Task space adaptation via the learning of gait controllers of magnetic soft millirobots Demir, S. O., Culha, U., Karacakol, A. C., Pena-Francesch, A., Trimpe, S., Sitti, M. The International Journal of Robotics Research, 40(12-14):1331-1351, December 2021 () DOI BibTeX

Empirical Inference Conference Paper The Inductive Bias of Quantum Kernels Kübler*, J. M., Buchholz*, S., Schölkopf, B. Advances in Neural Information Processing Systems 34 (NeurIPS 2021), :12661-12673, (Editors: M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan), Curran Associates, Inc., 35th Annual Conference on Neural Information Processing Systems, December 2021, *equal contribution (Published) arXiv URL BibTeX

Perceiving Systems Article The neural coding of face and body orientation in occipitotemporal cortex Foster, C., Zhao, M., Bolkart, T., Black, M. J., Bartels, A., Bülthoff, I. NeuroImage, 246:118783, December 2021 (Published) paper DOI BibTeX

Haptic Intelligence Article Virtual Reality Treatment Displaying the Missing Leg Improves Phantom Limb Pain: A Small Clinical Trial Ambron, E., Buxbaum, L. J., Miller, A., Stoll, H., Kuchenbecker, K. J., Coslett, H. B. Neurorehabilitation and Neural Repair, 35(12):1100-1111, December 2021 (Published) DOI BibTeX

Empirical Inference Article Coupling of hippocampal theta and ripples with pontogeniculooccipital waves Ramirez-Villegas, J., Besserve, M., Murayama, Y., Evrard, H., Oeltermann, A., Logothetis, N. Nature, 589(7840):96-102, Nature, November 2021 (Published) DOI URL BibTeX

Intelligent Control Systems Conference Paper Using Physics Knowledge for Learning Rigid-Body Forward Dynamics with Gaussian Process Force Priors Rath, L., Geist, A. R., Trimpe, S. In Proceedings of the 5th Conference on Robot Learning, 164:101-111, Proceedings of Machine Learning Research, (Editors: Faust, Aleksandra and Hsu, David and Neumann, Gerhard), PMLR, 5th Conference on Robot Learning (CoRL 2021), November 2021 (Published) URL BibTeX