Header logo is


2019


no image
Hierarchical Task-Parameterized Learning from Demonstration for Collaborative Object Movement

Hu, S., Kuchenbecker, K. J.

Applied Bionics and Biomechanics, (9765383), December 2019 (article)

Abstract
Learning from demonstration (LfD) enables a robot to emulate natural human movement instead of merely executing preprogrammed behaviors. This article presents a hierarchical LfD structure of task-parameterized models for object movement tasks, which are ubiquitous in everyday life and could benefit from robotic support. Our approach uses the task-parameterized Gaussian mixture model (TP-GMM) algorithm to encode sets of demonstrations in separate models that each correspond to a different task situation. The robot then maximizes its expected performance in a new situation by either selecting a good existing model or requesting new demonstrations. Compared to a standard implementation that encodes all demonstrations together for all test situations, the proposed approach offers four advantages. First, a simply defined distance function can be used to estimate test performance by calculating the similarity between a test situation and the existing models. Second, the proposed approach can improve generalization, e.g., better satisfying the demonstrated task constraints and speeding up task execution. Third, because the hierarchical structure encodes each demonstrated situation individually, a wider range of task situations can be modeled in the same framework without deteriorating performance. Last, adding or removing demonstrations incurs low computational load, and thus, the robot’s skill library can be built incrementally. We first instantiate the proposed approach in a simulated task to validate these advantages. We then show that the advantages transfer to real hardware for a task where naive participants collaborated with a Willow Garage PR2 robot to move a handheld object. For most tested scenarios, our hierarchical method achieved significantly better task performance and subjective ratings than both a passive model with only gravity compensation and a single TP-GMM encoding all demonstrations.

hi

DOI [BibTex]


Decoding subcategories of human bodies from both body- and face-responsive cortical regions
Decoding subcategories of human bodies from both body- and face-responsive cortical regions

Foster, C., Zhao, M., Romero, J., Black, M. J., Mohler, B. J., Bartels, A., Bülthoff, I.

NeuroImage, 202(15):116085, November 2019 (article)

Abstract
Our visual system can easily categorize objects (e.g. faces vs. bodies) and further differentiate them into subcategories (e.g. male vs. female). This ability is particularly important for objects of social significance, such as human faces and bodies. While many studies have demonstrated category selectivity to faces and bodies in the brain, how subcategories of faces and bodies are represented remains unclear. Here, we investigated how the brain encodes two prominent subcategories shared by both faces and bodies, sex and weight, and whether neural responses to these subcategories rely on low-level visual, high-level visual or semantic similarity. We recorded brain activity with fMRI while participants viewed faces and bodies that varied in sex, weight, and image size. The results showed that the sex of bodies can be decoded from both body- and face-responsive brain areas, with the former exhibiting more consistent size-invariant decoding than the latter. Body weight could also be decoded in face-responsive areas and in distributed body-responsive areas, and this decoding was also invariant to image size. The weight of faces could be decoded from the fusiform body area (FBA), and weight could be decoded across face and body stimuli in the extrastriate body area (EBA) and a distributed body-responsive area. The sex of well-controlled faces (e.g. excluding hairstyles) could not be decoded from face- or body-responsive regions. These results demonstrate that both face- and body-responsive brain regions encode information that can distinguish the sex and weight of bodies. Moreover, the neural patterns corresponding to sex and weight were invariant to image size and could sometimes generalize across face and body stimuli, suggesting that such subcategorical information is encoded with a high-level visual or semantic code.

ps

paper pdf DOI [BibTex]

paper pdf DOI [BibTex]


Active Perception based Formation Control for Multiple Aerial Vehicles
Active Perception based Formation Control for Multiple Aerial Vehicles

Tallamraju, R., Price, E., Ludwig, R., Karlapalem, K., Bülthoff, H. H., Black, M. J., Ahmad, A.

IEEE Robotics and Automation Letters, Robotics and Automation Letters, 4(4):4491-4498, IEEE, October 2019 (article)

Abstract
We present a novel robotic front-end for autonomous aerial motion-capture (mocap) in outdoor environments. In previous work, we presented an approach for cooperative detection and tracking (CDT) of a subject using multiple micro-aerial vehicles (MAVs). However, it did not ensure optimal view-point configurations of the MAVs to minimize the uncertainty in the person's cooperatively tracked 3D position estimate. In this article, we introduce an active approach for CDT. In contrast to cooperatively tracking only the 3D positions of the person, the MAVs can actively compute optimal local motion plans, resulting in optimal view-point configurations, which minimize the uncertainty in the tracked estimate. We achieve this by decoupling the goal of active tracking into a quadratic objective and non-convex constraints corresponding to angular configurations of the MAVs w.r.t. the person. We derive this decoupling using Gaussian observation model assumptions within the CDT algorithm. We preserve convexity in optimization by embedding all the non-convex constraints, including those for dynamic obstacle avoidance, as external control inputs in the MPC dynamics. Multiple real robot experiments and comparisons involving 3 MAVs in several challenging scenarios are presented.

ps

pdf DOI Project Page [BibTex]

pdf DOI Project Page [BibTex]


no image
Decoding the Viewpoint and Identity of Faces and Bodies

Foster, C., Zhao, M., Bolkart, T., Black, M., Bartels, A., Bülthoff, I.

Journal of Vision, 19(10): 54c, pages: 54-55, Arvo Journals, September 2019 (article)

Abstract
(2019). . , 19(10): 25.13, 54-55. doi: Zitierlink: http://hdl.handle.net/21.11116/0000-0003-7493-4

ps

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Low-Hysteresis and Low-Interference Soft Tactile Sensor Using a Conductive Coated Porous Elastomer and a Structure for Interference Reduction

Park, K., Kim, S., Lee, H., Park, I., Kim, J.

Sensors and Actuators A: Physical, 295, pages: 541-550, August 2019 (article)

Abstract
The need for soft whole-body tactile sensors is emerging. Piezoresistive materials are advantageous in terms of making large tactile sensors, but the hysteresis of piezoresistive materials is a major drawback. The hysteresis of a piezoresistive material should be attenuated to make a practical piezoresistive soft tactile sensor. In this paper, we introduce a low-hysteresis and low-interference soft tactile sensor using a conductive coated porous elastomer and a structure to reduce interference (grooves). The developed sensor exhibits low hysteresis because the transduction mechanism of the sensor is dominated by the contact between the conductive coated surface. In a cyclic loading experiment with different loading frequencies, the mechanical and piezoresistive hysteresis values of the sensor are less than 21.7% and 6.8%, respectively. The initial resistance change is found to be within 4% after the first loading cycle. To reduce the interference among the sensing points, we also propose a structure where the grooves are inserted between the adjacent electrodes. This structure is implemented during the molding process, which is adopted to extend the porous tactile sensor to large-scale and facile fabrication. The effects of the structure are investigated with respect to the normalized design parameters ΘD, ΘW, and ΘT in a simulation, and the result is validated for samples with the same design parameters. An indentation experiment also shows that the structure designed for interference reduction effectively attenuates the interference of the sensor array, indicating that the spatial resolution of the sensor array is improved. As a result, the sensor can exhibit low hysteresis and low interference simultaneously. This research can be used for many applications, such as robotic skin, grippers, and wearable devices.

hi

DOI [BibTex]

DOI [BibTex]


no image
Physical activity in non-ambulatory toddlers with cerebral palsy

M.Orlando, J., Pierce, S., Mohan, M., Skorup, J., Paremski, A., Bochnak, M., Prosser, L. A.

Research in Developmental Disabilities, 90, pages: 51-58, July 2019 (article)

Abstract
Background: Children with cerebral palsy are less likely to be physically active than their peers, however there is limited evidence regarding self-initiated physical activity in toddlers who are not able, or who may never be able, to walk. Aims: The aim of this study was to measure self-initiated physical activity and its relationship to gross motor function and participation in non-ambulatory toddlers with cerebral palsy. Methods and procedures: Participants were between the ages of 1–3 years. Physical activity during independent floor-play at home was recorded using a wearable tri-axial accelerometer worn on the child’s thigh. The Gross Motor Function Measure-66 and the Child Engagement in Daily Life, a parent-reported questionnaire of participation, were administered. Outcomes and results: Data were analyzed from the twenty participants who recorded at least 90 min of floor-play (mean: 229 min), resulting in 4598 total floor-play minutes. The relationship between physical activity and gross motor function was not statistically significant (r = 0.20; p = 0.39), nor were the relationships between physical activity and participation (r = 0.05−0.09; p = 0.71−0.84). Conclusions and implications: The results suggest physical activity during floor-play is not related to gross motor function or participation in non-ambulatory toddlers with cerebral palsy. Clinicians and researchers should independently measure physical activity, gross motor function, and participation.

hi

DOI [BibTex]

DOI [BibTex]


Implementation of a 6-{DOF} Parallel Continuum Manipulator for Delivering Fingertip Tactile Cues
Implementation of a 6-DOF Parallel Continuum Manipulator for Delivering Fingertip Tactile Cues

Young, E. M., Kuchenbecker, K. J.

IEEE Transactions on Haptics, 12(3):295-306, June 2019 (article)

Abstract
Existing fingertip haptic devices can deliver different subsets of tactile cues in a compact package, but we have not yet seen a wearable six-degree-of-freedom (6-DOF) display. This paper presents the Fuppeteer (short for Fingertip Puppeteer), a device that is capable of controlling the position and orientation of a flat platform, such that any combination of normal and shear force can be delivered at any location on any human fingertip. We build on our previous work of designing a parallel continuum manipulator for fingertip haptics by presenting a motorized version in which six flexible Nitinol wires are actuated via independent roller mechanisms and proportional-derivative controllers. We evaluate the settling time and end-effector vibrations observed during system responses to step inputs. After creating a six-dimensional lookup table and adjusting simulated inputs using measured Jacobians, we show that the device can make contact with all parts of the fingertip with a mean error of 1.42 mm. Finally, we present results from a human-subject study. A total of 24 users discerned 9 evenly distributed contact locations with an average accuracy of 80.5%. Translational and rotational shear cues were identified reasonably well near the center of the fingertip and more poorly around the edges.

hi

DOI Project Page [BibTex]


no image
How Does It Feel to Clap Hands with a Robot?

Fitter, N. T., Kuchenbecker, K. J.

International Journal of Social Robotics, 12(1):113-127, April 2019 (article)

Abstract
Future robots may need lighthearted physical interaction capabilities to connect with people in meaningful ways. To begin exploring how users perceive playful human–robot hand-to-hand interaction, we conducted a study with 20 participants. Each user played simple hand-clapping games with the Rethink Robotics Baxter Research Robot during a 1-h-long session involving 24 randomly ordered conditions that varied in facial reactivity, physical reactivity, arm stiffness, and clapping tempo. Survey data and experiment recordings demonstrate that this interaction is viable: all users successfully completed the experiment and mentioned enjoying at least one game without prompting. Hand-clapping tempo was highly salient to users, and human-like robot errors were more widely accepted than mechanical errors. Furthermore, perceptions of Baxter varied in the following statistically significant ways: facial reactivity increased the robot’s perceived pleasantness and energeticness; physical reactivity decreased pleasantness, energeticness, and dominance; higher arm stiffness increased safety and decreased dominance; and faster tempo increased energeticness and increased dominance. These findings can motivate and guide roboticists who want to design social–physical human–robot interactions.

hi

DOI [BibTex]

DOI [BibTex]


 Perceptual Effects of Inconsistency in Human Animations
Perceptual Effects of Inconsistency in Human Animations

Kenny, S., Mahmood, N., Honda, C., Black, M. J., Troje, N. F.

ACM Trans. Appl. Percept., 16(1):2:1-2:18, Febuary 2019 (article)

Abstract
The individual shape of the human body, including the geometry of its articulated structure and the distribution of weight over that structure, influences the kinematics of a person’s movements. How sensitive is the visual system to inconsistencies between shape and motion introduced by retargeting motion from one person onto the shape of another? We used optical motion capture to record five pairs of male performers with large differences in body weight, while they pushed, lifted, and threw objects. From these data, we estimated both the kinematics of the actions as well as the performer’s individual body shape. To obtain consistent and inconsistent stimuli, we created animated avatars by combining the shape and motion estimates from either a single performer or from different performers. Using these stimuli we conducted three experiments in an immersive virtual reality environment. First, a group of participants detected which of two stimuli was inconsistent. Performance was very low, and results were only marginally significant. Next, a second group of participants rated perceived attractiveness, eeriness, and humanness of consistent and inconsistent stimuli, but these judgements of animation characteristics were not affected by consistency of the stimuli. Finally, a third group of participants rated properties of the objects rather than of the performers. Here, we found strong influences of shape-motion inconsistency on perceived weight and thrown distance of objects. This suggests that the visual system relies on its knowledge of shape and motion and that these components are assimilated into an altered perception of the action outcome. We propose that the visual system attempts to resist inconsistent interpretations of human animations. Actions involving object manipulations present an opportunity for the visual system to reinterpret the introduced inconsistencies as a change in the dynamics of an object rather than as an unexpected combination of body shape and body motion.

ps

publisher pdf DOI [BibTex]

publisher pdf DOI [BibTex]


no image
Response of active Brownian particles to shear flow

Asheichyk, K., Solon, A., Rohwer, C. M., Krüger, M.

The Journal of Chemical Physics, 150(14), American Institute of Physics, Woodbury, N.Y., 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Vortex Mass in the Three-Dimensional O(2) Scalar Theory

Delfino, G., Selke, W., Squarcini, A.

Physical Review Letters, 122(5), American Physical Society, Woodbury, N.Y., 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Dynamics near planar walls for various model self-phoretic particles

Bayati, P., Popescu, M. N., Uspal, W. E., Dietrich, S., Najafi, A.

Soft Matter, 15(28):5644-5672, Royal Society of Chemistry, Cambridge, UK, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Glucose Oxidase Micropumps: Multi-Faceted Effects of Chemical Activity on Tracer Particles Near the Solid-Liquid Interface

Munteanu, R. E., Popescu, M. N., Gáspár, S.

Condensed Matter, 4(3), MDPI, Basel, 2019 (article)

icm

DOI [BibTex]


no image
Criticality senses topology

Vasilyev, O. A., Maciolek, A., Dietrich, S.

EPL, 128(2), EDP Science, Les-Ulis, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Drag Force for Asymmetrically Grafted Colloids in Polymer Solutions

Werner, M., Malgaretti, P., Maciolek, A.

Frontiers in Physics, 7, Frontiers Media, Lausanne, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Feeling Your Neighbors across the Walls: How Interpore Ionic Interactions Affect Capacitive Energy Storage

Kondrat, S., Vasilyev, O., Kornyshev, A. A.

The Journal of Physical Chemistry Letters, 10(16):4523-4527, American Chemical Society, Washington, DC, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Active Janus colloids at chemically structured surfaces

Uspal, W. E., Popescu, M. N., Dietrich, S., Tasinkevych, M.

The Journal of Chemical Physics, 150(20), American Institute of Physics, Woodbury, N.Y., 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Illumination-induced motion of a Janus nanoparticle in binary solvents

Araki, T., Maciolek, A.

Soft Matter, 15(26):5243-5254, Royal Society of Chemistry, Cambridge, UK, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Transient response of an electrolyte to a thermal quench

Janssen, M., Bier, M.

Physical Review E, 99(4), American Physical Society, Melville, NY, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Aging phenomena during phase separation in fluids: decay of autocorrelation for vapor\textendashliquid transitions

Roy, Sutapa, Bera, Arabinda, Majumder, Suman, Das, Subir K.

Soft Matter, 15(23):4743-4750, Royal Society of Chemistry, Cambridge, UK, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Flux and storage of energy in nonequilibrium stationary states

Holyst, R., Maciolek, A., Zhang, Y., Litniewski, M., Knycha\la, P., Kasprzak, M., Banaszak, M.

Physical Review E, 99(4), American Physical Society, Melville, NY, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Correlations and forces in sheared fluids with or without quenching

Rohwer, C. M., Maciolek, A., Dietrich, S., Krüger, M.

New Journal of Physics, 21, IOP Publishing, Bristol, 2019 (article)

icm

DOI [BibTex]


no image
Ensemble dependence of critical Casimir forces in films with Dirichlet boundary conditions

Rohwer, C. M., Squarcini, A., Vasilyev, O., Dietrich, S., Gross, M.

Physical Review E, 99(6), American Physical Society, Melville, NY, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Controlling the dynamics of colloidal particles by critical Casimir forces

Magazzù, A., Callegari, A., Staforelli, J. P., Gambassi, A., Dietrich, S., Volpe, G.

Soft Matter, 15(10):2152-2162, Royal Society of Chemistry, Cambridge, UK, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Charge regulation radically modifies electrostatics in membrane stacks

Majee, A., Bier, M., Blossey, R., Podgornik, R.

Physical Review E, 100(5), American Physical Society, Melville, NY, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Self and Body Part Localization in Virtual Reality: Comparing a Headset and a Large-Screen Immersive Display

van der Veer, A. H., Longo, M. R., Alsmith, A. J. T., Wong, H. Y., Mohler, B. J.

Frontiers in Robotics and AI, 6(33), 2019 (article)

ps

DOI [BibTex]

DOI [BibTex]


The Virtual Caliper: Rapid Creation of Metrically Accurate Avatars from {3D} Measurements
The Virtual Caliper: Rapid Creation of Metrically Accurate Avatars from 3D Measurements

Pujades, S., Mohler, B., Thaler, A., Tesch, J., Mahmood, N., Hesse, N., Bülthoff, H. H., Black, M. J.

IEEE Transactions on Visualization and Computer Graphics, 25(5):1887-1897, IEEE, 2019 (article)

Abstract
Creating metrically accurate avatars is important for many applications such as virtual clothing try-on, ergonomics, medicine, immersive social media, telepresence, and gaming. Creating avatars that precisely represent a particular individual is challenging however, due to the need for expensive 3D scanners, privacy issues with photographs or videos, and difficulty in making accurate tailoring measurements. We overcome these challenges by creating “The Virtual Caliper”, which uses VR game controllers to make simple measurements. First, we establish what body measurements users can reliably make on their own body. We find several distance measurements to be good candidates and then verify that these are linearly related to 3D body shape as represented by the SMPL body model. The Virtual Caliper enables novice users to accurately measure themselves and create an avatar with their own body shape. We evaluate the metric accuracy relative to ground truth 3D body scan data, compare the method quantitatively to other avatar creation tools, and perform extensive perceptual studies. We also provide a software application to the community that enables novices to rapidly create avatars in fewer than five minutes. Not only is our approach more rapid than existing methods, it exports a metrically accurate 3D avatar model that is rigged and skinned.

ps

Project Page IEEE Open Access IEEE Open Access PDF DOI [BibTex]

Project Page IEEE Open Access IEEE Open Access PDF DOI [BibTex]


no image
Comment on "Which interactions dominate in active colloids?" [J. Chem. Phys. 150, 061102 (2019)]

Popescu, M. N., Dominguez, A., Uspal, W. E., Tasinkevych, M., Dietrich, S.

The Journal of Chemical Physics, 151(6), American Institute of Physics, Woodbury, N.Y., 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Current-mediated synchronization of a pair of beating non-identical flagella

Dotsenko, V., Maciolek, A., Oshanin, G., Vasilyev, O., Dietrich, S.

New Journal of Physics, 21, IOP Publishing, Bristol, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Driving an electrolyte through a corrugated nanopore

Malgaretti, P., Janssen, M., Pagonabarraga, I., Rubi, J. M.

The Journal of Chemical Physics, 151(8), American Institute of Physics, Woodbury, N.Y., 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Spectral Content of a Single Non-Brownian Trajectory

Krapf, D., Lukat, N., Marinari, E., Metzler, R., Oshanin, G., Selhuber-Unkel, C., Squarcini, A., Stadler, L., Weiss, M., Xu, X.

Physical Review X, 9(1), American Physical Society, New York, NY, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Curvature affects electrolyte relaxation: Studies of spherical and cylindrical electrodes

Janssen, M.

Physical Review E, 100(4), American Physical Society, Melville, NY, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Dynamics of the critical Casimir force for a conserved order parameter after a critical quench

Gross, M., Rohwer, C. M., Dietrich, S.

Physical Review E, 100(1), American Physical Society, Melville, NY, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Interface structures in ionic liquid crystals

Bartsch, H., Bier, M., Dietrich, S.

Soft Matter, 15(20):4109-4126, Royal Society of Chemistry, Cambridge, UK, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Interfacial premelting of ice in nano composite materials

Li, H., Bier, M., Mars, J., Weiss, H., Dippel, A., Gutowski, O., Honkimäki, V., Mezger, M.

Physical Chemistry Chemical Physics, 21(7):3734-3741, Royal Society of Chemistry, Cambridge, England, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Connections Matter: On the Importance of Pore Percolation for Nanoporous Supercapacitors

Vasilyev, O., Kornyshev, A. A., Kondrat, S.

ACS Applied Energy Materials, 2(8):5386-5390, American Chemical Society, Washington, DC, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Theory of light-activated catalytic Janus particles

Uspal, W. E.

The Journal of Chemical Physics, 150(11), American Institute of Physics, Woodbury, N.Y., 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Recovering superhydrophobicity in nanoscale and macroscale surface textures

Giacomello, A., Schimmele, L., Dietrich, S., Tasinkevych, M.

Soft Matter, 15(37):7462-7471, Royal Society of Chemistry, Cambridge, UK, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Brownian dynamics assessment of enhanced diffusion exhibited by "fluctuating-dumbbell enzymes".

Kondrat, S., Popescu, M. N.

Physical Chemistry Chemical Physics, 21(35):18811-18815, Royal Society of Chemistry, Cambridge, England, 2019 (article)

icm

DOI [BibTex]

DOI [BibTex]

2015


Scalable Robust Principal Component Analysis using {Grassmann} Averages
Scalable Robust Principal Component Analysis using Grassmann Averages

Hauberg, S., Feragen, A., Enficiaud, R., Black, M.

IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI), December 2015 (article)

Abstract
In large datasets, manual data verification is impossible, and we must expect the number of outliers to increase with data size. While principal component analysis (PCA) can reduce data size, and scalable solutions exist, it is well-known that outliers can arbitrarily corrupt the results. Unfortunately, state-of-the-art approaches for robust PCA are not scalable. We note that in a zero-mean dataset, each observation spans a one-dimensional subspace, giving a point on the Grassmann manifold. We show that the average subspace corresponds to the leading principal component for Gaussian data. We provide a simple algorithm for computing this Grassmann Average (GA), and show that the subspace estimate is less sensitive to outliers than PCA for general distributions. Because averages can be efficiently computed, we immediately gain scalability. We exploit robust averaging to formulate the Robust Grassmann Average (RGA) as a form of robust PCA. The resulting Trimmed Grassmann Average (TGA) is appropriate for computer vision because it is robust to pixel outliers. The algorithm has linear computational complexity and minimal memory requirements. We demonstrate TGA for background modeling, video restoration, and shadow removal. We show scalability by performing robust PCA on the entire Star Wars IV movie; a task beyond any current method. Source code is available online.

ps sf

preprint pdf from publisher supplemental Project Page [BibTex]

2015


preprint pdf from publisher supplemental Project Page [BibTex]


{SMPL}: A Skinned Multi-Person Linear Model
SMPL: A Skinned Multi-Person Linear Model

Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., Black, M. J.

ACM Trans. Graphics (Proc. SIGGRAPH Asia), 34(6):248:1-248:16, ACM, New York, NY, October 2015 (article)

Abstract
We present a learned model of human body shape and pose-dependent shape variation that is more accurate than previous models and is compatible with existing graphics pipelines. Our Skinned Multi-Person Linear model (SMPL) is a skinned vertex-based model that accurately represents a wide variety of body shapes in natural human poses. The parameters of the model are learned from data including the rest pose template, blend weights, pose-dependent blend shapes, identity-dependent blend shapes, and a regressor from vertices to joint locations. Unlike previous models, the pose-dependent blend shapes are a linear function of the elements of the pose rotation matrices. This simple formulation enables training the entire model from a relatively large number of aligned 3D meshes of different people in different poses. We quantitatively evaluate variants of SMPL using linear or dual-quaternion blend skinning and show that both are more accurate than a Blend-SCAPE model trained on the same data. We also extend SMPL to realistically model dynamic soft-tissue deformations. Because it is based on blend skinning, SMPL is compatible with existing rendering engines and we make it available for research purposes.

ps

pdf video code/model errata DOI Project Page Project Page [BibTex]

pdf video code/model errata DOI Project Page Project Page [BibTex]


Dyna: A Model of Dynamic Human Shape in Motion
Dyna: A Model of Dynamic Human Shape in Motion

Pons-Moll, G., Romero, J., Mahmood, N., Black, M. J.

ACM Transactions on Graphics, (Proc. SIGGRAPH), 34(4):120:1-120:14, ACM, August 2015 (article)

Abstract
To look human, digital full-body avatars need to have soft tissue deformations like those of real people. We learn a model of soft-tissue deformations from examples using a high-resolution 4D capture system and a method that accurately registers a template mesh to sequences of 3D scans. Using over 40,000 scans of ten subjects, we learn how soft tissue motion causes mesh triangles to deform relative to a base 3D body model. Our Dyna model uses a low-dimensional linear subspace to approximate soft-tissue deformation and relates the subspace coefficients to the changing pose of the body. Dyna uses a second-order auto-regressive model that predicts soft-tissue deformations based on previous deformations, the velocity and acceleration of the body, and the angular velocities and accelerations of the limbs. Dyna also models how deformations vary with a person’s body mass index (BMI), producing different deformations for people with different shapes. Dyna realistically represents the dynamics of soft tissue for previously unseen subjects and motions. We provide tools for animators to modify the deformations and apply them to new stylized characters.

ps

pdf preprint video data DOI Project Page Project Page [BibTex]

pdf preprint video data DOI Project Page Project Page [BibTex]


Linking Objects to Actions: Encoding of Target Object and Grasping Strategy in Primate Ventral Premotor Cortex
Linking Objects to Actions: Encoding of Target Object and Grasping Strategy in Primate Ventral Premotor Cortex

Vargas-Irwin, C. E., Franquemont, L., Black, M. J., Donoghue, J. P.

Journal of Neuroscience, 35(30):10888-10897, July 2015 (article)

Abstract
Neural activity in ventral premotor cortex (PMv) has been associated with the process of matching perceived objects with the motor commands needed to grasp them. It remains unclear how PMv networks can flexibly link percepts of objects affording multiple grasp options into a final desired hand action. Here, we use a relational encoding approach to track the functional state of PMv neuronal ensembles in macaque monkeys through the process of passive viewing, grip planning, and grasping movement execution. We used objects affording multiple possible grip strategies. The task included separate instructed delay periods for object presentation and grip instruction. This approach allowed us to distinguish responses elicited by the visual presentation of the objects from those associated with selecting a given motor plan for grasping. We show that PMv continuously incorporates information related to object shape and grip strategy as it becomes available, revealing a transition from a set of ensemble states initially most closely related to objects, to a new set of ensemble patterns reflecting unique object-grip combinations. These results suggest that PMv dynamically combines percepts, gradually navigating toward activity patterns associated with specific volitional actions, rather than directly mapping perceptual object properties onto categorical grip representations. Our results support the idea that PMv is part of a network that dynamically computes motor plans from perceptual information. Significance Statement: The present work demonstrates that the activity of groups of neurons in primate ventral premotor cortex reflects information related to visually presented objects, as well as the motor strategy used to grasp them, linking individual objects to multiple possible grips. PMv could provide useful control signals for neuroprosthetic assistive devices designed to interact with objects in a flexible way.

ps

publisher link DOI Project Page [BibTex]

publisher link DOI Project Page [BibTex]


Multi-view and 3D Deformable Part Models
Multi-view and 3D Deformable Part Models

Pepik, B., Stark, M., Gehler, P., Schiele, B.

Pattern Analysis and Machine Intelligence, 37(11):14, IEEE, March 2015 (article)

Abstract
As objects are inherently 3-dimensional, they have been modeled in 3D in the early days of computer vision. Due to the ambiguities arising from mapping 2D features to 3D models, 3D object representations have been neglected and 2D feature-based models are the predominant paradigm in object detection nowadays. While such models have achieved outstanding bounding box detection performance, they come with limited expressiveness, as they are clearly limited in their capability of reasoning about 3D shape or viewpoints. In this work, we bring the worlds of 3D and 2D object representations closer, by building an object detector which leverages the expressive power of 3D object representations while at the same time can be robustly matched to image evidence. To that end, we gradually extend the successful deformable part model [1] to include viewpoint information and part-level 3D geometry information, resulting in several different models with different level of expressiveness. We end up with a 3D object model, consisting of multiple object parts represented in 3D and a continuous appearance model. We experimentally verify that our models, while providing richer object hypotheses than the 2D object models, provide consistently better joint object localization and viewpoint estimation than the state-of-the-art multi-view and 3D object detectors on various benchmarks (KITTI [2], 3D object classes [3], Pascal3D+ [4], Pascal VOC 2007 [5], EPFL multi-view cars [6]).

ps

DOI Project Page [BibTex]

DOI Project Page [BibTex]


{Spike train SIMilarity Space} ({SSIMS}): A framework for single neuron and ensemble data analysis
Spike train SIMilarity Space (SSIMS): A framework for single neuron and ensemble data analysis

Vargas-Irwin, C. E., Brandman, D. M., Zimmermann, J. B., Donoghue, J. P., Black, M. J.

Neural Computation, 27(1):1-31, MIT Press, January 2015 (article)

Abstract
We present a method to evaluate the relative similarity of neural spiking patterns by combining spike train distance metrics with dimensionality reduction. Spike train distance metrics provide an estimate of similarity between activity patterns at multiple temporal resolutions. Vectors of pair-wise distances are used to represent the intrinsic relationships between multiple activity patterns at the level of single units or neuronal ensembles. Dimensionality reduction is then used to project the data into concise representations suitable for clustering analysis as well as exploratory visualization. Algorithm performance and robustness are evaluated using multielectrode ensemble activity data recorded in behaving primates. We demonstrate how Spike train SIMilarity Space (SSIMS) analysis captures the relationship between goal directions for an 8-directional reaching task and successfully segregates grasp types in a 3D grasping task in the absence of kinematic information. The algorithm enables exploration of virtually any type of neural spiking (time series) data, providing similarity-based clustering of neural activity states with minimal assumptions about potential information encoding models.

ps

pdf: publisher site pdf: author's proof DOI Project Page [BibTex]

pdf: publisher site pdf: author's proof DOI Project Page [BibTex]


no image
Structures of simple liquids in contact with nanosculptured surfaces

Singh, S. L., Schimmele, L., Dietrich, S.

Physical Review E, 91(3), American Physical Society, Melville, NY, 2015 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Line contribution to the critical Casimir force between a homogeneous and a chemically stepped surface

Parisen Toldin, F., Tröndle, M., Dietrich, S.

Journal of Physics: Condensed Matter, 27(21), IOP Publishing, Bristol, UK, 2015 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Self-propulsion of a catalytically active particle near a planar wall: from reflection to sliding and hovering

Uspal, W. E., Popescu, M. N., Dietrich, S., Tasinkevych, M.

Soft Matter, 11(3):434-438, Royal Society of Chemistry, Cambridge, UK, 2015 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
A size dependent evaluation of the cytotoxicity and uptake of nanographene oxide

Mendes, R. G., Koch, B., Bachmatiuk, A., Ma, X., Sanchez, S., Damm, C., Schmidt, O. G., Gemming, T., Eckert, J., Rümmeli, M. H.

Journal of Materials Chemistry B, 3(12):2522-2529, Royal Society of Chemistry, 2015 (article)

icm

DOI [BibTex]

DOI [BibTex]