Robotic Composites and Compositions Article 2025

Emergent patterns of interaction with dynamic objects

Thumb ticker sm buseaktas headshot 2024
Robotic Composites and Compositions
Max Planck Research Group Leader

Perception by touch is fundamentally linked to the motor system. A hallmark of this linkage takes the form of stereotyped haptic “exploratory procedures” [1], movement patterns that emerge when people set a perceptual goal such as judging the roughness of a textured surface. This paper expands the study of touch-directed movements by asking what patterns emerge when people encounter and interact with novel objects without explicitly specified goals. Participants were invited to freely interact with an art installation containing novel objects with distinct design features, intended to vary familiarity, structural affordance, and aesthetic response. Objects’ affordances were additionally varied over time by utilizing jamming, a physical mechanism that induces changes in stiffness and plasticity. From video recordings, four categories of spontaneous “interactive procedures” differentiated by underlying goals were reliably identified: passive observational, active perceptual, constructive, and hedonic. Perceptual actions were most frequent, indicating an overriding goal of acquiring information about physical properties. The prevalence of other interactive procedures varied across objects, demonstrating the influence of perceptual affordances and prior knowledge. Changes in state further moderated interactions, such that interactions were longer in the stiff/jammed state, and the occurrence of a state change during an interactive procedure lengthened its duration. These findings extend our understanding of haptic exploration beyond explicitly goal-directed contexts, revealing how spontaneous responses in complex and dynamic environments are linked to perceptual outcomes and prior knowledge.

Author(s): Aktaş, Buse and Myers, Paris and Salem, Emily and Klatzky, Roberta and Howe, Robert
Journal: PLOS ONE
Volume: 20
Pages: e0331844
Year: 2025
Project(s):
BibTeX Type: Article (article)
DOI: https://doi.org/10.1371/journal.pone.0331844
State: Published
URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0331844

BibTeX

@article{emergentinteractions,
  title = {Emergent patterns of interaction with dynamic objects},
  journal = {PLOS ONE},
  abstract = {Perception by touch is fundamentally linked to the motor system. A hallmark of this linkage takes the form of stereotyped haptic “exploratory procedures” [1], movement patterns that emerge when people set a perceptual goal such as judging the roughness of a textured surface. This paper expands the study of touch-directed movements by asking what patterns emerge when people encounter and interact with novel objects without explicitly specified goals. Participants were invited to freely interact with an art installation containing novel objects with distinct design features, intended to vary familiarity, structural affordance, and aesthetic response. Objects’ affordances were additionally varied over time by utilizing jamming, a physical mechanism that induces changes in stiffness and plasticity. From video recordings, four categories of spontaneous “interactive procedures” differentiated by underlying goals were reliably identified: passive observational, active perceptual, constructive, and hedonic. Perceptual actions were most frequent, indicating an overriding goal of acquiring information about physical properties. The prevalence of other interactive procedures varied across objects, demonstrating the influence of perceptual affordances and prior knowledge. Changes in state further moderated interactions, such that interactions were longer in the stiff/jammed state, and the occurrence of a state change during an interactive procedure lengthened its duration. These findings extend our understanding of haptic exploration beyond explicitly goal-directed contexts, revealing how spontaneous responses in complex and dynamic environments  are linked to perceptual outcomes and prior knowledge.},
  volume = {20},
  pages = {e0331844},
  year = {2025},
  author = {Aktaş, Buse and Myers, Paris and Salem, Emily and Klatzky, Roberta and Howe, Robert},
  doi = {https://doi.org/10.1371/journal.pone.0331844},
  url = {https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0331844}
}