Abstract
Digital humans are emerging as autonomous agents in multiparty interactions, yet existing evaluation metrics largely ignore contextual coordination dynamics. We introduce a unified, intervention-driven framework for objective assessment of multiparty social behaviour in skeletal motion data, spanning three complementary dimensions: (1) synchrony via Cross-Recurrence Quantification Analysis, (2) temporal alignment via Multiscale Empirical Mode Decomposition-based Beat Consistency, and (3) structural similarity via Soft Dynamic Time Warping. We validate metric sensitivity through three theory-driven perturbations-gesture kinematic dampening, uniform speech-gesture delays, and prosodic pitch-variance reduction-applied to approximate to 145 30-second thin slices of group interactions from the DnD dataset. Mixed-effects analyses reveal predictable, joint-independent shifts: dampening increases CRQA determinism and reduces beat consistency, delays weaken cross-participant coupling, and pitch flattening elevates F0 SoftDTW costs. A complementary perception study (N = 27) compares judgments of full-video and skeleton-only renderings to quantify representation effects. Our three measures deliver orthogonal insights into spatial structure, timing alignment, and behavioural variability. Thereby forming a robust toolkit for evaluating and refining socially intelligent agents. Code available on GitHub.
| Original language | English |
|---|---|
| Title of host publication | Proceedings Of The 27th International Conference On Multimodal Interaction, Icmi 2025 |
| Publisher | ASSOC COMPUTING MACHINERY |
| Pages | 249-264 |
| Number of pages | 16 |
| ISBN (Electronic) | 979-8-4007-1499-3 |
| DOIs | |
| Publication status | Published - 2025 |
| Event | 27th International Conference on Multimodal Interaction-ICMI - Canberra, Australia Duration: 13 Oct 2025 → 17 Oct 2025 |
Conference
| Conference | 27th International Conference on Multimodal Interaction-ICMI |
|---|---|
| Country/Territory | Australia |
| City | Canberra |
| Period | 13/10/25 → 17/10/25 |
Keywords
- Emd
- Rqa
- SoftDTW
- Coordination
- Human perception
- Interpersonal synchrony
- Social computing
Fingerprint
Dive into the research topics of 'Multimodal Quantitative Measures for Multiparty Behavior Evaluation'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver