Frontiers in neurorobotics · 2026
Anticipating interactions: a predictive diffusion framework for evolving bimanual manipulation.
СтатьяНазвание и аннотация: Перевод пока не подготовлен
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Liu Xukun, Xie Fengjuan, He Xuzhou, Liu Aifeng, Yan Lijun, Yang Jianwei, Huang Hongsheng, Wei Shenggang
Аннотация
INTRODUCTION: Bimanual robotic manipulation remains a significant challenge in embodied AI, as it requires synchronized motion planning, inter-arm collision avoidance, and dynamic role allocation over long task horizons. Although existing diffusion-based policies and affordance learning methods have demonstrated considerable capability, they largely treat the environment as static and fail to model how interaction relationships and coordination patterns evolve over time.
METHODS: This paper introduces the Predictive Affordance and Coordination Evolution Diffusion Policy (PACE-DP), a unified framework that explicitly forecasts future scene dynamics and models the temporal progression of manipulation affordances and bimanual coordination. PACE-DP integrates three predictive components: (1) a Predictive Scene Module that forecasts latent future object-centric representations; (2) an Affordance and Coordination Evolution Module that constructs temporally evolving interaction graphs and employs a Graph Transformer to predict future relation types, grasp success probabilities, coordination modes, and spatial alignment targets; and (3) a Conditional Diffusion Policy that generates smooth, coordinated action sequences conditioned on fused current and predicted features.
RESULTS: We evaluate PACE-DP on the RoboTwin 2.0 platform across 10 diverse bimanual tasks, including handover, placement, stacking, and switch operation. Experimental results show that PACE-DP performs favorably compared with baseline methods, achieving higher success rates on coordination-intensive tasks with only marginal computational overhead.
DISCUSSION: These findings suggest that explicitly predicting future affordance and coordination evolution provides an effective inductive bias for bimanual manipulation, enabling more reliable coordination without substantially increasing computational cost. PACE-DP thus offers a promising step toward predictive, temporally aware policies for long-horizon bimanual tasks.
METHODS: This paper introduces the Predictive Affordance and Coordination Evolution Diffusion Policy (PACE-DP), a unified framework that explicitly forecasts future scene dynamics and models the temporal progression of manipulation affordances and bimanual coordination. PACE-DP integrates three predictive components: (1) a Predictive Scene Module that forecasts latent future object-centric representations; (2) an Affordance and Coordination Evolution Module that constructs temporally evolving interaction graphs and employs a Graph Transformer to predict future relation types, grasp success probabilities, coordination modes, and spatial alignment targets; and (3) a Conditional Diffusion Policy that generates smooth, coordinated action sequences conditioned on fused current and predicted features.
RESULTS: We evaluate PACE-DP on the RoboTwin 2.0 platform across 10 diverse bimanual tasks, including handover, placement, stacking, and switch operation. Experimental results show that PACE-DP performs favorably compared with baseline methods, achieving higher success rates on coordination-intensive tasks with only marginal computational overhead.
DISCUSSION: These findings suggest that explicitly predicting future affordance and coordination evolution provides an effective inductive bias for bimanual manipulation, enabling more reliable coordination without substantially increasing computational cost. PACE-DP thus offers a promising step toward predictive, temporally aware policies for long-horizon bimanual tasks.