MedElevator Войти в исследования
← Поиск публикаций

DOI 10.1109/tvcg.2026.3738876

Медицинская библиотека · IEEE transactions on visualization and computer graphics · 2026

HAGI++: Head-Assisted Gaze Imputation and Generation.

Jiao Chuhan, Hu Zhiming, Bulling Andreas

СтатьяПеревод пока не подготовлен

Аннотация

Mobile eye-tracking is crucial for capturing human visual attention in real-world and XR settings, supporting research and human-computer interaction. Yet blinks, pupil-detection errors and lighting changes create missing values that hinder gaze analysis. We present HAGI++, a multi-modal diffusion-based imputation method that, for the first time, leverages integrated head-orientation sensors to exploit the natural correlation between head and eye movements. Using a transformer-based diffusion model, it learns cross-modal dependencies between eye and head data and can additionally incorporate wrist/hand motion when such wearable signals are available. Evaluations on the large-scale Nymeria, Ego-Exo4D and HOT3D datasets show that HAGI++ consistently outperforms traditional interpolation and deep-learning time-series imputation baselines. Statistical analysis confirms that its gaze-velocity distributions closely match real human behaviour, yielding realistic imputations. Even when 100% of gaze data are missing (pure gaze generation), HAGI++ exceeds methods that rely on the visual inputs and the methods rely on full-body motion capture by incorporating wrist motion from commercial wearables. Our approach enables more complete, accurate eye-gaze recordings in real-world contexts, enhancing gaze-based analysis and interaction across many applications.

Для цитирования: Jiao Chuhan, Hu Zhiming, Bulling Andreas. HAGI++: Head-Assisted Gaze Imputation and Generation.. IEEE transactions on visualization and computer graphics. 2026. DOI: 10.1109/tvcg.2026.3738876.
Подготовка и перевод публикации
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…

История · было → стало

Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.

Тип публикации указан по данным источника. Уровень доказательности автоматически не присваивается.