Projects

AAAI 2026

GazeInterpreter: Parsing Eye Gaze to Generate Eye-Body-Coordinated Narrations

Qing Chang, Zhiming Hu

Proceedings of the AAAI Conference on Artificial Intelligence, 2026

TVCG 2025 · ISMAR 2025 oral

Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses

Zhiming Hu, Jiahui Xu, Syn Schmitt, Andreas Bulling

IEEE Transactions on Visualization and Computer Graphics (TVCG, oral presentation at ISMAR 2024), 2025, 31(9): 4655-4666

TVCG 2025 · ISMAR 2025 oral

HaHeAE: Learning Generalisable Joint Representations of Human Hand and Head Movements in Extended Reality

Zhiming Hu, Guanhua Zhang, Zheming Yin, Daniel Haeufle, Syn Schmitt, Andreas Bulling

IEEE Transactions on Visualization and Computer Graphics (TVCG, oral presentation at ISMAR 2025), 2025, 31(10): 8726 - 8737

SIGGRAPH 2025

HOIGaze: Gaze Estimation During Hand-Object Interactions in Extended Reality Exploiting Eye-Hand-Head Coordination

Zhiming Hu, Daniel Haeufle, Syn Schmitt, Andreas Bulling

Proceedings of the ACM Special Interest Group on Computer Graphics and Interactive Techniques (SIGGRAPH), 2025: 1-10

TiiS 2025

DiffGaze: A Diffusion Model for Modelling Fine-grained Human Gaze Behaviour on 360° Images

Chuhan Jiao, Yao Wang, Guanhua Zhang, Mihai Bâce, Zhiming Hu, Andreas Bulling

ACM Transactions on Interactive Intelligent Systems, 2025

UIST 2025

HAGI: Head-Assisted Gaze Imputation for Mobile Eye Trackers

Chuhan Jiao, Zhiming Hu, Andreas Bulling

Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), 2025: 1-14

CHI 2025

SummAct: Uncovering User Intentions Through Interactive Behaviour Summarisation

Guanhua Zhang, Mohamed Ahmed, Zhiming Hu, Andreas Bulling

Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (CHI), 2025: 1-17

PACM HCI 2024 · ETRA

PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation

Mayar Elfares, Pascal Reisert, Zhiming Hu, Wenwu Tang, Ralf Küsters, Andreas Bulling

Proceedings of the ACM on Human-Computer Interaction (PACM HCI), 2024, 8(ETRA): 1-23

IROS 2024

GazeMotion: Gaze-guided Human Motion Forecasting

Zhiming Hu, Syn Schmitt, Daniel Haeufle, Andreas Bulling

Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024: 13017-13022

TVCG 2024 · ISMAR 2024 Journal-track

HOIMotion: Forecasting Human Motion During Human-Object Interactions Using Egocentric 3D Object Bounding Boxes

Zhiming Hu, Zheming Yin, Daniel Haeufle, Syn Schmitt, Andreas Bulling

IEEE Transactions on Visualization and Computer Graphics (TVCG, ISMAR 2024 Journal-track), 2024, 30(11): 7375 - 7385

CHI 2024

SalChartQA: Question-driven Saliency on Information Visualisations

Yao Wang, Weitian Wang, Abdullah Abdelhafez, Mayar Elfares, Zhiming Hu, Mihai Bâce, Andreas Bulling

Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (CHI), 2024: 1-14

PACM HCI 2024 · ETRA

VisRecall++: Analysing and Predicting Visualisation Recallability from Gaze Behaviour

Yao Wang, Yue Jiang, Zhiming Hu, Constantin Ruhdorfer, Mihai Bâce, Andreas Bulling

Proceedings of the ACM on Human-Computer Interaction (PACM HCI), 2024, 8(ETRA): 1-18

Pacific Graphics 2024

GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction

Haodong Yan, Zhiming Hu, Syn Schmitt, Andreas Bulling

Proceedings of the Pacific Conference on Computer Graphics and Applications (Pacific Graphics), 2024: 1-12

UIST 2024

DisMouse: Disentangling Information from Mouse Movement Data

Guanhua Zhang, Zhiming Hu, Andreas Bulling

Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), 2024: 1-13

CHI 2024

Mouse2Vec: Learning Reusable Semantic Representations of Mouse Behaviour

Guanhua Zhang, Zhiming Hu, Mihai Bâce, Andreas Bulling

Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (CHI), 2024: 1-17

NeurIPS GMML 2023

Federated Learning for Appearance-based Gaze Estimation in the Wild

Mayar Elfares, Zhiming Hu, Pascal Reisert, Andreas Bulling, Ralf Küsters

Proceedings of the NeurIPS Workshop Gaze Meets ML (NeurIPS GMML), 2023: 20-36

TVCG 2023 · IEEE VR 2023 oral

EHTask: Recognizing User Tasks from Eye and Head Movements in Immersive Virtual Reality

Zhiming Hu, Andreas Bulling, Sheng Li, Guoping Wang

IEEE Transactions on Visualization and Computer Graphics (TVCG, oral presentation at IEEE VR 2022), 2023, 29(4): 1992-2004

UIST 2023

SUPREYES: SUPer Resolution for EYES Using Implicit Neural Representation Learning

Chuhan Jiao, Zhiming Hu, Mihai Bâce, Andreas Bulling

Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), 2023: 1-13

TVCG 2023 · IEEE VR 2023 oral

Intentional Head-Motion Assisted Locomotion for Reducing Cybersickness

Zehui Lin, Xiang Gu, Sheng Li, Zhiming Hu, Guoping Wang

IEEE Transactions on Visualization and Computer Graphics (TVCG, oral presentation at IEEE VR 2022), 2023, 29(8): 3458-3471

INTERACT 2023

Exploring Natural Language Processing Methods for Interactive Behaviour Modelling

Guanhua Zhang, Matteo Bortoletto, Zhiming Hu, Lei Shi, Mihai Bâce, Andreas Bulling

Proceedings of the IFIP Conference on Human-Computer Interaction (INTERACT), 2023: 3-26

IEEE VRW 2021

Eye Fixation Forecasting in Task-Oriented Virtual Reality

Zhiming Hu

Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2021: 707-708

TVCG 2021 · IEEE VR 2021 Journal-track

FixationNet: Forecasting Eye Fixations in Task-Oriented Virtual Environments

Zhiming Hu, Andreas Bulling, Sheng Li, Guoping Wang

IEEE Transactions on Visualization and Computer Graphics (TVCG, IEEE VR 2021 Journal-track), 2021, 27(5): 2681-2690

Journal of Graphics 2021

Research progress of user task prediction and algorithm analysis (in Chinese)

Zhiming Hu, Sheng Li, Meng Gai

Journal of Graphics, 2021, 42(3): 367-375

TVCG 2020 · IEEE VR 2020 Journal-track

DGaze: CNN-Based Gaze Prediction in Dynamic Scenes

Zhiming Hu, Sheng Li, Congyi Zhang, Kangrui Yi, Guoping Wang, Dinesh Manocha

IEEE Transactions on Visualization and Computer Graphics (TVCG, IEEE VR 2020 Journal-track), 2020, 26(5): 1902-1911

IEEE VRW 2020

Gaze Analysis and Prediction in Virtual Reality

Zhiming Hu

Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2020: 543–544

VRIH 2020

Temporal continuity of visual attention for future gaze prediction in immersive virtual reality

Zhiming Hu, Sheng Li, Meng Gai

Virtual Reality and Intelligent Hardware (VRIH), 2020, 2(2): 142-152

TVCG 2019 · IEEE VR 2019 Journal-track

SGaze: A Data-Driven Eye-Head Coordination Model for Realtime Gaze Prediction

Zhiming Hu, Congyi Zhang, Sheng Li, Guoping Wang, Dinesh Manocha

IEEE Transactions on Visualization and Computer Graphics (TVCG, IEEE VR 2019 Journal-track), 2019, 25(5): 2002-2010