Perceptual User Interfaces Logo
University of Stuttgart Logo

Biography

Zhiming Hu is a post-doctoral researcher in the Perceptual User Interfaces Group and Computational Biophysics and Biorobotics Group (with Syn Schmitt), at the University of Stuttgart, Germany since August 2022. He obtained his PhD degree in Computer Software and Theory from Peking University, China in 2022. He received his Bachelor's degree in Optical Engineering from Beijing Institute of Technology, China in 2017. His research interests include virtual reality, visual attention, human-computer interaction, eye tracking, and human intention prediction. He served as a reviewer for IEEE VR, ISMAR, TVCG, IMWUT, IJHCI, CVPR, ECCV, and ICCV.


Teaching

2024
Machine Perception and Learning (Teaching Assistant) (winter)Master
2023
Machine Perception and Learning (Teaching Assistant) (winter)Master
2022
Machine Perception and Learning (Teaching Assistant)Master


Supervision

2023
Eye-body correlation analysis and pose-based gaze prediction (M.Sc.) Jiahui Xu

Open Thesis Projects

 
Multimodal Learning for Human Pose ForecastingMaster
 
Multimodal Learning For Human Eyes and Human MotionMaster

Publications

  1. VisRecall++: Analysing and Predicting Visualisation Recallability from Gaze Behaviour

    VisRecall++: Analysing and Predicting Visualisation Recallability from Gaze Behaviour

    Yao Wang, Yue Jiang, Zhiming Hu, Constantin Ruhdorfer, Mihai Bâce, Andreas Bulling

    Proc. ACM on Human-Computer Interaction (PACM HCI), pp. 1–11, 2024.

    Abstract Links BibTeX Project

  2. PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation

    PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation

    Mayar Elfares, Pascal Reisert, Zhiming Hu, Wenwu Tang, Ralf Küsters, Andreas Bulling

    Proc. ACM on Human-Computer Interaction (PACM HCI), pp. , 2024.

    Abstract Links BibTeX Project

  3. Mouse2Vec: Learning Reusable Semantic Representations of Mouse Behaviour

    Mouse2Vec: Learning Reusable Semantic Representations of Mouse Behaviour

    Guanhua Zhang, Zhiming Hu, Mihai Bâce, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–17, 2024.

    Abstract Links BibTeX Project

  4. SalChartQA: Question-driven Saliency on Information Visualisations

    SalChartQA: Question-driven Saliency on Information Visualisations

    Yao Wang, Weitian Wang, Abdullah Abdelhafez, Mayar Elfares, Zhiming Hu, Mihai Bâce, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–14, 2024.

    Abstract Links BibTeX Project

  1. DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360° Images

    DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360° Images

    Chuhan Jiao, Yao Wang, Guanhua Zhang, Mihai Bâce, Zhiming Hu, Andreas Bulling

    arXiv:2403.17477, pp. 1–13, 2024.

    Abstract Links BibTeX Project

  2. GazeMotion: Gaze-guided Human Motion Forecasting

    GazeMotion: Gaze-guided Human Motion Forecasting

    Zhiming Hu, Syn Schmitt, Daniel Häufle, Andreas Bulling

    arXiv:2403.09885, pp. 1–6, 2024.

    Abstract Links BibTeX Project

  1. SUPREYES: SUPer Resolution for EYES Using Implicit Neural Representation Learning

    SUPREYES: SUPer Resolution for EYES Using Implicit Neural Representation Learning

    Chuhan Jiao, Zhiming Hu, Mihai Bâce, Andreas Bulling

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 1–13, 2023.

    Abstract Links BibTeX Project

  2. Exploring Natural Language Processing Methods for Interactive Behaviour Modelling

    Exploring Natural Language Processing Methods for Interactive Behaviour Modelling

    Guanhua Zhang, Matteo Bortoletto, Zhiming Hu, Lei Shi, Mihai Bâce, Andreas Bulling

    Proc. IFIP TC13 Conference on Human-Computer Interaction (INTERACT), pp. 1–22, 2023.

    Abstract Links BibTeX Project Best Student Paper Nomination

  3. Federated Learning for Appearance-based Gaze Estimation in the Wild

    Federated Learning for Appearance-based Gaze Estimation in the Wild

    Mayar Elfares, Zhiming Hu, Pascal Reisert, Andreas Bulling, Ralf Küsters

    Proceedings of The 1st Gaze Meets ML workshop, PMLR, pp. 20–36, 2023.

    Abstract Links BibTeX Project

  1. Pose2Gaze: Generating Realistic Human Gaze Behaviour from Full-body Poses using an Eye-body Coordination Model

    Pose2Gaze: Generating Realistic Human Gaze Behaviour from Full-body Poses using an Eye-body Coordination Model

    Zhiming Hu, Jiahui Xu, Syn Schmitt, Andreas Bulling

    arXiv:2312.12042, pp. 1–10, 2023.

    Abstract Links BibTeX Project

  2. GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction

    GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction

    Haodong Yan, Zhiming Hu, Syn Schmitt, Andreas Bulling

    arXiv:2312.12090, pp. 1–10, 2023.

    Abstract Links BibTeX Project

  1. Intentional Head-Motion Assisted Locomotion for Reducing Cybersickness

    Intentional Head-Motion Assisted Locomotion for Reducing Cybersickness

    Zehui Lin, Xiang Gu, Sheng Li, Zhiming Hu, Guoping Wang

    IEEE Transactions on Visualization and Computer Graphics (TVCG), , 2022.

    Abstract Links BibTeX Project

  1. EHTask: Recognizing User Tasks from Eye and Head Movements in Immersive Virtual Reality

    EHTask: Recognizing User Tasks from Eye and Head Movements in Immersive Virtual Reality

    Zhiming Hu, Andreas Bulling, Sheng Li, Guoping Wang

    IEEE Transactions on Visualization and Computer Graphics (TVCG), 29(4), pp. 1992–2004, 2021.

    Abstract Links BibTeX Project

  2. FixationNet: Forecasting Eye Fixations in Task-Oriented Virtual Environments

    FixationNet: Forecasting Eye Fixations in Task-Oriented Virtual Environments

    Zhiming Hu, Andreas Bulling, Sheng Li, Guoping Wang

    IEEE Transactions on Visualization and Computer Graphics (TVCG), 27(5), pp. 2681–2690, 2021.

    Abstract Links BibTeX Project TVCG Best Journal Nominees Award

  3. Research progress of user task prediction and algorithm analysis (in Chinese)

    Research progress of user task prediction and algorithm analysis (in Chinese)

    Zhiming Hu, Sheng Li, Meng Gai

    Journal of Graphics, 42(3), pp. 367-375, 2021.

    Abstract Links BibTeX Project

  1. Eye Fixation Forecasting in Task-Oriented Virtual Reality

    Eye Fixation Forecasting in Task-Oriented Virtual Reality

    Zhiming Hu

    Proceedings of the 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, pp. 707-708, 2021.

    Abstract Links BibTeX Project

  1. DGaze: CNN-Based Gaze Prediction in Dynamic Scenes

    DGaze: CNN-Based Gaze Prediction in Dynamic Scenes

    Zhiming Hu, Sheng Li, Congyi Zhang, Kangrui Yi, Guoping Wang, Dinesh Manocha

    IEEE Transactions on Visualization and Computer Graphics, 26(5), pp. 1902–1911, 2020.

    Abstract Links BibTeX Project

  2. Temporal continuity of visual attention for future gaze prediction in immersive virtual reality

    Temporal continuity of visual attention for future gaze prediction in immersive virtual reality

    Zhiming Hu, Sheng Li, Meng Gai

    Virtual Reality and Intelligent Hardware (VRIH), 2(2), pp. 142–152, 2020.

    Abstract Links BibTeX Project

  1. Gaze Analysis and Prediction in Virtual Reality

    Gaze Analysis and Prediction in Virtual Reality

    Zhiming Hu

    Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, pp. 543–544, 2020.

    Abstract Links BibTeX Project

  1. SGaze: A Data-Driven Eye-Head Coordination Model for Realtime Gaze Prediction

    SGaze: A Data-Driven Eye-Head Coordination Model for Realtime Gaze Prediction

    Zhiming Hu, Congyi Zhang, Sheng Li, Guoping Wang, Dinesh Manocha

    IEEE Transactions on Visualization and Computer Graphics (TVCG), 25(5), pp. 2002–2010, 2019.

    Abstract Links BibTeX Project