Perceptual User Interfaces Logo
University of Stuttgart Logo

Biography

Yao Wang is a PhD student in the Perceptual User Interfaces group since September 2020. He holds a Bachelor's degree in Intelligence Software and Technology and a Master’s degree in Computer Software and Technology both from Peking University. He works now on visual attention modelling for optimization of information visualizations, which integrated to Project A07 in SFB-TRR 161. He did a research stay at Aalto University (Finland) in User Interface Group with Prof. Antti Oulasvirta from January to April 2023.

The first research goal is acquiring large-scale humanlike attention data without eye-tracking equipment on information visualizations. He turns to crowdsourcing approaches (webcam or mouse-clicking) or gaze synthetic models. The second research goal is to computationally model human visual behaviour (saliency map, scanpath) under different tasks (top-down) in information visualizations. The third research goal is to develop a task-driven computational model to optimize the information visualisation by maximising metrics (e.g. recallability, gaze uncertainty).


Teaching

2022
Mensch-Computer-Interaktion (Teaching Assistant)Bachelor
 
Machine Perception and Learning (Tutor)Master
2021
Mensch-Computer-Interaktion (Teaching Assistant)Bachelor
 
Machine Learning and Computer Vision for HCI (Fachpraktikum)Master
2020
Machine Learning and Computer Vision for HCI (Fachpraktikum)Master

Supervision

2024
Question Type Classification from Human Visual Attention Data on Information Visualizations (B.Sc.) Tobias Kostorz
 
Analyzing Neural Attention in Chart Question Answering (M.Sc.) Yingpeng Ma§§
2023
Gaze Uncertainty Prediction of Information Visualisations (B.Sc.) Sichun Zeng
 
GPT-4-based Visualization Reasoning Dataset (B.Sc.) Jo Hollenbeck
 
Large-scale Information Visualization Saliency Dataset Collection (B.Sc.) Abdullah Abdelhafez (German University of Cairo)**
 
Task-driven Attention Prediction on Information Visualisations (HiWi Project) Weitian Wang
2022
Gaze Uncertainty Prediction and Correction on InfoVis (HiWi Project) Qian-Rong Yi
 
Visual Question Answering through Attention Modelling with Curiosity-driven Reinforcement Learning (M.Sc.) Stoyan Dimitrov*
 
Predicting Recallability from Gaze Behaviour on InfoVis (B.Sc.) Sarra Bakhchali
 
Understanding Gaze Behaviour during Question-Answering on Information Visualisations (HiWi Project) Nuo Chen
2021
VisRecall: Quantifying Information Visualisation Recallability via Question Answering (Erasmus Internship) Chuhan Jiao (Aalto University)
 
Scanpath Modeling on Information Visualisations (HiWi Project) Saiteja Malyala
 
Implementation of Analysis Toolbox for Information Visualisations (HiWi Project) Sruthi Radhakrishnan
 
Multi-view 3D Saliency (M.Sc.) Qi Dai
 
Joint Learning Model for Saliency and Scanpath Prediction (M.Sc.) Jiaqi Qin
 
Multi Duration Saliency Dataset Annotation Toolox (HiWi Project) Luwei Liu
2020
Deep Learning Engineering in Saliency Modeling (HiWi Project) Wei Zhang
*Co-supervised with Ekta Sood
**Co-supervised with Mayar Elfares
§Co-supervised with Susanne Hindennach
§§Co-supervised with Susanne Hindennach and Ekta Sood

Open Thesis Projects

 
Understanding 3D Visualisation in VR with Eye TrackingBachelor/Master

Publications

  1. VisRecall++: Analysing and Predicting Visualisation Recallability from Gaze Behaviour

    VisRecall++: Analysing and Predicting Visualisation Recallability from Gaze Behaviour

    Yao Wang, Yue Jiang, Zhiming Hu, Constantin Ruhdorfer, Mihai Bâce, Andreas Bulling

    Proc. ACM on Human-Computer Interaction (PACM HCI), 8 (ETRA), pp. 1–18, 2024.

    Abstract Links BibTeX Project

  1. Saliency3D: a 3D Saliency Dataset Collected on Screen

    Saliency3D: a 3D Saliency Dataset Collected on Screen

    Yao Wang, Qi Dai, Mihai Bâce, Karsten Klein, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–9, 2024.

    Abstract Links BibTeX Project

  2. SalChartQA: Question-driven Saliency on Information Visualisations

    SalChartQA: Question-driven Saliency on Information Visualisations

    Yao Wang, Weitian Wang, Abdullah Abdelhafez, Mayar Elfares, Zhiming Hu, Mihai Bâce, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–14, 2024.

    Abstract Links BibTeX Project

  1. DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360° Images

    DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360° Images

    Chuhan Jiao, Yao Wang, Guanhua Zhang, Mihai Bâce, Zhiming Hu, Andreas Bulling

    arXiv:2403.17477, pp. 1–13, 2024.

    Abstract Links BibTeX Project

  1. Scanpath Prediction on Information Visualisations

    Scanpath Prediction on Information Visualisations

    Yao Wang, Mihai Bâce, Andreas Bulling

    IEEE Transactions on Visualization and Computer Graphics (TVCG), 30 (7), pp. 3902–3914, 2023.

    Abstract Links BibTeX Project

  1. Improving Neural Saliency Prediction with a Cognitive Model of Human Visual Attention

    Improving Neural Saliency Prediction with a Cognitive Model of Human Visual Attention

    Ekta Sood, Lei Shi, Matteo Bortoletto, Yao Wang, Philipp Müller, Andreas Bulling

    Proc. the 45th Annual Meeting of the Cognitive Science Society (CogSci), pp. 3639–3646, 2023.

    Abstract Links BibTeX Project

  1. VisRecall: Quantifying Information Visualisation Recallability via Question Answering

    VisRecall: Quantifying Information Visualisation Recallability via Question Answering

    Yao Wang, Chuhan Jiao, Mihai Bâce, Andreas Bulling

    IEEE Transactions on Visualization and Computer Graphics (TVCG), 28 (12), pp. 4995-5005, 2022.

    Abstract Links BibTeX Project

  1. Impact of Gaze Uncertainty on AOIs in Information Visualisations

    Impact of Gaze Uncertainty on AOIs in Information Visualisations

    Yao Wang, Maurice Koch, Mihai Bâce, Daniel Weiskopf, Andreas Bulling

    ETRA Workshop on Eye Tracking and Visualization (ETVIS), pp. 1–6, 2022.

    Abstract Links BibTeX Project

  1. Semantic 3D Reconstruction with Learning MVS and 2D Segmentation of Aerial Images

    Semantic 3D Reconstruction with Learning MVS and 2D Segmentation of Aerial Images

    Zizhuang Wei, Yao Wang, Hongwei Yi, Yisong Chen, Guoping Wang

    Applied Sciences, 10 (4), pp. 1275, 2020.

    Abstract Links BibTeX Project

  1. Large-Scale Structure from Motion with Semantic Constraints of Aerial Images

    Large-Scale Structure from Motion with Semantic Constraints of Aerial Images

    Yu Chen, Yao Wang, Peng Lu, Yisong Chen, Guoping Wang

    Proc. Chinese Conference on Pattern Recognition and Computer Vision (PRCV), pp. 347-359, 2018.

    Abstract Links BibTeX Project

  2. Sobel Heuristic Kernel for Aerial Semantic Segmentation

    Sobel Heuristic Kernel for Aerial Semantic Segmentation

    Tao Hu, Yao Wang, Yisong Chen, Peng Lu, Heng Wang, Guoping Wang

    IEEE International Conference on Image Processing (ICIP), pp. 3074-3078, 2018.

    Abstract Links BibTeX Project