CAI Logo

2025

Conference Papers

  1. ActionDiffusion: An Action-aware Diffusion Model for Procedure Planning in Instructional Videos

    Lei Shi, Paul-Christian Bürkner, Andreas Bulling

    Proc. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. , 2025.

    Abstract Links BibTeX Project

2024

Journal Articles

  1. PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation

    PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation

    Mayar Elfares, Pascal Reisert, Zhiming Hu, Wenwu Tang, Ralf Küsters, Andreas Bulling

    Proc. ACM on Human-Computer Interaction (PACM HCI), 8 (ETRA), pp. 1–23, 2024.

    Abstract Links BibTeX Project

  2. Mindful Explanations: Prevalence and Impact of Mind Attribution in XAI Research

    Mindful Explanations: Prevalence and Impact of Mind Attribution in XAI Research

    Susanne Hindennach, Lei Shi, Filip Miletic, Andreas Bulling

    Proc. ACM on Human-Computer Interaction (PACM HCI), 8 (CSCW), pp. 1–42, 2024.

    Abstract Links BibTeX Project Best Paper Honourable Mention Award

  3. Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses

    Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses

    Zhiming Hu, Jiahui Xu, Syn Schmitt, Andreas Bulling

    IEEE Transactions on Visualization and Computer Graphics (TVCG), , pp. 1–12, 2024.

    Abstract Links BibTeX Project

  4. HOIMotion: Forecasting Human Motion During Human-Object Interactions Using Egocentric 3D Object Bounding Boxes

    HOIMotion: Forecasting Human Motion During Human-Object Interactions Using Egocentric 3D Object Bounding Boxes

    Zhiming Hu, Zheming Yin, Daniel Haeufle, Syn Schmitt, Andreas Bulling

    IEEE Transactions on Visualization and Computer Graphics (TVCG), , pp. 1–11, 2024.

    Abstract Links BibTeX Project Best Journal Paper Award

  5. Int-HRL: Towards Intention-based Hierarchical Reinforcement Learning

    Anna Penzkofer, Simon Schaefer, Florian Strohm, Mihai Bâce, Stefan Leutenegger, Andreas Bulling

    Neural Computing and Applications (NCAA), , pp. 1–7, 2024.

    Abstract Links BibTeX Project

  6. Learning User Embeddings from Human Gaze for Personalised Saliency Prediction

    Learning User Embeddings from Human Gaze for Personalised Saliency Prediction

    Florian Strohm, Mihai Bâce, Andreas Bulling

    Proc. ACM on Human-Computer Interaction (PACM HCI), 8 (ETRA), pp. 1–18, 2024.

    Abstract Links BibTeX Project

  7. VisRecall++: Analysing and Predicting Visualisation Recallability from Gaze Behaviour

    VisRecall++: Analysing and Predicting Visualisation Recallability from Gaze Behaviour

    Yao Wang, Yue Jiang, Zhiming Hu, Constantin Ruhdorfer, Mihai Bâce, Andreas Bulling

    Proc. ACM on Human-Computer Interaction (PACM HCI), 8 (ETRA), pp. 1–18, 2024.

    Abstract Links BibTeX Project

  8. Individual differences in visuo-spatial working memory capacity and prior knowledge during interrupted reading

    Individual differences in visuo-spatial working memory capacity and prior knowledge during interrupted reading

    Francesca Zermiani, Prajit Dhar, Florian Strohm, Sibylle Baumbach, Andreas Bulling, Maria Wirzberger

    Frontiers in Cognition, 3, pp. 1–9, 2024.

    Abstract Links BibTeX Project

Conference Papers

  1. DisMouse: Disentangling Information from Mouse Movement Data

    DisMouse: Disentangling Information from Mouse Movement Data

    Guanhua Zhang, Zhiming Hu, Andreas Bulling

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 1–13, 2024.

    Abstract Links BibTeX Project

  2. SalChartQA: Question-driven Saliency on Information Visualisations

    SalChartQA: Question-driven Saliency on Information Visualisations

    Yao Wang, Weitian Wang, Abdullah Abdelhafez, Mayar Elfares, Zhiming Hu, Mihai Bâce, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–14, 2024.

    Abstract Links BibTeX Project

  3. Mouse2Vec: Learning Reusable Semantic Representations of Mouse Behaviour

    Mouse2Vec: Learning Reusable Semantic Representations of Mouse Behaviour

    Guanhua Zhang, Zhiming Hu, Mihai Bâce, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–17, 2024.

    Abstract Links BibTeX Project

  4. Multi-Modal Video Dialog State Tracking in the Wild

    Multi-Modal Video Dialog State Tracking in the Wild

    Adnen Abdessaied, Lei Shi, Andreas Bulling

    Proc. 18th European Conference on Computer Vision (ECCV), pp. 1–25, 2024.

    Abstract Links BibTeX Project

  5. VD-GR: Boosting Visual Dialog with Cascaded Spatial-Temporal Multi-Modal GRaphs

    VD-GR: Boosting Visual Dialog with Cascaded Spatial-Temporal Multi-Modal GRaphs

    Adnen Abdessaied, Lei Shi, Andreas Bulling

    Proc. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 5805–5814, 2024.

    Abstract Links BibTeX Project

  6. OLViT: Multi-Modal State Tracking via Attention-Based Embeddings for Video-Grounded Dialog

    OLViT: Multi-Modal State Tracking via Attention-Based Embeddings for Video-Grounded Dialog

    Adnen Abdessaied, Manuel Hochmeister, Andreas Bulling

    Proc. 31st Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING), pp. 1–11, 2024.

    Abstract Links BibTeX Project

  7. EyeSeeIdentity: Exploring Natural Gaze Behaviour for Implicit User Identification during Photo Viewing

    EyeSeeIdentity: Exploring Natural Gaze Behaviour for Implicit User Identification during Photo Viewing

    Yasmeen Abdrabou, Mariam Hassib, Shuqin Hu, Ken Pfeuffer, Mohamed Khamis, Andreas Bulling, Florian Alt

    Proc. Symposium on Usable Security and Privacy (USEC), pp. 1–12, 2024.

    Abstract Links BibTeX Project

  8. Neural Reasoning About Agents’ Goals, Preferences, and Actions

    Neural Reasoning About Agents’ Goals, Preferences, and Actions

    Matteo Bortoletto, Lei Shi, Andreas Bulling

    Proc. 38th AAAI Conference on Artificial Intelligence (AAAI), pp. 456–464, 2024.

    Abstract Links BibTeX Project

  9. Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition

    Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition

    Matteo Bortoletto, Constantin Ruhdorfer, Adnen Abdessaied, Lei Shi, Andreas Bulling

    Proc. 62nd Annual Meeting of the Association for Computational Linguistics (ACL), pp. 1–16, 2024.

    Abstract Links BibTeX Project

  10. Benchmarking Mental State Representations in Language Models

    Benchmarking Mental State Representations in Language Models

    Matteo Bortoletto, Constantin Ruhdorfer, Lei Shi, Andreas Bulling

    Proc. ICML 2024 Workshop on Mechanistic Interpretability, pp. 1–21, 2024.

    Abstract Links BibTeX Project

  11. Explicit Modelling of Theory of Mind for Belief Prediction in Nonverbal Social Interactions

    Explicit Modelling of Theory of Mind for Belief Prediction in Nonverbal Social Interactions

    Matteo Bortoletto, Constantin Ruhdorfer, Lei Shi, Andreas Bulling

    Proc. 27th European Conference on Artificial Intelligence (ECAI), pp. 866–873, 2024.

    Abstract Links BibTeX Project

  12. Generating Realistic Arm Movements in Reinforcement Learning: A Quantitative Comparison of Reward Terms and Task Requirements

    Generating Realistic Arm Movements in Reinforcement Learning: A Quantitative Comparison of Reward Terms and Task Requirements

    Jhon Paul Feliciano Charaja Casas, Isabell Wochner, Pierre Schumacher, Winfried Ilg, Martin Giese, Christophe Maufroy, Andreas Bulling, Syn Schmitt, Daniel F.B. Haeufle

    Proc. 10th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, pp. 1–6, 2024.

    Abstract Links BibTeX Project

  13. Explaining Disagreement in Visual Question Answering Using Eye Tracking

    Explaining Disagreement in Visual Question Answering Using Eye Tracking

    Susanne Hindennach, Lei Shi, Andreas Bulling

    Proc. International Workshop on Pervasive Eye Tracking and Mobile Gaze-Based Interaction (PETMEI), pp. 1–7, 2024.

    Abstract Links BibTeX Project

  14. GazeMotion: Gaze-guided Human Motion Forecasting

    GazeMotion: Gaze-guided Human Motion Forecasting

    Zhiming Hu, Syn Schmitt, Daniel Häufle, Andreas Bulling

    Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1–6, 2024.

    Abstract Links BibTeX Project Oral Presentation

  15. MultiMediate’24: Multi-Domain Engagement Estimation

    MultiMediate’24: Multi-Domain Engagement Estimation

    Philipp Müller, Michal Balazia, Tobias Baur, Michael Dietz, Alexander Heimerl, Anna Penzkofer, Dominik Schiller, François Brémond, Jan Alexandersson, Elisabeth André, Andreas Bulling

    Proceedings of the 32nd ACM International Conference on Multimedia, pp. 11377 - 11382, 2024.

    Abstract Links BibTeX Project

  16. VSA4VQA: Scaling A Vector Symbolic Architecture To Visual Question Answering on Natural Images

    VSA4VQA: Scaling A Vector Symbolic Architecture To Visual Question Answering on Natural Images

    Anna Penzkofer, Lei Shi, Andreas Bulling

    Proc. 46th Annual Meeting of the Cognitive Science Society (CogSci), 2024.

    Abstract Links BibTeX Project Oral Presentation

  17. Quantifying Human Upper Limb Stiffness Responses Based on a Computationally Efficient Neuromusculoskeletal Arm Model

    Quantifying Human Upper Limb Stiffness Responses Based on a Computationally Efficient Neuromusculoskeletal Arm Model

    Maria Sapounaki, Pierre Schumacher, Winfried Ilg, Martin Giese, Christophe Maufroy, Andreas Bulling, Syn Schmitt, Daniel F.B. Haeufle, Isabell Wochner

    Proc. 10th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, pp. 1–6, 2024.

    Abstract Links BibTeX Project Oral Presentation

  18. Inferring Human Intentions from Predicted Action Probabilities

    Inferring Human Intentions from Predicted Action Probabilities

    Lei Shi, Paul-Christian Bürkner, Andreas Bulling

    Proc. Workshop on Theory of Mind in Human-AI Interaction at CHI 2024, pp. 1–7, 2024.

    Abstract Links BibTeX Project

  19. Saliency3D: a 3D Saliency Dataset Collected on Screen

    Saliency3D: a 3D Saliency Dataset Collected on Screen

    Yao Wang, Qi Dai, Mihai Bâce, Karsten Klein, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–9, 2024.

    Abstract Links BibTeX Project

  20. GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction

    GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction

    Haodong Yan, Zhiming Hu, Syn Schmitt, Andreas Bulling

    Proc. 32nd Pacific Conference on Computer Graphics and Application (PG), pp. 1–10, 2024.

    Abstract Links BibTeX Project

  21. InteRead: An Eye Tracking Dataset of Interrupted Reading

    InteRead: An Eye Tracking Dataset of Interrupted Reading

    Francesca Zermiani, Prajit Dhar, Ekta Sood, Fabian Kögel, Andreas Bulling, Maria Wirzberger

    Proc. 31st Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING), pp. 9154–9169, 2024.

    Abstract Links BibTeX Project

Technical Reports

  1. PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation

    PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation

    Mayar Elfares, Pascal Reisert, Zhiming Hu, Wenwu Tang, Ralf Küsters, Andreas Bulling

    arXiv:2402.18970, pp. 1–22, 2024.

    Abstract Links BibTeX Project

  2. OLViT: Multi-Modal State Tracking via Attention-Based Embeddings for Video-Grounded Dialog

    OLViT: Multi-Modal State Tracking via Attention-Based Embeddings for Video-Grounded Dialog

    Adnen Abdessaied, Manuel Hochmeister, Andreas Bulling

    arXiv:2402.13146, pp. 1–11, 2024.

    Abstract Links BibTeX Project

  3. Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition

    Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition

    Matteo Bortoletto, Constantin Ruhdorfer, Adnen Abdessaied, Lei Shi, Andreas Bulling

    arXiv:2405.12621, pp. 1–16, 2024.

    Abstract Links BibTeX Project

  4. Benchmarking Mental State Representations in Language Models

    Benchmarking Mental State Representations in Language Models

    Matteo Bortoletto, Constantin Ruhdorfer, Lei Shi, Andreas Bulling

    arXiv:2406.17513, pp. 1–21, 2024.

    Abstract Links BibTeX Project

  5. Explicit Modelling of Theory of Mind for Belief Prediction in Nonverbal Social Interactions

    Explicit Modelling of Theory of Mind for Belief Prediction in Nonverbal Social Interactions

    Matteo Bortoletto, Constantin Ruhdorfer, Lei Shi, Andreas Bulling

    arXiv:2407.06762, pp. 1–11, 2024.

    Abstract Links BibTeX Project

  6. Generating Realistic Arm Movements in Reinforcement Learning: A Quantitative Comparison of Reward Terms and Task Requirements

    Generating Realistic Arm Movements in Reinforcement Learning: A Quantitative Comparison of Reward Terms and Task Requirements

    Jhon Paul Feliciano Charaja Casas, Isabell Wochner, Pierre Schumacher, Winfried Ilg, Martin Giese, Christophe Maufroy, Andreas Bulling, Syn Schmitt, Daniel F.B. Haeufle

    arXiv:2402.13949, pp. 1–6, 2024.

    Abstract Links BibTeX Project

  7. GazeMotion: Gaze-guided Human Motion Forecasting

    GazeMotion: Gaze-guided Human Motion Forecasting

    Zhiming Hu, Syn Schmitt, Daniel Häufle, Andreas Bulling

    arXiv:2403.09885, pp. 1–6, 2024.

    Abstract Links BibTeX Project

  8. DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360° Images

    DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360° Images

    Chuhan Jiao, Yao Wang, Guanhua Zhang, Mihai Bâce, Zhiming Hu, Andreas Bulling

    arXiv:2403.17477, pp. 1–13, 2024.

    Abstract Links BibTeX Project

  9. DiffEyeSyn: Diffusion-based User-specific Eye Movement Synthesis

    DiffEyeSyn: Diffusion-based User-specific Eye Movement Synthesis

    Chuhan Jiao, Guanhua Zhang, Zhiming Hu, Andreas Bulling

    arXiv:2409.01240, pp. 1–22, 2024.

    Abstract Links BibTeX Project

  10. MultiMediate’24: Multi-Domain Engagement Estimation

    MultiMediate’24: Multi-Domain Engagement Estimation

    Philipp Müller, Michal Balazia, Tobias Baur, Michael Dietz, Alexander Heimerl, Anna Penzkofer, Dominik Schiller, François Brémond, Jan Alexandersson, Elisabeth André, Andreas Bulling

    arXiv:2408.16625, pp. 1–6, 2024.

    Abstract Links BibTeX Project

  11. The Overcooked Generalisation Challenge

    The Overcooked Generalisation Challenge

    Constantin Ruhdorfer, Matteo Bortoletto, Anna Penzkofer, Andreas Bulling

    arxiv:2406.17949, pp. 1-25, 2024.

    Abstract Links BibTeX Project

  12. ActionDiffusion: An Action-aware Diffusion Model for Procedure Planning in Instructional Videos

    ActionDiffusion: An Action-aware Diffusion Model for Procedure Planning in Instructional Videos

    Lei Shi, Paul Burkner, Andreas Bulling

    arXiv:2403.08591, pp. 1–6, 2024.

    Abstract Links BibTeX Project

  13. Learning User Embeddings from Human Gaze for Personalised Saliency Prediction

    Learning User Embeddings from Human Gaze for Personalised Saliency Prediction

    Florian Strohm, Mihai Bâce, Andreas Bulling

    arXiv:2403.13653, pp. 1–15, 2024.

    Abstract Links BibTeX Project

  14. SeFFeC: Semantic Facial Feature Control for Fine-grained Face Editing

    SeFFeC: Semantic Facial Feature Control for Fine-grained Face Editing

    Florian Strohm, Mihai Bâce, Markus Kaltenecker, Andreas Bulling

    arXiv:2403.13972, pp. 1–18, 2024.

    Abstract Links BibTeX Project

2023

Journal Articles

  1. Privacy-Aware Eye Tracking: Challenges and Future Directions

    Privacy-Aware Eye Tracking: Challenges and Future Directions

    Céline Gressel, Rebekah Overdorf, Inken Hagenstedt, Murat Karaboga, Helmut Lurtz, Michael Raschke, Andreas Bulling

    IEEE Pervasive Computing, 22 (1), pp. 95-102, 2023.

    Abstract Links BibTeX Project

  2. Scanpath Prediction on Information Visualisations

    Scanpath Prediction on Information Visualisations

    Yao Wang, Mihai Bâce, Andreas Bulling

    IEEE Transactions on Visualization and Computer Graphics (TVCG), 30 (7), pp. 3902–3914, 2023.

    Abstract Links BibTeX Project

Conference Papers

  1. Exploring Natural Language Processing Methods for Interactive Behaviour Modelling

    Exploring Natural Language Processing Methods for Interactive Behaviour Modelling

    Guanhua Zhang, Matteo Bortoletto, Zhiming Hu, Lei Shi, Mihai Bâce, Andreas Bulling

    Proc. IFIP TC13 Conference on Human-Computer Interaction (INTERACT), pp. 1–22, 2023.

    Abstract Links BibTeX Project Best Student Paper Nomination

  2. Improving Neural Saliency Prediction with a Cognitive Model of Human Visual Attention

    Improving Neural Saliency Prediction with a Cognitive Model of Human Visual Attention

    Ekta Sood, Lei Shi, Matteo Bortoletto, Yao Wang, Philipp Müller, Andreas Bulling

    Proc. the 45th Annual Meeting of the Cognitive Science Society (CogSci), pp. 3639–3646, 2023.

    Abstract Links BibTeX Project

  3. GazeCast: Using Mobile Devices to Allow Gaze-based Interaction on Public Displays

    GazeCast: Using Mobile Devices to Allow Gaze-based Interaction on Public Displays

    Omar Namnakani, Penpicha Sinrattanavong, Yasmeen Abdrabou, Andreas Bulling, Florian Alt, Mohamed Khamis

    Proc. Communication by Gaze Interaction Symposium (COGAIN), pp. 1–8, 2023.

    Abstract Links BibTeX Project COGAIN Best Paper Award

  4. Int-HRL: Towards Intention-based Hierarchical Reinforcement Learning

    Int-HRL: Towards Intention-based Hierarchical Reinforcement Learning

    Anna Penzkofer, Simon Schaefer, Florian Strohm, Mihai Bâce, Stefan Leutenegger, Andreas Bulling

    Proc. Adaptive and Learning Agents Workshop (ALA), pp. 1–7, 2023.

    Abstract Links BibTeX Project

  5. Impact of Privacy Protection Methods of Lifelogs on Remembered Memories

    Impact of Privacy Protection Methods of Lifelogs on Remembered Memories

    Passant Elagroudy, Mohamed Khamis, Florian Mathis, Diana Irmscher, Ekta Sood, Andreas Bulling, Albrecht Schmidt

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–10, 2023.

    Abstract Links BibTeX Project

  6. Federated Learning for Appearance-based Gaze Estimation in the Wild

    Federated Learning for Appearance-based Gaze Estimation in the Wild

    Mayar Elfares, Zhiming Hu, Pascal Reisert, Andreas Bulling, Ralf Küsters

    Proceedings of The 1st Gaze Meets ML workshop, PMLR, pp. 20–36, 2023.

    Abstract Links BibTeX Project

  7. SUPREYES: SUPer Resolution for EYES Using Implicit Neural Representation Learning

    SUPREYES: SUPer Resolution for EYES Using Implicit Neural Representation Learning

    Chuhan Jiao, Zhiming Hu, Mihai Bâce, Andreas Bulling

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 1–13, 2023.

    Abstract Links BibTeX Project

  8. MultiMediate ’23: Engagement Estimation and Bodily Behaviour Recognition in Social Interactions

    MultiMediate ’23: Engagement Estimation and Bodily Behaviour Recognition in Social Interactions

    Philipp Müller, Michal Balazia, Tobias Baur, Michael Dietz, Alexander Heimerl, Dominik Schiller, Mohammed Guermal, Dominike Thomas, François Brémond, Jan Alexandersson, Elisabeth André, Andreas Bulling

    Proceedings of the 31st ACM International Conference on Multimedia, pp. 9640–9645, 2023.

    Abstract Links BibTeX Project

  9. Multimodal Integration of Human-Like Attention in Visual Question Answering

    Multimodal Integration of Human-Like Attention in Visual Question Answering

    Ekta Sood, Fabian Kögel, Philipp Müller, Dominike Thomas, Mihai Bâce, Andreas Bulling

    Proc. Workshop on Gaze Estimation and Prediction in the Wild (GAZE), CVPRW, pp. 2647–2657, 2023.

    Abstract Links BibTeX Project Tobii Sponsor Award, Oral Presentation

  10. Facial Composite Generation with Iterative Human Feedback

    Facial Composite Generation with Iterative Human Feedback

    Florian Strohm, Ekta Sood, Dominike Thomas, Mihai Bâce, Andreas Bulling

    Proc. The 1st Gaze Meets ML workshop, PMLR, pp. 165–183, 2023.

    Abstract Links BibTeX Project

  11. Usable and Fast Interactive Mental Face Reconstruction

    Usable and Fast Interactive Mental Face Reconstruction

    Florian Strohm, Mihai Bâce, Andreas Bulling

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 1–15, 2023.

    Abstract Links BibTeX Project

  12. Gaze Behaviour in Adolescents with Obsessive-compulsive Disorder During Exposure Within Cognitive-behavioural Therapy

    Gaze Behaviour in Adolescents with Obsessive-compulsive Disorder During Exposure Within Cognitive-behavioural Therapy

    Annika Thierfelder, Björn Severitt, Carolin Sarah Klein, Annika Kristin Alt, Karsten Hollmann, Andreas Bulling, Winfried Ilg

    Proc. 17th EAI International Conference on Pervasive Computing Technologies for Healthcare (Pervasive Health), 2023.

    Abstract Links BibTeX Project

Technical Reports

  1. Neural Reasoning About Agents’ Goals, Preferences, and Actions

    Neural Reasoning About Agents’ Goals, Preferences, and Actions

    Matteo Bortoletto, Lei Shi, Andreas Bulling

    arXiv:2312.07122, pp. 1–13, 2023.

    Abstract Links BibTeX Project

  2. Pose2Gaze: Generating Realistic Human Gaze Behaviour from Full-body Poses using an Eye-body Coordination Model

    Pose2Gaze: Generating Realistic Human Gaze Behaviour from Full-body Poses using an Eye-body Coordination Model

    Zhiming Hu, Jiahui Xu, Syn Schmitt, Andreas Bulling

    arXiv:2312.12042, pp. 1–10, 2023.

    Abstract Links BibTeX Project

  3. Int-HRL: Towards Intention-based Hierarchical Reinforcement Learning

    Int-HRL: Towards Intention-based Hierarchical Reinforcement Learning

    Anna Penzkofer, Simon Schaefer, Florian Strohm, Mihai Bâce, Stefan Leutenegger, Andreas Bulling

    arxiv:2306.11483, pp. 1–7, 2023.

    Abstract Links BibTeX Project

  4. Inferring Human Intentions from Predicted Action Probabilities

    Inferring Human Intentions from Predicted Action Probabilities

    Lei Shi, Paul-Christian Bürkner, Andreas Bulling

    arXiv:2308.12194, pp. 1–7, 2023.

    Abstract Links BibTeX Project

  5. GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction

    GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction

    Haodong Yan, Zhiming Hu, Syn Schmitt, Andreas Bulling

    arXiv:2312.12090, pp. 1–10, 2023.

    Abstract Links BibTeX Project

2022

Journal Articles

  1. Understanding, Addressing, and Analysing Digital Eye Strain in Virtual Reality Head-Mounted Displays

    Understanding, Addressing, and Analysing Digital Eye Strain in Virtual Reality Head-Mounted Displays

    Teresa Hirzle, Fabian Fischbach, Julian Karlbauer, Pascal Jansen, Jan Gugenheimer, Enrico Rukzio, Andreas Bulling

    ACM Transactions on Computer-Human Interaction (TOCHI), 29 (4), pp. 1-80, 2022.

    Abstract Links BibTeX Project

  2. Anticipatory Human-Machine Interaction (Dagstuhl Seminar 22202)

    Anticipatory Human-Machine Interaction (Dagstuhl Seminar 22202)

    Jelmer Borst, Andreas Bulling, Cleotilde Gonzalez, Nele Russwinkel

    Dagstuhl Reports, 12 (5), pp. 131–169, 2022.

    Links BibTeX Project

  3. Adapting visualizations and interfaces to the user

    Adapting visualizations and interfaces to the user

    Francesco Chiossi, Johannes Zagermann, Jakob Karolus, Nils Rodrigues, Priscilla Balestrucci, Daniel Weiskopf, Benedikt Ehinger, Tiare Feuchtner, Harald Reiterer, Lewis L. Chuang, Marc Ernst, Andreas Bulling, Sven Mayer, Albrecht Schmidt

    it - Information Technology, 64 (4-5), pp. 133–143, 2022.

    Abstract Links BibTeX Project

  4. User-centred multimodal authentication: securing handheld mobile devices using gaze and touch input

    User-centred multimodal authentication: securing handheld mobile devices using gaze and touch input

    Mohamed Khamis, Karola Marky, Andreas Bulling, Florian Alt

    Behaviour & Information Technology, 41 (10), pp. 2061-2083, 2022.

    Abstract Links BibTeX Project

  5. VisRecall: Quantifying Information Visualisation Recallability via Question Answering

    VisRecall: Quantifying Information Visualisation Recallability via Question Answering

    Yao Wang, Chuhan Jiao, Mihai Bâce, Andreas Bulling

    IEEE Transactions on Visualization and Computer Graphics (TVCG), 28 (12), pp. 4995-5005, 2022.

    Abstract Links BibTeX Project

Conference Papers

  1. ThumbPitch: Enriching Thumb Interaction on Mobile Touchscreens using Deep Learning

    ThumbPitch: Enriching Thumb Interaction on Mobile Touchscreens using Deep Learning

    Jamie Ullerich, Maximiliane Windl, Andreas Bulling, Sven Mayer

    ACM Proceedings of the 34st Australian Conference on Human-Computer-Interaction (OzCHI), pp. 1–9, 2022.

    Abstract Links BibTeX Project

  2. Impact of Gaze Uncertainty on AOIs in Information Visualisations

    Impact of Gaze Uncertainty on AOIs in Information Visualisations

    Yao Wang, Maurice Koch, Mihai Bâce, Daniel Weiskopf, Andreas Bulling

    ETRA Workshop on Eye Tracking and Visualization (ETVIS), pp. 1–6, 2022.

    Abstract Links BibTeX Project

  3. Mind Wandering Trait-level Tendencies During Lecture Viewing: A Pilot Study

    Mind Wandering Trait-level Tendencies During Lecture Viewing: A Pilot Study

    Francesca Zermiani, Andreas Bulling, Maria Wirzberger

    Proc. EduEye Workshop on Eye Tracking in Learning and Education (EduEye), pp. 1–7, 2022.

    Abstract Links BibTeX Project

  4. PrivacyScout: Assessing Vulnerability to Shoulder Surfing on Mobile Devices

    PrivacyScout: Assessing Vulnerability to Shoulder Surfing on Mobile Devices

    Mihai Bâce, Alia Saad, Mohamed Khamis, Stefan Schneegass, Andreas Bulling

    Proc. on Privacy Enhancing Technologies (PETs), pp. 650–669, 2022.

    Abstract Links BibTeX Project

  5. Designing for Noticeability: The Impact of Visual Importance on Desktop Notifications

    Designing for Noticeability: The Impact of Visual Importance on Desktop Notifications

    Philipp Müller, Sander Staal, Mihai Bâce, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–13, 2022.

    Abstract Links BibTeX Project

  6. Video Language Co-Attention with Multimodal Fast-Learning Feature Fusion for VideoQA

    Video Language Co-Attention with Multimodal Fast-Learning Feature Fusion for VideoQA

    Adnen Abdessaied*, Ekta Sood*, Andreas Bulling

    Proc. of the 7th Workshop on Representation Learning for NLP (Repl4NLP), pp. 1–12, 2022.

    Abstract Links BibTeX Project

  7. Neuro-Symbolic Visual Dialog

    Neuro-Symbolic Visual Dialog

    Adnen Abdessaied, Mihai Bâce, Andreas Bulling

    Proc. 29th International Conference on Computational Linguistics (COLING), pp. 1–11, 2022.

    Abstract Links BibTeX Project

  8. Gaze-enhanced Crossmodal Embeddings for Emotion Recognition

    Gaze-enhanced Crossmodal Embeddings for Emotion Recognition

    Ahmed Abdou, Ekta Sood, Philipp Müller, Andreas Bulling

    Proc. International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–18, 2022.

    Abstract Links BibTeX Project

  9. MultiMediate’22: Backchannel Detection and Agreement Estimation in Group Interactions

    MultiMediate’22: Backchannel Detection and Agreement Estimation in Group Interactions

    Philipp Müller, Dominik Schiller, Dominike Thomas, Michael Dietz, Hali Lindsay, Patrick Gebhard, Elisabeth André, Andreas Bulling

    Proc. ACM Multimedia (MM), pp. 7109-7114, 2022.

    Abstract Links BibTeX Project

  10. Multimodal Sensor-based Identification of Stress and Compulsive Actions in Children with Obsessive-compulsive Disorder for Telemedical Treatment

    Multimodal Sensor-based Identification of Stress and Compulsive Actions in Children with Obsessive-compulsive Disorder for Telemedical Treatment

    Annika Thierfelder, Jonas Primbs, Björn Severitt, Carolin Sarah Hohnecker, Jan Kühnhausen, Annika Kristin Alt, Anja Pascher, Ursula Wörz, Helene Passon, Jens Seemann, Christian Ernst, Heinrich Lautenbacher, Martin Holderried, Enkelejda Kasneci, Martin Giese, Andreas Bulling, Michael Menth, Gottfried Maria Barth, Winfried Ilg, Karsten Hollmann, Tobias Johann Renner

    Proc. the 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 1–7, 2022.

    Abstract Links BibTeX Project

  11. Predicting Next Actions and Latent Intents during Text Formatting

    Predicting Next Actions and Latent Intents during Text Formatting

    Guanhua Zhang, Susanne Hindennach, Jan Leusmann, Felix Bühler, Benedict Steuerlein, Sven Mayer, Mihai Bâce, Andreas Bulling

    Proc. the CHI Workshop Computational Approaches for Understanding, Generating, and Adapting User Interfaces, pp. 1–6, 2022.

    Abstract Links BibTeX Project

Technical Reports

  1. Federated Learning for Appearance-based Gaze Estimation in the Wild

    Federated Learning for Appearance-based Gaze Estimation in the Wild

    Mayar Elfares, Zhiming Hu, Pascal Reisert, Andreas Bulling, Ralf Küsters

    arXiv:2211.07330, pp. 1–17, 2022.

    Abstract Links BibTeX Project

  2. MultiMediate’22: Backchannel Detection and Agreement Estimation in Group Interactions

    MultiMediate’22: Backchannel Detection and Agreement Estimation in Group Interactions

    Philipp Müller, Dominik Schiller, Dominike Thomas, Michael Dietz, Hali Lindsay, Patrick Gebhard, Elisabeth André, Andreas Bulling

    arXiv:2209.09578, pp. 1–6, 2022.

    Abstract Links BibTeX Project

2021

Journal Articles

  1. EHTask: Recognizing User Tasks from Eye and Head Movements in Immersive Virtual Reality

    EHTask: Recognizing User Tasks from Eye and Head Movements in Immersive Virtual Reality

    Zhiming Hu, Andreas Bulling, Sheng Li, Guoping Wang

    IEEE Transactions on Visualization and Computer Graphics (TVCG), 29 (4), pp. 1992–2004, 2021.

    Abstract Links BibTeX Project

  2. FixationNet: Forecasting Eye Fixations in Task-Oriented Virtual Environments

    FixationNet: Forecasting Eye Fixations in Task-Oriented Virtual Environments

    Zhiming Hu, Andreas Bulling, Sheng Li, Guoping Wang

    IEEE Transactions on Visualization and Computer Graphics (TVCG), 27 (5), pp. 2681–2690, 2021.

    Abstract Links BibTeX Project TVCG Best Journal Nominees Award

  3. Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach

    Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach

    Christoph Strauch, Teresa Hirzle, Stefan Van Stigchel, Andreas Bulling

    Journal of Vision (JOV), 21 (7), pp. 1-13, 2021.

    Abstract Links BibTeX Project

Conference Papers

  1. Altering Non-verbal Cues to Implicitly Direct Attention in Social VR

    Altering Non-verbal Cues to Implicitly Direct Attention in Social VR

    Radiah Rivu, Ken Pfeuffer, Philipp Müller, Yomna Abdelrahman, Andreas Bulling, Florian Alt

    ACM Symposium on Spatial User Interaction (SSUI), pp. 1–2, 2021.

    Abstract Links BibTeX Project

  2. VQA-MHUG: A gaze dataset to study multimodal neural attention in VQA

    VQA-MHUG: A gaze dataset to study multimodal neural attention in VQA

    Ekta Sood, Fabian Kögel, Florian Strohm, Prajit Dhar, Andreas Bulling

    Proc. ACL SIGNLL Conference on Computational Natural Language Learning (CoNLL), pp. 27–43, 2021.

    Abstract Links BibTeX Project Oral Presentation

  3. ConAn: A Usable Tool for Multimodal Conversation Analysis

    ConAn: A Usable Tool for Multimodal Conversation Analysis

    Anna Penzkofer, Philipp Müller, Felix Bühler, Sven Mayer, Andreas Bulling

    Proc. ACM International Conference on Multimodal Interaction (ICMI), pp. 341-351, 2021.

    Abstract Links BibTeX Project

  4. A Critical Assessment of the Use of SSQ as a Measure of General Discomfort in VR Head-Mounted Displays

    A Critical Assessment of the Use of SSQ as a Measure of General Discomfort in VR Head-Mounted Displays

    Teresa Hirzle, Maurice Cordts, Enrico Rukzio, Jan Gugenheimer, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–14, 2021.

    Abstract Links BibTeX Project

  5. MultiMediate: Multi-modal Group Behaviour Analysis for Artificial Mediation

    MultiMediate: Multi-modal Group Behaviour Analysis for Artificial Mediation

    Philipp Müller, Dominik Schiller, Dominike Thomas, Guanhua Zhang, Michael Dietz, Patrick Gebhard, Elisabeth André, Andreas Bulling

    Proc. ACM Multimedia (MM), pp. 4878–4882, 2021.

    Abstract Links BibTeX Project

  6. Neural Photofit: Gaze-based Mental Image Reconstruction

    Neural Photofit: Gaze-based Mental Image Reconstruction

    Florian Strohm, Ekta Sood, Sven Mayer, Philipp Müller, Mihai Bâce, Andreas Bulling

    Proc. IEEE International Conference on Computer Vision (ICCV), pp. 245-254, 2021.

    Abstract Links BibTeX Project

Technical Reports

  1. Scanpath Prediction on Information Visualisations

    Scanpath Prediction on Information Visualisations

    Yao Wang, Mihai Bâce, Andreas Bulling

    arXiv:2112.02340, pp. 1–14, 2021.

    Abstract Links BibTeX Project

  2. VisRecall: Quantifying Information Visualisation Recallability via Question Answering

    VisRecall: Quantifying Information Visualisation Recallability via Question Answering

    Yao Wang, Chuhan Jiao, Mihai Bâce, Andreas Bulling

    arXiv:2112.15217, pp. 1–10, 2021.

    Abstract Links BibTeX Project

  3. Multimodal Integration of Human-Like Attention in Visual Question Answering

    Multimodal Integration of Human-Like Attention in Visual Question Answering

    Ekta Sood, Fabian Kögel, Philipp Müller, Dominike Thomas, Mihai Bâce, Andreas Bulling

    arxiv:2109.13139, pp. 1–11, 2021.

    Abstract Links BibTeX Project

  4. Neural Photofit: Gaze-based Mental Image Reconstruction

    Neural Photofit: Gaze-based Mental Image Reconstruction

    Florian Strohm, Ekta Sood, Sven Mayer, Philipp Müller, Mihai Bâce, Andreas Bulling

    arXiv:2108.07524, pp. 1–10, 2021.

    Abstract Links BibTeX Project

2020

Journal Articles

  1. Deep Gaze Pooling: Inferring and Visually Decoding Search Intents From Human Gaze Fixations

    Deep Gaze Pooling: Inferring and Visually Decoding Search Intents From Human Gaze Fixations

    Hosnieh Sattar, Mario Fritz, Andreas Bulling

    Neurocomputing, 387, pp. 369–382, 2020.

    Abstract Links BibTeX Project

  2. How far are we from quantifying visual attention in mobile HCI?

    How far are we from quantifying visual attention in mobile HCI?

    Mihai Bâce, Sander Staal, Andreas Bulling

    IEEE Pervasive Computing, 19 (2), pp. 46-55, 2020.

    Abstract Links BibTeX Project

Conference Papers

  1. Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention

    Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention

    Ekta Sood, Simon Tannert, Philipp Müller, Andreas Bulling

    Advances in Neural Information Processing Systems (NeurIPS), pp. 1–15, 2020.

    Abstract Links BibTeX Project

  2. Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension

    Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension

    Ekta Sood, Simon Tannert, Diego Frassinelli, Andreas Bulling, Ngoc Thang Vu

    Proc. ACL SIGNLL Conference on Computational Natural Language Learning (CoNLL), pp. 12-25, 2020.

    Abstract Links BibTeX Project

  3. Combining Gaze Estimation and Optical Flow for Pursuits Interaction

    Combining Gaze Estimation and Optical Flow for Pursuits Interaction

    Mihai Bâce, Vincent Becker, Chenyang Wang, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1-10, 2020.

    Abstract Links BibTeX Project Best Paper Award

  4. Adversarial Attacks on Classifiers for Eye-based User Modelling

    Adversarial Attacks on Classifiers for Eye-based User Modelling

    Inken Hagestedt, Michael Backes, Andreas Bulling

    Adj. Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1-3, 2020.

    Abstract Links BibTeX Project

  5. A Survey of Digital Eye Strain in Gaze-Based Interactive Systems

    A Survey of Digital Eye Strain in Gaze-Based Interactive Systems

    Teresa Hirzle, Maurice Cordts, Enrico Rukzio, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1-12, 2020.

    Abstract Links BibTeX Project

  6. Visual Analytics and Annotation of Pervasive Eye Tracking Video

    Visual Analytics and Annotation of Pervasive Eye Tracking Video

    Kuno Kurzhals, Nils Rodrigues, Maurice Koch, Michael Stoll, Andrés Bruhn, Andreas Bulling, Daniel Weiskopf

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1-9, 2020.

    Abstract Links BibTeX Project

  7. Anticipating Averted Gaze in Dyadic Interactions

    Anticipating Averted Gaze in Dyadic Interactions

    Philipp Müller, Ekta Sood, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1-10, 2020.

    Abstract Links BibTeX Project

  8. Quantification of Users’ Visual Attention During Everyday Mobile Device Interactions

    Quantification of Users’ Visual Attention During Everyday Mobile Device Interactions

    Mihai Bâce, Sander Staal, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–14, 2020.

    Abstract Links BibTeX Project

  9. Learning-based Region Selection for End-to-End Gaze Estimation

    Learning-based Region Selection for End-to-End Gaze Estimation

    Xucong Zhang, Yusuke Sugano, Andreas Bulling, Otmar Hilliges

    Proc. British Machine Vision Conference (BMVC), pp. 1-13, 2020.

    Abstract Links BibTeX Project

Technical Reports

  1. Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention

    Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention

    Ekta Sood, Simon Tannert, Philipp Müller, Andreas Bulling

    arxiv:2010.07891, pp. 1–18, 2020.

    Abstract Links BibTeX Project

  2. Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension

    Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension

    Ekta Sood, Simon Tannert, Diego Frassinelli, Andreas Bulling, Ngoc Thang Vu

    arxiv:2010.06396, pp. 1–14, 2020.

    Abstract Links BibTeX Project

  3. Adversarial Attacks on Classifiers for Eye-based User Modelling

    Adversarial Attacks on Classifiers for Eye-based User Modelling

    Inken Hagestedt, Michael Backes, Andreas Bulling

    arXiv:2006.00860, pp. 1–9, 2020.

    Abstract Links BibTeX Project

2019

Journal Articles

  1. Classifying Attention Types with Thermal Imaging and Eye Tracking

    Classifying Attention Types with Thermal Imaging and Eye Tracking

    Yomna Abdelrahman, Anam Ahmad Khan, Joshua Newn, Eduardo Velloso, Sherine Ashraf Safwat, James Bailey, Andreas Bulling, Frank Vetere, Albrecht Schmidt

    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 3 (3), pp. 1–27, 2019.

    Abstract Links BibTeX Project

  2. InvisibleEye: Fully Embedded Mobile Eye Tracking Using Appearance-Based Gaze Estimation

    InvisibleEye: Fully Embedded Mobile Eye Tracking Using Appearance-Based Gaze Estimation

    Julian Steil, Marc Tonsen, Yusuke Sugano, Andreas Bulling

    ACM SIGMOBILE Mobile Computing and Communications Review, 23 (2), pp. 30-34, 2019.

    Abstract Links BibTeX Project

  3. MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation

    MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation

    Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling

    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 41 (1), pp. 162-175, 2019.

    Abstract Links BibTeX Project

Conference Papers

  1. Towards High-Frequency SSVEP-Based Target Discrimination with an Extended Alphanumeric Keyboard

    Towards High-Frequency SSVEP-Based Target Discrimination with an Extended Alphanumeric Keyboard

    Sahar Abdelnabi, Michael Xuelin Huang, Andreas Bulling

    Proc. IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1-6, 2019.

    Abstract Links BibTeX Project

  2. A fast approach to refraction-aware 3D eye-model fitting and gaze prediction

    A fast approach to refraction-aware 3D eye-model fitting and gaze prediction

    Kai Dierkes, Moritz Kassner, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–9, 2019.

    Abstract Links BibTeX Project

  3. Can Privacy-Aware Lifelogs Alter Our Memories?

    Can Privacy-Aware Lifelogs Alter Our Memories?

    Passant Elagroudy, Florian Mathis, Andreas Bulling, Mohamed Khamis, Diana Irmscher, Albrecht Schmidt

    Ext. Abstr. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–6, 2019.

    Abstract Links BibTeX Project

  4. A Design Space for Gaze Interaction on Head-mounted Displays

    A Design Space for Gaze Interaction on Head-mounted Displays

    Teresa Hirzle, Jan Gugenheimer, Florian Geiselhart, Andreas Bulling, Enrico Rukzio

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–12, 2019.

    Abstract Links BibTeX Project

  5. SacCalib: Reducing Calibration Distortion for Stationary Eye Trackers Using Saccadic Eye Movements

    SacCalib: Reducing Calibration Distortion for Stationary Eye Trackers Using Saccadic Eye Movements

    Michael Xuelin Huang, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–10, 2019.

    Abstract Links BibTeX Project

  6. Moment-to-Moment Detection of Internal Thought during Video Viewing from Eye Vergence Behavior

    Moment-to-Moment Detection of Internal Thought during Video Viewing from Eye Vergence Behavior

    Michael Xuelin Huang, Jiajia Li, Grace Ngai, Hong Va Leong, Andreas Bulling

    Proc. ACM Multimedia (MM), pp. 1–9, 2019.

    Abstract Links BibTeX Project

  7. Reducing Calibration Drift in Mobile Eye Trackers by Exploiting Mobile Phone Usage

    Reducing Calibration Drift in Mobile Eye Trackers by Exploiting Mobile Phone Usage

    Philipp Müller, Daniel Buschek, Michael Xuelin Huang, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–9, 2019.

    Abstract Links BibTeX Project

  8. Emergent Leadership Detection Across Datasets

    Emergent Leadership Detection Across Datasets

    Philipp Müller, Andreas Bulling

    Proc. ACM International Conference on Multimodal Interaction (ICMI), pp. 274-278, 2019.

    Abstract Links BibTeX Project

  9. KnuckleTouch: Enabling Knuckle Gestures on Capacitive Touchscreens using Deep Learning

    KnuckleTouch: Enabling Knuckle Gestures on Capacitive Touchscreens using Deep Learning

    Robin Schweigert, Jan Leusmann, Simon Hagenmayer, Maximilian Weiß, Huy Viet Le, Sven Mayer, Andreas Bulling

    Proc. Mensch und Computer, pp. 387-397, 2019.

    Abstract Links BibTeX Project

  10. Predicting Gaze Patterns: Text Saliency for Integration into Machine Learning Tasks

    Predicting Gaze Patterns: Text Saliency for Integration into Machine Learning Tasks

    Ekta Sood

    Proc. International Workshop on Computational Cognition (ComCo), pp. 1–2, 2019.

    Links BibTeX Project Best Poster Award

  11. PrivacEye: Privacy-Preserving Head-Mounted Eye Tracking Using Egocentric Scene Image and Eye Movement Features

    PrivacEye: Privacy-Preserving Head-Mounted Eye Tracking Using Egocentric Scene Image and Eye Movement Features

    Julian Steil, Marion Koelle, Wilko Heuten, Susanne Boll, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–10, 2019.

    Abstract Links BibTeX Project Best Video Award

  12. Privacy-Aware Eye Tracking Using Differential Privacy

    Privacy-Aware Eye Tracking Using Differential Privacy

    Julian Steil, Inken Hagestedt, Michael Xuelin Huang, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–9, 2019.

    Abstract Links BibTeX Project Best Paper Award

  13. Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applications

    Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applications

    Xucong Zhang, Yusuke Sugano, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–13, 2019.

    Abstract Links BibTeX Project

Book Chapters

  1. Pervasive Eye Tracking for Real-World Consumer Behavior Analysis

    Pervasive Eye Tracking for Real-World Consumer Behavior Analysis

    Andreas Bulling, Michel Wedel

    Michael Schulte-Mecklenbeck, Anton Kühberger (Eds.): A Handbook of Process Tracing Methods for Decision Research: A Critical Review and User’s Guide, Taylor & Francis, pp. 27-44, 2019.

    Abstract Links BibTeX Project

Technical Reports

  1. Accurate and Robust Eye Contact Detection During Everyday Mobile Device Interactions

    Accurate and Robust Eye Contact Detection During Everyday Mobile Device Interactions

    Mihai Bâce, Sander Staal, Andreas Bulling

    arXiv:1907.11115, pp. 1–12, 2019.

    Abstract Links BibTeX Project

  2. How far are we from quantifying visual attention in mobile HCI?

    How far are we from quantifying visual attention in mobile HCI?

    Mihai Bâce, Sander Staal, Andreas Bulling

    arXiv:1907.11106, pp. 1–7, 2019.

    Abstract Links BibTeX Project

  3. Moment-to-Moment Detection of Internal Thought from Eye Vergence Behaviour

    Moment-to-Moment Detection of Internal Thought from Eye Vergence Behaviour

    Michael Xuelin Huang, Jiajia Li, Grace Ngai, Hong Va Leong, Andreas Bulling

    arXiv:1901.06572, pp. 1–22, 2019.

    Abstract Links BibTeX Project

  4. SacCalib: Reducing Calibration Distortion for Stationary Eye Trackers Using Saccadic Eye Movements

    SacCalib: Reducing Calibration Distortion for Stationary Eye Trackers Using Saccadic Eye Movements

    Michael Xuelin Huang, Andreas Bulling

    arXiv:1903.04047, pp. 1–10, 2019.

    Abstract Links BibTeX Project

  5. Emergent Leadership Detection Across Datasets

    Emergent Leadership Detection Across Datasets

    Philipp Müller, Andreas Bulling

    arXiv:1905.02058, pp. 1–5, 2019.

    Abstract Links BibTeX Project

  6. Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applications

    Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applications

    Xucong Zhang, Yusuke Sugano, Andreas Bulling

    arXiv:1901.10906, pp. 1–13, 2019.

    Abstract Links BibTeX Project

2018

Journal Articles

  1. Eye movements during everyday behavior predict personality traits

    Eye movements during everyday behavior predict personality traits

    Sabrina Hoppe, Tobias Loetscher, Stephanie Morey, Andreas Bulling

    Frontiers in Human Neuroscience, 12, pp. 1–8, 2018.

    Abstract Links BibTeX Project

  2. CueAuth: Comparing Touch, Mid-Air Gestures, and Gaze for Cue-based Authentication on Situated Displays

    CueAuth: Comparing Touch, Mid-Air Gestures, and Gaze for Cue-based Authentication on Situated Displays

    Mohamed Khamis, Ludwig Trotter, Ville Mäkelä, Emanuel Zezschwitz, Jens Le, Andreas Bulling, Florian Alt

    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2 (7), pp. 1–22, 2018.

    Abstract Links BibTeX Project

  3. GazeDirector: Fully Articulated Eye Gaze Redirection in Video

    GazeDirector: Fully Articulated Eye Gaze Redirection in Video

    Erroll Wood, Tadas Baltrušaitis, Louis-Philippe Morency, Peter Robinson, Andreas Bulling

    Computer Graphics Forum (CGF), 37 (2), pp. 217-225, 2018.

    Abstract Links BibTeX Project Best Paper Honourable Mention Award

Conference Papers

  1. Error-Aware Gaze-Based Interfaces for Robust Mobile Gaze Interaction

    Error-Aware Gaze-Based Interfaces for Robust Mobile Gaze Interaction

    Michael Barz, Florian Daiber, Daniel Sonntag, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–10, 2018.

    Abstract Links BibTeX Project Best Paper Award

  2. A novel approach to single camera, glint-free 3D eye model fitting including corneal refraction

    A novel approach to single camera, glint-free 3D eye model fitting including corneal refraction

    Kai Dierkes, Moritz Kassner, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–9, 2018.

    Abstract Links BibTeX Project

  3. Towards a Symbiotic Human-Machine Depth Sensor: Exploring 3D Gaze for Object Reconstruction

    Towards a Symbiotic Human-Machine Depth Sensor: Exploring 3D Gaze for Object Reconstruction

    Teresa Hirzle, Jan Gugenheimer, Florian Geiselhart, Andreas Bulling, Enrico Rukzio

    Adj. Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 114-116, 2018.

    Abstract Links BibTeX Project

  4. Understanding Face and Eye Visibility in Front-Facing Cameras of Smartphones used in the Wild

    Understanding Face and Eye Visibility in Front-Facing Cameras of Smartphones used in the Wild

    Mohamed Khamis, Anita Baier, Niels Henze, Florian Alt, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–12, 2018.

    Abstract Links BibTeX Project

  5. Which one is me? Identifying Oneself on Public Displays

    Which one is me? Identifying Oneself on Public Displays

    Mohamed Khamis, Christian Becker, Andreas Bulling, Florian Alt

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–12, 2018.

    Abstract Links BibTeX Project Best Paper Honourable Mention Award

  6. VRPursuits: Interaction in Virtual Reality using Smooth Pursuit Eye Movements

    VRPursuits: Interaction in Virtual Reality using Smooth Pursuit Eye Movements

    Mohamed Khamis, Carl Oechsner, Florian Alt, Andreas Bulling

    Proc. International Conference on Advanced Visual Interfaces (AVI), pp. 1–8, 2018.

    Abstract Links BibTeX Project

  7. The Past, Present, and Future of Gaze-enabled Handheld Mobile Devices: Survey and Lessons Learned

    The Past, Present, and Future of Gaze-enabled Handheld Mobile Devices: Survey and Lessons Learned

    Mohamed Khamis, Florian Alt, Andreas Bulling

    Proc. ACM International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI), pp. 1–17, 2018.

    Abstract Links BibTeX Project Best Paper Honourable Mention Award

  8. GazeDrone: Mobile Eye-Based Interaction in Public Space Without Augmenting the User

    GazeDrone: Mobile Eye-Based Interaction in Public Space Without Augmenting the User

    Mohamed Khamis, Anna Kienle, Florian Alt, Andreas Bulling

    Proc. ACM Workshop on Micro Aerial Vehicle Networks, Systems, and Applications (DroNet), pp. 66-71, 2018.

    Abstract Links BibTeX Project

  9. A Multimodal Corpus of Expert Gaze and Behavior during Phonetic Segmentation Tasks

    A Multimodal Corpus of Expert Gaze and Behavior during Phonetic Segmentation Tasks

    Arif Khan, Ingmar Steiner, Yusuke Sugano, Andreas Bulling, Ross Macdonald

    Proc. Language Resources and Evaluation Conference (LREC), pp. 4277–4281, 2018.

    Abstract Links BibTeX Project

  10. Hidden Pursuits: Evaluating Gaze-selection via Pursuits when the Stimulus Trajectory is Partially Hidden

    Hidden Pursuits: Evaluating Gaze-selection via Pursuits when the Stimulus Trajectory is Partially Hidden

    Thomas Mattusch, Mahsa Mirzamohammad, Mohamed Khamis, Andreas Bulling, Florian Alt

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–5, 2018.

    Abstract Links BibTeX Project

  11. Detecting Low Rapport During Natural Interactions in Small Groups from Non-Verbal Behavior

    Detecting Low Rapport During Natural Interactions in Small Groups from Non-Verbal Behavior

    Philipp Müller, Michael Xuelin Huang, Andreas Bulling

    Proc. ACM International Conference on Intelligent User Interfaces (IUI), pp. 153-164, 2018.

    Abstract Links BibTeX Project

  12. Robust Eye Contact Detection in Natural Multi-Person Interactions Using Gaze and Speaking Behaviour

    Robust Eye Contact Detection in Natural Multi-Person Interactions Using Gaze and Speaking Behaviour

    Philipp Müller, Michael Xuelin Huang, Xucong Zhang, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–10, 2018.

    Abstract Links BibTeX Project

  13. Learning to Find Eye Region Landmarks for Remote Gaze Estimation in Unconstrained Settings

    Learning to Find Eye Region Landmarks for Remote Gaze Estimation in Unconstrained Settings

    Seonwook Park, Xucong Zhang, Andreas Bulling, Otmar Hilliges

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–10, 2018.

    Abstract Links BibTeX Project Best Presentation Award

  14. Fixation Detection for Head-Mounted Eye Tracking Based on Visual Similarity of Gaze Targets

    Fixation Detection for Head-Mounted Eye Tracking Based on Visual Similarity of Gaze Targets

    Julian Steil, Michael Xuelin Huang, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–9, 2018.

    Abstract Links BibTeX Project

  15. Forecasting User Attention During Everyday Mobile Interactions Using Device-Integrated and Wearable Sensors

    Forecasting User Attention During Everyday Mobile Interactions Using Device-Integrated and Wearable Sensors

    Julian Steil, Philipp Müller, Yusuke Sugano, Andreas Bulling

    Proc. ACM International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI), pp. 1–13, 2018.

    Abstract Links BibTeX Project Best Paper Award

  16. Training Person-Specific Gaze Estimators from Interactions with Multiple Devices

    Training Person-Specific Gaze Estimators from Interactions with Multiple Devices

    Xucong Zhang, Michael Xuelin Huang, Yusuke Sugano, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1–12, 2018.

    Abstract Links BibTeX Project

  17. Revisiting Data Normalization for Appearance-Based Gaze Estimation

    Revisiting Data Normalization for Appearance-Based Gaze Estimation

    Xucong Zhang, Yusuke Sugano, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 1–9, 2018.

    Abstract Links BibTeX Project

Technical Reports

  1. Privacy-Aware Eye Tracking Using Differential Privacy

    Privacy-Aware Eye Tracking Using Differential Privacy

    Julian Steil, Inken Hagestedt, Michael Xuelin Huang, Andreas Bulling

    arXiv:1812.08000, pp. 1–22, 2018.

    Abstract Links BibTeX Project

  2. PrivacEye: Privacy-Preserving First-Person Vision Using Image Features and Eye Movement Analysis

    PrivacEye: Privacy-Preserving First-Person Vision Using Image Features and Eye Movement Analysis

    Julian Steil, Marion Koelle, Wilko Heuten, Susanne Boll, Andreas Bulling

    arXiv:1801.04457, pp. 1–14, 2018.

    Abstract Links BibTeX Project

2017

Journal Articles

  1. EyePACT: Eye-Based Parallax Correction on Touch-Enabled Interactive Displays

    EyePACT: Eye-Based Parallax Correction on Touch-Enabled Interactive Displays

    Mohamed Khamis, Daniel Buschek, Tobias Thieron, Florian Alt, Andreas Bulling

    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 1 (4), pp. 1–18, 2017.

    Abstract Links BibTeX Project

  2. InvisibleEye: Mobile Eye Tracking Using Multiple Low-Resolution Cameras and Learning-Based Gaze Estimation

    InvisibleEye: Mobile Eye Tracking Using Multiple Low-Resolution Cameras and Learning-Based Gaze Estimation

    Marc Tonsen, Julian Steil, Yusuke Sugano, Andreas Bulling

    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 1 (3), pp. 1–21, 2017.

    Abstract Links BibTeX Project Distinguished Paper Award

  3. Look together: using gaze for assisting co-located collaborative search

    Look together: using gaze for assisting co-located collaborative search

    Yanxia Zhang, Ken Pfeuffer, Ming Ki Chong, Jason Alexander, Andreas Bulling, Hans Gellersen

    Personal and Ubiquitous Computing, 21 (1), pp. 173-186, 2017.

    Abstract Links BibTeX Project

Conference Papers

  1. Gaze Embeddings for Zero-Shot Image Classification

    Gaze Embeddings for Zero-Shot Image Classification

    Nour Karessli, Zeynep Akata, Bernt Schiele, Andreas Bulling

    Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6412-6421, 2017.

    Abstract Links BibTeX Project Spotlight Presentation

  2. GTmoPass: Two-factor Authentication on Public Displays Using GazeTouch passwords and Personal Mobile Devices

    GTmoPass: Two-factor Authentication on Public Displays Using GazeTouch passwords and Personal Mobile Devices

    Mohamed Khamis, Regina Hasholzner, Andreas Bulling, Florian Alt

    Proc. ACM International Symposium on Pervasive Displays (PerDis), pp. 1–9, 2017.

    Abstract Links BibTeX Project

  3. EyeScout: Active Eye Tracking for Position and Movement Independent Gaze Interaction with Large Public Displays

    EyeScout: Active Eye Tracking for Position and Movement Independent Gaze Interaction with Large Public Displays

    Mohamed Khamis, Axel Hoesl, Alexander Klimczak, Martin Reiss, Florian Alt, Andreas Bulling

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 155-166, 2017.

    Abstract Links BibTeX Project

  4. GazeTouchPIN: Protecting Sensitive Data on Mobile Devices using Secure Multimodal Authentication

    GazeTouchPIN: Protecting Sensitive Data on Mobile Devices using Secure Multimodal Authentication

    Mohamed Khamis, Mariam Hassib, Emanuel Zezschwitz, Andreas Bulling, Florian Alt

    Proc. ACM International Conference on Multimodal Interaction (ICMI), pp. 446-450, 2017.

    Abstract Links BibTeX Project

  5. They are all after you: Investigating the Viability of a Threat Model that involves Multiple Shoulder Surfers

    They are all after you: Investigating the Viability of a Threat Model that involves Multiple Shoulder Surfers

    Mohamed Khamis, Linda Bandelow, Stina Schick, Dario Casadevall, Andreas Bulling, Florian Alt

    Proc. International Conference on Mobile and Ubiquitous Multimedia (MUM), pp. 1–5, 2017.

    Abstract Links BibTeX Project Best Paper Honourable Mention Award

  6. Noticeable or Distractive? A Design Space for Gaze-Contingent User Interface Notifications

    Noticeable or Distractive? A Design Space for Gaze-Contingent User Interface Notifications

    Michaela Klauck, Yusuke Sugano, Andreas Bulling

    Ext. Abstr. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1779-1786, 2017.

    Abstract Links BibTeX Project

  7. EyeMirror: Mobile Calibration-Free Gaze Approximation using Corneal Imaging

    EyeMirror: Mobile Calibration-Free Gaze Approximation using Corneal Imaging

    Christian Lander, Sven Gehring, Markus Löchtefeld, Andreas Bulling, Antonio Krüger

    Proc. International Conference on Mobile and Ubiquitous Multimedia (MUM), pp. 1–13, 2017.

    Abstract Links BibTeX Project

  8. Predicting the Category and Attributes of Visual Search Targets Using Deep Gaze Pooling

    Predicting the Category and Attributes of Visual Search Targets Using Deep Gaze Pooling

    Hosnieh Sattar, Andreas Bulling, Mario Fritz

    Proc. IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 2740-2748, 2017.

    Abstract Links BibTeX Project

  9. It’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation

    It’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation

    Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling

    Proc. IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 2299-2308, 2017.

    Abstract Links BibTeX Project

  10. Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery

    Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery

    Xucong Zhang, Yusuke Sugano, Andreas Bulling

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 193-203, 2017.

    Abstract Links BibTeX Project Best Paper Honourable Mention Award

Technical Reports

  1. A Multimodal Corpus of Expert Gaze and Behavior during Phonetic Segmentation Tasks

    A Multimodal Corpus of Expert Gaze and Behavior during Phonetic Segmentation Tasks

    Arif Khan, Ingmar Steiner, Yusuke Sugano, Andreas Bulling, Ross Macdonald

    arXiv:1712.04798, pp. 1–4, 2017.

    Abstract Links BibTeX Project

  2. Visual Decoding of Targets During Visual Search From Human Eye Fixations

    Visual Decoding of Targets During Visual Search From Human Eye Fixations

    Hosnieh Sattar, Mario Fritz, Andreas Bulling

    arXiv:1706.05993, pp. 1–9, 2017.

    Abstract Links BibTeX Project

  3. GazeDirector: Fully Articulated Eye Gaze Redirection in Video

    GazeDirector: Fully Articulated Eye Gaze Redirection in Video

    Erroll Wood, Tadas Baltrušaitis, Louis-Philippe Morency, Peter Robinson, Andreas Bulling

    arXiv:1704.08763, pp. 1–10, 2017.

    Abstract Links BibTeX Project

  4. MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation

    MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation

    Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling

    arXiv:1711.09017, pp. 1–14, 2017.

    Abstract Links BibTeX Project

2016

Journal Articles

  1. Pervasive Attentive User Interfaces

    Pervasive Attentive User Interfaces

    Andreas Bulling

    IEEE Computer, 49 (1), pp. 94-98, 2016.

    Abstract Links BibTeX Project

  2. EyeWear Computers for Human-Computer Interaction

    EyeWear Computers for Human-Computer Interaction

    Andreas Bulling, Kai Kunze

    ACM Interactions, 23 (3), pp. 70-73, 2016.

    Abstract Links BibTeX Project

  3. Eyewear Computing – Augmenting the Human with Head-mounted Wearable Assistants (Dagstuhl Seminar 16042)

    Eyewear Computing – Augmenting the Human with Head-mounted Wearable Assistants (Dagstuhl Seminar 16042)

    Andreas Bulling, Ozan Cakmakci, Kai Kunze, James M. Rehg

    Dagstuhl Reports, 6 (1), pp. 160–206, 2016.

    Links BibTeX Project

  4. Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art

    Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art

    Wolfgang Fuhl, Marc Tonsen, Andreas Bulling, Enkelejda Kasneci

    Springer Machine Vision and Applications, 27, pp. 1275-1288, 2016.

    Abstract Links BibTeX Project

Conference Papers

  1. Attention, please! Comparing Features for Measuring Audience Attention Towards Pervasive Displays

    Attention, please! Comparing Features for Measuring Audience Attention Towards Pervasive Displays

    Florian Alt, Andreas Bulling, Lukas Mecke, Daniel Buschek

    Proc. ACM SIGCHI Conference on Designing Interactive Systems (DIS), pp. 823-828, 2016.

    Abstract Links BibTeX Project

  2. Memorability of Cued-Recall Graphical Passwords with Saliency Masks

    Memorability of Cued-Recall Graphical Passwords with Saliency Masks

    Florian Alt, Mateusz Mikusz, Stefan Schneegass, Andreas Bulling

    Proc. International Conference on Mobile and Ubiquitous Multimedia (MUM), pp. 191-200, 2016.

    Abstract Links BibTeX Project

  3. Prediction of Gaze Estimation Error for Error-Aware Gaze-Based Interfaces

    Prediction of Gaze Estimation Error for Error-Aware Gaze-Based Interfaces

    Michael Barz, Florian Daiber, Andreas Bulling

    Proc. International ACM Symposium on Eye Tracking Research and Applications (ETRA), pp. 275-278, 2016.

    Abstract Links BibTeX Project

  4. Xplore-M-Ego: Contextual Media Retrieval Using Natural Language Queries

    Xplore-M-Ego: Contextual Media Retrieval Using Natural Language Queries

    Sreyasi Nag Chowdhury, Mateusz Malinowski, Andreas Bulling, Mario Fritz

    Proc. ACM International Conference on Multimedia Retrieval (ICMR), pp. 243-247, 2016.

    Abstract Links BibTeX Project

  5. Smooth Eye Movement Interaction Using EOG Glasses

    Smooth Eye Movement Interaction Using EOG Glasses

    Murtaza Dhuliawala, Juyoung Lee, Junichi Shimizu, Andreas Bulling, Kai Kunze, Thad Starner, Woontack Woo

    Proc. ACM International Conference on Multimodal Interaction (ICMI), pp. 307-311, 2016.

    Abstract Links BibTeX Project

  6. GazeTouchPass: Multimodal Authentication Using Gaze and Touch on Mobile Devices

    GazeTouchPass: Multimodal Authentication Using Gaze and Touch on Mobile Devices

    Mohamed Khamis, Florian Alt, Mariam Hassib, Emanuel Zezschwitz, Regina Hasholzner, Andreas Bulling

    Ext. Abstr. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 2156-2164, 2016.

    Abstract Links BibTeX Project

  7. TextPursuits: Using Text for Pursuits-Based Interaction and Calibration on Public Displays

    TextPursuits: Using Text for Pursuits-Based Interaction and Calibration on Public Displays

    Mohamed Khamis, Ozan Saltuk, Alina Hang, Katharina Stolz, Andreas Bulling, Florian Alt

    Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 274-285, 2016.

    Abstract Links BibTeX Project

  8. Challenges and Design Space of Gaze-enabled Public Displays

    Challenges and Design Space of Gaze-enabled Public Displays

    Mohamed Khamis, Florian Alt, Andreas Bulling

    Adj. Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 1736-1745, 2016.

    Abstract Links BibTeX Project

  9. EyeVote in the Wild: Do Users bother Correcting System Errors on Public Displays?

    EyeVote in the Wild: Do Users bother Correcting System Errors on Public Displays?

    Mohamed Khamis, Ludwig Trotter, Markus Tessman, Christina Dannhart, Andreas Bulling, Florian Alt

    Proc. International Conference on Mobile and Ubiquitous Multimedia (MUM), pp. 57-62, 2016.

    Abstract Links BibTeX Project

  10. On the Verge: Voluntary Convergences for Accurate and Precise Timing of Gaze Input

    On the Verge: Voluntary Convergences for Accurate and Precise Timing of Gaze Input

    Dominik Kirst, Andreas Bulling

    Ext. Abstr. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1519-1525, 2016.

    Abstract Links BibTeX Project

  11. 3D Gaze Estimation from 2D Pupil Positions on Monocular Head-Mounted Eye Trackers

    3D Gaze Estimation from 2D Pupil Positions on Monocular Head-Mounted Eye Trackers

    Mohsen Mansouryar, Julian Steil, Yusuke Sugano, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 197-200, 2016.

    Abstract Links BibTeX Project

  12. Concept for Using Eye Tracking in a Head-mounted Display to Adapt Rendering to the User’s Current Visual Field

    Concept for Using Eye Tracking in a Head-mounted Display to Adapt Rendering to the User’s Current Visual Field

    Daniel Pohl, Xucong Zhang, Andreas Bulling, Oliver Grau

    Proc. of the 22nd ACM Conference on Virtual Reality Software and Technology (VRST), pp. 323-324, 2016.

    Abstract Links BibTeX Project

  13. Combining Eye Tracking with Optimizations for Lens Astigmatism in Modern Wide-Angle HMDs

    Combining Eye Tracking with Optimizations for Lens Astigmatism in Modern Wide-Angle HMDs

    Daniel Pohl, Xucong Zhang, Andreas Bulling

    Proc. IEEE Virtual Reality (VR), pp. 269-270, 2016.

    Abstract Links BibTeX Project

  14. SkullConduct: Biometric User Identification on Eyewear Computers Using Bone Conduction Through the Skull

    SkullConduct: Biometric User Identification on Eyewear Computers Using Bone Conduction Through the Skull

    Stefan Schneegass, Youssef Oualil, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 1379-1384, 2016.

    Abstract Links BibTeX Project

  15. Gaussian Processes as an Alternative to Polynomial Gaze Estimation Functions

    Gaussian Processes as an Alternative to Polynomial Gaze Estimation Functions

    Laura Sesma-Sanchez, Yanxia Zhang, Andreas Bulling, Hans Gellersen

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 229-232, 2016.

    Abstract Links BibTeX Project

  16. Solar System: Smooth Pursuit Interactions Using EOG Glasses

    Solar System: Smooth Pursuit Interactions Using EOG Glasses

    Junichi Shimizu, Juyoung Lee, Murtaza Dhuliawala, Andreas Bulling, Thad Starner, Woontack Woo, Kai Kunze

    Adj. Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 369-372, 2016.

    Abstract Links BibTeX Project

  17. Three-Point Interaction: Combining Bi-manual Direct Touch with Gaze

    Three-Point Interaction: Combining Bi-manual Direct Touch with Gaze

    Adalberto Simeone, Andreas Bulling, Jason Alexander, Hans Gellersen

    Proc. International Conference on Advanced Visual Interfaces (AVI), pp. 168-175, 2016.

    Abstract Links BibTeX Project

  18. AggreGaze: Collective Estimation of Audience Attention on Public Displays

    AggreGaze: Collective Estimation of Audience Attention on Public Displays

    Yusuke Sugano, Xucong Zhang, Andreas Bulling

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 821-831, 2016.

    Abstract Links BibTeX Project Best Paper Honourable Mention Award

  19. Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environments

    Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environments

    Marc Tonsen, Xucong Zhang, Yusuke Sugano, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 139-142, 2016.

    Abstract Links BibTeX Project

  20. Learning an appearance-based gaze estimator from one million synthesised images

    Learning an appearance-based gaze estimator from one million synthesised images

    Erroll Wood, Tadas Baltrušaitis, Louis-Philippe Morency, Peter Robinson, Andreas Bulling

    Proc. ACM International Symposium on Eye Tracking Research and Applications (ETRA), pp. 131–138, 2016.

    Abstract Links BibTeX Project Emerging Investigator Award

  21. A 3D Morphable Eye Region Model for Gaze Estimation

    A 3D Morphable Eye Region Model for Gaze Estimation

    Erroll Wood, Tadas Baltrušaitis, Louis-Philippe Morency, Peter Robinson, Andreas Bulling

    Proc. European Conference on Computer Vision (ECCV), pp. 297-313, 2016.

    Abstract Links BibTeX Project

  22. Spatio-Temporal Modeling and Prediction of Visual Attention in Graphical User Interfaces

    Spatio-Temporal Modeling and Prediction of Visual Attention in Graphical User Interfaces

    Pingmei Xu, Yusuke Sugano, Andreas Bulling

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 3299-3310, 2016.

    Abstract Links BibTeX Project Best Paper Honourable Mention Award

Book Chapters

  1. Proc. 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp)

    Paul Lukowicz, Antonio Krüger, Andreas Bulling, Youn-Kyung Lim, Shwetak N. Patel

    Heidelberg, Germany, ACM, 2016.

    Links BibTeX Project

Technical Reports

  1. Computational Modelling and Prediction of Gaze Estimation Error for Head-mounted Eye Trackers

    Computational Modelling and Prediction of Gaze Estimation Error for Head-mounted Eye Trackers

    Michael Barz, Andreas Bulling, Florian Daiber

    DFKI Research Reports, pp. 1–6, 2016.

    Abstract Links BibTeX Project

  2. Contextual Media Retrieval Using Natural Language Queries

    Contextual Media Retrieval Using Natural Language Queries

    Sreyasi Nag Chowdhury, Mateusz Malinowski, Andreas Bulling, Mario Fritz

    arXiv:1602.04983, pp. 1–8, 2016.

    Abstract Links BibTeX Project

  3. End-to-End Eye Movement Detection Using Convolutional Neural Networks

    End-to-End Eye Movement Detection Using Convolutional Neural Networks

    Sabrina Hoppe, Andreas Bulling

    arXiv:1609.02452, pp. 1–15, 2016.

    Abstract Links BibTeX Project

  4. Gaze Embeddings for Zero-Shot Image Classification

    Gaze Embeddings for Zero-Shot Image Classification

    Nour Karessli, Zeynep Akata, Bernt Schiele, Andreas Bulling

    arXiv:1611.09309, pp. 1–10, 2016.

    Abstract Links BibTeX Project

  5. 3D Gaze Estimation from 2D Pupil Positions on Monocular Head-Mounted Eye Trackers

    3D Gaze Estimation from 2D Pupil Positions on Monocular Head-Mounted Eye Trackers

    Mohsen Mansouryar, Julian Steil, Yusuke Sugano, Andreas Bulling

    arXiv:1601.02644, pp. 1–6, 2016.

    Abstract Links BibTeX Project

  6. Predicting the Category and Attributes of Mental Pictures Using Deep Gaze Pooling

    Predicting the Category and Attributes of Mental Pictures Using Deep Gaze Pooling

    Hosnieh Sattar, Andreas Bulling, Mario Fritz

    arXiv:1611.10162, pp. 1–14, 2016.

    Abstract Links BibTeX Project

  7. Seeing with Humans: Gaze-Assisted Neural Image Captioning

    Seeing with Humans: Gaze-Assisted Neural Image Captioning

    Yusuke Sugano, Andreas Bulling

    arXiv:1608.05203, pp. 1–8, 2016.

    Abstract Links BibTeX Project

  8. It’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation

    It’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation

    Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling

    arXiv:1611.08860, pp. 1–10, 2016.

    Abstract Links BibTeX Project

2015

Journal Articles

  1. Introduction to the Special Issue on Activity Recognition for Interaction

    Introduction to the Special Issue on Activity Recognition for Interaction

    Andreas Bulling, Ulf Blanke, Desney Tan, Jun Rekimoto, Gregory Abowd

    ACM Transactions on Interactive Intelligent Systems (TiiS), 4 (16e), pp. 1–3, 2015.

    Abstract Links BibTeX Project

  2. A study on the natural history of scanning behaviour in patients with visual field defects after stroke

    A study on the natural history of scanning behaviour in patients with visual field defects after stroke

    Tobias Loetscher, Celia Chen, Sophie Wignall, Andreas Bulling, Sabrina Hoppe, Owen Churches, Nicole Thomas

    BMC Neurology, 15 (64), pp. 1–4, 2015.

    Abstract Links BibTeX Project

  3. Walking reduces spatial neglect

    Walking reduces spatial neglect

    Tobias Loetscher, Celia Chen, Sabrina Hoppe, Andreas Bulling, Sophie Wignall, Churches Owen, Nicole Thomas, Andrew Lee

    , 21 (S2), pp. 120-121, 2015.

    Abstract Links BibTeX Project

  4. The Feet in HCI: A Survey of Foot-Based Interaction

    The Feet in HCI: A Survey of Foot-Based Interaction

    Eduardo Velloso, Dominik Schmidt, Jayson Alexander, Hans Gellersen, Andreas Bulling

    ACM Computing Surveys, 48 (2), pp. 1–36, 2015.

    Abstract Links BibTeX Project

  5. Pursuits: Spontaneous Eye-Based Interaction for Dynamic Interfaces

    Pursuits: Spontaneous Eye-Based Interaction for Dynamic Interfaces

    Mélodie Vidal, Andreas Bulling, Hans Gellersen

    ACM SIGMOBILE Mobile Computing and Communications Review, 18 (4), pp. 8-10, 2015.

    Abstract Links BibTeX Project

  6. Eye tracking for public displays in the wild

    Eye tracking for public displays in the wild

    Yanxia Zhang, Ming Ki Chong, Jörg Müller, Andreas Bulling, Hans Gellersen

    Springer Personal and Ubiquitous Computing, 19 (5), pp. 967-981, 2015.

    Abstract Links BibTeX Project

Conference Papers

  1. GravitySpot: Guiding Users in Front of Public Displays Using On-Screen Visual Cues

    GravitySpot: Guiding Users in Front of Public Displays Using On-Screen Visual Cues

    Florian Alt, Andreas Bulling, Gino Gravanis, Daniel Buschek

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 47-56, 2015.

    Abstract Links BibTeX Project

  2. Graphical Passwords in the Wild – Understanding How Users Choose Pictures and Passwords in Image-based Authentication Schemes

    Graphical Passwords in the Wild – Understanding How Users Choose Pictures and Passwords in Image-based Authentication Schemes

    Florian Alt, Stefan Schneegass, Alireza Sahami, Mariam Hassib, Andreas Bulling

    Proc. ACM International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI), pp. 316-322, 2015.

    Abstract Links BibTeX Project

  3. Human Visual Behaviour for Collaborative Human-Machine Interaction

    Human Visual Behaviour for Collaborative Human-Machine Interaction

    Andreas Bulling

    Adj. Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 903-907, 2015.

    Abstract Links BibTeX Project

  4. Orbits: Enabling Gaze Interaction in Smart Watches using Moving Targets

    Orbits: Enabling Gaze Interaction in Smart Watches using Moving Targets

    Augusto Esteves, Eduardo Velloso, Andreas Bulling, Hans Gellersen

    Adj. Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 419-422, 2015.

    Abstract Links BibTeX Project

  5. Orbits: Enabling Gaze Interaction in Smart Watches using Moving Targets

    Orbits: Enabling Gaze Interaction in Smart Watches using Moving Targets

    Augusto Esteves, Eduardo Velloso, Andreas Bulling, Hans Gellersen

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 457-466, 2015.

    Abstract Links BibTeX Project Best Paper Award

  6. Recognition of Curiosity Using Eye Movement Analysis

    Recognition of Curiosity Using Eye Movement Analysis

    Sabrina Hoppe, Tobias Loetscher, Stephanie Morey, Andreas Bulling

    Adj. Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 185-188, 2015.

    Abstract Links BibTeX Project

  7. Tackling Challenges of Interactive Public Displays using Gaze

    Tackling Challenges of Interactive Public Displays using Gaze

    Mohamed Khamis, Andreas Bulling, Florian Alt

    Adj. Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 763-766, 2015.

    Abstract Links BibTeX Project

  8. A Field Study on Spontaneous Gaze-based Interaction with a Public Display using Pursuits

    A Field Study on Spontaneous Gaze-based Interaction with a Public Display using Pursuits

    Mohamed Khamis, Florian Alt, Andreas Bulling

    Adj. Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 865-874, 2015.

    Abstract Links BibTeX Project

  9. Scene viewing and gaze analysis during phonetic segmentation tasks

    Scene viewing and gaze analysis during phonetic segmentation tasks

    Arif Khan, Ingmar Steiner, Ross Macdonald, Yusuke Sugano, Andreas Bulling

    Proc. European Conference on Eye Movements (ECEM), pp. 1–2, 2015.

    Links BibTeX Project

  10. On the interplay between spontaneous spoken instructions and human visual behaviour in an indoor guidance task

    On the interplay between spontaneous spoken instructions and human visual behaviour in an indoor guidance task

    Nikolina Koleva, Sabrina Hoppe, Mohammed Mehdi Moniri, Maria Staudte, Andreas Bulling

    Proc. Annual Meeting of the Cognitive Science Society (CogSci), pp. 1–6, 2015.

    Abstract Links BibTeX Project

  11. GazeProjector: Accurate Gaze Estimation and Seamless Gaze Interaction Across Multiple Displays

    GazeProjector: Accurate Gaze Estimation and Seamless Gaze Interaction Across Multiple Displays

    Christian Lander, Sven Gehring, Antonio Krüger, Sebastian Boring, Andreas Bulling

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 395-404, 2015.

    Abstract Links BibTeX Project

  12. Emotion recognition from embedded bodily expressions and speech during dyadic interactions

    Emotion recognition from embedded bodily expressions and speech during dyadic interactions

    Philipp Müller, Sikandar Amin, Prateek Verma, Mykhaylo Andriluka, Andreas Bulling

    Proc. International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 663-669, 2015.

    Abstract Links BibTeX Project

  13. Prediction of Search Targets From Fixations in Open-world Settings

    Prediction of Search Targets From Fixations in Open-world Settings

    Hosnieh Sattar, Sabine Müller, Mario Fritz, Andreas Bulling

    Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 981-990, 2015.

    Abstract Links BibTeX Project

  14. Discovery of Everyday Human Activities From Long-term Visual Behaviour Using Topic Models

    Discovery of Everyday Human Activities From Long-term Visual Behaviour Using Topic Models

    Julian Steil, Andreas Bulling

    Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 75-85, 2015.

    Abstract Links BibTeX Project

  15. Self-Calibrating Head-Mounted Eye Trackers Using Egocentric Visual Saliency

    Self-Calibrating Head-Mounted Eye Trackers Using Egocentric Visual Saliency

    Yusuke Sugano, Andreas Bulling

    Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 363-372, 2015.

    Abstract Links BibTeX Project

  16. Gaze+RST: Integrating Gaze and Multitouch for Remote Rotate-Scale-Translate Tasks

    Gaze+RST: Integrating Gaze and Multitouch for Remote Rotate-Scale-Translate Tasks

    Jayson Turner, Jason Alexander, Andreas Bulling, Hans Gellersen

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 4179-4188, 2015.

    Abstract Links BibTeX Project

  17. An Empirical Investigation of Gaze Selection in Mid-Air Gestural 3D Manipulation

    An Empirical Investigation of Gaze Selection in Mid-Air Gestural 3D Manipulation

    Eduardo Velloso, Jayson Turner, Jason Alexander, Andreas Bulling, Hans Gellersen

    Proc. IFIP TC13 Conference on Human-Computer Interaction (INTERACT), pp. 315-330, 2015.

    Abstract Links BibTeX Project

  18. Interactions Under the Desk: A Characterisation of Foot Movements for Input in a Seated Position

    Interactions Under the Desk: A Characterisation of Foot Movements for Input in a Seated Position

    Eduardo Velloso, Jason Alexander, Andreas Bulling, Hans Gellersen

    Proc. IFIP TC13 Conference on Human-Computer Interaction (INTERACT), pp. 384-401, 2015.

    Abstract Links BibTeX Project

  19. The Royal Corgi: Exploring Social Gaze Interaction for Immersive Gameplay

    The Royal Corgi: Exploring Social Gaze Interaction for Immersive Gameplay

    Mélodie Vidal, Remi Bismuth, Andreas Bulling, Hans Gellersen

    Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), pp. 115-124, 2015.

    Abstract Links BibTeX Project

  20. Analyzing Visual Attention During Whole Body Interaction with Public Displays

    Analyzing Visual Attention During Whole Body Interaction with Public Displays

    Robert Walter, Andreas Bulling, David Lindlbauer, Martin Schüssler, Hans Jörg Müller

    Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 1263-1267, 2015.

    Abstract Links BibTeX Project

  21. Rendering of Eyes for Eye-Shape Registration and Gaze Estimation

    Rendering of Eyes for Eye-Shape Registration and Gaze Estimation

    Erroll Wood, Tadas Baltrušaitis, Xucong Zhang, Yusuke Sugano, Peter Robinson, Andreas Bulling

    Proc. IEEE International Conference on Computer Vision (ICCV), pp. 3756-3764, 2015.

    Abstract Links BibTeX Project

  22. Appearance-based Gaze Estimation in the Wild

    Appearance-based Gaze Estimation in the Wild

    Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling

    Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4511-4520, 2015.

    Abstract Links BibTeX Project

Book Chapters

  1. Proc. International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction (PETMEI)

    Proc. International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction (PETMEI)

    Peter Kiefer, Yanxia Zhang, Andreas Bulling

    Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 825–828, 2015.

    Abstract Links BibTeX Project

Technical Reports

  1. GazeProjector: Location-independent gaze interaction on and across multiple displays

    GazeProjector: Location-independent gaze interaction on and across multiple displays

    Christian Lander, Sven Gehring, Antonio Krüger, Sebastian Boring, Andreas Bulling

    DFKI Research Reports, pp. 1–10, 2015.

    Abstract Links BibTeX Project

  2. Prediction of Search Targets From Fixations in Open-world Settings

    Prediction of Search Targets From Fixations in Open-world Settings

    Hosnieh Sattar, Sabine Müller, Mario Fritz, Andreas Bulling

    arXiv:1502.05137, pp. 1–10, 2015.

    Abstract Links BibTeX Project

  3. GazeDPM: Early Integration of Gaze Information in Deformable Part Models

    GazeDPM: Early Integration of Gaze Information in Deformable Part Models

    Iaroslav Shcherbatyi, Andreas Bulling, Mario Fritz

    arXiv:1505.05753, pp. 1–14, 2015.

    Abstract Links BibTeX Project

  4. Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environments

    Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environments

    Marc Tonsen, Xucong Zhang, Yusuke Sugano, Andreas Bulling

    arXiv:1511.05768, pp. 1–4, 2015.

    Abstract Links BibTeX Project

  5. Rendering of Eyes for Eye-Shape Registration and Gaze Estimation

    Rendering of Eyes for Eye-Shape Registration and Gaze Estimation

    Erroll Wood, Tadas Baltrušaitis, Xucong Zhang, Yusuke Sugano, Peter Robinson, Andreas Bulling

    arXiv:1505.05916, pp. 1–9, 2015.

    Abstract Links BibTeX Project

  6. Appearance-Based Gaze Estimation in the Wild

    Appearance-Based Gaze Estimation in the Wild

    Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling

    arXiv:1504.02863, pp. 1–10, 2015.

    Abstract Links BibTeX Project

2014

Journal Articles

  1. A Tutorial on Human Activity Recognition Using Body-worn Inertial Sensors

    A Tutorial on Human Activity Recognition Using Body-worn Inertial Sensors

    Andreas Bulling, Ulf Blanke, Bernt Schiele

    ACM Computing Surveys, 46 (3), pp. 1–33, 2014.

    Abstract Links BibTeX Project