Gaze-supported Remote Interaction

Description

An easy and efficient interaction with increasingly complex digital systems poses a central question for human-computer interaction. As digital systems become more and more ubiquituous, their shape, behavior, and handling differ significantly from traditional desktop workspace environments for which keyboard and mouse input devices and WIMP-interfaces have proved useful. In this respect, a trend goes towards large-sized wall displays, multitouch tables, and mobile input devices. More suitable interaction techniques (in terms of natural and yet efficient) for such diverse digital systems still need further investigation. In this respect, the consideration of a user’s visual perception poses a high potential for the interaction with large-sized displays (or multi-display environments), as it may reveal important hints about a user’s current visual attention. This enables a better and more directed information presentation at locations that are currently of interest to the user.

This project investigates the potential of gaze-supported interaction techniques in combination with additional input modalities for the interaction with remote (large-sized) displays. Particular challenges result from the collection and evaluation of precise gaze data in real-time for interaction purposes and an appropriate combination of input and output devices for a comfortable and efficient handling. In the scope of this project, we are particularly interested how such combinations may benefit from the consideration of a user’s visual attention as a secondary input channel.

 

Related publications

  • Vorschaubild
    Honorable Mention

    Honorable Mention

    Stellmach, S., Dachselt, R.:

    Look & Touch: Gaze-supported Target Acquisition

    To appear in Proceedings of the Conference on Human Factors in Computing Systems (CHI 2012) Austin, TX, USA, May 5-10, 2012.

  • Vorschaubild

    Stellmach, S., Dachselt, R.:

    Investigating Gaze-supported Multimodal Pan and Zoom

    Proceedings of the 2012 ACM Symposium on Eye-Tracking Research and Applications (ETRA 2012) (Santa Barbara, CA, USA, March 28-30, 2012).

    ETRA 2012, ACM, ISBN 978-1-4503-1221-9, pp. 357-360.

    Downloads: Short paper (914KB), Poster (4095KB), Video (28123KB)

  • Vorschaubild

    Stellmach, S., Dachselt, R.:

    Designing Gaze-based User Interfaces for Steering in Virtual Environments

    Proceedings of the 2012 ACM Symposium on Eye-Tracking Research and Applications (ETRA 2012) (Santa Barbara, CA, USA, March 28-30, 2012).

    ETRA 2012, ACM, ISBN 978-1-4503-1221-9, pp. 131-138.

    Downloads: Full paper (1185KB), Video (25619KB)

  • Vorschaubild
    Best Paper

    Best Paper

    Stellmach, S., Stober, S., Nürnberger, A., Dachselt, R.:

    Designing Gaze-supported Multimodal Interactions for the Exploration of Large Image Collections

    Proceedings of the 1st ACM Conference on Novel Gaze-Controlled Applications (NGCA 2011) Karlskrona, Sweden, May 26-27, 2011, pp. 1-8.

  • Vorschaubild

    Nacke, L., Stellmach, S., Sasse, D., Niesenhaus, J., Dachselt, R.:

    LAIF: A Logging and Interaction Framework for Gaze-Based Interfaces in Virtual Entertainment Environments

    Electronic Proceedings of the Interactive Cultures Conference 2010 (Duisburg, Germany, September 12-15, 2010).

    Interactive Cultures 2010, Oldenbourg Publishing, Munich, pp. 19 - 29.

    Downloads: Paper (1405KB)