Demonstration Video of Throw'n'Tilt on Vimeo.

Tilting along the x axis: down, neutral, up and along the y axis: left, right.

Tilting along the x axis: down, neutral, up and along the y axis: left, right.

Throw+Tilt Interaction: Throwing images to a large display and fetching them back.

Throw+Tilt Interaction: Throwing images to a large display and fetching them back.

Natural Throw and Tilt Interaction between Mobile Phones and Distant Displays

Abstract

To provide intuitive ways of interacting with media data, this research work addresses the seamless combination of sensor-enabled phones with large displays. An intuitive basic set of tilt gestures is introduced for a stepwise or continuous interaction with both mobile applications and distant user interfaces by utilizing the handheld as a remote control. In addition, we introduce throwing gestures to transfer media documents and even running interfaces to a large display. To improve usability, data and interfaces can be thrown from a mobile phone to a distant screen and also fetched back to achieve mobility. We demonstrate the feasibility of the interaction methods with several advanced application prototypes facilitating a natural flow of interaction.

Application Prototypes

Sample Application 1: Tilt Interaction: Using discrete tilt gestures to operate Mambo on a large screen.

Sample Application 1: Using discrete tilt gestures to operate Mambo on a large screen.

Remotely operating Google Earth. Tilt, zoom & pan mode using tilt gestures.

Sample Application 2: Remotely operating Google Earth. Tilt, zoom & pan mode using tilt gestures.

Remote Media Manager: Browsing various media using tilt gestures in different views: matrix view & coverflow view.

Sample Application 3: Remote Media Manager: Browsing various media using tilt gestures in different views: matrix view & coverflow view.

 

Related publications

  • Vorschaubild

    Dachselt, R., Buchholz, R.:

    Natural Throw and Tilt Interaction between Mobile Phones and Distant Displays

    CHI '09 Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, April 04-09, 2009).

    CHI '09, ACM, New York, NY.

    Downloads: Interactivity Paper (3647KB), Additional Poster (9127KB), Video (21903KB)

  • Vorschaubild

    Dachselt, R., Buchholz, R.:

    Throw and Tilt - Seamless Interaction across Devices Using Mobile Phone Gestures

    Proceedings of the 2nd Workshop on Mobile and Embedded Interactive Systems (Informatik 2008, Munich, Germany, September 11, 2008).

    MEIS'08, pp. 272-278.

    Downloads: Paper (2741KB)