Leveraging the Hand Surface as an Eyes-free TV Remote Control

User input on television typically requires a mediator device such as a handheld remote control. While being a well-established interaction paradigm, a handheld device has serious drawbacks: it can be easily misplaced due to its mobility and in case of a touch screen interface, it also requires additional visual attention. Emerging interaction paradigms like 3D mid-air gestures using novel depth sensors such as Microsoft's Kinect aim at overcoming these limitations, but are known to for instance be tiring. In this work, we propose to leverage the hand as an interactive surface for TV remote control. Our contribution is two- fold: (1) How precisely can people touch their hand landmarks without looking at them? (2) How effectively can they map the on-screen UI elements to their hand and touch them without visual attention? Our results show that the hand has the potential to be leveraged for device-less and eyes-free TV remote interaction without any third-party mediator device.



Niloofar Dezfuli, Mohammadreza Khalilbeigi, Jochen Huber, Murat Özkokmaz, Max Mühlhäuser. PalmRC: Leveraging the Palm Surface as an Imaginary Eyes-free TV Remote Control
In: Behaviour & Information Technology, p. to appear, December 2013.

Niloofar Dezfuli, Mohammadreza Khalilbeigi, Jochen Huber, Florian Müller, and Max Mühlhäuser. 2012. PalmRC: imaginary palm-based remote control for eyes-free television interaction. In Proceedings of the 10th European conference on Interactive tv and video (EuroiTV '12). ACM, New York, NY, USA, 27-34.
http://doi.acm.org/10.1145/2325616.2325623 - [Best Paper Award]

Niloofar Dezfuli, Mohammadreza Khalilbeigi, Jochen Huber, Florian Müller, and Max Mühlhäuser. 2012. Leveraging the palm surface as an eyes-free tv remote control. In Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts (CHI EA '12). ACM, New York, NY, USA, 2483-2488.



  • Florian Müller
  • Mürat Özkorkmaz
  • Johann Raspasovic

Talk and Touch News


Article about Test Driven Development of Voice User Interfaces

The trend and innovation Blog Smarter Service published our article about Test Driven Development of Voice User Interfaces (German only). [more]


Accepted work at SigDial

Our submission on how the integration of Prolog as a datamodel in SCXML has been accepted at SigDial. Here, we extend our approaches regarding the W3C MMI architecture and made a huge step forward towards enbling the Information... [more]


Article about Unit Testing for Voice Based Application

Our article about approaches to enable test driven development concepts for voice-based applications has been published at OBJEKTspektrum. Here, we compare our proposed framework for VoiceXML unit testing with current... [more]


Accepted work at SiMPE 2013

Two papers have been accepted for the upcoming workshop on Speech in Mobile and Pervasive Environments (SiMPE) held in conjunction with mobileHCI. Spatial Audio with the W3C Architecture for Multimodal InterfacesVoice-based... [more]


Talks about (J)VoiceXMLUnit

In his Bachelor Thesis at the Talk&Touch group at the Telecooperation Lab Raphael Groner developed an initial framework to enable unit testing in VoiceXML. This approach paves the way for test driven development... [more]


Article about MMI

Our article at Springer's Journal on Multimodal User Interfaces about our experiences when implementing the W3C standard for Multimodal architectures and interfaces has been published as an Online First... [more]

Displaying 8 to 13 of 13
<< First < Previous 1-7 8-13 Next > Last >>
A A A | Drucken Print | Impressum Impressum | Sitemap Sitemap | Suche Search | Kontakt Contact | Webseitenanalyse: Mehr Informationen
zum Seitenanfangzum Seitenanfang