WiGest: A Ubiquitous WiFi-based Gesture Recognition System






WiGest conceptual overview WiGest logic flow

WiGest is a ubiquitous WiFi-based hand gesture recognition system for controlling applications running on off-the-shelf WiFi-equipped devices. Unlike the other systems, WiGest does not require any modification to the available wireless equipment or any extra sensors. It does not require any prior training and can operate in non-line-of-sight scenarios. The basic idea is to leverage the effect of the in-air hand motion on the wireless signal strength received by the device from an access point to recognize the performed gesture.

We implement a proof-of-concept prototype using off-the-shelf laptops and standard WiFi access points, and extensively evaluate the system in two typical environments. Our results show that WiGest detects the basic primitives with an accuracy of 87.5% using a single AP only, including through-the-wall non-line-of-sight scenarios. In addition, when evaluating the system using a multi-media player application, we achieve a classification accuracy of 96% using two overheard APs.

Videos and media coverage

People

Collaborators

  • Prof. Khaled Harras, Carnegie Mellon University, Qatar

Publications

  1. WiGest: A ubiquitous WiFi-based gesture recognition system
    Heba Abdelnasser, Moustafa Youssef, and Khaled Harras
    INFOCOM 2015.
    Download: Paper, Slides
  2. WiGest Demo: A Ubiquitous WiFi-based Gesture Recognition System
    Heba Abdelnasser, Khaled Harras, and Moustafa Youssef
    INFOCOM demo 2015.
    Download: PDF
  3. WiGest: A ubiquitous WiFi-based gesture recognition system
    Heba Abdelnasser, Moustafa Youssef, and Khaled Harras
    Technical Report, 2015.
    Download: PDF