Wave detection

In collaboration with SnapBack we developed Nosfy, a computer vision algorithm able to detect hand movements (LEFT vs. RIGHT) from the camera of any phone, tablet or laptop. The starting point is the frame difference, as in many computer vision projects.

Features regarding the size and direction of movement are extracted and integrated over time, without relying on hand shape detection. The resulting algorithm is very fast and can run on any smartphone.

This kind of technology is useful not only to offer a touchless interaction, but also to detect movements fast without processing the details, e.g. an alarm trigger in surveillance or anomaly detection in industrial production.

The original Nosfy was prototyped in Python and deployed in Java. I am eager to try HTML5 computer vision, leveraging libraries like JSfeat.

See also