Handzplay is an online platform to create and explore gesture interactions. It uses machine learning model to detect hands from a webcam and offers options to design interfaces and define gesture rules.

2022 / design & development

A tool to unpack and explore gesture interaction

Building a tool to design, build, and test gesture interactions

What is gesture good at? - early ideas

exploring the gesture interaction

We all imagine that we'll control devices with hand gestures in the future (probably due to sci-fi films). With the development of AI and machine learning technology, is it now finally the time? Is it a hype or a good experience? What are sweetspots that we can apply this interaction to? To better understand the characteristics of the interaction and answer questions above, I built this playground.

canvas mode

01 create a rule

how to add a new rule

02 create an interface

Design a visual interface on the screen that reacts to your gesture. Users can select a shape and how it changes by certain actions, like air-swipe, hover, and click.

how to add a new interface

03 canvas mode

canvas mode

canvas mode