Lab · Computer vision

Face, hand & body detection

Live face mesh, eye tracking, eye colour, expressions, hand gestures and body pose — all running inside your browser.

Everything runs on your device. Your camera image never leaves your phone or computer.

Start the camera or upload a photo Works best in good light, facing the camera.

How it works

Face mesh

A neural network places 478 points on each face, including the irises. From them the tool works out where you're facing and looking, and reads 52 facial movements such as smiling, blinking and raised eyebrows.

Hands & gestures

21 points per hand, for up to two hands. The tool counts raised fingers and recognises gestures such as thumbs up, victory and open palm.

Eye colour & body

Eye colour is estimated from the pixels inside each iris, so lighting changes the result. A third model tracks 33 points on the body.

Built with Google's open-source MediaPipe models (Apache 2.0), hosted on this site.