AR camera reacting to faces, hands and poses
An AR app that overlays effects responding to expressions, gestures and poses. I implemented result classification, visual effects and native compositing that retains the overlays in saved photos and video.
Screens
From recognition to an effect
Face, hand and body recognition results are classified and combined into one overlay. Emotion results are presented as estimates with confidence information, not as a diagnosis or fact.
Keeping previews and saved media consistent
I connected the native camera and GPU compositing so effects do not disappear when media is saved. Overlays are retained in photos and video when the user chooses to save.
On-device recognition
Face and pose recognition run on the device. I kept that processing separate from general app analytics so the data handled by each path remains distinct.