Control smart home devices with gestures!
My use case - I can control whole floor lights by showing V sign to turn them on, and showing “high five” to turn them off.
Previously, I used Siri or button to control lights, and with Siri, you know - sometimes it just doesn’t work, especially if other family memebers are talking or watch TV.
We need a camera that would support gestures recognition, in my case it’s:
- Aqara Camera Hub G3
- Aqara Hub M100 (optional, to expose gesture events to Home Assistant).
Enable gesture detection
- In Aqara app, in camera settings, click on Device Settings → Camera Settings → Detection Settings.
- Choose Gesture Detection tab and enable Gesture Detection.
Create signals that will be exposed to Home Assistant via Matter protocol by Aqara Hub.
-
Go all the way back to the home screen of the app, and switch to Profile tab.
-
Click AI Lab → Connect to Ecosystems and click on Home Assistant, Scene and Signal Sync, Signal Management.
- Click +.
- IF: Choose the camera with enabled gesture detection, then Gesture detected.
- Click gesture from the picture.
- Click Save.
- Repeat process for every gesture you want to see in Home Assistant.
In Home Assistant, go to Settings → Automations and Scenes → + Create Automation.
Trigger would be
When: Entity Gesture Occupancy To Detected, where Gesture is gesture signal name you created in Aqara app.
And If:
Light → Choose your lights to turn on (I use areas, Living Room and Kitchen).