Doorbell unlock with face detection?

[onecrash]

Is there a way to use the face detection to automatically unlock the door?

[DEChrisE]

Hi @onecrash yes it’s possible

[onecrash]

Do we have that in USA? I think that’s German right? Let me see if I can figure it out.

[DEChrisE]

You should have, at least when you have smart door lock and smart doorbell from Aqara

[UnrealAbyss]

Have you tried using a photo?

[DEChrisE]

Nope not yet

[UnrealAbyss]

Please try it when you have time. I’ll be grateful. This is a very important safety feature.

[gafich10]

Hello, I have a working door opening based on photos (facial recognition) from a G5 camera and a U200 lock. I made an automation for this, it’s very convenient, especially when my hands are busy (the camera is looking into the yard), showed my face and the door opened.

[UnrealAbyss]

So, anyone who shows a photo can now open the door and get inside?

[JohnD]

Using face recognition with a normal camera might feel futuristic, but it’s not safe. If you care about privacy and security, stick to systems that use infrared and 3D depth mapping, like Face ID.

Normal Cameras Only See in 2D

A regular camera captures a flat image - just colors and light, no depth. That means the system only compares two-dimensional pictures of your face.

The problem? A 2D image can easily be fooled. Someone could unlock your phone, door look or somthing like that using a printed photo or even a short video of you.

Lighting and Angles Cause Issues

Camera-based recognition systems struggle when lighting changes - for example, in bright sunlight, darkness, or when your face is slightly turned. That makes them unreliable in daily use.

Face ID (and Similar Systems) Work Differently

Apple’s Face ID uses a TrueDepth camera system that projects invisible infrared dots on your face to create a 3D depth map. It also takes an infrared image that works even in total darkness.

The probability that any given person from the general population can unlock a device with Face ID is less than 1 in 1,000,000. Basic 2D face recognition systems can be between 1 in 1,000 and 1 in 50,000 - or even worse. In other words, they’re hundreds of times less secure.

Here is more information about Face ID:

About Face ID advanced technology - Apple Support

Better solutions

Combine several factors, such as facial recognition and a Bluetooth beacon. An intruder would need to have a photo of you, which may be easy to find on social networks. However, they would also need to steal your Bluetooth beacon.

Use special Matter devices such as the SwitchBot Keypad Vision with 3D facial recognition. The device can be purchased separately, but I’m not sure if it can be combined with Aqara via Matter.

[KingDando]

You can use a Matter compatible Smart Lock or you use the Matter Synchronisation in the Aqara App, that expose to Apple Home, when a specific face is detected.

[gafich10]

Theoretically you are right, but practically I researched and tried to change my photo to fool G5. Nothing worked, I even printed the photo that I gave G5, it didn’t work either. When I appear in the camera so that it can track and open the lock, I have to smile and shake my head (somewhere around this photo was given) then the lock opens.
I always think that the neighbors will say, “something is wrong with him, he’s laughing at himself”

[JohnD]

Are there any official statements from Aqara regarding the security of facial recognition?

I only found this post:

@Aqara_PM_Donie

Actually, I think there are very high security risks when using G4/G410 in this way. The face recognition of G4/G410 is based on two-dimensional image analysis and can easily be deceived by a single photo or picture. We suggest that this door opening method be limited to opening your yard door, not your home’s entrance or garage door.

I just happened to see that Aqara also has a product with 3D facial recognition. Interesting.

Smart Lock D200i - Aqara

Just so you know: Some insurance companies require you to inform them if you install a smart lock or start using facial recognition technology on your door. If you don’t inform them and something happens, it could cause problems when you file a claim. It’s best to check with your insurance company first.

[gafich10]

This is my research and personal practice. I am not voicing official information, please pay attention to this.

[JohnD]

I didn’t mean to imply that. I was just asking if you knew of any official statements.

[Raman.V]

Hello @UnrealAbyss
As Donie already wrote, cameras recognize 2D images, so this will work with photos—this has been tested on the G4, G410, and G5. For apartment entry, I use the D200i—it uses a dot projector and can’t be fooled by photos.

[Aqara_PM_Donie]

Hello guys,

I am willing to reply to this question again and provide some new content:

1. Firstly, yes, we do not recommend using any facial recognition feature of Aqara Camera to link the opening of your entrance door lock. However, if it is a courtyard door, I believe the risk is not significant. The reason is that facial recognition based on 2D flat images has lower security than using 3D detection. Sometimes, when you use printed photos, it seems that you cannot deceive the camera, it is only a matter of angle or facial image size. As long as you stick the photo close enough to the camera lens, it will eventually deceive the camera.

2. Aqara has not yet launched the global version of the face recognition door lock, but some of the Chinese Mainland version we launched have the 3D face unlocking function. For Aqara, the main risk of launching overseas 3D face locks is the local regulatory requirements, and how our face algorithm can meet the recognition accuracy of people with different skin colors as far as possible. Although technically we can reduce the security risk to the minimum, we will still be cautious if we try, and I think the probability of launching face recognition door locks in the future is 100%.

3. If a transitional solution is provided, such as adding 3D facial recognition function to a visual doorbell to ensure the security of facial recognition (integrated on the visual doorbell, it is not directly used for unlocking function, so the security review risk of the product is relatively small), is it a feasible solution for you? Welcome everyone to discuss this topic.

[UnrealAbyss]

Thank you for your detailed answer.

[JohnD]

@Aqara_PM_Donie

If a transitional solution is provided, such as adding 3D facial recognition function to a visual doorbell to ensure the security of facial recognition (integrated on the visual doorbell, it is not directly used for unlocking function, so the security review risk of the product is relatively small), is it a feasible solution for you? Welcome everyone to discuss this topic.

Honestly, the 2D face recognition that’s already built in is totally fine for me when it comes to notifications or just knowing who’s at the door.
A doorbell with 3D face recognition would only really make sense if it could also unlock the door - otherwise it’s just a more expensive version of what we already have.

I get that there are probably some regulatory issues, but if it was available as an optional “use at your own risk” feature, I think many users (including me) would be happy to try it.

Personally, I’d feel much safer if multiple factors could be combined - for example, face recognition plus a Bluetooth beacon nearby. Since most Matter-compatible devices already include Bluetooth, maybe that kind of feature could even come later via a firmware update, in the same way as the auto-unlock feature.