KR102341883B1 - Smart door system with facial recognition function - Google Patents

Abstract

A smart door system equipped with a face recognition function is disclosed. a door lock module that locks or unlocks the door; a smart bell device attached to the side wall of the door or the front of the door; and a user terminal for the user to open and close the door, and the smart bell device may be configured to control whether the door is opened or closed by the user's face recognition. According to the smart door system equipped with the above-described face recognition function, the door is opened and closed electrically by face recognition in a situation in which the user cannot input the password because the user is holding an object in both hands, thereby improving user convenience and entry and exit. It has the effect of increasing security for In particular, there is an effect that can prevent intrusion due to forgery of the user's face by preparing for the height of the face image. In addition, since the keypad of the touch screen is configured as a random keypad and the password is automatically generated and discarded in real time according to the location of the user terminal and the Wi-Fi connection, etc., there is an effect that can prevent damage caused by the exposure of the password. On the other hand, by distributing and distributing a temperature sensor on the door knob so that the door lock is not released when a person's body temperature is not detected, it has the effect of preventing an intruder from holding the door knob wearing gloves to avoid leaving fingerprints. .

Description

Smart door system with facial recognition function {SMART DOOR SYSTEM WITH FACIAL RECOGNITION FUNCTION}

The present invention relates to a smart door system, and more particularly, to a smart door system equipped with a face recognition function.

The entrance door of an existing house or apartment is mainly provided with a door lock of a password input method.

Although the door lock is very convenient, there is a disadvantage that the security is somewhat weak because there is a risk of password leakage. Since the user is perceived as someone who knows the password, there is a lot of room for anyone to break into the house.

In addition, compared to its convenience, the fact that you have to press the password every time has a disadvantage in that you have to bear some inconvenience. In particular, it is very inconvenient in situations where you have a lot of luggage or cannot use both hands freely.

Accordingly, there is a need for a system that minimizes the risk of password leakage and allows convenient access in various situations.

Laid-Open Patent Publication No. 10-2021-0030602 Registered Patent Publication No. 10-1731097

An object of the present invention is to provide a smart door system equipped with a face recognition function.

A smart door system equipped with a face recognition function according to the above object of the present invention includes: a door lock module for locking or unlocking a door; It may be configured to include a smart bell device attached to the side wall of the door or the front of the door.

Here, the smart bell device may be configured to control whether the door is opened or closed by the user's face recognition.

And it may be configured to further include a user terminal for the user to open and close the door.

According to the smart door system equipped with the above-described face recognition function, the door is opened and closed electrically by face recognition in a situation in which the user cannot input the password because the user is holding an object in both hands, thereby improving user convenience and entry and exit. It has the effect of increasing security for In particular, there is an effect that can prevent intrusion due to forgery of the user's face by preparing for the height of the face image.

In addition, since the keypad of the touch screen is configured as a random keypad and the password is automatically generated and discarded in real time according to the location of the user terminal and the Wi-Fi connection, etc., there is an effect that can prevent damage caused by the exposure of the password.

On the other hand, by distributing and distributing a temperature sensor on the door knob so that the door lock is not released when a person's body temperature is not detected, it has the effect of preventing an intruder from holding the door knob while wearing gloves to avoid leaving fingerprints. .

In addition, since the femtocell AP is installed in the house and configured to check the access history of the femtocell AP, when an intrusion occurs, the intruder can be tracked through the femtocell access history.

On the other hand, by receiving a specific image in the image application of the user terminal through the Bluetooth connection from the smart bell device, and downloading it from the image application server to determine the unlocking of the door lock in comparison with each other, an intruder attempts to break in using the user terminal Even if you do not know which image is the designated image, it has the effect of preventing intrusion at all. That is, even if an intruder secures the user terminal, it is impossible to unlock the door, thereby ensuring full security.

1 is a block diagram of a smart door system equipped with a face recognition function according to an embodiment of the present invention.
2 is a front view illustrating an inner surface of a door according to an embodiment of the present invention.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and will be described in detail in the detailed content for carrying out the invention. However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing each figure, like reference numerals have been used for like elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a smart door system equipped with a face recognition function according to an embodiment of the present invention.

Referring to FIG. 1 , a smart door system equipped with a face recognition function according to an embodiment of the present invention includes a door electric opener 100 , a door close detection sensor 200 , a courier/pet entrance electric opener 300 , and a smart It may be configured to include a bell device 400 , a user terminal 500 , and a temperature sensor 600 .

Hereinafter, a detailed configuration will be described.

The electric door opener 100 may be configured to automatically open and close the door 10 using an electric motor.

The door closing detection sensor 200 may be configured to detect whether the door 10 is open or closed.

The courier/pet doorway electric open/close device 300 may be configured to automatically open and close the courier/pet doorway provided at the lower end of the door 10 using an electric motor.

The smart bell device 400 may be configured to be attached to the side wall of the door 10 or the front side of the door 10 .

The smart bell device 400 includes a PIR sensor 401, a touch screen 402, a doorbell display control module 403, a random keypad display control module 404, a notice display control module 405, a face image database 406 , face photographing camera module 407, face recognition module 408, face recognition height detection module 409, door lock release determination module 410, door lock opening/closing control module 411, wide-angle camera module 412, shape contour Recognition module 413, door electric open/close determination module 414, door electric open/close control module 415, video real-time transmission module 416, microphone 417, speaker 418, video call module 419, user Command receiving module 420, courier / pet entrance electric opening/closing control module 421, parcel monitoring module 422, object recognition module 423, lost image real-time transmission module 424, automatic password generation module 425 , password automatic discard module 426, push transmission module 427, Bluetooth module 428, user terminal confirmation module 429, image contrast confirmation module 430, to be configured to include a femtocell connection confirmation module 431 can

Hereinafter, a detailed configuration will be described.

The PIR sensor 401 may be configured to detect the approach of a person in front of the door 10 .

The touch screen 402 may be configured to display a doorbell button and a keypad for receiving a password.

When approaching is detected by the PIR sensor 401 , the doorbell display control module 403 may be configured to display a doorbell on the touch screen 402 .

The random keypad display control module 404 may be configured to display, on the touch screen 402 , a random keypad in which the arrangement of numbers is changed each time, when an approach is detected by the PIR sensor 401 . It is advantageous for security because the position of the key pressed each time is different.

The notice display control module 405 may be configured to control the user to display a notice for the visitor on the touch screen 402 . For example, a notice such as 'Please do not ring the doorbell because the baby is sleeping' may be displayed.

The facial image database 406 may be configured such that the user's facial image is pre-registered and stored.

The face capturing camera module 407 may be configured to generate a face image by capturing a face when an approach is detected by the PIR sensor 401 .

The face recognition module 408 may be configured to recognize a face from the face image generated by the face capture camera module 407 .

The face recognition height detection module 409 may be configured to detect a face recognition height in the face capture image obtained by the face capture camera module 407 . A distance detector (not shown) may be further provided next to the face photographing camera module 407 to measure a distance to an approaching person. Through this, the height of the approaching person according to the facial recognition height can be calculated by triangulation. In this case, it may be determined whether the user's key and the accessor's key are within an error range. The use of fake facial images can be prevented.

The door lock release determination module 410 determines whether the password received from the touch screen 402 is correct, whether the face recognized by the face recognition module 408 is a registered face, and the face detected by the face recognition height detection module 409 Configured to determine whether to release the door lock 20 according to whether the recognition height matches the face recognition height of the pre-registered user, and whether the body temperature detected by the temperature sensor 600 exists within an error range of the body temperature can be

Here, the temperature sensor 600 may prevent an intruder from touching the door lead 20a while wearing gloves so as not to leave a fingerprint. The temperature sensor 600 may be provided on both the inside of the door 10 and the outside of the door lead 20a.

The door lock opening/closing control module 411 may be configured to control locking/unlocking of the door lock 20 according to the determination of the door lock release determination module 410 .

When an approach is detected by the PIR sensor 401, the wide-angle camera module 412 may be configured to photograph the whole body of the approaching person at a predetermined proximity distance.

The shape contour recognition module 413 recognizes the shape contour of the approacher photographed by the wide-angle camera module 412 to determine whether the approacher is holding an object in both hands, sitting in a wheelchair, or using crutches. It may be configured to determine whether to electrically open or close the door 10 by determining the. That is, it may be determined whether the situation is unsuitable for writing with both hands.

The door electric opening/closing determination module 414 may be configured to determine whether to electrically open/close the door 10 as a result of the recognition of the shape contour recognition module 413 .

The door electric opening/closing control module 415 opens the door 10 using an electric motor according to the judgment of the door electric opening/closing determination module 414, and when the person approaching disappears from the wide-angle camera module 412, It may be configured to stop opening and close the door 10 again.

The image real-time transmission module 416 may be configured to transmit the image photographed by the face photographing camera module 407 and the image photographed by the wide-angle camera module 412 to the user terminal 500 in real time.

The microphone 417 may be configured to receive an accessor's voice.

The speaker 418 may be configured to output a user voice of a remote location.

The video call module 419 may be configured to perform a video call with the user terminal 500 at a remote location through the microphone 417 and the speaker 418 .

The user command receiving module 420 may be configured to receive a user command from the user terminal 500 .

The delivery/pet doorway electric opening/closing control module 421 may be configured to electrically open/close the delivery/pet doorway 30 through remote control of the user terminal 500 .

The courier product monitoring module 422 may be configured to monitor through the image of the wide-angle camera module 412 so that the parcel is not lost when the parcel is placed in front of the door 10 .

The object recognition module 423 may be configured to recognize the parcel delivery item monitored by the parcel delivery item monitoring module 422 .

The lost image real-time transmission module 424 may be configured to transmit the lost image to the user terminal 500 in real time when the parcel is lost.

When the user terminal 500 is connected to the Wi-Fi access point 40 in the house or the GPS location information of the user terminal 500 is close to the house, the password automatic generation module 425 determines that the user has returned home, and the password can be configured to automatically generate in real time.

The password automatic destruction module 426 determines that the user is going out when the user terminal 500 is disconnected from the Wi-Fi access point 40 or the GPS location information of the user terminal 500 is out of the vicinity of the house, and It can be configured to automatically destroy newly created passwords in real time.

The push transmission module 427 may be configured to transmit, in real time, whether the approaching person is approaching, a face image, an attempt to make a video call, and a password automatically generated in real time to the user terminal 500 using a push message.

The Bluetooth module 428 may be configured to receive an image from the user terminal 500 .

The user terminal confirmation module 429 may be configured to confirm whether the terminal connected to the Bluetooth module 428 is the user terminal 500 .

The image contrast check module 430 may be configured to compare the image received from the Bluetooth module 428 with a predetermined image among the images received from the image application server 60 to check whether they match.

The femtocell connection confirmation module 431 may be configured to confirm whether the user terminal 500 is connected to the femtocell AP 50 in the house.

The door lock lock/unlock determination module 410 is configured to determine in real time whether the door lock 20 is locked/unlocked according to whether the image of the image contrast check module 430 matches, and the femtocell connection check module 431 confirms the user When the terminal 500 accesses the femtocell AP 50 , it may be configured to determine whether to lock/unlock the door lock 20 in real time.

The user terminal 500 is a configuration for opening and closing the user's door 10, and may be a user's smart phone.

The user terminal 500 includes a Wi-Fi module 501, a Wi-Fi connection detection module 502, a GPS module 503, a password generation/disposal control module 504, a remote opening/closing control module 505, an image application 506, It may be configured to include a Bluetooth module 507 and a femtocell connection history checking module 508 .

Hereinafter, a detailed configuration will be described.

The Wi-Fi module 501 may be configured to automatically connect to the Wi-Fi access point 40 .

The Wi-Fi connection detection module 502 may be configured to detect whether it is connected to the Wi-Fi access point 40 .

The GPS module 503 may be configured to calculate GPS location information of the user terminal 500 .

The password generation/discard control module 504 automatically generates or automatically discards a password according to whether the user terminal 500 is connected to the Wi-Fi access point 40 and the GPS location information calculated by the GPS module 503. It may be configured to generate a command in real time and transmit it to the smart bell device 400 in real time.

The remote opening/closing control module 505 may be configured to remotely control the courier/pet doorway electric opening/closing control module 421 to automatically open and close the courier/pet doorway 30.

The image application 506 may be configured to generate and store an image using a camera provided in the user terminal 500, and to upload the stored image to the image application 60 in real time to synchronize it.

The Bluetooth module 507 may be configured to transmit an image previously designated by the user among the images stored in the image application 506 to the Bluetooth module 428 of the smart bell device 400 in real time. Such an image may be a specific image previously designated by the user among numerous images of the image application 506 , so that only the user can know which image it is.

The femtocell access history checking module 508 may be configured to check the access history of the femtocell AP 50 through the mobile communication server 70 to identify an intruder in the house. This history can be checked in real time, and when an intruder intrudes, the intruder can be searched in real time or post-mortem.

The temperature sensor 600 may be configured to be distributed in the form of a number of points on the surface of the door knob 20a so as to detect the body temperature of an approaching person.

2 is a front view showing an inner surface of a door according to an embodiment of the present invention.

2, the door 10 is configured to include an installation groove 10a, a communication hole 10b, a motor unit 10c, a blower fan 10d, a heat generating unit 10e, and a fragrance emitting unit 10f. can be

Hereinafter, a detailed configuration will be described.

The installation groove 10a may be configured to be provided on the inner surface of the door 10 .

The communication hole 10b may be configured such that the inside of the installation groove 10a communicates with the outside of the door 10 .

The motor unit 10c is provided in the installation groove 10a, and may be configured to be connected to a rotating shaft.

The blowing fan 10d is provided in the installation groove 10a, and may be configured to drive the blowing fan 10c through a rotation shaft.

The heating part 10e is provided in the installation groove 10a, and may be configured to generate heat.

The fragrance emitting part 10f may be provided in the installation groove 10a, and may be configured to emit a fragrance due to a melting action by the heat of the heating part 10e.

Here, the heating unit 10e may be configured to generate heat when a password error occurs more than a predetermined number of times in the door lock 20 or when the remaining amount of the battery is lowered to a predetermined standard or less.

Although it has been described with reference to the above embodiments, those skilled in the art can understand that various modifications and changes can be made to the present invention without departing from the spirit and scope of the present invention as set forth in the following claims. There will be.

10: door
10a: installation home
10b: communication hole
10c: motor unit
10d: blow fan
10e: heating part
10f: scent emitting part
100: door electric opener
200: door closing detection sensor
300: Delivery / pet door electric opener
400: smart bell device
401: PIR sensor
402: touch screen
403: doorbell display control module
404: random keypad display control module
405: notice display control module
406: facial image database
407: facial photographing camera module
408: face recognition module
409: face recognition height detection module
410: door lock release determination module
411: door lock opening/closing control module
412: wide-angle camera module
413: shape contour recognition module
414: door electric open/close judgment module
415: door electric opening/closing control module
416: video real-time transmission module
417: microphone
418: speaker
419: video call module
420: user command receiving module
421: courier / pet entrance electric opening and closing control module
422: courier goods monitoring module
423: object recognition module
424: lost video real-time transmission module
425: password automatic generation module
426: password automatic discard module
427: push sending module
428: Bluetooth module
429: user terminal confirmation module
430: image contrast check module
431: femtocell access confirmation module
500: user terminal
501: wifi module
502: wifi connection detection module
503: GPS module
504: password generation/revocation control module
505: remote open/close control module
506: image application
507: Bluetooth module
508: femtocell access history check module
600: temperature sensor

Claims (3)

an electric door opener that automatically opens and closes the door using an electric motor;
a door closing detection sensor for detecting whether the door is open or closed;
A courier/pet door opening and closing device that automatically opens and closes the courier/pet doorway provided at the lower end of the door using an electric motor;
a smart bell device attached to the side wall of the door or the front of the door;
a user terminal for the user to open and close the door;
It includes a temperature sensor provided to be distributed in the form of a number of points on the surface of the door knob to detect the body temperature of the approaching person,
The smart bell device,
a PIR sensor for detecting the approach of a person in front of the door;
a touch screen displaying a doorbell button and a keypad for receiving a password;
a doorbell display control module configured to display a doorbell on the touch screen when an approach is detected by the PIR sensor;
a random keypad display control module for displaying a random keypad whose numeric arrangement is changed each time on the touch screen when an approach is detected by the PIR sensor;
a guide display control module for controlling the user to display a guide for the visitor on the touch screen;
a facial image database in which the user's facial image is pre-registered and stored;
a face photographing camera module for generating a facial image by photographing a face when approach is detected by the PIR sensor;
a face recognition module for recognizing a face from the face image generated by the face photographing camera module;
a face recognition height detection module for detecting a face recognition height from the face capture image generated by the face photographing camera module;
Whether the password input from the touch screen is correct, whether the face recognized by the face recognition module is a registered face, whether the face recognition height detected by the face recognition height detection module matches the face recognition height of the pre-registered user a door lock release determination module for determining whether to release the door lock according to whether or not the body temperature detected by the temperature sensor exists within an error range of the body temperature;
a door lock opening/closing control module for controlling locking/unlocking of the door lock according to the determination of the door lock release determination module;
a wide-angle camera module for photographing the entire body of the approaching person at a predetermined proximity distance when the PIR sensor detects an approach;
a shape contour recognition module for recognizing the contour of the approacher photographed by the wide-angle camera module to determine whether the approacher is holding an object in both hands, the approacher is sitting in a wheelchair, or the approacher is using crutches;
a door electric opening/closing determination module for determining whether to electrically open or close the door as a result of the recognition of the shape contour recognition module;
a door electric opening/closing control module for opening the door using an electric motor according to the determination of the electric door opening/closing determination module, and stopping the opening of the door and closing the door again when the person approaching disappears from the wide-angle camera module;
an image real-time transmission module for transmitting the image photographed by the face photographing camera module and the image photographed by the wide-angle camera module to the user terminal in real time;
a microphone for receiving the voice of the approaching person;
a speaker for outputting a user's voice from a remote location;
a video call module for performing a video call with a remote user terminal through the microphone and the speaker;
a user command receiving module for receiving a user command from the user terminal;
a courier/pet doorway electric opening/closing control module for electrically opening and closing the courier/pet doorway through the remote control of the user terminal;
a courier product monitoring module for monitoring through the image of the wide-angle camera module so that the parcel is not lost when the parcel is placed in front of the door;
an object recognition module for recognizing the parcels monitored by the parcel monitoring module;
a lost image real-time transmission module for transmitting the lost image to the user terminal in real time when the parcel is lost;
When the user terminal is connected to a Wi-Fi access point in the house or when the GPS location information of the user terminal is close to the house, it is determined that the user has returned home and a password automatic generation module for automatically generating a password in real time;
When the user terminal is disconnected from the Wi-Fi access point or the GPS location information of the user terminal is out of the vicinity of the house, it is determined that the user is going out and automatically discards the newly created password in real time. module;
a push transmission module for transmitting in real time whether the approach of the approaching person is detected, the face image, the video call attempt, and the password automatically generated in real time to the user terminal using a push message;
a Bluetooth module for receiving an image from the user terminal;
a user terminal confirmation module for confirming whether the terminal connected to the Bluetooth module is the user terminal;
an image contrast checking module that compares the image received from the Bluetooth module and a predetermined image among the images received from the image application server to confirm whether they match or not;
It is configured to include a femtocell connection confirmation module for confirming whether the user terminal is connected to the femtocell AP in the house,
The door lock lock/unlock determination module,
is configured to determine in real time whether the door lock is locked/unlocked according to whether the image of the image contrast verification module matches, and when the user terminal accesses the femtocell AP as a result of checking the femtocell connection verification module, the lock/unlock of the door lock is configured to determine in real time whether
The user terminal is
a Wi-Fi module that automatically connects to the Wi-Fi access point;
a Wi-Fi connection detection module for detecting whether the Wi-Fi access point is connected;
a GPS module for calculating GPS location information of the user terminal;
Password generation / for generating a user command to automatically generate or automatically discard a password according to whether the user terminal is connected to the Wi-Fi access point and the GPS location information calculated by the GPS module in real time and transmit it to the smart bell device in real time waste control module;
a remote opening/closing control module for remotely controlling the courier/pet doorway electric opening/closing control module to automatically open/close the courier/pet doorway;
an image application that generates and stores an image using a camera provided in the user terminal, and uploads the stored image to the image application in real time for synchronization;
a Bluetooth module for transmitting, in real time, an image previously designated by the user among the images stored in the image application to the Bluetooth module of the smart bell device;
It is configured to include a femtocell access history checking module for checking the access history of the femtocell AP through a mobile communication server to identify an intruder in the house,
The door is
an installation groove provided on the inner surface of the door;
a communication hole through which the inside of the installation groove communicates with the outside of the door;
a blowing fan provided in the installation groove and connected to the rotating shaft;
a motor unit provided in the installation groove and configured to drive a blower fan through the rotation shaft;
a heating part provided in the installation groove and generating heat;
It is provided in the installation groove, and is configured to include a fragrance emitting part that emits a fragrance due to a melting action by the heat of the heating part,
The heating part,
A smart door system with a face recognition function, characterized in that the door lock is configured to generate heat when a password error occurs more than a predetermined number of times or when the remaining battery level is lowered to a predetermined standard or less. delete delete

Images