KR20180088346A - Door lock system using iris detection - Google Patents

Abstract

According to the present invention, disclosed is a door lock system for providing a visitor face image and authenticating a user through a mobile communication terminal by securing connection between a network gateway, which is a networking device of the door lock, and the mobile communication terminal by using location information of the mobile communication terminal. In the connection between the network gateway and the mobile communication terminal, the door lock system defines an IP address of Wi-Fi as location information of the mobile communication terminal when the mobile communication terminal is connected through Wi-Fi. On the other hand, the door lock system defines a unique mobile terminal number of a mobile communication data network as location information of the mobile communication terminal to secure connection in real time when the mobile communication terminal is not connected through Wi-Fi. Accordingly, the mobile communication terminal provides the visitor face image according to the securing of the connection. And, door opening of the door lock is controlled according to the provided visitor face image. Thus, the connection between the door lock and the mobile communication terminal is smoothly performed in real time. Therefore, the door opening of the door lock can be flexibly controlled according to the transmission of the visitor face image even when an owner of a house is located at a location a little away or far away from home or at a number of different locations.

Description

[0001] The present invention relates to a door lock system using iris recognition,

The present invention relates to a door lock and a user authentication method, and more particularly, to a door lock using iris recognition, a system thereof, and a mobile communication terminal, a network gateway and a user authentication method used therefor.

Conventional security systems using cryptographic keys and face recognition are used as security systems such as security alarms, safes, doors, personal computers (PCs), and bank ATMs (Automatic Teller Machines). However, there is a security threat due to the leakage of the encryption key. For example, when a ten key pad is operated to input a cipher key, there is a problem of a security threat due to an input trace left on the ten key pad after the operation and exposure due to the input of the ten keypad.

In a security system using face recognition, the authentication key itself is inputted to the biometric recognizer differently due to the possibility of change of the face recognition information according to the use environment and time, and the recognition performance is deteriorated. In addition, there is a high possibility of errors in face recognition information when wearing a face mask such as glasses, mask, sunglasses and muffler.

Therefore, there is a need for a description of a door lock and a user authentication method that provide a high level of security for the risk of leakage of a cryptographic key and possibility of biometric information change.

In addition, in addition to the digital door lock itself, the owner of the house leaves the security system, checking the face of the person who visited the home, and especially if it is located far away from home, There is a case where convenience is required to open or close the front door, and there is a need for a security system technique using face recognition in this case.

The present invention is based on the technical background as described above. The present invention detects an eye position in a face image of a user who approaches a door lock, and acquires an iris image through an iris camera. Then, by comparing the iris patterns, the user authenticates the user who approaches the door lock.

In addition, iris pattern information of a user is acquired through an iris camera to which a tilt mechanism is applied, thereby preventing deterioration of recognition performance due to possibility of change of biometric information.

Optionally, a communication module capable of communicating with the mobile device is provided, biometric information is received from the mobile device, and the biometric information is registered in the security system, thereby facilitating user registration of the security system, thereby improving convenience.

In addition, it is possible to use the user's mobile communication terminal to check the face of a visiting person, and particularly to check the face of a visiting person when the mobile communication terminal is located far away from the home, .

According to an aspect of the present invention, a door lock includes a wake-up module for recognizing a user access or driving the door lock according to a button input of a user, a door lock The iris recognition module compares the iris pattern inputted in the door lock with the previously stored iris pattern and authenticates the user who approached the door lock according to the comparison result.

The iris recognition module includes a face photographing unit for acquiring a face image of a user who approaches the door lock when the door lock is driven, an eye position sensing unit for sensing an eye position of the user's face image acquired by the face photographing unit, A servo control section for adjusting the inclination of the iris photographing section and generating an iris photographing control signal according to the result, an iris photographing section for photographing the iris of the user approaching the door lock on the basis of the iris photographing control signal, And an iris pattern comparing unit for comparing an iris pattern with a previously stored iris pattern, and authenticating the user who approaches the door lock according to the comparison result.

The iris capturing unit controls the tilt mechanism by the iris capturing signal obtained from the servo control unit and is inclined according to the sensed eye position.

The wake-up module includes at least one access recognition sensor for sensing the presence of an object approaching the door lock, and an input unit for obtaining a button input from a user approaching the door lock. The wake-up module drives the door lock according to the sensing result and the button input signal I will.

According to another aspect of the present invention, there is provided a security system for receiving biometric information from a mobile device and a mobile device for acquiring biometric information including a user's iris, storing the received biometric information, storing the stored biometric information, And a door lock for authenticating the user based on the comparison result.

The biometric information is unique identification information including iris pattern information, fingerprint information, retina information, and facial information.

According to another aspect of the present invention, there is provided a method for authenticating a user, comprising the steps of: sensing a user's access; acquiring a face image of the accessed user when the door lock is driven according to a sensing result; Sensing the eye position in the image, acquiring the iris image of the user with the iris camera based on the sensed eye position, comparing the iris pattern extracted from the acquired iris image with the previously stored iris pattern, And authenticating the user accordingly.

The step of acquiring the iris image of the user acquires the iris image of the user by controlling the inclination or operation of the iris camera through servo control.

The acquiring of the iris image includes acquiring the iris image with the iris camera and extracting the iris pattern from the acquired iris image.

The pre-stored iris pattern extracts an iris pattern from an iris image received from a mobile device having a communication function, forms an extracted iris pattern into a database, or photographs an iris from a door lock, extracts an iris pattern from the captured iris image , And the extracted iris pattern is a database.

According to another aspect of the present invention, there is provided a door lock system comprising:

The digital door lock acquires the face image of the visitor and provides the face image to the user mobile communication terminal, the user mobile communication terminal displays the face image of the visitor, and controls the door opening operation of the digital door lock according to the door open control signal input from the user .

The specific structure includes a digital door lock, a network gateway for registering terminal information of a user mobile communication terminal to transmit a face image of a visitor accessing the digital door lock, and networking the user mobile communication terminal registered with the terminal information and the digital door lock, A user mobile communication terminal having terminal information registered in the network gateway, and a location server for collecting and securing location information of the network gateway and the user mobile communication terminal and connecting them to each other. .

According to the present invention, a high security level is provided through a user authentication process through iris recognition.

Further, by acquiring the iris pattern information of the user, deterioration of recognition performance due to possibility of change of the biometric information is prevented.

Optionally, biometric information is received from the mobile device and registered in the security system, thereby facilitating registration and improving convenience.

Then, after confirming the face of the visiting person using the user's mobile communication terminal, in particular, when the user is located far away from home, the user (for example, the house owner) is notified that there is a person visiting the house, Thereby improving the convenience of the user to open or close the door of his / her home.

In particular, the real-time connection between the door lock and the mobile communication terminal smoothly controls the door lock of the door lock according to the transmission of the visitor's face image even if the house owner is located at a plurality of different places such as a little or far away from home.

1 is a block diagram of a security system according to an embodiment of the present invention.
2A and 2B are views illustrating a configuration of a door lock to which an iris recognition module according to an embodiment of the present invention is applied.
3 is a detailed block diagram of a door lock according to an embodiment of the present invention.
4 is a diagram showing an example of the structure of a mechanism of the iris recognition module according to the embodiment of the present invention.
5A and 5B are views showing an embodiment of adjusting a tilt of a face photographing camera and an iris camera according to an embodiment of the present invention.
6 is a signal flow diagram of a security system according to an embodiment of the present invention.
7 is a flowchart illustrating a security system operation procedure for authenticating a user according to another embodiment of the present invention.
8 is a flowchart illustrating a user authentication process in the door lock according to an exemplary embodiment of the present invention.
FIGS. 9A to 9C are views illustrating an embodiment of photographing a user's face and iris according to a key of a user accessing a door lock according to an embodiment of the present invention.
10 is a view showing a configuration of a door lock system according to the present invention.
11 is a view for explaining the operation of the door lock system according to the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. And is intended to enable a person skilled in the art to readily understand the scope of the invention, and the invention is defined by the claims. It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. It is noted that " comprises, " or "comprising," as used herein, means the presence or absence of one or more other components, steps, operations, and / Do not exclude the addition.

The term " module ", as used herein, should be interpreted to include software, hardware, or a combination thereof, depending on the context in which the term is used. For example, the software may be machine language, firmware, embedded code, and application software. In another example, the hardware can be a circuit, a processor, a computer, an integrated circuit, a circuit core, a sensor, a micro-electro-mechanical system (MEMS), a passive device, or a combination thereof.

Prior to explanation, the meaning of terms used in this specification will be briefly described. It should be noted that the description of the term is provided for the purpose of helping understanding of the specification and is not used to limit the technical idea of the present invention unless explicitly stated as a limitation of the present invention.

- Servo  Servo control

Servo control is a type of feedback control, and is a control method in which the control amount follows the target value.

In the present invention, an eye position is sensed in a face image of a user approaching a door lock, and an iris pattern is acquired by adjusting a tilt and an operation of an iris camera to which a tilt mechanism is applied through servo control. Thereafter, the obtained iris pattern is compared with the previously stored iris pattern, and the user who approached the door lock is authenticated according to the comparison result.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

1 is a block diagram of a security system according to an embodiment of the present invention.

Referring to FIG. 1, a security system according to an embodiment of the present invention includes a mobile device 100, a door lock 200, and an external device 300.

The mobile device 100 acquires biometric information including a user's iris image and the like. For example, the mobile device 100 captures an eye of a user through a camera or the like and acquires biometric information including iris pattern information. The obtained biometric information is transmitted to the door lock 200 through a data processing process. Here, the mobile device 110 corresponds to a device that each user carries and uses. However, the mobile device 110 is not limited to a portable device. For example, it may be a mobile phone or a mobile computer having a communication function, a photographing function, and a biometric information sensing function.

The door lock (200) receives the biometric information from the mobile device (100) and stores the received biometric information. Then, the stored biometric information is compared with the biometric information input from the user, and the user is authenticated based on the comparison result. The door lock 200 according to one embodiment includes a wakeup module 210, a microcontroller 230, an iris recognition module 250, a cryptographic key input module 270 and a communication module 290, .

The wakeup module 210 recognizes a user access through a sensor or generates a wake up signal according to a button input of a user to drive the door lock 200. [ The generated wake-up signal is input to the iris recognition module 250 via the microcontroller 230.

When the door lock 200 is driven, the iris recognition module 250 compares the iris pattern input to the door lock 200 with the previously stored iris pattern, and authenticates the user who approaches the door lock 200 according to the comparison result.

The present invention is for authenticating a user who has approached a door lock through iris recognition, and user authentication through a cryptographic key input described later is applied to user authentication separately from iris authentication. Specifically, in the preferred embodiment of the present invention, the user is authenticated through the iris pattern comparison. The authentication process by inputting the encryption key is not performed after the iris authentication process, or only the authentication process by inputting the encryption key is performed through the user authentication process.

The cryptographic key input module 290 receives a cryptographic key from a user to authenticate a user who has accessed the door lock. Thereafter, the input encryption key is compared with a predetermined encryption key, and the user is authenticated according to the comparison result.

The communication module 290 is a communication module based on a short range wireless communication based communication function such as Bluetooth communication, Infrared Data Association (IrDA) communication, RFID (Radio Frequency Identification) communication, Zigbee, NFC . In one embodiment, the communication module 290 may be used to receive biometric information of the user from the mobile device 100 in real time, or the door lock 200 may transmit user authentication status information and the like to the mobile device 100, The authentication status information of the door lock 200 can be provided in real time.

The external device 300 is a device that stores biometric information of users who need to register in the door lock 200. The external device 300 transmits data stored in the external device 300 to the door lock 200. [ The external device 300 stores various data including biometric information, and may be composed of one or more nonvolatile memories and volatile memories. In the present invention, it is possible to use the ROM (Read Only Memory), flash memory, RAM (Random Access Memory), internal hard disk (HDD), external hard disk, external storage medium As shown in FIG.

2A and 2B are views illustrating a configuration of a door lock to which an iris recognition module according to an embodiment of the present invention is applied.

2A and 2B, the door lock to which the iris recognition module is applied includes an optical window 210, an input keypad 230, and an iris recognition module (not shown). In the embodiment, the door lock is described as a door lock, but it is not limited thereto.

Referring to FIG. 2B, the iris recognition module 250 of the door lock 200 according to the embodiment includes a face photographing camera 251, an iris camera 253, and a processor board 255.

The face photographing camera 251 photographs the face of the user who approaches the door lock. When the eye position is sensed in the photographed face image, the iris camera 253 acquires the iris image by photographing the iris of the user based on the sensed eye position information. At this time, a tilt mechanism is applied to the iris camera 253, and the tilt and the operation of the iris camera 253 are controlled by servo control. Then, the processor board 255 extracts the iris pattern from the iris image and compares the extracted iris pattern with the previously stored iris pattern, thereby performing the initial security authentication of the user according to the comparison result.

Hereinafter, the operation process of the door lock (e.g., door lock) will be described in detail with reference to FIG.

3 is a detailed block diagram of a door lock according to an embodiment of the present invention.

3, the door lock includes a wakeup module 210, an iris recognition module 250, and the like. The iris recognition module 250 includes a processor 251, a face photographing unit 253, An eye position sensing unit 255, a servo control unit 257, an iris capturing unit 258, and an iris pattern comparing unit 259. [

The wake-up module 210 senses the presence of an object approaching the door lock 200 and inputs sensing information (a) to the microcontroller 230. For example, the wakeup module 210 may recognize an object proximate to the door lock with the access recognition sensor 213, acquire an input signal from the user through the input unit 215, and perform a wake up operation to drive the door lock ) Signal. The generated wake-up signal (a) is input to the microcontroller 230.

The microcontroller 230 acquires the correct input from the user based on the wake-up signal a obtained from the wake-up module 210 or determines that the person has approached the door lock, To the processor 251 of the processor 250.

The processor 251 of the iris recognition module 250 inputs the face photographing signal c to the face photographing unit 253 in accordance with the inputted photographing start signal b. Then, the face photographing unit 253 photographs the face of the user who is close to the door lock 200. [ For example, the face photographing unit 253 may be a camera, a CMOS, and a DMOS, which are capable of photographing a face of a user.

After the user's face photographing, the face image data d is transmitted to the eye position sensing unit 255. [ The eye position sensing unit 255 senses the eye position through a general image processing process including edge detection and the like in the received face image data d. For example, the eye position sensing unit 255 senses the coordinates of the left and right eyes in the face region, and transmits the coordinate information e1 and e2 of the sensed eyes to the iris capturing unit 258 and the processor 251 do. The processor 251 generates an iris capturing signal and outputs the generated iris capturing control signal f to the servo controller 257 via the coordinate information e1 of the eye received by the processor 251 . Here, the iris photographing control signal f includes a tilt control signal of the iris camera and an iris camera operation signal according to the eye position.

The servo control unit 257 generates the imaging signal g based on the input iris imaging control signal f and inputs it to the iris imaging unit 258. [

The iris photographing unit 258 photographs the iris of the user based on the coordinate information e2 of the previously acquired eye according to the inputted photographing signal g. When the user's iris image is acquired, the user's own biometric information such as an iris pattern is extracted from the iris image. Then, the iris capturing section 258 transmits the extracted inherent biometric information h to the iris comparing section 259. [

The iris comparison unit 259 compares the inherent biometric information h including the received iris pattern and the like with previously stored inherent biometric information. The comparison result information (i) is input to the processor 251.

The processor 251 determines whether the user is authenticated according to the input comparison result information (i). If the inputted biometric information matches the stored biometric information, the processor 251 completes the authentication for the user.

According to another embodiment of the present invention, a user who accesses the door lock can be authenticated through only a password input. The present invention performs user authentication through iris recognition and iris pattern comparison. User authentication through password input, which will be described later, is performed independently of the authentication process through iris recognition.

The microcontroller 230 transmits the input authentication performance signal k to the encryption input unit 271 of the encryption key input module 270. [

The encryption input unit 271 receives a preset encryption key such as a ten key, a pattern, etc. from the user according to the input authentication execution signal k. The input encryption key information (n) is transmitted to the determination unit 273. [

The determination unit 273 compares the encryption key received from the user with a predetermined encryption key to authenticate the user according to the comparison result. For example, if the input encryption key and the stored encryption key coincide with each other, the door open signal and the authentication completion signal m are transmitted to the microcontroller 230 to perform a door open operation. On the other hand, if the inputted encryption key is different from the stored encryption key, the re-input signal is transmitted to the encryption input unit 271 so that the user can input the encryption key again.

4 is a diagram showing an example of the structure of a mechanism of the iris recognition module according to the embodiment of the present invention.

 4A through 4C are a front view and a side view of a door lock device including an iris recognition module according to an embodiment.

4A to 4C, the face photographing unit 253 corresponds to a fixed camera 410, the iris photographing unit 258 corresponds to an iris camera 430 to which a tilt mechanism is applied, The servo control unit 257 corresponds to the servo motor 440.

In addition, the access recognition sensor 113 of the wakeup module 110 corresponds to at least one sensor 420 shown in Figs. 4A to 4C.

Specifically, when the access recognition sensor 420 recognizes the user access to the door lock, the face photographing camera 410 photographs the face of the accessing user. Then, the eye position is sensed in the face region of the photographed face image.

The inclination of the iris camera 430 to which the tilt mechanism is applied is controlled by the axis 441 connected to the servo motor 440 and the angle of the iris camera 430 is adjusted according to the inclination, The iris is photographed.

5A and 5B are views showing an embodiment of adjusting a tilt of a face photographing camera and an iris camera according to an embodiment of the present invention.

5A and 5B, the face photographing camera 410 operated by the user access sensing photographs the face of the user within an angle of? 1. Then, when the eye position is sensed in the photographed face image, the inclination of the iris camera is adjusted by the servo control, and the iris of the user located within the photographing angle? 2 of the iris camera is photographed.

The iris camera according to the embodiment adjusts the tilt angle of the iris camera according to the eye position of the user to be photographed. For example, as shown in FIG. 5A, when the user is a large user, the eye position of the user is relatively high. Therefore, the servo control unit 257, which controls the inclination and motion of the iris camera, lt; / RTI > On the other hand, in the case of a user with a small key, since the eye position is low, the servo control unit 257 adjusts the tilt angle of the iris camera to? 4.

6 is a signal flow diagram of a security system according to an embodiment of the present invention.

In step S510, a process of photographing the biometric information of the user including the iris in the mobile device 100 is performed. Here, the mobile device 100 may be a tablet PC, a laptop, a personal computer (PC), a smart phone, a personal digital assistant (PDA) A mobile communication terminal, or the like. That is, the mobile device 100 includes a memory for storing a specific application for connecting to the door lock 200 via a wired / wireless communication network 140, a device having a microprocessor for executing and controlling a program, it means. Although the mobile device 100 is generally a personal PC, any terminal can be used as long as it is capable of server-client communication with the management device, and a broad concept including all communication computing devices such as a notebook computer, a mobile communication terminal, to be.

In step S520, the process of transmitting data photographed by the mobile device 100 to the door lock 200 is performed.

In step S530, the process of storing the photographing data in the door lock 200 is performed.

In step S540, when an object approach from the door lock 200 to the door lock is detected or a button input of the user is obtained, a door lock operation is performed.

In step S550, when the door lock 200 is driven, a process of acquiring an iris image from the door lock 200 is performed.

In step S560, the iris image obtained in the door lock 200 is compared with the stored iris image. If the acquired iris image coincides with the stored iris image, in step S570, it is determined that the initial authentication is completed in the door lock 200 and the door is opened. On the other hand, if the obtained iris image is different from the stored iris image, the process returns to step S550 to acquire the iris image again.

Thereafter, in step S580, the process of transmitting the authentication status information from the door lock 200 to the mobile device 100 is performed according to the user's selection.

7 is a flowchart illustrating a security system operation procedure for additional authentication of a user according to another embodiment of the present invention.

Since steps S610 through S660 correspond to steps S510 through S560 in FIG. 6, the description of the steps S610 through S660 will be omitted. In step S670, the process of receiving the encryption key input from the user in the door lock 200 is performed.

In step S680, a process of comparing the encryption key input from the door lock 200 with a preset encryption key is performed. If the input cryptographic key matches the predetermined cryptographic key, step S690 is performed to determine that the additional authentication is completed in the door lock 200 and open the door. On the other hand, if the inputted encryption key is different from the preset encryption key, the process returns to step S670 and the process of acquiring the encryption key is performed again.

Thereafter, in step S700, the process of transmitting the authentication status information from the door lock 200 to the mobile device 100 is performed according to the user's selection.

In the description of the embodiment, the additional authentication of the user is performed through the encryption key. However, the additional authentication may be various types of authentication, such as pattern recognition and voice recognition, which improve the security after the iris recognition.

 8 is a flowchart illustrating a user authentication process in the door lock according to an exemplary embodiment of the present invention.

In step S710, the iris image data received from the mobile device 100 is stored in the door lock 200 or the iris image data registered in the door lock 200 is stored.

In step S720, the wake-up module 110 detects the user's access or drives the door lock by the user's input.

After the driving, in step S730, a process of photographing the face of the user approaching from the face photographing unit 253 is performed.

In step S740, a process of sensing the eye position within the face region of the face image photographed by the eye position sensing unit 255 is performed.

In step S750, the process of capturing the eye position information sensed by the iris capturing unit 258 and photographing the iris with the iris camera whose inclination is adjusted according to the eye position is performed.

In step S760, a process of extracting the iris pattern from the iris image photographed by the iris comparison unit 259 and comparing the extracted iris pattern with the previously stored iris pattern is performed.

In step S770, if the pre-stored iris pattern matches the extracted iris pattern, the processor 251 of the iris recognition module 250 proceeds to an additional authentication process of receiving the encryption key, And if the extracted iris patterns are different, the process returns to step S730.

In step S780, the pre-stored iris pattern is identical to the extracted iris pattern, so that the process of receiving the encryption key from the user in the encryption input module 270 is performed.

In step S790, the determination unit 273 of the cipher module 270 compares the pre-set cipher key with the input cipher key.

If the predetermined encryption key matches the input encryption key, it is determined that the additional authentication is completed. In step S800, the microcontroller 220 of the door lock 200 opens the door.

In the description of the embodiment of the present invention, the initial user authentication is iris recognition and the additional user authentication is encryption key authentication. However, at least one of the initial authentication and the additional authentication may be selected and applied to the security system . In addition, not only the pattern of the iris but also the identification information of the body such as the color of the iris, the fingerprint, and the voice can be used in the authentication process.

FIGS. 9A to 9C are views illustrating an embodiment of photographing a user's face and iris according to a key of a user accessing a door lock according to an embodiment of the present invention.

Referring to FIG. 9A, when a user having a relatively large key approaches the door lock, the face is photographed by the face camera, the eye position is sensed and the sensed eye position The inclination of the iris camera is automatically adjusted. After adjusting the slope of the iris camera, the iris image of the accessed user is acquired and the authentication process is performed.

FIG. 9B shows an embodiment for acquiring a user's iris image without tilting the iris camera.

FIG. 9C shows an embodiment in which an iris image is acquired when a user having a small key approaches the door lock.

Referring to FIG. 9C, when a user having a small key such as a child approaches the door lock and the approach of a user having a small key is sensed, the face is photographed by the face camera, the eye position is sensed, The inclination of the iris camera is automatically adjusted according to the eye position. After adjusting the slope of the iris camera, the iris image of the accessed user is acquired and the authentication process is performed.

In the present invention, an initial authentication is performed by sensing an eye position in a face image of a user who approaches a door lock to acquire an iris image and comparing iris patterns. After the initial authentication, additional authentication is performed through the encryption key input, thereby providing a high security level.

In addition, the iris image information of the user is obtained through the iris camera, the inclination of which is automatically adjusted, thereby preventing the deterioration of the recognition performance due to the possibility of change of the biometric information.

In addition, by providing a communication module capable of communicating with the mobile device in the door lock, biometric information is received from the mobile device and registered in the security system, thereby facilitating user registration and improving convenience.

The door lock mentioned in the present invention can be applied to a device requiring a security system such as an ATM door lock, an alarm device, a safe, a door, a personal computer (PC, Personnel Computer) and a bank ATM (Automatic Teller Machine) device.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. Therefore, the scope of the present invention should not be limited by the illustrated embodiments, but should be determined by the scope of the appended claims and equivalents thereof.

10 is a diagram illustrating a configuration of a face recognition digital door lock system of a mobile communication terminal according to the present invention.

10, a digital door lock system according to the present invention registers a terminal information of a mobile communication terminal 300 to transmit a face image of a visitor who accesses a digital door lock 100, a digital door lock 100, A mobile communication terminal 300 having the terminal information registered therein, a network gateway 200 for networking with the digital door lock 100, a mobile communication terminal 300 having terminal information registered in the network gateway 200, And a location server 400 for collecting and securing location information of the network gateway 200 and the mobile communication terminal 300 to be connected to each other.

The digital door lock 100 acquires a face image of a visitor approaching the door lock and performs image processing (image editing + image compression) to transmit the image to the network gateway 200. The digital door lock 100 transmits the user's mobile communication terminal 300 In accordance with the door opening control signal of the door opening control unit. The structure includes a wake-up button 110 for driving the door lock according to a button input of a visitor, a proximity sensor for recognizing the approach of the visitor, and an iris pattern for a user approaching the door lock An iris recognition module (120) having a system processor (123) that compares the iris pattern with an iris pattern and authenticates a user who approached the door lock in accordance with the comparison result; and an iris recognition module A face camera lens 121 for acquiring a face image of a visitor who is electrically connected to the system processor 123 of the iris recognition module 120 and accesses the door lock, The system processor 123 of the iris recognition module 120 may further include a facial image acquisition unit having an image sensor 122 for sensing an image of the facial camera lens 121, A function of editing and compressing an image sensed by the sensor 122 is provided. The microcontroller 130 starts driving the iris recognition module 120 at the time of inputting the visit wake-up button 110 or recognizing a visitor approach of the proximity recognition sensor, 120 to the network gateway 200 for networking the accessed face image of the visitor with the digital door lock 100 and the previously registered mobile communication terminal 300 and transmits the facial image of the accessed visitor from the network gateway 200 And controls the opening and closing of the door according to the door open control signal of the mobile communication terminal 300. A communication module (an RF (Zigbee) module) for transmitting the facial image of the accessed visitor, which is compressed by the system processor 123 of the iris recognition module 120, to the network gateway 200 .

The network gateway 200 registers the terminal information of the mobile communication terminal 300 to transmit a face image of a visitor who has accessed the digital door lock 100 and transmits the registered information to the mobile communication terminal 300 and the digital door lock 100). The network gateway 200 transmits the face image of the visitor acquired by the digital door lock 100 to the mobile terminal 300 based on the location information of the mobile communication terminal 300 in which the terminal information received from the location server 400 is registered, And transmits the door open control signal of the digital door lock 100 returned from the mobile communication terminal 300 in which the terminal information is registered to the digital door lock 100. The structure includes a communication module 201 for transmitting a visitor face image from the digital door lock 100 and a main processor 202 for controlling the entire connection operation of the network gateway 200. The main processor 202 Registers the terminal information of the mobile communication terminal 300 to transmit a face image of a visitor who approaches the digital door lock 100 and informs the location server 400 of position information each time the location information of the mobile communication terminal 300 is changed, A mobile communication terminal 300 that has a wired or wireless Internet access point function and is connected to the digital door lock 100 and is connected to the mobile communication terminal 300, And transmits the face image of the visitor acquired by the digital door lock 100 to the mobile communication terminal 300 registered with the terminal information received from the location server 400 And transmits the door open control signal of the digital door lock (100) returned from the mobile communication terminal (300) in which the terminal information is registered, to the mobile communication terminal (300) To the digital door lock (100). The network gateway 200 further includes a door lock door open / close button 203 which is electrically connected to the communication module 201 and has a door lock function.

The mobile communication terminal 300 is a smartphone of the home owner equipped with the digital door lock 100 having the terminal information registered in the network gateway 200 with the terminal information registered in the network gateway 200 . The mobile communication terminal 300 causes a face image of a visitor transmitted from the network gateway 200 to be a push alarm and transmits a door open control signal of the digital door lock 100 to the location server 400. [ To the network gateway 200 based on the location information of the network gateway 200 received from the network gateway 200. The mobile communication terminal 300 includes a storage unit for storing a visitor face confirmation application and a control unit for driving the application stored in the mobile communication terminal 300. The control unit Displays a visitor face image of the digital door lock 100 transmitted from the network gateway 200 and transmits a door open control signal corresponding to input information from a user to the network gateway 200. [ When the door open command is input, the controller transmits the door open command and the password to the digital door lock via the network gateway 200 based on the visitor face verification application. The door lock confirms that the password matches the pre-registered password, and executes the door lock opening command only if it matches. (Pre-registered password prevents the password leakage even in the case of gateway hacking because the door lock only has data. )

The location server 400 collects and acquires location information of the network gateway 200 and the mobile communication terminal 300 to be connected to each other. The location information of the acquired mobile communication terminal 300 is transmitted to the network gateway 200 and informed to the mobile communication terminal 300. The location information of the network gateway 200 is transmitted to the mobile communication terminal 300 so that they are connected to each other. For example, the location information may be an IP address of a WiFi when the mobile communication terminal 300 is connected to a wi-fi connection. When the mobile communication terminal 300 is connected to a Wi-Fi connection, It becomes a cell phone number. The location server 400 receives the changed location information (e.g., IP address) from the network gateway 200 every time the location information of the network gateway 200 is changed, and transmits the location information to the mobile communication terminal 300 Obtain a connection.

11 is a view for explaining the operation of the face recognition digital door lock system of the mobile communication terminal according to the present invention.

As shown in FIG. 11, the digital door lock system according to the present invention acquires a face image of a visitor who has accessed the digital door lock, processes the image, and transmits the image to the network gateway.

That is, a face image of a visitor who accesses the door lock is acquired through a sensor for image sensing of the face camera lens and the face camera lens.

Then, edit and compress the acquired visitor's face image.

That is, in the acquired face image of the visitor, the user adds the setting space to the face portion of the visitor who approaches the digital door lock and the face around the face, cuts and edits the screen, and compresses the edited image to be transmitted to the mobile communication terminal.

Then, the face image of the visitor who accesses the compressed door lock is transmitted to the network gateway.

Then, the network gateway registers the terminal information of the mobile communication terminal to transmit the face image of the visitor who accesses the digital door lock, and networkizes the mobile communication terminal with the registered terminal information and the digital door lock.

Then, the network gateway transmits the face image of the visitor acquired by the digital door lock to the mobile communication terminal registered with the terminal information based on the location information of the mobile communication terminal registered with the terminal information received from the location server.

Then, the mobile communication terminal causes the face image of the visitor received from the network gateway to be a push alarm, and controls the door open control signal of the digital door lock so that a user (e.g., a house owner) And returns the input door open control signal to the network gateway based on the location information of the network gateway received from the location server.

Thus, the real-time connection between the door lock and the mobile communication terminal is smoothly performed, so that even if the house owner is located at a plurality of different places such as a little or far away from home, the door lock opening control is controlled according to the transfer of the visitor face image.

For example, if the input information from a user (e.g., home owner) is a door open command based on a specific application (a visitor face confirmation application according to the present invention), the mobile communication terminal encrypts the door open command and the password And transmits it to the network gateway. The network gateway passes the password and door open command to the digital door lock. The door lock confirms that the password matches the pre-registered password, and executes the door lock opening command only if it matches. (Pre-registered password prevents the password leakage even in the case of gateway hacking because the door lock only has data. )

Then, the network gateway transmits the door open control signal of the digital door lock returned from the mobile communication terminal to the digital door lock via the RF (or ZigBee) communication.

The digital door lock controls the door open according to the door open control signal transmitted from the network gateway, thereby permitting or rejecting the visitor's visit.

Description of the Related Art [0002]
100: Digital door lock 200: Network gateway
300: mobile communication terminal 400: location server

Claims (6)

In a digital door lock system,
A system processor for authenticating a user who has approached the door lock according to a comparison result between a user iris pattern approaching the door lock and a pre-stored iris pattern, a door wake- And a micro controller for controlling opening and closing of the door based on the result of the user authentication, wherein the microprocessor obtains a face image of an access visitor and transmits the processed image to the door controller, A digital door lock that controls opening;
The terminal door information of the visitor who accesses the digital door lock is registered and networked to the digital door lock to transmit the visitor face image obtained by the digital door lock and to transmit the door open control signal of the returned digital door lock to the digital door lock Forwarding network gateway;
A mobile communication terminal for displaying a face image of a visitor received from the network gateway as a push alarm with the terminal information registered in the network gateway and returning a door open control signal of the digital door lock; And
When the WiFi connection of the mobile communication terminal occurs, the IP address of the WiFi is connected to the network gateway, which is a networking device of the digital door lock, with the mobile communication terminal as location information of the mobile communication terminal, When the mobile communication terminal is not connected, the terminal unique number of the mobile communication data network is connected to the network gateway, which is a networking device of the digital door lock, with the mobile communication terminal as location information of the mobile communication terminal, A location server for acquiring information in real time and acquiring the information, providing the information to the counterpart device, and connecting them to each other;
And,

Wherein the digital door lock includes a face image acquiring unit electrically connected to the system processor of the iris recognition module and having a face camera lens for acquiring an access visitor face image of the door lock and a sensor for sensing an image of the face camera lens, The system processor of the system is provided with a sensing image editing compression function of the sensor, and the microcontroller starts driving the iris recognition module when the visit wake-up button is pressed, and transmits the compressed access visitor face image of the iris recognition module to the network gateway And controls the opening and closing of the door according to the door open control signal of the mobile communication terminal. In a digital door lock system,
An iris recognition module having a system processor for authenticating a user approaching the door lock according to a comparison result between a user iris pattern approaching the door lock and a previously stored iris pattern, A digital door lock which includes a microcontroller controlling the opening and closing of the door as an authentication result, the door door being opened and closed according to a door opening control signal obtained by acquiring and processing an access visitor's face image;
The controller registers the terminal information of the mobile communication terminal to transmit the face image of the visitor who accesses the digital door lock, networkizes the terminal information to the digital door lock, transmits the visitor face image acquired by the digital door lock, To a digital door lock;
A mobile communication terminal for displaying a face image of a visitor received from the network gateway as a push alarm with the terminal information registered in the network gateway and returning a door open control signal of the digital door lock; And
When the WiFi connection of the mobile communication terminal occurs, the IP address of the WiFi is connected to the network gateway, which is a networking device of the digital door lock, with the mobile communication terminal as location information of the mobile communication terminal, When the mobile communication terminal is not connected, the terminal unique number of the mobile communication data network is connected to the network gateway, which is a networking device of the digital door lock, with the mobile communication terminal as location information of the mobile communication terminal, A location server for acquiring information in real time and acquiring the information, providing the information to the counterpart device, and connecting them to each other;
And,

Wherein the digital door lock includes a face image acquiring unit electrically connected to the system processor of the iris recognition module and having a face camera lens for acquiring an access visitor face image of the door lock and a sensor for sensing an image of the face camera lens, Wherein the system processor of the iris recognition module is provided with a sensing image editing compression function of the sensor and the microcontroller starts driving the iris recognition module when recognizing the visitor approach of the proximity recognition sensor and transmits the compressed access visitor face image of the iris recognition module to the network gateway And controls opening and closing of the door according to the door open control signal of the mobile communication terminal. 3. The method according to claim 1 or 2,
The network gateway comprises:
A communication module for transmitting a visitor's face image from the digital door lock; And
And a main processor for controlling the entire connection operation of the network gateway,
The main processor registers terminal information of a mobile communication terminal to transmit a face image of a visitor who accesses the digital door lock, informs the location server of position information of the mobile communication terminal each time it changes its location information, The mobile communication terminal having the wired / wireless Internet access point function, the mobile communication terminal having the wired / wireless internet access point function, and the wired / And transmitting the door open control signal of the digital door lock, which is returned from the mobile communication terminal registered with the terminal information, to the digital mobile communication terminal, I need to transfer it to the door lock. Door lock system, using iris recognition, characterized in that. The method of claim 3,
The network gateway comprises:
And a door lock opening / closing button of a door lock function electrically connected to the communication module. The method according to claim 1,
The mobile communication terminal includes:
A storage unit for storing a visitor face confirmation application; And
And a controller for driving an application stored in the mobile communication terminal,

Wherein,
Displaying a face image of a visitor of the digital door lock transmitted from the network gateway based on the visitor face identification application and transmitting a door open control signal corresponding to input information from the user to the network gateway, Door Lock System Using. 6. The method of claim 5,
Wherein,
When the input information from the user is a door open command based on the visitor face confirmation application, transmits a door open command and a user input password to the network gateway and transmits the door open command and the user input password to the door lock, And the door lock opening command is executed only when the door lock opening command matches the pre-registered password.

Images