KR20220080884A - Method and system for extracting image using thermal camera - Google Patents

Abstract

The present invention relates to a face recognition access control system using a thermal imaging camera equipped with a hand sanitizer device. In particular, the main cause of infection is a person at risk of infection exposed to a coronavirus caused by hand contact. It relates to a face recognition access control system and method using a thermal imaging camera that can safely and accurately determine whether an infected person is infected only with face information and temperature information without direct hand contact in certain controlled areas such as airports and hospitals during a period of inactivity.
In addition, the present invention provides a technology for disinfecting hands by providing a hand disinfection device at the bottom of the face recognition terminal, but drying the hands after hand disinfection

Description

{METHOD AND SYSTEM FOR EXTRACTING IMAGE USING THERMAL CAMERA}

The present invention relates to a face recognition access control system using a thermal imaging camera equipped with a hand sanitizer device, and in particular, for those who are at risk of infection, the main cause of infection being exposed to the corona virus caused by hand contact, infectious diseases are prevalent It relates to a face recognition access control system and method using a thermal imaging camera that can safely and accurately determine whether an infected person is infected only with face information and temperature information without direct hand contact in certain controlled areas such as airports and hospitals during a period of inactivity.

In addition, the present invention provides a technique for disinfecting hands by providing a hand sanitizer at the bottom of the face recognition terminal, but drying the hands after hand disinfection

Access control systems are being installed to safely protect people, property, information, etc. in specific places where access control is required, such as buildings, research institutes, factories, offices, and security areas.

In general, access control that requires the control of an accessor in a building or office building is done through biometrics such as an access manager, reading an access card, fingerprints or iris, etc. There is a very cumbersome problem because it must be recorded.

In particular, in spaces such as hospitals, schools, large corporations, government offices, prisons, or the military, various people live in groups. There is a risk that the disease may be transmitted to

However, the existing access control system was operated in such a way as to decide whether to enter or not based only on images of the person who wanted to enter, and as a result, a person who has the right to enter a specific space can freely enter the space even if he is infected with a disease. It was a situation in which I was entering.

Therefore, if a person's health status can be determined by measuring a person's body temperature before entering a space where several people gather or stay together, such as a company, school, or academy, not only can the spread of infectious diseases be prevented, but also individuals It can inform you of your overlooked health condition so that you can take quick action.

Due to the recent corona virus infection, the public need for a system that can check the health status of people entering a specific space or restrict access according to their health status is increasing.

Such a system cannot disinfect hands because it is not equipped with a hand sanitizer device.

The purpose of the present invention is to provide face information without direct hand contact in certain controlled areas such as airports and hospitals during epidemics, for people at risk of infection exposed to coronavirus, etc., the main cause of infection is by hand contact and to provide a face recognition access control system using a thermal imaging camera that can safely and accurately determine whether an infected person is infected only with temperature information.

In addition, hand sanitizer is provided at the bottom of the face recognition terminal to disinfect hands.

Provides technology to dry hands after hand disinfection

Disclosed is a face recognition access control system using a thermal imaging camera according to a first aspect of the present invention for achieving the above object.

A first embodiment of a face recognition access control system using a thermal imager of the present invention includes a face recognition terminal for recognizing the face of an occupant, and a thermal imaging camera module for measuring the body temperature of the entrant and transmitting it to the face recognition terminal an occupant monitoring unit; and an allowable range of body temperature of the entrant is set in advance, and the resident's face information recognized by the face recognition terminal and the resident's body temperature information transmitted to the face recognition terminal are transmitted. It is characterized in that it includes; a management server for storing and displaying; access is restricted when the body temperature of the occupant is above the allowable range, and access is allowed only when the body temperature of the entrant is less than the allowable range.

A second embodiment of the face recognition access control system using the thermal imaging camera of the present invention includes a face recognition terminal that is registered as a user, an allowable range of body temperature is set, and recognizes the face of a person, and measures the body temperature of the person. an occupant monitoring unit including a thermal image camera module to be transmitted to the face recognition terminal; and a management server that transmits the face information of the person recognized by the face recognition terminal and the body temperature information of the person who is transferred to the face recognition terminal, matches the transmitted face information and the body temperature information, and stores and displays the information. It is characterized in that the access is allowed only when the face information recognized by the face recognition terminal is a registered user and the body temperature of the entrant is less than or equal to the allowable range.

The face recognition terminal and the thermal imaging camera module as described above may be formed as a separate type or as an integrated type.

In this case, the face recognition terminal is configured to automatically recognize the face of the entrant using artificial intelligence (AI) technology and automatically display the occupant's body temperature measured by the thermal imaging camera.

In addition, the management server is configured to open and close the door by transmitting a control signal to the door through which a person enters and exits.

In another configuration, the face recognition terminal may be configured to open and close the door by transmitting a control signal to the door through which the person enters and exits.

In addition, the management server may further include a computer or mobile terminal equipped with client software that can inquire the stored face information and body temperature information in a wired or wireless communication method.

On the other hand, a face recognition access control method using a thermal imaging camera according to the second aspect of the present invention is disclosed.

A first embodiment of a face recognition access control method using a thermal imaging camera of the present invention includes a first step of setting an allowable range of body temperature of a person in a management server; a second step of recognizing the face of the occupant through the face recognition terminal and measuring the body temperature of the occupant through the thermal imaging camera module; a third step of transmitting the face information of the person recognized by the face recognition terminal and the body temperature information measured by the thermal imaging camera module to the management server; a fourth step of matching the person's face information and body temperature information and storing the matching information in the management server; a fifth step of displaying the matched person's face information and body temperature information; a sixth step of determining whether the body temperature of the entrant is within an allowable range; a seventh step of restricting access when the body temperature of the occupant is above the allowable range; and an eighth step of allowing entry if the body temperature of the occupant is less than the allowable range.

A second embodiment of the face recognition access control method using the thermal imaging camera of the present invention includes: a first step of registering a user in a face recognition terminal and setting an allowable body temperature range of the occupant; a second step of recognizing the face of the occupant through the face recognition terminal and measuring the body temperature of the occupant through the thermal imaging camera module; a third step of determining whether the face information recognized through the face recognition terminal is a registered user; a fourth step of determining whether the body temperature of an entrant is within an allowable range when the face information recognized through the face recognition terminal is a registered user; a fifth step of restricting access when the body temperature of the occupant is above the allowable range; and a sixth step of allowing entry if the body temperature of the occupant is below the allowable range.

The face recognition terminal and the thermal imaging camera module as described above may be formed as a separate type or as an integrated type.

In this case, the face recognition terminal is configured to automatically recognize the face of the entrant using artificial intelligence (AI) technology and automatically display the occupant's body temperature measured by the thermal imaging camera.

Specific details of other embodiments are included in "Details for carrying out the invention" and the accompanying "drawings".

Advantages and/or features of the present invention, and methods of achieving them, will become apparent with reference to the various embodiments described below in detail in conjunction with the accompanying drawings.

However, the present invention is not limited to the configuration of each embodiment disclosed below, but may also be implemented in a variety of different forms, and each embodiment disclosed in this specification only makes the disclosure of the present invention complete, It is provided to fully inform those of ordinary skill in the art to which the invention pertains to the scope of the present invention, and it should be understood that the present invention is only defined by the scope of each claim.

According to the present invention, without direct hand contact in a certain controlled area such as an airport or hospital during an epidemic period for a person at risk of being exposed to the corona virus, etc. Only face information and temperature information can safely and accurately determine whether an infected person is infected.

In other words, by matching the entrant's body temperature information measured through the thermal imaging camera module with the occupant's face information detected through the face recognition terminal, the entrant's body temperature information is used to control access to a certain control area and post-management information. There is an effect that can be used.

1 is a diagram schematically showing a face recognition access control system using a thermal imaging camera according to the present invention.
2 is a view showing, as an example, a face recognition terminal and an authentication result in a face recognition access control system using a thermal imager according to the present invention, (a) is an abnormal state. (b) is a normal state, and FIG.
3 is a view showing a process of implementing the first embodiment of the face recognition access control method using a thermal imaging camera according to the present invention.
4 is a view showing a process of implementing the second embodiment of the face recognition access control method using a thermal imaging camera according to the present invention.
5 is a perspective view for explaining the hand sanitizer of the present invention;
6 is a perspective view of a hand sanitizer device of the present invention;
A) is a cross-sectional view of the hand sanitizer
b) is a reference diagram

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

A first embodiment of a face recognition access control system using a thermal imager according to the present invention includes an occupant monitoring unit and a management server as shown in FIG. 1 .

The occupant monitoring unit includes a face recognition terminal 10 and a thermal imaging camera module 20 .

The face recognition terminal 10 is for recognizing the face of an entrant. The technology of the face recognition terminal 10 is a face detection technology that finds a face in a photographed image, and authentication that confirms whether the detected face is the face of a registered user. divided into parts.

First, an image taken to detect a face is reduced at a certain rate regardless of the size of the face.

Then, in order to minimize the interference of lighting, the image is converted into a black-and-white flat relief image, and a face is found based on the components of the face.

After confirming the position of the face, the face detection process is completed by restoring the original image.

In the early face authentication technology, a method of distinguishing a detected face by the geometrical features of the face was used, which is to find facial components such as eyes, nose, and mouth, and use the difference in topographical characteristics between these components.

However, in recent years, more complex face authentication technology has been used to process various face shapes caused by facial expressions, lighting, angles, and the like.

As an example, the entire face contour, location information of eyes, nose, and mouth and corresponding features are first identified and used as a factor in determining face recognition.

And, after extracting and transforming only the edge information of the face, another facial feature factor is selected based on the density of the line, etc., so that the face extracted from the image and the user face registered in the system The face is recognized by comparison.

The thermal imaging camera module 20 measures the body temperature of an occupant and transmits it to the face recognition terminal 10, and refers to a device that tracks and detects heat and displays it on a screen at a glance.

A general camera has the same structure as the human eye and captures images similar to what our eyes see, but a thermal imaging camera is a special equipment that uses only heat to take pictures.

Utilizing this point, it is being used usefully in various fields, and it is also used for forest fire monitoring by installing a thermal imaging camera on an unmanned aerial vehicle (drone).

Even small fires that cannot be seen from afar can be captured by thermal imaging cameras.

In addition, it is also used to easily determine whether a livestock has a disease, because the livestock observed to have a particularly high fever compared to other livestock is more likely to be ill.

It is also used for military purposes. Using a thermal imaging camera, even at night when there is no light, it is easy to find the body of a person who is generating heat by itself, so it is used as night surveillance equipment.

As such, the thermal imaging camera shows the screen according to how much heat it generates, so you can check the object regardless of the presence of obstacles such as smoke or light.

Such a face recognition terminal 10 and the thermal imaging camera module 20 may be formed as a separate type or may be formed integrally.

At this time, the face recognition terminal 10 is configured to automatically recognize the face of the entrant using artificial intelligence (AI) technology and automatically display the occupant's body temperature measured by the thermal imaging camera.

In the management server 30, the administrator or operator sets the allowable range of the body temperature of the occupants in advance, and the body temperature information of the entrants transferred from the thermal imaging camera module 20 to the face recognition terminal 10 is transmitted, and the It is to match, store and display facial information and body temperature information.

This management server 30 is configured to open and close the door by transmitting a control signal to the door through which the visitor enters. According to the body temperature information of the visitor, when the body temperature is above the allowable range, the control signal is provided to the door to close the door. and transmits a control signal to the door to open the door when the body temperature is below the allowable range according to the body temperature information of the visitor.

A second embodiment of the face recognition access control system using a thermal imaging camera according to the present invention includes an occupant monitoring unit and a management server 30 as shown in FIG. 1 .

The occupant monitoring unit includes a face recognition terminal 10 that registers the user, sets the allowable temperature range of entrants, recognizes the occupant's face, and a thermal imaging camera module ( 20) is included.

The management server 30 transmits the face information of the person recognized by the face recognition terminal 10 and the body temperature information of the person who is transferred to the face recognition terminal 10, matches the transmitted face information with the body temperature information, and stores it and display.

At this time, it is characterized in that access is permitted only when the face information recognized by the face recognition terminal 10 is a registered user and the body temperature of the person entering or leaving is less than the allowable range.

On the other hand, in the face recognition access control system using a thermal imaging camera according to the present invention, the client software 40 that can inquire the face information and body temperature information of the person who is matched and stored in the management server 30 in a wired/wireless communication method is provided. It may further include a mounted computer or mobile terminal.

Accordingly, not only the management server 30 but also the client software 40 such as a computer program or a mobile app can inquire the matched face information and body temperature information of the entrant.

According to the present invention configured as described above, a person who is at risk of infection exposed to the corona virus, etc. caused by hand contact, the main cause of infection, is directly hand It is possible to safely and accurately determine whether or not an infected person is infected with only face information and temperature information without contact.

That is, by matching the entrant's body temperature information measured through the thermal imaging camera module 20 with the occupant's face information detected through the face recognition terminal 10, the entrance and exit of a certain control area using the occupant's body temperature information It has the advantage of being used as control and follow-up management information.

3 is a view showing a process of implementing the first embodiment of the face recognition access control method using a thermal imaging camera according to the present invention.

A first embodiment of a face recognition access control method using a thermal imager according to the present invention includes a first step (S1) of setting an allowable range of body temperature of an occupant in a management server as shown in FIG. 3; a second step (S2) of recognizing the face of the entrant through the face recognition terminal and measuring the body temperature of the entrant through the thermal imaging camera module; a third step (S3) of transmitting the face information of the person recognized by the face recognition terminal and the body temperature information measured by the thermal imaging camera module to the server for management (S3); a fourth step (S4) of matching the face information and body temperature information of the occupants and storing them in a management server; a fifth step (S5) of displaying the matched person's face information and body temperature information; a sixth step (S6) of determining whether the body temperature of the occupant is within the allowable range; a seventh step (S7) of restricting access when the body temperature of the occupant is above the allowable range; and an eighth step (S8) of allowing entry if the body temperature of the occupant is below the allowable range.

The face recognition terminal and the thermal imaging camera module may be formed as a separate type or as an integrated type.

In this case, the face recognition terminal is configured to automatically recognize the face of the entrant using artificial intelligence (AI) technology and automatically display the occupant's body temperature measured by the thermal imaging camera.

In addition, in the fifth step (S5) of displaying the matched face information and body temperature information of the entrant, the client can inquire the face information and body temperature information of the entrants matched and stored in the management server in the fourth step in a wired/wireless communication method It may further include displaying with a computer or mobile terminal equipped with software.

Accordingly, not only the management server but also the client software such as a computer program or a mobile app can inquire the matched face information and body temperature information of the visitor.

4 is a view showing a process of implementing the second embodiment of the face recognition access control method using a thermal imaging camera according to the present invention.

The second embodiment of the face recognition access control method using a thermal imaging camera according to the present invention, as shown in FIG. 4, includes a first step (S10) of registering a user in the face recognition terminal and setting the allowable range of body temperature of the entrant. ); a second step (S20) of recognizing the face of the entrant through the face recognition terminal and measuring the body temperature of the entrant through the thermal imaging camera module; a third step of determining whether the face information recognized through the face recognition terminal is a registered user (S30); a fourth step (S40) of determining whether the body temperature of an entrant is within an allowable range when the face information recognized through the face recognition terminal is a registered user; a fifth step (S50) of restricting access when the body temperature of the occupant is above the allowable range; and a sixth step (S60) of allowing entry if the body temperature of the occupant is below the allowable range.

At this time, the face information of the entrant recognized in the second step (S20) and the measured body temperature information of the entrant are transmitted to the management server, and the facial information and body temperature information of the entrant are matched and stored in the management server, The method may further include a seventh step (S70) of displaying, through a computer or a mobile terminal equipped with client software, which can inquire the face information and body temperature information matched and stored in the management server through wired/wireless communication methods.

A hand sanitizing device 100 is provided at the bottom of the face recognition single blower 10, but the hand sanitizing device 100 includes a hand receiving space 110 capable of accommodating the user's hand in front;

a first outlet 130 through which the wind generated by the blowing fan 120 is discharged on the upper side of the hand receiving space 110;

The blower fan so that the wind discharged to the first outlet 130 is sucked into the suction unit 121 of the blower fan 120 via the hand receiving space 110 and moves back to the first outlet 130 . a duct portion 132 in which a conduit 131 is formed between the discharge portion 122 of the 120 and the first discharge port 130;

a pump (not shown) for pumping the hand disinfection liquid to the outside of the hand receiving space 110;

A nozzle (not shown) for spraying the hand sanitizing liquid into the center of the hand receiving space 110 when a second discharge port 133 is located when pumping from the pump on the upper side of the hand receiving space 110;

a second discharge port 133 through which the duct unit 132 is formed between the discharge unit 122 and the first discharge port 130;

A wall 134 blocking between the first outlet 130 and the second outlet 133 is formed, and the wall is connected to one side by a hinge shaft 135 so that the wall 134 is connected to the hinge shaft 135. The wall 134 is configured to open when rotated about the center.

The heater 137 is accommodated in the first outlet 133.

The wall 134 is vertically erected by a spring 136 to block between the first and second outlets 130 and 133.

At the same time as the blowing fan 120 is operated by applying power, the hand sanitizer liquid is sprayed from the pump through the nozzle.

Therefore, initially, the weak wind of the blowing fan 120 moves to the pipe line 131 and is discharged to the second discharge port 133 and is sprayed with the disinfectant liquid by hand. After that, when the pump is stopped, the liquid injection is determined

After that, the blowing fan 120 leads to a strong wind. As a result, the wall 134 erected by the elastic force of the spring 136 rotates in the direction of the first outlet 130 with the hinge shaft 135 as the center by the strong wind. At this time, the strong wind is discharged to the first outlet 130 .

At this time, the heater is powered on, so the wind turns into warm air to dry your hands.

Power supply to the heater is interrupted by the wall when the wall is overturned (opened by strong wind) and a switch (not shown) operates. At this time, power is supplied to the heater

The reason for doing this is that when the hand sanitizer liquid passes through the heater 137 on the wind of the blower fan 120, a odor may be generated by the heater 137 at high temperature, so the second outlet 133 is initially opened. After that, the first outlet 130 is opened to dry hands by the warm air of the heater.

10: face recognition terminal
20: thermal imaging camera module
30: server for management
100 ; Hand sanitizer (100)

Claims (1)

A hand sanitizing device 100 is provided at the bottom of the face recognition single blower 10, but the hand sanitizing device 100 includes a hand receiving space 110 capable of accommodating the user's hand in front;
a first outlet 130 through which the wind generated by the blowing fan 120 is discharged on the upper side of the hand receiving space 110;
The blower fan so that the wind discharged to the first outlet 130 is sucked into the suction unit 121 of the blower fan 120 via the hand receiving space 110 and moves back to the first outlet 130 . a duct portion 132 in which a conduit 131 is formed between the discharge portion 122 of the 120 and the first discharge port 130;

a pump (not shown) for pumping a hand disinfectant liquid to the outside of the hand receiving space 110;
A nozzle (not shown) for spraying the hand sanitizing liquid into the center of the hand receiving space 110 when a second discharge port 133 is located when pumping from the pump on the upper side of the hand receiving space 110;
a second discharge port 133 through which the duct unit 132 is formed between the discharge unit 122 and the first discharge port 130;
A wall 134 blocking between the first outlet 130 and the second outlet 133 is formed, and the wall is connected to one side by a hinge shaft 135 so that the wall 134 is connected to the hinge shaft 135 . A face recognition access control system using a thermal imager equipped with a hand disinfection device, characterized in that it includes a configuration to open the wall (134) when it rotates around the center.

Images