KR102268065B1 - Visitor management device for prevention of infection - Google Patents

Abstract

In accordance with various embodiments of the present invention, a visitor management device for prevention of infection uses a thermal imaging camera to check if there is an obstacle which prevents the measurement of the temperature of a user's forehead. If there is no obstacle, the device measures a user's temperature by setting a photographing point of the thermal imaging camera as a first feature point extracted from the user's forehead. When there is an obstacle, the device measures the user's temperature by setting the photographing point of the thermal imaging camera as a second feature point extracted between the eyebrows of the user or as a third feature point extracted between the pupils of the user. When the user's temperature is within a normal range, the device acquires a user face image through the RGB camera. The device checks whether a fourth feature point is extracted from a chin boundary of the user among the acquired face image. If the fourth feature point is not extracted, the device can determine that the user is wearing a mask and issue an authentication sticker using an authentication sticker issuer. Other embodiments are possible.

Description

Access control device for preventing infectious disease {VISITOR MANAGEMENT DEVICE FOR PREVENTION OF INFECTION}

The present invention relates to a device for managing an occupant for preventing an infectious disease, and more particularly, to a device for authenticating entry and exit of an entrant only when the occupant's body temperature is within a normal range and wearing a mask.

Recently, the spread of local infection through multi-use facilities of Corona 19 has become a problem. In public offices, schools, airports, train stations, bus terminals, subway stations, large marts, department stores, or entertainment facilities, where a large number of users enter and exit, it is necessary to control their temperature and wear masks.

Currently, in large facilities such as government offices, the personal information of passers-by is recorded by hand using paper and pen, and the temperature check of passers-by is usually checked with a thermal imaging camera, and when a fever is found, the manager uses an infrared thermometer. I am checking again. In smaller facilities, rather than expensive thermal imaging cameras, the manager is taking the method of checking the fever status of passers-by with an infrared thermometer. In addition, the manager visually checks whether or not to wear a mask to control access.

Therefore, passers-by must be exposed to the infection state using pens and papers that several people have touched, and the manager must measure the temperature of the person entering the facility and visually check whether or not they are wearing a mask, so the manager is exposed to the infection state. There is this.

In addition, it is difficult to secure a skilled thermal imaging camera operator and infrared thermometer operator because each multi-use facility has to measure the temperature of each person entering the facility, and incorrect measurement by unskilled personnel is pointed out as a problem.

KR Patent Publication 10-2017-0080739

The present invention has been devised to solve the above problems, and it is to provide an apparatus for accurately measuring the body temperature of an occupant by using the forehead or the forehead as a body temperature measurement site depending on whether the forehead is exposed in face recognition using an image. There is this.

Another object of the present invention is to provide an apparatus for accurately determining whether to wear a mask by using the feature points of the outer boundary of the jaw line.

Another object of the present invention is to provide a device for automatically disinfecting hands and shoes to a user.

In addition, an object of the present invention is to provide an apparatus for automatically removing and discarding a release paper protecting an adhesive surface of an authentication sticker while automatically issuing an authentication sticker to a user whose authentication is completed.

According to various embodiments of the present disclosure, an occupant management apparatus for preventing infectious diseases includes: a housing having a first space into which a user's hand is put and a second space into which a user's shoes are put; an RGB camera installed in the housing to recognize at least a part of the user's body and scan a QR code; a thermal imaging camera installed in the housing to measure a user's body temperature; a hand sanitizer disposed in the first space to spray a disinfectant solution when the user's hand is inserted; a shoe sterilizer disposed in the second space to spray a disinfectant solution when the user's shoes are inserted; an authentication sticker issuer installed in the housing to issue an authentication sticker for entry and exit; and a control unit for controlling each component installed in the housing, wherein the control unit checks whether there is an obstacle obstructing the temperature measurement on the user's forehead through the thermal imaging camera, and if the obstacle does not exist , the user's temperature is measured by setting the photographing point of the thermal imaging camera as the first feature point extracted from the user's forehead, whereas, when the obstacle is present, the photographing point of the thermal imaging camera is extracted between the user's eyebrows. The user's temperature is measured by setting the feature point or a third feature point extracted between the user's pupils, and when the user's temperature is within the normal range, the user's face image is acquired through the RGB camera, and among the acquired face images It is checked whether the fourth feature point is extracted from the user's jaw boundary, and when the fourth feature point is not extracted, it is determined that the user is wearing a mask, and the authentication sticker can be issued using the authentication sticker issuer.

In one embodiment of the present invention, the control unit may spray the disinfectant solution through the hand sanitizer and the shoe sanitizer during or after completion of measuring the user's temperature through the thermal imaging camera.

In an embodiment of the present invention, the LED light emitting unit installed in the housing to emit at least one color and a speaker unit installed in the housing to output a sound, wherein the controller is provided that the temperature of the user is within a normal range. If not, a color indicating high fever may be output through the LED light emitting unit, and a voice message indicating high fever may be outputted through the speaker unit.

In one embodiment of the present invention, when the fourth feature point is extracted, the control unit determines that the user does not wear a mask, outputs a color indicating that the mask is not worn through the LED light emitting unit, and outputs the color through the speaker unit A voice message indicating that the mask is not worn may be output.

In one embodiment of the present invention, further comprising a reader for recognizing a card or an NFC module, wherein the control unit receives at least one of card information obtained through the reader, NFC information, or palm information obtained through the RGB camera to check whether the user is a registrant, if the user is a registrant, the user's face is photographed through the thermal imaging camera and the RGB camera, and if the user is unregistered, an occupant registration voice message is output through the speaker unit. can

In an embodiment of the present invention, the control unit requests a QR code through a monitor unit or a speaker unit provided in the housing after the issuance of the authentication sticker, stores personal information included in the QR code, and sends the QR code You can scan and approve access.

In an embodiment of the present invention, the controller may calculate an eyebrow boundary line, a left feature point of the eyebrow boundary line, a right feature point of the eyebrow boundary line, and the second feature point using Equation 1 below.

[Equation 1]

Here, X is a parameter for estimating the maximum probability of the density of components (eg, cluster density of eyebrows, etc.) among each component of the face, exp is the exponential, i is the density of the feature components, and j is the confirmed feature. is the component density of the vector, ω is the cube root of 1 (ω: omega), p is the feature position indicator variable, μ is the feature mean (μ:mu) value, ∑ is the feature component density of “i” It means iteration until a value is found, n is the target position with respect to the center point of the feature vector, and ε is the density position of the feature vector.

In an embodiment of the present invention, the controller may detect the boundary line of the chin and the fourth feature point through Equation 2 below.

[Equation 2]

Here, x is a parameter for estimating the maximum probability of the density of components (eg, cluster density of eyebrows, etc.) among each component of the face, i is the feature component density, j is the component density of the determined feature vector, and μ is It is the feature average (μ:mu) value, ∑ means iteration until we find the feature component density value of “i”, T is the Transposition variable of 0Feature vector, and y is the vertical position of each component of the face. It is the feature vector component density, and n is the target position with respect to the center point of the feature vector.

In an embodiment of the present invention, the control unit may calculate the forehead and hair boundary line, the left feature point of the forehead and hair boundary line, and the right feature point of the forehead and hair boundary line using Equation 4 below.

[Equation 4]

Here, X is a parameter for estimating the maximum probability of the density of components (eg, cluster density of eyebrows, etc.) among each component of the face, exp is the exponential, i is the density of the feature components, and Ф is the variable "i is the first-order component density probability vector of the feature vector that fully specifies the component density of “, P is the feature position indicator variable, μ is the feature mean (μ:mu) value, and ∑ is the feature component density of “i”. It means iteration until a value is found, where d is Distance (“P” is the distance from the reference point), N is the center point of the feature vector based on the variable “P”, and T is the Transposition (matrix transposition) of the feature vector. ) is a variable.

In an embodiment of the present invention, the controller may calculate the first feature point through proportional integration of Equation 1 and Equation 4 expressed by Equation 5 below.

[Equation 5]

According to the present invention as described above, it has various effects as follows.

According to the present invention, it is possible to accurately determine the user's body temperature and whether or not to wear a mask by using facial recognition.

In addition, according to the present invention, it is possible to increase the effectiveness of preventing infectious diseases by allowing the user to automatically disinfect his/her hands and shoes.

In addition, the present invention can increase user convenience by automatically removing the release paper that protects the adhesive surface of the authentication sticker while automatically issuing the authentication sticker to the user who has completed authentication.

1 is a diagram schematically illustrating an access management apparatus according to an embodiment of the present invention.
2 is a flowchart illustrating a method for managing an occupant according to an embodiment of the present invention.
FIG. 3 is a flowchart illustrating an example of the method for managing a visitor of FIG. 2 .
4 is a flowchart illustrating an example of measuring body temperature and determining whether to wear a mask of FIG. 2 .
5 is an exemplary diagram for explaining a method for managing an occupant according to an embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. And, in describing the embodiment of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, the terms to be described later are terms defined in consideration of the functions of the present invention, which may vary according to the intention or custom of the user or operator. Therefore, the definition should be made based on the content throughout this specification.

A preferred embodiment of the present invention will be described with reference to the accompanying drawings as follows. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, only this embodiment allows the disclosure of the present invention to be complete and the scope of the invention to those of ordinary skill in the art completely It is provided to inform you.

Various embodiments of the present document may be implemented as software (eg, a program) including instructions stored in a machine-readable storage medium (eg, a computer). The device is a device capable of calling a stored command from a storage medium and operating according to the called command, and may include an electronic device (eg, a server) according to the disclosed embodiments. Instructions may include code generated or executed by a compiler or interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not include a signal and is tangible, and does not distinguish that data is semi-permanently or temporarily stored in the storage medium.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product may be distributed in the form of a machine-readable storage medium (eg, compact disc read only memory (CD-ROM)) or online through an application store (eg, Play Store™). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

Each of the components (eg, a module or a program) according to various embodiments may be composed of a singular or a plurality of entities, and some sub-components of the aforementioned sub-components may be omitted, or other sub-components may be It may be further included in various embodiments. Alternatively or additionally, some components (eg, a module or a program) may be integrated into a single entity to perform the same or similar functions performed by each corresponding component prior to integration. According to various embodiments, operations performed by a module, program, or other component are executed sequentially, parallel, iteratively, or heuristically, or at least some operations are executed in a different order, are omitted, or other operations are added. can be

Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used with the meaning commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless clearly defined in particular.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. As used herein, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components.

1 is a diagram schematically illustrating an access management apparatus according to an embodiment of the present invention.

Referring to FIG. 1 , an occupant management apparatus 100 for preventing infectious diseases according to an embodiment of the present invention includes a controller (not shown), a housing 101 , a thermal imaging camera 102 , an RGB camera 103 , and a hand. Disinfector (not shown), shoe sterilizer (not shown), authentication sticker issuer 106, LED light emitting unit 107, speaker unit 108, reader 109, monitor unit 110, communication unit 111, microphone It may include a unit 112 , a trash can 113 , and an authentication sticker separator (not shown). For example, the access management apparatus 100 of the present invention may be a kiosk.

In one embodiment, the housing 101 may include a first space 104 into which the user's hand is put and a second space 105 into which the user's shoes are put, and each component of the access management device 100 is are installed

In one embodiment, the thermal imaging camera 102 may be installed in the housing to measure the body temperature of the user. For example, the thermal imaging camera 102 may acquire a thermal image by photographing the user's upper body. The thermal image may be displayed on the monitor unit 110 through the control unit.

In one embodiment, the RGB camera 103 may be installed in the housing to recognize at least a part of the user's body and scan the QR code. For example, the RGB camera 103 may photograph the user's face and transmit it to the controller. For example, an image acquired through the RGB camera 103 may be utilized for face recognition, palm recognition, iris recognition, and the like.

In an embodiment, a hand sanitizer (not shown) may be disposed in the first space 104 to spray the disinfectant solution when the user's hand is inserted.

In an embodiment, the shoe sterilizer (not shown) may be disposed in the second space 105 to spray the disinfectant solution when the user's shoes are inserted.

In an embodiment, the authentication sticker issuer 106 may be installed in the housing 101 to issue an authentication sticker for access and passage. For example, body temperature check date, normal body temperature check, mask wearing, and time information may be printed on the authentication sticker. In the present invention, the authentication sticker can be issued as a smart electronic authentication sticker, for example, a QR code. For example, a user's phone number may be input through the microphone unit 112 , and measured body temperature and mask wearing determination information may be generated as a QR code and transmitted to the input phone number.

In one embodiment, the LED light emitting unit 107 may be installed in the housing to emit at least one color. For example, the LED light emitting unit 107 may emit a red light indicating a warning according to the control of the controller.

In one embodiment, the speaker unit 108 may be installed in the housing 101 to output a sound to notify the user of a guide message by voice, to notify the result of body temperature measurement, or to output a warning message when a fever is checked.

In an embodiment, the reader 109 may recognize a card or an NFC module. Also, for example, the reader 109 may scan a QR code displayed on the user's phone monitor. The scanned QR code is transmitted to the control unit, and the control unit can interpret the QR code to register the user's personal information. For example, when the reader 109 operates as a QR code recognizer, the user's personal information included in the scanned QR code is transmitted through a mobile network such as 3G, 5G, or LAN (WAN) through the KI-Pass of the Ministry of Health and Welfare. (Electronic access list) can be transmitted to DB.

In an embodiment, the monitor unit 110 may be provided in the housing 101 and may display a photographed thermal image, a measured body temperature, a temperature check determination result, whether a mask is worn, and the like.

In an embodiment, the communication unit 111 is for transmitting the authentication result to the user's phone, and may be configured as any one of Wi-Fi communication, Bluetooth communication, and mobile phone communication.

In an embodiment, the microphone unit 112 may obtain a user's voice command. That is, since there is a risk of infection in a contact input device (eg, a keyboard), it is more preferable to use voice input to avoid this.

In one embodiment, the authentication sticker separator (not shown) may automatically remove the release paper protecting the adhesive surface of the authentication sticker from the automatically issued authentication sticker, and discard the removed release paper in the trash can 113 .

In an embodiment, the control unit may control each component installed in the housing 101 . For example, the control unit may be implemented on a circuit board including a computer executing an occupant management program for preventing infectious diseases and peripheral parts thereof. The control unit may transmit the measurement result information to a manager device (not shown) connected by wire or wireless. Here, the manager device may be a main server of a multi-use facility or a management server of a competent government office.

In the present invention, the authentication sticker or QR code may include information such as a phone number, measurement location (kiosk serial number and installation location), measurement time (date and time), measured body temperature, and whether or not to wear a mask.

2 is a flowchart illustrating a method for managing an occupant according to an embodiment of the present invention. FIG. 3 is a flowchart illustrating an example of the method for managing an occupant of FIG. 2 . 4 is a flowchart illustrating an example of measuring body temperature and determining whether to wear a mask of FIG. 2 . 5 is an exemplary diagram for explaining a method for managing an occupant according to an embodiment of the present invention. The operations of FIGS. 2 to 4 may be performed by the occupant management apparatus 100 illustrated in FIG. 1 .

2 to 5 , in an embodiment, the control unit may identify a user in operation 21 .

For example, the device 100 of the present invention may identify the user in mode 1 of operation 31 and mode 2 of operation 32 . In the case of mode 1, in operation 33, the user may be requested to create a questionnaire, and when information related to the questionnaire created by the user is input, the user may be identified and a face photographing operation may be performed.

For example, in mode 2, the control unit may be always connected to the information desk through the communication unit 111 , and in operation 34 , card information obtained through the reader 109 , NFC information, or RGB camera 103 through It may be confirmed whether the user is a registrant through at least one of the acquired palm information.

In addition, when the user is not registered, the controller may output a voice message for resident registration through the speaker unit 108 in operation 35 , and transmit a message indicating a situation requiring resident registration to the information desk in operation 36 .

In an embodiment, in operation 22, the controller may photograph the user's face. For example, when the user is a registrant, the controller may photograph the user's face through the thermal imaging camera 102 and the RGB camera 103 in operation 37 .

In an embodiment, in operation 23 , the controller may determine whether the user's body temperature is high.

For example, in operation 38 , the control unit checks whether an obstacle is present on the user's forehead through the thermal imaging camera 102 , and if there is no obstacle, the thermal imaging camera 102 . The user's temperature may be measured by setting the photographing point as the first feature point (f5 in FIG. 5 ) extracted from the user's forehead. Here, the obstacle may be the user's hair or a hair band.

On the other hand, when there is an obstacle, the control unit converts the photographing point of the thermal imaging camera 102 into a second feature point extracted between the user's eyebrows (f4 in FIG. 5) or a third feature point extracted between the user's pupils (f3 in FIG. 5). It can be set to measure the user's temperature.

When the user's temperature is not within the normal range, in operation 39 , the controller may output a color indicating high fever through the LED light emitting unit 107 and output a voice message indicating high fever through the speaker unit 108 .

Meanwhile, in operations 40 to 43 , the controller may spray the disinfectant solution through the hand sanitizer and the shoe sanitizer during or after completion of measuring the user's temperature through the thermal imaging camera 102 .

In an embodiment, in operation 24 , the controller may determine whether the user wears a mask.

For example, in operation 44, when the user's temperature is within a normal range, the controller acquires a face image of the user through the RGB camera 103, and among the acquired face images, a fourth feature point (FIG. 5) at the user's chin boundary of f11 to f16) is extracted, and when the fourth feature point (f11 to f16 in FIG. 5) is not extracted, it may be determined that the user wears the mask.

On the other hand, when the fourth feature point (f11 to f16 in FIG. 5) is extracted, the control unit determines that the user does not wear a mask in operation 45 and outputs a color indicating that the mask is not worn through the LED light emitting unit 107, , a voice message indicating that the mask is not worn may be output through the speaker unit 108 .

In an embodiment, the control unit may scan a QR code (electronic access list) in operation 25 . For example, in operations 46 to 49, the control unit requests a QR code through the monitor unit 110 or the speaker unit 108 provided in the housing, stores personal information included in the QR code, and scans the QR code. It is possible to create an electronic access list through this.

In an embodiment, when a specified condition is satisfied in operation 26, the controller may authenticate the user. For example, the specified condition may be a case in which the body temperature is normal and a mask is worn.

For example, when it is determined that the user wears a mask, the controller may issue an authentication sticker using the authentication sticker issuer 106 in operation 50 .

For example, the control unit may automatically remove the release paper that protects the adhesive surface of the authentication sticker through the authentication sticker separator while automatically issuing the authentication sticker to the user whose authentication has been completed, thereby enhancing user convenience.

In addition, the control unit may open the gate so that the user can enter after issuing the authentication sticker (operation 51).

Accordingly, the present invention can automatically and quickly and accurately determine the body temperature of an entrant and whether or not to wear a mask, thoroughly prevent infectious diseases through a hand sanitizer and a shoe sterilizer, and increase user convenience by easily controlling the authentication sticker release paper can

Meanwhile, the configuration of extracting each feature point and securing metadata for each body part in order to measure body temperature and determine whether to wear a mask according to the present invention will be described in more detail with reference to FIGS. 4 and 5 .

In an embodiment, the controller may detect facial features, such as a pupil, a forehead, an eyebrow, a nose, and a jaw line, in operation 54 through an image acquisition operation 52 of the RGB camera 103 and a facial feature recognition server operation 53 .

More specifically, the controller may detect the pupil feature (operation 55), extract pupil metadata X, Y, W, H, and index (operation 56), and store the characteristic meta record in the database (operation 57). Pupil features can be extracted through existing facial recognition technology.

In an embodiment, the controller may detect eyebrow features (operation 58), extract eyebrow metadata X, Y, W, H, and indexes (operation 59), and store (60) the feature meta record in a database.

For example, the control unit calculates the eyebrow boundary line d4, the left characteristic point f6 of the boundary line d4, and the right characteristic point f7 and the second characteristic point f4 of the boundary line d4 using Equation 1 below. can

[Equation 1]

Here, X is a parameter for estimating the maximum probability of the density of components (eg, cluster density of eyebrows, etc.) among each component of the face, exp is the exponential, i is the density of the feature components, and j is the confirmed feature. is the component density of the vector, ω is the cube root of 1 (ω: omega), p is the feature position indicator variable, μ is the feature mean (μ: mu) value, ∑ is the feature component density of “i” It means iteration until a value is found, n is the target position with respect to the center point of the feature vector, and ε is the density position of the feature vector.

In an embodiment, the controller may detect jaw line features (operation 61), extract jaw line metadata X, Y, W, H, and indexes (operation 62), and store the characteristic meta record in a database (63). .

For example, the controller may detect the boundary line A of the jaw, the fourth feature points f11 to f16, and a search result item through Equation 2 below.

[Equation 2]

x is a parameter for estimating the maximum probability of component density (eg, eyebrow cluster density, etc.) among each component of the face, i is the feature component density, j is the component density of the determined feature vector, and μ is the feature average (μ:mu) value, ∑ means iteration until the feature component density value of “i” is found, T is the Transposition variable of the feature vector, and y is the vertical feature vector of each face component. is the component density, and n is the target position with respect to the center point of the feature vector.

On the other hand, in an embodiment, the controller may recognize the facial jaw line characteristics after operation 63, determine whether to wear a mask, and determine the user's state by unconfirmed wearing a mask when the user does not wear a mask, and the user When wearing a mask, it is possible to determine the user status by confirming wearing the mask.

In an embodiment, the controller may calculate the left and right pupillary distance (PD) (operation 64), extract a third characteristic point at the center of the pupil distance (operation 65), and store the feature meta record in the database 66 ) can be stored in

For example, the controller may detect the pupil line d3 through face recognition, and the left pupil feature point f1, the right pupil feature point f2, and the third feature point f3 can be detected through Equation 3 below. can

[Equation 3]

In an embodiment, the controller may calculate the forehead center (operation 67), extract a first feature point of the forehead center (operation 68), and store the feature meta-record in the database 69 .

For example, the controller may calculate the feature point f8 on the left side of the boundary line d6, the feature point f8 on the left side of the boundary line d6, and the feature point f9 on the right side of the boundary line d6 by using Equation 4 below.

[Equation 4]

X is a parameter for estimating the maximum probability of the density of components (eg, cluster density of eyebrows, etc.) among each component of the face, exp is the exponential, i is the density of the feature components, and Ф is the value of the variable "i". It is the first-order component density probability vector of the feature vector that fully specifies the component density, P is the feature position indicator variable, μ is the feature average (μ:mu) value, and ∑ is the feature component density value of “i”. It means iteration until found, where d is the Distance (“P” is the distance from the reference point), N is the center point of the feature vector based on the variable “P”, and T is the Transposition variable of the feature vector. to be.

Also, the controller may calculate the first feature point f5 corresponding to the center of the forehead through proportional integration of Equations 1 and 4 expressed by Equation 5 below.

[Equation 5]

In an embodiment, the control unit may calculate a feature vertex (operation 70), determine whether an obstacle covers the forehead (operation 71), and when the forehead is covered, the third feature point of the pupil center It is possible to set the shooting point (operation 74) by using it, and if the forehead is not covered by an obstacle, the shooting point can be set using the first characteristic point of the forehead (operation 72), and the characteristic meta record is stored in the database, respectively (operations 73 and 75) may be performed, and accordingly, the body temperature may be measured (operation 76).

According to various embodiments of the present disclosure, an occupant management apparatus for preventing infectious diseases includes: a housing having a first space into which a user's hand is put and a second space into which a user's shoes are put; an RGB camera installed in the housing to recognize at least a part of a user's body and scan a QR code; a thermal imaging camera installed in the housing to measure a user's body temperature; a hand sanitizer disposed in the first space to spray a disinfectant solution when the user's hand is inserted; a shoe sterilizer disposed in the second space to spray a disinfectant solution when the user's shoes are inserted; an authentication sticker issuer installed in the housing to issue an authentication sticker for entry and exit; and a control unit for controlling each component installed in the housing, wherein the control unit checks whether there is an obstacle obstructing the temperature measurement on the user's forehead through the thermal imaging camera, and if the obstacle does not exist , the temperature of the user is measured by setting the photographing point of the thermal imaging camera as the first feature point extracted from the user's forehead, whereas, when the obstacle is present, the photographing point of the thermal imaging camera is extracted between the user's eyebrows. The user's temperature is measured by setting the feature point or a third feature point extracted between the user's pupils, and when the user's temperature is within the normal range, the user's face image is acquired through the RGB camera, and among the acquired face images It is checked whether the fourth feature point is extracted from the user's jaw boundary, and when the fourth feature point is not extracted, it is determined that the user is wearing a mask, and the authentication sticker can be issued using the authentication sticker issuer.

According to various embodiments of the present disclosure, the controller may spray the disinfectant solution through the hand sanitizer and the shoe sanitizer during or after completion of measuring the user's temperature through the thermal imaging camera.

According to various embodiments, an LED light emitting unit installed in the housing to emit at least one color; and a speaker unit installed in the housing to output a sound, wherein the control unit outputs a color indicating high heat through the LED light emitting unit when the temperature of the user is not within a normal range, and the high temperature through the speaker unit It is possible to output a voice message indicating that

According to various embodiments, when the fourth feature point is extracted, the control unit determines that the user does not wear a mask, outputs a color indicating that the mask is not worn through the LED light emitting unit, and does not wear the mask through the speaker unit It is possible to output a voice message indicating that

According to various embodiments, a reader for recognizing a card or an NFC module; further comprising, wherein the control unit through at least one of card information obtained through the reader, NFC information, or palm information obtained through the RGB camera Check whether the user is a registrant, if the user is a registrant, the user's face is photographed through the thermal imaging camera and the RGB camera, and if the user is not a registrant, an occupant registration voice message can be output through the speaker unit have.

According to various embodiments, the control unit, after issuing the authentication sticker, requests a QR code through a monitor unit or a speaker unit provided in the housing, stores personal information included in the QR code, and scans the QR code. access can be granted.

According to various embodiments of the present disclosure, the controller may calculate an eyebrow boundary line, a left feature point of the eyebrow boundary line, a right feature point of the eyebrow boundary line, and the second feature point using Equation 1 below.

[Equation 1]

Here, X is a parameter for estimating the maximum probability of the density of components (eg, cluster density of eyebrows, etc.) among each component of the face, exp is the exponential, i is the density of the feature components, and j is the confirmed feature. is the component density of the vector, ω is the cube root of 1 (ω: omega), p is the feature position indicator variable, μ is the feature mean (μ:mu) value, ∑ is the feature component density of “i” It means iteration until a value is found, n is the target position with respect to the center point of the feature vector, and ε is the density position of the feature vector.

According to various embodiments of the present disclosure, the controller may detect the boundary line of the chin and the fourth feature point through Equation 2 below.

[Equation 2]

Here, x is a parameter for estimating the maximum probability of the density of components (eg, cluster density of eyebrows, etc.) among each component of the face, i is the feature component density, j is the component density of the determined feature vector, and μ is It is the feature average (μ:mu) value, ∑ means iteration until we find the feature component density value of “i”, T is the Transposition variable of 0Feature vector, and y is the vertical position of each component of the face. It is the feature vector component density, and n is the target position with respect to the center point of the feature vector.

According to various embodiments of the present disclosure, the controller may calculate the forehead and hair boundary line, the left feature point of the forehead and hair boundary line, and the right feature point of the forehead and hair boundary line using Equation 4 below.

[Equation 4]

Here, X is a parameter for estimating the maximum probability of the density of components (eg, cluster density of eyebrows, etc.) among each component of the face, exp is the exponential, i is the density of the feature components, and Ф is the variable "i is the first-order component density probability vector of the feature vector that fully specifies the component density of “, P is the feature position indicator variable, μ is the feature mean (μ:mu) value, and ∑ is the feature component density of “i”. It means iteration until a value is found, where d is the Distance (“P” is the distance from the reference point), N is the center point of the feature vector based on the variable “P”, and T is the Transposition (matrix transposition) of the feature vector. ) is a variable.

According to various embodiments of the present disclosure, the controller may calculate the first feature point through proportional integration of Equation 1 and Equation 4 expressed by Equation 5 below.

[Equation 5]

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and not only the claims described below, but also all modifications equivalently or equivalently to the claims described below belong to the scope of the spirit of the present invention. will be.

100: access control device
101: housing
102: thermal imaging camera
103: RGB camera
104: first space (hand sanitizer)
105: second space (shoe sterilizer)
106: authentication sticker issuer
107: LED light emitting unit
108: speaker unit
109: reader
110: monitor unit
111: communication department
112: microphone unit
113: Trash

Claims (10)

In the visitor management device for the prevention of infectious diseases,
a housing having a first space into which the user's hand is put and a second space into which the user's shoes are put;
an RGB camera installed in the housing to recognize at least a part of the user's body and scan a QR code;
a thermal imaging camera installed in the housing to measure a user's body temperature;
a hand sanitizer disposed in the first space to spray a disinfectant solution when the user's hand is inserted;
a shoe sterilizer disposed in the second space to spray a disinfectant solution when the user's shoes are inserted;
an authentication sticker issuer installed in the housing to issue an authentication sticker for entry and exit; and
A control unit for controlling each component installed in the housing,
The control unit is
Checking whether there is an obstacle in the user's forehead that prevents temperature measurement through the thermal imaging camera,
If the obstacle does not exist, the temperature of the user is measured by setting the shooting point of the thermal imaging camera as the first feature point extracted from the user's forehead,
On the other hand, when the obstacle exists, the user's temperature is measured by setting the shooting point of the thermal imaging camera as a second feature point extracted between the user's eyebrows or a third feature point extracted between the user's pupils,
When the user's temperature is within the normal range, the user's face image is acquired through the RGB camera,
Check whether a fourth feature point is extracted from the user's chin boundary among the acquired face images,
If the fourth characteristic point is not extracted, it is determined that the user is wearing a mask, and the authentication sticker is issued using the authentication sticker issuer,
wherein the control unit calculates the eyebrow boundary line, the left feature point of the eyebrow boundary line, the right feature point of the eyebrow boundary line, and the second feature point using Equation 1 below.
[Equation 1]

Here, X is a parameter for estimating the maximum probability of the density of components (eg, cluster density of eyebrows, etc.) among each component of the face, exp is exponential, i is the density of feature components, and j is the determined feature is the component density of the vector, ω is the cube root of 1 (ω: omega), p is the feature position indicator variable, μ is the feature mean (μ:mu) value, ∑ is the feature component density of “i” It means iteration until a value is found, n is the target position with respect to the center point of the feature vector, and ε is the density position of the feature vector.
According to claim 1, wherein the control unit,
The device for preventing an infectious disease, characterized in that the disinfectant is sprayed through the hand sanitizer and the shoe sanitizer during or after the user's temperature is measured through the thermal imaging camera.
According to claim 1,
an LED light emitting unit installed in the housing to emit at least one color; and
Further comprising a speaker unit installed in the housing for outputting sound,
The control unit is
When the user's temperature is not within the normal range, a color indicating high fever is output through the LED light emitting unit, and a voice message indicating the high fever is outputted through the speaker unit.
According to claim 3, wherein the control unit,
When the fourth feature point is extracted, it is determined that the user is not wearing a mask, and a color indicating that the mask is not worn is outputted through the LED light emitting unit, and a voice message indicating that the mask is not worn is outputted through the speaker unit. Access control device to prevent infectious diseases.
4. The method of claim 3,
A reader for recognizing a card or NFC module; further comprising,
The control unit is
Confirming that the user is a registrant through at least one of card information obtained through the reader, NFC information, or palm information obtained through the RGB camera,
When the user is a registrant, the user's face is photographed through the thermal imaging camera and the RGB camera,
When the user is a non-registered person, the device for preventing an infectious disease characterized by outputting an occupant registration voice message through the speaker unit.
According to claim 1, wherein the control unit,
After issuing the authentication sticker, a QR code is requested through the monitor unit or speaker unit provided in the housing,
An access management device for preventing infectious diseases, characterized in that the personal information contained in the QR code is stored and the access is approved by scanning the QR code.
delete The apparatus of claim 1, wherein the control unit detects the boundary line of the jaw and the fourth characteristic point through Equation 2 below.
[Equation 2]

Here, x is a parameter for estimating the maximum probability of component density (eg, eyebrow cluster density, etc.) among each component of the face, i is the feature component density, j is the component density of the determined feature vector, and μ is It is the feature average (μ:mu) value, ∑ means iteration until we find the feature component density value of “i”, T is the Transposition variable of 0Feature vector, and y is the vertical position of each component of the face. It is the feature vector component density, and n is the target position with respect to the center point of the feature vector.
According to claim 1, wherein the control unit, the forehead and hair boundary line, the left feature point of the forehead and hair boundary line, and the right feature point of the forehead and hair boundary line using Equation 4 for the prevention of infectious diseases, characterized in that Access control device.
[Equation 4]

Here, X is a parameter for estimating the maximum probability of the density of components (eg, cluster density of eyebrows, etc.) among each component of the face, exp is the exponential, i is the density of the feature components, and Ф is the variable "i is the first-order component density probability vector of a feature vector that fully specifies the component density of “, P is the feature position indicator variable, μ is the feature mean (μ:mu) value, and ∑ is the feature component density of “i”. It means iteration until a value is found, where d is the Distance (“P” is the distance from the reference point), N is the center point of the feature vector based on the variable “P”, and T is the Transposition (matrix transposition) of the feature vector. ) is a variable.
The apparatus of claim 9, wherein the control unit calculates the first feature point through proportional integration of Equations 1 and 4, which are expressed by Equation 5 below.
[Equation 5]

Images