WO2022003852A1 - Authentication control device, authentication control system, authentication control method, and non-transitory computer readable medium - Google Patents

Abstract

An authentication control device (10) is provided with: an image acquisition unit (11) for acquiring a captured image capturing a pedestrian in a predetermined passage; an authentication control unit (12) for acquiring a biometric authentication result based on bio-information of a plurality of persons and bio-information of the pedestrian extracted from the captured image; a body surface temperature acquisition unit (13) for acquiring body surface temperature measured from the pedestrian; a determination unit (15) for determining a projection mode according to a combination of the biometric authentication result and the body surface temperature; and a projection control unit (16) for controlling a predetermined projection apparatus such that projection is performed by the determined projection mode at a predetermined projection area.

Description

Authentication control device, authentication control system, authentication control method and non-temporary computer-readable medium

The present invention relates to an authentication control device, an authentication control system, an authentication control method and a non-temporary computer-readable medium, and in particular, an authentication control device, an authentication control system, an authentication control method and a non-temporary method for controlling biometric authentication. Regarding computer readable media.

In a facility that authenticates at the time of entry / exit, the gate device installed at the entrance / exit authenticates the person who wishes to enter / exit, and controls the opening / closing of the gate according to the authentication result. In recent years, in order to authenticate a large number of people in parallel, a gateless walk-through type authentication system is required.

In addition, biometric authentication technologies such as face authentication and vein authentication are increasingly being used to authenticate those who wish to enter and leave. Here, Patent Document 1 discloses a technique relating to an authentication system that performs face authentication and vein authentication. Further, Patent Document 2 discloses that face recognition is used in a delivery storage system.

Also, from the viewpoint of preventing the spread of infectious diseases, it is becoming more common to check the health condition of a person at the time of admission, in addition to collating with information registered in advance, when determining admission qualifications. In Patent Document 4, a visible image is taken for a specific person and an infrared image is taken at the same time, the face of the person is recognized by the visible image, and a pulse is obtained from the infrared image of the skin region of the face. A technique relating to an imaging system capable of measuring vital signs such as body temperature and body temperature is disclosed.

Japanese Unexamined Patent Publication No. 2019-128880 Japanese Unexamined Patent Publication No. 2019-21729 Japanese Unexamined Patent Publication No. 2016-103786

In recent years, there has been an increasing need to check the authentication results and health status of applicants at the time of admission. However, the above-mentioned patent document has a problem that it is difficult to intuitively visually recognize the authentication result and the health condition.

This disclosure is made to solve such a problem, and is an authentication control device and an authentication control for easily grasping the authentication result and the health condition of an admission applicant in a walk-through type authentication system. It is intended to provide systems, authentication control methods and non-temporary computer readable media.

The authentication control device according to the first aspect of the present disclosure is
An image acquisition means for acquiring an image taken by a pedestrian on a predetermined passage, and
An authentication control means for acquiring biometric authentication results of biometric information of a plurality of persons and biometric information of the pedestrian extracted from the photographed image, and
A body surface temperature acquisition means for acquiring the body surface temperature measured from the pedestrian, and
A determination means for determining a projection mode according to a combination of the biometric authentication result and the body surface temperature,
A projection control means for controlling a predetermined projection device so as to project onto a predetermined projection area according to the determined projection mode, and a projection control means.
To prepare for.

The authentication control system according to the second aspect of the present disclosure is
With the shooting device,
Body surface temperature measuring device and
Projector and
Authentication control device and
Equipped with
The authentication control device is
An image acquisition means for acquiring a photographed image taken by a pedestrian on a predetermined passage by the photographing device, and an image acquisition means.
An authentication control means for acquiring biometric authentication results of biometric information of a plurality of persons and biometric information of the pedestrian extracted from the photographed image, and
A body surface temperature acquisition means for acquiring the body surface temperature measured from the pedestrian by the measuring device, and
A determination means for determining a projection mode according to a combination of the biometric authentication result and the body surface temperature,
A projection control means for controlling the projection device so as to project onto a predetermined projection area according to the determined projection mode, and a projection control means.
To prepare for.

The authentication control method according to the third aspect of the present disclosure is
The computer
Acquire the captured image taken by a pedestrian on a predetermined passage,
The biometric authentication result of the biometric information of a plurality of persons and the biometric information of the pedestrian extracted from the photographed image is acquired.
Obtaining the body surface temperature measured from the pedestrian,
The projection mode according to the combination of the biometric authentication result and the body surface temperature is determined.
A predetermined projection device is controlled so as to project onto a predetermined projection area according to the determined projection mode.

The non-temporary computer-readable medium in which the authentication control program according to the fourth aspect of the present disclosure is stored is a human-readable medium.
Image acquisition processing to acquire captured images taken by pedestrians on a predetermined passage,
Authentication control processing for acquiring biometric authentication results of biometric information of a plurality of persons and biometric information of the pedestrian extracted from the photographed image, and
The body surface temperature acquisition process for acquiring the body surface temperature measured from the pedestrian, and
A determination process for determining a projection mode according to a combination of the biometric authentication result and the body surface temperature, and
A projection control process that controls a predetermined projection device so as to project onto a predetermined projection area according to the determined projection mode, and
Let the computer run.

The present disclosure provides an authentication control device, an authentication control system, an authentication control method, and a non-temporary computer-readable medium for easily grasping the authentication result and health condition of an applicant in a walk-through type authentication system. be able to.

It is a block diagram which shows the structure of the authentication control apparatus which concerns on this Embodiment 1. It is a flowchart which shows the flow of the authentication control method which concerns on this Embodiment 1. It is a block diagram which shows the whole structure of the authentication control system which concerns on this Embodiment 2. It is a block diagram which shows the structure of the authentication apparatus which concerns on this Embodiment 2. It is a flowchart which shows the flow of the face information registration processing which concerns on this Embodiment 2. It is a flowchart which shows the flow of the face recognition processing by the authentication apparatus which concerns on this Embodiment 2. It is a block diagram which shows the structure of the authentication control apparatus which concerns on this Embodiment 2. It is a flowchart which shows the flow of the authentication control method which concerns on this Embodiment 2. It is a figure which shows the example of the projection control which concerns on this Embodiment 2. It is a figure which shows the example of the projection control which concerns on this Embodiment 2. It is a flowchart which shows the flow of the passing person number monitoring process which concerns on this Embodiment 2. It is a block diagram which shows the structure of the authentication control apparatus which concerns on this Embodiment 3. It is a flowchart which shows the flow of the authentication control method which concerns on this Embodiment 3. It is a flowchart which shows the flow of the body surface temperature determination processing which concerns on this Embodiment 3. It is a block diagram which shows the whole structure of the authentication control system which concerns on this Embodiment 4. It is a block diagram which shows the structure of the authentication control apparatus which concerns on this Embodiment 4. It is a block diagram which shows the structure of the authentication control apparatus which concerns on this Embodiment 5. It is a flowchart which shows the flow of the authentication control method which concerns on this Embodiment 5.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and duplicate explanations are omitted as necessary for the sake of clarity of explanation.

<Embodiment 1>
FIG. 1 is a block diagram showing a configuration of an authentication control device 10 according to the first embodiment. The authentication control device 10 is an information processing device that projects an image near the feet of the person in a projection mode according to a combination of a personal authentication result based on a photographed image of a pedestrian on a predetermined passage and a measurement result of the body surface temperature. Is. Here, the authentication control device 10 is connected to a network (not shown). The network may be wired or wireless. Further, the network is connected to a photographing device (not shown) and a projection device (not shown) installed in the passage of the facility.

The authentication control device 10 includes an image acquisition unit 11, an authentication control unit 12, a body surface temperature acquisition unit 13, a specific unit 14, a determination unit 15, and a projection control unit 16. The image acquisition unit 11 acquires an image taken by a pedestrian on a predetermined passage. The authentication control unit 12 acquires biometric authentication results of biometric information of a plurality of persons and biometric information of pedestrians extracted from captured images. Here, the biological information is facial feature information, iris information, fingerprint information, and the like. When the biometric information of a plurality of persons is stored in the authentication control device 10 in advance, the authentication control unit 12 performs the authentication process. Alternatively, when the facial feature information of a plurality of persons is stored in the external authentication device of the authentication control device 10 in advance, the authentication control unit 12 causes the authentication device to perform authentication and acquires the authentication result.

The body surface temperature acquisition unit 13 acquires the body surface temperature measured from a pedestrian. The identification unit 14 identifies the position of a pedestrian on the passage based on the captured image. The determination unit 15 determines the projection mode according to the combination of the biometric authentication result and the body surface temperature. Here, the projection mode is a projection method by a projection device, display information of a projection target, and the like. The projection control unit 16 controls a predetermined projection device so that a projection region based on a specified position is projected according to a determined projection mode.

FIG. 2 is a flowchart showing the flow of the authentication control method according to the first embodiment. First, the image acquisition unit 11 acquires a photographed image taken by a pedestrian on a predetermined passage (S11). Next, the authentication control unit 12 acquires the biometric authentication result of the biometric information of a plurality of persons and the biometric information of the pedestrian extracted from the captured image (S12).

Then, the body surface temperature acquisition unit 13 acquires the body surface temperature measured from the pedestrian (S13). Note that step S13 may be executed in parallel with steps S11, S12, and S14.

Then, the specific unit 14 specifies the position of the pedestrian on the passage based on the captured image (S14). Subsequently, the determination unit 15 determines the projection mode according to the combination of the biometric authentication result and the body surface temperature (S15). After that, the projection control unit 16 controls a predetermined projection device so as to project the projection region based on the position specified in step S14 according to the projection mode determined in step S15 (S16).

As described above, according to the present embodiment, it is possible to project the image near the feet of the pedestrian in a projection mode according to the combination of the biometric authentication result of the pedestrian and the body surface temperature. Therefore, in the walk-through type authentication system, it is possible to easily grasp the authentication result and the health condition of the applicant for admission.

Note that, in the first embodiment, the specific unit 14 is not essential. In that case, the projection control unit 16 may control the predetermined projection device so that the predetermined projection area is projected according to the determined projection mode. Further, in this case, step S14 of FIG. 2 is not executed, and in step S16, the projection control unit 16 controls a predetermined projection device so that the predetermined projection area is projected according to the projection mode determined in step S15. Will be done.

The authentication control device 10 includes a processor, a memory, and a storage device as a configuration (not shown). Further, the storage device stores a computer program in which the processing of the image providing method according to the present embodiment is implemented. Then, the processor reads the computer program from the storage device into the memory and executes the computer program. As a result, the processor realizes the functions of the image acquisition unit 11, the authentication control unit 12, the body surface temperature acquisition unit 13, the specific unit 14, the determination unit 15, and the projection control unit 16.

Alternatively, the image acquisition unit 11, the authentication control unit 12, the body surface temperature acquisition unit 13, the specific unit 14, the determination unit 15, and the projection control unit 16 may each be realized by dedicated hardware. Further, a part or all of each component of each device may be realized by a general-purpose or dedicated circuitry, a processor, or a combination thereof. These may be composed of a single chip or may be composed of a plurality of chips connected via a bus. A part or all of each component of each device may be realized by the combination of the circuit or the like and the program described above. Further, as a processor, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), or the like can be used.

Further, when a part or all of each component of the authentication control device 10 is realized by a plurality of information processing devices and circuits, the plurality of information processing devices and circuits may be centrally arranged. It may be distributed. For example, the information processing device, the circuit, and the like may be realized as a form in which each is connected via a communication network, such as a client-server system and a cloud computing system. Further, the function of the authentication control device 10 may be provided in the SaaS (Software as a Service) format.

<Embodiment 2>
The second embodiment is a specific example of the first embodiment described above. FIG. 3 is a block diagram showing the overall configuration of the authentication control system 1000 according to the second embodiment. The authentication control system 1000 is an information system that projects display contents according to a combination of biometric authentication results and body surface temperature for each of a plurality of pedestrians U1 to U3 walking in the passage 500 onto a projection area. In the following description, biometric authentication is referred to as face authentication, and biometric information is referred to as facial feature information. However, biometric authentication and biometric information can be applied to other technologies that utilize captured images. For example, as the biological information, data (feature amount) calculated from physical characteristics peculiar to an individual such as fingerprints, voice prints, veins, retinas, and iris patterns (patterns) of the pupil may be used.

The authentication control system 1000 includes an authentication device 100, an authentication control device 200, a thermo camera 300, and a projector 400. Each of the authentication device 100, the authentication control device 200, the thermo camera 300, and the projector 400 is connected via the network N. Here, the network N is a wired or wireless communication line.

A thermo camera 300 and a projector 400 are installed in the passage 500. The thermo camera 300 is a device including a predetermined photographing device and a body surface temperature measuring device. The photographing device may be, for example, a stereo camera. The thermo camera 300 photographs the body including the faces of pedestrians U1 to U3, and transmits the captured image to the authentication control device 200 via the network N. The thermo camera 300 measures the temperature in the imaging target area, generates a thermographic image showing the temperature distribution, and transmits the thermographic image to the authentication control device 200 via the network N.

The projector 400 is an example of a projection device. The projector 400 receives instructions on the projection mode such as the projection area and the projection content from the authentication control device 200 via the network N, and projects the projection content onto the projection area according to the projection mode.

The authentication device 100 is an information processing device that stores facial feature information of a plurality of persons. Further, the authentication device 100 collates the face image or face feature information included in the request with the face feature information of each user in response to the face recognition request received from the outside, and requests the collation result (authentication result). Reply to the original.

FIG. 4 is a block diagram showing the configuration of the authentication device 100 according to the second embodiment. The authentication device 100 includes a face information DB (DataBase) 110, a face detection unit 120, a feature point extraction unit 130, a registration unit 140, and an authentication unit 150. The face information DB 110 stores the user ID 111 and the face feature information 112 of the user ID in association with each other. The face feature information 112 is a set of feature points extracted from the face image. The authentication device 100 may delete the face feature information 112 in the face feature DB 110 in response to a request from the registered user of the face feature information 112. Alternatively, the authentication device 100 may be deleted after a certain period of time has elapsed from the registration of the face feature information 112.

The face detection unit 120 detects a face area included in the registered image for registering face information and outputs it to the feature point extraction unit 130. The feature point extraction unit 130 extracts feature points from the face region detected by the face detection unit 120, and outputs face feature information to the registration unit 140. Further, the feature point extraction unit 130 extracts the feature points included in the face image received from the authentication control device 200, and outputs the face feature information to the authentication unit 150.

The registration unit 140 newly issues the user ID 111 when registering the facial feature information. The registration unit 140 registers the issued user ID 111 and the face feature information 112 extracted from the registered image in the face information DB 110 in association with each other. The authentication unit 150 performs face authentication using the face feature information 112. Specifically, the authentication unit 150 collates the face feature information extracted from the face image with the face feature information 112 in the face information DB 110. The authentication unit 150 returns to the authentication control device 200 whether or not the facial feature information matches. The presence or absence of matching of facial feature information corresponds to the success or failure of authentication. The fact that the facial feature information matches (with matching) means that the degree of matching is equal to or higher than a predetermined value.

FIG. 5 is a flowchart showing the flow of the face information registration process according to the second embodiment. Here, the information registration terminal (not shown) photographs the body including the face of each user, and transmits a face information registration request including the captured image (registered image) to the authentication device 100 via the network N. The information registration terminal is, for example, an information processing device such as a personal computer, a smartphone, or a tablet terminal.

First, the authentication device 100 acquires the registered image included in the face information registration request (S21). For example, the authentication device 100 receives a face information registration request from an information registration terminal via a network N. Next, the face detection unit 120 detects the face region included in the registered image (S22). Next, the feature point extraction unit 130 extracts feature points from the face region detected in step S22, and outputs face feature information to the registration unit 140 (S23). Finally, the registration unit 140 issues the user ID 111, associates the user ID 111 with the face feature information 112, and registers the user ID 111 in the face information DB 110 (S24). The authentication device 100 may receive the face feature information 112 from the information registration terminal and register it in the face information DB 110 in association with the user ID 111.

FIG. 6 is a flowchart showing the flow of face recognition processing by the authentication device 100 according to the second embodiment. First, the feature point extraction unit 130 acquires a face image for authentication included in the face authentication request (S31). For example, the authentication device 100 receives a face recognition request from the authentication control device 200 via the network N, and extracts face feature information from the face image included in the face recognition request as in steps S21 to S23. Alternatively, the authentication device 100 may receive facial feature information from the authentication control device 200. Next, the authentication unit 150 collates the acquired face feature information with the face feature information 112 of the face information DB 110 (S32). When the face feature information matches, that is, when the degree of matching of the face feature information is equal to or higher than a predetermined value (Yes in S33), the authentication unit 150 identifies the user ID 111 of the user whose face feature information matches (S34). , The user ID 111 specified that the face authentication was successful is returned to the authentication control device 200 (S35). When the matching face feature information does not exist (No in S33), the authentication unit 150 returns to the authentication control device 200 that the face authentication has failed (S36).

In step S32, the authentication unit 150 does not need to try to collate with all the face feature information 112 in the face information DB 110. For example, the authentication unit 150 may preferentially try to collate with the face feature information registered in the period from the day when the face recognition request is received to several days before. This can improve the collation speed. Further, when the above-mentioned priority collation fails, it is advisable to collate with all the remaining facial feature information.

Return to Fig. 3 and continue the explanation. The authentication control device 200 projects the pedestrians U1 to U3 photographed and measured by the thermo camera 300 using the projection device on the projection area in a projection mode according to the combination of the face recognition result and the body surface temperature. It is an information processing device that can be used. The authentication control device 200 may be redundant to a plurality of servers, or each functional block may be realized by a plurality of computers.

Next, the authentication control device 200 will be described in detail. FIG. 7 is a block diagram showing the configuration of the authentication control device 200 according to the second embodiment. The authentication control device 200 includes a storage unit 210, a memory 220, a communication unit 230, and a control unit 240. The storage unit 210 is a storage device for a hard disk, a flash memory, or the like. The storage unit 210 stores the program 211, the projection mode information 212, and the maximum number of passable people 213. The program 211 is a computer program in which the processing of the authentication control method according to the second embodiment is implemented.

The projection mode information 212 is information that defines the projection mode. The projection mode information 212 is information in which the face authentication result 2121, the determination result 2122, and the projection mode 2123 are associated with each other. The projection mode 2123 is uniquely determined by the combination of the face recognition result 2121 and the determination result 2122. That is, the projection mode 2123 is an example of the projection mode according to the combination of the face recognition result 2121 and the determination result 2122. The face recognition result 2121 is the result of success or failure of face recognition in one user. The determination result 2122 is a determination result (possible or not) of whether or not the measured value of the body surface temperature in one user is less than a predetermined value. The projection mode 2123 is the color of the laser beam, the projection pattern (blinking pattern), the projection time, and the like. Specific examples of the definition of the projection mode information 212 when the projection mode 2123 is a color include the following (1) to (4).
(1) When the face recognition result is successful and the body surface temperature is less than 37.5 degrees (judgment result is acceptable), the projection mode is green. (2) The face recognition result is successful and the body surface temperature is 37. If the temperature is 5 degrees or higher (judgment result is negative), the projection mode is red. (3) If the face recognition result fails and the body surface temperature is less than 37.5 degrees (judgment result is acceptable), the projection mode is yellow (judgment result is acceptable). 4) When the face recognition result fails and the body surface temperature is 37.5 degrees or higher (determination result is negative), the projection mode may be purple, and (3) and (4) may have the same projection mode.

Further, the projection mode 2123 may be a projection time. For example, when the face recognition result fails or the body surface temperature is 37.5 degrees or higher (determination result is negative), the projection time may be longer than in other cases. Alternatively, the projection mode 2123 may be highlighted as compared with other cases when the face recognition result fails or the body surface temperature is 37.5 degrees or higher (determination result is negative). Here, the highlighting is, for example, increasing the brightness, increasing the blinking frequency, and the like, but is not limited thereto.

The maximum number of people who can pass 213 is the maximum number of pedestrians who can pass through the passage 500. The maximum number of people that can pass 213 is information registered in advance by an administrator or the like.

The memory 220 is a volatile storage device such as a RAM (RandomAccessMemory), and is a storage area for temporarily holding information when the control unit 240 operates. The communication unit 230 is a communication interface with the network N.

The control unit 240 is a processor, that is, a control device that controls each configuration of the authentication control device 200. The control unit 240 reads the program 211 from the storage unit 210 into the memory 220, and executes the program 211. As a result, the control unit 240 realizes the functions of the acquisition unit 241, the authentication control unit 242, the specific unit 243, the determination unit 244, the projection control unit 245, the detection unit 246, and the calculation unit 247.

The acquisition unit 241 is an example of the image acquisition unit 11 and the body surface temperature acquisition unit 13. The acquisition unit 241 acquires a photographed image and a thermography image from the thermo camera 300 via the network N. The acquisition unit 241 collates the photographed image with the thermography image, and acquires the body surface temperature for each pedestrian (user), for example, the temperature of the face. The acquisition unit 241 outputs the acquired captured image to the authentication control unit 242, and outputs the acquired body surface temperature to the determination unit 244.

The authentication control unit 242 is an example of the authentication control unit 12. The authentication control unit 242 controls face recognition for each pedestrian U1 to U3 face region included in the captured image. The authentication control unit 242 causes the authentication device 100 to perform face recognition on the face feature information extracted from the photographed image for each user in the photographed image acquired by the acquisition unit 241, and the face authentication result from the authentication device 100. To get. Then, the authentication control unit 242 outputs the face authentication result of each user to the determination unit 244. For example, the authentication control unit 242 transmits a face recognition request including the acquired captured image to the authentication device 100 via the network N, and receives the face recognition result of each user from the authentication device 100. The authentication control unit 242 may detect the face areas of each pedestrian U1 to U3 from the captured image, include the image of the face area in the face authentication request for each user, and transmit the face authentication request. Alternatively, the authentication control unit 242 may extract the face feature information from the face region and include the face feature information in the face authentication request.

The specific unit 243 is an example of the specific unit 14. The captured image is analyzed to identify the position of a pedestrian on the passage 500. For example, the specific unit 243 may specify the position coordinates from the area of each pedestrian in the captured image and convert them into the position coordinates on the passage 500. When the camera 310 is a stereo camera, the identification unit 243 analyzes the two captured images to identify the position of each pedestrian on the passage 500. Further, the specifying unit 243 analyzes the captured image to specify the traveling direction of each pedestrian in the passage 500.

The decision unit 244 is an example of the decision unit 15. The determination unit 244 determines the projection area and the projection mode. The projection area is an area of the floor surface of the passage 500 projected by the projector 400, and may be defined by position coordinates or the like.

The determination unit 244 determines the projection area at least based on the specified position. Further, the determination unit 244 may determine the region in the traveling direction specified from the specified position as the projection area. At this time, the determination unit 244 may determine the projection area so that when the face recognition result indicates authentication failure, the projection area is wider than when the face authentication result indicates authentication success. Further, the determination unit 244 may determine the projection area so that when the body surface temperature is at least a predetermined value, it is wider than when it is less than a predetermined value.

Further, the determination unit 244 determines the display information as the projection mode, which is a combination of the display content according to the face authentication result and the display content according to the body surface temperature. For example, the display content according to the face authentication result may be a name or a nickname registered in advance together with the face image of the user when the face authentication result indicates the authentication success. In addition, the display content according to the face authentication result may be a message notifying that the face authentication result is not registered when the face authentication result indicates an authentication failure. Further, the display content according to the body surface temperature may be a notation of the body surface temperature itself. Further, the display content according to the body surface temperature may be a face mark showing a cheerful facial expression or characters indicating good physical condition when the body surface temperature is less than a predetermined value. When the body surface temperature is equal to or higher than a predetermined value, the display content according to the body surface temperature may be a face mark showing a sad expression or characters indicating poor physical condition.

Further, the determination unit 244 determines the projection mode 2123 according to the combination of the face recognition result 2121 and the body surface temperature (or its determination result 2122) from the projection mode information 212. For example, the determination unit 244 may determine the projection mode so as to project in different colors depending on the combination of the face recognition result and the body surface temperature determination result. For example, the determination unit 244 may set the projection color to blue or green when the face authentication result is successful, and may set the projection color to red when the authentication fails.

Further, the determination unit 244 may determine the projection time as the projection mode according to the combination of the face recognition result and the determination result of the body surface temperature. For example, when the face authentication result is authentication failure or the body surface temperature is equal to or higher than a predetermined value, the determination unit 244 may determine the projection time longer than in other cases. For example, the feet of a pedestrian who has succeeded in face recognition may be illuminated with green for a moment, and the feet of a pedestrian who has failed in face recognition may be illuminated with red for a while.

Further, when the face authentication result is authentication failure or the body surface temperature is equal to or higher than a predetermined value, the determination unit 244 may determine the projection mode so as to highlight it as compared with other cases. Here, the highlighting is, for example, increasing the brightness, increasing the blinking frequency, and the like, but is not limited thereto. Also, highlighting may include making the projection area wider. At that time, the determination unit 244 may make the projection area wider when the body surface temperature is equal to or higher than a predetermined value even when the face recognition result indicates that the authentication is successful.

The projection control unit 245 is an example of the projection control unit 16. The projection control unit 245 controls the projector 400 so that the determined projection area is projected according to the determined projection mode. For example, the projection control unit 245 controls the projector 400 so that the determined display information is projected on the projection area. Further, the projection control unit 245 controls the projector 400 so as to project at a determined projection time. Specifically, the projection control unit 245 transmits a control signal indicating coordinate information indicating a projection area, projection time, display information, and the like to the projector 400 via the network N.

The detection unit 246 detects the number of pedestrians in the passage 500 from the captured image. The calculation unit 247 calculates the remaining number of passable people from the maximum number of passable people 213 of the passage 500 and the detected number of people. Then, the projection control unit 245 controls the predetermined projection area so as to display the calculated number of passable people. Further, when the number of detected people exceeds the maximum number of people who can pass 213, the projection control unit 245 controls the predetermined projection area so as to display a warning. For example, the predetermined projection area may be near the entrance of the passage 500, and the warning display may be projected in red. This makes it possible to prevent further pedestrians from entering the passage 500. Here, the predetermined projection area may be, for example, near the entrance / exit of the passage 500. Further, as the projection device that projects onto a predetermined projection area, a dedicated device other than the projector 400 may be used.

FIG. 8 is a flowchart showing the flow of the authentication control method according to the second embodiment. First, as a premise, it is assumed that pedestrians U1 to U3 are walking on the passage 500. Then, the thermo camera 300 starts shooting, measures the temperature, and generates a shot image and a thermography image. Then, it is assumed that the thermo camera 300 sequentially transmits the captured image and the thermography image to the authentication control device 200 via the network N.

At this time, the acquisition unit 241 acquires a captured image from the thermo camera 300 via the network N (S401). The identification unit 243 identifies the position of a pedestrian on the passage 500 based on the captured image (S402). That is, the specific unit 243 converts the position coordinates of the pedestrian in the captured image into the position coordinates on the passage 500.

Further, the authentication control unit 242 makes a face recognition request to the authentication device 100 for each pedestrian included in the captured image (S403). Specifically, the acquisition unit 241 extracts the face area of each pedestrian from the captured image and acquires the face feature information from the face area. Then, the authentication control unit 242 includes the face feature information for each pedestrian in the face authentication request and transmits it to the authentication device 100 via the network N. Then, the authentication control unit 242 acquires the face authentication result for each pedestrian from the authentication device 100 (S404).

Further, in parallel with steps S401 to S404, the acquisition unit 241 receives the thermography image from the thermo camera 300 via the network N, collates the thermography image with the captured image, and the body surface temperature of each pedestrian's face region. (S405). Then, the determination unit 244 determines whether or not the body surface temperature is less than a predetermined value for each user (S406). Here, when the body surface temperature is less than the predetermined value, the determination result is "OK", and when the body surface temperature is the predetermined value or more, the determination result is "No".

After steps S402, S404 and S406, the determination unit 244 determines the projection area including the specified position based on the face recognition result and the determination result (S407). Further, the determination unit 244 determines the projection mode according to the combination of the face recognition result and the determination result (S408). The execution of steps S407 and S408 may be performed in parallel or in series.

After steps S407 and S408, the projection control unit 245 controls the projector 400 so that the projection area is projected according to the projection mode (S409).

FIG. 9 is a diagram showing an example of projection control according to the second embodiment. Here, it is assumed that three projectors 410 to 430 are installed instead of the projector 400. Further, it is assumed that the pedestrians U1 to U3 are traveling toward the back of the passage 500. Then, it is assumed that the pedestrians U1 and U3 succeed in face recognition, and the pedestrian U2 fails in face recognition. Each of the projection areas 511, 521 and 531 is an area projected in the traveling direction of the pedestrians U1, U2 and U3, respectively. In the projection area 511, the notation of "F: OK" indicating the success of face recognition and the notation of the body surface temperature "36.5 °" (that is, less than a predetermined value) are projected as display information. In the projection area 521, the notation of "F: NG" indicating the failure of face recognition and the notation of the body surface temperature "36.3 °" (that is, less than a predetermined value) are projected as display information. The projection area 531 shows that the notation of "F: OK" indicating the success of face recognition and the notation of the body surface temperature "37.8 °" (that is, a predetermined value or more) are projected as display information.

FIG. 10 is a diagram showing another example of projection control according to the second embodiment. Here, it is assumed that the pedestrians U1 and U3 succeed in face recognition, and the pedestrian U2 fails in face recognition. Further, the body surface temperature of the pedestrian U1 is lower than the predetermined value, and the body surface temperature of the pedestrian U3 is equal to or higher than the predetermined value. The body surface temperature of the pedestrian U2 may be above or below a predetermined value. Each of the projection areas 512, 522 and 532 is an area projected in the traveling direction of the pedestrians U1, U2 and U3, respectively. In the projection area 512, it is shown that an example of the face mark associated with the pedestrian U1 succeeding in face recognition and the body surface temperature is less than a predetermined value is projected as display information. In the projection area 522, it is shown that the pedestrian U2 fails in face recognition and the associated message "not registered" is projected as display information when the body surface temperature is arbitrary. Further, it is shown that the projection area 522 is a wider area than the projection areas 512 and 532 in which the face authentication is successful because the face authentication fails. In the projection area 532, it is shown that an example of the face mark associated with the pedestrian U3 succeeding in face recognition and the body surface temperature is equal to or higher than a predetermined value is projected as display information. As a result, the pedestrian U2 can more directly recognize that he / she has failed in face recognition, and can promote face recognition by, for example, turning his / her face toward the camera. If the face recognition is successful and the body surface temperature is equal to or higher than a predetermined value, the projection area may be wider.

Note that, as display information according to the case where the body surface temperature is equal to or higher than a predetermined value (judgment result is negative), a message prompting to go to the examination room may be used, for example, "to the examination room". This makes it easier for not only the guards but also the person to be certified to grasp their own health condition and move to the examination room.

FIG. 11 is a flowchart showing the flow of the passing number monitoring process according to the second embodiment. The passing number monitoring process is executed in parallel with the above-mentioned authentication control process. Specifically, step S401 is the same as in FIG. After that, steps S410 and subsequent steps are executed in parallel with steps S402 and S404. That is, the detection unit 246 detects the number of pedestrians in the passage 500 from the captured image (S410). For example, the detection unit 246 analyzes the captured image and counts the number of regions corresponding to pedestrians.

Next, the projection control unit 245 determines whether or not the detected number of people is 213 or less, which is the maximum number of people that can pass through (S411). If YES in step S411, that is, if the detected number of people is 213 or less, the calculation unit 247 calculates the remaining number of passable people from the maximum number of passable people 213 and the detected number of people (S412). Then, the projection control unit 245 performs projection control so as to display the remaining number of passable persons calculated by using the predetermined projection device for the predetermined projection area (S413).

On the other hand, when NO in step S411, that is, when the detected number of people exceeds the maximum number of passable people 213, the projection control unit 245 performs projection control so as to display a warning for a predetermined projection area (S414). ). This makes it easier for pedestrians to enter the passage 500 within the range that can be authenticated by the authentication control device 200. Therefore, the authentication control system 1000 can be operated stably.

Here, in the present embodiment, when the face authentication result indicates the authentication failure, the projection may be performed with a longer projection time than when the authentication is successful. As an example, when the face recognition result indicates an authentication failure, the projection control unit 245 performs projection control so as to maintain the projection of the projector 400 on the projection area. This makes it easier for the pedestrian U2 in FIG. 9 or FIG. 10 to more appropriately identify that he / she has failed in face recognition. In addition, it becomes easier for the surrounding guards and the like to more appropriately recognize that the pedestrian U2 has failed in face recognition, and it becomes easier to speak to the pedestrian U2.

After that, it is assumed that the pedestrian U2 succeeds in face recognition. That is, when the face recognition result indicates that the authentication is successful after the authentication fails, the projection control unit 245 performs projection control so as to switch the display content that maintains the projection at the time of the authentication failure to the display content at the time of the authentication success. As a result, the pedestrian U2 can more appropriately identify that he / she has succeeded in face recognition. The same applies to security guards.

In this embodiment, the display of success or failure of the authentication result may be distinguished between the employee of the facility and the guest. In that case, it is assumed that the storage unit 210 stores the user ID of the employee in advance in association with the attribute (affiliation) and the like. Then, the identification unit 243 specifies the attribute of the pedestrian based on the biometric authentication result. For example, when the biometric authentication result is successful, the identification unit 243 identifies the user ID included in the biometric authentication result and acquires the attribute associated with the specified user ID from the storage unit 210. The determination unit 244 determines at least one of the projection area and the projection mode according to the specified attribute. For example, if the attribute can be acquired, since it is an employee, the determination unit 244 makes the projection mode modest as compared with the guest. Alternatively, in the case of an employee, the decision unit 244 narrows the projection area as compared with the guest. In other words, if the attribute cannot be acquired, the decision unit 244 exaggerates the projection mode as compared with the employee because it is a guest. Alternatively, in the case of a guest, the decision-making unit 244 widens the projection area as compared with the employee. The storage unit 210 may store the guest user ID and the attribute (guest) in association with each other in advance. In that case, when the attribute associated with the specified user ID is a guest, the determination unit 244 may make a determination in the case of the guest described above. These can improve the hospitality to the guests.

Further, in the present embodiment, when the face authentication result indicates the success of the face authentication, the acquisition unit 241 may acquire the body surface temperature. As a result, the overall processing load of the authentication control device 200 can be reduced.

In this embodiment, the pedestrian is continuously photographed while walking, but once the face recognition is successful, the subsequent face recognition does not have to be successful. For example, if the face is turned away from the thermo camera 300 after the face recognition is successful, the face recognition may fail. Even in such a case, the pedestrian's face recognition result may be regarded as a success, the projection mode and the projection area may be determined, and the projection may be performed. One means of realization is as follows.

First, the authentication control unit 242 extracts the body shape feature amount for each pedestrian from the photographed image. Then, when the face recognition result of the pedestrian X indicates success, the control unit 240 registers the body shape feature amount X1 of the pedestrian X in the storage unit 210 (as a successful face recognition person). The control unit 240 may register the user ID of the pedestrian X and the body shape feature amount X1 in the storage unit 210 in association with each other. Further, at this time, the determination unit 244 determines the projection mode and the projection area according to the face recognition result (success) and the determination result as described above, and the projection control unit 245 projects the projection region into the projection mode according to the projection mode. In addition, the projector 400 is controlled.

Next, it is assumed that the pedestrian X continues walking and is photographed again by the thermo camera 300. At this time, it is assumed that the authentication control unit 242 cannot sufficiently extract the face area of the pedestrian X from the captured image and the face authentication fails. On the other hand, it is assumed that the authentication control unit 242 can sufficiently extract the body shape feature amount X2 of the pedestrian X from the captured image. Here, the determination unit 244 searches the storage unit 210 for the body shape feature amount X1 that matches the body shape feature amount X2 within a predetermined range. When searched, the determination unit 244 considers the face recognition result of the pedestrian X to be successful and determines the projection mode and projection area. As a result, the projection area corresponding to the pedestrian X is projected in the projection mode when the face recognition is successful. Therefore, thereafter, the display information indicating the success of the face recognition is continuously projected on the destination of the pedestrian X. That is, the movement of the pedestrian X is projected so as to be tracked (following).

<Embodiment 3>
The third embodiment is a modification of the second embodiment described above. Since the overall configuration of the third embodiment is the same as that of FIG. 3, the illustration is omitted, and the differences will be described below. FIG. 12 is a block diagram showing the configuration of the authentication control device 200a according to the third embodiment. In the storage unit 210 of the authentication control device 200a, the program 211 is replaced with the program 211a and the user management information 214 is added as compared with the authentication control device 200 described above. Further, in the control unit 240 of the authentication control device 200a, the determination unit 244 is replaced with the determination unit 244a as compared with the authentication control device 200 described above. Other configurations are the same as those of the authentication control device 200.

Program 211a is a computer program in which the processing of the authentication control method according to the third embodiment is implemented. The user management information 214 is information for managing user information. The user management information 214 is information in which the user ID 2141 and the body surface temperature history 2142 are associated with each other. The body surface temperature history 2142 is a measurement history of the body surface temperature in the corresponding user (pedestrian). For example, when the pedestrian is an employee, the body surface temperature is measured by the thermo camera 300 every day, so that the body surface temperature history 2142 may be added to the user management information 214 in association with the user ID 2141 each time. .. The body surface temperature history 2142 may be an average value of measured values. For example, the average value may be recalculated each time it is measured.

The determination unit 244a determines a predetermined value based on the pedestrian's body surface temperature history 2142, and determines the projection mode and the projection area according to the determination result of comparing and determining the acquired body surface temperature and the determined predetermined value. Determine at least one.

FIG. 13 is a flowchart showing the flow of the authentication control method according to the third embodiment. In addition, steps S401 to S405 and S407 to S409 are the same as those in FIG. 8 described above. After steps S402, S404 and S405, the determination unit 244a performs a body surface temperature determination process (S406a).

FIG. 14 is a flowchart showing the flow of the body surface temperature determination process according to the third embodiment. First, the determination unit 244a determines whether or not the face recognition is successful (S501). Specifically, the determination unit 244a determines whether the face authentication result acquired in step S403 indicates success or failure of authentication. If it is determined that the authentication is successful, the determination unit 244a identifies the user ID included in the face authentication result (S502). Then, the determination unit 244a acquires the body surface temperature history 2142 associated with the specified user ID 2141 from the user management information 214 (S503). Subsequently, the determination unit 244a calculates an average value from the acquired body surface temperature history 2142 (S504). Then, the determination unit 244a determines a predetermined value based on the calculated average value (S505). For example, the determination unit 244a determines (updates) the temperature obtained by adding 1 degree to the calculated average value as a predetermined value. After that, the determination unit 244a compares the body surface temperature acquired in step S405 with the predetermined value determined in step S505, and determines whether or not the body surface temperature is less than the predetermined value (S506). Then, the process returns to FIG. If it is determined in step S501 that the authentication has failed, the process returns to FIG. 13 with no determination result. After that, steps SS407 to S409 are executed as described above.

This makes it easier for the pedestrian to be aware that the body temperature is likely to be higher than his / her normal fever, makes it easier for security guards, etc. to recognize it, and makes it easier to speak out. As described above, the same effect as that of the above-described embodiment can be obtained by this embodiment as well. Furthermore, the present embodiment can further contribute to the prevention of the spread of infectious diseases.

<Embodiment 4>
The fourth embodiment is a modification of the second or third embodiment described above. In the fourth embodiment, the notification by the speaker and the output to the terminal for the administrator are performed according to the face authentication result. FIG. 15 is a block diagram showing the overall configuration of the authentication control system 1000b according to the fourth embodiment. In the authentication control system 1000b, the authentication control device 200 is replaced with the authentication control device 200b, and the directional speaker 700 and the management terminal 600 are added as compared with the authentication control system 1000 described above. Other configurations are the same as the authentication control system 1000.

The directional speaker 700 is a highly directional speaker installed in the passage 500. Therefore, the directional speaker 700 can transmit sound waves more clearly than usual in the output direction. The directional speaker 700 is connected to the network N and outputs a predetermined warning in the output direction instructed by the authentication control device 200b.

The management terminal 600 is an information processing device operated and viewed by security guards and persons concerned with the facility. The management terminal 600 is connected to the network N and displays the captured image and the biometric authentication result received from the authentication control device 200b on the screen.

FIG. 16 is a block diagram showing the configuration of the authentication control device according to the fourth embodiment. In the authentication control device 200b, the program 211 is replaced with the program 211b, and the output unit 248 and the transmission unit 249 are added, as compared with the authentication control device 200 described above. Other configurations are the same as those of the authentication control device 200.

Program 211b is a computer program in which the processing of the authentication control method according to the fourth embodiment is implemented. When the biometric authentication result indicates an authentication failure, the output unit 248 outputs a predetermined warning toward the specified position to the directional speaker 700 via the network N. Alternatively, the output unit 248 may output a predetermined warning toward the standing position of the guard. When the biometric authentication result indicates an authentication failure, the transmission unit 249 transmits the captured image, the biometric authentication result, and the body surface temperature to the management terminal 600 via the network N.

As described above, the same effect as that of the above-described embodiment can be obtained by this embodiment as well. Further, according to the present embodiment, it is possible to more clearly notify the pedestrian himself or the guard that the authentication has failed. In addition, the pedestrian himself, the guards, and the persons concerned can more easily recognize the difference in the authentication result.

<Embodiment 5>
The fifth embodiment is a modification of the second embodiment described above. FIG. 17 is a block diagram showing a configuration of the authentication control device according to the fifth embodiment. In the storage unit 210 of the authentication control device 200c, the program 211 is replaced with the program 211c and the face information DB 215 is added as compared with the authentication control device 200 described above. Further, in the control unit 240 of the authentication control device 200c, the authentication control unit 242 is replaced with the authentication control unit 242c as compared with the authentication control device 200 described above.

Program 211c is a computer program in which the processing of the authentication control method according to the fifth embodiment is implemented.

The face information DB 215 corresponds to the face information DB 110 of the authentication device 100 described above, and a plurality of user IDs 2151 and the face feature information 2152 are associated with each other.

The authentication control unit 242c performs face authentication by collating the face feature information extracted from the face area of the user (pedestrian) included in the acquired captured image with the face feature information 2152 stored in the storage unit 210. By doing so, the face recognition result is acquired.

FIG. 18 is a flowchart showing the flow of the authentication control method according to the fifth embodiment. In FIG. 18, step S402 in FIG. 8 described above is replaced with steps S402a and S402b.

After step S401, the authentication control unit 242c extracts face feature information from each user's face area in the acquired captured image (S402a). Then, the authentication control unit 242c collates the extracted face feature information with the face feature information 2152 in the face information DB 215 for each user (S402b).

As described above, the same effect as that of the above-mentioned second embodiment can be obtained in the fifth embodiment as well. Of course, the present embodiment 5 may be modified from the third or fourth embodiment.

<Other embodiments>
In the above-described embodiment, the description is given as a hardware configuration, but the present invention is not limited to this. The present disclosure can also be realized by causing the CPU to execute a computer program for arbitrary processing.

In the above example, the program is stored using various types of non-transitory computer readable medium and can be supplied to the computer. Non-temporary computer-readable media include various types of tangible storage media. Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical disks), CD-ROMs (ReadOnlyMemory), CD-Rs, Includes CD-R / W, DVD (DigitalVersatileDisc), semiconductor memory (eg, mask ROM, PROM (ProgrammableROM), EPROM (ErasablePROM), flash ROM, RAM (RandomAccessMemory)). The program may also be supplied to the computer by various types of temporary computer readable medium. Examples of temporary computer-readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

Note that this disclosure is not limited to the above embodiment, and can be appropriately changed without departing from the spirit. Further, the present disclosure may be carried out by appropriately combining the respective embodiments.

Some or all of the above embodiments may also be described, but not limited to:
(Appendix A1)
An image acquisition means for acquiring an image taken by a pedestrian on a predetermined passage, and
An authentication control means for acquiring biometric authentication results of biometric information of a plurality of persons and biometric information of the pedestrian extracted from the photographed image, and
A body surface temperature acquisition means for acquiring the body surface temperature measured from the pedestrian, and
A determination means for determining a projection mode according to a combination of the biometric authentication result and the body surface temperature,
A projection control means for controlling a predetermined projection device so as to project onto a predetermined projection area according to the determined projection mode, and a projection control means.
Authentication control device.
(Appendix A2)
Further provided with specific means for identifying the position of the pedestrian on the passage based on the captured image.
The determining means further determines the projection area based on the identified position.
The authentication control device according to Appendix A1, wherein the projection control means controls the projection device so as to project onto the determined projection area.
(Appendix A3)
The identifying means analyzes the captured image to further identify the traveling direction of the pedestrian in the passage.
The authentication control device according to Appendix A2, wherein the determination means determines a region in the specified traveling direction as the projection region from the specified position.
(Appendix A4)
The authentication control device according to Appendix A2 or 3, wherein the determination means determines the projection area so that when the biometric authentication result indicates an authentication failure, the projection area is wider than when the authentication is successful.
(Appendix A5)
The authentication control device according to any one of Supplementary A2 to 4, wherein the determination means determines the projection area so that when the body surface temperature is equal to or higher than a predetermined value, the projection area is wider than when the temperature is lower than a predetermined value. ..
(Appendix A6)
The authentication control device according to Appendix A5, wherein the determination means determines the predetermined value based on the history of the body surface temperature of the pedestrian.
(Appendix A7)
The determination means determines the display information obtained by combining the display content according to the biometric authentication result and the display content according to the body surface temperature as the projection mode.
The authentication control device according to any one of Supplementary AA 1 to 6, wherein the projection control means controls the projection device so that the determined display information is projected on the projection area.
(Appendix A8)
The authentication control device according to any one of Supplementary A1 to 7, wherein the determination means determines the projection mode so as to project in different colors depending on the combination.
(Appendix A9)
The determining means determines the projection time as the projection mode according to the combination.
The authentication control device according to any one of Supplementary AA 1 to 8, wherein the projection control means controls the projection device so as to project at the determined projection time.
(Appendix A10)
The authentication control device according to Appendix A9, wherein the determination means determines the projection time longer than in other cases when the biometric authentication result is authentication failure or the body surface temperature is equal to or higher than a predetermined value.
(Appendix A11)
The determination means determines the projection mode so as to be highlighted as compared with other cases when the biometric authentication result is authentication failure or the body surface temperature is equal to or higher than a predetermined value. Authentication control device as described in the section.
(Appendix A12)
Further provided with an attribute specifying means for specifying the attribute of the pedestrian based on the biometric authentication result,
The authentication control device according to any one of Supplementary A1 to 11, wherein the determination means determines at least one of the projection area and the projection mode according to the specified attribute.
(Appendix A13)
The authentication control device according to any one of Supplementary AA 1 to 12, wherein the body surface temperature acquisition means acquires the body surface temperature when the biometric authentication result indicates success of face authentication.
(Appendix A14)
If the biometric authentication result indicates an authentication failure, an output means for outputting a predetermined warning toward the specified position to the highly directional speaker installed in the passage is further provided. The authentication control device according to any one item.
(Appendix A15)
1 Authentication control device as described in the section.
(Appendix A16)
The authentication control means causes an authentication device that stores biometric information of the plurality of persons to authenticate with the biometric information acquired from the photographed image, and acquires the biometric authentication result from the authentication device. The authentication control device according to any one of 15 to 15.
(Appendix A17)
Further provided with a storage means for storing the biometric information of the plurality of persons,
The authentication control means obtains the biometric authentication result by collating the biometric information of the plurality of persons with the biometric information acquired from the captured image, and obtains the biometric authentication result. The authentication control device described in.
(Appendix B1)
With the shooting device,
Body surface temperature measuring device and
Projector and
Authentication control device and
Equipped with
The authentication control device is
An image acquisition means for acquiring a photographed image taken by a pedestrian on a predetermined passage by the photographing device, and an image acquisition means.
An authentication control means for acquiring biometric authentication results of biometric information of a plurality of persons and biometric information of the pedestrian extracted from the photographed image, and
A body surface temperature acquisition means for acquiring the body surface temperature measured from the pedestrian by the measuring device, and
A determination means for determining a projection mode according to a combination of the biometric authentication result and the body surface temperature,
A projection control means for controlling the projection device so as to project onto a predetermined projection area according to the determined projection mode, and a projection control means.
Authentication control system with.
(Appendix B2)
Further provided with specific means for identifying the position of the pedestrian on the passage based on the captured image.
The determining means further determines the projection area based on the identified position.
The authentication control system according to Appendix B1, wherein the projection control means controls the projection device so as to project onto the determined projection area.
(Appendix C1)
The computer
Acquire the captured image taken by a pedestrian on a predetermined passage,
The biometric authentication result of the biometric information of a plurality of persons and the biometric information of the pedestrian extracted from the photographed image is acquired.
Obtaining the body surface temperature measured from the pedestrian,
The projection mode according to the combination of the biometric authentication result and the body surface temperature is determined.
A predetermined projection device is controlled so as to project onto a predetermined projection area according to the determined projection mode.
Authentication control method.
(Appendix D1)
Image acquisition processing to acquire captured images taken by pedestrians on a predetermined passage,
Authentication control processing for acquiring biometric authentication results of biometric information of a plurality of persons and biometric information of the pedestrian extracted from the photographed image, and
The body surface temperature acquisition process for acquiring the body surface temperature measured from the pedestrian, and
A determination process for determining a projection mode according to a combination of the biometric authentication result and the body surface temperature, and
A projection control process that controls a predetermined projection device so as to project onto a predetermined projection area according to the determined projection mode, and
A non-transitory computer-readable medium containing an authentication control program that causes a computer to execute.

Although the invention of the present application has been described above with reference to the embodiments (and examples), the invention of the present application is not limited to the above embodiments (and examples). Various changes that can be understood by those skilled in the art can be made within the scope of the present invention in terms of the configuration and details of the present invention.

10 Authentication control device 11 Image acquisition unit 12 Authentication control unit 13 Body surface temperature acquisition unit 14 Specific unit 15 Decision unit 16 Projection control unit 1000 Authentication control system 1000b Authentication control system 1000c Authentication control system 100 Authentication device 110 Face information DB
111 User ID
112 Face feature information 120 Face detection unit 130 Feature point extraction unit 140 Registration unit 150 Authentication unit 200 Authentication control device 200a Authentication control device 200b Authentication control device 200c Authentication control device 210 Storage unit 211 Program 211a Program 211b Program 211c Program 212 Projection mode information 2121 Face authentication result 2122 Judgment result 2123 Projection mode 213 Maximum number of passable people 214 User management information 2141 User ID
2142 Body surface temperature history 215 Face information DB
2151 User ID
2152 Face feature information 220 Memory 230 Communication unit 240 Control unit 241 Acquisition unit 242 Authentication control unit 242c Authentication control unit 243 Specific unit 244 Decision unit 244a Decision unit 245 Projection control unit 246 Detection unit 247 Calculation unit 248 Output unit 249 Transmission unit 300 Thermo Camera 400 Projector 410 Projector 420 Projector 430 Projector 500 Passage 511 Projection Area 512 Projection Area 521 Projection Area 522 Projection Area 531 Projection Area 532 Projection Area 600 Management Terminal 700 Directional Speaker N Network U1 Pedestrian U2 Pedestrian

Claims (21)

1. An image acquisition means for acquiring an image taken by a pedestrian on a predetermined passage, and
   An authentication control means for acquiring biometric authentication results of biometric information of a plurality of persons and biometric information of the pedestrian extracted from the photographed image, and
   A body surface temperature acquisition means for acquiring the body surface temperature measured from the pedestrian, and
   A determination means for determining a projection mode according to a combination of the biometric authentication result and the body surface temperature,
   A projection control means for controlling a predetermined projection device so as to project onto a predetermined projection area according to the determined projection mode, and a projection control means.
   Authentication control device.
2. Further provided with specific means for identifying the position of the pedestrian on the passage based on the captured image.
   The determining means further determines the projection area based on the identified position.
   The authentication control device according to claim 1, wherein the projection control means controls the projection device so as to project onto the determined projection area.
3. The identifying means analyzes the captured image to further identify the traveling direction of the pedestrian in the passage.
   The authentication control device according to claim 2, wherein the determination means determines a region in the specified traveling direction as the projection region from the specified position.
4. The authentication control device according to claim 2 or 3, wherein the determination means determines the projection area so that when the biometric authentication result indicates an authentication failure, the projection area is wider than when the authentication is successful.
5. The authentication control according to any one of claims 2 to 4, wherein the determination means determines the projection area so that when the body surface temperature is equal to or higher than a predetermined value, the projection area is wider than when the temperature is lower than a predetermined value. Device.
6. The authentication control device according to claim 5, wherein the determination means determines the predetermined value based on the history of the body surface temperature of the pedestrian.
7. The determination means determines the display information obtained by combining the display content according to the biometric authentication result and the display content according to the body surface temperature as the projection mode.
   The authentication control device according to any one of claims 1 to 6, wherein the projection control means controls the projection device so that the determined display information is projected on the projection area.
8. The authentication control device according to any one of claims 1 to 7, wherein the determination means determines the projection mode so as to project in different colors depending on the combination.
9. The determining means determines the projection time as the projection mode according to the combination.
   The authentication control device according to any one of claims 1 to 8, wherein the projection control means controls the projection device so as to project at the determined projection time.
10. The authentication control device according to claim 9, wherein the determination means determines the projection time longer than in other cases when the biometric authentication result is authentication failure or the body surface temperature is equal to or higher than a predetermined value.
11. The determination means is any one of claims 1 to 10 for determining the projection mode so that when the biometric authentication result is authentication failure or the body surface temperature is equal to or higher than a predetermined value, the projection mode is highlighted as compared with other cases. The authentication control device according to item 1.
12. Further provided with an attribute specifying means for specifying the attribute of the pedestrian based on the biometric authentication result,
    The authentication control device according to any one of claims 1 to 11, wherein the determination means determines at least one of the projection area and the projection mode according to the specified attribute.
13. The authentication control device according to any one of claims 1 to 12, wherein the body surface temperature acquisition means acquires the body surface temperature when the biometric authentication result indicates success of face authentication.
14. Claims 1 to 13 further include an output means for outputting a predetermined warning toward the specified position to the highly directional speaker installed in the passage when the biometric authentication result indicates an authentication failure. The authentication control device according to any one of the above items.
15. One of claims 1 to 14, further comprising a transmission means for transmitting the photographed image, the biometric authentication result, and the body surface temperature to a predetermined information processing apparatus via a network when the biometric authentication result indicates an authentication failure. The authentication control device according to item 1.
16. The authentication control means has an authentication device that stores biometric information of a plurality of persons perform authentication on the biometric information acquired from the photographed image, and obtains the biometric authentication result from the authentication device. The authentication control device according to any one of 1 to 15.
17. Further provided with a storage means for storing the biometric information of the plurality of persons,
    The authentication control means is any one of claims 1 to 15 for acquiring the biometric authentication result by collating the biometric information of the plurality of persons with the biometric information acquired from the captured image and performing authentication. Authentication control device as described in the section.
18. With the shooting device,
    Body surface temperature measuring device and
    Projector and
    Authentication control device and
    Equipped with
    The authentication control device is
    An image acquisition means for acquiring a photographed image taken by a pedestrian on a predetermined passage by the photographing device, and an image acquisition means.
    An authentication control means for acquiring biometric authentication results of biometric information of a plurality of persons and biometric information of the pedestrian extracted from the photographed image, and
    A body surface temperature acquisition means for acquiring the body surface temperature measured from the pedestrian by the measuring device, and
    A determination means for determining a projection mode according to a combination of the biometric authentication result and the body surface temperature,
    A projection control means for controlling the projection device so as to project onto a predetermined projection area according to the determined projection mode, and a projection control means.
    Authentication control system with.
19. Further provided with specific means for identifying the position of the pedestrian on the passage based on the captured image.
    The determining means further determines the projection area based on the identified position.
    The authentication control system according to claim 18, wherein the projection control means controls the projection device so as to project onto the determined projection area.
20. The computer
    Acquire the captured image taken by a pedestrian on a predetermined passage,
    The biometric authentication result of the biometric information of a plurality of persons and the biometric information of the pedestrian extracted from the photographed image is acquired.
    Obtaining the body surface temperature measured from the pedestrian,
    The projection mode according to the combination of the biometric authentication result and the body surface temperature is determined.
    A predetermined projection device is controlled so as to project onto a predetermined projection area according to the determined projection mode.
    Authentication control method.
21. Image acquisition processing to acquire captured images taken by pedestrians on a predetermined passage,
    Authentication control processing for acquiring biometric authentication results of biometric information of a plurality of persons and biometric information of the pedestrian extracted from the photographed image, and
    The body surface temperature acquisition process for acquiring the body surface temperature measured from the pedestrian, and
    A determination process for determining a projection mode according to a combination of the biometric authentication result and the body surface temperature, and
    A projection control process that controls a predetermined projection device so as to project onto a predetermined projection area according to the determined projection mode, and
    A non-transitory computer-readable medium containing an authentication control program that causes a computer to execute.

Images