JP7243885B1 - Information processing system, information processing method, and computer program - Google Patents

Abstract

Kind Code: A1 A predetermined process is executed appropriately by executing authentication processing of a target.
An information processing system (10) includes acquisition means (120) for acquiring face information from an image taken by a first camera and acquiring iris information from an image taken by a second camera; and authentication means (130) for performing authentication processing using iris information, and execution means (140) for executing predetermined processing for permitting admission to the facility used by the subject when the authentication processing is successful, Authentication processing using both face information and iris information of a first target is successful, and authentication processing using at least one of face information and iris information of a second target different from the first target The first subject and the second subject are allowed to enter the facility provided that the is successful.
[Selection drawing] Fig. 2

Description

The present disclosure relates to technical fields of information processing systems, information processing methods, and computer programs.

As a system of this type, a system that authenticates visitors to a house is known. For example, Patent Literature 1 discloses performing biometric authentication (for example, face authentication using an intercom with a camera) when visiting staff of a housekeeping service enter or leave a house.

JP 2019-52476 A

This disclosure aims at improving the techniques disclosed in the prior art documents.

One aspect of the information processing system disclosed herein is an acquisition unit that acquires face information from an image captured by a first camera and acquires iris information from an image captured by a second camera; authentication means for performing an authentication process using iris information; and execution means for executing a predetermined process of permitting admission to a facility used by a subject when the authentication process is successful, the execution means comprising: The authentication process using both the face information and the iris information of one target has succeeded, and at least one of the face information and the iris information of a second target different from the first target The first and second objects are permitted to enter the facility on condition that the authentication processing using the is successful.

One aspect of the information processing method of this disclosure is an information processing method executed by at least one computer, in which face information is obtained from an image captured by a first camera, and facial information is obtained from an image captured by a second camera. Acquiring iris information, performing authentication processing using the face information and the iris information, performing predetermined processing to permit admission to a facility used by the target when the authentication processing is successful, and the authentication process using both the face information and the iris information of a second target different from the first target is used at least one of the face information and the iris information The admission of the first target and the second target to the facility is permitted on condition that the authentication process is successful.

According to one aspect of the computer program of the present disclosure, at least one computer acquires facial information from an image captured by a first camera, acquires iris information from an image captured by a second camera, and acquires the facial information. and performing an authentication process using the iris information, and if the authentication process is successful, performing a predetermined process of permitting admission to a facility used by the first target, and obtaining the face information and the iris information of the first target. The authentication process using both has succeeded, and the authentication process using at least one of the face information and the iris information of a second target different from the first target has succeeded. an information processing method for permitting the first and second objects to enter the facility on the condition that

2 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment; FIG. FIG. 2 is a perspective view showing the configuration of an authentication terminal included in the information processing system according to the first embodiment; 1 is a perspective view showing a configuration around a camera in an information processing system according to a first embodiment; FIG. 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment; FIG. It is a block diagram which shows the functional structure of the modification of the information processing system which concerns on 1st Embodiment. 4 is a flow chart showing the flow of operations by the information processing system according to the first embodiment; 9 is a flow chart showing the flow of operations by the information processing system according to the second embodiment; FIG. 11 is a block diagram showing a functional configuration of an information processing system according to a third embodiment; FIG. FIG. 14 is a flow chart showing the flow of operations by an information processing system according to the fourth embodiment; FIG. 14 is a flow chart showing the flow of operations by the information processing system according to the fifth embodiment; FIG. 16 is a flow chart showing the flow of operations by an information processing system according to the sixth embodiment; FIG. FIG. 22 is a block diagram showing a functional configuration of an information processing system according to a seventh embodiment; FIG. FIG. 14 is a flow chart showing the flow of operations by an information processing system according to the seventh embodiment; FIG. FIG. 14 is a flow chart showing the flow of operations by an information processing system according to the eighth embodiment; FIG. FIG. 22 is a flow chart showing the flow of operations by the information processing system according to the ninth embodiment; FIG. FIG. 22 is a flow chart showing the flow of operations by the information processing system according to the tenth embodiment; FIG. FIG. 21 is a block diagram showing the functional configuration of an information processing system according to an eleventh embodiment; FIG. 22 is a flow chart showing the flow of operations by the information processing system according to the eleventh embodiment; FIG. FIG. 22 is a block diagram showing a functional configuration of an information processing system according to a twelfth embodiment; FIG. FIG. 22 is a flow chart showing the flow of operations by an information processing system according to a thirteenth embodiment; FIG. FIG. 22 is a flow chart showing a modification of the flow of operations by the information processing system according to the thirteenth embodiment; FIG. FIG. 10 is a plan view showing an example of a display screen when registering an object; FIG. 11 is a plan view showing an example of a display screen when updating target registration information; FIG. 11 is a plan view showing an example of a display screen showing an absence time of a registered target; FIG. 10 is a plan view showing an example of a display screen showing the home status of a registered target;

Hereinafter, embodiments of an information processing system, an information processing apparatus, an information processing method, and a recording medium will be described with reference to the drawings.

<First Embodiment>
An information processing system according to the first embodiment will be described with reference to FIGS. 1 to 6. FIG.

(Hardware configuration)
First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing the hardware configuration of an information processing system according to the first embodiment.

As shown in FIG. 1 , an information processing system 10 according to the first embodiment includes a processor 11 , a RAM (Random Access Memory) 12 , a ROM (Read Only Memory) 13 and a storage device 14 . Information processing system 10 may further include an input device 15 and an output device 16 . The information processing system 10 may also include a first camera 18 and a second camera 19 . The above-described processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, first camera 18, and second camera 19 are connected via a data bus 17. .

Processor 11 reads a computer program. For example, processor 11 is configured to read a computer program stored in at least one of RAM 12, ROM 13 and storage device . Alternatively, the processor 11 may read a computer program stored in a computer-readable recording medium using a recording medium reader (not shown). The processor 11 may acquire (that is, read) a computer program from a device (not shown) arranged outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15 and the output device 16 by executing the read computer program. Particularly in this embodiment, when the computer program loaded by the processor 11 is executed, the processor 11 implements a functional block that acquires a target image and performs biometric authentication. That is, the processor 11 may function as a controller that executes each control of the information processing system 10 .

Note that the processor 11 may be configured as, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), a DSP (Demand-Side Platform), and an ASIC (Application Specific Integrate). . The processor 11 may be configured with one of these, or may be configured to use a plurality of them in parallel.

The RAM 12 temporarily stores computer programs executed by the processor 11 . The RAM 12 temporarily stores data temporarily used by the processor 11 while the processor 11 is executing the computer program. The RAM 12 may be, for example, a D-RAM (Dynamic RAM).

The ROM 13 stores computer programs executed by the processor 11 . The ROM 13 may also store other fixed data. The ROM 13 may be, for example, a P-ROM (Programmable ROM).

The storage device 14 stores data that the information processing system 10 saves for a long period of time. Storage device 14 may act as a temporary storage device for processor 11 . The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

The input device 15 is a device that receives input instructions from the user of the information processing system 10 . Input device 15 may include, for example, at least one of a keyboard, mouse, and touch panel. The input device 15 may be configured as a mobile terminal such as a smart phone or a tablet.

The output device 16 is a device that outputs information about the information processing system 10 to the outside. For example, the output device 16 may be a display device (eg, display) capable of displaying information regarding the information processing system 10 . Also, the output device 16 may be a speaker or the like capable of outputting information about the information processing system 10 by voice. The output device 16 may be configured as a mobile terminal such as a smart phone or a tablet.

The 1st camera 18 and the 2nd camera 19 are the cameras installed in the location which can image an image of object. Note that the target here is not limited to humans, and may include animals such as dogs and snakes, robots, and the like. The first camera 18 and the second camera 19 may be configured as cameras that respectively capture different parts of the object. For example, the first camera 18 may capture images containing the subject's face, while the second camera 19 may be configured to capture images containing the subject's iris. The first camera 18 and the second camera 19 may be configured as visible light cameras or may be configured as near-infrared cameras. Also, the first camera 18 and the second camera 19 may be configured as depth cameras or may be configured as thermo cameras. Depth cameras can acquire depth images, for example, of the distance between the object and the camera. A thermal camera can acquire a body temperature image, for example, of the body temperature of a subject. Different types of cameras described above (for example, visible light camera, near-infrared camera, depth camera, thermo camera) may be appropriately combined to form the first camera 18 and the second camera 19, and the combination is not particularly limited. . For example, the first camera 18 may be configured as a face camera and the second camera 19 may be a thermo camera, or the first camera 18 may be a depth camera and the second camera 19 may be a near-infrared camera. The first camera 18 and the second camera 19 may be cameras that capture still images, or may be cameras that capture moving images. The first camera 18 and the second camera 19 may be cameras mounted on a terminal (for example, a smart phone) owned by the target. A plurality of first cameras 18 and second cameras 19 may be provided. Also, a camera different from the first camera 18 and the second camera 19 (for example, a third camera or a fourth camera) may be provided. A specific configuration example of the first camera 18 and the second camera 19 will be described later in detail.

Note that FIG. 1 illustrates an example of the information processing system 10 including a plurality of devices, but all or part of these functions may be realized by one device (information processing device). . This information processing apparatus, for example, includes only the processor 11, the RAM 12, and the ROM 13 described above, and other components (that is, the storage device 14, the input device 15, the output device 16, the first camera 18, and the second The camera 19) may be provided in an external device connected to the information processing device, for example. Also, the information processing device may implement a part of the arithmetic function by an external device (for example, an external server, a cloud, etc.).

(Authentication terminal configuration)
Next, the configuration of the authentication terminal included in the information processing system 10 according to the first embodiment will be described with reference to FIG. FIG. 2 is a perspective view showing the configuration of an authentication terminal included in the information processing system according to the first embodiment;

As shown in FIG. 2, the information processing system 10 according to the first embodiment includes an authentication terminal 30 including the first camera 18 and the second camera 19 described above. The housing of the authentication terminal 30 is made of resin, metal, or the like, for example. A display 40 is provided on the front portion of the authentication terminal. This display may display various information about the authentication terminal, messages for the user, and images and videos captured by the first camera 18 and the second camera 19 . A first camera 18 and a second camera 19 are installed inside a camera installation portion 35 (a portion surrounded by a broken line in the figure) located below the display 40 . Note that the first camera 18 and the second camera 19 may be provided so as to be visible from the outside of the housing, or may be provided so as to be invisible from the outside. For example, when the first camera 18 and the second camera 19 are configured as visible light cameras, the visible light cameras may be exposed to the outside in order to capture external visible light (for example, visible light cameras An opening may be provided in the vicinity.) Further, when the first camera 18 and the second camera 19 are configured as near-infrared cameras, the near-infrared cameras may be provided so as not to be exposed to the outside (for example, , may be covered with a visible light cut film or the like). Furthermore, when the first camera 18 is configured as a visible light camera and the second camera 19 is configured as a near-infrared camera, the first camera 18 is exposed to the outside (for example, an opening is provided near the first camera 18), The second camera 19 may be provided so as not to be exposed to the outside (for example, it may be covered with a visible light cut film or the like).

(Configuration around the camera)
Next, the configuration around the camera in the information processing system 10 according to the first embodiment (the internal configuration of the camera installation portion 35 of the authentication terminal described above) will be specifically described with reference to FIG. FIG. 3 is a perspective view showing the configuration around the camera in the information processing system according to the first embodiment. In the following description, it is assumed that the first camera 18 is a visible light camera that captures the face of the target, and the second camera 19 is a near-infrared camera that captures the iris of the target.

As shown in FIG. 3, the first camera 18 and the second camera 19 are arranged inside the case 50 . Inside the case 50, in addition to the first camera 18 and the second camera 19, a motor 20 and two near-infrared illuminators 21 are arranged. The near-infrared illumination 21 is configured to irradiate the target with near-infrared light when the second camera 19, which is a near-infrared camera, takes an image.

Especially in this embodiment, the first camera 18 and the second camera 19 are configured to be rotatable about the same rotation axis (see the broken line in the figure). Specifically, the first camera 18 and the second camera 19 are configured so as to be integrally rotatable in the vertical direction around the rotation axis by being driven by the motor 20 ( arrow). Therefore, when the first camera 18 and the second camera 19 are rotated upward, the imaging ranges of the first camera 18 and the second camera 19 both change upward. Further, when the first camera 18 and the second camera 19 are rotated downward, the imaging ranges of the first camera 18 and the second camera 19 both change downward.

In the example shown in FIG. 3, the near-infrared illumination 21 is also rotatable about the same axis of rotation as the first camera 18 and the second camera 19 . Therefore, when the first camera 18 and the second camera 19 are rotated upward, the near-infrared illumination 21 is integrally driven and directed upward. Further, when the first camera 18 and the second camera 19 are rotated downward, the near-infrared illumination 21 is also integrally driven to face downward.

(Functional configuration)
Next, a functional configuration of the information processing system 10 according to the first embodiment will be described with reference to FIG. FIG. 4 is a block diagram showing the functional configuration of the information processing system according to the first embodiment;

As shown in FIG. 4, the information processing system 10 according to the first embodiment includes the already-described first camera 18 and second camera 19, the rotation control unit 110, and It includes a biometric information acquisition unit 120 , an authentication unit 130 and an execution unit 140 . Each of the rotation control unit 110, the biometric information acquisition unit 120, the authentication unit 130, and the execution unit 140 may be a processing block implemented by, for example, the above-described processor 11 (see FIG. 1).

The rotation control unit 110 is configured to be able to control rotation operations of the first camera 18 and the second camera 19 . For example, the rotation control unit 110 is configured to be able to determine the rotation direction and amount of rotation of the first camera 18 and the second camera 19 and execute control according to the determined parameters. The rotation control unit 110 controls rotation operations of the first camera 18 and the second camera 19 according to the position of the object. The position of the target may be, for example, the position where the target's face exists or the position where the target's eyes exist. Further, the position of the target may be not only the position in the height direction, but also the position in the depth direction corresponding to the distance to the camera, or the position in the left-right direction. Specifically, the second It controls the rotation operations of the first camera 18 and the second camera 19 . For example, when the first camera 18 is a face camera that captures an image of the target's face and the second camera 19 is an iris camera that captures an iris of the target, the rotation control unit 110 moves the image of the target within the imaging range of the first camera 18. The rotation operations of the first camera 18 and the second camera 19 are controlled so that the subject's face fits within the imaging range of the second camera 19 and the iris of the target falls within the imaging range of the second camera 19 . Note that the rotation control unit 110 may be configured to acquire the target position from outside the system. For example, the rotation control unit 110 may acquire the target position from various sensors. On the other hand, the information processing system 10 according to the first embodiment may be configured so that the position of the target can be detected within the system. The configuration in this case will be described in detail in the modification below.

(Modification)
Here, a modification of the information processing system 10 according to the first embodiment will be described with reference to FIG. FIG. 5 is a block diagram showing a functional configuration of a modification of the information processing system according to the first embodiment; In addition, in FIG. 5, the same code|symbol is attached|subjected to the element similar to the component shown in FIG.

As shown in FIG. 5, the modified example of the information processing system 10 according to the first embodiment includes a first camera 18 and a second camera 19, a rotation control unit 110, and It includes a target position detection unit 115 , a biometric information acquisition unit 120 , an authentication unit 130 and an execution unit 140 . That is, the information processing system 10 according to the modified example is configured by further including an object detection unit 115 in addition to the configuration of the first embodiment (see FIG. 4). The target position detection unit 115 may be, for example, a processing block realized by the above-described processor 11 (see FIG. 1).

The target position detection unit 115 is configured to acquire images captured by the first camera 18 and the second camera 19 and detect the position of the target from at least one of these images. The target position detection unit 115 may be configured to be able to detect the position of the target's face and the positions of the eyes from the face image captured by the face camera, which is the first camera 18, for example. When the first camera 18 is configured as a face camera and the second camera 19 is configured as an iris camera, the respective cameras have different imaging ranges (the imaging range of the face camera is wide). In such a case, first, the first camera 18 (ie, face camera) with a wide imaging range detects the target position, and the second camera 19 (ie, iris camera) with a narrow imaging range is rotated so that the iris can be captured. may be controlled.

The target position detected by the target position detection unit 115 is configured to be output to the rotation control unit 110 . Then, the rotation control unit 110 performs rotation control of the first camera 18 and the second camera 19 based on the target position detected by the target position detection unit 115 . Note that the position detection by the target position detection unit 115 and the rotation operation by the rotation control unit 110 may be executed in parallel. In this case, the position of the object may be detected while imaging with the first camera 18 and the second camera 19, and the rotational motion may be performed based on the detected position at the same time.

Returning to FIG. 4, the biometric information acquisition unit 120 is configured to be able to acquire first biometric information from an image captured by the first camera 18 (hereinafter referred to as “first image” as appropriate). Also, the biometric information acquisition unit 120 is configured to be able to acquire second biometric information from an image captured by the second camera 19 (hereinafter referred to as a “second image” as appropriate). The first biometric information may be a feature amount of a part included in the images captured by the first camera 18 and the second camera 19 (that is, a parameter indicating the feature amount of the part of the living body). For example, when the first camera 18 is a face camera that captures the face of the target and the second camera 19 is an iris camera that captures the iris of the target, the biological information acquiring unit 120 captures the first The feature amount of the target's face may be obtained from one image (that is, the face image), and the feature amount of the target's iris may be obtained from the second image (that is, the iris image) captured by the second camera 19 . Each of the first biometric information and the second biometric information acquired as biometric information is configured to be output to the authentication unit 130 .

The authentication unit 130 is configured to be able to execute target authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 . For example, the authentication unit 130 is configured to be able to determine whether or not the target is a registered user by comparing the first biometric information and the second biometric information with pre-registered biometric information. . Also, the authentication unit 130 uses the first biometric information and the second biometric information to determine whether or not the target is a living body (for example, whether or not impersonation is being performed using a photograph, video, mask, etc.). may be configured to be possible. Spoofing involves instructing the target to perform a predetermined action (for example, "Please shake your head sideways" or "Please look up"), and the target moves as instructed. It may be determined by whether or not Alternatively, spoofing can be performed by using a thermo image to determine whether an object has body temperature, or using a depth image to determine whether height information exists in each part of the object (eg, eyes, nose, mouth, etc.). (that is, whether it is flat like a photograph). The authentication unit 130 may separately perform an authentication process using the first biometric information and an authentication process using the second biometric information, and integrate the authentication results to obtain a final authentication result. For example, if both the authentication process using the first biometric information and the authentication process using the second biometric information are successful, the authentication unit 130 may determine that the final authentication result is successful. Further, the authentication unit 130 may determine that the final authentication result is failure when at least one of the authentication process using the first biometric information and the authentication process using the second biometric information fails. The authentication result of the authentication unit 130 is configured to be output to the execution unit 140 .

The executing unit 140 is configured to be able to execute predetermined processing in the facility based on the authentication result of the authenticating unit 130 . “Facilities” here refer to facilities used by the subject, such as residential facilities such as condominiums, stores such as retail stores, corporate offices, bus terminals, airports, and facilities for holding various events. you can Facilities are not limited to indoor facilities, and may be outdoor facilities such as parks and amusement parks. Also, the "predetermined process" includes various processes that can be executed in a facility, and may be, for example, a process for controlling facility equipment. In this case, the predetermined process may be a process performed at multiple facilities. The predetermined process may include multiple processes. A specific example of the predetermined process will be described in detail in an embodiment described later. For example, the execution unit 140 may execute a predetermined process when the authentication process in the authentication unit 130 succeeds, and may not execute the predetermined process when the authentication process in the authentication unit 130 fails. Alternatively, the execution unit 140 executes the first predetermined processing when the authentication processing in the authentication unit 130 succeeds, and executes the second predetermined processing (i.e., the first predetermined processing) in the case where the authentication processing in the authentication unit 130 fails. A process different from the process) may be executed.

(Flow of operation)
Next, the operation flow of the information processing system 10 according to the first embodiment will be described with reference to FIG. FIG. 6 is a flow chart showing the operation flow of the information processing system according to the first embodiment.

As shown in FIG. 6, when the information processing system 10 according to the first embodiment operates, the rotation control unit 110 first detects the position of the object (step S101). Then, the rotation control unit 110 controls the rotation of the first camera 18 and the second camera 19 according to the detected target position (step S102). Note that the first camera 18 and the second camera 19 may perform imaging at the timing when the control by the rotation control section 110 ends. In this case, the first camera 18 and the second camera 19 may capture images at the same time or at different timings. Also, the first camera 18 and the second camera 19 may take images during the control by the rotation control section 110 . For example, the first camera 18 and the second camera 19 may capture images a plurality of times while the rotation control by the rotation control unit 110 is being continued.

Subsequently, the biometric information acquiring unit 120 acquires images captured by the first camera 18 and the second camera 19 (that is, the first image and the second image) (step S103). Then, the biometric information acquiring unit 120 acquires first biometric information from the first image captured by the first camera 18, and acquires second biometric information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). Then, the execution unit 140 executes predetermined processing in the facility based on the authentication result of the authentication unit 130 (step S106).

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the first embodiment will be described.

As described with reference to FIGS. 1 to 6, in the information processing system 10 according to the first embodiment, the first camera 18 and the second camera 19 are rotated about the same rotation axis to obtain images of the target. If the two cameras are rotated about the same axis of rotation in this way, it is possible to collectively adjust their imaging ranges. Therefore, compared to, for example, the case of driving two cameras separately, the device configuration can be simplified and the size of the device can be reduced. In addition, since the two cameras are driven in the same direction, it becomes easy to image the same object with each camera. In other words, it is possible to avoid situations in which two cameras image different objects.

Further, in this embodiment, the first biometric information and the second information are acquired from the images captured by the first camera 18 and the second camera 19, and based on the authentication result using the biometric information, predetermined processing in the facility is performed. is executed. In this way, highly accurate authentication processing can be executed for the target who intends to use the facility, and the predetermined processing can be executed appropriately. For example, if the target is a registered user, it can be determined that the user is allowed to execute the predetermined process, and the predetermined process can be executed. Further, when the target is a user who is not registered or when it is determined that the user is impersonated, it is possible to determine that the user should not execute the predetermined process, and prevent the predetermined process from being executed.

<Second embodiment>
An information processing system 10 according to the second embodiment will be described with reference to FIG. It should be noted that the second embodiment differs from the above-described first embodiment only in part of the operation, and other parts may be the same as those of the first embodiment. Therefore, in the following, portions different from the already described first embodiment will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Details of prescribed processing)
First, the contents of the predetermined process executed in the information processing system 10 according to the second embodiment will be described.

In the information processing system 10 according to the second embodiment, the execution unit 140 executes processing for permitting entry to the facility as predetermined processing. Specifically, the execution unit 140 permits the target to enter the facility (or enter a predetermined area of the facility) when the authentication processing in the authentication unit 130 succeeds. On the other hand, if the authentication processing in the authentication unit 130 fails, the execution unit 140 does not permit the target to enter the facility (or enter a predetermined area of the facility) (in other words, prohibits the object from entering the facility). ). A specific example of the process of permitting entry is the process of unlocking the auto-lock at the entrance of the condominium. In this case, execution unit 140 unlocks the auto-lock of the entrance when authentication processing in authentication unit 130 succeeds (for example, when the target is a resident of an apartment building, a guest registered in advance, or the like). , allows entry to the inside of the target apartment. In addition, when the authentication processing in the authentication unit 130 fails (for example, when the target is not a resident of the condominium, or when fraud such as impersonation is performed), the execution unit 140 unlocks the auto-lock of the entrance. and do not allow the subject to enter the apartment. Note that the authentication process may be performed a plurality of times when entering the target. For example, the first authentication process may be performed at the entrance of the first floor of the condominium, and the second authentication process may be performed in front of the room on the floor where the target resides. When the authentication process is performed multiple times in this manner, the number and types of modals to be used may be changed. For example, in the first authentication process performed at the entrance, entry is permitted if face authentication is successful, but in the second authentication process performed in front of the room, entry is allowed if both face authentication and iris authentication are successful. You may allow it.

(Flow of operation)
Next, the flow of operations by the information processing system 10 according to the second embodiment will be described with reference to FIG. FIG. 7 is a flow chart showing the operation flow of the information processing system according to the second embodiment. In addition, in FIG. 7, the same reference numerals are assigned to the same processes as those described in FIG.

As shown in FIG. 7, when the information processing system 10 according to the second embodiment operates, the rotation control unit 110 first detects the target position (step S101). Then, the rotation control unit 110 controls the rotation of the first camera 18 and the second camera 19 according to the detected target position (step S102).

Subsequently, the biometric information acquiring unit 120 acquires images captured by the first camera 18 and the second camera 19 (that is, the first image and the second image) (step S103). Then, the biometric information acquiring unit 120 acquires first biometric information from the first image captured by the first camera 18, and acquires second biometric information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). The executing unit 140 then determines whether or not both the authentication processing using the first biometric information and the authentication processing using the second biometric information in the authentication unit 130 have succeeded (step S201). If both authentication processes have not succeeded (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the predetermined process is not executed (that is, entry to the target facility is not permitted).

On the other hand, if both of the authentication processes have succeeded (step S201: YES), the execution unit 140 determines whether or not the person permitted to enter has a companion (step S202). Whether or not there is a companion may be determined, for example, by whether or not there is another target around the target (for example, within a predetermined distance). In this case, the existence of other objects may be detected from images captured by the first camera 18 and the second camera 19 . For example, when a plurality of people are captured in the images captured by the first camera 18 and the second camera 19 (for example, when a plurality of faces are detected from the images), the execution unit 140 It can be determined that there is a companion. Alternatively, the presence of other subjects may be determined by claims by subjects whose authentication process has been successful. For example, when the target operates the terminal and inputs that there is a companion (for example, when pressing the "with companion" button displayed on the touch panel), the execution unit 140 instructs the target unit to It can be determined that there is In addition, the presence or absence of companions may be reported in a non-contact manner. For example, the presence or absence of companions may be declared by gestures of the user. In this case, if there are two companions, you can raise two fingers, and if there are four companions, you can raise four fingers. may be Also, if a suspicious person is nearby and you want to issue an SOS secretly (without being noticed by the suspicious person), you may make the target perform a specific gesture. For example, when a gesture such as covering the right eye with a hand is performed, an alert may be sent to an apartment concierge, a security guard, or the like, informing the existence of a suspicious person. If there is no companion (step S202: NO), the subsequent processing is omitted and the series of operations ends.

On the other hand, if there is a companion (step S202: YES), the information processing system 10 according to the second embodiment performs similar processing for the companion. Specifically, the rotation control unit 110 detects the position of the target (companion) (step S101). Then, the rotation control unit 110 controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the target (accompanying person) (step S102).

Subsequently, the biometric information acquiring unit 120 acquires images of the companion captured by the first camera 18 and the second camera 19 (that is, the first image and the second image) (step S103). Then, the biometric information acquisition unit 120 acquires the first biometric information of the companion from the first image captured by the first camera 18, and the second biometric information of the companion from the second image captured by the second camera 19. Information is acquired (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the companion's first biometric information and second biometric information acquired by the biometric information acquisition unit 120 (step S105). In particular, the execution unit 140 determines whether or not at least one of the authentication processing using the first biometric information and the authentication processing using the second biometric information in the authentication unit 130 has succeeded (step S203). . That is, for the first subject, it was determined whether or not both the authentication processing using the first biometric information and the authentication processing using the second biometric information were successful. It is determined whether or not either one of the authentication processing using the information and the authentication processing using the second biometric information has succeeded.

Then, when at least one of the authentication processes is successful (step S203: YES), the execution unit 140 permits the subject and the companion to enter the facility (step S204). Therefore, when the target is accompanied by a companion, entry is not permitted only by successful authentication of the target, but is permitted by successful authentication of the companion. However, for accompanying persons, even if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, if the other authentication process succeeds, admission will be permitted. Allowed. For example, if both face authentication and iris authentication of the subject are successful, the companion may be allowed to enter if only the face authentication is successful. Note that if both of the authentication processes fail (step S204: NO), the execution unit 140 does not permit the subject and the companion to enter the facility. When there are a plurality of companions, the authentication process may be performed for each companion in turn, or may be performed collectively. For example, the authentication process may be performed by performing the authentication process by performing imaging a plurality of times in the order closest to the first camera 18 and the second camera 19, or all images included in the imaging ranges of the first camera 18 and the second camera 19 may be captured. All accompanying persons may be detected (imaging may be performed only once), and authentication processing may be executed collectively.

In addition, in the example described above, an example in which the target companion is processed has been given, but the companion may be another user who is not accompanying the target. That is, the above-described processing may be performed for another user different from the target.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the second embodiment will be described.

As described with reference to FIG. 7, in the information processing system 10 according to the second embodiment, authentication processing is performed for each of the subject and the accompanying person, and admission to the facility is determined. In the second embodiment, in particular, the companion accompanying the target is allowed to enter the facility under looser conditions than the target. can be allowed. For example, a target who is an apartment resident may be a guest (that is, a user who has some relationship with the target: for example, a friend or acquaintance of the target, as well as a user who has a business relationship with the target, such as a housekeeper, a maid, or a tutor). ), if the guest's first biometric information (e.g., face information) is registered, even if the second biometric information (e.g., iris information) is not registered, the accompanying person person will be allowed to enter. That is, iris images are more difficult to register than face images (for example, cameras that can capture iris images are limited). . In addition, although the conditions for admission are relaxed for accompanying persons, since authentication processing using both the first biometric information and the second biometric information is performed for the target, deterioration of security is suppressed. On the other hand, even if you are a companion, it is required that the authentication process succeeds in at least one of the first biometric information and the second biometric information. tailgating) can be prevented.

<Third Embodiment>
An information processing system 10 according to the third embodiment will be described with reference to FIG. It should be noted that the third embodiment may partially differ from the first and second embodiments described above in configuration and operation, and the rest may be the same as those in the first and second embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Functional configuration)
Next, the functional configuration of the information processing system 10 according to the third embodiment will be described with reference to FIG. FIG. 8 is a block diagram showing the functional configuration of an information processing system according to the third embodiment. In addition, in FIG. 8, the same reference numerals are given to the same elements as those shown in FIG.

As shown in FIG. 8, the information processing system 10 according to the third embodiment includes a first camera 18 and a second camera 19, a rotation control unit 110, a biometric information acquiring unit, and the like as components for realizing its functions. It includes a unit 120 , an authentication unit 130 , an execution unit 140 and an operation reception unit 150 . That is, the information processing system 10 according to the second embodiment further includes an operation reception unit 150 in addition to the configuration of the first embodiment (see FIG. 4). The operation reception unit 150 may be, for example, a processing block implemented by the above-described processor 11 (see FIG. 1).

The operation reception unit 150 is configured to be able to receive an operation from a user in the facility (for example, a user in the room called by the intercom). The operation reception unit 150 is configured to be able to control the rotation of the first camera 18 and the second camera 19 according to user's operation. Rotation control by the operation reception unit 150 is control executed separately from rotation control by the rotation control unit 110 . The operation reception unit 150 may control the rotation of the first camera 18 and the second camera 19 according to the user's operation, for example, after the rotation control by the rotation control unit 110 is finished. Alternatively, the operation reception unit 150 may control the rotation of the first camera 18 and the second camera 19 according to the user's operation before the rotation control by the rotation control unit 110 is started. The operation reception unit 150 may be configured as an intercom installed in the room, for example. Alternatively, the operation reception unit 150 may receive an operation from an application installed on a user's terminal (for example, a smartphone or the like).

When the rotation of the first camera 18 and the second camera 19 is controlled by the operation reception unit 150 , the operation of the system after rotation control may also be executed according to the operation received by the operation reception unit 150 . For example, authentication processing using images captured by the first camera 18 and the second camera 19 may be started in response to an operation accepted by the operation accepting unit 150 . More specifically, when the user performs an operation to rotate the first camera 18 and the second camera 19, a message such as "Would you like to perform authentication?" is displayed on the terminal. Then, when the user touches a button indicating that authentication is to be performed (for example, a "Yes" or "YES" button), the authentication process is started at that timing. In this way, the target can be confirmed by the authentication process, so the target can be confirmed more reliably than when visually checking the video.

Here, an example in which the information processing system 10 according to the third embodiment is applied to the entrance of an apartment building will be described. At the entrance of the condominium, the first camera 18 and the second camera 19 capture images of a target (ie, a user who is about to enter the condominium). For example, the first camera 18 images the subject's face, and the second camera 19 images the subject's iris. In this case, the rotation control unit 110 performs control such that each of the first camera 18 and the second camera 19 faces the face of the target. It is assumed that the images captured by the first camera 18 and the second camera 19 can be checked by residents of the condominium.

When the rotation control is executed as described above, since the first camera 18 and the second camera 19 are directed toward the face of the target, there is a possibility that other portions may not fit within the imaging range. For example, the target's hand is no longer visible, making it impossible to know what the target is holding. Alternatively, a short target user (for example, a child) cannot be seen. In such a case, the resident of the condominium operates the imaging angles of the first camera 18 and the second camera 19 . For example, a resident of an apartment complex can move the first camera 18 and the second camera 19 downward to check whether the subject is holding something in his/her hand, whether the subject is carrying a child, and the like. In addition, when the first camera 18 or the second camera 19 cannot be rotated normally due to a system failure or the like, manual rotation control can be performed to rotate the first camera 18 and the second camera 19 in an appropriate direction (for example, the face). direction). In this case, not only the residents of the apartment but also the manager (concierge, etc.) may be able to manually control the rotation of the first camera 18 and the second camera 19 . For example, when the first camera 18 and the second camera 19 do not rotate normally, the resident of the condominium touches the contact button displayed on the display of the control terminal (that is, the terminal having the operation reception unit 150). Then, you can connect to the concierge and notify the system of any trouble, or have the concierge manually control the rotation.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the third embodiment will be described.

As described with reference to FIG. 8 , in the information processing system 10 according to the third embodiment, a user in the facility can control rotation of the first camera 18 and the second camera 19 . By doing so, it is possible for the user in the facility to check the part that cannot be seen under normal rotation control (that is, rotation control by the rotation control unit 110). Therefore, it is possible to improve the user's convenience and the security function. Also, since the first camera 18 and the second camera 19 are rotatable, a wider area can be confirmed compared to a non-rotating camera.

<Fourth Embodiment>
An information processing system 10 according to the fourth embodiment will be described with reference to FIG. It should be noted that the fourth embodiment may differ from the first to third embodiments described above only in part of the operation, and may be the same as the first to third embodiments in other respects. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Details of prescribed processing)
First, the content of the predetermined process executed in the information processing system 10 according to the fourth embodiment will be described.

In the information processing system 10 according to the fourth embodiment, the execution unit 140 executes the process of calling the elevator to the designated floor as the predetermined process. Specifically, the execution unit 140 executes a process of calling an elevator to the floor corresponding to the target position for which the authentication process has succeeded. For example, if the target is successfully authenticated at the entrance on the first floor, the execution unit 140 may execute processing to call the elevator to the first floor (ie, the floor where the target is located). However, if the elevator cannot be called to the floor where the target is located (for example, the elevator can only be used from the second floor), a process of calling the elevator to the nearest floor to the target may be executed. Alternatively, if the subject is known not to take the elevator immediately after authentication (e.g., is expected to go upstairs to run errands and take the elevator), the subject is expected to take the elevator. A process of calling an elevator to the floor may be executed. Note that the process of calling the elevator may be executed together with the already-described process of permitting entry into the facility (see the second embodiment). That is, the execution unit 140 may execute, as the predetermined processes, a process of permitting entry and a process of calling an elevator. In this case, when it is detected that the number of users permitted to enter is equal to or greater than a predetermined number, a plurality of elevators may be called. The predetermined number of people here may be the number of people according to the capacity of the elevator. For example, if an elevator has a capacity of 5 people, detecting 6 or more users may call 2 elevators.

(Flow of operation)
Next, the operation flow of the information processing system 10 according to the fourth embodiment will be described with reference to FIG. FIG. 9 is a flow chart showing the operation flow of the information processing system according to the fourth embodiment. In addition, in FIG. 9, the same reference numerals are assigned to the same processes as those shown in FIG.

As shown in FIG. 9, when the information processing system 10 according to the fourth embodiment operates, the rotation control unit 110 first detects the target position (step S101). Then, the rotation control unit 110 controls the rotation of the first camera 18 and the second camera 19 according to the detected target position (step S102).

Subsequently, the biometric information acquiring unit 120 acquires images captured by the first camera 18 and the second camera 19 (that is, the first image and the second image) (step S103). Then, the biometric information acquiring unit 120 acquires first biometric information from the first image captured by the first camera 18, and acquires second biometric information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). The executing unit 140 then determines whether or not both the authentication processing using the first biometric information and the authentication processing using the second biometric information in the authentication unit 130 have succeeded (step S201).

If both authentication processes have succeeded (step S201: YES), the execution unit 140 executes a process of calling an elevator to the floor corresponding to the target position (step S401). On the other hand, if both of the authentication processes have not succeeded (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the process of calling the elevator to the floor corresponding to the target position is not executed.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the fourth embodiment will be described.

As described with reference to FIG. 9, in the information processing system 10 according to the fourth embodiment, when the target authentication process is successful, the process of calling the elevator to the floor corresponding to the target position is executed. By doing so, the time for the object to wait for the elevator can be shortened, and the object can move smoothly in the facility.

<Fifth Embodiment>
An information processing system 10 according to the fifth embodiment will be described with reference to FIG. It should be noted that the fifth embodiment may differ from the first to fourth embodiments described above only in a part of the operation, and the other parts may be the same as those of the first to fourth embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Details of prescribed processing)
First, the contents of the predetermined process executed in the information processing system 10 according to the fifth embodiment will be described.

In the information processing system 10 according to the fifth embodiment, the execution unit 140 executes a process of calling the vehicle used by the target to a predetermined position as the predetermined process. Note that the "vehicle" here is a broad concept that includes not only automobiles but also various mobile objects used by objects, such as motorcycles, bicycles, ships, airplanes, and helicopters. For example, if the target is successfully authenticated at the timing of leaving the front door of his/her home, the execution unit 140 causes the vehicle owned by the target (for example, the vehicle previously associated with the target) to leave the mechanical parking lot and enter the driveway. You may output instructions to move to . Note that the timing of exiting the garage is not limited to just before leaving the entrance. For example, when the authentication terminal installed in front of the door after exiting the front door succeeds in authentication, the door may be locked and the vehicle may be taken out. Also, when instructing to leave the garage using a smartphone application, it may be possible to reserve a leaving time, for example, to leave the garage after 30 minutes. Furthermore, if there is a possibility that the target will not use a vehicle (for example, if there is a possibility that the target will walk or use other means of transportation), the execution unit 140 performs processing to confirm whether the target will use a vehicle. may For example, the execution unit 140 may display on a terminal (for example, a smart phone) owned by the target whether or not the target uses a car. For example, if the authentication process is successful, a message such as "Would you like to exit the car?" may be output on the display of the terminal. In this case, the execution unit 140 may execute a process of calling the vehicle to a predetermined location when the target uses the vehicle. In other words, the execution unit 140 may not execute the process of calling the vehicle to the predetermined location when the target inputs that the vehicle will not be used (or when nothing is input). Further, when there are a plurality of vehicles that the target may use (for example, when the target owns a plurality of vehicles), the execution unit 140 causes the target to select a vehicle to use. good too. Alternatively, the executing unit 140 may prepare for leaving the vehicle immediately instead of actually leaving the vehicle. For example, if the vehicle is located on the 10th basement floor, processing may be executed to move the vehicle to a location closer to the ground, such as the 2nd basement floor. Note that even if the authentication process is successful, if the subject has gone somewhere without using the vehicle (for example, if the vehicle has not been used for a predetermined period of time), the vehicle will be moved to the position before leaving the garage. may be set back to .

(Flow of operation)
Next, the operation flow of the information processing system 10 according to the fifth embodiment will be described with reference to FIG. FIG. 10 is a flow chart showing the operation flow of the information processing system according to the fifth embodiment. In FIG. 10, the same reference numerals are given to the same processes as those shown in FIG.

As shown in FIG. 10, when the information processing system 10 according to the fifth embodiment operates, the rotation control unit 110 first detects the position of the object (step S101). Then, the rotation control unit 110 controls the rotation of the first camera 18 and the second camera 19 according to the detected target position (step S102).

Subsequently, the biometric information acquiring unit 120 acquires images captured by the first camera 18 and the second camera 19 (that is, the first image and the second image) (step S103). Then, the biometric information acquiring unit 120 acquires first biometric information from the first image captured by the first camera 18, and acquires second biometric information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). The executing unit 140 then determines whether or not both the authentication processing using the first biometric information and the authentication processing using the second biometric information in the authentication unit 130 have succeeded (step S201).

If both authentication processes have succeeded (step S201: YES), the execution unit 140 executes a process of calling the vehicle used by the target to a predetermined position (step S401). On the other hand, if both of the authentication processes have not succeeded (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the process of calling the vehicle used by the target to the predetermined location is not executed.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the fifth embodiment will be described.

As described with reference to FIG. 10, in the information processing system 10 according to the fifth embodiment, when the target authentication process is successful, the process of calling the vehicle used by the target to a predetermined position is executed. In this way, the waiting time for calling the vehicle can be shortened, or the trouble of moving the vehicle by the subject can be saved, so that the subject can use the vehicle more smoothly.

<Sixth Embodiment>
An information processing system 10 according to the sixth embodiment will be described with reference to FIG. It should be noted that the sixth embodiment may differ from the above-described fifth embodiment only in a part of the operation, and other parts may be the same as those of the first to fifth embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Details of prescribed processing)
First, the contents of the predetermined process executed in the information processing system 10 according to the sixth embodiment will be described.

In the information processing system 10 according to the sixth embodiment, the execution unit 140 executes, as predetermined processing, processing for guiding a target to a route within a facility. Specifically, the execution unit 140 executes a process of guiding the target along a route that does not pass other users when the target moves within the facility. The execution unit 140 may display an in-facility map on a terminal (for example, a smartphone, etc.) owned by the target, for example, and superimpose the route to proceed thereon. In addition, when the object moves between floors in the facility, the elevator to ride may be displayed. The route to be guided may be a route outside the facility. For example, a suggestion such as "Please use the second back door to exit the condominium" may be made so as not to cross paths with other users outside the condominium. Also, in addition to the route, it may be configured to indicate time information as well. For example, instructions such as "Please leave in 5 minutes because it is currently busy" or "Please pass this route in 3 minutes and take the elevator in 5 minutes" may be output. Note that such route guidance may be implemented by monitoring the positions of other users within the facility, for example, using a surveillance camera or the like installed within the facility. If it is difficult to avoid all other users, the execution unit 140 may guide a route that minimizes the number of other users passing each other. Also, other users (for example, family members, facility management staff, etc.) specified in advance by the user may be allowed to pass each other. The process of guiding the route may be executed together with the process of calling an elevator (see the fourth embodiment) or the process of calling a vehicle (see the fifth embodiment) already described.

(Flow of operation)
Next, the operation flow of the information processing system 10 according to the sixth embodiment will be described with reference to FIG. 11 . FIG. 11 is a flow chart showing the operation flow of the information processing system according to the sixth embodiment. In FIG. 11, the same reference numerals are given to the same processes as those shown in FIG.

As shown in FIG. 11, when the information processing system 10 according to the sixth embodiment operates, the rotation control unit 110 first detects the target position (step S101). Then, the rotation control unit 110 controls the rotation of the first camera 18 and the second camera 19 according to the detected target position (step S102).

Subsequently, the biometric information acquiring unit 120 acquires images captured by the first camera 18 and the second camera 19 (that is, the first image and the second image) (step S103). Then, the biometric information acquiring unit 120 acquires first biometric information from the first image captured by the first camera 18, and acquires second biometric information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). The executing unit 140 then determines whether or not both the authentication processing using the first biometric information and the authentication processing using the second biometric information in the authentication unit 130 have succeeded (step S201).

If both of the authentication processes have succeeded (step S201: YES), the execution unit 140 executes a process of guiding the target on the route to proceed within the facility (step S401). On the other hand, if both of the authentication processes have not succeeded (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the process of guiding the target to the progress route within the facility is not executed.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the sixth embodiment will be described.

As described with reference to FIG. 11 , in the information processing system 10 according to the sixth embodiment, when the target authentication process is successful, the process of guiding the target on the progress route within the facility is executed. In this way, it is possible to prevent the target from passing other users in the facility. Such an effect is exhibited remarkably when the target wants to avoid being seen and act in the facility (for example, when the target is a celebrity or the like).

<Seventh embodiment>
An information processing system 10 according to the seventh embodiment will be described with reference to FIGS. 12 and 13. FIG. It should be noted that the seventh embodiment may differ from the first to sixth embodiments described above only in a part of configuration and operation, and other parts may be the same as those of the first to sixth embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Functional configuration)
First, the functional configuration of the information processing system 10 according to the seventh embodiment will be described with reference to FIG. 12 . FIG. 12 is a block diagram showing the functional configuration of an information processing system according to the seventh embodiment. In addition, in FIG. 12, the same code|symbol is attached|subjected to the element similar to the component shown in FIG.

As shown in FIG. 12, the information processing system 10 according to the seventh embodiment includes a first camera 18 and a second camera 19, a rotation control unit 110, a biometric information acquiring unit, and a It comprises a unit 120 , an authentication unit 130 , an execution unit 140 and a warning unit 160 . That is, the information processing system 10 according to the seventh embodiment further includes a warning unit 160 in addition to the configuration of the first embodiment (see FIG. 4). The warning unit 160 may be, for example, a processing block implemented by the processor 11 (see FIG. 1) described above.

The warning unit 160 is configured to be capable of outputting a warning when the target does not reach the predetermined location within a predetermined time after the target authentication process is successful. The “predetermined location” here is a location that is set as a location (for example, the destination of the target) that is predicted to arrive at the target whose authentication process has succeeded. Also, the "predetermined time" is a time set according to the time required for the object to reach the predetermined location (may include some margin). For example, when the target authentication process is successful at the entrance of the condominium, the warning unit 160 outputs a warning if the target does not reach a specific room in the condominium (for example, home or visiting destination) within a predetermined time. You can do it. The content of the warning may, for example, inform the target that some abnormality has occurred. The warning unit 160 may warn, for example, the facility management staff or the like, or may warn the target himself/herself or the user of the target visit destination. The warning by the warning unit 160 may be, for example, an alert display using a display or output of an alert sound using a speaker. In addition, a plurality of predetermined times are set, and if the target does not reach the predetermined location by the first predetermined time, the first warning (for example, a weak warning) is executed, and by the second predetermined time A second warning (eg, a stronger warning) may be executed if the target does not reach the predetermined location. It should be noted that the level of importance may be set for the target of the warning. For example, guests are more likely to get lost than residents who are accustomed to living in an apartment, and there is also a possibility of theft or the like, so the importance of guests may be set high. In this case, a short predetermined period of time until the warning is issued may be set for a target with a high degree of importance. Alternatively, the alert may be strengthened (for example, the second alert always notifies the concierge, etc.) for a target with a high degree of importance. In addition, even if you are a resident of an apartment building, you can set the importance of children, the elderly, and users with chronic illnesses to be as high as guests, shorten the predetermined time until an alert is issued, or strengthen the alert. You can

(Flow of operation)
Next, the operation flow of the information processing system 10 according to the seventh embodiment will be described with reference to FIG. 13 . FIG. 13 is a flow chart showing the operation flow of the information processing system according to the seventh embodiment. In addition, in FIG. 13, the same reference numerals are assigned to the same processes as those shown in FIG.

As shown in FIG. 13, when the information processing system 10 according to the seventh embodiment operates, the rotation control unit 110 first detects the target position (step S101). Then, the rotation control unit 110 controls the rotation of the first camera 18 and the second camera 19 according to the detected target position (step S102).

Subsequently, the biometric information acquiring unit 120 acquires images captured by the first camera 18 and the second camera 19 (that is, the first image and the second image) (step S103). Then, the biometric information acquiring unit 120 acquires first biometric information from the first image captured by the first camera 18, and acquires second biometric information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). The executing unit 140 then determines whether or not both the authentication processing using the first biometric information and the authentication processing using the second biometric information in the authentication unit 130 have succeeded (step S201).

If both authentication processes have succeeded (step S201: YES), the execution unit 140 executes a process of permitting the object to enter the facility (step S204). On the other hand, if both of the authentication processes have not succeeded (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the process of permitting the target to enter the facility is not executed.

When the target is permitted to enter the facility, the warning unit 160 determines whether or not a predetermined period of time has passed since the authentication was successful (step S701). If it is determined that the predetermined time has not passed (step S701: NO), the warning unit 160 continues to measure the time after the successful authentication. On the other hand, if it is determined that the predetermined time has passed (step S701: YES), the warning unit 160 determines whether or not the target has reached the predetermined location (step S702).

If the target has not reached the predetermined location (step S702: NO), the warning unit 160 outputs a warning (step S703). On the other hand, if the target has already arrived at the predetermined location (step S702: YES), the warning unit 160 does not output a warning.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the seventh embodiment will be described.

As described with reference to FIGS. 12 and 13, in the information processing system 10 according to the seventh embodiment, the warning unit 160 outputs a warning when the target does not reach the predetermined location within a predetermined time after successful authentication. be done. In this way, it is possible to inform the target that some abnormality has occurred based on the passage of time after authentication. For example, it is possible to notify that the target is lost in the facility or that the target has fallen down due to poor physical condition.

<Eighth Embodiment>
An information processing system 10 according to the eighth embodiment will be described with reference to FIG. It should be noted that the eighth embodiment may be different from the first to seventh embodiments described above only in part of the operation, and the other parts may be the same as those of the first to seventh embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Details of prescribed processing)
First, the content of the predetermined process executed in the information processing system 10 according to the eighth embodiment will be described.

In the information processing system 10 according to the eighth embodiment, the execution unit 140 executes a process of permitting a request for a predetermined service to a target as the predetermined process. The "predetermined service" here may involve payment processing (that is, the occurrence of costs), such as calling a taxi or ordering food delivery. After the subject is authenticated, the predetermined service may be requested from a terminal in the facility, a terminal (smartphone) owned by the subject, or the like. In addition, when requesting a predetermined service, information indicating the location of the successfully authenticated target (e.g., GPS location information) and information about the target (e.g., target name, address, room number, etc.) may be automatically notified.

The cost of requesting the prescribed service will be settled by the payment method linked to the successfully authenticated target. For example, the payment may be automatically deducted from the account associated with the object specified by the authentication process. Alternatively, settlement processing may be automatically performed using a credit card associated with the object specified by the authentication processing. In addition, at the stage of requesting the service, processing may be performed to confirm with the target itself whether or not the payment method associated with the target may be used for payment.

(Flow of operation)
Next, the operation flow of the information processing system 10 according to the eighth embodiment will be described with reference to FIG. FIG. 14 is a flow chart showing the operation flow of the information processing system according to the eighth embodiment. In FIG. 14, the same reference numerals are given to the same processes as those shown in FIG.

As shown in FIG. 14, when the information processing system 10 according to the eighth embodiment operates, the rotation control unit 110 first detects the position of the object (step S101). Then, the rotation control unit 110 controls the rotation of the first camera 18 and the second camera 19 according to the detected target position (step S102).

Subsequently, the biometric information acquiring unit 120 acquires images captured by the first camera 18 and the second camera 19 (that is, the first image and the second image) (step S103). Then, the biometric information acquiring unit 120 acquires first biometric information from the first image captured by the first camera 18, and acquires second biometric information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). The executing unit 140 then determines whether or not both the authentication processing using the first biometric information and the authentication processing using the second biometric information in the authentication unit 130 have succeeded (step S201).

If both authentication processes have succeeded (step S201: YES), the execution unit 140 executes a process of permitting the request for the predetermined service to the target (step S801). On the other hand, if both of the authentication processes have not succeeded (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, when either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the process of permitting the request for the predetermined service to the target is not executed.

If the target is permitted to request the predetermined service, the execution unit 140 determines whether the target has requested the predetermined service (step S802). Then, when the predetermined service is requested (step S802: YES), the payment method associated with the service fee is settled (step S803). On the other hand, if the predetermined service has been requested (step S802: NO), the subsequent processing is omitted, and the series of operations ends.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the eighth embodiment will be described.

As described with reference to FIG. 14, in the information processing system 10 according to the eighth embodiment, when the target authentication process is successful, the target is permitted to request a predetermined service, and the cost is linked to the target. Payment will be made using a payment method based on In this way, it is possible to improve the convenience of the target while enhancing security through biometric authentication. In addition, by notifying the service requesting party of the information indicating the position of the object and the information regarding the object, it is possible to save the trouble of separately informing the service requesting party of these information.

<Ninth Embodiment>
An information processing system 10 according to the ninth embodiment will be described with reference to FIG. It should be noted that the ninth embodiment may differ from the first to eighth embodiments described above only in part of the operation, and the other parts may be the same as those of the first to eighth embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Details of prescribed processing)
First, the contents of the predetermined process executed in the information processing system 10 according to the ninth embodiment will be described.

In the information processing system 10 according to the ninth embodiment, the execution unit 140 executes, as the predetermined process, a process of permitting a payment process by a successfully authenticated target. The payment processing here is not particularly limited, but may be, for example, payment processing when purchasing a product at a store or a vending machine.

If the subject makes a payment, the cost will be settled by the payment method associated with the permitter who authorizes the subject to process the payment. In other words, the permitter pays the fee, not the person who made the payment. In addition, when the permitter performs the settlement process, the permitter should notify and pay the cost. A specific relationship between the permitter and the target here is, for example, a parent-child relationship. In this case, if the child (target) is successfully authenticated and the permitter for the target is identified, the parent (permitter) will pay the payment processing fee. Alternatively, a relationship between an apartment resident and a housekeeper can be mentioned. In this case, if the authentication by the housekeeper (subject) is successful and the permitter for the subject is identified, the payment processing fee will be paid by the employer (permitter). Note that the permitter may set an upper limit amount for payment processing. In this case, the target for whom the authentication process is successful cannot perform the settlement process exceeding the upper limit amount. In addition, the permitter may limit the usage of payment processing. For example, the Authorizer can set up to only pay for purchases made at a particular store by the subject.

(Flow of operation)
Next, the operation flow of the information processing system 10 according to the ninth embodiment will be described with reference to FIG. 15 . FIG. 15 is a flow chart showing the operation flow of the information processing system according to the ninth embodiment. In FIG. 15, the same reference numerals are given to the same processes as those shown in FIG.

As shown in FIG. 15, when the information processing system 10 according to the ninth embodiment operates, the rotation control unit 110 first detects the target position (step S101). Then, the rotation control unit 110 controls the rotation of the first camera 18 and the second camera 19 according to the detected target position (step S102).

Subsequently, the biometric information acquiring unit 120 acquires images captured by the first camera 18 and the second camera 19 (that is, the first image and the second image) (step S103). Then, the biometric information acquiring unit 120 acquires first biometric information from the first image captured by the first camera 18, and acquires second biometric information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). The executing unit 140 then determines whether or not both the authentication processing using the first biometric information and the authentication processing using the second biometric information in the authentication unit 130 have succeeded (step S201).

If both authentication processes have succeeded (step S201: YES), the execution unit 140 permits the target to perform the payment process (step S901). On the other hand, if both of the authentication processes have not succeeded (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the target is not permitted to perform the payment process.

When the target is permitted to perform the settlement process, the executing unit 140 determines whether the target has performed the settlement process (step S902). Then, if the payment processing by the target has been performed (step S902: YES), the payment is made by the payment method associated with the permitter (step S903). On the other hand, if the payment processing by the target has not been performed (step S902: NO), the subsequent processing is omitted, and the series of operations ends.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the ninth embodiment will be described.

As described with reference to FIG. 15, in the information processing system 10 according to the ninth embodiment, when the authentication processing of the target is successful, the processing of permitting the payment processing to the target is executed, and the fee is different from that of the target. Payment is made using the payment method associated with the person. In this way, it is possible to improve the convenience of payment processing while enhancing security through biometric authentication.

<Tenth Embodiment>
An information processing system 10 according to the tenth embodiment will be described with reference to FIG. It should be noted that the tenth embodiment may differ from the first to ninth embodiments described above only in a part of the operation, and other parts may be the same as those in the first to ninth embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Details of prescribed processing)
First, the contents of the predetermined process executed in the information processing system 10 according to the tenth embodiment will be described.

In the information processing system 10 according to the tenth embodiment, the execution unit 140 executes a process of specifying a room to be used as a predetermined process. For example, if the target is a resident of an apartment building, the execution unit 140 may specify the room number of the target's home. The information for specifying the room to be used by the target may be registered in advance or may be input by the target. Alternatively, the room number in which the object resides may be automatically obtained by authenticating the object. The execution unit 140 further executes a process of outputting an instruction to carry the target baggage to the specified room as the predetermined process. For example, when the room number of the target house in the condominium is specified as in the above example, the execution unit 140 may output an instruction to carry the target package from the entrance to the room of the house. The instruction to transport the load may be output to, for example, a transport robot or the like, or may be output to facility staff or the like. The execution unit 140 may perform processing for confirming the presence or absence of packages, the number of packages, the weight of packages, and the like for the target before outputting the instruction to carry the packages. In this case, an instruction to transport the cargo may be output after considering the confirmed items. For example, when the number of packages is large or when the packages are extremely heavy, an instruction including cautions such as "a trolley is required" may be output.

(Flow of operation)
Next, the operation flow of the information processing system 10 according to the tenth embodiment will be described with reference to FIG. FIG. 16 is a flow chart showing the operation flow of the information processing system according to the tenth embodiment. In FIG. 16, the same reference numerals are given to the same processes as those shown in FIG.

As shown in FIG. 16, when the information processing system 10 according to the tenth embodiment operates, the rotation control unit 110 first detects the target position (step S101). Then, the rotation control unit 110 controls the rotation of the first camera 18 and the second camera 19 according to the detected target position (step S102).

Subsequently, the biometric information acquiring unit 120 acquires images captured by the first camera 18 and the second camera 19 (that is, the first image and the second image) (step S103). Then, the biometric information acquiring unit 120 acquires first biometric information from the first image captured by the first camera 18, and acquires second biometric information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). The executing unit 140 then determines whether or not both the authentication processing using the first biometric information and the authentication processing using the second biometric information in the authentication unit 130 have succeeded (step S201).

If both authentication processes have succeeded (step S201: YES), execution unit 140 identifies the room used by the target (step S1001). Then, the executing unit 140 further outputs an instruction to carry the luggage to the specified room (step S1002). It should be noted that if the target does not have luggage, the processing of steps S1001 and S1002 may be omitted.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the tenth embodiment will be described.

As described with reference to FIG. 16, in the information processing system 10 according to the tenth embodiment, when the target authentication process is successful, the room to be used by the target is specified, and an instruction to carry the target package to that room is issued. output. In this way, the object does not need to carry the luggage by himself, so it is possible to improve convenience. Further, if the object is authenticated and the object's room number is automatically specified, convenience can be improved compared to the case of manually inputting the room number.

<Eleventh Embodiment>
An information processing system 10 according to the eleventh embodiment will be described with reference to FIGS. 17 and 18. FIG. The eleventh embodiment may differ from the first to tenth embodiments described above only partially in configuration and operation, and may be the same as the first to tenth embodiments in other respects. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Functional configuration)
First, the functional configuration of the information processing system 10 according to the eleventh embodiment will be described with reference to FIG. 17 . FIG. 17 is a block diagram showing the functional configuration of an information processing system according to the eleventh embodiment. In addition, in FIG. 17, the same code|symbol is attached|subjected to the element similar to the component shown in FIG.

As shown in FIG. 17, the information processing system 10 according to the eleventh embodiment includes a first camera 18 and a second camera 19, a rotation control unit 110, a biometric information acquiring unit, and a It includes a unit 120 , an authentication unit 130 , an execution unit 140 , a sick person detection unit 170 and a call control unit 180 . That is, the information processing system 10 according to the eleventh embodiment further includes a sick person detection unit 170 and a call control unit 180 in addition to the configuration of the first embodiment (see FIG. 4). there is The unwell person detection unit 170 and the call control unit 180 may be, for example, processing blocks implemented by the above-described processor 11 (see FIG. 1).

The unwell person detection unit 170 is configured to be able to detect a user who is in unwell physical condition (hereinafter referred to as a “person in poor physical condition” as appropriate) in the facility. The person in poor physical condition detection unit 170 may be configured to be able to detect a person in poor physical condition, for example, using images from a surveillance camera or the like installed in the facility. In addition, the poor physical condition detection unit 170 detects a poor physical condition person using an image captured by an authentication terminal (for example, the first camera 18 and the second camera 19) provided in the information processing system 10 according to the present embodiment. may be configured to be possible. In this case, the unwell person detection unit 170 may detect, for example, a user lying on the floor or a user sitting down as an unwell person. In addition, the unwell person detection unit 170 may be configured to be able to specify the location of the unwell person. Information about the unwell person detected by the unwell person detection unit 170 is configured to be output to the call control unit 180 .

The call control unit 180 is configured to be able to call an elevator equipped with a lifesaving tool to the floor corresponding to the position of the unwell person detected by the unhealthy person detection unit 170 . For example, when a person with poor physical condition collapses on the second floor, the call control unit 180 may execute a process of calling an elevator to the second floor (that is, the floor where the person with poor physical condition is present). However, if the elevator cannot be called to the floor where the sick person is present (for example, the elevator cannot be used from all floors), processing to call the elevator to the nearest floor to the target may be executed. In addition, the lifesaving equipment provided in the elevator may include, for example, an AED (automated external defibrillator), oral medicine, wound medicine, adhesive plaster, wrapper, and the like. After calling the elevator, an alert may be sent to the floor from which the elevator was called, the residents of the floor from which the elevator was called, the condominium concierge, security guards, and the like. In this case, an instruction may be output to respond using a lifesaving tool provided in the elevator.

(Flow of operation)
Next, the operation flow of the information processing system 10 according to the eleventh embodiment will be described with reference to FIG. FIG. 18 is a flow chart showing the operation flow of the information processing system according to the eleventh embodiment. The process shown in FIG. 18 is executed independently of the series of operations described in FIG. you can

As shown in FIG. 18, when the information processing system 10 according to the eleventh embodiment operates, first, the sick person detection unit 170 detects a sick person in the facility (step S1101). It should be noted that if a person in poor physical condition is not detected (step S1101: NO), the subsequent processing is omitted, and the series of operations ends.

On the other hand, when a person in poor physical condition is detected (step S1101: YES), the person in poor physical condition detection unit 170 identifies the position of the person in poor physical condition (step S1102). Then, the call control unit 180 calls an elevator equipped with a lifesaving tool to the floor corresponding to the position of the physically unwell person (step S1103). Note that the call control unit 180 may notify the subject himself/herself or the user who assists the subject that an elevator equipped with a lifesaving tool has been called.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the eleventh embodiment will be described.

As described with reference to FIGS. 17 and 18, in the information processing system 10 according to the eleventh embodiment, when an unwell person is detected in the facility, a lifesaving tool is provided on the floor corresponding to the location of the unwell person. An elevator is called. In this way, it is possible to appropriately and quickly provide relief to the sick person.

<Twelfth Embodiment>
An information processing system 10 according to the twelfth embodiment will be described with reference to FIGS. 19 to 21. FIG. The twelfth embodiment may differ from the above-described first to eleventh embodiments only in a part of configuration and operation, and other parts may be the same as those of the first to eleventh embodiments. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Functional configuration)
First, the functional configuration of the information processing system 10 according to the twelfth embodiment will be described with reference to FIG. 19 . FIG. 19 is a block diagram showing the functional configuration of an information processing system according to the twelfth embodiment. In addition, in FIG. 19, the same code|symbol is attached|subjected to the element similar to the component shown in FIG.4 and FIG.17.

As shown in FIG. 19, the information processing system 10 according to the 121st embodiment includes a first camera 18 and a second camera 19, a rotation control unit 110, a biometric information acquisition device, and a It includes a unit 120 , an authentication unit 130 , an execution unit 140 , a physically unwell person detection unit 170 and a notification unit 190 . In other words, the information processing system 10 according to the twelfth embodiment further includes a poor physical condition detection unit 170 and a notification unit 190 in addition to the configuration of the first embodiment (see FIG. 4). . It should be noted that the poor physical condition detection unit 170 may be the same as that of the already described eleventh embodiment. The notification unit 190 may be, for example, a processing block implemented by the processor 11 (see FIG. 1) described above.

The notifying unit 190 notifies the user associated with the subject when the unwell person detected by the unhealthy person detection unit 170 is the subject for which the authentication process has succeeded. The notification unit 190 may, for example, notify the target's family or the like of information indicating the location where the target is lying down. The notification unit 190 may make a notification using facilities within the facility (for example, a display, a speaker, etc. installed within the facility). Alternatively, the notification unit 190 may notify a terminal (for example, a smartphone or the like) owned by the user associated with the target.

(Flow of operation)
Next, the operation flow of the information processing system 10 according to the twelfth embodiment will be described with reference to FIG. FIG. 20 is a flow chart showing the operation flow of the information processing system according to the twelfth embodiment. In FIG. 20, the same reference numerals are given to the same processes as those shown in FIG.

As shown in FIG. 20, when the information processing system 10 according to the twelfth embodiment operates, first, the sick person detection unit 170 detects a sick person in the facility (step S1101). It should be noted that if a person in poor physical condition is not detected (step S1101: NO), the subsequent processing is omitted, and the series of operations ends.

On the other hand, when a person in poor physical condition is detected (step S1101: YES), the person in poor physical condition detection unit 170 identifies the position of the person in poor physical condition (step S1102). Then, the notification unit 190 determines whether or not the person in poor physical condition has been authenticated (that is, whether or not the authentication process using the first biometric information and the second biometric information has been successful) (step S1201).

If the person in poor physical condition has been authenticated (step S1201: YES), the notification unit 190 notifies the user associated with the person in poor physical condition (step S1202). On the other hand, if the person in poor physical condition has not been authenticated (step S1201: NO), subsequent processing is omitted, and the series of operations ends.

(Modification)
Next, with reference to FIG. 21, a modification of the operation flow of the information processing system 10 according to the twelfth embodiment will be described. FIG. 21 is a flow chart showing a modification of the operation flow of the information processing system according to the twelfth embodiment. In FIG. 21, the same reference numerals are given to the same processes as those shown in FIGS.

As shown in FIG. 21, in the modified example of the information processing system 10 according to the twelfth embodiment, first, the unwell person detection unit 170 detects an unwell person in the facility (step S1101). It should be noted that if a person in poor physical condition is not detected (step S1101: NO), the subsequent processing is omitted, and the series of operations ends.

On the other hand, when a person in poor physical condition is detected (step S1101: YES), the person in poor physical condition detection unit 170 identifies the position of the person in poor physical condition (step S1102). Here, in particular, the information processing system 10 according to the modification includes the call control unit 180 (see FIG. 17) described in the eleventh embodiment, and a lifesaving tool (step S1103).

Subsequently, the notification unit 190 determines whether or not the person with poor physical condition has been authenticated (step S1201). Then, if the person in poor physical condition has been authenticated (step S1201: YES), the notification unit 190 notifies the user associated with the person in poor physical condition (step S1202). On the other hand, if the person in poor physical condition has not been authenticated (step S1201: NO), subsequent processing is omitted, and the series of operations ends.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the twelfth embodiment will be described.

As described with reference to FIGS. 19 to 21, in the information processing system 10 according to the twelfth embodiment, when the person in poor physical condition is an authenticated target (in other words, when the person is identified as a target), The user will be notified accordingly. By doing so, it is possible to quickly inform other users of the existence of the person who is in poor physical condition, and to appropriately provide relief to the person who is in poor physical condition.

<Thirteenth Embodiment>
An information processing system 10 according to the thirteenth embodiment will be described with reference to FIGS. 22 to 25. FIG. The thirteenth embodiment shows a specific operation example (display example) of the above-described first to twelfth embodiments, and its configuration and operation are the same as those of the first to twelfth embodiments. It's okay. Therefore, in the following, portions different from the already described embodiments will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Target registration)
First, with reference to FIG. 22, a display example and operation when registering an object will be described. FIG. 22 is a plan view showing an example of a display screen when registering an object. In the following description, it is assumed that the first biometric information is face information and the second biometric information is iris information.

Registered users in the authentication process may be added as appropriate. When adding a registered user, a face image may be captured to register the first biometric information (face information), and iris information may be captured to register the second biometric information (iris information). If it is difficult to take an iris image (for example, if you do not have a camera for taking an iris image), you can take only the face image once and register the face information, and then take the iris image later to obtain the iris information. may be registered.

As shown in FIG. 22, registered users and their registration status may be confirmed and edited on a smartphone, for example. From the image shown in FIG. 22, it can be confirmed that both face information and iris information are registered for Hio, Honko, and Denta. On the other hand, it can be confirmed that only face information is registered and iris information is not registered for a user who is about to be newly registered. Note that these user names may be editable as appropriate.

(Update of registration information)
Next, a display example and operation when updating registration information will be described with reference to FIG. FIG. 23 is a plan view showing an example of a display screen when updating target registration information.

The registered face information and iris information may be updated to new ones. For example, since the face of an infant changes significantly over a certain period of time, an alert prompting the user to update the registered information may be sent after a predetermined period of time has elapsed since the face information was registered. Also, the age of the target may be stored together, and the update frequency may be changed according to the age. For example, the update frequency may decrease as the age increases.

As shown in FIG. 23, when updating the registration information, for example, on the update screen displayed on the smartphone, an update button corresponding to the user who wants to update is pressed, and an image for updating is captured. An image may be captured by a camera built in a smartphone or the like, or may be captured by a dedicated registration terminal or the like. When updating at the registration terminal, information for identifying the user (for example, in the case of an apartment, the room number, etc.) may be input.

(Action according to home status)
Next, an operation example according to the home situation will be described with reference to FIGS. 24 and 25. FIG. FIG. 24 is a plan view showing an example of a display screen showing an absence time of a registered target. FIG. 25 is a plan view showing an example of a display screen showing the home status of a registered target.

As shown in FIG. 24, the registered user's absence time may be input in advance, and notification may be sent to the terminal or the like of the registered user when a visitor arrives during the absence time. Further, when spoofing is detected, it may be notified that spoofing has occurred.

As shown in FIG. 25, the home status may be changed based on the result of the authentication process. For example, if the authentication process succeeds at the entrance of the condominium, the registered user's at-home status may be changed to "at home". Also, if the authentication process is successful when leaving the front door of the home, the home status of the registered user may be changed to "absence".

<Other prescribed processing>
In each of the above-described embodiments, a plurality of examples of the predetermined process executed by the information processing system 10 were given, but the predetermined process is not limited to these examples, and may include other processes.

For example, when performing authentication processing when leaving a room, the predetermined processing may be processing to lock the room. Alternatively, the process may be a process of notifying relevant persons of the object that the object has left the room. Alternatively, in a condominium with a concierge service, processing may be performed to notify the concierge staff that a subject who has left the room will stop by the concierge. Alternatively, the process of requesting the concierge to ship the luggage in the butler box installed in front of the room may be used. Further, if there is a parcel that has been delivered to the target, the process may be a process of notifying that fact.

In addition, the predetermined processing may be processing related to shared facilities (for example, fitness room, bar lounge, party room, co-working space, etc.) within the facility. For example, the predetermined process may be a process of making a reservation for a shared facility. Alternatively, the processing may be such that the usage fee of the shared facility or the purchase fee within the shared facility can be settled by a linked settlement method. Alternatively, the process may be a process of instructing a robot or the like to transport garbage (for example, transportation to a predetermined garbage disposal site).

A processing method of recording a program for operating the configuration of each embodiment so as to realize the functions of each embodiment described above on a recording medium, reading the program recorded on the recording medium as a code, and executing it on a computer is also implemented. Included in the category of form. That is, a computer-readable recording medium is also included in the scope of each embodiment. In addition to the recording medium on which the above program is recorded, the program itself is also included in each embodiment.

For example, a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, CD-ROM, magnetic tape, nonvolatile memory card, and ROM can be used as the recording medium. Further, not only the program recorded on the recording medium alone executes the process, but also the one that operates on the OS and executes the process in cooperation with other software and functions of the expansion board. included in the category of Furthermore, the program itself may be stored on the server, and part or all of the program may be downloaded from the server to the user terminal.

It should be noted that the configurations and flows of the respective embodiments described above can be combined. At that time, three or more embodiments may be combined.

<Appendix>
The embodiments described above may also be described in the following additional remarks, but are not limited to the following.

(Appendix 1)
The information processing system according to Supplementary Note 1 includes rotation control means for rotating a first camera and a second camera having the same rotation axis on the rotation axis according to the position of an object to be imaged; Acquisition means for acquiring first biometric information from an image captured by a camera and acquiring second biometric information from an image captured by the second camera, and authentication using the first biometric information and the second biometric information An information processing system comprising: authentication means for performing processing; and execution means for performing predetermined processing in a facility used by the target when the authentication processing is successful.

(Appendix 2)
In the information processing system according to appendix 2, the predetermined process includes a process of permitting admission to the facility, and the execution means is configured to obtain the first biological information and the second biological information of the first target. The authentication process using both is successful, and the authentication process using at least one of the first biometric information and the second biometric information of a second target different from the first target is successful. The information processing system according to supplementary note 1, wherein the admission of the first target and the second target to the facility is permitted on the condition that the first target and the second target are permitted to enter the facility.

(Appendix 3)
The information processing system according to Appendix 3 is the information processing system according to Appendix 1 or 2, wherein the first camera and the second camera are rotatable on a rotation axis according to an operation by a user in the facility. information processing system.

(Appendix 4)
The information according to any one of appendices 1 to 3, wherein the information processing system according to appendix 4, wherein the predetermined process includes a process of calling an elevator to a floor on which the target for which the authentication process is successful is located processing system.

(Appendix 5)
5. The information processing system according to any one of appendices 1 to 4, wherein the predetermined process includes a process of calling a vehicle used by the target whose authentication process is successful to a predetermined position. The information processing system described.

(Appendix 6)
In the information processing system according to appendix 6, the predetermined process includes a process of guiding the target, for whom the authentication process has been successful, on a route that can be traveled without passing another person in the facility. and an information processing system according to any one of appendices 1 to 5.

(Appendix 7)
7. The information processing system according to any one of appendices 1 to 6, further comprising warning means for outputting a warning when the target does not reach a predetermined location within a predetermined time after the successful authentication process. The information processing system described in .

(Appendix 8)
In the information processing system according to appendix 8, the predetermined process enables the subject, for whom the authentication process has succeeded, to request a predetermined service, and provides information indicating the location of the successful authentication process and information about the subject. 8. According to any one of appendices 1 to 7, wherein the item is sent to a request destination of the predetermined service, and the cost when the target requests the predetermined service is settled by a settlement method linked to the target. information processing system.

(Appendix 9)
In the information processing system according to appendix 9, the predetermined process enables payment processing by the target for whom the authentication process is successful, and the cost for the payment processing by the target is 9. The information processing system according to any one of appendices 1 to 8, wherein payment is made by a payment method associated with an authorized person who is permitted to perform

(Appendix 10)
In the information processing system according to appendix 10, the predetermined process includes a process of specifying a room in the facility used by the target for whom the authentication process is successful, and a task of transporting the target's luggage to the specified room. 10. The information processing system according to any one of appendices 1 to 9, comprising:

(Appendix 11)
The information processing system according to appendix 11 includes detection means for detecting a user who is in poor physical condition in the facility, and call control means for calling an elevator equipped with a lifesaving tool to the floor corresponding to the position of the detected user. 11. The information processing system according to any one of appendices 1 to 10, further comprising:

(Appendix 12)
The information processing system according to appendix 12 includes detection means for detecting a user in poor physical condition within the facility; 12. The information processing system according to any one of appendices 1 to 11, further comprising notification means for notifying other users.

(Appendix 13)
The information processing apparatus according to Supplementary Note 13 includes rotation control means for rotating a first camera and a second camera having the same rotation axis on the rotation axis according to the position of an object to be imaged; Acquisition means for acquiring first biometric information from an image captured by a camera and acquiring second biometric information from an image captured by the second camera, and authentication using the first biometric information and the second biometric information An information processing apparatus comprising: authentication means for performing processing; and execution means for performing predetermined processing in a facility used by the target when the authentication processing is successful.

(Appendix 14)
The information processing method according to appendix 14 is an information processing method executed by at least one computer, wherein the first camera and the second camera having the same rotation axis are rotated according to the position of the object to be imaged. Rotating on an axis, obtaining first biological information from an image captured by the first camera, obtaining second biological information from the image captured by the second camera, obtaining the first biological information and the first biological information 2. An information processing method for performing an authentication process using biometric information, and performing a predetermined process in a facility used by the target when the authentication process is successful.

(Appendix 15)
The recording medium according to appendix 15 causes at least one computer to rotate a first camera and a second camera having the same rotation axis on the rotation axis according to the position of an object to be imaged, obtaining first biometric information from the image captured by the camera of the above, obtaining second biometric information from the image captured by the second camera, and performing authentication processing using the first biometric information and the second biometric information and executing a predetermined process in the facility used by the target when the authentication process is successful.

(Appendix 16)
The computer program according to attachment 16 causes at least one computer to rotate a first camera and a second camera having the same rotation axis on the rotation axis according to the position of an object to be imaged, obtaining first biometric information from the image captured by the camera of the above, obtaining second biometric information from the image captured by the second camera, and performing authentication processing using the first biometric information and the second biometric information and executing a predetermined process in the facility used by the target when the authentication process is successful.

This disclosure can be appropriately modified within the scope that does not contradict the gist or idea of the invention that can be read from the scope of claims and the entire specification. and recording media are also included in the technical concept of this disclosure.

10 information processing system 11 processor 18 first camera 19 second camera 20 motor 21 near-infrared illumination 30 authentication terminal 35 camera installation part 40 display 50 case 110 rotation control unit 115 target position detection unit 120 biological information acquisition unit 130 authentication unit 140 Execution unit 150 Operation reception unit 160 Warning unit 170 Poor physical condition detection unit 180 Call control unit 190 Notification unit

Claims (10)

acquisition means for acquiring face information from an image captured by a first camera and acquiring iris information from an image captured by a second camera;
authentication means for performing authentication processing using the face information and the iris information;
Execution means for executing a predetermined process of permitting admission to a facility used by a target when the authentication process is successful;
with
The executing means performs the authentication process using both the face information and the iris information of the first target, and the face information and the face information of a second target different from the first target. permitting the first target and the second target to enter the facility on condition that the authentication process using at least one of the iris information is successful;
Information processing system. 2. The information processing system according to claim 1, wherein said first camera and said second camera are rotatable on a rotation axis according to an operation by a user in said facility. 3. The information processing system according to claim 1, wherein said predetermined processing includes processing of permitting entry to said facility and processing of calling an elevator to a floor on which said target for whom said authentication processing has succeeded is located. 4. The predetermined process includes, in addition to the process of permitting entry to the facility, the process of calling a vehicle used by the target whose authentication process has succeeded to a predetermined location. Information processing system according to the item. The predetermined process includes, in addition to the process of permitting admission to the facility, the process of guiding the target, for whom the authentication process has been successful, on a route that can be traveled within the facility without passing another person. 5. The information processing system according to any one of claims 1 to 4, wherein 6. The information processing system according to any one of claims 1 to 5, further comprising warning means for outputting a warning when said target does not reach a predetermined location within a predetermined time after said successful authentication processing. In addition to the process of permitting admission to the facility, the predetermined process enables the subject for whom the authentication process has succeeded to request a predetermined service, and information indicating the location where the authentication process has succeeded and information about the subject. including a process of sending to the request destination of the predetermined service,
The cost when the target requests the predetermined service is settled by the payment method linked to the target,
The information processing system according to any one of claims 1 to 6. The predetermined process includes, in addition to the process of permitting admission to the facility, the process of enabling payment processing by the subject for whom the authentication process has succeeded,
The cost of the payment processing by the target is settled by a payment method associated with an authorized person who permits the target to perform the payment processing.
The information processing system according to any one of claims 1 to 7. An information processing method executed by at least one computer, comprising:
Acquiring face information from an image captured by a first camera, acquiring iris information from an image captured by a second camera,
performing an authentication process using the face information and the iris information;
If the authentication process is successful, executing a predetermined process of permitting admission to the facility used by the target;
The authentication process using both the face information and the iris information of a first target has succeeded, and at least the face information and the iris information of a second target different from the first target Permitting the first object and the second object to enter the facility on the condition that the authentication process using one of them is successful;
Information processing methods. on at least one computer,
Acquiring face information from an image captured by a first camera, acquiring iris information from an image captured by a second camera,
performing an authentication process using the face information and the iris information;
If the authentication process is successful, executing a predetermined process of permitting admission to the facility used by the target;
The authentication process using both the face information and the iris information of a first target has succeeded, and at least the face information and the iris information of a second target different from the first target Permitting the first object and the second object to enter the facility on the condition that the authentication process using one of them is successful;
A computer program that causes an information processing method to be executed.

Images