JP7420300B2 - Information processing system, information processing method, and computer program - Google Patents

Description

This disclosure relates to the technical field of information processing systems, information processing methods, and computer programs.

As this type of system, one is known that performs authentication processing on visitors to a residence. For example, Patent Document 1 discloses that biometric authentication (for example, facial authentication using a camera-equipped intercom) is performed for visiting staff of a housekeeping service when they enter a residence or leave a residence.

JP2019-52476A

This disclosure aims to improve upon the techniques disclosed in the prior art documents.

One aspect of the information processing system of this disclosure includes a rotation control means for rotating a first camera and an illumination means having the same rotation axis on the rotation axis according to the position of the object to be imaged; an acquisition unit that acquires first biometric information from an image captured by a camera; an authentication unit that performs an authentication process using the first biometric information; and an authentication unit that performs authentication processing using the first biometric information; Execution means for executing processing.

One aspect of the information processing method of this disclosure is an information processing method executed by at least one computer, wherein a first camera and an illumination means having the same rotation axis are rotated according to the position of an object to be imaged. rotate on an axis, obtain first biometric information from an image captured by the first camera, perform authentication processing using the first biometric information, and if the authentication processing is successful, the target Execute predetermined processing at the facility.

One aspect of the computer program of this disclosure causes at least one computer to rotate a first camera and an illumination means having the same rotation axis on the rotation axis according to the position of the object to be imaged; acquiring first biometric information from an image captured by a camera, performing an authentication process using the first biometric information, and executing a predetermined process at a facility used by the subject if the authentication process is successful; Execute the information processing method.

FIG. 1 is a block diagram showing a hardware configuration of an information processing system according to a first embodiment. FIG. 2 is a perspective view showing the configuration of an authentication terminal included in the information processing system according to the first embodiment. FIG. 2 is a perspective view showing the configuration around a camera in the information processing system according to the first embodiment. FIG. 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment. FIG. 2 is a block diagram showing a functional configuration of a modified example of the information processing system according to the first embodiment. 3 is a flowchart showing the flow of operations performed by the information processing system according to the first embodiment. 7 is a flowchart showing the flow of operations performed by the information processing system according to the second embodiment. FIG. 3 is a block diagram showing the functional configuration of an information processing system according to a third embodiment. 12 is a flowchart showing the flow of operations performed by the information processing system according to the fourth embodiment. 13 is a flowchart showing the flow of operations performed by the information processing system according to the fifth embodiment. 12 is a flowchart showing the flow of operations performed by the information processing system according to the sixth embodiment. It is a block diagram showing the functional composition of an information processing system concerning a 7th embodiment. It is a flowchart which shows the flow of operation by the information processing system concerning a 7th embodiment. It is a flowchart which shows the flow of operation by the information processing system concerning an 8th embodiment. 12 is a flowchart showing the flow of operations performed by the information processing system according to the ninth embodiment. 10 is a flowchart showing the flow of operations performed by the information processing system according to the tenth embodiment. FIG. 7 is a block diagram showing the functional configuration of an information processing system according to an eleventh embodiment. 11 is a flowchart showing the flow of operations performed by the information processing system according to the eleventh embodiment. FIG. 12 is a block diagram showing the functional configuration of an information processing system according to a twelfth embodiment. 13 is a flowchart showing the flow of operations performed by the information processing system according to the thirteenth embodiment. 13 is a flowchart showing a modified example of the flow of operations performed by the information processing system according to the thirteenth embodiment. FIG. 3 is a plan view showing an example of a display screen when registering a target. FIG. 7 is a plan view showing an example of a display screen when updating target registration information. It is a top view which shows an example of the display screen which shows the absence time of the registered object. FIG. 3 is a plan view showing an example of a display screen showing the home status of a registered target.

Embodiments of an information processing system, an information processing apparatus, an information processing method, and a recording medium will be described below with reference to the drawings.

<First embodiment>
An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 6.

(Hardware configuration)
First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to FIG. 1. FIG. 1 is a block diagram showing the hardware configuration of an information processing system according to the first embodiment.

As shown in FIG. 1, the information processing system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing system 10 may further include an input device 15 and an output device 16. Further, the information processing system 10 may include a first camera 18 and a second camera 19. The above-described processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, first camera 18, and second camera 19 are connected via a data bus 17. .

Processor 11 reads a computer program. For example, the processor 11 is configured to read a computer program stored in at least one of the RAM 12, ROM 13, and storage device 14. Alternatively, the processor 11 may read a computer program stored in a computer-readable recording medium using a recording medium reading device (not shown). The processor 11 may obtain (that is, read) a computer program from a device (not shown) located outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. Particularly in this embodiment, when the computer program read by the processor 11 is executed, a functional block is implemented in the processor 11 that acquires an image of a target and performs biometric authentication. That is, the processor 11 may function as a controller that executes various controls of the information processing system 10.

Note that the processor 11 is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), or a DSP (Demand-Side Platform). form), may be configured as an ASIC (Application Specific Integrated Circuit) . The processor 11 may be configured with one of these, or may be configured to use a plurality of them in parallel.

The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that is temporarily used by the processor 11 while the processor 11 is executing a computer program. The RAM 12 may be, for example, a D-RAM (Dynamic RAM).

ROM 13 stores computer programs executed by processor 11. The ROM 13 may also store other fixed data. The ROM 13 may be, for example, a P-ROM (Programmable ROM).

The storage device 14 stores data that the information processing system 10 stores for a long time. Storage device 14 may operate as a temporary storage device for processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

The input device 15 is a device that receives input instructions from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet.

The output device 16 is a device that outputs information regarding the information processing system 10 to the outside. For example, the output device 16 may be a display device (eg, a display) that can display information regarding the information processing system 10. Furthermore, the output device 16 may be a speaker or the like that can output information regarding the information processing system 10 in audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet.

The first camera 18 and the second camera 19 are cameras installed at locations where images of the target can be captured. Note that the target here is not limited to humans, and may include animals such as dogs and snakes, robots, and the like. The first camera 18 and the second camera 19 may be configured as cameras that respectively capture images of different parts of the target. For example, the first camera 18 may be configured to capture an image including the subject's face, while the second camera 19 may be configured to capture an image including the subject's iris. The first camera 18 and the second camera 19 may be configured as visible light cameras or may be configured as near-infrared cameras. Further, the first camera 18 and the second camera 19 may be configured as a depth camera or a thermo camera. The depth camera is capable of acquiring a depth image regarding the distance between the object and the camera, for example. A thermo camera is capable of acquiring, for example, a body temperature image regarding the body temperature of a subject. The different types of cameras mentioned above (for example, visible light camera, near-infrared camera, depth camera, thermo camera) may be appropriately combined to form the first camera 18 and the second camera 19, and the combination is not particularly limited. . For example, the first camera 18 may be configured as a face camera, and the second camera 19 may be configured as a thermo camera, or the first camera 18 may be configured as a depth camera, and the second camera 19 may be configured as a near-infrared camera. The first camera 18 and the second camera 19 may be cameras that capture still images or cameras that capture moving images. The first camera 18 and the second camera 19 may be cameras installed in a terminal (for example, a smartphone) that the target has. A plurality of first cameras 18 and a plurality of second cameras 19 may be provided. Further, a camera different from the first camera 18 and the second camera 19 (for example, a third camera or a fourth camera) may be provided. Specific configuration examples of the first camera 18 and the second camera 19 will be described in detail later.

Although FIG. 1 shows an example of the information processing system 10 that includes a plurality of devices, all or part of these functions may be realized by one device (information processing device). . This information processing device is configured, for example, only with the above-described processor 11, RAM 12, and ROM 13, and other components (i.e., storage device 14, input device 15, output device 16, first camera 18, and second The camera 19) may be provided in, for example, an external device connected to the information processing device. Further, the information processing device may realize some of the calculation functions by an external device (for example, an external server, a cloud, etc.).

(Configuration of authentication terminal)
Next, the configuration of the authentication terminal included in the information processing system 10 according to the first embodiment will be described with reference to FIG. 2. FIG. 2 is a perspective view showing the configuration of an authentication terminal included in the information processing system according to the first embodiment.

As shown in FIG. 2, the information processing system 10 according to the first embodiment includes an authentication terminal 30 including the first camera 18 and second camera 19 described above. The casing of the authentication terminal 30 is made of, for example, resin or metal. A display 40 is provided on the front part of the authentication terminal. This display may display various information regarding the authentication terminal, messages to the user, and images and videos captured by the first camera 18 and the second camera 19. A first camera 18 and a second camera 19 are installed inside a camera installation part 35 (the part surrounded by a broken line in the figure) at the bottom of the display 40. Note that the first camera 18 and the second camera 19 may be provided so as to be visible from the outside of the housing, or may be provided so that they are not visible from the outside. For example, when the first camera 18 and the second camera 19 are configured as visible light cameras, the visible light cameras may be provided to be exposed to the outside in order to take in external visible light (for example, the visible light cameras In addition, when the first camera 18 and the second camera 19 are configured as near-infrared cameras, the near-infrared cameras may be provided so as not to be exposed to the outside (for example, an opening may be provided nearby). , may be covered with a visible light cut film, etc.). Furthermore, when the first camera 18 is configured as a visible light camera and the second camera 19 is configured as a near-infrared camera, the first camera 18 is exposed to the outside (for example, an opening is provided near the first camera 18), and the second camera 19 is configured as a near-infrared camera. The two cameras 19 may be provided so as not to be exposed to the outside (for example, they may be covered with a visible light cut film or the like).

(Configuration around the camera)
Next, the configuration around the camera in the information processing system 10 according to the first embodiment (the internal configuration of the camera installation portion 35 of the authentication terminal described above) will be specifically described with reference to FIG. 3. FIG. 3 is a perspective view showing the configuration around the camera in the information processing system according to the first embodiment. In addition, below, the case where the 1st camera 18 is a visible light camera which images the target's face, and the 2nd camera 19 is a near-infrared camera which images the target's iris will be explained as an example.

As shown in FIG. 3, the first camera 18 and the second camera 19 are arranged inside the case 50. Inside the case 50, in addition to the first camera 18 and the second camera 19, a motor 20 and two near-infrared lights 21 are arranged. Note that the near-infrared illumination 21 is configured to irradiate a target with near-infrared light when the second camera 19, which is a near-infrared camera, takes an image.

Particularly in this embodiment, the first camera 18 and the second camera 19 are configured to be rotatable about the same rotation axis (see the broken line in the figure). Specifically, the first camera 18 and the second camera 19 are configured to be able to rotate integrally in the vertical direction around a rotation axis by being driven by a motor 20 (as shown in the figure). (see arrow). Therefore, when the first camera 18 and the second camera 19 are rotated upward, the imaging ranges of the first camera 18 and the second camera 19 both change upward. Further, when the first camera 18 and the second camera 19 are rotated downward, the imaging ranges of the first camera 18 and the second camera 19 both change downward.

Further, in the example shown in FIG. 3, the near-infrared illumination 21 is also configured to be rotatable about the same rotation axis as the first camera 18 and the second camera 19. Therefore, when the first camera 18 and the second camera 19 are rotated upward, the near-infrared illumination 21 is also driven integrally and faces upward. Further, when the first camera 18 and the second camera 19 are rotated downward, the near-infrared illumination 21 is also driven integrally and faces downward.

(Functional configuration)
Next, the functional configuration of the information processing system 10 according to the first embodiment will be described with reference to FIG. 4. FIG. 4 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.

As shown in FIG. 4, the information processing system 10 according to the first embodiment includes the already described first camera 18 and second camera 19, and the rotation control unit 110 as components for realizing its functions. It is configured to include a biometric information acquisition section 120, an authentication section 130, and an execution section 140. Each of the rotation control section 110, the biometric information acquisition section 120, the authentication section 130, and the execution section 140 may be a processing block implemented by, for example, the above-mentioned processor 11 (see FIG. 1).

The rotation control unit 110 is configured to be able to control the rotation operations of the first camera 18 and the second camera 19. For example, the rotation control unit 110 is configured to be able to determine the rotation direction and amount of rotation of the first camera 18 and the second camera 19, and execute control according to the determined parameters. The rotation control unit 110 controls the rotation operations of the first camera 18 and the second camera 19 depending on the position of the object. The position of the target may be, for example, a position where the target's face is present, or a position where the target's eyes are present. Further, the position of the object may be not only a position in the height direction but also a position in the depth direction corresponding to the distance to the camera, or a position in the left and right direction. Specifically, the first camera 18 and the second camera 19 each capture an image of the object (in other words, the object falls within the imaging range of each of the first camera 18 and the second camera 19). The rotation operation of the first camera 18 and the second camera 19 is controlled. For example, if the first camera 18 is a face camera that images the target's face and the second camera 19 is an iris camera that images the target's iris, the rotation control unit 110 controls the The rotational operations of the first camera 18 and the second camera 19 are controlled so that the face of the subject fits within the imaging range of the second camera 19 and the iris of the subject falls within the imaging range of the second camera 19. Note that the rotation control unit 110 may be configured to acquire the target position from outside the system. For example, the rotation control unit 110 may acquire the target position from various sensors. On the other hand, the information processing system 10 according to the first embodiment may be configured to be able to detect the position of a target within the system. The configuration in this case will be explained in detail in the following modified example.

(Modified example)
Here, a modification of the information processing system 10 according to the first embodiment will be described with reference to FIG. 5. FIG. 5 is a block diagram showing a functional configuration of a modified example of the information processing system according to the first embodiment. Note that in FIG. 5, the same reference numerals are given to the same elements as those shown in FIG. 4.

As shown in FIG. 5, the modification of the information processing system 10 according to the first embodiment includes a first camera 18, a second camera 19, a rotation control unit 110, and a rotation control unit 110 as components for realizing its functions. It is configured to include a target position detection section 115, a biometric information acquisition section 120, an authentication section 130, and an execution section 140. That is, the information processing system 10 according to the modification is configured to further include an object detection unit 115 in addition to the configuration of the first embodiment (see FIG. 4). The target position detection unit 115 may be a processing block implemented by, for example, the processor 11 (see FIG. 1) described above.

The target position detection unit 115 is configured to be able to acquire images captured by the first camera 18 and the second camera 19 and detect the position of the target from at least one of these images. The target position detection unit 115 may be configured to be able to detect the position of the target's face and the position of the eyes from a face image captured by a face camera, which is the first camera 18, for example. Note that when the first camera 18 is configured as a face camera and the second camera 19 is configured as an iris camera, the imaging ranges of the respective cameras are different (the imaging range of the face camera is wide). In such a case, the first camera 18 (i.e., face camera) with a wide imaging range first detects the target position, and the second camera 19 (i.e., iris camera) with a narrow imaging range is rotated so that the iris can be imaged. may be controlled.

The position of the object detected by the object position detection section 115 is configured to be output to the rotation control section 110. The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 based on the position of the target detected by the target position detection unit 115. Note that the position detection by the target position detection section 115 and the rotation operation by the rotation control section 110 may be performed simultaneously and in parallel. In this case, the position of the object may be detected while imaging with the first camera 18 and the second camera 19, and a rotation operation may be performed based on the simultaneously detected position.

Returning to FIG. 4, the biological information acquisition unit 120 is configured to be able to acquire first biological information from an image captured by the first camera 18 (hereinafter referred to as a "first image" as appropriate). Furthermore, the biological information acquisition unit 120 is configured to be able to acquire second biological information from an image captured by the second camera 19 (hereinafter referred to as a "second image" as appropriate). The first biological information may be a feature amount of a region included in images captured by the first camera 18 and second camera 19 (that is, a parameter indicating a feature amount of the region of the living body). For example, if the first camera 18 is a face camera that images the target's face and the second camera 19 is an iris camera that images the target's iris, the biometric information acquisition unit 120 The feature amount of the target's face may be acquired from one image (ie, a face image), and the feature amount of the target's iris may be acquired from the second image (ie, the iris image) captured by the second camera 19. Each of the first biometric information and the second biometric information acquired as biometric information is output to the authentication unit 130.

The authentication unit 130 is configured to be able to perform target authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120. For example, the authentication unit 130 is configured to be able to determine whether the target is a registered user by comparing the first biometric information and the second biometric information with biometric information registered in advance. . The authentication unit 130 also uses the first biometric information and the second biometric information to determine whether the target is a living body (for example, whether or not the subject is impersonating a person using a photo, video, mask, etc.). It may be configured as possible. Impersonation involves instructing a target to perform a specific action (for example, instructing the target to "shake your head to the side" or "look up"), and then the target moves as instructed. The judgment can be made based on whether or not the Alternatively, spoofing uses thermo images to determine whether the target has a body temperature, and depth images to determine whether height information exists for each part of the target (e.g. eyes, nose, mouth, etc.). (In other words, is it a flat surface like a photograph?). The authentication unit 130 may separately perform an authentication process using the first biometric information and an authentication process using the second biometric information, and integrate the authentication results to obtain the final authentication result. For example, the authentication unit 130 may determine that the final authentication result is a success when both the authentication process using the first biometric information and the authentication process using the second biometric information are successful. Further, the authentication unit 130 may determine that the final authentication result is a failure when at least one of the authentication process using the first biometric information and the authentication process using the second biometric information fails. The authentication result of the authentication section 130 is configured to be output to the execution section 140.

The execution unit 140 is configured to be able to execute predetermined processing at the facility based on the authentication result of the authentication unit 130. Note that "facilities" here refer to facilities used by the target, such as residential facilities such as apartments, stores such as retail stores, corporate offices, bus terminals and airports, and facilities that hold various events. It's fine. The facility is not limited to being indoors, but may be an outdoor facility such as a park or an amusement park. Further, the "predetermined process" includes various processes that can be executed in the facility, and may be, for example, a process for controlling equipment in the facility. In this case, the predetermined process may be a process executed at multiple facilities. The predetermined process may include multiple processes. A specific example of the predetermined processing will be described in detail in the embodiment described later. For example, the execution unit 140 may execute a predetermined process when the authentication process in the authentication unit 130 is successful, and may not execute the predetermined process when the authentication process in the authentication unit 130 fails. Alternatively, the execution unit 140 executes the first predetermined process when the authentication process in the authentication unit 130 is successful, and executes the second predetermined process (i.e., the first predetermined process) when the authentication process in the authentication unit 130 fails. It may also be possible to perform a process different from the above process.

(Flow of operation)
Next, the flow of operations performed by the information processing system 10 according to the first embodiment will be described with reference to FIG. 6. FIG. 6 is a flowchart showing the flow of operations performed by the information processing system according to the first embodiment.

As shown in FIG. 6, when the information processing system 10 according to the first embodiment operates, the rotation control unit 110 first detects the position of a target (step S101). The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the target (step S102). Note that the first camera 18 and the second camera 19 may take images at the timing when the control by the rotation control unit 110 ends. In this case, the first camera 18 and the second camera 19 may take images at the same time or at different timings. Further, the first camera 18 and the second camera 19 may take images during the control by the rotation control unit 110. For example, the first camera 18 and the second camera 19 may capture images multiple times while the rotation control unit 110 continues to control the rotation.

Subsequently, the biological information acquisition unit 120 acquires images captured by the first camera 18 and the second camera 19 (i.e., the first image and the second image) (step S103). Then, the biological information acquisition unit 120 acquires first biological information from the first image captured by the first camera 18 and acquires second biological information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). Then, the execution unit 140 executes a predetermined process at the facility based on the authentication result by the authentication unit 130 (step S106).

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the first embodiment will be explained.

As described in FIGS. 1 to 6, in the information processing system 10 according to the first embodiment, the first camera 18 and the second camera 19 are rotated about the same rotation axis to acquire images of the target. In this way, by rotating the two cameras around the same rotation axis, it is possible to collectively adjust their imaging ranges. Therefore, compared to, for example, driving two cameras separately, the device configuration can be simplified and the device can be made smaller. Furthermore, since the two cameras are driven in the same direction, it becomes easy to image the same object with each camera. In other words, it is possible to avoid a situation where two cameras capture images of different objects.

In this embodiment, first biometric information and second information are further acquired from the images captured by the first camera 18 and the second camera 19, and predetermined processing at the facility is performed based on the authentication results using the biometric information. is executed. In this way, it is possible to perform highly accurate authentication processing for a person who is attempting to use the facility, and to appropriately perform predetermined processing. For example, if the target is a registered user, the user can be determined to be a user who may perform the predetermined process, and the predetermined process can be executed. Furthermore, if the target is an unregistered user or if it is determined that the user is impersonating the user, it can be determined that the user should not perform the predetermined process, and the predetermined process may not be executed.

<Second embodiment>
An information processing system 10 according to a second embodiment will be described with reference to FIG. 7. Note that the second embodiment differs from the first embodiment described above only in some operations, and other parts may be the same as the first embodiment. Therefore, in the following, parts that are different from the first embodiment described above will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

(Contents of prescribed processing)
First, the content of the predetermined process executed in the information processing system 10 according to the second embodiment will be explained.

In the information processing system 10 according to the second embodiment, the execution unit 140 executes a process of permitting entry to a facility as a predetermined process. Specifically, if the authentication process in the authentication unit 130 is successful, the execution unit 140 allows the subject to enter the facility (or enter a predetermined area of the facility). On the other hand, if the authentication process in the authentication unit 130 fails, the execution unit 140 does not allow the target to enter the facility (or enter a predetermined area of the facility) (in other words, prohibits entry to the facility). ). A specific example of the process for permitting entry is the process of unlocking the automatic lock at the entrance of an apartment building. In this case, the execution unit 140 unlocks the automatic lock of the entrance when the authentication process in the authentication unit 130 is successful (for example, when the target is a resident of an apartment or a pre-registered guest). , allowing entry into the target apartment. Furthermore, the execution unit 140 unlocks the automatic lock of the entrance when the authentication process in the authentication unit 130 fails (for example, when the target is not a resident of the condominium or when fraud such as impersonation is being carried out). Do not allow the subject to enter the apartment. Note that the authentication process may be performed multiple times when the target enters. For example, the first authentication process may be performed at the entrance of the first floor of the apartment, and the second authentication process may be performed in front of the room on the floor where the subject resides. When performing authentication processing multiple times in this way, the number and type of modals to be used may be changed. For example, in the first authentication process performed at the entrance, entry is permitted if face recognition is successful, but in the second authentication process performed in front of the room, entry is permitted if both face recognition and iris recognition are successful. You may allow it.

(Flow of operation)
Next, the flow of operations by the information processing system 10 according to the second embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart showing the flow of operations performed by the information processing system according to the second embodiment. Note that in FIG. 7, the same reference numerals are given to processes similar to those described in FIG.

As shown in FIG. 7, when the information processing system 10 according to the second embodiment operates, the rotation control unit 110 first detects the position of a target (step S101). The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the target (step S102).

Subsequently, the biological information acquisition unit 120 acquires images captured by the first camera 18 and the second camera 19 (i.e., the first image and the second image) (step S103). Then, the biological information acquisition unit 120 acquires first biological information from the first image captured by the first camera 18 and acquires second biological information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). Then, the execution unit 140 determines whether both the authentication process using the first biometric information and the authentication process using the second biometric information in the authentication unit 130 are successful (step S201). Note that if both authentication processes are not successful (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the predetermined process is not executed (that is, entry to the target facility is not permitted).

On the other hand, if both authentication processes are successful (step S201: YES), the execution unit 140 determines whether or not the subject to whom entry is permitted has a companion (step S202). Whether or not there is a companion may be determined, for example, based on whether or not there are other objects around the object (for example, within a predetermined distance). In this case, the presence of another object may be detected from images captured by the first camera 18 and the second camera 19. For example, if multiple people are included in the image captured by the first camera 18 and the second camera 19 (for example, if multiple faces are detected from the image), the execution unit 140 It may be determined that there is a companion. Alternatively, the existence of other targets may be determined by a declaration by a target whose authentication process is successful. For example, when the target operates the terminal and inputs that there is a companion (for example, when the user presses the "accompanying" button displayed on the touch panel), the execution unit 140 inputs the presence of a companion in the target section. It can be determined that there is a Furthermore, the presence or absence of accompanying persons may be reported without contact. For example, the presence or absence of a companion may be declared by the user's gesture. In this case, it is possible to declare the number of accompanying persons in addition to the presence or absence of accompanying persons, such as by holding up two fingers if there are two accompanying persons, and by holding up four fingers if there are four accompanying persons. may be done. Furthermore, if a suspicious person is nearby and you want to issue an SOS secretly (without the suspicious person noticing), you may have the target perform a specific gesture. For example, if the user performs a gesture such as covering his right eye with his hand, an alert may be sent to the condominium concierge, security guard, etc. to inform them of the presence of a suspicious person. Note that if there is no accompanying person (step S202: NO), the subsequent processing is omitted and the series of operations ends.

On the other hand, if there is a companion (step S202: YES), the information processing system 10 according to the second embodiment performs the same process for the companion. Specifically, the rotation control unit 110 detects the position of the object (accompanying person) (step S101). The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the object (accompanying person) (step S102).

Subsequently, the biometric information acquisition unit 120 acquires images of the accompanying person (ie, the first image and the second image) captured by the first camera 18 and the second camera 19 (step S103). Then, the biometric information acquisition unit 120 acquires the first biometric information of the companion from the first image captured by the first camera 18 and obtains the second biometric information of the companion from the second image captured by the second camera 19. Information is acquired (step S104).

Subsequently, the authentication unit 130 executes an authentication process using the first biometric information and second biometric information of the companion acquired by the biometric information acquisition unit 120 (step S105). In particular, the execution unit 140 determines whether at least one of the authentication process using the first biometric information and the authentication process using the second biometric information in the authentication unit 130 is successful (step S203). . In other words, for the first target, it was determined whether or not both the authentication process using the first biometric information and the authentication process using the second biometric information were successful, whereas for the accompanying person, the authentication process using the first biometric information was successful. It is determined whether either the authentication process using the information or the authentication process using the second biometric information is successful.

Then, if at least one of the authentication processes is successful (step S203: YES), the execution unit 140 allows the subject and the accompanying person to enter the facility (step S204). Therefore, if the subject is accompanied by a companion, entry will not be permitted only if the subject's authentication is successful, but entry will be permitted only if the companion's authentication is successful. However, for companions, even if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, if the other authentication process is successful, they will be able to enter. Allowed. For example, if both face authentication and iris authentication of the subject are successful, entry may be permitted for a companion if only face authentication is successful. Note that if both of the authentication processes have failed (step S204: NO), the execution unit 140 does not permit the subject and the accompanying person to enter the facility. If there are multiple companions, the authentication process may be performed for each companion in turn, or the authentication process may be performed for each companion in turn. For example, the authentication process may be performed by capturing images multiple times in the order closest to the first camera 18 and second camera 19, or all images included in the imaging range of the first camera 18 and second camera 19 may be It is also possible to detect all companions (images are taken only once) and execute the authentication process all at once.

In addition, in the example mentioned above, although the example which performed the process about the target accompanying person was given, the accompanying person may be another user who is not accompanying the target. That is, the above-described process may be performed on another user different from the target user.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the second embodiment will be explained.

As described with reference to FIG. 7, in the information processing system 10 according to the second embodiment, authentication processing is performed for each of the subject and the accompanying person, and it is determined whether or not they can enter the facility. In particular, in the second embodiment, companions who accompany the target are allowed to enter the facility under conditions that are less strict than the target, so even if, for example, there is insufficient registered information about the companion, they will not be able to enter the facility appropriately. may be allowed. For example, if a target who is a resident of an apartment is a guest (i.e., a user who has some kind of relationship with the target; for example, a friend or acquaintance of the target, or a user who has a business relationship with the target, such as a housekeeper, maid, tutor, etc.) (including), as long as the guest's primary biometric information (e.g. facial information) is registered, even if the guest's secondary biometric information (e.g. iris information) is not registered, the guest will be able to accompany the guest. will be allowed entry. In other words, iris images are more difficult to register than face images (for example, iris images can only be captured by a limited number of cameras), but it is possible to permit a companion to enter with just a face image, which is relatively easy to register. . It should be noted that although the conditions for admission permission are relaxed for accompanying persons, since the authentication process using both the first biometric information and the second biometric information is performed for the target, deterioration in security is suppressed. On the other hand, even if you are a companion, you are required to successfully complete the authentication process using at least the first biometric information and the second biometric information, so there is a risk that an unintended third party may be allowed to enter (so-called tailgating) can be prevented.

<Third embodiment>
An information processing system 10 according to a third embodiment will be described with reference to FIG. 8. Note that the third embodiment differs from the first and second embodiments described above in some configurations and operations, and may be the same as the first and second embodiments in other parts. Therefore, in the following, parts that are different from each of the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

(Functional configuration)
Next, the functional configuration of the information processing system 10 according to the third embodiment will be described with reference to FIG. 8. FIG. 8 is a block diagram showing the functional configuration of an information processing system according to the third embodiment. In addition, in FIG. 8, the same reference numerals are attached to the same elements as those shown in FIG. 4.

As shown in FIG. 8, the information processing system 10 according to the third embodiment includes a first camera 18, a second camera 19, a rotation control unit 110, and a biological information acquisition unit as components for realizing its functions. It is configured to include a section 120, an authentication section 130, an execution section 140, and an operation reception section 150. That is, the information processing system 10 according to the second embodiment is configured to further include an operation reception section 150 in addition to the configuration of the first embodiment (see FIG. 4). The operation reception unit 150 may be, for example, a processing block implemented by the processor 11 (see FIG. 1) described above.

The operation reception unit 150 is configured to be able to accept operations from a user within the facility (for example, a user within a room who receives a call via an intercom). The operation reception unit 150 is configured to be able to control the rotation of the first camera 18 and the second camera 19 according to a user's operation. The rotation control by the operation reception unit 150 is control executed separately from the rotation control by the rotation control unit 110. The operation reception unit 150 may control the rotation of the first camera 18 and the second camera 19 according to the user's operation, for example after the rotation control by the rotation control unit 110 is completed. Alternatively, the operation reception unit 150 may control the rotation of the first camera 18 and the second camera 19 in response to a user's operation before the rotation control unit 110 starts rotation control. The operation reception unit 150 may be configured as, for example, an intercom installed in a room. Alternatively, the operation reception unit 150 may accept an operation from an application installed on a user's terminal (for example, a smartphone, etc.).

When the rotation of the first camera 18 and the second camera 19 is controlled by the operation reception unit 150, the operation of the system after the rotation control may also be performed according to the operation received by the operation reception unit 150. For example, an authentication process using images captured by the first camera 18 and the second camera 19 may be started in response to an operation accepted by the operation reception unit 150. More specifically, when the user performs an operation to rotate the first camera 18 and the second camera 19, a message such as "Do you want to perform authentication?" is displayed on the terminal. Then, when the user touches a button indicating authentication (for example, a "Yes" or "YES" button), the authentication process is started at that timing. In this way, since the target can be confirmed through the authentication process, the target can be confirmed more reliably than when visually checking the video.

Here, an example will be described in which the information processing system 10 according to the third embodiment is applied to an entrance of an apartment. At the entrance of the condominium, a first camera 18 and a second camera 19 take images of a target (that is, a user attempting to enter the condominium). For example, the first camera 18 captures an image of the target's face, and the second camera 19 captures an image of the target's iris. In this case, the rotation control unit 110 performs control such that each of the first camera 18 and the second camera 19 faces the target's face. It is assumed that the images captured by the first camera 18 and the second camera 19 can be checked by residents of the apartment.

When the rotation control is executed as described above, since the first camera 18 and the second camera 19 face the direction of the target's face, there is a possibility that other parts will not be included in the imaging range. For example, the subject's hands are no longer visible, making it difficult to tell what the subject is holding. Alternatively, a target user of short height (for example, a child, etc.) may become invisible. In such a case, the resident of the apartment operates the imaging angles of the first camera 18 and the second camera 19. For example, a resident of an apartment can move the first camera 18 and the second camera 19 downward to check whether the subject is holding something in his hand, whether the subject is carrying a child, etc. In addition, if the first camera 18 or the second camera 19 cannot rotate normally due to a system failure, etc., by manually controlling the rotation, the first camera 18 and the second camera 19 can be rotated in an appropriate direction (for example, facing the face). direction). In this case, in addition to the residents of the apartment, the manager (such as a concierge) may also be able to manually control the rotation of the first camera 18 and the second camera 19. For example, if the first camera 18 and the second camera 19 do not rotate normally, the resident of the apartment touches a contact button displayed on the display of the control terminal (ie, the terminal including the operation reception unit 150). This will connect you to the concierge, where you can report any system malfunctions or have the concierge manually control the rotation.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the third embodiment will be explained.

As described with reference to FIG. 8, in the information processing system 10 according to the third embodiment, a user in the facility can control the rotation of the first camera 18 and the second camera 19. In this way, users in the facility can check parts that cannot be seen with normal rotation control (that is, rotation control by the rotation control unit 110). Therefore, user convenience and crime prevention functions can be improved. Furthermore, since the first camera 18 and the second camera 19 are rotatable, it is possible to check a wider area compared to a camera that does not rotate.

<Fourth embodiment>
An information processing system 10 according to a fourth embodiment will be described with reference to FIG. 9. Note that the fourth embodiment differs from the first to third embodiments described above only in some operations, and other parts may be the same as the first to third embodiments. Therefore, in the following, parts that are different from each of the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

(Contents of prescribed processing)
First, the contents of the predetermined processing executed in the information processing system 10 according to the fourth embodiment will be explained.

In the information processing system 10 according to the fourth embodiment, the execution unit 140 executes a process of calling an elevator to a designated floor as a predetermined process. Specifically, the execution unit 140 executes a process of calling an elevator to the floor corresponding to the location of the target for which the authentication process was successful. For example, if the target is successfully authenticated at the entrance on the first floor, the execution unit 140 may execute a process of calling an elevator to the first floor (that is, the floor where the target is present). However, if the elevator cannot be called to the floor where the target is located (for example, the elevator can only be boarded from the second floor), the process of calling the elevator to the floor closest to the target may be executed. Alternatively, if it is known that the subject will not take the elevator immediately after authentication (for example, if the subject is expected to go to the second floor to finish an errand and then take the elevator), it is predicted that the subject will take the elevator. A process of calling an elevator to the floor may also be executed. Note that the process of calling the elevator may be executed in conjunction with the process of permitting entry into the facility (see the second embodiment), which has already been described. That is, the execution unit 140 may execute a process of permitting entry and a process of calling an elevator as the predetermined process. In this case, if it is detected that the number of users permitted to enter is greater than or equal to a predetermined number, multiple elevators may be called. The predetermined number of people here may be a number of people depending on the capacity of the elevator. For example, if the capacity of an elevator is five, two elevators may be called if six or more users are detected.

(Flow of operation)
Next, the flow of operations performed by the information processing system 10 according to the fourth embodiment will be described with reference to FIG. 9. FIG. 9 is a flowchart showing the flow of operations performed by the information processing system according to the fourth embodiment. Note that in FIG. 9, processes similar to those shown in FIG. 7 are given the same reference numerals.

As shown in FIG. 9, when the information processing system 10 according to the fourth embodiment operates, the rotation control unit 110 first detects the position of the target (step S101). The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the target (step S102).

Subsequently, the biological information acquisition unit 120 acquires images captured by the first camera 18 and the second camera 19 (i.e., the first image and the second image) (step S103). Then, the biological information acquisition unit 120 acquires first biological information from the first image captured by the first camera 18 and acquires second biological information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). Then, the execution unit 140 determines whether both the authentication process using the first biometric information and the authentication process using the second biometric information in the authentication unit 130 are successful (step S201).

If both authentication processes are successful (step S201: YES), the execution unit 140 executes a process of calling an elevator to the floor corresponding to the target position (step S401). On the other hand, if both authentication processes are not successful (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the process of calling the elevator to the floor corresponding to the target position is not executed.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the fourth embodiment will be explained.

As described with reference to FIG. 9, in the information processing system 10 according to the fourth embodiment, when the authentication process for the target is successful, a process for calling an elevator to the floor corresponding to the position of the target is executed. In this way, the time the subject waits for the elevator will be shortened and the subject will be able to move smoothly within the facility.

<Fifth embodiment>
An information processing system 10 according to a fifth embodiment will be described with reference to FIG. 10. Note that the fifth embodiment differs from the first to fourth embodiments described above only in some operations, and may be the same as the first to fourth embodiments in other parts. Therefore, in the following, parts that are different from each of the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

(Contents of prescribed processing)
First, the contents of the predetermined process executed in the information processing system 10 according to the fifth embodiment will be explained.

In the information processing system 10 according to the fifth embodiment, the execution unit 140 executes a process of calling a vehicle used by a target to a predetermined position as a predetermined process. Note that the term "vehicle" here is a broad concept that includes not only automobiles but also various types of moving objects used by the subject, such as motorcycles, bicycles, ships, airplanes, and helicopters. For example, if the authentication is successful when the target exits the front door of the home, the execution unit 140 takes the vehicle owned by the target (for example, a vehicle that has been linked to the target in advance) from the mechanical parking lot and You may output instructions for moving to . Note that the timing of leaving the warehouse is not limited to just before leaving the front door. For example, when the user exits the entrance and is successfully authenticated using an authentication terminal installed in front of the door, the door may be locked and the vehicle may be taken out of the garage. Furthermore, when instructing to leave the garage using a smartphone app, it may be possible to reserve a time for leaving the garage, such as leaving the garage in 30 minutes, for example. Furthermore, if there is a possibility that the target will not use a vehicle (for example, if there is a possibility that the target will walk or use other means of transportation), the execution unit 140 executes a process to confirm whether the target uses a vehicle. You can. For example, the execution unit 140 may display a message on a terminal owned by the target (for example, a smartphone) to confirm whether or not the target uses a car. For example, if the authentication process is successful, a message such as "Do you want to leave the car?" may be output on the display of the terminal. In this case, the execution unit 140 may execute a process of calling a vehicle to a predetermined position when the target inputs that he or she will use a car. In other words, the execution unit 140 may not execute the process of calling the vehicle to a predetermined location when the target inputs that the vehicle will not be used (or when no input is made). Furthermore, if there are multiple vehicles that the target may use (for example, if the target owns multiple vehicles), the execution unit 140 executes a process that causes the target to select a vehicle to use. Good too. Further, the execution unit 140 may prepare for leaving the vehicle immediately, rather than actually leaving the vehicle. For example, if the vehicle is located on the 10th floor underground, processing may be performed to move the vehicle to a location closer to the ground, such as the 2nd floor underground. Even if the authentication process is successful, if the target goes somewhere without using the vehicle (for example, if the vehicle is not used after a predetermined period of time), the vehicle will be returned to the location where it was before leaving the garage. You may also change it back to .

(Flow of operation)
Next, the flow of operations performed by the information processing system 10 according to the fifth embodiment will be described with reference to FIG. 10. FIG. 10 is a flowchart showing the flow of operations performed by the information processing system according to the fifth embodiment. Note that in FIG. 10, processes similar to those shown in FIG. 7 are given the same reference numerals.

As shown in FIG. 10, when the information processing system 10 according to the fifth embodiment operates, the rotation control unit 110 first detects the position of the target (step S101). The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the target (step S102).

Subsequently, the biological information acquisition unit 120 acquires images captured by the first camera 18 and the second camera 19 (i.e., the first image and the second image) (step S103). Then, the biological information acquisition unit 120 acquires first biological information from the first image captured by the first camera 18 and acquires second biological information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). Then, the execution unit 140 determines whether both the authentication process using the first biometric information and the authentication process using the second biometric information in the authentication unit 130 are successful (step S201).

If both authentication processes are successful (step S201: YES), the execution unit 140 executes a process of calling the vehicle used by the target to a predetermined position (step S401). On the other hand, if both authentication processes are not successful (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the process of calling the vehicle used by the target to a predetermined location is not executed.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the fifth embodiment will be explained.

As described with reference to FIG. 10, in the information processing system 10 according to the fifth embodiment, when the authentication process of the target is successful, a process of calling the vehicle used by the target to a predetermined position is executed. In this way, the waiting time when calling a vehicle is shortened, or the subject does not have to move the vehicle himself, so the subject can use the vehicle more smoothly.

<Sixth embodiment>
An information processing system 10 according to a sixth embodiment will be described with reference to FIG. 11. Note that the sixth embodiment differs from the fifth embodiment described above only in some operations, and other parts may be the same as the first to fifth embodiments. Therefore, in the following, parts that are different from each of the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

(Contents of prescribed processing)
First, the content of the predetermined process executed in the information processing system 10 according to the sixth embodiment will be explained.

In the information processing system 10 according to the sixth embodiment, the execution unit 140 executes a process of guiding a target through a route within a facility as a predetermined process. Specifically, when the target moves within the facility, the execution unit 140 executes a process of guiding the target along a route in which the target does not pass by other users. For example, the execution unit 140 may display an in-facility map on a terminal owned by the target (for example, a smartphone, etc.), and may superimpose a route to be taken on the map. Further, when the target moves from floor to floor within the facility, the elevator to be boarded may be displayed. The route to be guided may be a route outside the facility. For example, the user may be given a suggestion such as "Please exit the apartment using the second back door" so as not to pass by other users outside the apartment. Further, in addition to the route, time information may also be instructed. For example, instructions such as "Please leave in 5 minutes as the route is currently crowded" or "Please pass this route in 3 minutes and get on the elevator in 5 minutes" may be output. Note that such route guidance may be realized by monitoring the positions of other users within the facility using, for example, a surveillance camera installed within the facility. Note that if it is difficult to avoid all other users, the execution unit 140 may guide the user along a route that will reduce the number of other users that will pass each other as much as possible. Furthermore, it may be possible to allow other users (for example, family members, facility management staff, etc.) specified by the user to pass each other. The process of guiding the route may be executed in conjunction with the process of calling an elevator (see the fourth embodiment) and the process of calling a vehicle (see the fifth embodiment), which have already been described.

(Flow of operation)
Next, the flow of operations performed by the information processing system 10 according to the sixth embodiment will be described with reference to FIG. 11. FIG. 11 is a flowchart showing the flow of operations performed by the information processing system according to the sixth embodiment. Note that in FIG. 11, processes similar to those shown in FIG. 7 are given the same reference numerals.

As shown in FIG. 11, when the information processing system 10 according to the sixth embodiment operates, the rotation control unit 110 first detects the position of the target (step S101). The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the target (step S102).

Subsequently, the biological information acquisition unit 120 acquires images captured by the first camera 18 and the second camera 19 (i.e., the first image and the second image) (step S103). Then, the biological information acquisition unit 120 acquires first biological information from the first image captured by the first camera 18 and acquires second biological information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). Then, the execution unit 140 determines whether both the authentication process using the first biometric information and the authentication process using the second biometric information in the authentication unit 130 are successful (step S201).

If both of the authentication processes are successful (step S201: YES), the execution unit 140 executes a process of guiding the target through the route within the facility (step S401). On the other hand, if both authentication processes are not successful (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the process of guiding the target through the route within the facility is not executed.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the sixth embodiment will be explained.

As described with reference to FIG. 11, in the information processing system 10 according to the sixth embodiment, when the authentication process for the target is successful, a process for guiding the target through the route within the facility is executed. In this way, it is possible to avoid the target from passing by other users within the facility. Such an effect will be noticeable when the target wants to avoid being seen in the facility (for example, when the target is a celebrity, etc.).

<Seventh embodiment>
An information processing system 10 according to a seventh embodiment will be described with reference to FIGS. 12 and 13. Note that the seventh embodiment differs from the first to sixth embodiments described above only in part of the configuration and operation, and may be the same as the first to sixth embodiments in other parts. Therefore, in the following, parts that are different from each of the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

(Functional configuration)
First, the functional configuration of the information processing system 10 according to the seventh embodiment will be described with reference to FIG. 12. FIG. 12 is a block diagram showing the functional configuration of an information processing system according to the seventh embodiment. In addition, in FIG. 12, the same reference numerals are given to the same elements as those shown in FIG. 4.

As shown in FIG. 12, the information processing system 10 according to the seventh embodiment includes a first camera 18, a second camera 19, a rotation control unit 110, and a biological information acquisition unit as components for realizing its functions. The system includes a section 120, an authentication section 130, an execution section 140, and a warning section 160. That is, the information processing system 10 according to the seventh embodiment is configured to further include a warning section 160 in addition to the configuration of the first embodiment (see FIG. 4). The warning unit 160 may be, for example, a processing block implemented by the processor 11 (see FIG. 1) described above.

The warning unit 160 is configured to be able to output a warning if the target does not reach a predetermined location within a predetermined time after the target authentication process is successful. The "predetermined location" here is a location that is set as a location (for example, the destination of the target) that is predicted to be reached by the target after successful authentication processing. Moreover, the "predetermined time" is a time set according to the time required for the target to reach the predetermined location (which may include some margin). For example, if the authentication process for the target is successful at the entrance of an apartment, the warning unit 160 outputs a warning if the target does not reach a specific room in the apartment (for example, home, place of visit, etc.) within a predetermined time. You can do as you like. The content of the warning may be, for example, a notification that some abnormality has occurred in the target. The warning unit 160 may issue a warning to, for example, the management staff of the facility, or may issue a warning to the target itself or users at the destination visited by the target. The warning by the warning unit 160 may be, for example, an alert display using a display, or an alert audio output using a speaker. Note that multiple predetermined times are set, and if the target does not reach the predetermined location by the first predetermined time, the first warning (for example, a weak warning) will be executed, and the warning will be executed by the second predetermined time. If the target does not reach a predetermined location, a second warning (for example, a stronger warning) may be executed. Note that a level of importance may be set for the target of the warning. For example, guests may be more likely to get lost and commit theft than residents who are used to living in an apartment, so the importance of guests may be set higher. In this case, the predetermined time period before issuing a warning may be set short for objects with high importance. Alternatively, the alert may be strengthened for a highly important target (for example, the concierge is always notified in the second alert). In addition, for users who are children, the elderly, and those with chronic illnesses, even if they are residents of an apartment, the importance level can be set as high as for guests, and the predetermined time before issuing an alert can be shortened or the alert can be strengthened. You may do so.

(Flow of operation)
Next, the flow of operations performed by the information processing system 10 according to the seventh embodiment will be described with reference to FIG. 13. FIG. 13 is a flowchart showing the flow of operations performed by the information processing system according to the seventh embodiment. Note that in FIG. 13, processes similar to those shown in FIG. 7 are given the same reference numerals.

As shown in FIG. 13, when the information processing system 10 according to the seventh embodiment operates, the rotation control unit 110 first detects the position of the target (step S101). The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the target (step S102).

Subsequently, the biological information acquisition unit 120 acquires images captured by the first camera 18 and the second camera 19 (i.e., the first image and the second image) (step S103). Then, the biological information acquisition unit 120 acquires first biological information from the first image captured by the first camera 18 and acquires second biological information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). Then, the execution unit 140 determines whether both the authentication process using the first biometric information and the authentication process using the second biometric information in the authentication unit 130 are successful (step S201).

If both authentication processes are successful (step S201: YES), the execution unit 140 executes a process to permit the subject to enter the facility (step S204). On the other hand, if both authentication processes are not successful (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the process of allowing the subject to enter the facility is not executed.

If the target is permitted to enter the facility, the warning unit 160 determines whether a predetermined time has elapsed since the authentication was successful (step S701). Note that if it is determined that the predetermined time has not elapsed (step S701: NO), the warning unit 160 continues measuring the time since the authentication was successful. On the other hand, if it is determined that the predetermined time has elapsed (step S701: YES), the warning unit 160 determines whether the target has reached a predetermined location (step S702).

If the target has not reached the predetermined location (step S702: NO), the warning unit 160 outputs a warning (step S703). On the other hand, if the target has already arrived at the predetermined location (step S702: YES), the warning unit 160 does not output a warning.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the seventh embodiment will be explained.

As described in FIGS. 12 and 13, in the information processing system 10 according to the seventh embodiment, if the target does not reach a predetermined location within a predetermined time after successful authentication, the warning unit 160 outputs a warning. be done. In this way, it is possible to notify that some kind of abnormality has occurred in the target based on the passage of time after authentication. For example, it is possible to notify that a subject is lost in a facility or has collapsed due to poor health.

<Eighth embodiment>
An information processing system 10 according to an eighth embodiment will be described with reference to FIG. 14. Note that the eighth embodiment differs from the first to seventh embodiments described above only in some operations, and may be the same as the first to seventh embodiments in other parts. Therefore, in the following, portions that are different from the embodiments already described will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Contents of prescribed processing)
First, the content of the predetermined process executed in the information processing system 10 according to the eighth embodiment will be explained.

In the information processing system 10 according to the eighth embodiment, the execution unit 140 executes a process of permitting a target to request a predetermined service as a predetermined process. The "predetermined service" here may be one that involves payment processing (that is, the generation of costs), such as calling a taxi or ordering food delivery. After the target is authenticated, the predetermined service may be requested from a terminal at the facility or a terminal (smartphone) owned by the target. In addition, when requesting a specific service, information indicating the location of the successfully authenticated target (e.g., GPS location information) and information regarding the target (e.g., the target's name, address, room number, etc.) will be sent to the service requester. may be automatically notified.

The cost of requesting a predetermined service is paid using the payment method associated with the successfully authenticated object. For example, the amount may be automatically debited from the account associated with the target identified through the authentication process. Alternatively, the payment process may be automatically performed using a credit card linked to the object specified by the authentication process. Note that, at the stage of requesting a service, processing may be performed to confirm with the subject himself/herself whether payment can be made using a payment method linked to the subject.

(Flow of operation)
Next, the flow of operations performed by the information processing system 10 according to the eighth embodiment will be described with reference to FIG. 14. FIG. 14 is a flowchart showing the flow of operations performed by the information processing system according to the eighth embodiment. Note that in FIG. 14, processes similar to those shown in FIG. 7 are given the same reference numerals.

As shown in FIG. 14, when the information processing system 10 according to the eighth embodiment operates, the rotation control unit 110 first detects the position of the target (step S101). The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the target (step S102).

Subsequently, the biological information acquisition unit 120 acquires images captured by the first camera 18 and the second camera 19 (i.e., the first image and the second image) (step S103). Then, the biological information acquisition unit 120 acquires first biological information from the first image captured by the first camera 18 and acquires second biological information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). Then, the execution unit 140 determines whether both the authentication process using the first biometric information and the authentication process using the second biometric information in the authentication unit 130 are successful (step S201).

If both authentication processes are successful (step S201: YES), the execution unit 140 executes a process of permitting the target to request a predetermined service (step S801). On the other hand, if both authentication processes are not successful (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the process of permitting the target to request the predetermined service is not executed.

If the target is permitted to request the predetermined service, the execution unit 140 determines whether the target has requested the predetermined service (step S802). If the predetermined service is requested (step S802: YES), the service fee is paid using the payment method associated with the target (step S803). On the other hand, if the predetermined service is requested (step S802: NO), the subsequent processing is omitted and the series of operations ends.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the eighth embodiment will be explained.

As described with reference to FIG. 14, in the information processing system 10 according to the eighth embodiment, when the authentication process of the target is successful, a process of permitting the target to request a predetermined service is executed, and the cost is tied to the target. Payment will be made using the following payment method. In this way, it is possible to improve the convenience of the target while increasing security through biometric authentication. Further, by notifying the service request destination of information indicating the location of the object and information regarding the object, it is possible to save the effort of separately communicating this information to the service request destination.

<Ninth embodiment>
An information processing system 10 according to a ninth embodiment will be described with reference to FIG. 15. Note that the ninth embodiment differs from the first to eighth embodiments described above only in some operations, and other parts may be the same as the first to eighth embodiments. Therefore, in the following, parts that are different from each of the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

(Contents of prescribed processing)
First, the content of the predetermined process executed in the information processing system 10 according to the ninth embodiment will be explained.

In the information processing system 10 according to the ninth embodiment, the execution unit 140 executes, as a predetermined process, a process of permitting a payment process by an object that has been successfully authenticated. The payment process here is not particularly limited, but may be, for example, a payment process when purchasing a product at a store or a vending machine.

If the target processes a payment, the cost will be paid using the payment method associated with the authorized person who has authorized the target to process the payment. In other words, the authorized person pays the fee, not the person who processed the payment. In addition, if the authorized person performs the payment processing, the authorized person may be made aware of the cost. The specific relationship between the permitter and the target here includes, for example, a parent-child relationship. In this case, if the authentication by the child (target) is successful and the authorized person for the target can be identified, the parent (authorized person) will pay the cost of the payment processing. Another example is the relationship between apartment residents and housekeepers. In this case, if the housekeeper (target) succeeds in authentication and the authorized person for the target can be identified, the apartment resident (authorized person) who is the employer will pay the cost of payment processing. Note that the authorized person may set an upper limit for payment processing. In this case, a target whose authentication process is successful will not be able to perform a payment process that exceeds the upper limit amount. Additionally, the authorized person may limit the use of payment processing. For example, the permitter can set the subject to pay only for purchases made at a specific store.

(Flow of operation)
Next, the flow of operations performed by the information processing system 10 according to the ninth embodiment will be described with reference to FIG. 15. FIG. 15 is a flowchart showing the flow of operations performed by the information processing system according to the ninth embodiment. Note that in FIG. 15, processes similar to those shown in FIG. 7 are given the same reference numerals.

As shown in FIG. 15, when the information processing system 10 according to the ninth embodiment operates, the rotation control unit 110 first detects the position of the target (step S101). The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the target (step S102).

Subsequently, the biological information acquisition unit 120 acquires images captured by the first camera 18 and the second camera 19 (i.e., the first image and the second image) (step S103). Then, the biological information acquisition unit 120 acquires first biological information from the first image captured by the first camera 18 and acquires second biological information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). Then, the execution unit 140 determines whether both the authentication process using the first biometric information and the authentication process using the second biometric information in the authentication unit 130 are successful (step S201).

If both authentication processes are successful (step S201: YES), the execution unit 140 allows the target to perform payment processing (step S901). On the other hand, if both authentication processes are not successful (step S201: NO), the subsequent processes are omitted and the series of operations ends. That is, if either the authentication process using the first biometric information or the authentication process using the second biometric information fails, the payment process is not permitted for the target.

If the target is permitted to perform the payment process, the execution unit 140 determines whether the target has performed the payment process (step S902). If the payment process is performed by the target (step S902: YES), the fee is paid using the payment method linked to the authorized person (step S903). On the other hand, if the payment processing by the target is not performed (step S902: NO), the subsequent processing is omitted and the series of operations ends.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the ninth embodiment will be explained.

As described with reference to FIG. 15, in the information processing system 10 according to the ninth embodiment, when the authentication process of the target is successful, the process of permitting the target to process the payment is executed, and the fee is different from that of the target. Payment is made using the payment method linked to the person. In this way, it is possible to improve the convenience of payment processing while increasing security through biometric authentication.

<Tenth embodiment>
An information processing system 10 according to a tenth embodiment will be described with reference to FIG. 16. Note that the tenth embodiment differs from the first to ninth embodiments described above only in some operations, and other parts may be the same as the first to ninth embodiments. Therefore, in the following, portions that are different from the embodiments already described will be described in detail, and descriptions of other overlapping portions will be omitted as appropriate.

(Contents of prescribed processing)
First, the contents of the predetermined processing executed in the information processing system 10 according to the tenth embodiment will be explained.

In the information processing system 10 according to the tenth embodiment, the execution unit 140 executes, as a predetermined process, a process of identifying a room to be used by a target. For example, if the target is a resident of an apartment, the execution unit 140 may specify the room number of the target's home. Information for specifying the room used by the subject may be registered in advance or may be input by the subject. Alternatively, by authenticating the target, the room number where the target resides may be automatically acquired. The execution unit 140 further executes a process of outputting an instruction to transport the target baggage to the specified room as a predetermined process. For example, as in the example described above, when the room number of the target home in an apartment is specified, the execution unit 140 may output an instruction to transport the target luggage from the entrance to the room of the home. The instruction to transport the cargo may be output to, for example, a transport robot or the like, or may be output to the staff of the facility. Before outputting the instruction to transport the luggage, the execution unit 140 may perform a process of checking whether the target has luggage, the number of luggage, the weight of the luggage, etc. In this case, an instruction to transport the cargo may be output after taking the confirmed matters into consideration. For example, if there is a large number of luggage or if the luggage is very heavy, an instruction including precautions such as "a trolley is required" may be output.

(Flow of operation)
Next, the flow of operations performed by the information processing system 10 according to the tenth embodiment will be described with reference to FIG. 16. FIG. 16 is a flowchart showing the flow of operations performed by the information processing system according to the tenth embodiment. Note that in FIG. 16, processes similar to those shown in FIG. 7 are given the same reference numerals.

As shown in FIG. 16, when the information processing system 10 according to the tenth embodiment operates, the rotation control unit 110 first detects the position of the target (step S101). The rotation control unit 110 then controls the rotation of the first camera 18 and the second camera 19 according to the detected position of the target (step S102).

Subsequently, the biological information acquisition unit 120 acquires images captured by the first camera 18 and the second camera 19 (i.e., the first image and the second image) (step S103). Then, the biological information acquisition unit 120 acquires first biological information from the first image captured by the first camera 18 and acquires second biological information from the second image captured by the second camera 19 (step S104).

Subsequently, the authentication unit 130 executes authentication processing using the first biometric information and the second biometric information acquired by the biometric information acquisition unit 120 (step S105). Then, the execution unit 140 determines whether both the authentication process using the first biometric information and the authentication process using the second biometric information in the authentication unit 130 are successful (step S201).

If both authentication processes are successful (step S201: YES), the execution unit 140 specifies the room used by the target (step S1001). Then, the execution unit 140 further outputs an instruction to transport the luggage to the specified room (step S1002). Note that if the target does not have any luggage, the processing in steps S1001 and S1002 may be omitted.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the tenth embodiment will be explained.

As described with reference to FIG. 16, in the information processing system 10 according to the tenth embodiment, when the authentication process of the target is successful, a room to be used by the target is specified and an instruction to transport the target's luggage to that room is issued. Output. In this way, the subject does not have to carry the luggage himself, so it is possible to improve convenience. Furthermore, if the object is authenticated and the object's room number is automatically specified, convenience can be improved compared to the case where the room number is input manually.

<Eleventh embodiment>
An information processing system 10 according to an eleventh embodiment will be described with reference to FIGS. 17 and 18. Note that the eleventh embodiment differs from the first to tenth embodiments described above only in part of the configuration and operation, and may be the same as the first to tenth embodiments in other parts. Therefore, in the following, parts that are different from each of the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

(Functional configuration)
First, the functional configuration of the information processing system 10 according to the eleventh embodiment will be described with reference to FIG. 17. FIG. 17 is a block diagram showing the functional configuration of an information processing system according to the eleventh embodiment. In addition, in FIG. 17, the same reference numerals are given to the same elements as those shown in FIG. 4.

As shown in FIG. 17, the information processing system 10 according to the eleventh embodiment includes a first camera 18, a second camera 19, a rotation control unit 110, and a biological information acquisition unit as components for realizing its functions. The system includes a section 120, an authentication section 130, an execution section 140, an unwell person detection section 170, and a call control section 180. That is, in addition to the configuration of the first embodiment (see FIG. 4), the information processing system 10 according to the eleventh embodiment further includes an unwell person detection section 170 and a call control section 180. There is. The unwell person detection unit 170 and the call control unit 180 may be, for example, processing blocks realized by the processor 11 (see FIG. 1) described above.

The unwell person detection unit 170 is configured to be able to detect unwell users within the facility (hereinafter appropriately referred to as "unwell people"). The unwell person detection unit 170 may be configured to be able to detect a unwell person using, for example, images from a surveillance camera installed within the facility. In addition, the unwell person detection unit 170 detects an unwell person using images captured by the authentication terminals (for example, the first camera 18 and the second camera 19) included in the information processing system 10 according to the present embodiment. It may be configured as possible. In this case, the unwell person detection unit 170 may detect, for example, a user who is lying on the floor or a user who is sitting down as an unwell person. In addition, the unwell person detection unit 170 may be configured to be able to identify the location where the unwell person is present. Information regarding the unwell person detected by the unwell person detection unit 170 is configured to be output to the call control unit 180.

The call control unit 180 is configured to be able to call an elevator equipped with life-saving tools to the floor corresponding to the location of the unwell person detected by the unwell person detection unit 170. For example, if a person who is unwell has collapsed on the second floor, the call control unit 180 may execute a process of calling the elevator to the second floor (that is, the floor where the person who is unwell is present). However, if the elevator cannot be called to the floor where the person who is not feeling well is located (for example, the elevator cannot be boarded from all floors), the process of calling the elevator to the floor closest to the target may be executed. Note that the life-saving tools provided in the elevator may include, for example, an AED (automated external defibrillator), oral medicine, wound medicine, bandages, wrapping bags, and the like. After calling the elevator, an alert may be sent to the floor where the elevator was called, the residents of the called floor, the concierge of the condominium, the security guard, etc. In this case, an instruction may be output to use a lifesaving tool provided in the elevator.

(Flow of operation)
Next, the flow of operations performed by the information processing system 10 according to the eleventh embodiment will be described with reference to FIG. 18. FIG. 18 is a flowchart showing the flow of operations performed by the information processing system according to the eleventh embodiment. Note that the process shown in FIG. 18 is executed independently of the series of operations described in FIG. It's fine.

As shown in FIG. 18, when the information processing system 10 according to the eleventh embodiment operates, the unwell person detection unit 170 first detects an unwell person in the facility (step S1101). Note that if a person who is unwell is not detected (step S1101: NO), the subsequent processing is omitted and the series of operations ends.

On the other hand, if an unwell person is detected (step S1101: YES), the unwell person detection unit 170 identifies the position of the unwell person (step S1102). Then, the call control unit 180 calls an elevator equipped with life-saving tools to the floor corresponding to the location of the unwell person (step S1103). Note that the call control unit 180 may notify the subject himself or herself, a user who rescues the subject, etc. that an elevator equipped with life-saving equipment has been called.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the eleventh embodiment will be explained.

As described in FIGS. 17 and 18, in the information processing system 10 according to the eleventh embodiment, when a person who is unwell is detected in a facility, life-saving tools are provided on the floor corresponding to the position of the person who is unwell. The elevator is called. In this way, it becomes possible to provide relief to people who are unwell in an appropriate and prompt manner.

<Twelfth embodiment>
An information processing system 10 according to the twelfth embodiment will be described with reference to FIGS. 19 to 21. Note that the twelfth embodiment differs from the first to eleventh embodiments described above only in part of the configuration and operation, and may be the same as the first to eleventh embodiments in other parts. Therefore, in the following, parts that are different from each of the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

(Functional configuration)
First, the functional configuration of the information processing system 10 according to the twelfth embodiment will be described with reference to FIG. 19. FIG. 19 is a block diagram showing the functional configuration of an information processing system according to the twelfth embodiment. In addition, in FIG. 19, the same reference numerals are given to the same elements as those shown in FIGS. 4 and 17.

As shown in FIG. 19, the information processing system 10 according to the 121st embodiment includes a first camera 18, a second camera 19, a rotation control unit 110, and a biological information acquisition unit as components for realizing its functions. The system includes a section 120, an authentication section 130, an execution section 140, an unwell person detection section 170, and a notification section 190. That is, the information processing system 10 according to the twelfth embodiment is configured to further include an unwell person detection section 170 and a notification section 190 in addition to the configuration of the first embodiment (see FIG. 4). . Note that the unwell person detection unit 170 may be the same as that of the already described eleventh embodiment. The notification unit 190 may be, for example, a processing block implemented by the processor 11 (see FIG. 1) described above.

The notification unit 190 notifies the user associated with the unwell person detected by the unwell person detection unit 170 when the authentication process is successful. The notification unit 190 may, for example, notify the target's family or the like of information indicating the location where the target has fallen. The notification unit 190 may perform the notification using equipment within the facility (for example, a display, a speaker, etc. installed within the facility). Alternatively, the notification unit 190 may notify a terminal (for example, a smartphone, etc.) owned by a user associated with the target.

(Flow of operation)
Next, the flow of operations performed by the information processing system 10 according to the twelfth embodiment will be described with reference to FIG. 20. FIG. 20 is a flowchart showing the flow of operations performed by the information processing system according to the twelfth embodiment. Note that in FIG. 20, processes similar to those shown in FIG. 18 are given the same reference numerals.

As shown in FIG. 20, when the information processing system 10 according to the twelfth embodiment operates, the unwell person detection unit 170 first detects an unwell person in the facility (step S1101). Note that if a person who is unwell is not detected (step S1101: NO), the subsequent processing is omitted and the series of operations ends.

On the other hand, if an unwell person is detected (step S1101: YES), the unwell person detection unit 170 identifies the position of the unwell person (step S1102). Then, the notification unit 190 determines whether the person who is unwell has been authenticated (that is, whether the person is a subject for whom the authentication process using the first biometric information and the second biometric information was successful) (step S1201).

If the unwell person has been authenticated (step S1201: YES), the notification unit 190 notifies the user associated with the unwell person (step S1202). On the other hand, if the person in poor physical condition has not been authenticated (step S1201: NO), the subsequent processing is omitted and the series of operations ends.

(Modified example)
Next, a modified example of the flow of operation by the information processing system 10 according to the twelfth embodiment will be described with reference to FIG. 21. FIG. 21 is a flowchart showing a modified example of the flow of operations performed by the information processing system according to the twelfth embodiment. Note that in FIG. 21, processes similar to those shown in FIGS. 18 and 20 are given the same reference numerals.

As shown in FIG. 21, in the modification of the information processing system 10 according to the twelfth embodiment, the unwell person detection unit 170 first detects an unwell person in the facility (step S1101). Note that if a person who is unwell is not detected (step S1101: NO), the subsequent processing is omitted and the series of operations ends.

On the other hand, if an unwell person is detected (step S1101: YES), the unwell person detection unit 170 identifies the position of the unwell person (step S1102). In particular, the information processing system 10 according to the modified example includes the call control unit 180 (see FIG. 17) described in the eleventh embodiment, and the information processing system 10 according to the modified example is equipped with a call control unit 180 (see FIG. 17), and a life-saving tool is placed on the floor corresponding to the location of the unwell person. calls an elevator equipped with (step S1103).

Subsequently, the notification unit 190 determines whether the person who is unwell has been authenticated (step S1201). If the unwell person has been authenticated (step S1201: YES), the notification unit 190 notifies the user associated with the unwell person (step S1202). On the other hand, if the person in poor physical condition has not been authenticated (step S1201: NO), the subsequent processing is omitted and the series of operations ends.

(technical effect)
Next, technical effects obtained by the information processing system 10 according to the twelfth embodiment will be described.

As described with reference to FIGS. 19 to 21, in the information processing system 10 according to the twelfth embodiment, if a person in poor physical condition is an authenticated target (in other words, if the person is specified as a target), A notification will be sent to the user who will be contacted. In this way, it becomes possible to quickly notify other users of the presence of a person who is unwell, and it is possible to appropriately rescue the person who is unwell.

<13th embodiment>
An information processing system 10 according to the thirteenth embodiment will be described with reference to FIGS. 22 to 25. The thirteenth embodiment shows a specific example of operation (display example) of the first to twelfth embodiments described above, and its configuration, operation, etc. are the same as those of the first to twelfth embodiments. It's good to be there. Therefore, in the following, parts that are different from each of the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

(Target registration)
First, a display example and operation when registering a target will be described with reference to FIG. 22. FIG. 22 is a plan view showing an example of a display screen when registering a target. In the following description, the first biometric information is information related to the face, and the second biometric information is information related to the iris.

Registered users in the authentication process may be added as appropriate. When adding a registered user, a face image may be captured in order to register the first biometric information (face information), and iris information may be captured in order to register the second biometric information (iris information). In addition, if it is difficult to capture an iris image (for example, if you do not have a camera at hand to capture an iris image), you can capture only a face image and register the face information, and then capture the iris image later to register the iris information. may also be registered.

As shown in FIG. 22, registered users and their registration status may be confirmed and edited on, for example, a smartphone. From the image shown in FIG. 22, it can be confirmed that both face information and iris information are registered for Hio, Honko, and Denta. On the other hand, it can be confirmed that for the user who is attempting to newly register, only face information is registered, and iris information is not registered. Note that the names of these users may be editable as appropriate.

(Update of registered information)
Next, a display example and operation when updating registration information will be described with reference to FIG. 23. FIG. 23 is a plan view showing an example of a display screen when updating target registration information.

The registered face information and iris information may be updated to new information. For example, since infants' faces change considerably over a certain period of time, an alert prompting the user to update the registered information may be sent after a predetermined period of time has elapsed since facial information was registered. Furthermore, the age of the target may also be stored, and the update frequency may be changed depending on the age. For example, the higher the age, the lower the update frequency may be.

As shown in FIG. 23, in order to update registered information, for example, on an update screen displayed on a smartphone, the update button corresponding to the user who wishes to update may be pressed and an image for updating may be captured. The image may be captured using a camera built into a smartphone or the like, or may be captured using a dedicated registration terminal or the like. When updating on a registration terminal, the user may be required to enter information to identify the user (for example, room number in the case of an apartment).

(Operations according to home situation)
Next, with reference to FIGS. 24 and 25, an example of the operation according to the home situation will be described. FIG. 24 is a plan view showing an example of a display screen showing the absence time of a registered target. FIG. 25 is a plan view showing an example of a display screen showing the home status of a registered target.

As shown in FIG. 24, the registered user's absence time may be inputted in advance, and if a visitor arrives during the absence time, a notification may be sent to the registered user's terminal or the like. Furthermore, if spoofing is detected, a notification may be sent to the effect that spoofing has occurred.

As shown in FIG. 25, the home status may be changed based on the result of the authentication process. For example, if the authentication process is successful at the entrance of an apartment building, the home status of the registered user may be changed to "at home." Further, if the authentication process is successful when leaving the front door of the home, the home status of the registered user may be changed to "absent".

<Other prescribed processing>
In each of the embodiments described above, a plurality of examples are given of the predetermined processing executed by the information processing system 10, but the predetermined processing is not limited to these examples and may include other processing.

For example, when performing the authentication process when leaving a room, the predetermined process may be a process of locking the room. Alternatively, it may be a process of notifying a person related to the subject that the subject has left the room. Alternatively, in a condominium with a concierge service, the process may be to notify the concierge staff that the subject who left the room will stop by the concierge. Alternatively, the process may include requesting a concierge to ship the luggage stored in a butler box installed in front of the room. Furthermore, if there is a package that has been delivered to the target address, the process may be such that a notification to that effect is sent.

In addition, the predetermined process may be a process related to a shared facility within the facility (eg, a fitness room, a bar lounge, a party room, a co-working space, etc.). For example, the predetermined process may be a process of making a reservation for a shared facility. Alternatively, the process may be such that the usage fee for the shared facility or the purchase fee within the shared facility can be settled using a payment method linked to the object. Alternatively, the processing may be a process of instructing a robot or the like to transport the trash (for example, transport it to a predetermined trash dump site).

Each embodiment also includes a processing method in which a program that operates the configuration of each embodiment described above is recorded on a recording medium, the program recorded on the recording medium is read as a code, and executed on a computer. Included in the category of form. That is, computer-readable recording media are also included within the scope of each embodiment. Furthermore, not only the recording medium on which the above-described program is recorded, but also the program itself is included in each embodiment.

As the recording medium, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, and a ROM can be used. In addition, each embodiment is not limited to a program that executes processing by itself as a program recorded on the recording medium, but also includes a program that operates on the OS and executes processing in collaboration with other software and functions of an expansion board. included in the category of Furthermore, the program itself may be stored on a server, and part or all of the program may be downloaded to the user terminal from the server.

Note that the configurations and flows of the embodiments described above can be combined. In this case, three or more embodiments may be combined.

<Additional notes>
Regarding the embodiment described above, the following supplementary notes may be further described, but are not limited to the following.

(Additional note 1)
The information processing system according to Supplementary Note 1 includes: a rotation control means for rotating a first camera and a second camera having the same rotation axis on the rotation axis according to the position of the object to be imaged; acquisition means for acquiring first biometric information from an image captured by a camera and second biometric information from an image captured by the second camera; and authentication using the first biometric information and the second biometric information. The information processing system includes an authentication unit that performs processing, and an execution unit that executes a predetermined process at a facility used by the target when the authentication process is successful.

(Additional note 2)
In the information processing system according to supplementary note 2, the predetermined process includes a process of permitting entry to the facility, and the execution means is configured to collect the first biometric information and the second biometric information of the first target. The authentication processing using both of them is successful, and the authentication processing using at least one of the first biometric information and the second biometric information of a second object different from the first object is successful. The information processing system according to Supplementary Note 1 allows the first subject and the second subject to enter the facility on the condition that the first subject and the second subject do so.

(Additional note 3)
The information processing system according to appendix 3 is the information processing system according to appendix 1 or 2, wherein the first camera and the second camera are rotatable on a rotation axis according to an operation by a user in the facility. This is an information processing system.

(Additional note 4)
The information processing system according to Supplementary note 4 is the information according to any one of Supplementary notes 1 to 3, wherein the predetermined process includes a process of calling an elevator to a floor where the object on which the authentication process was successful is located. It is a processing system.

(Appendix 5)
The information processing system according to Supplementary Note 5 is set forth in any one of Supplementary Notes 1 to 4, wherein the predetermined process includes a process of calling a vehicle used by the subject who has successfully passed the authentication process to a predetermined position. This is the information processing system described.

(Appendix 6)
In the information processing system according to appendix 6, the predetermined process includes a process of guiding the subject, for whom the authentication process has been successfully completed, a route that can be taken within the facility without passing by another person. , the information processing system according to any one of Supplementary Notes 1 to 5.

(Appendix 7)
The information processing system according to appendix 7 further comprises a warning means for outputting a warning if the target does not reach a predetermined location within a predetermined time after the authentication process is successful, according to any one of appendices 1 to 6. This is an information processing system described in .

(Appendix 8)
In the information processing system according to appendix 8, the predetermined process enables the target for which the authentication process has been successful to request a predetermined service, and also includes information indicating the location where the authentication process has been successful and information regarding the target. It is sent to the person requesting the prescribed service, and the cost when the subject requests the prescribed service is paid by the payment method linked to the subject, as described in any one of appendices 1 to 7. This is an information processing system.

(Appendix 9)
In the information processing system according to appendix 9, the predetermined process enables the subject for whom the authentication process has been successfully completed to process a payment, and the cost for the payment process by the subject is paid when the subject performs the payment process. 8. The information processing system according to any one of Supplementary Notes 1 to 8, in which payment is made using a payment method associated with a person authorized to perform the above.

(Appendix 10)
In the information processing system according to appendix 10, the predetermined process includes a process of specifying a room in the facility used by the subject who has successfully passed the authentication process, and a process of transporting the subject's luggage to the specified room. The information processing system according to any one of Supplementary Notes 1 to 9, including a process of instructing.

(Appendix 11)
The information processing system according to appendix 11 includes a detection means for detecting a user in poor physical condition in the facility, and a call control means for calling an elevator equipped with a lifesaving tool to a floor corresponding to the position of the detected user. The information processing system according to any one of Supplementary Notes 1 to 10, further comprising the following.

(Appendix 12)
The information processing system according to Supplementary note 12 includes a detection means for detecting a user in poor physical condition in the facility, and a detecting means for detecting a user in poor physical condition in the facility; 12. The information processing system according to any one of Supplementary Notes 1 to 11, further comprising a notification means for notifying another user.

(Appendix 13)
The information processing device according to Supplementary Note 13 includes: a rotation control means for rotating a first camera and a second camera having the same rotation axis on the rotation axis according to the position of the object to be imaged; acquisition means for acquiring first biometric information from an image captured by a camera and second biometric information from an image captured by the second camera; and authentication using the first biometric information and the second biometric information. The information processing apparatus includes an authentication means that performs processing, and an execution means that executes predetermined processing at a facility used by the target when the authentication processing is successful.

(Appendix 14)
The information processing method described in Appendix 14 is an information processing method executed by at least one computer, and includes rotating a first camera and a second camera having the same rotation axis according to the position of the object to be imaged. rotate on an axis, acquire first biological information from an image taken by the first camera, acquire second biological information from an image taken by the second camera, and acquire the first biological information and the first biological information from the image taken by the second camera. 2. This information processing method performs an authentication process using biometric information, and when the authentication process is successful, executes a predetermined process at a facility used by the target.

(Additional note 15)
The recording medium according to appendix 15 causes at least one computer to rotate a first camera and a second camera having the same rotation axis on the rotation axis according to the position of the object to be imaged, and obtaining first biometric information from an image captured by the second camera; obtaining second biometric information from the image captured by the second camera; and performing authentication processing using the first biometric information and the second biometric information. The information processing method is a recording medium on which a computer program for executing an information processing method is recorded, which executes a predetermined process in a facility used by the target when the authentication process is successful.

(Appendix 16)
The computer program according to appendix 16 causes at least one computer to rotate a first camera and a second camera having the same rotation axis on the rotation axis according to the position of the object to be imaged, and obtaining first biometric information from an image captured by the second camera; obtaining second biometric information from the image captured by the second camera; and performing authentication processing using the first biometric information and the second biometric information. The information processing method is a computer program that executes an information processing method that executes a predetermined process at a facility used by the target when the authentication process is successful.

This disclosure can be modified as appropriate within the scope or spirit of the invention that can be read from the claims and the entire specification, and information processing systems, information processing devices, information processing methods, etc. that involve such modifications can be modified as appropriate. and a recording medium are also included in the technical idea of this disclosure.

10 Information processing system 11 Processor 18 First camera 19 Second camera 20 Motor 21 Near-infrared illumination 30 Authentication terminal 35 Camera installation part 40 Display 50 Case 110 Rotation control unit 115 Target position detection unit 120 Biometric information acquisition unit 130 Authentication unit 140 Execution unit 150 Operation reception unit 160 Warning unit 170 Unwell person detection unit 180 Call control unit 190 Notification unit

Claims (10)

a rotating member having a first camera and illumination means;
Rotation control means for controlling the rotation of the rotating member so that the first camera and the illumination means rotate about the same rotation axis according to the position of the object to be imaged;
acquisition means for acquiring first biological information from an image captured by the first camera;
an authentication means that performs authentication processing using the first biometric information;
Execution means for executing a predetermined process at a facility used by the target when the authentication process is successful;
An information processing system equipped with. further comprising a cover installed to prevent the first camera from being exposed to the outside;
The information processing system according to claim 1. The rotating member further includes a second camera,
The rotation control means controls rotation of the rotation member so that the second camera rotates on the rotation axis,
The acquisition means acquires second biological information from an image captured by the second camera,
The authentication means performs the authentication process using the second biometric information,
The information processing system according to claim 1 or 2 . The rotation control means rotates the second camera based on the image captured by the first camera.
The information processing system according to any one of claims 1 to 3. The information processing system according to claim 3 or 4 , wherein the first camera and the second camera image the object during rotation control by the rotation control means. The information processing system according to claim 3 or 4 , wherein the first camera and the second camera image the object when rotation control by the rotation control means is completed. The predetermined process includes a process of permitting entry to the facility,
The execution means is configured to perform authentication processing using both the first biometric information and the second biometric information of the first target successfully, and the execution means is configured to perform the authentication process using both the first biometric information and the second biometric information of the first target, and Allowing the first subject and the second subject to enter the facility on the condition that the authentication process using at least one of the first biometric information and the second biometric information is successful. ,
The information processing system according to any one of claims 3 to 6 . The information processing system according to any one of claims 3 to 7 , wherein the first camera and the second camera are rotatable on a rotation axis according to an operation by a user in the facility. . An information processing method executed by at least one computer, the method comprising:
Controlling a rotating member having a first camera and illumination means so that the first camera and illumination means rotate about the same rotation axis depending on the position of the object to be imaged,
obtaining first biological information from an image captured by the first camera;
Performing an authentication process using the first biometric information,
If the authentication process is successful, executing a predetermined process at the facility used by the target;
Information processing method. on at least one computer,
Controlling a rotating member having a first camera and illumination means so that the first camera and illumination means rotate about the same rotation axis depending on the position of the object to be imaged,
obtaining first biological information from an image captured by the first camera;
Performing an authentication process using the first biometric information,
If the authentication process is successful, executing a predetermined process at the facility used by the target;
A computer program that executes an information processing method.