WO2022176339A1

WO2022176339A1 - Information processing device, information processing system, information processing method, and non-transitory computer-readable medium

Info

Publication number: WO2022176339A1
Application number: PCT/JP2021/045358
Authority: WO
Inventors: 秀典北方
Original assignee: 日本電気株式会社
Priority date: 2021-02-17
Filing date: 2021-12-09
Publication date: 2022-08-25
Also published as: JPWO2022176339A1

Abstract

An information processing device (10) comprises a registration unit (11), a determination unit (12), an authentication control unit (13), a start processing unit (14), and a completion processing unit (15). The registration unit (11) registers attribute information of a person in association with biometric information for each person. The determination unit (12) determines, for each person, a mission group including one or a plurality of missions on the basis of the attribute information. After acquiring biometric information for authentication of the person from an information terminal, the authentication control unit (13) causes a person to perform biometric authentication The start processing unit (14) causes the information terminal to output content information of at least one mission included in a mission group corresponding to the person when the biometric authentication is successful and a start request is acquired from the information terminal. The completion processing unit (15) executes processing according to completion of the mission when the biometric authentication is successful and a completion request is acquired from the information terminal.

Description

Information processing device, information processing system, information processing method, and non-transitory computer-readable medium

The present disclosure relates to an information processing device, an information processing system, an information processing method, and a non-temporary computer-readable medium. computer readable medium.

For the efficient operation of experiential event venues, applications have been proposed to support operations. For example, Patent Literature 1 discloses an information processing apparatus that displays content associated with facilities such as parks and amusement parks in an appropriate display order according to the position of the facility user.

In addition, efforts are being made to understand the behavior of each participant in order to operate the event efficiently. As a technique for recording people's actions, for example, Patent Literature 2 discloses a face authentication system that performs face authentication for each event caused by user's actions in a facility.

JP 2019-164754 A JP 2020-144443 A

Here, it is required to revitalize the event venue. However, the information processing apparatus described in Patent Literature 1 described above cannot display contents according to the attributes of the participants, which is insufficient in terms of revitalizing the event venue. It should be noted that the face authentication system described in Patent Literature 2 is not intended to activate the event site.

In view of the problems described above, an object of the present disclosure is to provide an information processing device, an information processing method, and a non-temporary computer-readable medium that suitably activate the event venue and suitably support the operation of the event venue. .

An information processing device according to an aspect of the present disclosure includes:
a registration means for registering the attribute information of each target person in association with the biometric information of the target person;
determining means for determining a mission group consisting of one or more missions for each subject based on the attribute information;
Authentication control means for performing biometric authentication when biometric information for authentication of a target person is acquired from an information terminal;
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject start processing means for causing the information terminal to output content information of at least one mission included in the group;
Completion processing means for executing a process according to the completion of the mission when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is obtained from the information terminal. Prepare.

An information processing system according to one aspect of the present disclosure includes:
an information terminal that acquires biometric information for authentication of a subject;
and an information processing device communicably connected to the information terminal.
The information processing device is
a registration means for registering the attribute information of each target person in association with the biometric information of the target person;
determining means for determining a mission group consisting of one or more missions for each subject based on the attribute information;
Authentication control means for performing biometric authentication when biometric information for authentication of a subject is acquired from the information terminal;
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject start processing means for causing the information terminal to output content information of at least one mission included in the group;
Completion processing means for executing a process according to the completion of the mission when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is acquired from the information terminal. have.

An information processing method according to an aspect of the present disclosure includes:
For each target person, the attribute information of the target person is registered in association with the biometric information of the target person,
determining a mission group consisting of one or more missions for each subject based on the attribute information;
When the biometric information for authentication of the target person is obtained from the information terminal, biometric authentication is performed,
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject causing the information terminal to output content information of at least one mission included in the group;
When the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is acquired from the information terminal, a process according to the completion of the mission is executed.

A non-transitory computer-readable medium according to one aspect of the present disclosure comprises:
a registration process for registering attribute information of each target person in association with the biometric information of the target person;
a determination process of determining a mission group consisting of one or more missions for each target person based on the attribute information;
Authentication control processing for performing biometric authentication when biometric information for authentication of a target person is acquired from an information terminal;
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject a start process for causing the information terminal to output content information of at least one mission included in the group;
a completion process for executing a process according to the completion of the mission when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is obtained from the information terminal; Stores the program to be executed.

According to the present disclosure, an information processing device, an information processing method, and a non-temporary information processing device, an information processing method, and a non-temporary information processing apparatus that appropriately activate an event site and appropriately support the operation of the event site by presenting a mission according to the attributes of the target person who is a participant can provide a computer-readable medium.

1 is a block diagram showing the configuration of an information processing apparatus according to a first embodiment; FIG. 3 is a diagram showing the flow of an information processing method according to the first embodiment; FIG. 2 is a block diagram showing the overall configuration of an information processing system according to a second embodiment; FIG. 2 is a block diagram showing the configuration of an authentication device according to a second embodiment; FIG. 9 is a flowchart showing the flow of face information registration processing according to the second embodiment; 9 is a flow chart showing the flow of face authentication processing according to the second embodiment; FIG. 10 is a block diagram showing the configuration of a face authentication terminal according to the second embodiment; FIG. FIG. 8 is a block diagram showing the configuration of a user terminal according to the second embodiment; FIG. 2 is a block diagram showing the configuration of an information processing apparatus according to a second embodiment; FIG. FIG. 10 is a diagram showing an example of the data structure of mission history information according to the second embodiment; 9 is a flowchart showing the flow of participation registration processing according to the second embodiment; 9 is a flowchart showing the flow of start processing according to the second embodiment; 9 is a flowchart showing the flow of completion processing according to the second embodiment; 9 is a flowchart showing the flow of payment registration processing according to the second embodiment; FIG. 11 is a sequence diagram showing the flow of participation registration processing according to the second embodiment; FIG. 11 is a sequence diagram showing the flow of start processing according to the second embodiment; FIG. 12 is a sequence diagram showing the flow of completion processing according to the second embodiment; FIG. 11 is a sequence diagram showing the flow of payment registration processing according to the second embodiment; FIG. 11 is a diagram showing an example of a terminal screen according to the second embodiment; FIG. FIG. 11 is a diagram showing an example of a terminal screen according to the second embodiment; FIG. FIG. 11 is a diagram showing an example of a terminal screen according to the second embodiment; FIG. FIG. 11 is a diagram showing an example of a terminal screen according to the second embodiment; FIG. FIG. 11 is a diagram showing an example of a terminal screen according to the second embodiment; FIG. FIG. 11 is a block diagram showing the overall configuration of an information processing system according to a third embodiment; FIG. FIG. 11 is a block diagram showing the configuration of an information processing apparatus according to a third embodiment; FIG. 11 is a flow chart showing the flow of authentication control processing according to the third embodiment; 10 is a flowchart showing the flow of image provision processing according to the third embodiment; FIG. 12 is a diagram showing an example of a photographed image according to the third embodiment; FIG. FIG. 12 is a diagram showing an example of a synthesized image according to the third embodiment; FIG.

Below, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same reference numerals are given to the same or corresponding elements, and redundant description will be omitted as necessary for clarity of description.

<Embodiment 1>
First, Embodiment 1 of the present disclosure will be described. FIG. 1 is a block diagram showing the configuration of an information processing apparatus 10 according to the first embodiment. The information processing device 10 is an information processing device that presents a mission to a target person who is a participant of the event at the event venue. Here, the information processing device 10 is connected to a network (not shown). A network may be wired or wireless. The network is also connected to an information terminal (not shown) that acquires biometric information for authentication of a subject. In other words, the information processing device 10 is communicably connected to the information terminal via the network. The information terminal may be a face authentication terminal, digital signage with a camera, or the like.

The information processing device 10 includes a registration unit 11 , a determination unit 12 , an authentication control unit 13 , a start processing unit 14 and a completion processing unit 15 .

The registration unit 11 is also called registration means. The registration unit 11 registers the attribute information of each target person in association with the biometric information of the target person. Here, the subject's attribute information is information related to the subject. For example, the subject's attribute information may include at least one of information indicating the subject's age, gender, occupation, family structure, hobby, companion information, and desired end time. The companion information indicates the presence or absence of a companion, and if there is a companion, the attributes of the group including the target person and the companion (group attribute). As an example, the group attribute is family (with parent and child), couple, friends, or the like. The companion information may include the identification information (ID) of the companion. The biometric information may be face, fingerprint, iris or vein feature information, or other biometric information.

The decision unit 12 is also called decision means. The determination unit 12 determines a mission group for each target person based on attribute information. Here, a mission group consists of one or more missions. In other words, when a mission group is composed of multiple missions, the mission group represents a collection of missions.

The authentication control unit 13 is also called authentication control means. When the authentication control unit 13 acquires the biometric information for authentication of the target person from the information terminal, the biometric authentication is performed.

The start processing unit 14 is also called start processing means. When the biometric authentication is successful and the start request is obtained from the information terminal, the start processing unit 14 causes the information terminal to output content information of at least one mission included in the mission group corresponding to the target person. The initiation request includes information indicating that the subject is requesting initiation of participation in the first or next mission.

The completion processing unit 15 is also called completion processing means. The completion processing unit 15 executes processing according to mission completion when biometric authentication is successful and a completion request is acquired from the information terminal. The completion request contains information indicating that the subject has completed the mission in which he or she is participating.

FIG. 2 is a diagram showing the flow of the information processing method according to the first embodiment. First, the registration unit 11 registers the attribute information of each target person in association with the biometric information of the target person (S11). Next, the determination unit 12 determines a mission group for each target person based on the target person's attribute information (S12). Next, the authentication control unit 13 determines whether or not the biometric information for authentication of the subject has been acquired from the information terminal (S13). If the authentication control unit 13 has not acquired the biometric information (No in S13), the process ends. On the other hand, when the authentication control unit 13 acquires the biometric information (Yes in S13), the authentication control unit 13 performs biometric authentication (S14), and determines whether or not the biometric authentication is successful (S15). If the biometric authentication is not successful (No in S15), the authentication control unit 13 terminates the process. On the other hand, if the biometric authentication is successful (Yes in S15), the start processing unit 14 determines whether or not a start request has been received from the information terminal (S16). The process shown in step S16 may be performed in parallel with the process shown in step S13. When the start request is acquired (Yes in S16), the start processing unit 14 causes the information terminal to output the content information of the mission of the target person's mission group (S17). On the other hand, if the start request has not been acquired (No in S16), the completion processing unit 15 determines whether or not the completion request has been acquired from the information terminal (S18). If the completion processing unit 15 does not acquire a completion request (No in S18), the processing ends. On the other hand, when the completion request is acquired (Yes in S18), the completion processing unit 15 executes a process according to mission completion (S19).

As described above, the information processing apparatus 10 according to the first embodiment presents a mission to each target person according to the attributes of the target person, so that the target person of various strata can preferably experience the mission. can. Therefore, the information processing device 10 can suitably activate the event venue and suitably support the operation of the event venue.

The information processing apparatus 10 includes a processor, a memory, and a storage device (not shown). Further, the storage device stores a computer program in which the processing of the information processing method according to the present embodiment is implemented. Then, the processor loads the computer program from the storage device into the memory and executes the computer program. Thereby, the processor realizes the functions of the registration unit 11 , the determination unit 12 , the authentication control unit 13 , the start processing unit 14 and the completion processing unit 15 .

Alternatively, the registration unit 11, the determination unit 12, the authentication control unit 13, the start processing unit 14, and the completion processing unit 15 may each be realized by dedicated hardware. Also, part or all of each component of each device may be realized by general-purpose or dedicated circuitry, processors, etc., or combinations thereof. These may be composed of a single chip, or may be composed of multiple chips connected via a bus. A part or all of each component of each device may be implemented by a combination of the above-described circuits and the like and programs. Moreover, CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (field-programmable gate array), etc. can be used as a processor.

Further, when part or all of each component of the information processing device 10 is realized by a plurality of information processing devices, circuits, etc., the plurality of information processing devices, circuits, etc. may be centrally arranged, They may be distributed. For example, the information processing device, circuits, and the like may be implemented as a form in which each is connected via a communication network, such as a client-server system, a cloud computing system, or the like. Also, the functions of the information processing device 10 may be provided in a SaaS (Software as a Service) format.

<Embodiment 2>
Next, Embodiment 2 of the present disclosure will be described. FIG. 3 is a block diagram showing the overall configuration of an information processing system 1000 according to the second embodiment. The information processing system 1000 is a computer system that allows a user U, who is a visitor of the event site and a participant of the event, to experience a mission at the event site. The event venue is a zoo, amusement park, or other event venue. A mission shows the experience program which the user U experiences, and the game which the user U plays. For example, the mission may be an animal feeding experience, a horseback riding experience, a treasure hunt game, or the like. The information processing system 1000 includes an authentication device 100, an information processing device 200, face authentication terminals 400-1 to 400-n (n is a natural number equal to or greater than 1), a shop terminal 600, and a user terminal 500. FIG. Authentication device 100, information processing device 200, face authentication terminals 400-1 to 400-n, store terminal 600, and user terminal 500 are connected via network N, respectively. Here, the network N is a wired or wireless communication line.

Also, face authentication terminals 400-1, 400-2, . . . 400-n are installed at points A1, A2, . Here, points A1 to An are assumed to be different spots in a certain event site A. FIG. For example, the point A1 may be the entrance of the zoo, and the points A2 to An may be sightseeing spots of the zoo or spots set between the sightseeing spots. . . , 400-n may be simply referred to as the face authentication terminal 400 hereinafter when the face authentication terminals 400-1, 400-2, . . . Also, the store terminal 600 is a face authentication terminal installed in a store at the event site or a store in the area where the event site is set up.

User U registers for participation at point A1 and registers his/her face information. Participation registration and face information registration may be performed at any face authentication terminal 400 or user terminal 500 that the user U desires. The user U performs face authentication using the face authentication terminal 400 at any point A1 to An, and participates in the presented mission if the face authentication is successful. Further, when the mission is completed, the user U uses the face authentication terminal 400 at any point A1 to An, for example, the face authentication terminal 400 near the mission completion or the face authentication terminal 400 used at the start of the mission, to perform face authentication. I do. If the facial recognition is successful, the presented mission will be completed. A score is added to the user U when the mission completion process is performed. User U then participates in the next presented mission. When the user U completes all the missions and ends the mission experience, the user U is given a privilege according to the score. Giving a privilege may mean giving an amount of points according to the accumulated score. A point is a point that can be used at a store, and may be, for example, a point that can be exchanged for merchandise or that can be applied to payment. For example, the user U receives a privilege at a store at the event site or a store in the area. That is, the user U uses points at the store.

Here, the authentication device 100 is an information processing device that stores facial feature information of a plurality of persons. In addition, in response to a face authentication request received from the outside, the authentication device 100 compares the face image or face feature information included in the request with the face feature information of each user, and requests the matching result (authentication result). Reply to original.

FIG. 4 is a block diagram showing the configuration of the authentication device 100 according to the second embodiment. The authentication device 100 includes a face information DB (DataBase) 110 , a face detection section 120 , a feature point extraction section 130 , a registration section 140 and an authentication section 150 . The face information DB 110 associates and stores a user ID 111 and face feature information 112 of the user ID. The facial feature information 112 is a set of feature points extracted from the facial image. Note that the authentication device 100 may delete the facial feature information 112 in the facial feature DB 110 at the request of the registered user of the facial feature information 112 . Alternatively, the authentication device 100 may delete the facial feature information 112 after a certain period of time has passed since it was registered.

The face detection unit 120 detects a face area included in a registration image for registering face information and outputs it to the feature point extraction unit 130 . Feature point extraction section 130 extracts feature points from the face area detected by face detection section 120 and outputs facial feature information to registration section 140 . Further, feature point extraction section 130 extracts feature points included in the facial image received from information processing apparatus 200 and outputs facial feature information to authentication section 150 .

The registration unit 140 newly issues a user ID 111 when registering facial feature information. The registration unit 140 associates the issued user ID 111 with the facial feature information 112 extracted from the registered image and registers them in the facial information DB 110 . The authentication unit 150 performs face authentication using the facial feature information 112 . Specifically, the authentication unit 150 collates the facial feature information extracted from the facial image with the facial feature information 112 in the facial information DB 110 . The authentication unit 150 replies to the information processing apparatus 200 whether or not the facial feature information matches. Whether the facial feature information matches or not corresponds to the success or failure of the authentication. Note that matching of facial feature information (matching) means a case where the degree of matching is equal to or greater than a predetermined value.

FIG. 5 is a flowchart showing the flow of face information registration processing according to the second embodiment. First, the authentication device 100 acquires the registration image included in the face information registration request (S21). For example, the authentication device 100 receives a face information registration request from the face authentication terminal 400, the user terminal 500, or the like via the network N. FIG. The face information registration request source is not limited to this, and may be the information processing apparatus 200 that receives the participation registration request from the face authentication terminal 400 or the user terminal 500 . Next, face detection section 120 detects a face area included in the registered image (S22). Next, the feature point extraction unit 130 extracts feature points from the face area detected in step S22, and outputs face feature information to the registration unit 140 (S23). Finally, the registration unit 140 issues the user ID 111, associates the user ID 111 with the facial feature information 112, and registers them in the facial information DB 110 (S24). Note that the authentication device 100 may receive the facial characteristic information 112 from the face information registration requester, associate it with the user ID 111 , and register it in the facial information DB 110 .

FIG. 6 is a flow chart showing the flow of face authentication processing by the authentication device 100 according to the second embodiment. First, the feature point extraction unit 130 acquires facial feature information for authentication (S31). For example, the authentication device 100 receives a face authentication request from the information processing device 200 via the network N, and extracts facial feature information from the face image included in the face authentication request in steps S21 to S23. Alternatively, authentication device 100 may receive facial feature information from information processing device 200 . Next, the authentication unit 150 collates the acquired facial feature information with the facial feature information 112 of the facial information DB 110 (S32). If the facial feature information matches, that is, if the degree of matching of the facial feature information is equal to or greater than a predetermined value (Yes in S33), the authentication unit 150 specifies the user ID 111 of the user whose facial feature information matches (S34). , the fact that the face authentication was successful and the specified user ID 111 are returned to the information processing apparatus 200 (S35). If there is no matching facial feature information (No in S33), the authentication unit 150 returns to the information processing apparatus 200 that the face authentication has failed (S36).

It should be noted that in step S32, the authentication unit 150 does not need to attempt matching with all the facial feature information 112 in the facial information DB 110. For example, the authentication unit 150 may preferentially attempt matching with facial feature information registered during the period from the day the face authentication request is received until several days before. This can improve matching speed. Also, if the preferential collation fails, it is preferable to collate with all the remaining facial feature information.

Return to Figure 3 and continue the explanation. Each of the face authentication terminals 400-1, 400-2, . . . 400-n is an information terminal including a camera and a display device.

The face authentication terminal 400 transmits a participation registration request for user U's mission experience to the information processing device 200 via the network N. The face authentication terminal 400 also captures a registration image used for face authentication of the user U at the time of participation registration. The face authentication terminal 400 transmits a face information registration request including the registered image to the authentication device 100 via the network N. FIG. The face authentication terminal 400 may transmit a face information registration request including the registered image to the authentication device 100 via the information processing device 200 . Note that the user U may use the user terminal 500 to perform participation registration and face information registration.

The face authentication terminal 400 captures a face image for authentication used for user U's face authentication. For example, the face authentication terminal 400 uses captured images of the user U at each installation location as images for authentication. The face authentication terminal 400 transmits a face authentication request including an image for authentication to the information processing device 200 via the network N. FIG. At this time, the face authentication terminal 400 may include in the face authentication request a location ID that identifies the location where the face authentication terminal 400 is installed. Moreover, the face authentication terminal 400 may include the shooting time in the face authentication request. Also, the face authentication terminal 400 receives the face authentication result from the information processing device 200 via the network N, and displays it on the screen as necessary. Here, the face authentication terminal 400 can transmit a mission start request and a mission completion request to the information processing apparatus 200 together with the face authentication request. The face authentication terminal 400 transmits a mission start request to the information processing device 200, and when the face authentication is successful, receives the content information of the mission selected corresponding to the user ID from the information processing device 200, and displays a screen. to display. Further, the face authentication terminal 400 transmits a mission completion request to the information processing apparatus 200, and if the face authentication is successful, a continuation permission/prohibition information input screen indicating whether or not to request the start (continuation) of participation in the next mission. display.

Next, the face authentication terminal 400 will be explained in detail. FIG. 7 is a block diagram showing the configuration of the face authentication terminal 400 according to the second embodiment. The face authentication terminal 400 includes a camera 410 , a storage section 420 , a communication section 430 , a display section 440 , a control section 450 and an input section 460 .

The camera 410 is a photographing device that takes pictures under the control of the control unit 450 . Storage unit 420 is a storage device that stores a program for realizing each function of face authentication terminal 400 . A communication unit 430 is a communication interface with the network N. FIG. Display unit 440 is a display device. The input unit 460 is an input device that receives an input from the user U. The display unit 440 and the input unit 460 may be configured integrally. As an example, the display unit 440 and the input unit 460 are touch panels. The control unit 450 controls hardware included in the face authentication terminal 400 . The control unit 450 includes an imaging control unit 451 , a registration unit 452 , an authentication control unit 453 and a display control unit 454 . Note that the authentication control unit 453 is not essential in the face authentication terminal 400-1 installed at the point A1. Also, the registration unit 452 is not essential in the face authentication terminals 400-2 to 400-n installed from the point A2 to An.

The imaging control unit 451 controls the camera 410 to capture the user U's registration image or authentication image. The registered image and the authentication image are images including at least the user's face area. Note that the photographed image (authentication image) at the point A1 or the like may include a landscape or the like unique to the point in the background. The imaging control section 451 outputs the registration image to the registration section 452 . The imaging control unit 451 also outputs the authentication image to the authentication control unit 453 .

The registration unit 452 transmits a face information registration request including the registration image to the authentication device 100 via the network N. Note that the registration unit 452 may transmit the face information registration request to the information processing apparatus 200 via the network N. FIG. Further, the registration unit 452 transmits a participation registration request to the information processing apparatus 200 via the network N. FIG. Note that the registration unit 452 may transmit the user attribute information received by the input unit 460 to the information processing apparatus 200 via the network N at the time of participation registration. The user attribute information may be included in the participation registration request. Authentication control unit 453 transmits a face authentication request including an authentication image to information processing apparatus 200 via network N, and receives a face authentication result. Also, the authentication control unit 453 transmits the above-described start request to the information processing apparatus 200 via the network N, and receives the content information of the mission. The authentication control unit 453 then outputs the received information to the display control unit 454 . Also, the authentication control unit 453 transmits a completion request to the information processing apparatus 200 via the network N. FIG. At this time, the authentication control unit 453 outputs, to the display control unit 454, an input screen for information indicating whether or not the user U desires to start the next mission, and prompts the user U to input. The authentication control unit 453 transmits the continuation permission/prohibition information to the information processing apparatus 200 in response to receiving the continuation permission/prohibition information from the user U.

The display control unit 454 displays the display content according to the face authentication result on the display unit 440. In addition, the display control unit 454 displays an input screen for mission content information and continuation permission/prohibition information on the display unit 440 .

Return to Figure 3 and continue the explanation. The store terminal 600 basically has the same configuration and functions as the face authentication terminal 400, but differs in that it functions as a payment device that performs electronic payment using face authentication. The store terminal 600 performs electronic payment and transmits the payment history to the information processing apparatus 200 via the network N when the face authentication is successful. Note that the store terminal 600 may omit the process of transmitting the start request, the completion request, and the continuation permission/prohibition information to the information processing apparatus 200 and various displays such as mission content information.

The store terminal 600 includes a payment unit (not shown) in addition to the configuration of the face authentication terminal 400. The payment unit performs electronic payment using a predetermined electronic payment means, and transmits a payment registration request including payment information to the information processing apparatus 200 via the network N when the face authentication result indicates that the face authentication is successful. Note that the registration unit 452 is not essential in the shop terminal 600 .

Return to Figure 3 and continue the explanation. A user terminal 500 is an information terminal owned by a user U. FIG. The user terminal 500 is, for example, a mobile phone terminal, a smart phone, a tablet terminal, a PC (Personal Computer) equipped with or connected to a camera, or the like. The user terminal 500 is associated with the user U's user ID or facial feature information. In other words, the user terminal 500 is a display terminal that can be specified by the user ID or facial feature information in the information processing apparatus 200 . For example, the user terminal 500 is a terminal logged in by the user U with his own user ID.

The user terminal 500 transmits a participation registration request for user U's mission experience to the information processing device 200 via the network N. Also, the user terminal 500 transmits a registration image used for face authentication of the user U to the authentication device 100, and makes a face information registration request. Note that the user terminal 500 may transmit the facial feature information extracted from the registered image to the authentication device 100 to make a facial information registration request. The user terminal 500 may transmit the registered image and facial feature information to the authentication device 100 via the information processing device 200 .

Next, the user terminal 500 will be described in detail. FIG. 8 is a block diagram showing the configuration of the user terminal 500 according to the second embodiment. User terminal 500 includes camera 510 , storage unit 520 , communication unit 530 , display unit 540 , control unit 550 , and input unit 560 .

The camera 510 is an image capturing device that performs image capturing under the control of the control unit 550 . The storage unit 520 is a storage device in which programs for realizing each function of the user terminal 500 are stored. A communication unit 530 is a communication interface with the network N. FIG. Display unit 540 is a display device. Input unit 560 is an input device that receives an input. The display unit 540 and the input unit 560 may be configured integrally. As an example, the display unit 540 and the input unit 560 are touch panels. The control unit 550 controls hardware of the user terminal 500 . The control unit 550 includes an imaging control unit 551 , a registration unit 552 , an acquisition unit 553 and a display control unit 554 .

The photographing control unit 551 controls the camera 510 to photograph a registered image of the user U. The imaging control section 551 outputs the registration image to the registration section 552 .

The registration unit 552 transmits a face information registration request including the registered image to the authentication device 100 via the network N. Note that the registration unit 552 may transmit the face information registration request to the information processing apparatus 200 via the network N. FIG. Further, the registration unit 552 transmits a participation registration request to the information processing apparatus 200 via the network N. FIG. Note that the registration unit 552 may transmit the user attribute information received by the input unit 560 to the information processing apparatus 200 via the network N at the time of registration for participation. The user attribute information may be included in the participation registration request. The acquisition unit 553 acquires various types of information via the network N and outputs the acquired information to the display control unit 554 . The display control section 554 displays the output information on the display section 540 . Note that the display unit 540, the acquisition unit 553, and the display control unit 554 are not essential in the second embodiment.

Return to Figure 3 and continue the explanation. The information processing apparatus 200 is an information processing apparatus that presents the content information of a mission to the user U or executes a process according to the completion of the mission when the user U succeeds in face authentication at the point A1 or the like. The information processing apparatus 200 may be made redundant by a plurality of servers, and each functional block may be realized by a plurality of computers.

Next, the information processing device 200 will be described in detail. FIG. 9 is a block diagram showing the configuration of an information processing apparatus 200 according to the second embodiment. Information processing apparatus 200 includes storage unit 210 , memory 220 , communication unit 230 , and control unit 240 . The storage unit 210 is a storage device such as a hard disk or flash memory. Storage unit 210 stores program 211 , user information 212 , mission history information 213 , mission information 214 , and payment history information 215 . The program 211 is a computer program in which the processing of the information processing method according to the second embodiment is implemented.

The user information 212 is basic information related to the user. That is, the user information 212 is user attribute information and the like. Specifically, the user information 212 is information in which a user ID 2121 and user attribute information 2122 are associated with each other. In the second embodiment, the user information 212 is also information in which a user ID 2121 is associated with a score 2123 and points 2124 . The user ID 2121 is information for identifying the user U, and is a user ID notified when face information is registered in the authentication device 100 . The user attribute information 2122 indicates the attribute information of the user U, and corresponds to the "subject's attribute information" according to the first embodiment. The score 2123 indicates the accumulated score obtained by the user U by completing the missions described above. The points 2124 are points that can be used at the store, as described above.

The mission history information 213 is the action history related to the mission of the user U who used the face authentication terminal 400 at each location. Specifically, the mission history information 213 is information in which a user ID 2131, mission group ID 2132, mission ID 2133, and completion status information 2134 are associated with each other. The user ID 2131 is a user ID included in the result of face authentication when face authentication executed in response to a mission start request or mission completion request is successful. A mission group ID 2132 is information for identifying a mission group. The mission ID 2133 is information identifying a mission. The mission ID 2133 indicates the mission ID of one mission in which the user U participates, among the missions included in the mission group having the mission group ID 2132 . For example, the mission ID 2133 indicates the mission ID of one mission selected by the user U among the mission groups.

FIG. 10 is a diagram showing an example of the data structure of the mission history information 213 according to the second embodiment. In this figure, the completion status information 2134 includes the start and completion times of the mission and location information of the user U when the mission was completed. The location information of the user U when the mission is completed indicates the point information of the face authentication terminal 400 that requested the completion. When the user U starts participating in the mission, the mission ID and the start time of the mission are recorded. Further, when the user U completes the mission, the time when the mission was completed and the location information of the user U at the time of completion of the mission are recorded in the user U record. The completion status information 2134 may include the degree of achievement of the user U's mission.

Here, the mission history information 213 shown in this figure includes evaluation information. The evaluation information is information indicating the user U's evaluation of the completed mission. When the user U completes the mission of the mission ID in the record, data is recorded in the evaluation information in the record.

Returning to FIG. 9, the description is continued. The mission information 214 is information that associates a mission, information related to the mission, and the mission group to which the mission belongs. Specifically, the mission information 214 associates a mission group ID 2141, a mission ID 2142, and mission attribute information 2143 with each other.
The mission group ID 2141 is information identifying the mission group to which the mission of the mission ID 2142 belongs. Mission attribute information 2143 is attribute information of a mission having mission ID 2142 . Mission attribute information 2143 includes content information indicating the content of the mission. In addition to the content information, the mission attribute information 2143 may include information on the starting point of the mission, the estimated time required to complete the mission, and the type of content of the mission.

The payment history information 215 is information indicating the payment history of the user U at the store. Specifically, the payment history information 215 associates a user ID 2151, a shop ID 2152, payment information 2153, and a date and time 2154 with each other. The user ID 2151 is a user ID that is included in the result of face authentication when the face authentication executed when requesting payment registration is successful. The store ID 2152 is the store ID of the store corresponding to the store terminal 600 that requested payment registration. The payment information 2153 is a history of payments made by the user U through face authentication using the store terminal 600 . The payment information 2153 includes, for example, the payment amount, the product, and the like. The date and time 2154 is the date and time when face authentication was performed at the time of payment.

The memory 220 is a volatile storage device such as RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 240 operates. The communication unit 230 is a communication interface with the network N. FIG.

The control unit 240 is a processor that controls each component of the information processing device 200, that is, a control device. The control unit 240 loads the program 211 from the storage unit 210 into the memory 220 and executes the program 211 . Thereby, the control unit 240 realizes the functions of the registration unit 241 , the determination unit 242 , the authentication control unit 243 , the start processing unit 244 and the completion processing unit 245 .

The registration unit 241 is an example of the registration unit 11 described above. The registration unit 241 registers the user ID 2121 and the user attribute information 2122 in the storage unit 210 when the face information of the user U is registered by the authentication device 100 at the time of participation registration and the user ID is notified. Thereby, the attribute information of the user U is associated with the facial feature information 112 stored in the authentication device 100 via the user ID.

Here, the user attribute information 2122 may be information that the information processing apparatus 200 receives via the network N the input data that the user U has input to the face authentication terminal 400 or the user terminal 500 .

Also, the user attribute information 2122 may be information generated by the registration unit 241 based on input data from the user U. For example, when the input data from the user U includes the schedule information of the user U, the registration unit 241 estimates the desired end time of the mission experience from the schedule information, and sets the user attribute information 2122 including the estimated desired end time. may be registered in the storage unit 210 . The schedule information may indicate flight times and itineraries. Note that the registration unit 241 may acquire schedule information from the schedule application of the user terminal 500 instead of the input data from the user U. This saves the user U the trouble of inputting.

Also, the user attribute information 2122 may be information generated by the registration unit 241 based on a captured image of the user U. The captured image may be a captured image captured for face authentication or face registration. For example, the registration unit 241 may estimate the age and gender of the user U from the captured image, and generate the user attribute information 2122 based on the estimated information. Further, for example, when a companion is detected together with the user U from the photographed image, the registration unit 241 may generate companion information and include it in the user attribute information 2122 . Specifically, the registration unit 241 may determine that the user U has a companion when a plurality of person areas are detected from the captured image. Here, whether or not the person area other than the image area of the user U is the image area of the companion of the user U is determined from the distance between the image area of the user U and other person areas and the size of both. you can However, not limited to this, the registration unit 241 can use an existing method. Further, the registration unit 241 may estimate the relationship (group attribute) between the user U and the companions from the captured image, and generate companion information including the group attribute. Note that when estimating various types of attribute information of the user U from the photographed image, the subject to be estimated is not limited to the registration unit 241 and may be the authentication device 100 . In this case, the registration unit 241 receives the attribute information of the user U together with the user ID from the authentication device 100 . In this way, by acquiring the attribute information of the user U from the captured image, it is possible to save the effort of the user U to input.

In addition, the registration unit 241 registers the action history in the mission in the storage unit 210 as the mission history information 213 when the face authentication at each point is successful. Further, the registration unit 241 registers the payment history in the storage unit 210 as the payment history information 215 when face authentication at the store is successful. When using points at the time of settlement, the registration unit 241 updates the points 2124 of the user information 212 .

The determination unit 242 is an example of the determination unit 12 described above. The determination unit 242 determines a mission group for each user U based on the user attribute information 2122 . For example, the determination unit 242 estimates the intelligence/physical level (ability level) from the age of the user U, and selects a mission group including missions that match the ability level. Further, when the user U is a child accompanied by an adult, the determination unit 242 selects a mission group including a mission requiring a higher ability level than when the user U is not accompanied by an adult. Further, when the time from the current time to the desired end time is short, the determination unit 242 selects a mission group including missions with a short required time.

The determining unit 242 may determine the mission group based on the location information of the face authentication terminal 400 that requested the start, in addition to the user attribute information 2122 . The determining unit 242 then registers the determined mission group ID in the storage unit 210 as the mission group ID 2132 of the mission history information 213 . Also, the determination unit 242 changes the mission group of the user U based on the user U's mission history information 213 . Specifically, the determination unit 242 determines based on at least one of the user U's mission completion status, user U's location information at the time of mission completion, user U's evaluation information, and user U's mission selection history, Change user U's mission group. When based on the completion status of the mission, the determination unit 242 determines the ability level of the user U from the time required to complete the mission of the user U and the degree of achievement, and selects an appropriate mission group according to the ability level of the user U. can be selected. The determination unit 242 can also select an appropriate mission group according to the user U's schedule based on the completion time and the desired end time included in the user attribute information 2122 of the user information 212 . Further, the determining unit 242 determines, based on the position information of the user U at the time of mission completion, that a mission group including a mission that can be participated in at a location close to the position information at the time of completion is the mission group to be presented next. becomes possible. As a result, it is possible to facilitate the holding of the mission. When based on user U's evaluation information and mission selection history, the determining unit 242 can estimate the tendency of user U's tastes and interests, and select an appropriate mission group according to the tastes and interests. Note that the determination unit 242 may change the mission group when the user U completes the mission and the mission history information 213 is updated, or when the first start process is performed after the update.

Also, the determination unit 242 may determine the mission group of the user U based on the congestion status of the event site or the work status of the staff at the event site. For example, the determination unit 242 sets missions held near locations that are congested or expected to be congested, and missions that are held near locations where staff work is excessive, as non-target missions. . Then, the determination unit 242 may select a mission group that does not include the non-target missions for the user U, or may exclude the non-target missions from the user U's mission group. As a result, event management can be facilitated.

The authentication control unit 243 is an example of the authentication control unit 13 described above. The authentication control unit 243 controls face authentication for the face area of the user U included in the captured image. That is, the authentication control unit 243 controls face authentication for the face area of the user U included in each photographed image photographed at each location or store. That is, the authentication control unit 243 causes the authentication device 100 to perform face authentication on the photographed image acquired from the face authentication terminal 400 or the shop terminal 600 . For example, the authentication control unit 243 transmits a face authentication request including the acquired photographed image to the authentication device 100 via the network N, and receives the face authentication result from the authentication device 100 . Note that the authentication control unit 243 may detect the face area of the user U from the captured image and include the image of the face area in the face authentication request. Also, the authentication control unit 243 may extract facial feature information from the face area and include the facial feature information in the face authentication request. The authentication control unit 243 then supplies the face authentication result to the start processing unit 244 or the completion processing unit 245 .

The start processing unit 244 is an example of the start processing unit 14 described above. The start processing unit 244 refers to the mission history information 213 and specifies the mission group ID 2132 corresponding to the user U when face authentication is successful and a start request is received from the face authentication terminal 400 that provides the captured image. Subsequently, the start processing unit 244 refers to the mission information 214 and acquires the mission attribute information 2143 of the missions included in the mission group with the mission group ID 2132 . Subsequently, the start processing unit 244 outputs the content information included in the acquired mission attribute information 2143 to the face authentication terminal 400 that made the request. At this time, if the mission group includes a plurality of missions, the start processing unit 244 causes the face authentication terminal 400 to output the content information of the plurality of missions so that the user U can select one mission from the plurality of missions. good. The start processing unit 244 acquires the mission ID of the mission selected by the user U from the face authentication terminal 400 and records the mission ID in the storage unit 210 as the mission ID 2133 of the mission history information 213 . At this time, the start processing unit 244 may record the time when the mission ID is received in the storage unit 210 as the start time of the completion status information 2134 . By enabling the user U to select a mission of interest in this way, the information processing apparatus 200 can provide the user U with a mission that matches his/her intention and ability.

The completion processing unit 245 is an example of the completion processing unit 15 described above. When the completion processing unit 245 has successfully performed face authentication and received a completion request from the face authentication terminal 400 that provides the captured image, the completion processing unit 245 executes processing according to mission completion. In the processing according to the completion of the mission, the time when the face authentication result is received or the shooting time is set as the completion time of the completion status information 2134, and the location information of the face authentication terminal 400 that is the requesting source is set as the location information of the user U at the time of completion. 210 includes processing for recording. The processing according to mission completion includes processing for adding a predetermined amount to the score 2123 of the user information 212 . Then, the completion processing unit 245 determines whether or not to perform the start processing of the next mission according to the addition of the user U's score 2123 . The completion processing unit 245 determines to perform the next mission start processing when the continuation permission/prohibition information received from the requesting face authentication terminal 400 indicates a continuation request. The completion processing unit 245 provides the user U with a privilege according to the score when not performing the start processing. Specifically, when the start processing is not performed, the completion processing unit 245 adds the points 2124 of the user information 212 by the amount corresponding to the score 2123 and makes it usable.

FIG. 11 is a flowchart showing the flow of participation registration processing according to the second embodiment. First, the registration unit 241 receives a participation registration request via the network N (S401). Here, the request source is assumed to be the face authentication terminal 400 or the user terminal 500 . It should be noted that, at this time, the registration unit 241 requests the authentication device 100 via the network N to register the face information in the face information DB 110 when the photographed image is received in addition to the participation registration request.

Then, the registration unit 241 acquires the user ID from the authentication device 100 via the network N (S402). Then, the registration unit 241 acquires the attribute information of the user U via the network N from the face authentication terminal 400 or the user terminal 500 that made the request (S403). As described above, instead of this, the registration unit 241 may generate attribute information of the user U based on the input data of the user U or the captured image. Then, the registration unit 241 registers the attribute information of the user U as the user attribute information 2122 of the user information 212 in association with the user ID 2121 (S404). Then, the registration unit 241 terminates the processing.

FIG. 12 is a flowchart showing the flow of start processing according to the second embodiment. First, the authentication control unit 243 acquires a captured image from the face authentication terminal 400 via the network N, and the start processing unit 244 acquires a start request from the face authentication terminal 400 via the network N (S411). Here, the captured image provider and the start requester are the same face authentication terminal, which is one of the face authentication terminals 400-1 to 400-n.

Next, the authentication control unit 243 transmits a face authentication request to the authentication device 100 via the network N (S412). At this time, the authentication control unit 243 includes at least one of the photographed image acquired in step S411, the face area extracted from the photographed image, or the facial feature information extracted from the face area in the face authentication request. Then, the authentication control unit 243 receives the face authentication result from the authentication device 100 via the network N (S413). The face authentication result includes the fact and the user ID when the face authentication is successful, and includes the fact when the face authentication is unsuccessful.

The authentication control unit 243 determines whether or not face authentication has succeeded (S414). When it is determined that the face authentication has failed (No in S414), the authentication control unit 243 outputs that the face authentication has failed (S415). Specifically, the authentication control unit 243 transmits a message to the face authentication terminal 400 that provides the image via the network N to the effect that the face authentication has failed. The authentication control unit 243 then terminates the process.

On the other hand, if it is determined that face authentication has succeeded (Yes in S414), the authentication control unit 243 identifies the user ID for which face authentication has succeeded (S416). Specifically, the authentication control unit 243 extracts the user ID included in the face authentication result. At this time, the authentication control unit 243 may output that the face authentication is successful. Specifically, the authentication control unit 243 may transmit a message to the requesting face authentication terminal 400 via the network N to the effect that the face authentication has succeeded.

Next, the start processing unit 244 identifies the mission group corresponding to the identified user ID (S417). Specifically, the start processing unit 244 acquires the mission group ID corresponding to the identified user ID from the mission history information 213 . If the mission group ID corresponding to the user ID is not recorded in the mission history information 213 here, the determination unit 242 may determine the mission group and record the mission group ID in the mission history information 213 .

Next, the start processing unit 244 outputs the content information of the missions included in the mission group to the requesting face authentication terminal 400 (S418). Specifically, first, the start processing unit 244 refers to the mission information 214 and identifies one or more mission IDs corresponding to the mission group ID. The start processing unit 244 then acquires content information corresponding to each mission ID from the mission information 214 . Then, the start processing unit 244 transmits one or a plurality of pieces of content information to the requesting face authentication terminal 400 via the network N for display. When the face authentication terminal 400 that is the source of the request is to display a plurality of pieces of content information, the start processing unit 244 allows the user U to select the pieces of content information.

Next, the start processing unit 244 receives a mission selection from the user U from the requesting face authentication terminal 400 (S419). Specifically, the start processing unit 244 receives the mission ID of the mission selected by the user U from the face authentication terminal 400 that is the source of the request.

Next, the start processing unit 244 registers the mission ID of the selected mission in the mission history information 213 (S420). At this time, the start processing unit 244 may register the start time in the mission history information 213 . Then, the start processing unit 244 ends the processing.

FIG. 13 is a flowchart showing the flow of completion processing according to the second embodiment. First, the authentication control unit 243 acquires a photographed image from the face authentication terminal 400 through the network N, and the completion processing unit 245 acquires a completion request from the face authentication terminal 400 through the network N (S430). Here, the captured image provider and the completion requester are the same face authentication terminal, which is one of the face authentication terminals 400-1 to 400-n. The authentication control unit 243 then executes the processes shown in steps S412 to S416.

Next, when the completion processing unit 245 succeeds in face authentication and identifies the user ID (S416), it updates the record corresponding to the user ID in the mission history information 213 (S431). Specifically, the completion processing unit 245 may register completion status information (completion time and position information at the time of completion) in the record corresponding to the user ID in the mission history information 213 . Further, when the completion processing unit 245 acquires the evaluation information of the user U, the completion processing unit 245 may register the evaluation information in the record corresponding to the user ID in the mission history information 213 . Note that the evaluation information may be the evaluation information input by the user U and received by the information processing apparatus 200 from the face authentication terminal 400 via the network N, or the captured image acquired by the information processing apparatus 200 in step S430. may be evaluation information generated based on. When the evaluation information is generated from the captured image, the completion processing unit 245 may estimate the smile level of the user U from the captured image and use the estimated smile level as the evaluation information. It should be noted that the degree of smile may be estimated by the authentication device 100 instead of the completion processing unit 245 . In this case, the authentication control unit 243 may receive the smile level as well as the face authentication result from the authentication device 100 in step S413.

Next, the completion processing unit 245 adds a predetermined amount to the score corresponding to the user ID in the user information 212 (S432). At this time, the completion processing unit 245 may determine the addition amount according to the difficulty level of the completed mission and the achievement level of the mission.

Next, the completion processing unit 245 determines whether or not to carry out the next start process (S433). Specifically, when the continuation availability information received from the requesting face authentication terminal 400 indicates a continuation request, the completion processing unit 245 determines to perform the next mission start processing. That is, a continuation request means a start request. If the completion processing unit 245 performs the next start processing (Yes in S433), the processing proceeds to step S411 or 417 in FIG. On the other hand, if the completion processing unit 245 does not perform the next start process (No in S433), the completion processing unit 245 gives the user U a privilege corresponding to the score (S434). Specifically, the completion processing unit 245 adds a predetermined amount of points of the user U in the user information 212 . The completion processing unit 245 then terminates the processing.

FIG. 14 is a flowchart showing the flow of payment registration processing according to the second embodiment. First, the authentication control unit 243 acquires a captured image from the shop terminal 600 via the network N (S441). The authentication control unit 243 then executes the processes shown in steps S412 to S416.

Next, when the registration unit 241 succeeds in face authentication and identifies the user ID (S416), it acquires a payment registration request including payment information from the shop terminal 600 (S442). Next, the registration unit 241 registers the acquired payment information in the payment history information 215 in association with the user ID (S443). At this time, the registration unit 241 may also register in the payment history information 215 the shop ID of the shop involved in the payment and the date and time. Next, the registration unit 241 processes the points of the user U (S444). For example, if the payment is made using points, the registration unit 241 may subtract the points corresponding to the user ID in the user information 212 by the amount used. Further, the registration unit 241 may add points corresponding to the user ID of the user information 212 according to the price. Then, the registration unit 241 terminates the processing.

15, 16, 17 and 18 are sequence diagrams showing an example of the flow of participation registration processing, start processing, completion processing and payment registration processing of the information processing apparatus 200 according to the second embodiment, respectively.

First, at point A1, the face authentication terminal 400-1 transmits a participation registration request to the information processing device 200 (S500). Further, the face authentication terminal 400-1 photographs the user U (S501), and transmits a face information registration request including the photographed image to the authentication device 100 via the network N (S502). Then, the authentication device 100 registers face information (face feature information) of the user U based on the captured image included in the received face information registration request (S503). The authentication device 100 then notifies the information processing device 200 of the user ID via the network N (S504). The face authentication terminal 400-1 also transmits the attribute information of the user U to the information processing apparatus 200 via the network N (S505). The information processing apparatus 200 associates the notified user ID with the attribute information of the user U and registers them in the user information 212 (S506).

Next, we move on to the explanation of FIG. At the point A1, the face authentication terminal 400-1 takes an image of the user U whose participation registration has been completed (S510), and transmits a start request and the taken image to the information processing apparatus 200 via the network N (S511). The information processing apparatus 200 transmits a face authentication request for the face area of the user U in the captured image included in the received face authentication request to the authentication apparatus 100 via the network N (S512). Then, the authentication device 100 performs face authentication on the face area of the user U in the captured image included in the received face authentication request (S513). Here, it is assumed that face authentication has succeeded. The authentication device 100 transmits the face authentication result including the fact that the face authentication was successful and the user ID to the information processing device 200 via the network N (S514).

Here, the information processing apparatus 200 determines a mission group corresponding to the user U whose face authentication has succeeded, based on the attribute information of the user U and the position information of the point A1 (S515). The information processing device 200 then transmits the mission IDs and content information of the plurality of missions included in the determined mission group to the face authentication terminal 400-1 via the network N (S516). As a result, the face authentication terminal 400-1 displays mission IDs and content information of a plurality of missions (S517). Face authentication terminal 400-1 then receives a mission selection operation from user U (S518). The face authentication terminal 400-1 transmits the mission ID of the selected mission to the information processing device 200 (S519). The information processing device 200 that has received the mission ID registers the mission history information 213 (S520). The face authentication terminal 400-1 may cause the display unit 440 to display the selected start point of the mission and the current location. Further, face authentication terminal 400-1 may cause display unit 440 to display route information from the current location to the selected mission start point. Then, the user U starts participating in the mission and moves from the point A1 to the point A2.

It should be noted that if the same face authentication terminal 400 issues a participation registration request and a start request consecutively, the processing shown in steps S510 to S514 may be omitted. In this case, the information processing apparatus 200 uses the user ID notified at the time of registration for participation to execute the processes after step S515.

Next, we move on to the explanation of FIG. Assume that the user U has completed the mission at the point A2. At the point A2, the face authentication terminal 400-2 captures an image of the user U (S522), and transmits a completion request and the captured image to the information processing apparatus 200 via the network N (S523). Then, steps S524 to S526, which are similar to steps S512 to S514, are executed. On the other hand, the face authentication terminal 400-2 accepts an operation of inputting evaluation information from the user U whose face has been successfully authenticated (S527). Face authentication terminal 400-2 then transmits the evaluation information to information processing apparatus 200 via network N (S528). The information processing device 200 that has acquired the user ID and the evaluation information updates the record corresponding to the user ID in the mission history information 213 (S529). The information processing apparatus 200 then adds a predetermined amount to the score corresponding to the user ID of the user information 212 (S530).

Here, the face authentication terminal 400-2 accepts an input operation of continuation permission/prohibition information from the user U (S531). In this example, it is assumed that the continuation permission/prohibition information input by the user U indicates a continuation request. The face authentication terminal 400-2 transmits a continuation request, that is, a request to start the next mission to the information processing device 200 via the network N (S532). Then, processing similar to steps S515 to S520 in FIG. 16 is executed, and the user U starts participating in the next mission.

In this case, in step S515, the information processing apparatus 200 changes the mission group based on the completion status of the mission, position information of the user U at the time of completion, evaluation information, mission selection history, congestion status, and the like.

In this example, when the user U completed the mission and requested to continue, the start process was performed, and the next mission was started. In other words, in response to receiving the continuation request (step S532), the information processing apparatus 200 executes the next mission start process to start the next mission. However, instead of this, the next mission may be started when the user U completes the mission, moves to the start point of the next mission, and checks in by face authentication. For example, after receiving the continuation request, the information processing apparatus 200 does not need to execute the next mission start process until it receives a start request again from the user U via the face authentication terminal 400 . In this case, the information processing apparatus 200 may execute the next mission start process when receiving the start request and the captured image from the face authentication terminal 400 installed near the next mission start point. Further, in response to receiving the continuation request, the information processing apparatus 200 outputs the contents of the next mission to the face authentication terminal 400 that requested the continuation so that the user U can confirm the contents of the next mission. good too. Specifically, after the information processing apparatus 200 receives the continuation request, the processes shown in steps S515 to S517 may be executed. At this time, the face authentication terminal 400 that requested the continuation may accept the reservation for the next mission from the user U and notify the information processing apparatus 200 of the reservation content. Specifically, after executing step S517, the processes shown in steps S518 to S520 may be executed. Then, when the information processing apparatus 200 receives a photographed image of the reserved user U and a start request from one of the face authentication terminals 400, the information processing apparatus 200 records the start time of the mission history information 213, and the next mission is started. good. As described above, the series of processes in which the next mission is started when the next mission is checked in after moving to the start point of the next mission is performed when the face authentication terminal 400 that is the continuation requester is installed at the guide location. It may be limited to the case where the face authentication terminal 400 is the face authentication terminal 400 that has been The face authentication terminal 400 installed at the guidance location is, for example, the face authentication terminal 400-1 at the point A1.

Next, we move on to the description of FIG. Assume that the user U has completed the mission at the point A2. Then, processing similar to steps S522 to S530 in FIG. 17 is executed. At point A2, face authentication terminal 400-2 accepts an input operation of continuation permission/prohibition information from user U (S540). In this example, it is assumed that the continuation permission/prohibition information input by the user U indicates a non-continuation request. The face authentication terminal 400-2 transmits a non-continuation request, that is, a request not to start the next mission to the information processing device 200 via the network N (S541). The information processing apparatus 200 that has received the non-continuation request converts the score corresponding to the user ID of the user information 212 into points and makes them available (S542).

Then, the user U moves from the point A2 to the store. At the store, the store terminal 600 captures an image of the user U (S543), and transmits the captured image to the information processing device 200 via the network N (S544). Then, steps S545 to S547, which are the same processes as steps S512 to S514, are executed. Here, it is assumed that face authentication has succeeded. The information processing apparatus 200 that has received the face authentication result transmits the face authentication result including the effect that the face authentication was successful and the user ID to the shop terminal 600 via the network N (S548). The store terminal 600 then executes the settlement process (S549). The store terminal 600 transmits a payment history registration request to the information processing device 200 via the network N (S550). The payment history registration request may include user ID, store ID, date and time, and payment information. The information processing device 200 then registers the payment history in the payment history information 215 (S551).

In the above description, the user U moves to the store and performs payment processing at the store terminal 600. Payment processing is possible without moving. In this case, the information processing device 200 may store personal payment information associated with the user ID in the storage unit 210 . As a result, the payment information and the facial feature information 112 of the authentication device 100 are linked via the user ID. The settlement registration process is, for example, as follows. First, the user terminal 500 transmits a payment processing request to the shop terminal 600 . Then, the user terminal 500 takes an image of the user U and transmits the taken image to the store terminal 600 or the store side server that performs electronic commerce with the user terminal 500 . The shop terminal 600 and the shop server transmit the received captured image to the information processing device 200 . Note that the user terminal 500 may directly transmit the captured image to the information processing device 200 . When the face authentication is successful, the store terminal 600 or the store server transmits a payment registration request to the information processing device 200, and the information processing device 200 executes payment processing to register the payment history in the payment history information 215. do. Note that the series of processes described above may be performed only between the information processing device 200 and the user terminal 500 without going through the store terminal 600 or the store server.

19 to 23 are diagrams showing an example of the terminal screen 610 according to the second embodiment. First, FIG. 19 shows a terminal screen 610 of the requesting face authentication terminal 400 when the face authentication is successful at the time of the start request. A terminal screen 610 in the figure displays information indicating that the face authentication has been successful and a message saying "Good luck, 〇〇-chan!". The face authentication terminal 400 may display the screen shown in this figure before displaying the content information of the mission.

FIG. 20 shows a terminal screen 610 when the requesting face authentication terminal 400 displays content information at the time of a start request. A terminal screen 610 in the figure displays the mission IDs of two missions (missions 1-1 and 1-2), some content information, and a message prompting a mission selection operation. The user U selects a mission by tapping a desired mission ID. After that, the terminal screen 610 transitions to the terminal screen 610 shown in FIG.

Detailed content information of the selected mission is displayed on the terminal screen 610 shown in FIG. For example, when the user U selects “Mission 1-2: Help Capybara go home”, the terminal screen 610 displays an explanation of the mission. Additionally, the terminal screen 610 may display map information of the area in which the selected mission will be held.

A terminal screen 610 shown in FIG. 22 displays the map information of the area where the selected mission is held, the starting point of the selected mission, the current location, and route information from the current location to the starting point. there is This makes it easier for the user U to participate in the next mission.

FIG. 23 shows the terminal screen 610 of the requesting face authentication terminal 400 when the face authentication is successful at the time of the completion request. A terminal screen 610 in the figure displays information indicating that face authentication has succeeded, and a message indicating that a score has been added, that is, points are scheduled to be added. The terminal screen 610 also displays an input area for the user U to request participation in the next mission.

As described above, the information processing apparatus 200 according to the second embodiment presents a mission for each user U based on the attribute information of the user U. Therefore, it is possible to appropriately experience the mission according to the user U's ability level and preference. can. The attribute information of the user U is not limited to gender, age, etc., and may include a desired end time generated based on the schedule information of the user U, or companion information. In this case, the information processing apparatus 200 can present different missions according to the situation of the user U on that day, so that repeat users are less likely to get bored.

In addition, the information processing apparatus 200 changes the mission to be presented next based on the user U's mission selection history and mission evaluation information, so that the user U can be provided with a more customized mission experience. . Therefore, the information processing device 200 can suitably activate the event venue and suitably support the operation of the event venue.

Note that the completion processing unit 245 may increase the score addition amount or the point addition amount when the user U has an accompanying person, compared to when the user U does not have an accompanying person. As a result, it is possible to promote group visits to the event site and activate the event site. At this time, companions for whom the additional amount is to be increased may be limited to companions having a predetermined group attribute. At this time, the completion processing unit 245 may change the group attributes of the companions for whom the additional amount is to be increased, according to the target audience of the event venue and the time/season. For example, if the event venue is a zoo, the completion processing unit 245 may limit the group attribute of companions for whom the additional amount is to be increased to family members. Further, for example, when the time is the Christmas season, the completion processing unit 245 may limit the group attribute of companions for whom the additional amount is to be increased to couples. As a result, it is possible to promote visits to target audiences.

In addition, when the completion processing unit 245 converts the score into points in response to receiving a non-continuation request, the completion processing unit 245 may output information on stores where points can be used to the face authentication terminal 400 that made the request. As a result, the user U can be encouraged to use the store after the event experience is over. At this time, the completion processing unit 245 preferentially outputs information on shops within a predetermined distance from the position of the user U (that is, the point of the face authentication terminal 400 that made the request), or determines the display order of the shops by the user U. may be set in order of proximity from the position of .

The information processing apparatus 200 may accumulate the user U's mission selection history and evaluation information, and analyze the user U's degree of interest and satisfaction. For example, the information processing apparatus 200 calculates the correlation between the attribute of the user U and the attribute of the mission with high interest/satisfaction from the user U's mission selection history and evaluation information. Then, the determining unit 242 may select a mission that may have a strong interest for each user U using the correlation, and determine a mission group including the selected mission as the user U's mission group. Thereby, the determination unit 242 can determine the mission group for each user U more appropriately. Further, the information processing apparatus 200 may create a new mission that may have a strong interest for each attribute of the user U based on the correlation.

Further, the information processing device 200 may analyze the interest level and satisfaction level of the user U for each season. Then, the information processing apparatus 200 may determine a mission group including missions that are popular in that season as the user U's mission group. As a result, it is possible to keep repeat users from getting bored.

In addition, the information processing apparatus 200 transmits content information of a mission selected according to the user U's attribute (for example, age), season, and theme as an advertisement to the terminal of the user U who has registered for participation in the past. , you may solicit repeat use.

<Embodiment 3>
Next, Embodiment 3 of the present disclosure will be described. FIG. 24 is a block diagram showing the overall configuration of an information processing system 1000a according to the third embodiment. The information processing system 1000 a has basically the same configuration and functions as the information processing system 1000 . However, information processing system 1000a includes information processing apparatus 200a instead of information processing apparatus 200, image storage server 300, and face authentication terminals 490-1 through 490-n instead of face authentication terminals 400-1 through 400-n. It is different in that it has Information processing device 200a, image storage server 300, and face authentication terminals 490-1 to 490-n are connected to network N. FIG. . . , 490-n are simply referred to as the face authentication terminal 490 when they are referred to without distinction.

In addition to the functions of the information processing device 200, the information processing device 200a stores the photographed image of the user U whose face has been successfully authenticated in the image storage server 300 in association with the user ID. Further, the information processing apparatus 200a acquires a photographed image of the user U participating in the mission from the face authentication terminal 490 in addition to when requesting the start and requesting the completion. Also in this case, when the face authentication is successful based on the captured image, the information processing apparatus 200a stores the captured image in the image storage server 300 in association with the user ID. When an image output request is received from the store terminal 600 after the mission experience is completed (after a non-continuation request), the photographed image of the user U corresponding to the image output request is output to the store terminal 600 .

The image storage server 300 is one or more file servers for storing captured images for face authentication. The image storage server 300 provides the captured image to the request source via the network N. FIG.

The face authentication terminals 490-1, 490-2, . . . 490-n are installed at points A1, A2, . The face authentication terminal 490 may photograph the user U who is participating in the mission, in addition to when requesting the start and completion of the mission. Here, the face authentication terminal 490 uses the photographed image as an authentication image, and transmits a face authentication request including the authentication image to the information processing apparatus 200a via the network N. FIG.

The configuration of the face authentication terminal 490 is basically the same as the configuration of the face authentication terminal 400 shown in FIG. Therefore, the imaging control unit 451 controls the camera 410 to capture an authentication image of the user U at the time of the start request and the completion request. The authentication control unit 453 then transmits a face authentication request including the authentication image to the information processing apparatus 200a via the network N. FIG. However, in addition to this, the imaging control unit 451 controls the camera 410 to capture an authentication image of the user U participating in the mission. The authentication control unit 453 then transmits a face authentication request including the authentication image of the user U participating in the mission to the information processing device 200a via the network N. FIG. Note that the authentication control unit 453 of some of the face authentication terminals 490-1 to 490-n may not have the function of transmitting the start request and the completion request. Here, the face authentication terminal 490 that does not have the function of sending a start request and a completion request is called a dedicated face authentication terminal, and the face authentication terminal 490 that has at least one of the function of sending a start request and a completion request is called a general-purpose face authentication terminal. Let's call it a terminal. That is, the dedicated face authentication terminal can be said to be a face authentication terminal that specializes in photographing the user U participating in the mission and transmitting a face authentication request accompanying this. The display control unit 454 and the display unit 440 are not essential in the dedicated face authentication terminal. A dedicated face authentication terminal is installed at a position where it is possible to photograph a person participating in a mission. That is, the points where the dedicated face authentication terminals are installed may be between the locations where the mission is held, for example, between the points where the general-purpose face authentication terminals are installed.

FIG. 25 is a block diagram showing the configuration of the information processing device 200a according to the third embodiment. The information processing device 200 a has basically the same configuration and functions as the information processing device 200 . However, in the information processing apparatus 200a, the storage unit 210 stores the program 211a instead of the program 211, and the control unit 240 has an authentication control unit 243a instead of the authentication control unit 243, and an image providing unit 246. It differs from the information processing device 200 . The program 211a is a computer program in which the processing of the information processing method according to the third embodiment is implemented.

In addition to the functions of the authentication control unit 243, the authentication control unit 243a stores the captured image in the image storage server 300 in association with the user ID when face authentication is successful based on the captured image.

The image providing unit 246 receives an image output request from the shop terminal 600, acquires the photographed image of the user U from the image storage server 300 when the face authentication is successful based on the photographed image, and sends the request to the shop terminal 600, The photographed image is output via the network N.

FIG. 26 is a flowchart showing the flow of authentication control processing according to the third embodiment. First, the authentication control unit 243a acquires a captured image via the network N (S600). Here, the image provider is any one of the face authentication terminals 490-1 to 490-n at points A1 to An. Next, the authentication control unit 243a executes the processes shown in steps S412 to S416 in FIG. Next, the authentication control unit 243a stores the captured image in the image storage server 300 in association with the identified user ID (S601).

When the information processing apparatus 200a receives a start request from the face authentication terminal 490 that provides the image, the information processing apparatus 200a may perform the processes shown in S417 to S420 of FIG. 12 in addition to the process of S601. When the information processing apparatus 200a receives a completion request from the face authentication terminal 490 that provides the image, the information processing apparatus 200a may perform the processes shown in S431 to S434 in FIG. 13 in addition to the process of S601.

FIG. 27 is a flowchart showing the flow of image providing processing according to the third embodiment. First, the authentication control unit 243a executes the processes shown in S441 and S412-416 in FIG. In S416, the authentication control unit 243a may output to the shop terminal 600 that the face authentication was successful when identifying the user ID for which the face authentication was successful.

Next, the image providing unit 246 acquires an image output request from the shop terminal 600 of the image providing source via the network N (S611). Next, the image providing unit 246 acquires the captured image associated with the identified user ID from the image storage server 300 (S612). Then, the image providing unit 246 outputs the acquired photographed image to the store terminal 600 that is the source of the request via the network N (S613). Then, at the store, the photographed image acquired by the store terminal 600 is printed, and the printed matter is provided to the user U as a souvenir. Note that the souvenir may be an album in which a plurality of printed images of the user U participating in the mission are collectively stored.

In addition to or instead of step S613, the image providing unit 246 may output the acquired captured image to the user terminal 500 or the face authentication terminal 400 via the network N. Thereby, the user U can acquire the photographed image without visiting the store.

In addition to or in place of steps S612 and S613, the image providing unit 246 identifies access information for the storage destination of the captured image associated with the user ID, and requests the access information for the storage destination via the network N. It may be output to the original store terminal 600 . The access information is, for example, link information to WEB information corresponding to the photographed image, and is specifically a URL or the like. The output destination of the access information is not limited to the store terminal 600, and may be the user terminal 500 or the face authentication terminal 490 at a specific point. The user terminal 500 reads the access information and transmits to the image storage server 300 a request to a predetermined storage destination corresponding to the access information. When receiving the request, the image storage server 300 reads the captured image stored in the storage destination specified by the request, and transmits the captured image to the user terminal 500 via the network N as a response. Thereby, the user terminal 500 acquires the captured image from the storage destination.

Note that the image providing unit 246 may change the number of images to be output according to the score obtained by the user U. Further, the image providing unit 246 may output, among the captured images acquired from the image storage server 300, captured images having a degree of smile equal to or greater than a predetermined value to the image output request source.

Here, FIG. 28 shows an example of a photographed image that the image providing unit 246 outputs to the store terminal 600 that requested the image output. FIG. 28 is a diagram showing an example of a captured image 620 according to the third embodiment. In this figure, the photographed image 620 shows the user U participating in the mission.

Note that the image providing unit 246 may edit the captured image acquired from the image storage server 300 in S612 and generate a composite image. Here, when there is one photographed image, the synthesized image may be an image obtained by synthesizing a predetermined template and the photographed image. Further, when two or more captured images are acquired, the combined image may be an image in which each captured image is combined so as to be individually identifiable.

FIG. 29 is a diagram showing an example of a composite image 630 according to the second embodiment. In the synthesized image 630, a plurality of photographed

images

631, 632, 633, 634, and 635 of the user U whose face authentication has succeeded are synthesized so as to be individually identifiable.

Then, the image providing unit 246 outputs the synthesized image to the image output request source. Thereby, the user U can obtain a printed matter of the composite image. Further, the image providing unit 246 may store the composite image in the image storage server 300 and output the access information of the storage destination via the network N to the image output request source. Thereby, the user terminal 500 can acquire the synthesized image.

As described above, the information processing apparatus 200a according to the third embodiment provides the user U with a photographed image at the time of a request to start a mission, a request to complete a mission, or during participation in a predetermined method. As a result, the event venue can be more activated.

It should be noted that the present disclosure is not limited to the above embodiments, and can be modified as appropriate without departing from the scope. For example, in the second and third embodiments described above, the authentication device 100 is connected to the information processing device 200 via the network N. FIG. However, instead of this, the functions of the face detection unit 120 , the feature point extraction unit 130 , the registration unit 140 and the authentication unit 150 of the authentication device 100 may be included in the control unit 240 of the information processing device 200 . Moreover, the face information DB 110 of the authentication device 100 may be included in the storage unit 210 of the information processing device 200 .

In addition, in the second embodiment described above, each point has a face authentication terminal 400, but there may be only one face authentication terminal 400 at a specific point. The same applies to the face authentication terminal 490 of the third embodiment.

Also, in the second and third embodiments described above, the face authentication terminal 400 and the face authentication terminal 490 are installed at a point, but the user terminal 500 carried by the user U may be used. In this case, the user terminal 500 may include its own location information in the start request and completion request to be transmitted to the

information processing apparatuses

200 and 200a.

Also, in the third embodiment described above, the image storage server 300 is connected to the information processing apparatus 200 via the network N. However, instead of this, the functions of image storage server 300 may be included in storage unit 210 of information processing apparatus 200 .

In Embodiments 2 and 3 described above, the completion processing unit 245 of the information processing device 200 grants a privilege to the user U as processing according to mission completion. At this time, the completion processing unit 245 may provide the user U with information on a place where the privilege can be used, such as information on a store, as recommendation information to encourage the user U to use the privilege. In this case, the completion processing unit 245 may generate information about a place where the privilege can be used and which is less than a predetermined distance from the position information of the face authentication terminal 400 that requested non-continuation. The generated information may include location information of the recommended location and route guidance information to the recommended location. When the privilege is granted, the completion processing unit 245 transmits the recommendation information to the face authentication terminal 400 or the user terminal 500 that requested non-continuation. The use of the privilege is not limited to payment at the store, and may be used for payment of transportation fares. Therefore, the location where the privilege can be used is not limited to the location of the store, and may be the location of the station or bus stop.

In addition, in the above-described embodiment, the hardware configuration has been described, but the configuration is not limited to this. The present disclosure can also implement arbitrary processing by causing a CPU to execute a computer program.

In the above examples, the program includes instructions (or software code) that, when read into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or tangible storage medium. By way of example, and not limitation, computer readable media or tangible storage media may include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drives (SSD) or other memory technology, CDs - ROM, digital versatile disc (DVD), Blu-ray disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disc storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or communication medium. By way of example, and not limitation, transitory computer readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

Some or all of the above-described embodiments can also be described in the following supplementary remarks, but are not limited to the following.
(Appendix 1)
a registration unit that registers, for each target person, the attribute information of the target person in association with the biometric information of the target person;
a determination unit that determines a mission group consisting of one or more missions for each subject based on the attribute information;
an authentication control unit for performing biometric authentication when biometric information for authentication of a target person is acquired from an information terminal;
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject a start processing unit that causes the information terminal to output content information of at least one mission included in the group;
a completion processing unit that, when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is obtained from the information terminal, executes processing according to the completion of the mission; Information processing device.
(Appendix 2)
The attribute information includes at least one of age, gender, occupation, family composition, hobbies, companion information indicating the presence or absence of companions or group attributes, and information indicating desired end time. Device.
(Appendix 3)
3. The information processing apparatus according to appendix 1 or 2, wherein the registration unit generates the attribute information based on at least one of input data from a subject and a captured image of the subject.
(Appendix 4)
4. The information processing apparatus according to any one of appendices 1 to 3, wherein the determination unit determines the mission group of the target person based on the congestion status of the venue or the work status of staff members at the venue.
(Appendix 5)
The start processing unit
When the biometric authentication is successful and a start request is obtained from the information terminal, the content information of a plurality of missions included in the mission group corresponding to the subject is obtained by the subject from the plurality of missions. 5. The information processing apparatus according to any one of appendices 1 to 4, wherein the information terminal is caused to selectably output .
(Appendix 6)
Based on at least one of the completion status of the mission, the target person's position information when the mission is completed, the target person's evaluation information on the completed mission, and the target person's mission selection history, the determination unit determines the target person The information processing device according to appendix 5.
(Appendix 7)
Processing according to mission completion includes processing to add the score of the target,
The completion processing unit determines whether or not to perform the start processing of the next mission according to the addition of the target person's score. 7. The information processing apparatus according to any one of appendices 1 to 6, wherein a privilege according to the condition is provided.
(Appendix 8)
an information terminal that acquires biometric information for authentication of a subject;
an information processing device communicably connected to the information terminal,
The information processing device is
a registration unit that registers, for each target person, the attribute information of the target person in association with the biometric information of the target person;
a determination unit that determines a mission group consisting of one or more missions for each subject based on the attribute information;
an authentication control unit that performs biometric authentication when biometric information for authentication of a subject is acquired from the information terminal;
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject a start processing unit that causes the information terminal to output content information of at least one mission included in the group;
a completion processing unit that, when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is obtained from the information terminal, executes processing according to the completion of the mission; an information processing system.
(Appendix 9)
The attribute information includes at least one of age, gender, occupation, family composition, hobbies, companion information indicating the presence or absence of companions or group attributes, and information indicating desired end time. system.
(Appendix 10)
a step of registering attribute information of a subject for each subject in association with the biometric information of the subject;
determining a mission group consisting of one or more missions for each subject based on the attribute information;
When biometric information for authentication of a target person is acquired from an information terminal, performing biometric authentication;
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject causing the information terminal to output content information of at least one mission included in the group;
when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is obtained from the information terminal, executing a process according to the completion of the mission. Processing method.
(Appendix 11)
to the computer,
a registration process for registering attribute information of each target person in association with the biometric information of the target person;
a determination process of determining a mission group consisting of one or more missions for each target person based on the attribute information;
Authentication control processing for performing biometric authentication when biometric information for authentication of a target person is acquired from an information terminal;
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject a start process for causing the information terminal to output content information of at least one mission included in the group;
a completion process for executing a process according to the completion of the mission when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is obtained from the information terminal; program to run.

Although the present invention has been described with reference to the embodiments, the present invention is not limited to the above. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.

This application claims priority based on Japanese Patent Application No. 2021-023728 filed on February 17, 2021, and the entire disclosure thereof is incorporated herein.

The information processing device and information processing system according to this embodiment can be used, for example, to operate an event venue.

REFERENCE SIGNS LIST 10 information processing device 11 registration unit 12 determination unit 13 authentication control unit 14 start processing unit 15 completion processing unit 100 authentication device 110 face information DB
111 User ID
112 facial feature information 120 face detection unit 130 feature point extraction unit 140 registration unit 150

authentication unit

200, 200a information processing apparatus 210

storage unit

211, 211a program 212 user information 2121 user ID
2122 User attribute information 2123 Score 2124 Points 213 Mission history information 2131 User ID
2132 Mission Group ID
2133 Mission ID
2134 Completion Status Information 214 Mission Information 2141 Mission Group ID
2142 Mission ID
2143 Mission attribute information 215 Payment history information 2151 User ID
2152 Store ID
2153 payment information 2154 date and time 220 memory 230 communication unit 240 control unit 241 registration unit 242

determination unit

243, 243a authentication control unit 244 start processing unit 245 completion processing unit 246 image providing unit 300 image storage server 400 face authentication terminal 410 camera 420 storage unit 430 communication unit 440 display unit 450 control unit 451 photographing control unit 452 registration unit 453 authentication control unit 454 display control unit 460 input unit 490 face authentication terminal 500 user terminal 510 camera 520 storage unit 530 communication unit 540 display unit 550 control unit 551 photographing Control unit 552 Registration unit 553 Acquisition unit 554 Display control unit 560 Input unit 600 Store terminal 610 Terminal screen 620 Photographed image 630

Synthetic image

631, 632, 633, 634, 635 Photographed

image

1000, 1000a Information processing system A1, A2, An Location N network U user

Claims

a registration means for registering the attribute information of each target person in association with the biometric information of the target person;
determining means for determining a mission group consisting of one or more missions for each subject based on the attribute information;
Authentication control means for performing biometric authentication when biometric information for authentication of a target person is acquired from an information terminal;
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject start processing means for causing the information terminal to output content information of at least one mission included in the group;
Completion processing means for executing a process according to the completion of the mission when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is obtained from the information terminal. Information processing device.
The information according to claim 1, wherein the attribute information includes at least one of information indicating age, gender, occupation, family composition, hobbies, presence or absence of companions or group attributes, and information indicating desired end time. processing equipment.
The information processing apparatus according to claim 1 or 2, wherein the registration means generates the attribute information based on at least one of input data from the subject and a captured image of the subject.
4. The information processing apparatus according to any one of claims 1 to 3, wherein the determination means determines the mission group of the target person based on the congestion status of the venue or the business status of staff members at the venue.
The start processing means is
When the biometric authentication is successful and a start request is obtained from the information terminal, the content information of a plurality of missions included in the mission group corresponding to the subject is obtained by the subject from the plurality of missions. 5. The information processing apparatus according to any one of claims 1 to 4, wherein the information terminal is caused to selectably output to the information terminal.
The determination means determines whether the target person The information processing apparatus according to claim 5, wherein the mission group of is changed.
Processing according to mission completion includes processing to add the score of the target,
The completion processing means determines whether or not to perform the start processing of the next mission according to the addition of the target person's score. The information processing apparatus according to any one of claims 1 to 6, wherein a privilege according to the condition is provided.
an information terminal that acquires biometric information for authentication of a subject;
an information processing device communicably connected to the information terminal,
The information processing device is
a registration means for registering the attribute information of each target person in association with the biometric information of the target person;
determining means for determining a mission group consisting of one or more missions for each subject based on the attribute information;
Authentication control means for performing biometric authentication when biometric information for authentication of a subject is acquired from the information terminal;
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject start processing means for causing the information terminal to output content information of at least one mission included in the group;
Completion processing means for executing a process according to the completion of the mission when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is acquired from the information terminal. an information processing system.
For each target person, the attribute information of the target person is registered in association with the biometric information of the target person,
determining a mission group consisting of one or more missions for each subject based on the attribute information;
When the biometric information for authentication of the target person is obtained from the information terminal, biometric authentication is performed,
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject causing the information terminal to output content information of at least one mission included in the group;
An information processing method, wherein when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is obtained from the information terminal, a process according to the completion of the mission is performed.
to the computer,
a registration process for registering attribute information of each target person in association with the biometric information of the target person;
a determination process of determining a mission group consisting of one or more missions for each target person based on the attribute information;
Authentication control processing for performing biometric authentication when biometric information for authentication of a target person is acquired from an information terminal;
When the biometric authentication is successful and a start request including information indicating that the subject is requesting to start participating in the first or next mission is obtained from the information terminal, the mission corresponding to the subject a start process for causing the information terminal to output content information of at least one mission included in the group;
a completion process for executing a process according to the completion of the mission when the biometric authentication is successful and a completion request including information indicating that the mission in which the target person is participating is completed is obtained from the information terminal; A non-transitory computer-readable medium storing a program for execution.