JP2023040764A - Image capturing device, information processing device, information processing method, and program - Google Patents

Abstract

To provide an image capturing device, an information processing device, an information processing method, and a program, which can be applied to photo creation game machines configured to provide a series of games for printing captured images on sticker paper sheets and allow for appropriately modifying content of a game if a user using the game is a repeat user.SOLUTION: In an information processing system, an image capturing unit of a photo sticker creation device 1 is configured to capture an image of multiple users U1, U2 using a game together, obtain a result of determination as to whether or not the users are repeat users who have used the game before based on the image acquired by photographing the multiple users, and modify content of the game according to the result of determination as to whether the users are repeat users or not.SELECTED DRAWING: Figure 3

Description

The present technology relates to a photographing device, an information processing device, an information processing method, and a program, and in particular, a photographing device and an information processing device capable of appropriately changing the contents of a game when the user who uses the game is a repeat user. , an information processing method, and a program.

Conventionally, a photo sticker creating device is known. A photo sticker creating apparatus photographs a user, makes the user edit the photographed image, and prints the edited image on sticker paper to provide the edited image. A photo sticker creating device is installed in an amusement facility or the like.

The flow of one game provided by the photo sticker creating device is that after taking a picture of the user in the photo booth as the subject, the user is moved to the editing booth and the image is edited according to the operations performed in the editing booth. , the edited image is printed on sticker paper.

JP 2012-142773 A

A game of the photo sticker making device is usually used by a plurality of users. If all of the users are repeat users, it may be preferable to change the content of the game before proceeding.

The present technology has been made in view of such a situation, and is intended to appropriately change the content of the game when the user who uses the game is a repeat user.

A photographing device according to one aspect of the present technology includes a photographing unit that photographs a plurality of users who use a game together as subjects, and a determination result as to whether or not the user is a repeat user who has used the game. an acquisition unit that acquires based on an image obtained by photographing the user; and a control that changes the content of the game based on a determination result as to whether or not each of the plurality of users is the repeat user. and a part.

An information processing device according to another aspect of the present technology includes an authentication unit that authenticates a person appearing in an image transmitted from a photographing device that photographs a plurality of users who use a game together as subjects, and a determination unit that determines whether or not the plurality of users are repeat users who have used the game; and a communication unit for transmitting to the photographing device.

In one aspect of the present technology, a plurality of users who use the game together are photographed as subjects, and the determination result as to whether or not the user is a repeat user who has used the game is obtained by photographing the plurality of users. obtained based on the captured image. Further, the content of the game is changed based on the determination result of whether or not each of the plurality of users is the repeat user.

In another aspect of the present technology, a person appearing in an image transmitted from a photographing device that photographs a plurality of users who use the game together as subjects is authenticated, and based on the result of person authentication, the plurality of users are identified. It is determined whether or not the user is a repeat user who has used the game. Also, information regarding the determination result as to whether each of the plurality of users is a repeat user is transmitted to the imaging device.

According to the present technology, it is possible to appropriately change the contents of the game when the user who uses the game is a repeat user.

It is a figure showing an example of composition of an information processing system concerning one embodiment of this art. FIG. 4 is a diagram showing an example of input/output of a face recognition engine; FIG. 10 is a diagram showing the flow of processing during a game; It is a figure which shows the example of game management information. FIG. 4 is a diagram showing an example of a display screen; It is a figure which shows the example of store installation information. 1 is a perspective view showing the appearance of a photo sticker creating device; FIG. It is a block diagram which shows the structural example of a photo sticker production apparatus. FIG. 4 is a diagram showing an example of face image generation; It is a figure explaining a user's standing position. It is a block diagram which shows the hardware structural example of an information processing server. It is a block diagram which shows the functional structural example of an information processing server. FIG. 10 is a flowchart for explaining a photo sticker creating game providing process executed by the photo sticker creating apparatus; FIG. FIG. 14 is a flow chart for explaining a photographing process in step S2 of FIG. 13; FIG. FIG. 11 is a diagram showing a display example of an analysis result screen; FIG. 10 is a diagram showing a display example at the start of face diagnosis; FIG. 10 is a diagram showing a display example of a face diagnosis screen; FIG. 10 is a diagram showing another display example of the face diagnosis screen; FIG. 10 is a diagram showing a display example of an edit screen; It is a figure which shows the mode in an edit booth. FIG. 10 is a diagram showing a display example of an editing palette; 4 is a flowchart for explaining the operation of an information processing server; It is a figure which shows the example of the timing which performs face authentication. FIG. 10 is a diagram showing another example of timing for performing face authentication; FIG. 4 is a diagram showing an example of a face recognition engine; FIG. 5 is a diagram showing another configuration example of the photo sticker creating apparatus; FIG. 10 is a diagram showing an example of presentation of information about standing positions;

<Provision of games using face recognition>
- System configuration FIG. 1 is a diagram illustrating a configuration example of an information processing system according to an embodiment of the present technology.

As shown in FIG. 1, an information processing system according to an embodiment of the present technology is configured by connecting a photo sticker creating device 1 and an information processing server 2 via a network 3 such as the Internet.

The photo sticker creation device 1 is a game machine that provides a photo creation game. The photo sticker creating device 1 is installed in a store such as an arcade. Although one photo sticker creating device 1 is shown in FIG. 1, the network 3 is connected to photo sticker creating devices 1 installed in a plurality of shops. A plurality of photo sticker creating apparatuses 1 may be installed in one store.

Users of the photo sticker creating apparatus 1 are mainly high school girls and young women. In the photo sticker creating apparatus 1, a plurality of users, such as two or three users per group, can enjoy the game. Of course, one user can also enjoy the game in the photo sticker creating apparatus 1 .

In the photo creation game of the photo sticker creation device 1, the user takes a picture as a subject. A user edits a photographed image obtained by photographing so as to synthesize an image for synthesis such as a handwritten character or a stamp image, and edits the photographed image into a colorful image. The user receives the sticker sheet on which the edited photographed image is printed, and ends the series of games.

Here, the photo sticker creating device 1 is, for example, a device compatible with 5G communication (fifth generation mobile communication system). Since the photo sticker creating device 1 is connected to the network 3 by 5G communication, communication between the photo sticker creating device 1 and the information processing server 2 is performed at high speed and with low delay. During the game of the photo sticker creating device 1 , transmission and reception of various types of information, which will be described later, are performed between the photo sticker creating device 1 and the information processing server 2 .

The information processing server 2 is a server on the Internet managed by the manufacturer of the photo sticker creating device 1 or the like. The information processing server 2 has a face authentication engine 11 . The face authentication engine 11 is an image processing engine that assigns a face ID, which is a unique ID, to the face of a person appearing in an image. The face recognition engine 11 is configured by, for example, an inference model generated by machine learning.

FIG. 2 is a diagram showing an example of input/output of the face authentication engine 11. As shown in FIG.

As shown in FIG. 2, the face recognition engine 11 is an inference model that receives a face image and outputs a face ID. In the example of FIG. 2, an ID of "000001" is output as the face ID in response to input of the face image of user U1. When the face image of the same person is input, the face recognition engine 11 outputs the same face ID. In the learning of the face recognition engine 11, face images of various people are used as learning data.

A method other than the method using the inference model may be adopted as long as it is a method that can assign a unique ID to each face. For example, the face authentication engine 11 may be an image processing engine that assigns a face ID to a face appearing in a face image for authentication by performing matching with a face image registered in advance. The matching of face images is performed, for example, by calculating the matching degree between the features extracted from the face images registered in advance and the features extracted from the authentication face image.

The face authentication engine 11 detects a face ID (assigns a face ID) from the face image sent from the photo sticker creating apparatus 1 . The photo sticker creating device 1 transmits face images of each user who uses the game of the photo sticker creating device 1 .

-Flow of photo creation game FIG. 3 is a diagram showing the flow of processing during the game.

Here, as shown on the left side of FIG. 3, a case where two users, user U1 and user U2, use the game of the photo sticker creating apparatus 1 together will be described. User U1 and user U2 are, for example, friends.

When the user U1 and the user U2 pay a predetermined amount of money and enter the photography booth according to the guidance, the user U1 and the user U2 are photographed. A camera is installed in the photo booth. The game of the photo sticker creation device 1 mainly consists of a series of operations of pre-selection before shooting, entering the shooting booth to take a photo, and moving from the shooting booth to the editing booth to edit the shot image. You can proceed by letting the user do the work.

For example, based on an image in which user U1 and user U2 are photographed together, photo sticker creation device 1 generates face images of user U1 and user U2, and sends them to information processing server 2 as indicated by arrow #1. to send.

The information processing server 2 inputs the face image transmitted from the photo sticker creating apparatus 1 to the face recognition engine 11, and detects the face IDs of the users U1 and U2 as described above.

Based on the detected face ID, the information processing server 2 also determines whether the user U1 and the user U2 who are playing the game using the photo sticker creating device 1 have used the photo sticker creating device 1 in the past. is a certain repeat user.

The information processing server 2 manages game management information including face IDs of users who have used the photo sticker creating apparatus 1 . The repeat determination, which determines whether or not the user who is playing the game using the photo sticker creating apparatus 1 is a repeat user, determines whether or not the same face ID as the detected face ID has been registered in the game management information. based on

FIG. 4 is a diagram showing an example of game management information.

As shown in FIG. 4, a game management information DB 12 is constructed in the information processing server 2 . For example, game management information is generated and stored in the game management information DB 12 each time a game is played in the photo sticker creating apparatus 1 .

As indicated by balloons, the game management information is information in which each piece of information such as the date and time of game use, housing ID, face ID, game information, and attribute information is linked.

The game usage date and time is information on the game usage date and time (game provision date and time).

The housing ID is the ID of the housing of the photo sticker creating apparatus 1 . A housing ID is set for each photo sticker creating device 1 installed in each store.

The face ID is the face ID of the user who used the game. When the user U1 and the user U2 use the game together, the face ID of the user U1 and the face ID of the user U2 are respectively registered. Since the face IDs of all the users who used the game each time are registered, it becomes possible to identify who used the game together based on the game management information.

The game information is information representing selections made by the user in past games. Various selections are made by the user in the pre-selection work before shooting, the shooting work in the shooting booth, and the editing work in the editing booth. For example, in editing in an editing booth, a user selects a tool to be used for editing a shot image, selects content, and the like.

Various data representing the user's situation during the past game, such as the standing position in the shooting booth (whether it was standing on the right or the left), the standing position in the editing booth, the number of users who used the game together, etc. information may be managed as game information.

The attribute information is user attribute information such as gender and age. The face authentication engine 11 may be provided with a function of estimating the gender and age of a person appearing in a face image. In this case, the face authentication engine 11 is prepared with an inference model that receives a face image and outputs gender information, and an inference model that receives a face image and outputs age information.

When the same face ID as the face ID detected based on the face image transmitted from the photo sticker creating device 1 is registered in the game management information including such information, the photo sticker creating device 1 is used. It is determined that the user playing the game is the repeat user. On the other hand, if the same face ID as the face ID detected based on the face image is not registered in the game management information, it is determined that the user playing the game using the photo sticker creating device 1 is not a repeat user. . Determination as to whether or not a user is a repeat user is made for each user.

The result of such repeat determination is transmitted together with the face ID from the information processing server 2 to the photo sticker creating apparatus 1 as indicated by arrow #2 in FIG. Based on the information transmitted from the information processing server 2, the photo sticker creating device 1 determines whether or not the user currently using the game of the photo sticker creating device 1 has used the game in the past. It is possible to specify whether

In the photo sticker creating apparatus 1, the content of the game provided to the user U1 and the user U2 is changed based on the result of the repeat determination.

FIG. 5 is a diagram showing an example of a display screen.

As will be described in detail later, in the game of the photo sticker creating apparatus 1, the analysis of the user's face is performed when the photo is taken in the photo booth. Face analysis is a process of identifying which system of a plurality of systems prepared in advance the user's face belongs to. The screen shown in FIG. 5 is an analysis result screen used to present analysis results of facial features. The photography booth is provided with a photography monitor that is used to display various screens such as a live view screen and an analysis result screen during photography.

When user U1 and user U2 are using the game together, the analysis result screen displays the analysis result of the facial features of user U1 and the analysis result of the facial features of user U2, respectively. The left area of the analysis result screen is a display area for the analysis result of the facial features of the user U1 standing on the left side facing the camera (shooting monitor), and the right area is a display area for the analysis result of the user U1 standing on the right side facing the camera. This is a display area for analysis results of facial features of user U2. In this example, user U1 stands on the left side facing the camera and user U2 stands on the right side facing the camera.

For example, when user U1 is a repeat user and user U2 is not a repeat user, as shown in FIG. It is displayed with the analysis results in the left area of the screen. In this case, the message for repeat users is not displayed in the right area of the analysis result screen.

The user U1 can realize that the photo sticker creating device 1 recognizes him/herself, and can get a special feeling. Information for repeat users, such as messages, may be presented audibly.

On the other hand, when both user U1 and user U2 are repeat users, as shown in FIG. and the area on the right, respectively, along with the analysis results.

The user U1 and the user U2 can each notice that the photo sticker creating device 1 recognizes them, and can get a special feeling.

In this way, the display of the analysis result screen is changed based on the result of the repeat determination, depending on whether all users who use the game together are repeat users or when users who are not repeat users are included. . Depending on whether all the users who are using the game together are repeat users or when there are users who are not repeat users, the display position of the message for repeat users and the number of messages displayed will change. Become. At least one of the display position of messages for repeat users and the number of messages to be displayed may be changed.

In addition to changing the display position and number of messages, the contents of the messages may also be changed. For example, if all the users who are using the game together are repeat users, a message such as "Thank you both for taking pictures again" is displayed.

In addition to the display of the analysis result screen, the contents of the game of the photo sticker creating device 1 at each timing are determined depending on whether all the users who use the game together are repeat users or when users who are not repeat users are included. It is possible to make it change with

After confirming the analysis result, the user U1 and the user U2 play the game according to the progress of the photo sticker creating apparatus 1. FIG.

In the above, a user who has used the game of the photo sticker creating device 1, which is a photo sticker creating device with a specific housing ID, is determined as a repeat user. A user who has used the game of the photo sticker creating device installed in the same store as the store where the is installed may be determined as a repeat user.

Whether or not the user has used the game of the photo sticker creating device installed in the same store as the store where the photo sticker creating device 1 is installed is determined together with the game management information as shown in FIG. This is done using store installation information.

The store installation information is information in which the ID of the store where the photo sticker creating device is installed, the ID of the model of the photo sticker creating device, etc. are associated with the housing ID. The information processing server 2 is provided with a store installation information DB 13, which is a database of store installation information. By referring to the store installation information, the information processing server 2 can identify the store where the photo sticker creating device is installed based on the housing ID of the photo sticker creating device that has transmitted the face image. becomes.

Further, a user who has used a game of a photo sticker creating apparatus of the same model as that of the photo sticker creating apparatus 1 may be determined as a repeat user. The model ID included in the store installation information is used to determine whether or not the user has used the game of the photo sticker creating device of the same model as the photo sticker creating device 1 .

In this way, the repeat user may be a user who has used the photo sticker creating device of the same housing, or may be a user who has used the photo sticker creating device of the same store. Also, the user may be a user who has used a photo sticker creating device of the same model.

The store installation information DB 13 may be constructed on a server different from the information processing server 2 .

<Configuration of each device>
Configuration of Photo Sticker Making Apparatus 1 FIG. 7 is a perspective view showing the appearance of the photo sticker making apparatus 1 .

As shown in FIG. 7, a pre-operation unit 21 is provided on the side surface of the photo sticker creating apparatus 1 having a box-shaped housing. The pre-operation unit 21 is a device used for pre-selection operations such as selection of the number of users who will use the game together and selection of a shooting course. A touch panel monitor 21A is provided above the pre-operation unit 21 . Below the touch panel monitor 21A, a coin slot 21B for paying the play fee is provided.

Screens used for various selections are displayed on the touch panel monitor 21A. After making various selections according to the display on the touch panel monitor 21A, the user enters the photography booth from the doorway G and takes pictures. A box-shaped photographing unit 31 containing a camera 31A is provided in front of the photographing booth. The photographing unit 31 is provided with a photographing monitor 31B.

An editing section 41 is provided on the left side of the pre-operation section 21 . The editing unit 41 is a device used for editing a photographed image obtained by photographing with the camera 31A. A user who has taken a photograph in the photographing booth moves to the editing booth in front of the editing unit 41 and edits the photographed image. An editing monitor 41A is provided on a slope formed above the editing section 41 . A screen used for editing the captured image is displayed on the editing monitor 41A.

FIG. 8 is a block diagram showing a configuration example of the photo sticker creating apparatus 1. As shown in FIG. Among the configurations shown in FIG. 8, the same reference numerals are given to the same configurations as those described above. Duplicate explanations will be omitted as appropriate.

As shown in FIG. 8, in the photo sticker creating apparatus 1, a pre-operation unit 21, a photographing unit 31, an editing unit 41, a communication unit 52, and a printing unit 53 are connected to a control unit 51 constituted by a PC. It is composed by

The control unit 51 executes a program by the CPU and controls the overall operation of the photo sticker creating apparatus 1 in accordance with the progress of the game. In the control unit 51, a game control unit 61 and an authentication result acquisition unit 62 are realized by executing a predetermined program.

The game control unit 61 controls a series of game processing such as pre-selection processing, shooting processing, editing processing, and printing processing.

The pre-selection process is a process that causes the user to perform pre-selection work such as selection of an imaging course.

The photographing process is a process for causing the user to perform photographing work with the user as the subject. In the photographing process, an image used for face authentication is also photographed in addition to the normal photographed image provided to the user. During face authentication, the game control unit 61 controls the camera 31A to photograph the user who is using the game, and acquires an image for face authentication. The image for face authentication is supplied to the authentication result acquisition section 62 .

The editing process is a process that causes the user to edit the photographed image obtained by the photographing process.

The printing process is a process of arranging the edited images obtained by the editing process in a predetermined layout and printing them on sticker paper. A sticker sheet on which an edited image is printed is provided to the user from an outlet provided at a predetermined position of the housing of the editing section 41 .

The game control unit 61 changes the content of each process based on the repeat determination result acquired by the authentication result acquisition unit 62 . The game control unit 61 functions as a control unit that changes the content of the game based on the determination result of whether or not each of the users is a repeat user. In addition, the game control unit 61 functions as a control unit that changes the content of the game depending on whether all the users who use the game together are repeat users or when users who are not repeat users are included.

In addition, the game control unit 61 controls the communication unit 52 to transmit game information representing user selections in the game to the information processing server 2 . The game information is sent to the information processing server 2 at the timing when the game ends, for example, along with information on the date and time of use of the game and information such as the user's face ID.

The authentication result acquisition unit 62 generates a face image showing each user's face based on the image for face authentication supplied from the game control unit 61 .

FIG. 9 is a diagram showing an example of face image generation.

As shown in the upper part of FIG. 9, when an image P in which the user U1 and the user U2 are photographed is taken as an image for face authentication, as indicated by the arrow #11, the face image of the user U1 and the face of the user U2 are photographed. An image is extracted from the image P.

In the example of FIG. 9, the person standing on the left side of the camera 31A (the person on the right side) is the user U1, and the person standing on the right side of the camera 31A (the person on the left side) is the user U2. is. Images of rectangular areas containing the faces of the users U1 and U2 are extracted as face images.

As shown in FIG. 10, when the user U1 stands on the left side facing the camera 31A and the user U2 stands on the right side facing the camera 31A, the standing positions of the respective users are identified based on the positions captured in the image. becomes possible.

Note that, as shown in the image P in FIG. 9, the original image before processing is used for face authentication. A normal photographed image that is provided to the user after being edited or the like is an image that has been processed, whereas a face image extracted from the image P that has not been processed is a face image. is transmitted to the information processing server 2 and used for face authentication.

The processing includes at least one of a process for enlarging the eyes, a small face process for reducing the size of the face, a skin color adjustment process for brightening the skin color of the face, and a hair color adjustment process for adjusting the color of the hair. processing is included.

For example, if face recognition is performed based on processed images that have undergone eye enlargement processing, different face IDs will be detected even when images of the same user are used. There is a possibility that false positives may occur. By performing face authentication based on the original image, it is possible to prevent such erroneous detection from occurring.

An image P showing the user U1 and the user U2 may be transmitted to the information processing server 2, and the information processing server 2 may generate the face image. The face authentication engine 11 provided in the information processing server 2 may be configured as an image processing engine that receives the image P and outputs the face ID of the user U1 and the face ID of the user U2.

The authentication result acquisition unit 62 in FIG. 8 controls the communication unit 52 to transmit the face image thus generated to the information processing server 2 . The authentication result acquisition unit 62 acquires the authentication result transmitted from the information processing server 2 . The authentication result acquired by the authentication result acquiring unit 62 includes the face ID and the repeat determination result. Other information managed in association with the face ID, such as game information and attribute information, is also appropriately provided to the photo sticker creating apparatus 1 .

The pre-operation unit 21 displays a predetermined screen on the touch panel monitor 21A and allows the user to make various selections before starting shooting. Pre-operation unit 21 receives a user's selection and outputs information representing the content of selection to control unit 51 .

The photographing unit 31 drives the camera 31A to photograph the user in the photography booth as a subject. For example, a plurality of photographed images are acquired by performing photographing a plurality of times. A photographed image acquired by the photographing unit 31 is supplied to the control unit 51 .

The editing unit 41 performs editing processing for users in the editing booth. The editing process includes image processing for editing the captured image. Editing of the captured image is performed using an editing screen displayed on the editing monitor 41A. After editing the photographed image, the editing unit 41 arranges the edited image in a predetermined layout to generate print data, and outputs the print data to the control unit 51 .

The communication unit 52 communicates with an external device such as the information processing server 2 . The communication unit 52 transmits the face image to the information processing server 2 . Along with the face image, information such as the date and time of use of the game and the cabinet ID is also transmitted as appropriate.

The printing section 53 has a printer. The printing unit 53 drives the printer and prints the edited photographed image on the sticker paper based on the print data.

Configuration of Information Processing Server 2 FIG. 11 is a block diagram showing a hardware configuration example of the information processing server 2 .

As shown in FIG. 11, the information processing server 2 is configured by a computer. The information processing server 2 may be configured by a plurality of computers. When the information processing server 2 is composed of a plurality of computers, various processes of the information processing server 2 are realized by cooperation of the respective computers.

A CPU (Central Processing Unit) 101 , a ROM (Read Only Memory) 102 and a RAM (Random Access Memory) 103 are interconnected by a bus 104 .

An input/output interface 105 is further connected to the bus 104 . Input unit 106 , output unit 107 , storage unit 108 , communication unit 109 , and drive 110 are connected to input/output interface 105 .

The input unit 106 is composed of a keyboard, a mouse, and the like. The output unit 107 is configured by a display or the like.

Storage unit 108 is configured by a hard disk, a non-volatile memory, or the like. The storage unit 108 stores programs executed by the CPU 101 and various information used to provide face authentication services.

A game management information DB 12 and a shop installation information DB 13 are constructed in the storage unit 108, for example. The storage unit 108 stores game management information that links various pieces of information such as the date and time of game use, cabinet ID, face ID, game information, and attribute information, and store installation information that links the cabinet ID, store ID, and model ID. It functions as a storage unit that stores the The combination of information stored in the storage unit 108 can be arbitrarily changed. If the game information includes information representing the user's selections in the game and information on the user's standing position at the time of shooting, the storage unit 108 stores the face ID assigned to each user as a result of face authentication, At least one of information representing the user's selection content in the game and information on the user's standing position at the time of shooting is linked and stored.

A communication unit 109 is an interface to the network 3 . For example, the communication unit 109 communicates with the photo sticker creating apparatus 1 and receives a face image transmitted from the photo sticker creating apparatus 1 . Also, the communication unit 109 transmits information such as the authentication result to the photo sticker creating apparatus 1 .

The drive 110 controls writing of data to the removable medium 111 and reading of data from the removable medium 111 .

FIG. 12 is a block diagram showing a functional configuration example of the information processing server 2. As shown in FIG.

As shown in FIG. 12, the information processing server 2 implements an information processing section 121 . The information processing section 121 is composed of an image acquisition section 131 , a face authentication section 132 , a determination section 133 and a game information acquisition section 134 . At least some of the functional units shown in FIG. 12 are implemented by the CPU 101 executing a predetermined program. The information processing section 121 is also provided with the game management information DB 12 described above.

Image acquisition unit 131 acquires the face image transmitted from photo sticker creation apparatus 1 and received by communication unit 109 . The face image acquired by the image acquisition section 131 is supplied to the face authentication section 132 .

The face authentication unit 132 is implemented by the face authentication engine 11 . The face authentication unit 132 inputs the face image supplied from the image acquisition unit 131 to the face authentication engine 11 and detects the face ID. The face authentication unit 132 outputs the face ID detected using the face authentication engine 11 to the determination unit 133 .

Further, the face authentication unit 132 outputs the face ID detected using the face authentication engine 11 to the game management information DB 12, and registers it in association with other information in the game management information regarding the current game.

The determination unit 133 refers to the game management information stored in the game management information DB 12, and determines whether or not the same face ID as the face ID supplied from the face authentication unit 132 has been registered. I do. If the same face ID as the face ID supplied from the face authentication unit 132 has already been registered, the user to whom that face ID is assigned is determined as a repeat user. On the other hand, when the same face ID as the face ID supplied from the face authentication unit 132 is not registered, the user to whom the face ID is assigned is determined as a user who is not a repeat user.

The determination unit 133 transmits information including the face ID supplied from the face authentication unit 132 and the result of the repeat determination to the photo sticker creating apparatus 1 as the authentication result.

The game information acquisition unit 134 receives game information transmitted from the photo sticker creating apparatus 1 at a predetermined timing such as when the game ends, and registers the information in the game management information.

<Operation of each device>
- Operation of photo sticker creating apparatus 1 The photo sticker creating game providing process executed by the photo sticker creating apparatus 1 will be described with reference to the flowchart of FIG. 13 . The process of FIG. 13 is started, for example, when a predetermined amount of money is paid.

In step S1, the game control unit 61 performs pre-selection processing for users outside the photography booth. In the pre-selection process, selection of the number of users, selection of a course of shooting, and the like are performed. Any selection is made using the selection screen displayed on the imaging monitor 31B of the pre-operation unit 21 . When the pre-selection process is completed, the user is guided to move to the photo booth.

In step S2, the game control unit 61 performs shooting processing for users in the shooting booth. In the photographing process, photographing, face analysis, face diagnosis, etc. are performed with the user as the subject. Details of the shooting process will be described later with reference to the flowchart of FIG. 14 .

In step S3, the game control unit 61 performs editing processing for users in the editing booth. Specifically, the game control unit 61 displays an editing screen on the editing monitor 41A, and performs editing work on the captured image obtained by the shooting process. Editing work is performed using various tools such as a pen tool and a stamp tool. The game control unit 61 performs image processing according to user's operation to generate an edited image.

In step S4, the game control section 61 outputs the print data to the printing section 53 and prints the edited image on the sticker paper. When the printing is completed, the sticker sheet on which the edited image is printed is discharged to the outlet of the housing and provided to the user.

In step S5, the game control section 61 controls the communication section 52 to upload the captured image and the edited image to an image management server (not shown). The image management server is a server on the Internet managed by the manufacturer of the photo sticker creating device 1 or the like. By accessing the image management server by operating a portable terminal such as a smart phone, the user can browse and download images created in the game.

In step S<b>6 , the game control unit 61 controls the communication unit 52 to transmit game information including information representing the selection content of the user in the game to the information processing server 2 . The information transmitted here is registered in the game management information in association with the face ID or the like.

Next, the photographing process performed in step S2 of FIG. 13 will be described with reference to the flowchart of FIG. Here, it is assumed that user U1 and user U2 are using the game together.

In step S21, the game control unit 61 controls the camera 31A to perform face analysis photography. Face analysis imaging is performed to capture an image for face analysis, which is an image used for analyzing facial features. For example, as described with reference to FIG. 9, one image in which the user U1 and the user U2 are photographed together is captured as an image for face analysis. A face image generated based on the face analysis image is also used for face authentication. The image for face analysis is also an image for face authentication.

In step S22, the authentication result acquisition unit 62 generates face images showing the faces of the users U1 and U2 based on the face analysis image.

In step S23, the game control unit 61 analyzes the facial images and analyzes the facial features of the user U1 and the user U2.

For example, the game control unit 61 analyzes each face image to detect feature points of specific parts of the face, such as contours, eyes, nose, and mouth. In addition, the game control unit 61 digitizes the features of the user's face in the face image and maps them on the feature amount space to identify the facial systems of the users U1 and U2. Each face of user U1 and user U2 is identified as one of a plurality of types such as cute, baby, fashionable, and adult.

In step S<b>24 , the authentication result acquisition unit 62 controls the communication unit 52 to transmit the face image to the information processing server 2 . The authentication result is transmitted from the information processing server 2 in response to the transmission of the face image. By using 5G communication, etc., it is possible to exchange with low latency.

In step S25, the authentication result acquisition unit 62 receives the authentication result, and acquires the face IDs of the users U1 and U2 and the repeat determination result. If at least one of the user U1 and the user U2 is determined to be a repeat user, the repeat user's game information is included in the authentication result and acquired. Based on the game information acquired here, for example, various selections made during the previous game are specified.

In step S26, the game control section 61 causes the image capturing monitor 31B to display an analysis result screen corresponding to the result of the repeat determination. As described above, the analysis result screen is a screen used for presenting the analysis result of the user's facial features.

FIG. 15 is a diagram showing an example of an analysis result screen.

Display areas 201L and 201R are arranged side by side on the analysis result screen displayed on the imaging monitor 31B. The display area 201L is a display area for analysis results of facial features of the user U1 standing on the left side facing the camera 31A (imaging monitor 31B). The display area 201L is assigned to the user U1 standing on the left side of the camera 31A.

The display area 201R is a display area for analysis results of the facial features of the user U2 standing on the right side facing the camera 31A. The display area 201R is an area assigned to the user U2 standing on the right side facing the camera 31A.

In the example of FIG. 15, display area 201L indicates that the analysis result of the facial features of user U1 is "cute". Above the facial feature analysis results, a message for repeat users saying "Thank you for taking the picture again" is displayed along with an illustration of a girl.

On the other hand, in the example of FIG. 15, display area 201R displays that the analysis result of the facial features of user U2 is "baby". No message for repeat users is displayed in the display area 201R. That is, the analysis result screen shown in FIG. 15 is the analysis result screen displayed when the user U1 is a repeat user and the user U2 is not a repeat user, as described with reference to FIG. 5A.

After such an analysis result screen is displayed, in step S27 of FIG. 14, the game control section 61 displays a face diagnosis screen on the imaging monitor 31B. Face diagnosis is guided by the user's answering questions regarding facial appearance preferences. Multiple choices are presented to the user along with the question. Depending on the result of the face diagnosis, the contents of image processing such as processing to be applied to the face are changed.

FIG. 16 is a diagram showing a display example at the start of face diagnosis.

At the start of face diagnosis, as shown in FIG. 16, a message is displayed to guide the diagnosis from the person standing on the left. Face diagnosis is performed one by one. After a predetermined period of time has passed, the display of the face diagnosis screen switches to the display shown in FIG.

In this example, the user U1 standing on the left is a repeat user. At the start of face diagnosis for repeat users, a face diagnosis screen displays a message asking whether or not the same content selected in the previous game is to be reflected in the current game, as shown in FIG. Is displayed. Below the message, a YES button 211 that is pressed when reflecting and a NO button 212 that is pressed when not reflecting are displayed.

That is, the game information provided from the information processing server 2 includes information about the content selected by the user U1 at the time of face diagnosis in the previous game. By pressing the YES button 211, the user U1 can use the same content as the selection content in the previous game as the face diagnosis result. User U1 can skip the selection regarding face diagnosis.

Further, by pressing the NO button 212, the user U1 can make a selection regarding the appearance of the face in the same manner as a user who is not a repeat user, without using the same selection as in the previous game.

At the lower right of the face diagnosis screen, an incorrect authentication button 213 including the characters "I have never taken a picture" is displayed. The incorrect authentication button 213 is a button that is pressed when a screen such as that shown in FIG. 17 is displayed for a user who is not a repeat user. When the false authentication button 213 is pressed, face diagnosis is started in the same way as when a user who is not a repeat user is targeted.

If an erroneous detection occurs in face ID detection using the face authentication engine 11, a screen for repeat users as shown in FIG. 17 may be displayed to a user who is not a repeat user. A user who is not a repeat user can select his or her facial image preference by pressing the false authentication button 213 .

For example, when the user U1 presses the YES button 211 and selects to use the same content as the selection content in the previous game as the face diagnosis result, the face diagnosis for the user U1 ends. Following the face diagnosis for user U1, face diagnosis for user U2 is started. At the start of face diagnosis for user U2, a face diagnosis screen including a message guiding the diagnosis of user U2 standing on the right side is displayed. After a predetermined period of time has elapsed, the display of the face diagnosis screen switches to the display shown in FIG.

Here, user U2 standing on the right side is not a repeat user. Face diagnosis for users who are not repeat users is performed by the user U2 answering questions as shown in FIG.

On the face diagnosis screen of FIG. 18, a message is displayed asking what kind of face the user wants to have. Below the message, buttons 221 and 222 are displayed as options. User U2 will answer the question by pressing button 221 or button 222 . Such questions are repeated several times with different content.

User U1 who is a repeat user can also perform such a face diagnosis again by pressing the NO button 212 in FIG. 17, separately from the face diagnosis during the previous game.

When the user U1 and the user U2 are also repeat users, a screen is displayed in which the user can select to reflect the same contents as those selected in the previous game, even when the user U2 is subjected to face diagnosis. If all the users who are using the game together are repeat users, or if there are users who are not repeat users, there is a screen where you can select to reflect the same selections as the previous game. The number of impressions is changed.

Returning to the description of FIG. 14, in step S28, the game control unit 61 accepts the user's selection of the face diagnosis screen. The processes of steps S27 and S28 are performed for each user.

When face diagnosis for all users is completed, in step S29, the game control unit 61 controls the camera 31A to perform normal photography. Normal photography is photography for generating a photographed image to be provided to the user. Normal photography is performed multiple times, for example, five times.

In step S30, the game control unit 61 processes the facial portion of each user in the captured image based on the facial parameters corresponding to the combination of the facial feature analysis result and the facial diagnosis result of each user. process. Face parameters are set in advance according to the combination of the facial feature analysis result and the face diagnosis result.

Processing using facial parameters corresponding to the combination of the analysis result of the facial features of the user U1 and the facial diagnosis result of the user U1 is performed on the facial portion of the user U1 appearing in the photographed image obtained by normal photographing. be done. In addition, processing using facial parameters corresponding to a combination of the analysis result of the facial features of the user U2 and the facial diagnosis result of the user U2 is applied to the facial portion of the user U2 appearing in the captured image.

As a result, the appearance of the user U1's face in the captured image is an appropriate appearance according to the analysis result of the facial features of the user U1 and the facial diagnosis result of the user U1. In addition, the image of the user U2's face in the captured image is an appropriate image according to the analysis result of the facial features of the user U2 and the face diagnosis result of the user U2.

In step S31, the game control unit 61 determines whether or not the shooting has ended. If it is determined that the shooting has not ended, the process returns to step S29, and normal shooting is repeated.

For example, if it is determined in step S31 that the photographing has ended because five photographed images have been photographed, the process returns to step S2 in FIG. 13, and the photographing process ends. After the shooting process, the editing process is performed for the user who has moved to the editing booth.

Display of Editing Screen FIG. 19 is a diagram showing an example of an editing screen.

When editing a shot image (step S3 in FIG. 13), an editing screen in which editing areas 301L and 301R are arranged side by side is displayed on the editing monitor 41A of the editing booth. Between the editing areas 301L and 301R, there is provided a thumbnail display area 302, which is a display area for thumbnail images used for selecting shot images to be edited.

The editing area 301L is used by the user U1 standing on the left side of the editing monitor 41A. The editing area 301R is used by the user U2 standing on the right side of the editing monitor 41A.

The editing area 301L is assigned to the user U1 standing on the left side of the editing monitor 41A, and the editing area 301R is assigned to the user U2 standing on the right side of the editing monitor 41A. becomes. As shown in FIG. 20, the editing screen is displayed on the premise that users U1 and U2 are editing in the same standing positions as when shooting. When the standing positions of the users U1 and U2 are opposite to the standing positions of FIG. 20, it is possible to change the screen display so that the user U2 uses the editing area 301L and the user U1 uses the editing area 301R. be done.

In the editing area 301L used by user U1 who is a repeat user, a repeat user message "Thank you for taking another picture" is displayed superimposed on the shot image to be edited. This also allows the user U1 to notice that the photo sticker creating apparatus 1 recognizes him/herself and to feel special.

Although not displayed in the example of FIG. 19, if the user U2 is a repeat user, a message for repeat users is also displayed in the editing area 301R used by the user U2.

The display of the message for repeat users disappears, for example, when a predetermined time has passed since the display of the editing screen started.

In this way, the display of the editing screen is also changed depending on whether all the users who are using the game together are repeat users and when users who are not repeat users are included. Depending on whether all the users who are using the game together are repeat users or when there are users who are not repeat users, the display position of the message for repeat users and the number of messages displayed will change. Become.

Editing palettes 303L and 303R are displayed below the editing areas 301L and 301R, respectively. Editing palettes 303L and 303R display buttons used for selecting various editing tools such as pen tools and stamp tools. User U1 and user U2 operate buttons and the like displayed on editing palettes 303L and 303R, respectively, using touch pen 41B (FIG. 20) to edit the shot image to be edited. A touch pen 41B for user U1 and a touch pen 41B for user U2 are provided near the editing monitor 41A.

A personal chart 304L, which is an area used for selecting recommended makeup processing set for user U1, is displayed on the left side of edit area 301L. Personal chart 304L displays, for example, buttons used to select makeup processing according to the combination of the analysis result of the facial features of user U1 and the facial diagnosis result of user U1. The makeup process is a process of adding highlights by image processing and adding eye color by image processing.

Similarly, a personal chart 304R used for selecting recommended makeup processing set for user U2 is also displayed on the right side of edit area 301R. Personal chart 304L displays buttons and the like used to select makeup processing according to the combination of the analysis result of the facial features of user U2 and the facial diagnosis result of user U2.

Editing of a captured image is performed by two users using such an editing screen.

FIG. 21 is a diagram showing a display example of the editing palette 303L.

The information for the repeat user may be displayed superimposed on the display of the edit palette 303L used by the user U1 who is the repeat user. In the example of FIG. 21, a message is displayed asking whether or not the same contents of the makeup process used in the previous game should be reflected in the current game.

Below the message, a YES button 321 to be pressed when reflecting and a NO button 322 to be pressed when not reflecting are displayed. Also, on the right side of the NO button 322, an incorrect authentication button 323 including the characters "I have never taken a picture" is displayed.

That is, in this example, the user U1 who is a repeat user can select to reflect the contents of the makeup process. The game information transmitted from the information processing server 2 as a result of the authentication includes information about the details of the make-up process selected by the user U1 during the previous game.

In this way, information representing various selections in past games can be managed in association with face IDs and used in the current game.

- Operation of information processing server 2 The operation of the information processing server 2 will be described with reference to the flowchart of FIG. 22 .

In step S<b>51 , the image acquisition section 131 ( FIG. 12 ) acquires the face image transmitted from the photo sticker creating apparatus 1 .

In step S52, the face authentication unit 132 inputs the face image acquired by the image acquisition unit 131 to the face authentication engine 11 to detect the face ID.

In step S53, the determination unit 133 refers to the game management information stored in the game management information DB 12, and determines whether or not the same face ID as the face ID detected by the face authentication unit 132 has been registered. Repeat determination is performed by

In step S54, the determination unit 133 transmits information including the face ID detected by the face authentication unit 132 and the repeat determination result to the photo sticker creating apparatus 1 as the authentication result.

In step S55, the game information acquisition unit 134 determines whether or not game information has been transmitted from the photo sticker creating apparatus 1, and waits until game information is transmitted.

If it is determined in step S55 that the game information has been transmitted from the photo sticker creating device 1, the game information acquisition unit 134 includes the game information transmitted from the photo sticker creating device 1 in the game management information in step S56. Register in the game management information DB 12.

In this way, the face ID can be included in the game management information and managed, and can be used for repeat determination.

When face authentication using an image obtained by face analysis photography fails (when face ID cannot be detected), even if the user is actually a repeat user, the game of the photo sticker creation device 1 may be repeated. It is possible to proceed in the same way as when targeting users who are not users.

Possible causes of face authentication failure include, for example, the poor appearance of the face and the failure to recognize the face from the image, and the occurrence of an error in communication between the photo sticker creating apparatus 1 and the information processing server 2 . In either case, the game of the photo sticker creating apparatus 1 proceeds in the same manner as when targeting users who are not repeat users.

<Modification>
・Example of image used for face recognition It is assumed that an image for face recognition (image for face analysis) is taken at the start of the shooting process, and face recognition is performed using the image that is not provided to the user. However, face authentication may be performed based on a photographed image obtained by normal photographing. A photographed image obtained by normal photographing is an image provided to the user by printing it on a sticker sheet or as data via an image management server.

FIG. 23 is a diagram showing an example of timings for performing face authentication.

After the user U1 and the user U2 enter the photography booth, a live view image is displayed on the photography monitor 31B provided in the photography booth. After a certain period of time has passed since the display of the live view image, the first photographing is performed, and face authentication is performed based on the photographed image P1, which is a still image obtained by the first photographing. A facial image extracted from the photographed image P1 is transmitted to the information processing server 2 .

In addition, a second photographing is performed, and face authentication is performed based on the photographed image P2 obtained by the second photographing. In this way, face authentication is repeated each time an image is taken. When the face recognition is performed based on the photographed image P5 obtained by the last photographing, for example, the fifth photographing, the photographing and the face authentication are completed.

Depending on the orientation of the face, face ID may not be detected in one face authentication. Also, there is a case where the photographing is performed in a state where only the user U2 who uses the camera together with the user U1 is shown. By repeatedly performing face authentication, it is possible to improve the accuracy of repeat determination for each user.

FIG. 24 is a diagram showing another example of the timing of performing face authentication.

As shown in FIG. 24, face authentication may be performed based on five shot images obtained by five shots after all shots are completed. When the fifth photographing is completed, face images extracted from each of the photographed images P1 to P5 are transmitted to the information processing server 2, and face authentication is performed based on each face image.

For example, if a predetermined face ID is detected as the face ID of a certain user 3 times and a different face ID is detected 2 times out of 5 face recognitions, the former face ID detected 3 times is Assigned as the user's face ID. By using many detected face IDs in a so-called majority decision, it is possible to improve the accuracy of repeat determination.

The reliability of the face ID may be calculated based on the state of the face appearing in the face image used as the input to the face recognition engine 11 . The reliability of the face ID is calculated based on the parameters representing the state of the face such as face size, face orientation, and expression. For example, a face ID detected using a face image with a large face facing the front is different from a face ID detected using a face image with a face facing sideways, or a face ID detected using a face image with a small face. The face ID has higher reliability than the face ID detected using the captured face image.

In this case, for example, repeat determination or the like is performed using a face ID for which reliability equal to or greater than a threshold is calculated.

Information on the reliability of the face ID may be included in the authentication result and provided from the information processing server 2 to the photo sticker creating apparatus 1, and used to control the contents of the game. Information for repeat users presented to users who are determined to be repeat users, such as changes in the content of messages or changes in the size of messages, is the reliability of face IDs used for repeat determination. changed based on

For example, a user determined to be a repeat user based on a face ID whose reliability is higher than the threshold is presented with the message "Thank you for taking another picture" as described above. On the other hand, a user determined to be a repeat user based on a face ID whose reliability is lower than the threshold is presented with a message with different content, such as "Did you take pictures before?"

This makes it possible to present a message according to the reliability of the face ID, that is, the reliability of the repeat determination.

Example of Face Authentication Engine As described above, the face authentication engine 11 is an image processing engine that receives a face image and outputs a unique face ID. There is a limit to the number of face IDs that the face recognition engine 11 can output (the number of faces that can be classified). As shown in FIG. 25, each attribute of the photo sticker creation device, such as a face authentication engine for each housing, a face authentication engine for the model, a face authentication engine for the store, a face authentication engine for the area where the store is located, etc. face recognition engine may be prepared in the information processing server 2 .

Face authentication engines 11-1A to 11-1C shown in FIG. 25 are face authentication engines for different housings. Which face authentication engine is used for face authentication is specified based on, for example, the case ID of the photo sticker creating device 1 that has transmitted the face image.

The face recognition engines 11-2A to 11-2C are face recognition engines for different models. Which face authentication engine is used for face authentication is specified based on, for example, a model ID corresponding to the model of the photo sticker creating device 1 that has transmitted the face image.

The face recognition engines 11-3A to 11-3C are face recognition engines for different shops. Which face authentication engine is used for face authentication is specified based on, for example, the shop ID of the shop where the photo sticker creating device 1 that has transmitted the face image is installed.

The face recognition engines 11-4A to 11-4C are face recognition engines for different regions. Which face authentication engine is used for face authentication is specified based on, for example, a region ID corresponding to the region in which the photo sticker creating device 1 that has transmitted the face image is located.

By preparing a face recognition engine for each attribute of the photo sticker creating apparatus, the number of faces that can be classified can be increased, and the accuracy of repeat determination can be improved.

A face ID detected by face authentication may be managed in association with identification information such as a Bluetooth (registered trademark) ID of a smartphone carried by a user. The identification information of the smart phone is included in, for example, game management information and managed.

The photo sticker creation device 1 acquires the Bluetooth (registered trademark) ID of the user's smartphone at the start of the game, and transmits it to the information processing server 2 together with the face image. In the information processing server 2, the face ID detected by inputting the face image to the face recognition engine 11 is recognized as the face ID linked in the game management information to the Bluetooth ID transmitted from the photo sticker creating device 1. If the face IDs are the same, it is determined that the user is a repeat user.

By using the identification information of the smartphone, it is possible to improve the accuracy of repeat determination.

As shown in FIG. 26, the face authentication engine 11 and the game management information DB 12 may be provided in the photo sticker creating apparatus 1. FIG. As a result, the photo sticker creating apparatus 1 can determine the repeat of the user who uses the own housing.

The face recognition engine 11 may be provided in the photo sticker creating device 1 and the game management information DB 12 may be provided in the information processing server 2 . Conversely, the face authentication engine 11 may be provided in the information processing server 2 and the game management information DB 12 may be provided in the photo sticker creating device 1 . In this way, it is possible to provide at least one of the functional units of FIG.

- Example of Repeat Determination A repeat user determination period may be set. A predetermined period such as one day, one week, one month, or one year is set as the determination period. A user who has used the game again before the elapse of the determination period since the previous use of the game is determined as a repeat user.

As a result, it is possible to prevent a user for whom a long period of time has passed since the previous use of the game from being determined as a repeat user.

The repeat count may be specified based on the game management information. If, for example, three pieces of game management information containing the same face ID are registered, the user with that face ID is determined to be the third repeat user.

By combining the number of repeats and the game usage date and time included in the game management information, it is possible to present a message corresponding to the number of repeats, such as "Today is the third time," as information for repeat users. becomes.

By using the game usage date and time, a message corresponding to a more detailed usage situation such as ``thank you for taking pictures today'' is presented to the user who used the game the previous day as information for repeat users. becomes possible.

In this way, it is possible to change the contents of the game based on various information included in the game management information.

・Example 1 of game change
The content of the game will change depending on whether all the users who are using the game together are repeat users or when there are users who are not repeat users. may be further changed by For example, the type of makeup that can be selected may be changed according to the age of the user, or the parameters used for various image processing such as processing may be changed.

Information other than gender and age, such as hair color, wearing of colored contact lenses, and wearing of makeup, may be estimated based on the facial image and managed as attribute information.

・Example 2 of game change
If it is determined that all of the users who use the game together are repeat users, it is further determined whether or not the user has used the game together in the past. good.

For example, when the user U1 and the user U2 have used a game together, the game management information DB 12 of the information processing server 2 contains game management information including a combination of the face ID of the user U1 and the face ID of the user U2. be registered. Based on the combination of face IDs, it is also possible to determine whether or not the user is a repeat user who has used the service together in the past. Since the same friends often use the game, multiple pieces of game management information containing the same combination of face IDs are registered.

If a user who uses the game together is determined to be a repeat user who used the game together in the past, or if all users who use the game together are repeat users, A game with a different content than when a repeat user is included in the users who use the game together is provided. For example, a message such as "You played together before" is presented to all friend users who are using the game together.

Repeated users who are using the game together notice that the photo sticker creating device 1 recognizes them, and can get a special feeling.

・Example 3 of game change
If the game information in the game management information contains information about the standing position at the time of shooting, the information regarding the standing position at the time of the previous game will be presented to repeat users who are using the game together. may

FIG. 27 is a diagram illustrating an example of presentation of information about standing positions.

As shown on the left side of FIG. 27, when the user U1 stood on the left side facing the camera 31A and the user U2 stood on the right side facing the camera 31A during the previous game, the game management information Information indicating that is registered as the information. The game management information also includes a combination of user U1's face ID and user U2's face ID.

In this state, if the user U1 and the user U2 have used the game of the photo sticker creating apparatus 1 again, in the repeat determination of the game this time, it is assumed that the user U1 and the user U2 are repeat users who have used the game together. be judged.

As shown on the right side of FIG. 27, in the current game, when user U1 stands on the right side facing camera 31A and user U2 stands on the left side facing camera 31A and takes a picture, photo sticker creating device 1 The game control unit 61 identifies that the standing positions of the user U1 and the user U2 are opposite to the previous standing position based on the standing position information included in the game information transmitted from the information processing server 2. . When the game control unit 61 identifies that the standing positions of the users U1 and U2 are opposite to the previous standing positions, the game control unit 61 presents a message indicating this to the users U1 and U2.

As a result, the user U1 and the user U2 can realize that the standing position is opposite to the standing position when shooting the previous game, and switch the standing position. When shooting with the same friends, each standing position is often decided. By presenting the information about the standing position, it is possible to shoot an image with the same composition as the image shot during the previous game.

The information about the standing position may be always presented when the user U1 and the user U2 are using it together, instead of when it is the opposite of the previous standing position. In this case, a message such as "Last time I stood on the left side" is presented to user U1, and a message such as "Last time I stood on the right side" is presented to user U2.

Information about the standing position is presented, for example, when user U1 and user U2 are using the device together. When the user U1 is using with a friend different from the user U2, or when the user U2 is using with a friend different from the user U1, the information regarding the standing position is not presented. Even when the user U1 is using with a friend different from the user U2, or when the user U2 is using with a friend different from the user U1, the information regarding the standing position is presented. may

Others If all the users who use the game together are repeat users, the guidance on how to proceed with the game may be omitted or simplified. Guidance is usually presented at each timing during the game to guide the content of the work at that time.

Guidance is presented differently depending on whether all of the users who are using the game together are repeat users or when there are users who are not repeat users. This makes it possible to shorten the game time.

Although user authentication is performed based on the face, it may be performed based on other biometric information such as iris and fingerprint. User authentication may be performed based on information such as an ID input by the user.

- Program The series of processes described above can be executed by hardware or by software. When executing a series of processes by software, a program that constitutes the software is installed from a program recording medium into a computer built into dedicated hardware or a general-purpose personal computer.

The program to be installed is provided by being recorded on removable media 111 shown in FIG. Alternatively, it may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be pre-installed in the ROM 102 or storage unit 108 .

The program executed by the computer may be a program in which processing is performed in chronological order according to the order described in this specification, or a program in which processing is performed in parallel or at necessary timing such as when a call is made. It may be a program that is carried out.

In this specification, a system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a single device housing a plurality of modules in one housing, are both systems. .

The effects described herein are only examples and are not limiting, and other effects may also occur.

Embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

For example, the present technology can take a configuration of cloud computing in which one function is shared by a plurality of devices via a network and processed jointly.

Further, each step described in the flowchart above can be executed by one device, or can be shared by a plurality of devices and executed.

Furthermore, when one step includes a plurality of processes, the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices.

1 photo sticker creation device, 2 information processing server, 11 face authentication engine, 12 game management information DB, 13 store installation information DB, 51 control unit, 61 game control unit, 62 authentication result acquisition unit, 121 information processing unit, 131 image acquisition unit, 132 face authentication unit, 133 determination unit, 134 game information acquisition unit

Claims (16)

a photographing unit that photographs a plurality of users who use the game together as subjects;
an acquisition unit that acquires a determination result as to whether or not the user is a repeat user who has used the game, based on images obtained by photographing a plurality of the users;
and a control unit that changes content of the game based on a determination result as to whether or not each of the plurality of users is the repeat user. 2. According to claim 1, the control unit changes the contents of the game depending on whether all of the plurality of users are the repeat users or when a user who is not the repeat user is included among the plurality of users. Imaging device as described. The photographing apparatus according to claim 1 or 2, wherein the control section presents information for the repeat user to each of the users determined as the repeat user. The photographing device according to claim 3, wherein the control section changes at least one of the number of displays and the display position of the information for the repeat user. further comprising a display unit for displaying the screen of the game,
5. The photographing apparatus according to claim 3, wherein the control unit displays the information for the repeat user in an area assigned to the user determined as the repeat user on the screen. The acquisition unit acquires information about selection content of the repeat user in the past game,
6. Any one of claims 3 to 5, wherein the control unit displays, as the information for the repeat user, information used for selecting whether or not to reflect in the current game the same content selected in the past game. The photographing device described in (1). The photographing according to any one of claims 1 to 6, wherein the control unit changes the contents of the game according to whether or not the plurality of users are the repeat users who used the game together. Device. The acquisition unit acquires information about the standing position of the repeat user at the time of shooting in the past game,
The photographing device according to claim 7, wherein the control unit presents information about standing positions when the plurality of users are the repeat users who have used the game together. 9. The photographing according to claim 8, wherein the control unit presents information about the standing positions when the standing positions of the plurality of users at the time of shooting in the current game are different from the standing positions at the time of shooting in the past games. Device. The acquisition unit authenticates a person based on the face image, and supplies each of the plurality of users generated based on the image to an information processing device that determines whether the authenticated person is the repeat user. 10. The photographing device according to any one of claims 1 to 9, wherein the face image of the user is transmitted, and information regarding a determination result as to whether or not the user is the repeat user is obtained from the information processing device. the photographic device
Multiple users who use the game together are photographed as subjects,
acquiring a determination result as to whether or not the user is a repeat user who has used the game based on images obtained by photographing a plurality of the users;
An information processing method, wherein the content of the game is changed based on a determination result as to whether or not each of the plurality of users is the repeat user. to the computer,
Multiple users who use the game together are photographed as subjects,
acquiring a determination result as to whether or not the user is a repeat user who has used the game based on images obtained by photographing a plurality of the users;
A program for executing processing for changing content of the game based on a determination result as to whether or not each of the plurality of users is the repeat user. an authentication unit for authenticating a person appearing in an image transmitted from a photographing device for photographing a plurality of users who use the game together;
a determination unit that determines whether or not the plurality of users are repeat users who have used the game based on the authentication result of the person;
An information processing apparatus comprising: a communication unit configured to transmit information regarding determination results as to whether or not each of the plurality of users is the repeat user to the photographing device. At least among identification information assigned to each of the plurality of users as the authentication result, information representing selection content in the game, and information on the standing position of each of the plurality of users at the time of shooting in the game The information processing apparatus according to claim 13, further comprising a storage unit that associates and stores any one of them. The information processing device
Authenticate the person appearing in the image sent from the shooting device that shoots multiple users who use the game together,
Determining whether or not the plurality of users are repeat users who have used the game based on the result of person authentication,
An information processing method, comprising transmitting to the photographing device information regarding a determination result as to whether each of the plurality of users is the repeat user. to the computer,
Authenticate the person appearing in the image sent from the shooting device that shoots multiple users who use the game together,
Determining whether or not the plurality of users are repeat users who have used the game based on the result of person authentication,
A program for executing a process of transmitting information regarding a determination result as to whether or not each of the plurality of users is the repeat user to the photographing device.

Images