JP2023019348A - Information processing apparatus, information processing method, program, and imaging apparatus - Google Patents

Abstract

To provide an information processing apparatus which authenticates a user of an imaging apparatus on the basis of a face image, an information processing method, a program, and an imaging apparatus.SOLUTION: An information processing apparatus stores a face image registered by a user, and performs user authentication to determine whether the user is included in a captured image which is captured in an imaging apparatus that provides a game including imaging processing to image the user as a subject, on the basis of the captured image and the face image.SELECTED DRAWING: Figure 5

Description

The present technology relates to an information processing device, an information processing method, a program, and a photographing device, and in particular, an information processing device, an information processing method, and a program that enable authentication of a user of the photographing device based on a face image. , and related to the imaging device.

Conventionally, a photo sticker creating device is known. A photo sticker creating apparatus photographs a user, makes the user edit the photographed image, and prints the edited image on sticker paper to provide the edited image. A photo sticker creating device is installed in an amusement facility or the like.

The flow of one game provided by the photo sticker creating device is that after taking a picture of the user in the photo booth as the subject, the user is moved to the editing booth, and the image is edited according to the operations performed in the editing booth. Then, the edited image is printed on the sticker paper.

Some stores that have installed such photo sticker making devices offer a so-called subscription service that allows users who have paid a fixed monthly fee to use the game of the photo sticker making device as many times as they like. Some stores do. A paper membership card is issued to a user who has registered as a member by paying a monthly fee.

Information such as the membership number, the expiration date of the subscription service, and the stores where the service can be used is recorded on the membership card, for example. A user who uses the photo sticker creating device presents the member's card to the staff of the store and asks them to perform an operation on the device to start the game, and then starts using the game.

Patent Literature 1 discloses a technique for realizing various services such as providing a ticket for free play of a game of a photo sticker creating device by means of a membership card application.

JP 2012-142773 A

There is a possibility that a user who has registered as a member lends his/her membership card to a friend, and the friend uses the membership card to use the photo sticker creating apparatus. Usually, the terms of use of the subscription service as described above include conditions that allow the use of the photo sticker creation device when the person who has registered as a member uses it, or when the person uses it with a friend. There is

The present technology has been made in view of such circumstances, and enables authentication of a user of an imaging device to be performed based on a face image.

An information processing apparatus according to one aspect of the present technology includes a storage unit that stores a face image registered by a user; an authentication unit that performs user authentication for determining whether or not a user is captured based on the photographed image and the face image;

A photographing device according to another aspect of the present technology is provided by an information processing device that stores a photographing unit that photographs a user as a subject, a photographed image that is photographed by the photographing unit, and a face image that is registered by the user. an authentication unit that performs user authentication for determining whether or not the user appears in the captured image based on the face image; and a control unit for controlling the progress of the game.

In one aspect of the present technology, a face image registered by a user is stored, and whether or not the user is included in a photographed image taken by a photographing device that provides a game including photographing processing for photographing the user as a subject. User authentication is performed based on the photographed image and the face image.

In another aspect of the present technology, a user is photographed as a subject, and based on the photographed image and the face image provided from an information processing device that stores the face image registered by the user. User authentication is performed to determine whether or not the user is shown in the captured image, and progress of the game including shooting of the user as a subject is controlled according to the result of the user authentication.

According to the present technology, authentication of a user of an imaging device can be performed based on a face image.

It is a figure which shows the flow at the time of utilization of the photo sticker production apparatus which concerns on one Embodiment of this technique. It is a figure which shows the mode of self-portrait. FIG. 10 is a diagram showing an example of facial image registration; FIG. 3 is a diagram showing an example of member information stored in a member information DB; FIG. FIG. 10 is a diagram showing an example of the flow of user authentication; FIG. 4 is a diagram showing an example of user authentication; FIG. 10 is a diagram showing another example of user authentication; FIG. 10 is a diagram showing an example of timing for performing user authentication; FIG. 10 is a diagram showing another example of timing for performing user authentication; 1 is a perspective view showing the appearance of a photo sticker creating device; FIG. It is a block diagram which shows the structural example of a photo sticker production apparatus. It is a block diagram which shows the structural example of a smart phone. 3 is a block diagram showing a hardware configuration example of an image management server; FIG. 3 is a block diagram showing an example functional configuration of an image management server; FIG. 10 is a flowchart describing a series of processes including user authentication; FIG. 10 is a diagram showing an example of the flow of user authentication when user authentication is performed by the photo sticker creating apparatus; FIG. 4 is a diagram showing an example of image management in an image management service; FIG. 10 is a diagram showing the flow of user authentication when getting an image; FIG. 10 is a diagram showing an example of an image provided when user authentication is successful; FIG. 10 is a diagram showing another example of an image provided when user authentication is successful;

<Subscription service>
- Flow at Game Start FIG. 1 is a diagram showing a flow at the time of using a photo sticker creation device according to an embodiment of the present technology.

A photo sticker creating apparatus 1 shown in FIG. 1 is a game machine that provides a photo creating game. The photo sticker creating device 1 is installed in a store such as an arcade.

Users of the photo sticker creating apparatus 1 are mainly high school girls and young women. In the photo sticker creating apparatus 1, a plurality of users, such as two or three users per group, can enjoy the game. Of course, one user can also enjoy the game in the photo sticker creating apparatus 1 .

In the photo creation game of the photo sticker creation device 1, the user takes a picture as a subject. A camera is provided in the housing of the photo sticker creating apparatus 1 . A user edits a photographed image obtained by photographing so as to synthesize an image for synthesis such as a handwritten character or a stamp image, and edits the photographed image into a colorful image. The user receives the sticker sheet on which the edited photographed image is printed, and ends the series of games.

In the photo sticker creating apparatus 1, the game can be started by inserting a predetermined amount of money such as 400 yen into the slot provided on the housing. can be presented to start the game. The user can use the function of the membership card by installing an application prepared by the manufacturer of the photo sticker creating apparatus 1 or the like on his/her smart phone and registering as a member.

By paying a predetermined fee such as 1000 yen/month, the user can play the game of the photo sticker creating apparatus 1 as many times as he/she wants in the month in which the fee is paid. That is, the photo sticker creating apparatus 1 of FIG. 1 is an apparatus capable of providing games as a so-called subscription service.

When starting a game using the membership card function, the user operates the smartphone to display code information such as a two-dimensional code on the application screen. The code information includes a user ID, which is user identification information. The user authenticates the user by causing the photo sticker creating apparatus 1 to read the code information displayed on the screen. The housing of the photo sticker creating apparatus 1 is provided with, for example, a code reader for reading code information displayed on the screen of the application.

User authentication may be performed by causing the photo sticker creating apparatus 1 to read a user ID stored in a contactless IC chip mounted on a smartphone, or the user ID may be displayed on the photo sticker creating apparatus 1 as described later. User authentication may be performed by reading code information such as a two-dimensional code on the smartphone side.

User membership information is managed in a server on the Internet. After reading the code information presented by the user, the photo sticker creating apparatus 1 transmits information such as the user ID to the server and requests user authentication. When the user authentication at the server succeeds, the server transmits information indicating that the user authentication has succeeded to the photo sticker creating apparatus 1, and the user thus inserts a predetermined amount of money such as 400 yen. It will be possible to use a regular game with the same content as when starting with a subscription service.

In this way, the user does not need to pay money each time he/she starts the game by registering as a regular user who can use the subscription service. Also, the user can play the game any number of times for a predetermined period such as one month.

Members are not limited-time subscription services in which a predetermined period such as one month is set as the usage period, but services with various usage conditions such as model-limited subscription services and store-limited subscription services. It may be provided with a certificate.

The model-limited subscription service is a service that allows users to use the game of a specific model among the models of photo sticker creating devices that are installed as many times as they like. The store-limited subscription service is a service that allows users to use the game of the photo sticker creating device installed in a specific store any number of times regardless of the model.

A combination of various conditions, such as period, model, store, etc., may be set as the usage conditions permitted for the authorized user. Also, conditions such as the number of times the service can be used may be set.

・Registration of face image There is a possibility that another user who has borrowed a smartphone from an authorized user may cheat by playing a game using the function of the authorized user's membership card. The subscription service is effective when the authorized user uses the game himself or when the authorized user uses the game with friends.

In order to prevent such fraudulent actions, the above-described user authentication is performed based on the face image registered by the user.

For example, when registering as a member of the subscription service, the user takes a picture of his or her face using the camera of the smartphone 2, as shown in FIG. An application for using the function of a membership card has a function of sending a self-portrait of a face image to a server and performing membership registration.

FIG. 3 is a diagram showing an example of facial image registration.

As shown in FIG. 3, an image management application 2A is installed in the smartphone 2 used by the user. The image management application 2A is an application provided by the manufacturer of the photo sticker creating device 1 or the like. The image management application 2A implements a membership registration function, a membership card function, and the like. As will be described later, functions such as viewing images uploaded from the photo sticker creating apparatus 1 to the image management server 3 and downloading images are also realized by the image management application 2A.

A face image taken by self-taking at the time of membership registration is transmitted to the image management server 3 as indicated by an arrow A1. The image management server 3 is a server on the Internet managed by the manufacturer of the photo sticker creating device 1 or the like. The image management server 3 is provided with a member information DB 11 and an image DB 12 . The face image transmitted to the image management server 3 is managed in the member information DB 11 as member information. Uploading of images stored in the image DB 12 will be described later.

FIG. 4 is a diagram showing an example of member information stored in the member information DB 11. As shown in FIG.

As shown in FIG. 4, the user ID, face image, subscription expiration date, email address, and attribute information are linked and stored as member information. The attribute information includes information such as gender and age.

User authentication at the start of the game using the function of the membership card is performed based on, for example, an image obtained by photographing the user during the game and a face image registered as member information.

If the user who started the game using the function of the membership card is the same as the user whose face image has been registered, it is determined that the user who started the game is an authorized user. If it is determined that the user who started the game is an authorized user, user authentication is successful, and the user who started the game can continue playing the normal game.

On the other hand, if the user who started the game using the function of the membership card is not the same person as the user whose face image has been registered, it is determined that the user who started the game is an unauthorized user. If the user who started the game is determined to be an unauthorized user, the user authentication fails, and a game with contents different from the normal game is played.

Thus, in the photo sticker creating apparatus 1, progress of the game is controlled according to the result of user authentication.

The game provided by the photo sticker creating apparatus 1 is a game including a shooting process, which is a process of shooting a user as a subject. By using the image obtained by the shooting process during the game, the image management server 3 can perform user authentication without making the user aware of it.

<User authentication (example of performing user authentication on the server side)>
FIG. 5 is a diagram showing an example of the flow of user authentication.

Here, a case where two users, user U1 and user U2, use the game of the photo sticker creating apparatus 1 together will be described. A user U1 is a user who subscribes to a subscription service, and has registered a face image when registering as a member. User U2 is a friend of user U1. User U2 has not subscribed to the subscription service.

As shown on the left side of FIG. 5, when the user U1 operates the image management application 2A and presents the membership card, the game is started. The game of the photo sticker creation device 1 mainly consists of a series of operations of pre-selection before shooting, entering the shooting booth to take a photo, and moving from the shooting booth to the editing booth to edit the shot image. You can proceed by letting the user do the work.

After presenting the membership card and causing the photo sticker creating apparatus 1 to read the code information, the users U1 and U2 select the number of people and the photography course as preselection work. A monitor or the like for displaying a screen used for pre-selection work is provided outside the shooting booth. A code reader or the like used for reading code information is also provided outside the photography booth.

After completing the pre-selection work, the users U1 and U2 enter the photography booth according to the guidance and take pictures. In the photography booth, a plurality of still images, such as five, are photographed at predetermined time intervals. The photography booth is provided with a photography monitor that displays a live view image, which is a moving image being captured by the camera. The users U1 and U2 pose for the camera while looking at the display of the monitor for photography prepared in the photography booth, and take a picture.

For example, when the first photographing is performed, the photo sticker creating apparatus 1 transmits the first photographed image P1 obtained by the first photographing to the image management server 3 as indicated by an arrow A11. In the photographed image P1, the user U1 is photographed on the right side and the user U2 is photographed on the left side. A user ID obtained by reading the code information is also transmitted to the image management server 3 .

The image management server 3 receives the photographed image P1 transmitted from the photo sticker creating apparatus 1, and reads the member information of the user U1 from the member information DB 11 based on the user ID. The image management server 3 also performs user authentication based on the photographed image P1 and the face image of the user U1 included in the member information. That is, user authentication is performed based on the photographed image transmitted from the photo sticker creating apparatus 1 during the game.

FIG. 6 is a diagram showing an example of user authentication.

As indicated by arrow A21, the facial image of user U1 and the facial image of user U2 are extracted from photographed image P1. In the example of FIG. 6, an image of a rectangular area containing each user's face is extracted as a face image.

Also, as indicated by an arrow A22, based on the facial images of the users U1 and U2 and the facial images stored in the image DB 12 as member information, the person appearing in the photographed image P1 has been registered as an authorized user. is the same as the user U1 of . For example, feature points are extracted from each face image, and it is determined whether or not they are the same person based on the positional relationship of the feature points. The determination of whether or not the person is the same person may be made using an inference model generated by machine learning.

The image provided to the user as a product of the game of the photo sticker creating apparatus 1 is an image that has undergone various types of processing. The processed image and the processed image further edited are printed on sticker paper or provided to the user via a server.

As shown in the photographed image P1 in FIG. 6, it is possible to use the original image before processing for user authentication. In this case, the image that is provided to the user as the first photographed image and that is to be edited is the image that has been processed, whereas the image that has not been processed is the image. It will be sent to the management server 3 and used for user authentication.

The processing includes at least one of a process for enlarging the eyes, a small face process for reducing the size of the face, a skin color adjustment process for brightening the skin color of the face, and a hair color adjustment process for adjusting the color of the hair. processing is included. Face images registered as member information are not subjected to such processing.

For example, if user authentication is performed based on a photographed image that has undergone eye enlargement processing and has undergone processing, even if a legitimate user appears in the photographed image, the facial image of the member information There is a possibility that an erroneous determination may occur as a person different from the person is in the image. By performing user authentication based on the original image of the captured image, it is possible to prevent such an erroneous determination from occurring.

When the determination is made based on the photographed image P1 and the registered face images, as shown in FIG. 7, it is determined that the user U1 appearing in the photographed image P1 is an authorized user, and the users U2 are not authorized users. is determined. Since user U1, who is an authorized user, is shown, user authentication is successful. That is, as shown in the lower part of FIG. 7, when a plurality of people are shown in the photographed image, if even one authorized user is shown, the user authentication is successful.

The user authentication result is transmitted from the image management server 3 to the photo sticker creating apparatus 1 as indicated by an arrow A12 in FIG. The photo sticker creating apparatus 1 controls the progress of the game according to the result of user authentication. User U1, who is an authorized user, can use the game of photo sticker creating apparatus 1 as a subscription service together with user U2. If the user authentication using the first shot image is successful, the processing after the second shot is performed.

User authentication as described above is performed, for example, based on a photographed image obtained by the photographing each time photographing is performed.

FIG. 8 is a diagram showing an example of timing for performing user authentication.

After the user U1 and the user U2 enter the shooting booth and shooting is started, a live view image is displayed on the shooting monitor provided in the shooting booth. After a certain period of time has passed since the display of the live view image, the first shooting is performed, and user authentication is performed based on the shot image P1 obtained by the first shooting.

Also, a second image capturing is performed, and user authentication is performed based on the captured image P2 obtained by the second image capturing. In this manner, user authentication is repeated each time an image is captured. When the user authentication is performed based on the photographed image P5 obtained by the last photographing, for example, the fifth photographing, the user authentication is finished together with the photographing.

Depending on the orientation of the face, the user authentication may not be successful in one authentication even when the authorized user is taking a picture. In addition, there is a case where the photographing is performed in a state in which only the user U2 who is playing with the user U1 who is the authorized user is shown.

By repeating user authentication in this way, it is possible to more reliably determine that an authorized user is being photographed. A flag indicating whether or not an authorized user is captured may be set for each captured image.

If user authentication is successful once, subsequent user authentication may not be performed. In the case where user authentication is performed for each shooting, it may be determined that the user authentication for the entire game has been successful when there is at least one captured image in which the authorized user is captured.

Alternatively, the user may be guided to take a picture while the authorized user is in the picture. Such guidance is provided, for example, by voice from a speaker provided in the photography booth of the photo sticker creating apparatus 1, or by screen display on a photography monitor.

FIG. 9 is a diagram showing another example of timing for performing user authentication.

As shown in FIG. 9, user authentication may be performed based on five shot images obtained by five shots after all shots are completed. When the fifth photographing is completed, the photographed images P1 to P5 are transmitted together with the user ID from the photo sticker creation device 1 to the image management server 3, and the face image extracted from each photographed image and the member information are displayed. User authentication is performed based on the face image of the registered user U1.

For example, if the user U1, who is an authorized user, appears in at least one of the five captured images, the user authentication is successful. User authentication success criteria can be set arbitrarily, such as when the authorized user appears in two or more captured images, or when the authorized user appears in all the captured images. be.

In this way, user authentication can be performed only once using a plurality of captured images after the last capture.

The details of the processing of the photo sticker creating apparatus 1 that performs user authentication as described above and controls the progress of the game based on the user authentication results will be described later.

<Configuration of each device>
Configuration of Photo Sticker Making Apparatus 1 FIG. 10 is a perspective view showing the appearance of the photo sticker making apparatus 1 .

As shown in FIG. 10, a pre-operation unit 21 is provided on the side surface of the photo sticker creating apparatus 1 having a box-shaped housing. The pre-operation unit 21 is a device used for pre-selection operations such as selection of the number of users playing together and selection of a shooting course. A touch panel monitor 21A is provided above the pre-operation unit 21 . Below the touch panel monitor 21A, a coin slot 21B for paying the play fee is provided. A code reader 21C for reading code information displayed on the smartphone 2 is provided on the left side of the coin slot 21B.

Screens used for various selections are displayed on the touch panel monitor 21A. After making various selections according to the display on the touch panel monitor 21A, the user enters the photography booth from the doorway G and takes pictures. A box-shaped photographing unit 31 containing a camera 31A is provided in front of the photographing booth. The photographing unit 31 is provided with a photographing monitor 31B.

An editing section 41 is provided on the left side of the pre-operation section 21 . The editing unit 41 is a device used for editing a photographed image obtained by photographing with the camera 31A. A user who has taken a photograph in the photographing booth moves to the editing booth in front of the editing unit 41 and edits the photographed image. An editing monitor 41A is provided on a slope formed above the editing section 41 . A screen used for editing the captured image is displayed on the editing monitor 41A.

FIG. 11 is a block diagram showing a configuration example of the photo sticker creating apparatus 1. As shown in FIG. Among the configurations shown in FIG. 11, the same reference numerals are assigned to the same configurations as those described above. Duplicate explanations will be omitted as appropriate.

As shown in FIG. 11, in the photo sticker creating apparatus 1, a pre-operation unit 21, a photographing unit 31, an editing unit 41, a communication unit 102, and a printing unit 103 are connected to a control unit 101 composed of a PC. It is composed by

The control unit 101 executes a predetermined program by the CPU and controls the overall operation of the photo sticker creating apparatus 1 in accordance with the progress of the game. The control unit 101 implements a game control unit 111 and an authentication result acquisition unit 112 by executing a predetermined program.

The game control unit 111 controls a series of game processing such as pre-selection processing, shooting processing, editing processing, and printing processing.

The pre-selection process is a process that causes the user to perform pre-selection work such as selection of an imaging course.

The photographing process is a process for causing the user to perform photographing work with the user as the subject.

The editing process is a process that causes the user to edit the photographed image obtained by the photographing process.

The printing process is a process of arranging the edited images obtained by the editing process in a predetermined layout and printing them on sticker paper. A sticker sheet on which an edited image is printed is provided to the user from an outlet provided at a predetermined position of the housing of the editing section 41 .

The authentication result acquisition unit 112 requests user authentication by controlling the communication unit 102 and transmitting the captured image supplied from the imaging unit 31 to the image management server 3 . The authentication result acquisition unit 112 acquires the user authentication result transmitted from the image management server 3 .

The pre-operation unit 21 displays a predetermined screen on the touch panel monitor 21A and allows the user to make various selections before starting shooting. The pre-operation unit 21 accepts the user's selection and outputs information representing the content of the selection to the control unit 101 .

The photographing unit 31 drives the camera 31A to photograph the user in the photography booth as a subject. For example, a plurality of photographed images are acquired by performing photographing a plurality of times. A photographed image acquired by the photographing unit 31 is supplied to the control unit 101 .

The editing unit 41 performs editing processing for users in the editing booth. The editing process includes image processing for editing the captured image. Editing of the captured image is performed using an editing screen displayed on the editing monitor 41A. After editing the photographed image, the editing unit 41 arranges the edited image in a predetermined layout to generate print data and outputs the print data to the control unit 101 . The above-described selection of processing may be performed when editing the captured image.

A communication unit 102 communicates with an external device such as the image management server 3 . The communication unit 102 transmits the captured image used for user authentication to the image management server 3 . The communication unit 102 also transmits images to be provided to the user to the image management server 3 via the server.

The printing unit 103 has a printer. The printing unit 103 drives the printer and prints the edited photographed image on the sticker paper based on the print data.

- Configuration of smart phone 2 FIG. 12 is a block diagram showing a configuration example of the smart phone 2 .

As shown in FIG. 12 , the smartphone 2 is provided with a control section 201 , a communication section 202 , a memory 203 , a display 204 , an operation section 205 and a camera 206 .

The control unit 201 is configured by a CPU, ROM, RAM, and the like. The control unit 201 controls the overall operation of the smartphone 2 by executing a predetermined program.

An application execution unit 201A is realized in the control unit 201 . By executing the image management application 2A by the application execution unit 201A, processing such as membership registration processing and display of a membership card screen is realized. The image management application 2A manages information such as a user ID for using services provided by the image management server 3. FIG. When presenting the membership card, the image management application 2A causes the display 204 to display a membership card screen including code information generated based on the user ID.

The communication unit 202 communicates with the image management server 3 via the Internet. The communication unit 202 receives information transmitted from the image management server 3 and outputs the information to the control unit 201 .

The memory 203 is composed of a flash memory or the like. The memory 203 stores various information such as images downloaded from the image management server 3 and applications executed by the control unit 201 .

The display 204 is configured by an organic EL display, LCD, or the like. The display 204 displays various screens such as the screen of the image management application 2A.

An operation unit 205 includes various buttons and a touch panel provided over the display 204 . The operation unit 205 outputs a signal representing the content of the user's operation to the control unit 201 .

The camera 206 takes pictures of various subjects including the user at the time of membership registration. The camera 206 may be used to read the code information displayed on the photo sticker creating apparatus 1 .

Configuration of Image Management Server 3 FIG. 13 is a block diagram showing an example of the hardware configuration of the image management server 3. As shown in FIG.

As shown in FIG. 13, the image management server 3 is composed of a computer. The image management server 3 may be configured by a plurality of computers. When the image management server 3 is composed of a plurality of computers, various processes of the image management server 3 are realized by cooperation of the respective computers.

A CPU (Central Processing Unit) 301 , ROM (Read Only Memory) 302 , and RAM (Random Access Memory) 303 are interconnected by a bus 304 .

An input/output interface 305 is further connected to the bus 304 . An input unit 306 , an output unit 307 , a storage unit 308 , a communication unit 309 and a drive 310 are connected to the input/output interface 305 .

The input unit 306 is composed of a keyboard, a mouse, and the like. The output unit 307 is configured by a display or the like.

A storage unit 308 is configured by a hard disk, a nonvolatile memory, or the like. A storage unit 308 stores various kinds of information used for providing an image providing service, such as programs executed by the CPU 301 and images uploaded from the photo sticker creating apparatus 1 . A member information DB 11 and an image DB 12 are constructed in the storage unit 308, for example.

A communication unit 309 is an interface to the Internet. For example, the communication unit 309 communicates with the photo sticker creating apparatus 1 and receives images uploaded from the photo sticker creating apparatus 1 . The communication unit 309 also communicates with the smartphone 2 and transmits various types of information such as information used for screen display and images selected to be downloaded to the smartphone 2 .

The drive 310 controls writing data to the removable medium 311 and reading data from the removable medium 311 .

FIG. 14 is a block diagram showing a functional configuration example of the image management server 3. As shown in FIG.

As shown in FIG. 14, the image management server 3 implements an information processing section 321 . The image management server 3 is an information processing device having an information processing section 321 .

The information processing section 321 is composed of an authentication section 331 and an image management section 332 . At least some of the functional units shown in FIG. 14 are implemented by the CPU 101 executing a predetermined program.

Authentication unit 331 acquires the photographed image transmitted from photo sticker creating apparatus 1 and received by communication unit 309 . The authentication unit 331 performs user authentication based on the photographed image transmitted from the photo sticker creating apparatus 1 and the face image managed in the member information DB 11 , and transmits the user authentication result to the photo sticker creating apparatus 1 . A result of user authentication by the authentication unit 331 is supplied to the image management unit 332 as appropriate.

The image management unit 332 associates images uploaded from the photo sticker creation apparatus 1 and received by the communication unit 109 with management information and stores them in the image DB 12 . The image management unit 332 controls the communication unit 109 to transmit the image of the user who uses the image providing service to the smart phone 2 . The image providing service is a service for providing an image created by the user during the game to the user using the photo sticker creating apparatus 1 . As will be described later, provision of images in the image provision service is controlled according to the result of user authentication.

<Operation of each device>
A series of processes including user authentication performed between the photo sticker creating apparatus 1 and the image management server 3 will be described with reference to the flowchart of FIG. The process of FIG. 15 is started, for example, when the user operates the smartphone 2 to display the membership card screen on the display 204 and points it toward the code reader 21C.

In step S1, the code reader 21C of the photo sticker creating apparatus 1 reads the code information displayed on the membership card screen.

In step S2, the game control section 111 of the control section 101 controls the pre-operation section 21 to perform pre-selection processing.

In step S3, the game control section 111 controls the photographing section 31 to perform photographing processing.

In step S<b>4 , the authentication result acquisition unit 112 transmits the captured image to the image management server 3 . Information such as the user ID is also sent to the image management server 3 along with the captured image as appropriate. When user authentication is performed for each photographing, the transmission of the photographed image by the authentication result acquisition unit 112 is performed each time photographing is performed. Further, in the case where user authentication is performed after the photographing is finished, the authentication result acquisition unit 112 transmits the photographed image when the photographing is finished.

In step S<b>11 , the authentication unit 331 of the image management server 3 receives the captured image transmitted from the photo sticker creating apparatus 1 .

In step S<b>12 , the authentication unit 331 performs user authentication based on the received photographed image and the face image managed in the member information DB 11 .

In step S<b>13 , the authentication unit 331 transmits the result of user authentication to the photo sticker creating apparatus 1 .

In step S<b>5 , the authentication result acquisition unit 112 of the photo sticker creating apparatus 1 acquires the user authentication result transmitted from the image management server 3 .

In step S6, the game control section 111 controls the progress of the game according to the result of user authentication.

If the user authentication is successful, the game control section 111 proceeds with the game thereafter. If the user authentication succeeds, the game is played with the same contents as when the game is started by inserting money.

For example, in a case where user authentication is performed for each photographing, if user authentication using the first photographed image is successful, the second and subsequent photographings are continued. Also, in the case where user authentication is performed after the end of photographing, if user authentication using a photographed image is successful, the user is guided to move to an editing booth, and processing after the editing process is continued.

Successful user authentication may be presented to the user in the photography booth.

On the other hand, when user authentication fails, the game control unit 111 performs a process different from that performed when user authentication succeeds. A process different from when the game is started by inserting money is performed.

For example, in a case where user authentication is performed for each photographing and user authentication using the first photographed image fails, the game control unit 111 stops the progress of the game (interrupts the progress of the game) before the second photographing. cause). Similarly, when user authentication using a captured image fails in the case where user authentication is performed after the end of photography, progress of the game is also stopped.

If user authentication fails, the user may be guided to continue the game by paying money. When the user pays the money according to the guidance, the game is restarted. In this case, a money slot is provided in the photography booth. Payment may be made by operating the smart phone 2 and making a cashless payment.

When user authentication succeeds, or when user authentication fails and payment is made, the game control unit 111 controls the editing unit 41 to perform editing processing in step S7.

In step S<b>8 , the game control section 111 controls the communication section 102 to upload the captured image to the image management server 3 . For example, a captured image before editing and a captured image after editing are transmitted to the image management server 3 .

In step S<b>14 , the image management section 332 of the image management server 3 receives the image uploaded from the photo sticker creating apparatus 1 .

In step S<b>15 , the image manager 332 saves the received image in the image DB 12 .

On the other hand, in step S9, the game control section 111 controls the printing section 103 to perform print processing. A series of processing ends when the user receives the seal paper on which the edited photographed image is printed.

Thus, the user can use the game of the photo sticker creating device 1 provided as a subscription service without being aware that face authentication is being performed.

On the side of the subscription service provider, it is possible to prevent the game of the photo sticker creating apparatus 1 from being illegally used as a subscription service by users other than authorized users. That is, even if a user borrows a smart phone from an authorized user and presents the authorized user's membership card to start playing the game, the user who started the game is determined as an unauthorized user by user authentication using a face image. Therefore, it becomes impossible to continue the normal game. By preventing unauthorized use, it becomes possible to increase the number of subscribers to subscription services.

<Another example of game progression>
If user authentication fails at the time of shooting, the game may proceed as is, and uploading to the image management server 3 may not be performed. Further, the printing process may not be performed, and the seal paper on which the photographed image is printed may not be provided. In this case, a user who fails user authentication cannot receive the image created during the game as data via the server or in the form printed on sticker paper.

Instead of restricting both the uploading to the image management server 3 and the printing process, only one of the uploading to the image management server 3 and the printing process may be restricted.

Instead of restricting uploading of all captured images, only images for which user authentication has failed may be uploaded, and images for which user authentication has succeeded may be uploaded.

In addition, instead of restricting printing of all captured images, only images for which user authentication has failed are not printed, and images for which user authentication has succeeded are printed on sticker paper and provided to the user. may

<User authentication (example of performing user authentication on the photo sticker creation device side)>
User authentication may be performed by the photo sticker creating device 1 instead of the image management server 3 .

FIG. 16 is a diagram showing an example of the flow of user authentication when user authentication is performed by the photo sticker creating apparatus 1. As shown in FIG. Description of the same processing as the processing described with reference to FIG. 5 will be omitted as appropriate.

As shown on the left side of FIG. 16, when the user U1 operates the image management application 2A and presents the membership card, the game is started. After presenting the membership card and causing the photo sticker creating apparatus 1 to read the code information, the users U1 and U2 select the number of people and the photography course as preselection work.

After completing the pre-selection work, the users U1 and U2 enter the photography booth according to the guidance and take pictures.

After the code information is read, the photo sticker creating apparatus 1 transmits the user ID included in the code information to the image management server 3 as indicated by an arrow A31.

The image management server 3 receives the user ID transmitted from the photo sticker creating apparatus 1, and reads the member information of the user U1 from the member information DB 11 based on the user ID. Image management server 3 transmits the face image of user U1 included in the member information to photo sticker creating apparatus 1, as indicated by arrow A32.

The photo sticker creating apparatus 1 receives the face image transmitted from the image management server 3, and performs user authentication based on the received face image and the photographed image obtained by the photographing process. User authentication by the photo sticker creating apparatus 1 is also performed for each face appearing in the photographed image as described with reference to FIG. User authentication by the photo sticker creating apparatus 1 may also be performed each time a photograph is taken, or may be performed after the completion of the photographing.

After user authentication, the photo sticker creating apparatus 1 controls the progress of the game according to the user authentication result.

In this manner, it is also possible to provide a registered face image from the image management server 3 to the photo sticker creating apparatus 1 and perform user authentication in the photo sticker creating apparatus 1 .

<Other processing based on user authentication result>
User authentication may not be performed during the game, but may be performed when an image is obtained (image acquisition) after the game ends.

Image get is a process of downloading an image uploaded from the photo sticker creating device 1 to the image management server 3 to the user's smartphone 2 or saving it on the My Page screen. The My Page screen is a user-dedicated screen (region) assigned to each user who has registered as a member of the image management service provided by the image management server 3 . By using the image management application 2A, it is possible to view the images saved on the My Page screen. The provision of the image by the image get is the provision of the image via the server described above.

Image Management Service FIG. 17 is a diagram showing an example of image management in the image management service. In the example of FIG. 17, only one photo sticker creating device 1 is shown, but in reality, a plurality of photo sticker creating devices 1 sold by the same manufacturer are provided.

The photo sticker creating apparatus 1 provides the image created by the game by printing it on sticker paper and providing the image to the user by making it viewable on the smartphone 2 . As shown in FIG. 17, the image created in the game is transmitted (uploaded) from the photo sticker creation device 1 to the image management server 3 . For example, 5 images created in the game are uploaded.

Management information is added to images uploaded from the photo sticker creating apparatus 1 . The management information is information generated in the photo sticker creating apparatus 1 and transmitted to the image management server 3 in order to manage uploaded images. In the image management server 3, the uploaded image is stored in the image DB 12 in association with each piece of information included in the management information.

The management information includes seal IDs, e-mail addresses, and the like.

The sticker ID is an ID issued by the photo sticker creating apparatus 1 according to a predetermined rule for each game. Since it is an ID issued each time a game is played, it can be said that it is an ID for identifying the game.

For example, the sticker ID is also notified to the user in a state of being printed on the edge of the sticker paper on which the edited image is printed. When the user of the smartphone 2 who has performed the login operation for the image management service on the image management application 2A inputs the sticker ID by looking at the edge of the sticker paper, the image management server 3 allows the user of the smartphone 2 to create an ID during the game. image is identified. In this way, the sticker ID is used to specify the image created by each user in each game.

The e-mail address is the user's e-mail address entered during the game.

The user's e-mail address is used by the image management server 3, for example, to notify by e-mail (e-mail) the URL assigned as the storage destination of the image. If there are two users, each user's mail address is included in the management information. For example, an e-mail address is entered at a predetermined timing such as when editing of a captured image is finished.

After such upload is performed, the user can access the image management server 3 by operating the image management application 2A, for example, and obtain the image created in the game. On the screen of the image management application 2A, images uploaded from the photo sticker creating apparatus 1 and available for download, images that can be stored on the My Page screen, and the like are displayed as thumbnails.

FIG. 18 is a diagram showing the flow of user authentication when obtaining an image.

As shown on the left side of FIG. 18, when the user U1 is displaying uploaded images and an instruction is given to get a predetermined image, the image management application 2A directs the user U1, as indicated by an arrow A41. requests the image management server 3 to get the image selected by .

The image management server 3 reads the member information of the user U1 from the member information DB 11 based on the user ID of the user U1. When the image management application 2A that manages the user ID of the user U1 accesses, the user ID of the user U1 is specified by the image management server 3. FIG.

In addition, the image management server 3 performs user authentication based on the photographed image requested to obtain the image and the face image of the user U1 included in the member information. If the user U1, who is an authorized user, appears in the photographed image for which the image get is requested, the user authentication is successful. Further, if the user U1, who is the authorized user, is not shown in the photographed image for which the image get is requested, the user authentication fails.

When the user authentication is successful, the image management server 3 permits the image acquisition of the requested photographed image, and provides the photographed image to the user. In this case, downloading to the smartphone 2, saving to the My Page screen, and the like are performed.

On the other hand, if the user authentication fails, the image management server 3 restricts the image acquisition of the requested photographed image and does not provide the photographed image to the user. Downloading to the smartphone 2, saving to the My Page screen, etc. are not performed.

FIG. 19 is a diagram showing an example of an image provided when user authentication is successful. It is assumed that five captured images P1 to P5 shown on the left side of FIG. 19 have been uploaded from the photo sticker creating apparatus 1 as images captured in one game.

If the user U1, who is an authorized user, appears in the photographed image for which the image get is requested, the user authentication is successful. As shown on the right side of FIG. 19, for example, captured images P1 to P3 in which a user U1 requesting an image get is shown are images that can be provided.

On the other hand, if the user U1, who is an authorized user, is not shown in the photographed image for which the image get is requested, the user authentication fails. As shown on the right side of FIG. 19, for example, the photographed images P4 and P5 in which the user U1 requesting the image acquisition is not shown are images that cannot be provided.

In this example, even if the images are captured in the same game, the captured images in which the user U1 is not shown are treated as images that cannot be provided.

As shown in FIG. 20, even if the image does not include the user U1, the image captured in the same game as the image including the user U1 who is the authorized user is treated as an image that can be provided. may As a result, user U1, who is an authorized user, can obtain an image of an image taken in a state in which only user U2, who is a friend who played the game together, is shown.

<Modification>
Although the membership card for using the subscription service is prepared as a function of the image management application 2A, it may be physically prepared using a card using materials such as paper and resin. . Code information including a user ID is printed on the surface of the membership card. When using the game by the subscription service, the user causes the photo sticker creating device 1 to read the code information printed on the membership card and starts the game.

The game of the photo sticker creating device 1 can be started by reading the code information displayed on the screen of the smartphone 2 into the code reader 21C of the photo sticker creating device 1. The game of the photo sticker creating device 1 may be started by reading the displayed code information on the smartphone 2 side.

In this case, for example, on the touch panel monitor 21A provided in the pre-operation unit 21 of the photo sticker creating apparatus 1, code information such as a two-dimensional code including the housing ID assigned to the housing of the photo sticker creating apparatus 1 is displayed. Is displayed. The user takes an image of the code information with the camera 206 of the smartphone 2 and causes the image management application 2A to read the housing ID of the photo sticker creating device 1 .

The housing ID of the photo sticker creating apparatus 1 read by the image management application 2A is transmitted to the image management server 3 together with the user ID managed by the image management application 2A, thereby using the photo sticker creating apparatus 1. The user ID of the user is specified by the image management server 3 . In the image management server 3, the user's face image is specified based on the user ID, and user authentication and the like are performed.

The image used for user authentication is taken during the shooting process using the camera 31A installed in the shooting booth. You may make it image|photographed using. For example, a camera provided in the pre-operation unit 21 can be used to photograph the user before entering the photography booth.

- Program The series of processes described above can be executed by hardware or by software. When a series of processes is executed by software, a program that constitutes the software is installed in a computer built into dedicated hardware or a general-purpose personal computer.

The program to be installed is provided by being recorded on removable media 311 shown in FIG. Alternatively, it may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be pre-installed in the ROM 302 or storage unit 308 .

The program executed by the computer may be a program in which processing is performed in chronological order according to the order described in this specification, or a program in which processing is performed in parallel or at necessary timing such as when a call is made. It may be a program that is carried out.

In this specification, a system means a set of multiple components (devices, modules (parts), etc.), whether or not all components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a single device housing a plurality of modules in one housing, are both systems. .

The effects described herein are only examples and are not limiting, and other effects may also occur.

Embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

For example, the present technology can take a configuration of cloud computing in which one function is shared by a plurality of devices via a network and processed jointly.

Further, each step described in the flowchart above can be executed by one device, or can be shared by a plurality of devices and executed.

Furthermore, when one step includes a plurality of processes, the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices.

1 photo sticker creation device, 2 smartphone, 3 image management server, 11 member information DB, 12 image DB, 21 pre-operation unit, 21C code reader, 31 photographing unit, 41 editing unit, 101 control unit, 111 game control unit, 112 Authentication result acquisition unit, 321 information processing unit, 331 authentication unit, 332 image management unit

Claims (14)

a storage unit that stores a face image registered by a user;
User authentication for determining whether or not the user is captured in a photographed image taken by a photographing device that provides a game including photographing processing for photographing the user as a subject, based on the photographed image and the face image. and an information processing device comprising: The information processing apparatus according to claim 1, wherein the authentication unit performs the user authentication based on the face image stored in association with the user ID transmitted as the identification information of the user. 3. The information according to claim 1, wherein the authentication unit performs the user authentication based on the captured image transmitted from the imaging device during the game, and transmits a result of the user authentication to the imaging device. processing equipment. 4. The information processing according to claim 3, wherein when the result of the user authentication indicates that it is determined that the user is not captured in the photographed image, progress of the game is stopped in the photographing device. Device. 5. The information processing apparatus according to claim 3, wherein the authentication unit performs the user authentication based on the captured image transmitted from the imaging device each time an image is captured. 5. The information processing apparatus according to claim 3, wherein the authentication unit performs the user authentication based on each of a plurality of the captured images transmitted from the imaging device after a plurality of times of imaging. further comprising an image storage unit that stores the captured image transmitted from the imaging device;
The information processing apparatus according to claim 1 or 2, wherein the authentication unit performs the user authentication based on the captured image selected by the user. 8. The image management unit according to claim 7, further comprising an image management unit that does not provide the photographed image to the user when the result of the user authentication indicates that the user is not shown in the photographed image. information processing equipment. If the photographed image in which the user is photographed is at least one of a plurality of the photographed images photographed in one game, the authenticating unit determines whether the user is photographed in the photographed image. 9. The information processing apparatus according to any one of claims 1 to 8, wherein the information processing apparatus determines that the The authenticating unit determines that the user appears in the captured image when at least one user whose face image has been registered is included in a plurality of persons appearing in the captured image. The information processing apparatus according to any one of claims 1 to 9. In the photographing device, the photographed image subjected to predetermined image processing is provided to the user as a product of the game,
11. The information processing apparatus according to any one of claims 1 to 10, wherein the authentication unit performs the user authentication based on an original image of the captured image that has not been subjected to the predetermined image processing. The information processing device
storing a face image registered by a user;
User authentication for determining whether or not the user is captured in a photographed image taken by a photographing device that provides a game including photographing processing for photographing the user as a subject, based on the photographed image and the face image. How to process information. to the computer,
storing a face image registered by a user;
User authentication for determining whether or not the user is captured in a photographed image taken by a photographing device that provides a game including photographing processing for photographing the user as a subject, based on the photographed image and the face image. A program to execute a process. a photographing unit for photographing a user as a subject;
Determining whether or not the user is shown in the photographed image based on the photographed image photographed by the photographing unit and the face image provided from an information processing device that stores the face image registered by the user. an authentication unit that performs user authentication for
and a control unit that controls progress of a game including shooting of the user as a subject according to a result of the user authentication.

Images