JP5790034B2 - Automatic photo creation device - Google Patents

Description

  The present invention relates to an automatic photo creation apparatus, and more particularly to an automatic photo creation apparatus that takes a user with a camera and outputs a composite image generated based on the taken image as a photograph.

  2. Description of the Related Art Conventionally, there is known a photo creation device for a game in which a user is photographed with a camera and the photographed image is output as a photo sticker or a photo card. Such a play photo creation device is highly playable or entertaining, and therefore, a variety of background images and foreground images (foreground images) prepared in advance according to the user's preference are combined with images to be synthesized. In particular, many are configured so that the user can select from frame images) or draw freely using a touch pen. Since such an operation by the user is performed on the photographed image, it is called “graffiti”.

  In addition, since such a game photo creation device is often used by a plurality of users, it is configured to provide an operation screen operated by each of the plurality of users (for example, Patent Document 1). reference).

  In recent years, the composite image that has been photographed and graffitied can be used on a mobile phone terminal, such that the composite image is directly transmitted from the game photo creation device to the mobile phone terminal, or the composite image is transmitted to a server. There is one that can be transferred once and downloaded later by a mobile phone terminal (for example, see Patent Document 2).

JP 2007-67565 A JP 2008-109580 A

  In such an amusement photo creation device, it is often played by two users, but may be played by three or more users. The frame image or stamp image for graffiti, the background image, or the divided layout of the output photo generally has a mode suitable for the number of users who play. Therefore, these are usually grouped according to the number of users (for example, for 2 or 3 users) and adapted to the number of users by user input (selecting tabs, etc.) In many cases, the selected group can be selected.

  However, the operation input for the above selection may be bothersome for the user. In particular, in the photo creation device for play in which the use time is limited, the play time of the user is substantially reduced. Become. In addition, when the user is not grouped by the number of users, it may be difficult to select an item suitable for the number of users.

  Accordingly, the present invention provides an automatic photo creation device that can display an operation screen having a display mode suitable for the number of users even when the number of users is not input by the user. With the goal.

The first invention is an automatic photo creation device comprising photographing means for photographing a user and output means for outputting a composite image including a photographed image obtained by the photographing means as a photograph,
Number of people detecting means for detecting the number of users by detecting the user's face part included in the captured image;
Display means;
Input means for accepting an operation by the user;
An operation screen for the operation, the operation screen having a display mode according to the number of users detected by the number-of-users detection means among a plurality of display modes provided in advance according to the number of users. An operation screen control means for displaying on the display means ,
When the number of operation screens displayed on the display unit for a set of users is plural, the number of people detection unit detects the number of users for each captured image to be included in the operation screen,
The operation screen control means is a plurality of operation screens for generating the composite images, respectively, and a plurality of operation screens having display modes corresponding to the number of users detected by the number of people detection means, It is displayed on the display means .

According to a second invention, in the first invention,
The operation screen control means causes the display means to display an operation screen that can accept an operation by the user according to a number different from the number of users detected by the number of persons detection means. It is characterized by that.

According to a third invention, in the second invention,
The operation screen control means has an operation screen capable of accepting an operation by the user by the input means for switching to an operation screen having a display mode corresponding to a number different from the number of users detected by the number of people detection means. And displaying on the display means.

According to a fourth invention, in any one of the first to third inventions,
The operation screen control means causes the display means to display a number of operation screens corresponding to the number of users detected by the number of people detection means.

According to a fifth invention, in any one of the first to fourth inventions,
The operation screen control means causes the display means to display a palette area that includes a plurality of selectable areas for an input operation performed by the input means and in which at least a part of the included selectable areas can be replaced. In addition, among the plurality of selectable areas grouped in advance, a plurality of selectable areas included in a group corresponding to the number of users detected by the number of people detecting means are initially displayed on the palette area. Features.

A sixth invention is the first or second invention, wherein
The operation screen control means causes the display device display a plurality of selectable area for input operation to be performed by the input unit, among the plurality of selectable regions displayed, is detected by the number detecting means One or more selectable areas associated with the number of users are displayed in a display mode that allows them to be distinguished from other selectable areas.

According to a seventh invention, in any one of the first to third inventions,
The photographing means performs the photographing a plurality of times,
The operation screen control means uses the number-of-people detection means to select a plurality of selectable areas for allowing the user to select an additional image including at least one of a foreground image and a background image to be combined with the captured image. A plurality of predetermined selectable areas are displayed before the number of users is detected, and after the number of users is detected by the number detection means, the number of users to be detected is A plurality of selectable areas are displayed in a corresponding display mode.

In an eighth aspect based on the seventh aspect ,
The photographing means performs an operation of performing the photographing once or more as one set, and performs the operations in two sets or more in order,
The operation screen control means causes the display means to display a plurality of selectable areas for allowing the user to select an additional image including at least one of a foreground image and a background image to be combined with the captured image. A plurality of predetermined selectable areas are displayed before the first set, and after the first set, the user detected by the number detection means with respect to a photographed image obtained by photographing by the photographing means A plurality of selectable areas are displayed in a display mode corresponding to the number of the display areas.

According to a ninth invention, in any one of the first to third inventions,
The photographing means continuously performs the photographing,
The operation screen control means detects a plurality of selectable areas for allowing the user to select an additional image including at least one of a foreground image and a background image to be combined with the photographed image by the number detection means. A plurality of selectable areas are displayed in a display mode according to the number of users to be
The number-of-person detection means is an image continuously acquired by photographing by the photographing means before or during display of the plurality of selectable areas by the operation screen control means, and is synthesized with the composite image. The number of users is detected by detecting a face portion of the user included in an image different from the captured image.

According to a tenth invention, in any one of the first to ninth inventions,
The input means includes operation means as two or more pointing devices respectively corresponding to two or more operation screens, and input operations by a plurality of users corresponding to different operation screens displayed on the display means. It is characterized by accepting in parallel.

An eleventh aspect of the invention is a photographing step for photographing a user;
An automatic photo creation method comprising an output step of outputting a composite image including a photographed image obtained in the photographing step as a photograph,
Detecting the number of users by detecting the user's face part included in the captured image; and
A display step;
An input step for accepting an operation by the user;
An operation screen for the operation, the operation screen having a display mode corresponding to the number of users detected in the number-of-users detection step among a plurality of display modes provided in advance according to the number of users And an operation screen control step for displaying in the display step ,
In the number detection step, when there are a plurality of operation screens displayed in the display step for a set of users, the number of users is detected for each captured image to be included in the operation screen,
In the operation screen control step, a plurality of operation screens for generating the composite images, respectively, and a plurality of operation screens having display modes corresponding to the number of users detected in the number of people detection step, The display is performed in the display step .

In a twelfth aspect of the present invention, an automatic photo creating apparatus which is a computer
A shooting step for shooting the user;
An output step of outputting a composite image including a photographed image obtained in the photographing step as a photograph;
Detecting the number of users by detecting the user's face part included in the captured image; and
A display step;
An input step for accepting an operation by the user;
An operation screen for the operation, the operation screen having a display mode corresponding to the number of users detected in the number-of-users detection step among a plurality of display modes provided in advance according to the number of users And an operation screen control step for displaying in the display step ,
In the number detection step, when there are a plurality of operation screens displayed in the display step for a set of users, the number of users is detected for each captured image to be included in the operation screen,
In the operation screen control step, a plurality of operation screens for generating the composite images, respectively, and a plurality of operation screens having display modes corresponding to the number of users detected in the number of people detection step, A program to be displayed in the display step .

According to the first aspect of the invention, the number of users detecting the face portion of the user included in the photographed image by the number detection means, the number of users is detected, and the operation of the display mode according to the number of detected users Since the screen is displayed, even if the number of users is not entered by the user, the number of users is automatically detected, and an operation screen having a display mode suitable for the number is displayed. Can do. Therefore, selection or operation by the user can be facilitated.
In addition, since the number of users is detected for each captured image to be included in a plurality of operation screens, and a plurality of operation screens with display modes corresponding to the number of detected users are displayed, operation An operation screen having a display mode suitable for each screen can be displayed. Therefore, selection or operation by the user can be facilitated.

  According to the second aspect, since the operation screen that can accept the operation by the user according to the number different from the number of users detected by the number detection means is displayed, the user's preference is met. Different selections can be prevented from being disturbed, and even if the number of users detected by the face recognition process is incorrect, correct selection (according to preferences) by the user is not disturbed. be able to.

  According to the third aspect of the invention, an operation by a user (for example, changing the number of divisions of the operation screen or switching the tag) is switched to an operation screen having a display mode corresponding to a number different from the number of users detected by the number-of-people detection means The operation screen that can accept the display change etc. is displayed, so that different selection according to the user's preference and correct selection by the user when the face recognition process is wrong should not be disturbed Can do.

  According to the fourth aspect, since the number of operation screens corresponding to the number of users is automatically displayed, the operation by the user can be facilitated.

According to the fifth aspect , since a plurality of selectable areas included in the group corresponding to the number of detected users are initially displayed in the palette area, the selection by the user without making the user aware of it. Can be made easier.

According to the sixth aspect, since one or more selectable areas associated with the number of detected users are displayed in a display mode that can be distinguished from other selectable areas, the user is conscious. By doing so, selection by the user can be facilitated.

According to the seventh aspect , a plurality of predetermined selectable areas are displayed before the number of users is detected by the number detection means, and after the detection, the photographed image obtained by photographing is displayed. Since a plurality of selectable areas are displayed in a display mode according to the number of users detected in this manner, a display mode different from that before detection of the number of users is displayed before each subsequent shooting (not predicted by the user). Display), the playability of the device can be improved.

According to the eighth aspect of the invention, a plurality of predetermined selectable areas are displayed before the first set shooting, and after the first set shooting, detection is performed on a shot image obtained by the first and subsequent shootings. Since a plurality of selectable areas are displayed in a display mode according to the number of users, the display mode is different from that before the first set (first time) and before each subsequent shooting (after the second time) (users) The display device can be improved in the playability of the device.

According to the ninth aspect , detection is performed before or during display of a plurality of selectable areas by the operation screen control unit, based on images (typically through images) continuously obtained by the imaging unit. Since a plurality of selectable areas are displayed in a display mode according to the number of users, the display mode according to the number of users detected before acquisition of a captured image to be synthesized without being conscious of the user. The operation screen is displayed. Therefore, an operation screen having a display mode suitable for the number of users can be displayed, and selection or operation by the user can be facilitated.

According to the tenth invention, two or more operation screens are displayed, and input operations by a plurality of users corresponding to different operation screens are accepted in parallel. The number of selectable areas such as selectable tools that match each other can be increased on each operation screen, and the playability of the device can be further enhanced.

According to the eleventh aspect of the invention, the effect of the first device invention can be similarly achieved in the method invention.

According to the twelfth aspect , the effect of the first aspect of the invention can be similarly achieved in the invention of the program.

It is a figure which shows the external appearance of the photo production apparatus for games which is an automatic photo production apparatus which concerns on one Embodiment of this invention. It is a front view of the imaging unit in the embodiment. It is a front view of the edit unit in the said embodiment. It is a front view of the output unit in the said embodiment. It is a schematic diagram which shows the display structure of the touchscreen for imaging operations in the said embodiment. It is a block diagram which shows the structure which looked at the principal part of the photo production apparatus for play concerning the said embodiment from the functional surface. It is a schematic diagram which shows the display structure of the touch panel for imaging operations including the selection operation area | region before the first imaging in the said embodiment. It is a schematic diagram which shows the display structure of the touch panel for imaging operations including the selection operation area | region after the first imaging in the said embodiment. It is a schematic diagram showing another example of the display configuration of the selection operation area before shooting in the embodiment, It is a schematic diagram which shows another example of the display structure of the selection operation area | region after imaging | photography in the said embodiment. In the said embodiment, it is a schematic diagram which shows the display structure of the touch panel 400 for edit operation in case two users play. In the said embodiment, it is a schematic diagram which shows the display structure of the touch panel 400 for edit operation in case three users play. It is a schematic diagram which shows an example of the display structure of the palette in the said embodiment. It is a schematic diagram which shows another example of the display structure of the palette in the said embodiment. It is a flowchart which shows the procedure of the imaging | photography process in the said embodiment. It is a flowchart which shows the procedure of the graffiti edit process in the said embodiment. It is a schematic diagram which shows an example of the display structure of the touch panel for edit operations in the 1st main modification of the said embodiment. It is a flowchart which shows the procedure of the imaging | photography process in the 2nd main modification of the said embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.
<1. Overall configuration>
FIG. 1 is a diagram showing an appearance of a game photo creation device that is an automatic photo creation device according to an embodiment of the present invention. More specifically, FIG. 1 (a) is an external side view of the play photo creation apparatus as viewed from the side, and FIG. 1 (b) is an external plan view as viewed from above. This play photo creation device accepts a shooting room 2 where a user enters, a shooting unit 3 that takes a picture of the user and receives selection of a background image and a foreground image, and an editing operation including graffiti (drawing operation) by the user. An editing unit 4 that generates a combined image combined with the photographed image and an output unit 5 that outputs the combined image are provided. FIG. 2 is a front view of the photographing unit 3, FIG. 3 is a front view of the editing unit 4, and FIG. 4 is a front view of the output unit 5. Hereinafter, the overall configuration of the game photo creation device according to the present embodiment will be described with reference to FIGS. 1 to 4.

  The photographing room 2 has a substantially rectangular parallelepiped shape, and the photographing unit 3 is arranged along the front surface of the photographing room 2 which is a front surface when viewed from the user entering the inside. Note that an opening for a user to enter and exit, and a light-shielding curtain that covers a part or all of the opening are provided on a part of each of the left and right side surfaces of the photographing room 2. In addition, a single color (in this case, blue or green) for chroma key composition processing is attached to the rear surface, which is the rear surface as viewed from the user who enters the photographing room 2. These colors are also attached to the floor surface.

  The photographing unit 3 includes a camera 10 as an imaging unit for photographing a user, strobes 11, 12, 13 L, 13 R, and 14 that are arranged at the top, bottom, left and right positions of the camera 10 and emit flash light, and below the camera 10. It is provided with a shooting operation touch panel 20 that is arranged and receives operations from a user, displays shot images, and the like.

  The camera 10 is typically a digital camera that generates a digital image signal using a CCD (Charge Coupled Device), captures a user, and outputs an image signal representing the captured image. The flashes 11 to 14 emit a flash toward the user in order to obtain sufficient light for photographing. The shooting operation touch panel 20 is configured to provide an operation screen for accepting various operations by the user during shooting, and to display an image based on the image signal in real time.

  FIG. 5 is a schematic diagram showing a display configuration of the touch panel 20 for shooting operation. As shown in FIG. 5, at the time of shooting, the shooting operation touch panel 20 has a real-time preview area 201 for displaying a shot image in real time, a pose sample display area 202 for displaying a pose sample, and a shooting. The graffiti target image display area 203 for displaying the graffiti target image obtained by the above is displayed. Further, as shown in FIGS. 7 and 8 to be described later, a frame image (which is a background image and a foreground image) that is combined and displayed on the photographed image is used on the photographing operation touch panel 20 at a time point before photographing. A selection operation area 205 to be selected by the user is displayed. The screen configuration of the shooting operation touch panel 20 including the frame image selection operation area 205 will be described later.

  The photographing unit 3 is built around a computer and incorporates a control device for controlling each part, an I / O control device, a network adapter for communicating with the editing unit 4, and the like. The photographing unit 3 includes a coin insertion slot 26 at the lower front side.

  The editing unit 4 is configured around a computer similar to the photographing unit 3, and includes a control device that controls each part and the like, and a network adapter that communicates with the photographing unit 3 and the like. Further, as shown in FIG. 1B, the editing unit 4 is divided into two units 4a and 4b so that two sets of users can play. One of the units 4a includes an editing operation touch panel 400 that includes a graffiti area, an area for displaying a menu for graffiti, a tool, and the like and functions as a GUI (Graphical User Interface) display means, and the editing operation touch panel 400 Touch pens 49L, 49R, and 49C are provided as pointing devices used for an operation on the. The other unit 4b has the same configuration. Here, the unit 4a seen in the foreground in FIG. 1A is referred to as “graffiti booth A”, and the unit 4b on the opposite side (the back side in the figure) is referred to as “graffiti booth B”.

  The editing operation touch panel 400 according to the present embodiment has a display configuration in which each of the units 4a and 4b allows two or three users to simultaneously doodle. In this description, components used by the user on the left side are given reference signs including “L”, and components used by the user on the right side are assigned reference signs including “R”. ing. In addition, when three users use, in addition to this, reference numerals including “C” are given to components used by the central user.

  Further, the editing operation touch panel 400 according to the present embodiment is configured to be able to simultaneously detect the operation positions of the plurality of touch pens 49L, 49R, and 49C, and the detected operation positions are the touch pens 49L, 49R, and 49C. It is also possible to detect which one of the operations corresponds to. For example, when a capacitive touch panel is used as the editing operation touch panel 400, simultaneous detection of such a plurality of operation positions and identification of the operated touch pen are possible.

  As shown in FIG. 4, the output unit 5 typically displays, for example, a material image such as a Deco-mail (registered trademark) image or a composite image obtained by grabbing a photographed image by an infrared port built in the mobile phone terminal. An output operation touch panel 30 that is operated by the user when transferring to the user's mobile phone terminal, and the above-described material image or the like arranged below the output operation touch panel 30 is directly transmitted to the mobile phone terminal as an infrared signal. An infrared port (non-contact communication port) 31 and a speaker 32 that informs the user by voice of operation methods and sound effects necessary for the communication. Further, the output unit 5 includes an outlet 33 for taking out a photo sticker, a photo card, or the like on which a composite image that has been edited by the editing unit 4 is printed.

  The touch panel 30 for output operation is a mobile phone provided with the non-contact communication function when the user wants to download the composite image from a server as well as a photo sticker or the like to view it on a mobile phone terminal. It is configured to provide an operation screen for accepting various operations necessary for transmission to the telephone terminal. This operation is mainly performed using the time until the photo sticker of the composite image is printed. Therefore, the user should use the time effectively until the photo sticker etc. is printed. Can do. A detailed display example will be described later.

  When the user wants to view the photo sticker on which the composite image is printed on the mobile phone terminal, the output operation touch panel 30 transmits the photo sticker to the mobile phone terminal having the infrared communication function (or other proximity wireless communication function). It is configured to provide an operation screen for accepting various operations necessary for this.

  Such an output unit 5 is also configured around a computer similar to the photographing unit 3, and includes a control device for controlling each part, a network adapter for communicating with the editing unit 4, etc. A network printer 35 for printing an image as a photo sticker or the like is provided.

  In the configuration as described above, after shooting in the shooting room 2, the user uses the graffiti booth A of the editing unit 4 or the touch panel 400 for the editing operation of the graffiti booth B to generate based on the shot image. Graffiti is performed on the graffiti target image. Then, the user prints the composite image generated by the graffiti by the network printer, transmits the image to the mobile phone terminal having the infrared communication function, and displays the image received by the mobile phone terminal on the terminal screen. .

<2. Functional configuration>
FIG. 6 is a block diagram showing the configuration of the main part of the play photo creating apparatus according to the present embodiment as seen from the functional aspect. 6 is functionally according to a photographing processing unit 7 for mainly performing a process of photographing a user (photographing process) and a graffiti operation of the user mainly on a graffiti target image. Edit processing unit 8 for performing the editing process of the graffiti target image, and output the graffiti target image subjected to the editing process as a photo sticker, etc. And an output processing unit 9 that performs processing (output processing) for outputting to a mobile phone terminal.

  The imaging processing unit 7 includes a first control unit 70, an imaging unit 71, a first display / operation unit 72, an I / O control unit 73, an illumination unit 74, and a first communication unit 75. It is configured. The edit processing unit 8 includes a second control unit 80, second display / operation units 81 and 82, and a second communication unit 83. The output processing unit 9 includes a third control unit 90, a third display / operation unit 91, a print output unit 92, an audio output unit 93, a non-contact communication unit 94, and a third communication unit 95. And a wireless communication unit 96. The first, second, and third communication units 75, 83, and 95 that are network adapters can communicate with each other via a network 6 that is a LAN (Local Area Network).

  The imaging unit 71 corresponds to the camera 10 configured using an imaging element such as a CCD, and captures an image in real time and outputs an image signal representing the image (captured image). This image signal is input to the first control unit 70 and temporarily stored as photographed image data in its internal memory. The captured image data is supplied as a captured image signal from the first control unit 70 to the first display / operation unit 72, and a captured image based on the captured image signal is displayed in real time. Actually, the captured image data stored as the captured image is high-resolution still image data, and the captured image data (also referred to as “through image data”) for real-time display is low-resolution moving image data. However, since the subject to be photographed is the same, they will be described below with no particular distinction (however, they will be explained separately in the second main modification described later).

  The first display / operation unit 72 corresponds to the shooting operation touch panel 20 and accepts an operation for selecting a background image and a foreground image to be added to the shot image, a shutter operation, and the like. Signals indicating these operations are input to the first control unit 70 as operation signals. Here, when a predetermined process for photographing the user (corresponding to the selected photographing menu) is started, guidance for the user is displayed on the first display / operation unit 72, and thereafter Based on an instruction from the first control unit 70, a flash is emitted from the flashes 11 to 14 in the shooting direction of the camera 10 after a predetermined time of about several seconds. At that time, an image signal output from the imaging unit 71 as a signal representing a photographed image of the user is input to the first control unit 70, a memory in the first control unit 70, a hard disk device as an auxiliary storage device, or the like. Stored as captured image data.

  The illumination unit 74 corresponds to the strobes 11, 12, 13 </ b> L, 13 </ b> R, 14 disposed at the top, bottom, left, and right positions of the camera 10. Turning off and dimming are controlled. The I / O control unit 73 corresponds to an I / O control device built in the photographing unit 3, and controls the illumination unit 74 based on an instruction from the first control unit 70. Further, an input signal such as a detection signal from a coin detection unit (not shown) described later is transferred to the first control unit 70. The first communication unit 75 corresponds to a network adapter built in the photographing unit 3 and functions as an interface for data transmission / reception via the network 6.

  The first control unit 70 is built in the photographing unit 3 and corresponds to a control device mainly composed of a computer including a CPU, a memory, a frame buffer, a timer, an auxiliary storage device and the like, and is stored in a predetermined memory stored in an internal memory. When the CPU executes the program, an instruction is given to each unit as described above in order to control each unit based on the operation signal or the like input as described above. A graffiti target image is generated based on the photographed image. The generated graffiti target image is written in the frame buffer and displayed on the first display / operation unit 72. Further, the first control unit 70 generates a composite image that is an image in which a predetermined background image or foreground image is drawn on the graffiti target image. As will be described in detail later, this graffiti target image has a background color that is a key color used to create a mask, and based on the well-known chroma key composition processing method, the image includes only the user's image. An image part is extracted and synthesized so that the photographed image part is inserted into the background image. The composite image generated in this way is displayed on the first display / operation unit 72 by being written in the frame buffer.

  Further, the first control unit 70 detects the number of users included in the photographed image by performing a well-known face recognition process (face detection process) on the photographed image, and the above-described appropriate number An operation screen for allowing the user to select a background image or a foreground image is displayed on the first display / operation unit 72. This point will also be described in detail later. When the shooting and the generation of the composite image are completed in this way, the generated composite image is appropriately selected according to the input operation of the user, and then the second corresponding to the editing unit 4 via the first communication unit 75. It is sent to the control unit 80. At this time, information indicating the number of users detected by the face recognition process is also sent to the second control unit 80 via the first communication unit 75. In this face recognition process, it is sufficient that the number of users can be detected, and it is not necessary to individually identify the users, but they may be identified.

  In addition to the above-described components, the photographing unit 3 is further provided with a coin detection unit (not shown) for detecting coins inserted into the coin insertion slot 26 in the photographing unit 3, and the first control unit 70 includes Based on the detection result of the coin detection unit, each unit is controlled so as to allow the user to play with the present photo creation device, such as shooting, selection of the background image and foreground image, and graffiti for a predetermined time. Since the detection operation by the coin detection unit and the control operation by the first control unit 70 based on the detection result are the same as those of the conventional game photo creation device and are well known, detailed description thereof will be omitted.

  The second control unit 80 is a built-in editing unit 4 and corresponds to a control device that is configured around a computer including a CPU, a memory, a frame buffer, an auxiliary storage device, and the like, and is a predetermined program stored in an internal memory. Is executed by the CPU to perform overall control related to the editing process. That is, the second control unit 80 functions as a GUI control unit that controls the second display / operation unit. In addition, the second control unit 80 adds a predetermined image to the graffiti target image based on an operation signal for performing graffiti processing on the graffiti target image (an image including a captured image) sent from the first control unit 70. A composite image that is an image in which the user is drawn is generated, or an operation screen suitable for either two or three persons is generated based on information indicating the number of users sent from the first control unit 70 Control. The operation screen and the generated composite image or material image are displayed on the corresponding second display / operation units 81 and 82 in accordance with a user instruction. When generation of the composite image as described above is completed, a suitable divided layout for two people or three people is preferentially displayed (initially) based on the number of users, and divided by the user. Accepts layout selection instructions. This point will be described later. Information indicating the selected divided layout and the generated composite image are sent to the output unit 5. If the print output unit 92 is outputting another composite image, a message to that effect is displayed and sent after waiting for completion.

  The second display / operation units 81 and 82 correspond to the editing operation touch panel 400 functioning as a graffiti GUI display means, and accept user operations using a touch pen. The second communication unit 83 corresponds to a network adapter built in the editing unit 4 and functions as an interface for data transmission / reception via the network 6.

  The third control unit 90 is built in the output unit 5 and corresponds to a control device mainly composed of a computer including a CPU, a memory, a frame buffer, a timer, an auxiliary storage device, and the like, and is stored in an internal memory. When the CPU executes a predetermined program, overall control relating to output processing is performed. The third control unit 90 stores the composite image sent from the second control unit 80 in the memory as composite image data. The print output unit 92 corresponds to the network printer 35 built in the output unit, and prints the composite image data stored in the memory as a photo sticker (or photo card) (which is appropriately laid out). The printed photo sticker or the like is taken out from an outlet 33 provided at the lower front of the output unit 5.

  Further, the third control unit 90 starts printing processing such as a photo sticker based on the divided layout information and the composite image sent from the second control unit 80, and at the same time accepts a user input operation. An operation screen to be described later is displayed on the third display / operation unit 91. The third display / operation unit 91 corresponds to the output operation touch panel 30 and functions as an input unit. The output operation touch panel 30 includes a monitor that functions as a display unit such as a liquid crystal display or a CRT (Cathode Ray Tube), and a touch panel for one person that is stacked on the upper surface and can recognize input coordinates. The monitor can display an operation screen divided into a plurality of screens, and the touch panel accepts an input operation using a user's touch pen for each of the plurality of divided screens, and the received input operation is used as an operation signal as a third signal. To the control unit 90.

  The third communication unit 95 corresponds to a network adapter built in the output unit 5 and functions as an interface for data transmission / reception via the network 6.

  Here, the third control unit 90 writes the demo image (demonstration image) stored in advance in the auxiliary storage device in the frame buffer from the end of the graffiti until the operation is started. Displayed on the display / operation unit 91. The audio output unit 93 corresponds to the speaker 32. The audio output unit 93 explains the input operation method to the user in conjunction with the operation screen displayed on the third display / operation unit 91, and the demo image is displayed on the third display / operation unit 91. When playing, play music etc. according to the demo image. The description of the input operation method, music, and the like are stored in advance in a hard disk device as an auxiliary storage device.

  Thereafter, the third control unit 90 provides the user with a mini-game to be described later until printing of the composite image is completed by the display of the third display / operation unit 91 or the voice or sound effect of the voice output unit 93. to continue. The contents of this mini game are similarly stored in advance in a hard disk device or the like.

  Here, the predetermined program executed in each control device is provided by, for example, a DVD-ROM which is a recording medium on which the program is recorded. That is, a DVD-ROM as a recording medium for the predetermined program is attached to a DVD-ROM driving device built in the control device as an auxiliary storage device, and the predetermined program is read from the DVD-ROM as an auxiliary storage device. Installed on the hard disk drive. The predetermined program may be provided via a recording medium (CD-ROM or the like) other than a DVD-ROM or a communication line. Then, when an operation for starting the present photo creating device is performed, the predetermined program installed in the hard disk device is transferred to the memory in the control device and temporarily stored therein, It is executed by the CPU. Thereby, the control process of each part by the control device is realized.

  The first to third control units 70, 80, 90 have been described as corresponding to devices including different computers built in different units, but such a configuration is an example, and The first to third control units 70, 80, 90 may be realized by two or less devices or four or more devices. In this case, a program corresponding to the function to be realized is executed in each device. In addition, the photographing unit 3, the editing unit 4, and the output unit 5 may be configured by two or less units or four or more units.

<3. Screen structure for shooting operations>
The game photo creation device according to the present embodiment is also characterized by an operation screen used for an input operation for allowing a user to select a frame image (a background image and a foreground image) to be combined with a captured image. Have. This operation screen shows the display mode at the time before the first set (first time) shooting (hereinafter also simply referred to as “before shooting”) and the time after the first set shooting (ie, the time before the second set shooting). The display mode in is different. Hereinafter, each display configuration in the selection operation area 205 displayed on the shooting operation touch panel 20 will be described.

  FIG. 7 is a schematic diagram showing a display configuration of the shooting operation touch panel 20 including the selection operation area 205 before shooting of the first set. The selection operation area 205 shown in FIG. 7 is a time point before the shooting time point when the display screen of the shooting operation touch panel 20 is displayed at the shooting time point shown in FIG. “Before first set shooting” or “Before first shooting”) is a part of the display screen that is different from the display screen displayed on a separate screen, and is used for selecting a frame image. This is a palette area in which a plurality of thumbnail icon areas 210 are displayed. As shown in FIG. 7, in addition to the selection operation area 205, the display screen includes selection image display areas 231 to 233 that display the selected frame image in a predetermined area outside the selection operation area 205. In addition, an OK button 240 for confirming the end of shooting is included to perform shooting after the selection of the frame image is completed.

  The thumbnail icon area 210 is displayed in a reduced size so that a frame image including a (partial) foreground image and a background image, which is to be subjected to chroma key composition with respect to the captured image, can be selected. To do. The user U selects one (icon) image in the thumbnail icon area 210 in the selection operation area 205 displayed on the shooting operation touch panel 20 (that is, touches the fingertip on the displayed button image). When this operation is performed, the selected frame image is displayed in the selected image display areas 231 to 233. That is, when the selection operation is performed three times, the selected image display areas 231 to 233 are displayed in order from the top. In this manner, three frame images can be selected here.

  In addition, a plurality of selectable tab areas 220 are provided near the upper side of the selection operation area 205 that is a palette area, and by selecting one of them, a plurality of tab areas 220 associated with the selected tab area are selected. A thumbnail icon area 210 is displayed. For example, the user U can select a total of 60 frame images, each of which is associated with each of the four tab regions, by selecting any one of the tab regions. Although the tab contents are not shown here, the group image is displayed from a predetermined point of view, such as the frame image display mode (eg, gorgeous background), display color (eg, pink background), display content (eg, sea background), etc. A plurality of converted (similar) frame images are displayed by selecting one tab.

  When three frame images are selected as described above, the user performs an operation of pressing the OK button 240 and ends the selection of the frame image. By performing this operation, the photographing operation touch panel 20 changes from the display screen shown in FIG. 7 to the display screen shown in FIG.

  In the display screen shown in FIG. 5, an image obtained by combining the selected first frame image and the current captured image (camera image) in real time is displayed in the real time preview area 201, and the first image is displayed. A pose sample suitable for the frame image is displayed in the pose sample display area 202. Here, the frame image is described as being composed of the foreground image and the background image, but may be composed of only one of the images.

  Thus, when a shutter operation or the like is received by, for example, pressing a shutter button (not shown) displayed on the shooting operation touch panel 20, the first frame image is chroma key-combined with the shot image as described above. A composite image is generated. Thereafter, an image obtained by combining the second frame image and the current captured image (camera image) in real time is displayed on the real-time preview area 201 on the shooting operation touch panel 20, and the second frame image is displayed. A pose sample suitable for the pose is displayed in the pose sample display area 202. Thereafter, shooting is performed. Similarly, when shooting for acquiring a shot image to be combined with the third frame image is performed, the first set (first time) shooting is finished.

  Here, as described above, the first control unit 70 detects the number of users by performing a known face recognition process on the acquired captured image. For this face detection method, a well-known method may be employed. For example, a template image is generated by enlarging, reducing, or rotating a model image stored in advance, and an image having a feature as a face on the basis of the template image. Can be used to detect whether or not the image is included in the captured image, a well-known detection method that does not use a template, such as the shape of the skin color area, or a detection method that uses various pattern recognition methods is there. Detailed description of these known methods is omitted. If hardware such as a well-known face detection LSI chip is used, detection can be performed faster than in the case of software processing described later. In this case, since three shot images are acquired in the first set of shooting, face recognition may be performed on all of these to detect the number of users (for example, the average), or the last shooting, for example. The face recognition process may be performed only on one of the captured images such as an image. After the number of users is detected based on the number of faces detected in this way, the display mode shown in FIG. 7 of the selection operation area 205 changes as shown in FIG.

  FIG. 8 is a schematic diagram showing a display configuration of the shooting operation touch panel 20 including the selection operation area 205 after the first set of shooting. As can be seen by comparing FIG. 8 with FIG. 7, a recommended notation image 250 is attached to a part of the plurality of thumbnail icon areas 210 included in the selection operation area 205. This recommended notation image 250 includes the characters “recommended for two people” and is displayed among the plurality of thumbnail icon areas 210 displayed (by the tab area 220 being operated by the user or initially selected). In addition, it is additionally displayed above the thumbnail icon area 210 corresponding to the frame image created mainly for two people.

  That is, each frame image is composed of four types, for example, for two people, for three people, for four people, and for five or more people (or may not be particularly related to the number of people), and corresponding plural images Each of the above-mentioned types is stored in association with the thumbnail icon area 210. Even if all of this kind of information can be displayed, if all of the information is displayed, the amount of information displayed on the display screen becomes too much, and it is often difficult for the user to select. Therefore, only types corresponding to the number of users detected by the face recognition process described above are displayed here. In FIG. 8, two persons are shown in a photographed image (not shown), and two persons are detected by the face recognition process. Therefore, a recommended notation image 250 including characters “recommended for two persons” is displayed. Therefore, for example, if three people are shown in the photographed image and three people are detected by the face recognition process, the recommended notation image 250 including the characters “recommended for three people” is displayed, and four people are shown in the photographed image. If it appears, a recommended notation image 250 including the characters “Recommended for 4 people” is displayed.

  In this way, by automatically detecting the number of photographed users and additionally displaying the recommended notation image 250 (recommended display), it is possible to facilitate the user's selection while making the user aware of it. . Further, since it is possible to select the thumbnail icon area 210 in which the recommended notation image 250 is not additionally displayed, the selection according to the user's preference (different from the recommended display) is not disturbed. can do. Furthermore, since the number of users detected by the face recognition process may be incorrect, it can be said that it is preferable not to prevent the user's correct selection (according to preference). Furthermore, since the recommended notation image 250 that was not additionally displayed before the first set of shooting (cannot be displayed) is displayed before the second set of shooting, the display is surprising to the user, and the device Can improve the playability. This can be configured in the same way before each shooting of the third and subsequent sets (especially when changing the number of photographers, etc.), and the display is similarly surprising, and the playability of the device can be improved. .

  Note that the recommended notation image 250 includes characters and has been described as being attached to the upper portion of the thumbnail icon area 210. However, the recommended notation image 250 may be recommended by a method other than characters, or may be outside the thumbnail icon area 210. It may be a display mode in which the frame portion is simply highlighted, or a display mode in which the arrangement order is rearranged (typically so that the recommended thumbnail icon area 210 comes up). Any display form that can be distinguished from the thumbnail icon area 210 (not recommended) may be used.

  Further, as shown in FIGS. 9 and 10, the display mode of changing the initial (selection) setting of the tab may be used without changing the display mode of the thumbnail icon area 210. FIG. 9 is a schematic diagram showing another example of the display configuration of the selection operation area 205 before the first set of photographing, and FIG. 10 shows another example of the display configuration of the selection operation area 205 after the first set of photographing. It is a schematic diagram shown.

  As can be seen by comparing FIG. 10 with FIG. 9, among the plurality of tab areas 220 provided near the upper side of the selection operation area 205, “recommended for two people” is described before the first set of photographing. The tab area 220 is in the initial selected state, whereas after shooting, the tab area 220 described as “Recommended for 3 people” is in the initial selected state. That is, in order to display the thumbnail icon area 210 in the selection operation area 205, one of the plurality of tab areas 220 is usually initially selected. Therefore, since the number of users is unknown before shooting, the tab area 220 described as “Recommended for two people” is set to the initial selection state, and after shooting, it is detected by the face recognition process described above. Tabs corresponding to the number of users (here, 3 people) are in the initial selection state. In this way, the number of photographed users is automatically detected, and the display mode for determining the initially selected tab area 220 makes the user particularly conscious (unlike recommended display). Therefore, the user can be easily selected. Further, since it is possible to select the thumbnail icon area 210 included in a tab that is not initially selected, it is possible to prevent different selections according to the user's preference. Furthermore, since the number of users detected by the face recognition process may be incorrect, it can be said that it is preferable not to prevent the user's correct selection (according to preference).

  The face recognition process described above is performed on the three images acquired in the set or one or two of the acquired images every time each set in which the three captured images are acquired is completed. Although it is a structure, the structure etc. which are performed only once with respect to the picked-up image acquired by the first set may be sufficient. Further, the number of shot images taken for one set, the number of sets shot during one game, and the total number of shot images are not particularly limited as long as they can be played within a predetermined time limit. The configuration may be such that one frame image is selected every time one image is taken, or the number of shot images taken in one set may change in each set. Further, the face recognition process may be performed at an arbitrary timing of any one or more times after the first set instead of the first set.

  Furthermore, when the number of users based on the face recognition process is detected a plurality of times as described above, the first control unit 70 determines the first detected value, the average value of the detected number or the most frequent occurrence. A value or the like may be given to the second control unit 80. In the following, for convenience of explanation, it is assumed that the most frequent value of the detected number of people is sent to the second control unit 80, and the number of people detected by the face recognition processing indicates this most frequent value.

  Here, the first control unit 70 associates the information on the number of users detected for each captured image with the captured image, and all the information on the number of detected users is stored in the second control unit 80. May be given. This configuration will be specifically described in a main modification described later. Next, a screen configuration for editing operation will be described.

<4. Screen structure for editing operations>
The game photo creation device according to the present embodiment is also characterized by an operation screen used for an editing operation for graffiti or the like on a graffiti target image (an image including a photographed image) generated based on the photographed image. doing. Hereinafter, a display configuration of the editing operation touch panel 400 that displays the operation screen will be described.

  In the present embodiment, depending on the number of persons detected by the face recognition process described above, the case where two users play as one set differs from the case where three users play as one set. A display mode for performing a (virtual) scribble suitable for each case is displayed on the editing operation touch panel 400 in an initial state (a state immediately before the start of the editing process in each play).

  11 is a schematic diagram showing a display configuration of the editing operation touch panel 400 when two users play, and FIG. 12 shows a display of the editing operation touch panel 400 when three users play. It is a schematic diagram which shows a structure.

  Specifically, the editing operation touch panel 400 includes images selected from a plurality of graffiti target images that are generated based on captured images and displayed in, for example, a thumbnail format, as components used by the left and right users, respectively. (Hereinafter simply referred to as “graffiti target image”) for displaying (virtual) scribble areas 41L and 41R and tools for the user to perform graffiti, that is, the (selected) scribble target image. Palettes 42L and 42R as a set of tools for editing instructions that are displayed as usable, buttons 45L and 45R for performing operations related to graffiti other than the tools included in the palettes 42L and 42R, and later Size change buttons 451L and 451R for changing the size (and configuration) of the operation screen as shown in FIG. It has been.

  In the present embodiment, in addition to the above-described components used by the left and right users, an operation screen is also displayed at the center of the editing operation touch panel 400. In the initial state when two users play, this central operation screen is an operation screen having a size smaller than the graffiti areas 41L and 41R at the lower center of the editing operation touch panel 400 as shown in FIG. Is displayed.

  Specifically, a graffiti target image is displayed on the central operation screen of the editing operation touch panel 400 as a component used by the central user when three or more users play as one set. A simple graffiti area 41C that can be used as an area for performing simple graffiti, a palette 42C that is a set of tools for creating simple graffiti and material images by a user and displayed as usable, and as described later A size change button 451C for changing the size (and configuration) of the operation screen is included. The simple graffiti area 41C can be used as an area for creating a material image such as an image for Deco-mail (registered trademark) or a free illustration image.

  The palette 42C includes a CL interrupt button 42CL or a CR interrupt button 42CR for allowing a central user to perform graffiti on the left operation screen or the right operation screen. The CL interrupt button 42CL is a button for selecting the left operation screen as an operation screen capable of editing an interrupt with the center touch pen 49C. The CR interrupt button 42CR is an interrupt screen with the center touch pen 49C. This is a button for selecting a right operation screen as an operation screen that can be edited (details will be described later).

  As shown in FIG. 11, the touch pens 49L, 49R, and 49C used for operations on the editing operation touch panel 400 are arranged as pointing devices corresponding to the left operation screen, the right operation screen, and the central operation screen, respectively. Has been.

  The left operation screen, the right operation screen, and the central operation screen can be changed in size between the normal size and the reduced size by operating the size change buttons 451L, 451R, and 451C, respectively. In the editing operation touch panel 400 in the initial state when two users play as shown in FIG. 11, the left operation screen and the right operation screen are displayed in the normal size, and the central operation screen is displayed in the reduced size. ing. In the present embodiment, when the size of the operation screen is changed, the configuration of the operation screen is also changed. Therefore, hereinafter, the configuration of the normal size operation screen is referred to as “normal configuration”, and the configuration of the reduced size operation screen is referred to as “reduced configuration”. In the editing operation touch panel 400, the size of the operation screen displayed in the normal configuration is the normal size, and the size of the operation screen displayed in the reduced configuration is the reduced size. However, as described later, the normal size is slightly different between the two-screen mode for two persons (FIG. 11) and the three-screen mode for three persons (FIG. 12).

  Now, in the editing operation touch panel 400 shown in FIG. 11 (the editing operation touch panel 400 in the initial state when two users play), the size change button 451C on the central operation screen in the reduced configuration is in the center. When an operation screen touch pen (hereinafter referred to as “center pen”) 49C is operated, the center operation screen is displayed in a normal configuration. At this time, the size of the central operation screen is increased while the left operation screen and the right operation screen are in the normal configuration, but the size of the display surface (the entire screen size) of the editing operation touch panel 400 is fixed. Therefore, the three operation screens are displayed in a state where the size (in the horizontal direction) of each of the three operation screens displayed in the normal configuration is slightly smaller than the normal size in the display configuration shown in FIG. The That is, the overall display configuration of the editing operation touch panel 400 (hereinafter simply referred to as “overall display configuration”) is changed from the configuration shown in FIG. 11 to the configuration shown in FIG. On the other hand, in the editing operation touch panel 400 shown in FIG. 12, when the size change button 451C in the normal operation central operation screen is operated with the central pen 49C, the central operation screen has a reduced configuration as shown in FIG. Is displayed.

  Hereinafter, in each of the two units 4a and 4b constituting the editing unit 4, the operation mode in which two operation screens including a left operation screen and a right operation screen are displayed in the normal configuration as shown in FIG. The operation mode in which the three operation screens are displayed in the normal configuration as shown in FIG. 12 is referred to as “three-screen mode”. In the present embodiment, in accordance with the switching of the operation mode between the two-screen mode and the three-screen mode, not only the screen size but also the screen configuration is slightly changed for each operation screen in the normal configuration. The configuration may not be changed. A configuration in which such an operation mode switching itself is not possible is also conceivable. However, since there is a possibility that the number of users detected by the face recognition process may be incorrect, a configuration in which switching is performed in this way is preferable.

  In addition, with the configuration that switches between the two-screen mode and the three-screen mode as described above, even when three or more users play as one set, the three users can operate the normal-configuration operation screen in the three-screen mode. Can be used simultaneously to edit graffiti on a captured image, while when two users play as a set, the two users are more than in the three-screen mode. Editing operations for graffiti on a photographed image can be simultaneously performed using the operation screens of the normal configuration of the large two-screen mode. In addition, the operation screen with the normal configuration in the two-screen mode can provide more graffiti tools than the operation screen with the normal configuration in the three-screen mode.

  As described above, the display mode that displays the graffiti editing operation screen with the number of operation screens corresponding to the number of users detected by the face recognition process facilitates the user's operation and the initially selected operation mode. Since it is possible to switch to a mode other than, do not interfere with the operation according to the user's preference (for example, the operation of scribbling the image of one operation screen with two of the three users) Can be. Further, since the number of users detected by the face recognition process may be incorrect, it can be said that it is preferable not to prevent the user's correct (or according to preference) selection.

  Here, the number of persons detected with respect to the tool 405 for editing instructions displayed on the palettes 42L and 42R as well as switching between the two-screen mode and the three-screen mode as described above (or without switching). A configuration may be adopted in which an identification display corresponding to is added in the same manner as shown in FIG. 8, or the initial selection setting of the tab area 420 is switched in the same manner as shown in FIGS.

  FIG. 13 is a schematic diagram illustrating an example of a display configuration of the palette 42L. The editing instruction tool 405 included in the palette 42L shown in FIG. 13 displays the types of editing operations such as stamps and frames constituting the graffiti image so that the user can select various graffiti. A tool for performing various editing operations on the (selected) graffiti target image. Hereinafter, an area occupied by the tool, that is, a selectable area is also expressed as a tool.

  A part of the plurality of tools 405 included in the palette 42L is provided with a number of people mark 450 corresponding to the recommended notation image 250 described above. The number mark 450 has a figure and a thick frame (highlighted frame) that can be intuitively determined to be for two people, and a plurality of tools that are displayed (by selecting the tab area 420). Of these, the tool 405 is added to and displayed on a tool 405 corresponding to a stamp image created mainly for two persons (for example) corresponding to two persons, which is the number of users detected by the face recognition process. Here, the plurality of tab regions 420 provided near the upper side of the pallet 42L are described as stamps A to D, and are grouped from a viewpoint (color, shape, type, etc.) different from the number of people.

  As described above, the number of photographed users is automatically detected, and the number of people mark 450 is additionally displayed (recommended display), so that the user can be easily selected by making the user aware of it. it can. In addition, since it is possible to select the tool 405 without the number mark 450 displayed, different selections according to the user's preference can be prevented from being hindered. Furthermore, since the number of users detected by the face recognition process may be incorrect, it can be said that it is preferable not to disturb the user's selection. Note that, as with the recommended notation image 250, the supplementary note display may be a display form that can be distinguished from other (not recommended) tools 405 by the user.

  Further, as shown in FIG. 9 and FIG. 10 described above, the configuration may be such that the initial selection setting of the tab is changed. FIG. 14 is a schematic diagram illustrating another example of the display configuration of the palette 42L.

  In FIG. 14, “for two people” corresponding to two of the plurality of tab areas 420 provided in the vicinity of the upper side of the pallet 42 </ b> L, which is the number of users detected by the face recognition process, is described. The display mode in which the tab area 420 is in the initial selection state is shown. As described above, by automatically detecting the number of photographed users and determining the tab area 420 to be initially selected, the user can be easily selected without making the user aware of it. . In addition, since it is possible to select the tool 405 included in a tab that is not initially selected, selection according to the user's preference can be prevented. Furthermore, since the number of users detected by the face recognition process may be incorrect, it can be said that it is preferable not to disturb the user's selection.

  Here, there are portions indicated as stamp A and stamp B in a plurality of tab areas 420, but it is assumed that two or three people are suitable, or suitable ones are mixed. Therefore, the initial selection setting of the tab shown in FIG. 14 is made, and when the tab described as the stamp A or the stamp B is selected, an additional display such as the number of people mark 450 as shown in FIG. 13 is made. It may be a configuration.

  When the editing operation by the user as described above displayed on the editing operation touch panel 400 is completed, a photo to be output from the output unit 5 (a photo sticker or a photo card on which a composite image obtained by the editing operation is printed). An operation screen for selecting the division pattern is displayed on the editing operation touch panel 400. Using the operation screen, the user performs an operation for selecting one of the plurality of division patterns prepared in advance.

  A pattern suitable for the number of users is also prepared for this division pattern, and a layout sample corresponding to the tool 405 (or thumbnail icon area 210) is placed in the palette corresponding to the palette 42L (or selection operation area 205). A plurality of icons shown are arranged and displayed so as to be switchable by tabs. Therefore, it can be considered similar to the configuration shown in FIG. 13 or FIG. In other words, the number of photographed users is automatically detected and an image corresponding to the number of people mark 450 (or recommended notation image 250) is added and displayed, or the tab to be initially selected is determined. This makes it easy to select the divided layout according to, and does not prevent different selections according to the user's preference.

  When the selection of such a photo division pattern is completed, the output unit 5 outputs a photo in which a composite image is arranged according to the division pattern. This is as described above. A processing procedure in the present photo creating apparatus in which the above display is performed will be described below with reference to FIGS. 15 and 16.

<5. Processing procedure in a photo creation device for play>
As described above, the play photo creating apparatus includes the photographing unit 3, the editing unit 4, and the output unit 5. The photographing unit 3 performs photographing processing, the editing unit 4 performs later-described graffiti editing processing, and the output unit 5 performs output processing. It should be noted that when a certain user is playing with the photographing unit 3, another user can play with the editing unit 4, and yet another user can output a composite image with the output unit 5. ing. In other words, this game photo creation device can perform shooting processing, graffiti editing processing, and output processing in parallel. Below, the outline | summary of the procedure of an imaging | photography process, a graffiti edit process, and an output process is demonstrated.

<5.1 Shooting process>
FIG. 15 is a flowchart showing the procedure of the photographing process in the present embodiment. When the play photo creation device is not used (when no play is performed), a demonstration image is displayed on the shooting operation touch panel 20. When the user inserts a coin into the coin insertion slot 26 while displaying the demo image, play is started (step S100).

  When the play is started, the first control unit 70 accepts selection of a shooting mode by the user (step S110). In step S110, for example, image quality (specifically, one of clear image quality with high contrast, soft image quality with softness, or cool image quality with transparency) is selected, brightness is selected, Whether to shoot automatically or manually is selected. When shooting automatically, a shooting theme is selected. In this case, the first control unit 70 displays on the shooting operation touch panel 20 a screen for allowing the user to select one or more shooting themes from a plurality of shooting themes prepared in advance. The selection operation by the person is accepted. Then, the first control unit 70 acquires selection information based on a user's selection operation, and determines a combination of a frame and a background to be used for shooting based on the selected shooting theme. When shooting manually, the user can freely determine the frame and background.

  Subsequently, in step S115, a display screen including the selection operation area 205 of the initial display mode before the first shooting described above shown in FIG. 7 is displayed on the shooting operation touch panel 20 and is displayed by the user (here, A selection operation of three (3) frame images is accepted.

  Thereafter, the process proceeds to step S120, and one set of three images is taken. At this time, a graffiti target image obtained by synthesizing the selected frame image with the photographed image is displayed on the photographing operation touch panel 20. The photographed image data obtained by this series of photographing is stored in the memory of the first control unit 70.

  In step S130, based on the photographed image data stored in the memory, a known face recognition method is used to detect human faces included in the photographed image, and the number thereof is detected. The contents of the process for detecting the number of users using this face recognition process have been described above.

  Step S140 includes a selection operation area 205 in a display mode corresponding to the number of users detected in step S130 (that is, a display mode in which the above-described recommended notation image 250 is additionally displayed or a tab is initially selected). A display screen is displayed on the shooting operation touch panel 20. Specifically, each time the process of step S140 is performed, graffiti target images are sequentially displayed additionally in the graffiti target image display area 203 of the photographing operation touch panel 20 shown in FIG. Thereafter, the process proceeds to step S150, and the first control unit 70 determines whether or not shooting of a predetermined number (number of sets) has been completed. As a result of the determination, if the number of images has been shot, the process proceeds to step S160. If the number of images has not been shot, the process returns to step S120. In practice, a time limit for photographing (for example, 3 minutes) is provided.

  In step S160, an image to be actually graffitied is selected (by the user) from a plurality of graffiti subject images. Specifically, the first control unit 70 displays a list of graffiti target images on the shooting operation touch panel 20 in order to allow the user to select an image to be used for graffiti and printing, and performs a selection operation by the user. Accept. Then, the first control unit 70 sends the image selected by the user to the second control unit 80 as an actual graffiti target image. After step S160 ends, the process proceeds to step S170. In step S170, a guidance screen is displayed. Specifically, the first control unit 70 displays a screen for guiding the user to any one of the editing units 4 (4 a or 4 b) on the photographing operation touch panel 20. Thereby, the photographing process is completed.

<5.2 Graffiti editing process>
FIG. 16 is a flowchart showing the procedure of graffiti editing processing in the present embodiment. The graffiti editing process is realized by the second control unit 80 operating as shown in FIG. 8 based on a predetermined program. In this process, after the above-described shooting process is completed, the second control unit 80 acquires a graffiti target image sent from the first control unit 70 via the network (LAN) 6 (step S200).

  Next, the second control unit 80 receives and receives information on the number of users detected by the well-known face recognition process performed by the first control unit 70 via the second communication unit 83. Based on the number of users, the graffiti editing operation screen is switched between the two-screen mode for two persons (FIG. 11) and the three-screen mode for three persons (FIG. 12), and the palette 42L 42R, an identification display corresponding to the detected number of persons is added to the editing instruction tool 405 displayed in 42R (FIG. 13), or the initial selection setting of the tab area 420 is switched to the one corresponding to the number of persons. (FIG. 14). Thereafter, the timer 46 is set to a predetermined time (specifically, a time during which graffiti is permitted), and countdown is started (step S220).

  After the timer 46 starts counting down, the editing operation touch panel 400 of each of the units 4a and 4b constituting the editing unit 4 displays a graffiti editing operation screen corresponding to the number of persons set in step S210, and the graffiti operation by the user (Drawing operation) is accepted (steps S230 to S250). At the time of this graffiti editing process, the editing unit 4 may accept an editing operation for creating a material image such as a decomail image in addition to an editing operation on the graffiti target image based on the photographed image.

  Specifically, when one of the buttons and tools in the editing operation screen is touched with a touch pen, the coordinate value is input (S230), and the corresponding graffiti screen processing (S240) is performed. Thereafter, in step S250, it is determined whether the graffiti has ended by the remaining time of the timer 46 becoming zero (or performing an operation to be ended by the user), and if not completed (in the case of No in S250), the step Returning to S230, the process is repeated until the graffiti is completed, and if the graffiti is completed (Yes in S250), the process proceeds to step S260.

  In step S260, the division pattern of the output photo is selected. Specifically, the second control unit 80 displays an operation screen on the editing operation touch panel 400 for causing the user to select one of a plurality of division patterns prepared in advance, and uses the operation screen. The selection operation by the person is accepted. Here, the second control unit 80 is detected for a plurality of icons indicating the divided layout samples displayed on the operation screen based on the information on the number of users received from the first control unit 70. An identification display according to the number of persons is added, or the initial selection setting of the tab added to the palette including the icon is switched to one according to the number of persons. And the 2nd control part 80 acquires selection information based on a user's selection operation. After the process of step S260 is completed, the process proceeds to step S270.

  In step S270, a guidance screen is displayed. Specifically, the second control unit 80 displays a screen for guiding the user to the output unit 5 on the editing operation touch panel 400. Thereby, the graffiti editing process ends. As described above, when the graffiti editing process is completed, the output unit 5 starts a printing process such as a photo sticker based on the composite image sent from the editing unit 4.

  The divided layout selection process and the operation screen initial setting process may be performed by the third control unit 90, and the operation screen may be displayed on the output operation touch panel 30.

<6. Effect>
As described above, according to the present embodiment, on the operation screen such as the graffiti editing operation screen, the frame image and the divided layout selection operation screen, the identification display is performed according to the number of users detected by the face recognition processing for the captured image. Or the initial setting of the tab and the graffiti editing operation screen is switched to the 2-screen mode for 2 people or the 3-screen mode for 3 people, so the number of users is not entered by the user Even in such a case, it is possible to automatically detect the number of users and display an operation screen having a display mode suitable for the number. Therefore, it is easy for the user to select or operate, and other selections are possible, so that different selections according to the user's preference can be prevented, and detection is performed by face recognition processing. Even when the number of users to be used is incorrect, correct selection (according to taste) by the user can be prevented.

<7. Modification>
<7.1 First Main Modification>
In the present embodiment, the graffiti editing operation screen is switched to the two-screen mode or the three-screen mode. However, instead of this configuration (or together with this configuration), two (or more) operation screens can be used as a graffiti target. For each captured image, the first control unit 70 may detect the number of users, and each operation screen may be displayed in a display mode suitable for the number of users. . Hereinafter, a specific description will be given with reference to FIG.

  FIG. 17 is a schematic diagram illustrating an example of the display configuration of the editing operation touch panel according to the first main modification of the present embodiment. Unlike the case shown in FIG. 11 or FIG. 12, the graffiti screen 400 shown in FIG. 17 is independent of the number of users (assuming that the typical number of users is two), and the left operation screen 400L. And a right operation screen 400R, and a graffiti area 401L, 401R, which is an area where a composite image obtained by combining a captured image and a graffiti image corresponding to the captured image can be displayed and virtual graffiti can be performed, Palette areas 402L and 402R in which a plurality of tools 405L and 405R for editing instructions are displayed, and first to fourth thumbnail image display areas 431L and 431R to 434L for selecting a captured image to be a graffiti target, 434R and a timer display area 450 indicating the remaining time for which graffiti is available are included.

  Here, the editing instruction tools 405L and 405R included in the palette areas 402L and 402R select the type of editing operation (typically grouped and displayed) such as a stamp and a frame constituting the graffiti image. This is a tool that can be displayed, and is a tool for the user to perform various graffiti, that is, a tool for instructing various editing operations on the (selected) graffiti target image.

  Further, in the vicinity of the palette areas 402L and 402R, there are pen buttons 421L and 421R for enabling selection of a virtual graffiti pen type according to the type of the graffiti, and a small image serving as a foreground for the user. Stamp buttons 422L and 422R for making it possible to select a type of a stamp image, frame buttons 423L and 423R for making it possible to select a type of frame image that decorates the vicinity of the captured image, and the background of the user Background buttons 424L and 424R for enabling selection of the type of background image to be displayed are displayed. The user U selects one of these various operation button groups with one of the two touch pens 49L1 and 49L2 that make a pair with respect to the left operation screen 400L (that is, the pen tip on the displayed button image). Are performed), a plurality of graffiti tools of the corresponding type are displayed in the pallet areas 402L and 402R. Here, for convenience of explanation, it is assumed that the stamp buttons 422L and 422R are selected.

  Also, a plurality of selectable tab areas 420L and 420R are provided near the upper sides of the palette areas 402L and 402R, and a plurality of tools associated with the selected tab area are selected by selecting one of them. 405L and 405R are displayed. When a tool indicating a certain stamp image is selected and an arbitrary position in the graffiti area 401L is touched with the touch pen in that state, a stamp image corresponding to the selected tool is displayed (combined) at that position.

  Here, as shown in FIG. 17, a photographed image showing two users is displayed as a graffiti object in the graffiti area 401L of the left operation screen 400L, and three persons are used in the graffiti area 401R of the right operation screen 400R. A photographed image of a person is displayed as a graffiti target. Therefore, by the face recognition process described above, information indicating that there are two users is associated with the captured image on the left operation screen 400L, and that there are three users on the captured image on the right operation screen 400R. Information is associated. Based on these pieces of information, the second control unit 80 initializes the tab area 420L in the palette area 402L of the left operation screen 400L to “for two persons”, and sets the tab area 420R in the palette area 402R of the right operation screen 400R. Initially set to “3 people”.

  Further, in order to select a photographed image that is different from the photographed image currently being graffitied, any one of the first to fourth thumbnail image display areas 431L, 431R to 434L, and 434R is selected by the user's operation. In addition, the captured image in the operation screen is changed to the selected captured image, and based on the information on the number of users associated with the changed captured image, the initial setting of the tab in the corresponding palette area in the screen Is changed.

  With the above configuration, the user can easily select each operation screen, and other selections are possible, so that different selections according to user preferences can be prevented. Even when the number of users detected by the face recognition process is incorrect, correct selection (according to preference) by the user can be prevented.

<7.2 Second Main Modification>
In the present embodiment, the face recognition process is performed after obtaining the first set of captured images, and the use is detected by the face recognition process for the captured image on the selection operation screen of the frame image to be combined with the second set of captured images. In this configuration, an identification display is added or a tab is initially set according to the number of persons, but a configuration in which face recognition is performed before the first set of captured images is acquired is also conceivable. Hereinafter, a specific description will be given with reference to FIG.

  FIG. 18 is a flowchart showing the procedure of the photographing process in the second main modification of the present embodiment. As can be seen by comparing with the procedure shown in FIG. 15, the processes after step S100 and step S500 in the second main modification of the present embodiment are the same as the processes after step S100 and step S500 in the embodiment. The initial screen display in step S115 in the embodiment is omitted, and the display mode of the selection operation screen corresponding to the number of people in step S114 and the content of the photographing process in step S120 are the same as the corresponding processing content (S140, S130) in the embodiment. Although they are the same, the processing order is different. That is, in the second main modification, the configuration for detecting the number of users is different from the configuration of the above embodiment, and therefore a selection operation screen corresponding to the number of people is displayed before the first shooting. Hereinafter, the number detection process (S113) will be described.

  In this number detection process, through image data for real-time display is used as a target for face recognition processing, not still image data (high resolution) stored as a captured image. This through image data is continuously acquired from the camera 10 (as a broadly captured image) from the start point to the end point of the entire shooting process (S100 to S170). Therefore, the operation screen of the photographing operation touch panel 20 including the selection operation area 205 shown in FIG. 8 displayed in step S114 can be displayed at an arbitrary timing immediately before the display. Then, the selection operation area 205 is not displayed in a display state where the recommended notation image 250 as shown in FIG. 7 is not attached, or the tab is left in the initial setting state, and the user does not display the selection operation area 205. Even when the number is not input, the number of users can be automatically detected immediately, and an operation screen having a display mode suitable for the number can be displayed.

  In addition, the number detection process (S113) is repeatedly performed at an appropriate interval or in real time while the selection operation screen corresponding to the number of persons is being displayed (S114), and the result is displayed. It may be a configuration reflected in. In this configuration, if dedicated hardware is not used for face recognition processing, a calculation load is applied. However, if the number of users increases or decreases during the display of the selection operation screen, the current number of people is immediately (for example, recommended notation). The display mode of the image 250 is reflected (from “recommended to 2 people” to “recommended to 3 people”). Therefore, since the unexpectedness felt by the user is further increased, the playability of the device can be further enhanced.

<7.3 Other Modifications>
In the present embodiment, the frame image selection operation screen, the graffiti editing operation screen, and the divided layout selection operation screen that are to be combined with the photographed image depend on the number of users detected by face recognition processing. In addition, a configuration in which an identification display is added or a tab is initially set, and a graffiti editing operation screen is switched to a two-screen mode or a three-screen mode, but these configurations include any one or a plurality of arbitrary ones. You may combine selectively. Further, the configuration of the first main modification may be applied to a configuration that is selectively combined with any one or any of the configurations described in the above-described embodiments. In these cases, the face recognition process may be performed by the second control unit 80 or the third control unit 90.

  In addition, the operation screen for adding an identification display or initializing a tab may be an operation screen other than the above-described operation screen, and may be an operation screen having an appropriate display mode depending on the number of users. . Then, the user can easily select on the operation screen.

3 ... Shooting unit 4 ... Editing unit 5 ... Output unit 6 ... Network (LAN)
DESCRIPTION OF SYMBOLS 10 ... Camera 20 ... Touch panel for imaging operation 30 ... Touch panel for output operation 35 ... Network printer 31 ... Infrared port 32 ... Speaker 42CL ... CL interrupt button 42CR ... CR interrupt button 70 ... First control unit 72 ... First Display / operation unit (touch panel for shooting operation)
80 ... second control unit 81, 82 ... second display / operation unit (touch panel for editing operation)
90 ... third control unit 91 ... third display / operation unit (touch panel for output operation)
92 ... Print output section (network printer)
94 ... Non-contact communication part (infrared port)
400 ... Touch panel for editing operation 451L, 451R, 451C ... Size change button

Claims (12)

An automatic photo creation device comprising a photographing means for photographing a user and an output means for outputting a composite image including a photographed image obtained by the photographing means as a photograph,
Number of people detecting means for detecting the number of users by detecting the user's face part included in the captured image;
Display means;
Input means for accepting an operation by the user;
An operation screen for the operation, the operation screen having a display mode according to the number of users detected by the number-of-users detection means among a plurality of display modes provided in advance according to the number of users. An operation screen control means for displaying on the display means ,
When the number of operation screens displayed on the display unit for a set of users is plural, the number of people detection unit detects the number of users for each captured image to be included in the operation screen,
The operation screen control means is a plurality of operation screens for generating the composite images, respectively, and a plurality of operation screens having display modes corresponding to the number of users detected by the number of people detection means, An automatic photo creation apparatus, characterized in that it is displayed on the display means .   The operation screen control means causes the display means to display an operation screen that can accept an operation by the user according to a number different from the number of users detected by the number of persons detection means. The automatic photo creating apparatus according to claim 1, wherein:   The operation screen control means has an operation screen capable of accepting an operation by the user by the input means for switching to an operation screen having a display mode corresponding to a number different from the number of users detected by the number of people detection means. The automatic photo creation apparatus according to claim 2, wherein the display means displays the image.   The operation screen control means causes the display means to display a number of operation screens corresponding to the number of users detected by the number-of-people detection means. The automatic photo creation apparatus of any one of Claims. The operation screen control means causes the display means to display a palette area that includes a plurality of selectable areas for an input operation performed by the input means and in which at least a part of the included selectable areas can be replaced. In addition, among the plurality of selectable areas grouped in advance, a plurality of selectable areas included in a group corresponding to the number of users detected by the number of people detecting means are initially displayed on the palette area. The automatic photo creation apparatus according to any one of claims 1 to 4 , wherein the automatic photo creation apparatus is characterized. The operation screen control means causes the display device display a plurality of selectable area for input operation to be performed by the input unit, among the plurality of selectable regions displayed, is detected by the number detecting means 3. The automatic display according to claim 1, wherein one or more selectable areas associated with the number of users to be displayed are displayed in a display mode in which the selectable areas can be distinguished from other selectable areas. Photo creation device. The photographing means performs the photographing a plurality of times,
The operation screen control means uses the number-of-people detection means to select a plurality of selectable areas for allowing the user to select an additional image including at least one of a foreground image and a background image to be combined with the captured image. A plurality of predetermined selectable areas are displayed before the number of users is detected, and after the number of users is detected by the number detection means, the number of users to be detected is The automatic photo creation apparatus according to any one of claims 1 to 3, wherein a plurality of selectable areas are displayed in a corresponding display mode. The photographing means performs an operation of performing the photographing once or more as one set, and performs the operations in two sets or more in order,
The operation screen control means causes the display means to display a plurality of selectable areas for allowing the user to select an additional image including at least one of a foreground image and a background image to be combined with the captured image. A plurality of predetermined selectable areas are displayed before the first set, and after the first set, the user detected by the number detection means with respect to a photographed image obtained by photographing by the photographing means The automatic photo creating apparatus according to claim 7 , wherein a plurality of selectable areas are displayed in a display mode corresponding to the number of the automatic photo creating apparatuses. The photographing means continuously performs the photographing,
The operation screen control means detects a plurality of selectable areas for allowing the user to select an additional image including at least one of a foreground image and a background image to be combined with the photographed image by the number detection means. A plurality of selectable areas are displayed in a display mode according to the number of users to be
The number-of-person detection means is an image continuously acquired by photographing by the photographing means before or during display of the plurality of selectable areas by the operation screen control means, and is synthesized with the composite image. The number of the users is detected by detecting a face portion of the users included in an image different from the photographed image. 4. The method according to any one of claims 1 to 3, wherein the number of users is detected. The automatic photo creation device described. Wherein the input hand stage consists operation means as two or more pointing devices respectively corresponding to two or more of the operation screen, an input operation by a plurality of users corresponding to different operation screen displayed on the display means The automatic photo creating apparatus according to claim 1, wherein the automatic photo creating apparatus accepts the images in parallel. A shooting step for shooting the user;
An automatic photo creation method comprising an output step of outputting a composite image including a photographed image obtained in the photographing step as a photograph,
Detecting the number of users by detecting the user's face part included in the captured image; and
A display step;
An input step for accepting an operation by the user;
An operation screen for the operation, the operation screen having a display mode corresponding to the number of users detected in the number-of-users detection step among a plurality of display modes provided in advance according to the number of users And an operation screen control step for displaying in the display step ,
In the number detection step, when there are a plurality of operation screens displayed in the display step for a set of users, the number of users is detected for each captured image to be included in the operation screen,
In the operation screen control step, a plurality of operation screens for generating the composite images, respectively, and a plurality of operation screens having display modes corresponding to the number of users detected in the number of people detection step, An automatic photo creation method characterized by displaying in the display step . To an automatic photo creation device that is a computer,
A shooting step for shooting the user;
An output step of outputting a composite image including a photographed image obtained in the photographing step as a photograph;
Detecting the number of users by detecting the user's face part included in the captured image; and
A display step;
An input step for accepting an operation by the user;
An operation screen for the operation, the operation screen having a display mode corresponding to the number of users detected in the number-of-users detection step among a plurality of display modes provided in advance according to the number of users And an operation screen control step for displaying in the display step ,
In the number detection step, when there are a plurality of operation screens displayed in the display step for a set of users, the number of users is detected for each captured image to be included in the operation screen,
In the operation screen control step, a plurality of operation screens for generating the composite images, respectively, and a plurality of operation screens having display modes corresponding to the number of users detected in the number of people detection step, A program displayed in the display step .

Images