JP2015213336A - Imaging apparatus for game, imaging method for game, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform image processing in such a manner that a plurality of object users are easily associated with processing content within a limited time.SOLUTION: An imaging apparatus for a game acquires an all-person captured image by a camera S124, then calculates feature amounts of face images of users included in the all-person captured image to identify them S125, then selects the images of the users by two touch panels respectively S126, then selects correcting modes by the two touch panels S127 to associate the images of the users with screens, and then performs image correction in the associated mode for each image of the users included in the obtained captured image S128.

Description

  The present invention relates to a game shooting apparatus, a game shooting method, and a program, and more specifically, a game shooting apparatus for shooting a user with a camera and providing a user with a composite image generated based on the shot image, The present invention relates to a game shooting method and program.

  2. Description of the Related Art Conventionally, an imaging device for a game that captures a user with a camera and provides the captured image to the user is known. Since such a shooting device for play is highly playable or entertaining, an image to be combined with the shot image is selected from a variety of background images and foreground images prepared in advance according to the user's preference. Or a user can freely draw with a touch pen. Since such an operation by the user is performed on the photographed image, it is called “graffiti”.

  In addition, a plurality of images (for example, 4 images) are selected from among a plurality of images (for example, 6 images) that are usually obtained by a plurality of times of shooting, as the image to be graffitied in such a game shooting apparatus. There are many. Such a photographed image is often corrected in a predetermined manner before (or during) the graffiti. For example, correction that changes a part of a user's image color (for example, skin or eye color) included in a photographed image, or changes a part of the image (for example, eye or face shape). May be performed. For example, Japanese Patent Application Laid-Open No. 2010-50501 describes a configuration in which small face processing is automatically performed to reduce the contour of a user's face in a captured image without being based on the user's instruction.

JP 2010-50501 A

  Here, there is a correction process that can be performed without accepting a user's instruction, such as the small face process described in Japanese Patent Application Laid-Open No. 2010-50501. Depending on the content of the correction on the person's image, it may be appropriate to perform correction according to the preference by accepting the user's instruction. In this case, the contents and degree of correction are displayed so that the user can select them, and a selection operation by the user is accepted.

  In this regard, most recent shooting devices for games are used by a plurality of users in most cases. Therefore, in order to simultaneously reflect different user preferences (intentions) in one shot image, the above correction is shot. It is necessary to divide each image of the user in the image.

  However, since the correspondence between a plurality of users appearing in a photographed image and a plurality of users performing the above operations cannot normally be determined with a known apparatus configuration, it is the user who performs the above correction for all images. It is often bothersome for them. In addition, in a game shooting apparatus, there is often a restriction on the play time (including the time from the start to the end of a series of shooting). In that case, it is preferable that the selection operation for the correction content or the like can be quickly performed by the user.

  Therefore, in the present invention, when there are a plurality of users, a game shooting apparatus and a game shooting method that can easily reflect each user's intention (such as a correction mode) on a predetermined shot image. And to provide a program.

  The present invention shoots a plurality of users in a shooting space for shooting, displays an acquired image on a display means, accepts an operation input by a plurality of users, and obtains an image acquired by shooting. Recognize each of the plurality of user images included, associate the received operation input with the identified plurality of user images, and, according to the received operation input, the user input associated with the operation input Image processing (correction) is performed to change the image display mode.

  According to such a configuration of the present invention, each user's image included in the captured image can be associated with each user's operation input, and each user's image can be corrected by each user's desired correction. Can be applied.

  According to the present invention, when there are a plurality of users, there is an effect that the intention of each user (such as a correction mode) can be easily reflected on a predetermined captured image.

It is a figure which shows the external appearance of the imaging device for games which is the imaging device for games which concerns on one Embodiment of this invention. It is a front view of the imaging unit in the embodiment. It is a front view of the edit unit in the said embodiment. It is a front view of the output unit in the said embodiment. It is a schematic diagram which shows the display structure of the touchscreen for imaging operations in the said embodiment. It is a block diagram which shows the structure which looked at the principal part of the imaging | photography device for play concerning the said embodiment from the functional surface. It is a flowchart which shows the procedure of the imaging | photography process in the said embodiment. It is a flowchart which shows the procedure of the graffiti edit process in the said embodiment. It is a flowchart which shows the procedure of the correction | amendment target determination process in the said embodiment. It is a figure which shows the example of an explanatory screen for the correction determination in the said embodiment. It is a figure which shows the example of an imaging | photography screen for the correction determination in the said embodiment. In the said embodiment, it is a figure which shows the user selection reception screen example displayed on the touch panel 20L for imaging operations on the left side. In the said embodiment, it is a figure which shows the example of a user selection reception screen displayed on the right touch panel 20R for imaging operation. In the said embodiment, it is a figure which shows the example of a correction selection reception screen for receiving selection operation of the correction aspect by a user. It is a flowchart which shows the procedure of the graffiti target image generation process in the said embodiment. In the modification of the said embodiment, it is a figure which shows an example of the imaging | photography screen for performing all members imaging | photography automatically. In the modification of the said embodiment, it is a figure which shows the other example of the imaging | photography screen for performing all members imaging | photography automatically. It is a front view which shows the modification of the imaging | photography unit in the modification of the said embodiment. In the modification of the said embodiment, it is a figure which shows an example of the imaging | photography screen containing the operation input screen for every user. In the modification of the said embodiment, it is a figure which shows another example of the imaging | photography screen containing the operation input screen for every user.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.
<1. Overall configuration>
FIG. 1 is a diagram showing an appearance of a game shooting apparatus that is a game shooting apparatus according to an embodiment of the present invention. More specifically, FIG. 1 (a) is an external side view of the game photographing apparatus as viewed from the side, and FIG. 1 (b) is an external plan view as viewed from above. This game shooting apparatus accepts an editing operation including a shooting room 2 in which a user enters, a shooting unit 3 for shooting a user to obtain a shot image, and a graffiti (drawing operation) by the user on the shot image, An editing unit 4 that generates a combined image combined with the captured image and an output unit 5 that outputs the combined image are provided. FIG. 2 is a front view of the photographing unit 3, FIG. 3 is a front view of the editing unit 4, and FIG. 4 is a front view of the output unit 5. Hereinafter, the overall configuration of the shooting apparatus for play according to the present embodiment will be described with reference to FIGS. 1 to 4.

  The photographing room 2 has a substantially rectangular parallelepiped shape, and the photographing unit 3 is arranged along the front surface of the photographing room 2 which is a front surface when viewed from the user entering the inside. Note that an opening for a user to enter and exit, and a light-shielding curtain that covers a part or all of the opening are provided on a part of each of the left and right side surfaces of the photographing room 2. In addition, a single color (in this case, blue or green) for chroma key composition processing is attached to the rear surface, which is the rear surface as viewed from the user who enters the photographing room 2. In addition, these colors may be attached | subjected also to the floor surface etc. which are included in the imaging | photography range of the imaging | photography unit 3, for example. The photography room 2 is not limited to the above configuration, and may be any space suitable for photography.

  The photographing unit 3 includes a camera 10 as an imaging unit for photographing a user, strobes 11, 12, 13 L, 13 R, and 14 that are arranged at the top, bottom, left and right positions of the camera 10 and emit flash light, and below the camera 10. Two photographing operation touch panels 20L and 20R that are arranged and accept operations from a user and display photographed images are provided.

  The camera 10 is typically a digital camera that generates a digital image signal using a CCD (Charge Coupled Device), captures a user, and outputs an image signal representing the captured image. The flashes 11 to 14 emit a flash toward the user in order to obtain sufficient light for photographing. The two shooting operation touch panels 20L and 20R have the same configuration, and each provide an operation screen for accepting various operations by the user at the time of shooting, and display an image based on the image signal in real time. It is configured as follows. Here, it is assumed that the shooting operation touch panel 20 </ b> L is used by a user standing on the left side with respect to the camera 10, and the shooting operation touch panel 20 </ b> R is used by a user standing on the right side with respect to the camera 10. In the following, the shooting operation touch panel 20L will be described as an example, but the shooting operation touch panel 20R also performs the same display and receives an operation input.

  FIG. 5 is a schematic diagram illustrating a display configuration of the touch panel 20L for photographing operation. As shown in FIG. 5, at the time of shooting, the shooting operation touch panel 20L has a real-time preview area 201 for displaying a shot image in real time, a pose sample display area 202 for displaying a pose sample, and a shooting. The graffiti target image display area 203 for displaying the graffiti target image already obtained by the above is displayed. In the real-time preview area 201, a background image that is chroma key-combined in real time with the captured image is displayed together.

  The photographing unit 3 includes components built in the editing unit 4 such as a computer, that is, a control device that controls each unit, an I / O control device, and a network adapter that communicates with other computers. It is controlled by etc. The photographing unit 3 includes a coin insertion slot 26 at the lower front side.

  The editing unit 4 is controlled by a computer different from the computer that controls the photographing unit 3. Further, as shown in FIG. 1B, the editing unit 4 is divided into two units 4a and 4b so that two sets of users can play. One of the units 4a includes an editing operation touch panel 400 that includes a graffiti area, an area for displaying a menu for graffiti, a tool, and the like and functions as a GUI (Graphical User Interface) display means, and the editing operation touch panel 400 Touch pens 49L and 49R are provided as pointing devices used for the operation of. The other unit 4b has the same configuration. Here, the unit 4a seen in the foreground in FIG. 1A is referred to as “graffiti booth A”, and the unit 4b on the opposite side (the back side in the figure) is referred to as “graffiti booth B”.

  The editing operation touch panel 400 according to the present embodiment has a display configuration in which two users can perform graffiti at the same time in each of the units 4a and 4b. In this description, components used by the user on the left side are given reference signs including “L”, and components used by the user on the right side are assigned reference signs including “R”. ing. But 3 or more users may use these suitably.

  In addition, the editing operation touch panel 400 according to the present embodiment is configured to be able to simultaneously detect the operation positions of the plurality of touch pens 49L and 49R, and each of the detected operation positions is any of the touch pens 49L and 49R. It is also possible to detect whether it corresponds to the above operation. For example, when a capacitive touch panel is used as the editing operation touch panel 400, simultaneous detection of such a plurality of operation positions and identification of the operated touch pen are possible.

  In this respect, the photographing operation touch panels 20L and 20R are configured not to use a touch pen (which may be used as a matter of course) but to be able to detect a plurality of operation positions by the user's finger. In order to realize this, as the photographing operation touch panels 20L and 20R, the proximity, contact, or pressing of the finger can be detected by other known methods such as the capacitive touch panel or the optical sensor method, for example. A display panel (a display panel capable of such detection is referred to as a “panel with a touch sensor”) is used.

  As shown in FIG. 4, the output unit 5 is typically provided with a take-out port 33 for taking out a photo sticker, a photo card, or the like on which a composite image that has been edited by the editing unit 4 is printed. . Further, the output unit 5 transfers, for example, a material image such as a Deco-mail (registered trademark) image or a composite image obtained by grabbing a photographed image to the user's mobile phone terminal by using an infrared port built in the mobile phone terminal, for example. Output operation touch panel 30 that is operated by the user, and an infrared port (non-contact) that is arranged below the output operation touch panel 30 and directly transmits the material image or the like as an infrared signal to the mobile phone terminal. (Communication port) 31 and a speaker 32 for notifying the user by voice of operation methods and sound effects necessary for the communication. This configuration is an example, and some or all of these elements may not be provided.

  The output operation touch panel 30 transmits the material image or the like to the mobile phone terminal having the non-contact communication function when the user wants to view the composite image not only on the photo sticker on which the composite image is printed but also on the mobile phone terminal. It is configured to provide an operation screen for accepting various operations necessary for the operation. This operation is mainly performed using the time until the photo sticker of the composite image is printed. Therefore, the user should use the time effectively until the photo sticker etc. is printed. Can do. Further, without providing the output operation touch panel 30 in the output unit 5, it is possible to perform the operation on the editing operation touch panel 400 of the editing unit 4.

  The output unit 5 has a built-in mobile phone terminal device 55, and a composite image including a photographed image is typically used as image data so that the composite image can be downloaded from a server by a mobile phone terminal used by a user. Is transmitted to a nearby wireless base by a third-generation mobile phone (3G) wireless communication system, and this image data is given from the wireless base station to an image server (not shown) via the Internet and stored.

  Such an output unit 5 is also controlled by a control device configured mainly for a computer that controls the photographing unit 3 and controlling each part, a network adapter for communicating with other computers, and the like, and a composite image. Is provided as a photo sticker.

  In the configuration as described above, after shooting in the shooting room 2, the user uses the graffiti booth A of the editing unit 4 or the touch panel 400 for the editing operation of the graffiti booth B to generate based on the shot image. Graffiti is performed on the graffiti target image. Then, the user prints the composite image generated by the graffiti by the network printer, transmits the image to the mobile phone terminal having the infrared communication function, and displays the image received by the mobile phone terminal on the terminal screen. .

<2. Functional configuration>
FIG. 6 is a block diagram showing the configuration of the main part of the shooting apparatus for play according to the present embodiment as seen from the functional aspect. The game photographing apparatus shown in FIG. 6 functionally includes an editing processing unit 8 that performs editing processing of the graffiti target image in accordance with the user's graffiti operation on the graffiti target image, and processing that mainly shoots the user. (Photographing processing) and processing to output the edited graffiti target image as a photo sticker, etc., or to output the created material image etc. to a mobile phone terminal using non-contact communication ( And an imaging output processing unit 7 for performing output processing.

  The imaging output processing unit 7 includes a first control unit 70, an imaging unit 71, a first display / operation unit 72, an I / O control unit 73, an illumination unit 74, and a first communication unit 75. The fourth display / operation unit 91, the print output unit 92, the audio output unit 93, the non-contact communication unit 94, and the wireless communication unit 96. The edit processing unit 8 includes a second control unit 80, a second display / operation unit 81, a third display / operation unit 82, and a second communication unit 85. The first and second communication units 75 and 85 that are network adapters can communicate with each other via a network 6 that is a LAN (Local Area Network).

  The imaging unit 71 corresponds to the camera 10 configured using an imaging element such as a CCD, and captures an image in real time and outputs an image signal representing the image (captured image). This image signal is input to the first control unit 70 and temporarily stored as photographed image data in its internal memory. The captured image data is supplied as a captured image signal from the first control unit 70 to the first display / operation unit 72, and a captured image based on the captured image signal is displayed in real time. Actually, the captured image data stored as the captured image is high-resolution still image data, and the captured image data (also referred to as “through image data”) for real-time display is low-resolution moving image data. However, since the photographing target is the same, the following description may be made without particularly distinguishing these.

  Here, the first display / operation unit 72 functions as display input reception means (or display means and input reception means) corresponding to the two shooting operation touch panels 20L and 20R, and a background image to be added to the shot image. An operation for selecting (and a foreground image), an operation for setting parameters for correcting a user image, which will be described later, a shutter operation, and the like are accepted. Signals indicating these operations are input to the first control unit 70 as operation signals. The first display / operation unit 72 only needs to function as a display input receiving unit having a plurality of operation screens (display screens). Therefore, one shooting operation touch panel is divided into a plurality of screens. May be. When there are three or more operation screens, one or more of the two or more shooting operation touch panels may be divided into a plurality of screens. Of course, the shooting operation touch panels 20L and 20R are only examples, and may be other display input devices, or may be provided by a display device (for example, a liquid crystal panel or the like) and an input device (for example, a button, a keyboard, or a trackball). The display input device may be configured, and may be configured to accept an operation input by the input device corresponding to each screen.

  The display input receiving means or the display means and the input receiving means include not only hardware for displaying and inputting, but also software for realizing functions for displaying and inputting. Therefore, two or more display means may be realized on one display device, and two or more input reception means may be realized on one input device. For example, in a configuration in which a plurality of operation screens are displayed on the screen of one liquid crystal touch panel, icons for operation and the like are displayed by a plurality of display means, and are used (such as pressing the icons). An operation input by a person is received by a plurality of input receiving means.

  Here, when a predetermined process for photographing the user (corresponding to the selected photographing menu) is started, guidance for the user is displayed on the first display / operation unit 72, and thereafter Based on an instruction from the first control unit 70, a flash is emitted from the flashes 11 to 14 in the shooting direction of the camera 10 after a predetermined time of about several seconds. At that time, an image signal output from the imaging unit 71 as a signal representing a photographed image of the user is input to the first control unit 70, a memory in the first control unit 70, a hard disk device as an auxiliary storage device, or the like. Stored as captured image data.

  The illumination unit 74 corresponds to the strobes 11, 12, 13 L, 13 R, and 14 (see FIG. 2) disposed at the top, bottom, left, and right positions of the camera 10, and performs I / O control based on instructions from the first control unit 70. Lighting / extinguishing and dimming are controlled by the unit 73. The I / O control unit 73 corresponds to an I / O control device built in the photographing unit 3, and controls the illumination unit 74 based on an instruction from the first control unit 70. Further, an input signal such as a detection signal from a coin detection unit (not shown) described later is transferred to the first control unit 70. The first communication unit 75 corresponds to a network adapter and functions as an interface for data transmission / reception via the network 6.

  The first control unit 70 is built in the editing unit 4 and corresponds to a control device mainly composed of a computer including a CPU, a memory, a frame buffer, a timer, an auxiliary storage device and the like, and is stored in a predetermined memory stored in an internal memory. When the CPU executes the program, an instruction is given to each unit as described above in order to control each unit based on the operation signal or the like input as described above. A graffiti target image is generated based on the photographed image. The generated graffiti target image is written in the frame buffer and displayed on the first display / operation unit 72. Further, the first control unit 70 generates a composite image that is an image in which a predetermined background image or foreground image is drawn on the graffiti target image. This graffiti target image has a background color that is a key color used to create a mask, and based on a well-known chroma key composition processing method, a captured image portion including only a user image is extracted, The photographed image portion is synthesized so as to be fitted into the background image. The composite image generated in this way is displayed on the first display / operation unit 72 by being written in the frame buffer.

  In addition to the above-described components, the photographing unit 3 is further provided with a coin detection unit (not shown) for detecting coins inserted into the coin insertion slot 26 in the photographing unit 3, and the first control unit 70 includes Based on the detection result of the coin detection unit, each unit is controlled so as to allow the user to play with the shooting device for play such as shooting, selection of a background image and foreground image, and graffiti for a predetermined time. Since the detection operation by the coin detection unit and the control operation by the first control unit 70 based on the detection result are the same as those of the conventional game shooting device, they are well known, and thus detailed description thereof is omitted.

  Next, the second control unit 80 is built in the editing unit 4 separately from the first control unit 70, and is configured around a computer including a CPU, a memory, a frame buffer, a timer, an auxiliary storage device, and the like. The CPU corresponds to a control device, and the CPU executes a predetermined program stored in the internal memory, thereby performing overall control relating to editing processing performed in the editing unit 4. That is, the second control unit 80 functions as a GUI control unit that controls the second and third display / operation units 81 and 82. In addition, the second control unit 80 is a composite image that is an image in which a predetermined image is drawn on the graffiti target image based on an operation signal for performing graffiti processing on the generated graffiti target image (an image including a captured image). Is generated. Examples of the predetermined image to be drawn include a selected stamp image, a linear image drawn with a touch pen, and a composite stamp image generated by superimposing two or more selected stamps in a predetermined order. A composite image can be used.

  When the generation of such a composite image is completed, an instruction to select a divided layout from the user is accepted, and information indicating the selected divided layout and the generated composite image are sent to the first control unit 70. If the print output unit 92 is outputting another composite image, a message to that effect is displayed and sent after waiting for completion. These pieces of information are transmitted / received via the network 6.

  The second and third display / operation units 81 and 82 correspond to an editing operation touch panel 400 that functions as a graffiti GUI display unit, and accepts a user's operation using a touch pen.

  The second communication unit 85 corresponds to a network adapter and functions as an interface for data transmission / reception via the network 6.

  The first control unit 70 performs overall control related to output processing in addition to the above-described shooting processing. The first control unit 70 stores the composite image sent from the second control unit 80 in the memory as composite image data. The print output unit 92 corresponds to the network printer 35 built in the output unit, and prints the composite image data stored in the memory as a photo sticker (or photo card) (which is appropriately laid out). The printed photo sticker or the like is taken out from an outlet 33 provided at the lower front of the output unit 5.

  Further, the first control unit 70 starts printing processing such as a photo sticker based on the divided layout information and the composite image sent from the second control unit 80, and at the same time receives a user input operation. The operation screen to be displayed is displayed on the fourth display / operation unit 91. The fourth display / operation unit 91 corresponds to the output operation touch panel 30 and functions as an input receiving unit. The output operation touch panel 30 includes a monitor that functions as a display unit such as a liquid crystal display or a CRT (Cathode Ray Tube), and a touch panel for one person that is stacked on the upper surface and can recognize input coordinates. The monitor can display an operation screen divided into a plurality of screens, and the touch panel accepts an input operation using a user's touch pen for each of the plurality of divided screens, and the received input operation is a first as an operation signal. To the control unit 70.

  The wireless communication unit 96 corresponds to the mobile phone terminal device 55 built in the output unit 5, and is created by the first control unit 70 so that the composite image can be downloaded from an image server unit (not shown) by the mobile phone terminal. The synthesized image data is transmitted to the wireless base unit by the 3G wireless communication method.

  Here, the first control unit 70 writes the demo image (demonstration image) stored in advance in the auxiliary storage device in the frame buffer from the end of the graffiti until the start of the operation, to the fourth buffer. Displayed on the display / operation unit 91. The audio output unit 93 corresponds to the speaker 32. The audio output unit 93 explains the input operation method to the user in conjunction with the operation screen displayed on the fourth display / operation unit 91, and the demo image is displayed on the fourth display / operation unit 91. When playing, play music etc. according to the demo image. The description of the input operation method, music, and the like are stored in advance in a hard disk device as an auxiliary storage device.

  Thereafter, the first control unit 70 provides the user with a mini-game to be described later until the composite image is printed by the display of the fourth display / operation unit 91 or the voice or sound effect of the voice output unit 93. to continue. The contents of this mini game are similarly stored in advance in a hard disk device or the like.

  Here, the predetermined program executed in each control device is provided by, for example, a DVD-ROM which is a recording medium on which the program is recorded. That is, a DVD-ROM as a recording medium for the predetermined program is attached to a DVD-ROM driving device built in the control device as an auxiliary storage device, and the predetermined program is read from the DVD-ROM as an auxiliary storage device. Installed on the hard disk drive. The predetermined program may be provided via a recording medium (CD-ROM or the like) other than a DVD-ROM or a communication line. Then, when an operation for starting the game shooting device is performed, the predetermined program installed in the hard disk device is transferred to the memory in the control device and temporarily stored therein, and the CPU in the control device Executed by. Thereby, the control process of each part by the control device is realized.

  Although the first and second control units 70 and 80 have been described as corresponding to devices including different computers, such a configuration is merely an example, and the first and second control units 70 are described. , 80 may be realized by one or three or more devices, and may be incorporated in any unit. In this case, each device executes a program corresponding to a function to be realized. In addition, the photographing unit 3, the editing unit 4, and the output unit 5 may be configured by two or less units or four or more units.

<3. Processing procedure in game shooting device>
As described above, the shooting device for play includes the shooting unit 3, the editing unit 4, and the output unit 5. The photographing unit 3 performs photographing processing, the editing unit 4 performs later-described graffiti editing processing, and the output unit 5 performs output processing. It should be noted that when a certain user is playing with the photographing unit 3, another user can play with the editing unit 4, and yet another user can output a composite image with the output unit 5. ing. In other words, this gaming device can perform shooting processing, graffiti editing processing, and output processing in parallel. The outline of the doodle editing process and the output process will be described below with a focus on the shooting process.

<3.1 Shooting process>
FIG. 7 is a flowchart showing the procedure of the photographing process in the present embodiment. When the game shooting device is not used (when no play is performed), demonstration images are displayed on the shooting operation touch panels 20L and 20R. When the user inserts a coin into the coin insertion slot 26 while displaying the demo image, the play is started (step S110).

  Subsequently, in step S120, the first controller 70 determines the user's face (typically) so that the image of the user included in the captured image (typically) is corrected in a manner desired by the user. Specifically, a process (correction target determination process) is performed in which the user is associated with the operation screen used by the user and the user selects the correction mode of the captured image. Since this correction target determination processing has a characteristic configuration, it will be described in detail later.

  When the correction target determination process is completed, whether to shoot automatically or manually is selected, and when shooting automatically, a shooting theme is selected. When automatic shooting is selected, the first control unit 70 performs a shooting operation on a screen for allowing the user to select one or more shooting themes from a plurality of shooting themes prepared in advance. Are displayed on the touch panels 20L and 20R, and a selection operation by the user is accepted. Then, the first control unit 70 acquires selection information based on the user's selection operation, and based on the selected shooting theme, a combined image (hereinafter referred to as a frame and a background) used for shooting. "Background image"). At this time, when shooting is performed a plurality of times, the number of background images equal to the number of shootings is determined.

  On the other hand, when shooting manually, the user freely determines the background image. That is, the user selects one to be used for shooting from a plurality of types of background images prepared. When shooting is performed a plurality of times, the user is made to select the number of background images corresponding to the number of shootings. The background image selected by the user is determined as the background image used for shooting.

  Next, in step S130, the first control unit 70 displays an operation screen as shown in FIG. 5 on the photographing operation touch panels 20L and 20R, respectively. As described above, in the real-time preview area 201, a background image that is chroma key-combined in real time with respect to a captured image is displayed. This chroma key composition display processing is generally a process for creating a chroma key mask. And a process of synthesizing the background image. The chroma key mask is, for example, a well-known composite mask (alpha channel), and an area having a key color (in this case, blue or green) in a target photographed image, that is, an area occupied by an image on the back of the photographing room 2. Is data for making transparent and making other areas non-transparent. In this composite mask, a value α indicating transparency of 0 (completely transparent) or 255 (completely non-transparent) is generally set for each pixel of the target image. By using such a chroma key mask, the background image region corresponding to the non-transparent region (α = 255) of the photographed image is hidden (masked), and the background image corresponding to the transparent region (α = 0). This area is synthesized so that it can be seen. Therefore, a composite image can be obtained as if a non-transparent area portion of the target captured image is cut out and the cut-out portion is pasted on the background image. The composite image obtained in this way is also displayed on the shooting operation touch panels 20L and 20R. The captured image displayed here is not actually (high-resolution) still image data stored as a captured image, but through-image data for performing real-time display. This through image data is continuously acquired from the camera 10 (as a broadly captured image) from the start point to the end point of the entire shooting process (S100 to S170). With such chroma key processing, it is possible to create a photo with high playability.

  Thereafter, the process proceeds to step S140, where it is determined whether or not it is a shooting timing at which shooting should be performed. If it is not the shooting timing (No in step S140), the operation screen display is repeated until the shooting timing is reached ( (S140 → S130 → S140) If it is the shooting timing (Yes in step S140), the process proceeds to the shooting process in step S150.

  In the shooting process in step S150, as described above, after a predetermined time of about several seconds has elapsed, a flash is emitted in the shooting direction of the camera 10, and the shot image data acquired by the camera 10 is stored in the first control unit 70. Stored in memory.

  Next, in step S160, the first control unit 70 corresponds to each user corresponding to the captured image obtained in step S150 in each correction mode selected and confirmed by each user in step S120. A process for generating a graffiti target image by correcting the image and combining it with a background image (graffit target image generation process) is performed. This graffiti target image generation process (S160) also has a characteristic configuration related to the correction target determination process (S120), and will be described in detail later. Note that the graffiti target image generation process in step S160 may be performed after the process in the following step S170 is completed.

  Subsequently, in step S170, the first control unit 70 determines whether or not shooting of a predetermined number of times (the number of sets) has been completed. As a result of the determination, if the predetermined number of shootings have been completed, the process proceeds to step S180, and if the predetermined number of shootings has not been completed, the process returns to step S130. In practice, a time limit for shooting (for example, 3 minutes) is provided, and when a predetermined number of times of shooting is completed earlier (somewhat) than the time limit, shooting is further performed (bonus). Called a shot).

  In step S180, an image to be actually graffitied is selected (by the user) from a plurality of graffiti subject images. Specifically, the first control unit 70 displays a list of graffiti target images on the touch panels 20L and 20R for photographing operation so that the user can select images to be used for graffiti and printing. Accept the operation. Note that an operation for selecting a different graffiti target image for each user may be accepted on the photographing operation touch panel 20L and the photographing operation touch panel 20R. Then, the first control unit 70 sets the image selected by the user as an actual (final) graffiti target image. At this time, the plurality of graffiti target images displayed on the photographing operation touch panels 20L and 20R are each photographed image corrected by the process of step S160.

  When the process in step S180 ends, the process proceeds to step S190. In step S190, a guidance screen is displayed. Specifically, the first control unit 70 displays a screen for guiding the user to any one of the editing units 4 (4a or 4b) on the photographing operation touch panels 20L and 20R. Thereby, the photographing process is completed. The present embodiment is characterized by the content of the correction target determination process in step S120 and the content of the graffiti target image generation process in step S160. For these points, refer to FIG. 9 and FIG. The contents of the subsequent graffiti editing process will be described later.

<3.2 Graffiti editing process>
FIG. 8 is a flowchart showing the procedure of graffiti editing processing in the present embodiment. The graffiti editing process is realized by the second control unit 80 operating as shown in FIG. 8 based on a predetermined program. In this process, after completion of the above-described shooting process, a timer built in the second control unit 80 is set to a predetermined time (specifically, a time for allowing graffiti), and countdown is started (step S1). S205). At this time, a graffiti editing operation screen is displayed on the editing operation touch panel of the editing unit 4 (4a or 4b) that has prompted the user to move by the process (guidance display) in step S190 of FIG. Then, a graffiti operation (drawing operation) by the user with respect to the selected plurality of shooting target images is accepted (steps S210 to S240). During the graffiti editing process, the editing unit 4 performs a material image such as a Deco-mail (registered trademark) image in addition to an editing operation for the graffiti target image (selected in step S180 in FIG. 7) based on the photographed image. An editing operation for creating the file may be accepted, but the description thereof is omitted.

  When a graffiti editing screen is displayed on the touch panel 400 and a predetermined tool icon (not shown) arranged at a predetermined position on this screen is touched with a touch pen, the graffiti function corresponding to the touched tool icon is selected and executed. A possible state is reached (step S210). Subsequently, when the area including the graffiti target image (not shown) displayed on the graffiti editing screen is touched with the touch pen, the touched position coordinates are input (step S220), and the graffiti typically selected at the position is selected. A compositing image (such as a stamp image) corresponding to the function, that is, a graffiti is displayed (step S230). In this graffiti editing process, the processing contents are typically stored in order with the position, and the final editing result is displayed. Therefore, editing can be canceled. Thereafter, in step S240, it is determined whether or not the graffiti has ended by the remaining time of the timer becoming zero (or performing an operation to be ended by the user), and if not (if No in step S240), step Returning to S210, the process is repeated until the graffiti is completed, and when the graffiti is completed (Yes in step S240), the composition for the selected composition is selected according to the procedure of the editing process stored in the process of step S230. A (final) synthesis process of the image and the graffiti target image is started, and a synthesized image is generated (step S250).

  In step S260, the division pattern of the output photo is selected. Specifically, the second control unit 80 displays on the editing operation touch panel 400 an operation screen for causing the user to select one of a plurality of division patterns prepared in advance, and the user The selection operation by is accepted. After the process of step S260 is completed, the process proceeds to step S270.

  In step S270, a guidance screen is displayed. Specifically, the second control unit 80 displays a screen for guiding the user to the output unit 5 on the editing operation touch panel 400. Thereby, the graffiti editing process ends. When the graffiti editing process ends, the output unit 5 starts a printing process such as a photo sticker based on the composite image (and information on the selected division pattern) sent from the second control unit 80. Is as described above.

<3.3 Correction Target Determination Process>
Next, detailed contents of the correction target determination process in step S120 will be described with reference to FIG. FIG. 9 is a flowchart showing a procedure of correction target determination processing in the present embodiment. In step S121 shown in FIG. 9, the first control unit 70 displays an explanation screen for photographing everyone, which is different from normal photographing, on the photographing operation touch panels 20L and 20R.

  FIG. 10 is a diagram illustrating an example of an explanation screen for photographing everyone. As shown in FIG. 10, since the image quality (image correction mode such as eye shape and density, face contour, skin quality, etc. described later) is set in accordance with the user's preference, This is displayed on the touch panel 20 for shooting operation. Note that this photographing is performed in order to recognize and identify the faces of all users, as will be described in detail later. In addition to the above shooting, an OK button 205 is displayed on the shooting operation touch panel 20, and the user performs an operation of pressing the OK button 205 (specifically, an operation of touching the position with a finger or the like). As a result, the screen shifts to the next operation screen. As shown in FIG. 10, it is desirable to notify the user that everyone will be shooting different from normal shooting from now on, but such notification may be omitted. Further, in relation to an example of an operation screen for shooting described later, in place of the explanation screen shown in FIG. 10 or on a screen (not shown) displayed thereafter, along with an explanation for asking the number of users, The structure which receives operation which inputs a number may be sufficient.

  Subsequently, in step S122, the first control unit 70 displays on the photographing operation touch panel 20 a photographing operation screen (photographing screen) for photographing all members different from normal photographing as shown in FIG. .

  FIG. 11 is a diagram illustrating an example of a shooting screen for shooting all the members. As shown in FIG. 11, the photographing operation touch panel 20 has a real-time preview area 201 (which is slightly larger here) similar to that during normal photographing, and a fixed position (predetermined position) in the real-time preview area 201. B) A displayed face position guide 206 and an OK button 205 are displayed. The face position guide 206 is not displayed during normal shooting, and the position where the face should be displayed is determined so that the face appears larger than during normal shooting. When this face position guide 206 is displayed, the user naturally moves the face position so that the face is within the frame and the face is fully captured, so that face recognition described later is performed. In this case, a suitable photographed image can be obtained. Of course, the face position guide 206 may be omitted. However, even in such a configuration, the face position guide 206 may be taken so as to face the front, and close to the camera 10 so that everyone's face can be clearly seen. In addition, a configuration in which a notification sentence is displayed or voice guidance is provided is preferable.

  Further, the face position guide 206 shown in FIG. 11 has a shape that is planned to be used by two users, but the number of users is, for example, the operation shown in FIG. It is determined by accepting a user operation input in or around the screen. Therefore, when the number of users is one or three or more, the face position guide 206 is scheduled to be used by a predetermined number of users according to the determined number of users. It is displayed in the shape that has been. Further, the number of persons may be detected by performing a face recognition process described later at this time.

  After the user is ready for shooting in this way, shooting is performed when an operation of pressing the OK button 205 displayed on the shooting operation touch panel 20 is performed. That is, the following processing shown in FIG. 9 is performed.

  First, in step S123, the first control unit 70 determines whether or not it is a shooting timing (here, whether or not the OK button 205 is pressed), and when it is not a shooting timing (in the case of No in step S123). The operation screen display is repeated until the shooting timing is reached (S123 → S122 → S123). If it is the shooting timing (Yes in step S123), the process proceeds to the shooting process in step S124.

  In the shooting process in step S124, a flash is emitted in the shooting direction of the camera 10 after a predetermined time of about several seconds as in the normal shooting, and the shot image data (here, all the shot images) acquired by the camera 10 is emitted. Is stored in the memory of the first control unit 70.

  Subsequently, in step S125, a process of recognizing the faces of all the users (here, two people) included in the all-person photographed image acquired in step S124 is performed. This face recognition process includes a face area recognition process for recognizing a face area and a face identification process for individually identifying the user's face. These may be performed stepwise or simultaneously. Further, the face identification process may be performed without performing the face area recognition process. Such processing is generally referred to as face recognition processing here. In this face recognition process, the face areas of two users are recognized here, and the faces of the two users are identified by calculating corresponding feature amounts.

  More specifically, first, a known method may be employed for the face area recognition process. For example, a template image is generated by enlarging, reducing, or rotating a model image stored in advance, and this template image is used as a reference. When an image having facial features is included in the captured image, a method for recognizing the region as a face region or a well-known recognition method that does not use a template, such as a skin color region shape, is recognized. It is possible to adopt a recognition method using various pattern recognition methods. Detailed description of these known methods is omitted. Next, a well-known technique may be used for the face identification process as well, such as the relative positional relationship and size of the eyes, nose, etc. of the face, the amount that characterizes the shape of the eyes, nose, cheeks, chin, etc. Then, a known geometrical or statistical numerical value (hereinafter referred to as “feature amount”) used for identifying the face is calculated. The feature amount is a plurality of integer values composed of a plurality of parameters, but may be defined in any manner as long as it can be distinguished from other faces. With this face identification process, it is possible to identify whether two users are photographed in any position or how they are photographed. By executing the program for recognizing and identifying the face area in this way, the user's face can be recognized easily and inexpensively without providing a sensor or the like. If hardware such as a well-known face detection (or face identification) LSI chip is used, face area recognition and face identification can be performed faster than in the case of software processing. Further, the face recognition process here is different from the normal face recognition process that requires one of a large number of (registered) faces to be accurately extracted. It is sufficient to perform recognition processing that can be distinguished from each other, and it is sufficient to calculate feature quantities that can be distinguished from each other.

  Subsequently, in step S126, a later-described user selection reception screen for determining a user to be corrected is displayed on the photographing operation touch panels 20L and 20R, and the user based on the displayed user selection reception screen is displayed. Operation input is accepted. An example of such a selection reception screen and an input to the screen will be described in detail with reference to FIGS.

  FIG. 12 is a diagram showing an example of a user selection reception screen displayed on the left photographing operation touch panel 20L, and FIG. 13 is an example of a user selection acceptance screen displayed on the right photographing operation touch panel 20R. FIG. As shown in FIG. 12, the photographing operation touch panel 20L displays the whole-person photographed image 211 photographed in step S124 and an OK button 205 for transitioning to the next screen. The same applies to FIG. However, the left user's face area included in the all-person photographed image 211 shown in FIG. 12 is hatched, and the right user's face area included in the all-person photographed image 211 shown in FIG. Are hatched. This diagonal line is attached to indicate that the selection has been made in an easy-to-understand manner. When the user selects a face area by pressing the face area, the color of the face changes or the display is depressed. Changes are made. As a result, the face area of the selected user can be easily identified. However, such a display mode is an example, and any display mode and input reception mode may be used as long as the user's selection can be received. When the selection of the user (the face area) selected in this way is completed, the first control unit 70 is selected from the selected screen (one of the touch screens 20L and 20R for photographing operation). The feature quantity indicating the user is stored in association with each other. For example, it is stored that the user having the feature amount A is selected on the left screen, and the user having the feature amount B is selected on the right screen.

  Subsequently, in step S127, a correction selection reception screen (to be described later) for determining the correction mode of the captured image is displayed on the shooting operation touch panels 20L and 20R, and an operation input by the user based on the displayed correction selection reception screen is performed. Reception is done. Such a correction selection acceptance screen and an input example on the screen will be described in detail with reference to FIG.

  FIG. 14 is a diagram illustrating an example of a correction selection reception screen for receiving a correction mode selection operation by a user. As shown in FIG. 14, a plurality of correction mode determination buttons 207 for selecting a correction mode and an OK button 205 for transitioning to the next screen are displayed on the shooting operation touch panels 20L and 20R. .

  Here, four types of correction modes are set as shown in FIG. 14, and the shape of the eye (specifically, the shape of the eye, the shape of a suspended eye, a leaned eye, etc.) ), Darkness of eyes (specifically, elements related to the internal shape and color of the eye, such as eye color and pupil size), and contour (specifically, chin And the skin edge (specifically, skin color, brightness, blur condition, etc.) The elements related to the appearance of the display are selectable. Note that such correction can be easily realized by using a known or appropriate change method or modification method for at least one of the color or shape of the image. Further, these correction modes are examples, and any known correction mode can be applied. These four correction modes are displayed so that four typical states A to D (hereinafter referred to as “setting states”) can be selected by a correction mode determination button 207. In FIG. 14, these setting states are indicated by symbols A to D. However, instead of these symbols, an explanatory text indicating the setting state or a number indicating the degree of correction may be used. Good. Further, by using a slider (bar) or the like, it may be displayed so as to be able to input an amount that changes steplessly, and there is no particular limitation on the type, number, input mode, and the like. Therefore, various known input interfaces can be used. As described above, the setting state for setting the correction state in a certain (type) correction mode is also referred to as “parameter” below. Information such as numerical values and symbols set in this parameter is hereinafter referred to as “parameter”. Also called “value”.

  In this way, when the setting state (parameter setting) of these correction modes is completed, the first control unit 70 sets the selected screen (one of the shooting operation touch panels 20L and 20R) and the setting. The associated parameter values are stored in association with each other. This makes it possible to associate the relationship between the screen stored in step S126 and the feature amount. That is, it is possible to store in what correction state the correction mode should be corrected for each user image (having a predetermined feature amount). For example, when a user showing the feature amount A is selected on the left screen and a user showing the feature amount B is selected on the right screen, the setting state of the correction mode for the image of the user showing the feature amount A, and the feature The setting state of the correction mode for the user image indicating the amount B is stored in association with each other. In this way, the first control unit 70 functions as an association unit that associates each user's face image with an operation input including an input of a correction mode setting state.

  Further, as shown in FIG. 14, an initial value is set in the correction mode setting state (parameter). In the figure, a setting state corresponding to a plurality of correction mode determination buttons 207 indicated by “B” is set as an initial value of each correction mode, which is surrounded by a dotted line labeled “Recommendation”. . In practice, an initial screen in which setting states corresponding to the notation “B” are initially set is displayed as an initial selection reception screen before an operation input by the user is performed.

  Such an initial setting state is changed when the user presses an appropriate correction mode determination button 207, and can be changed to a setting state as shown in FIG. 14, for example. When the setting state of the correction mode is determined, the OK button 205 shown in FIG. 14 is pressed, the determination of the correction mode setting state ends (the parameter value is determined), and the correction target determination process ends. To do. Even if the OK button 205 is not pressed, when a predetermined time has elapsed after the selection acceptance screen (see FIG. 12) is displayed, the determination of the correction mode setting state is terminated and the correction target determination process is terminated. It may be.

  As described above, when the correction target determination process (S120) shown in FIG. 7 is finished, a predetermined number of pictures are taken, and the photographing process is finished. Subsequent graffiti processing and output processing are also as described above. Next, detailed contents of the graffiti target image generation process in step S160 will be described with reference to FIG.

<3.4 Graffiti target image generation processing>
FIG. 15 is a flowchart showing the procedure of the graffiti target image generation process in the present embodiment. In step S161 shown in FIG. 15, the first control unit 70 creates the above-described chroma key mask, and images (hereinafter referred to as “user images”) occupied by the user for each user (here, two). Generate. As described above, by creating a chroma key mask, it is possible to distinguish between the two user images and the background area occupied by the back image of the photographing room 2 having the key color. Since the user is often standing, the user image is often divided into two. However, when the user image is not divided into two, such as when the user is in contact, two boundaries can be set by appropriately setting a boundary line (for example, consisting of points equidistant from the two faces). Create a user profile. Here, although it may not be easy to divide the user's image into two, the most important area to be corrected and the area that the user is particularly aware of is the face area. In most cases, this face area is divided into two without touching, and even if it is not divided, the boundary of the face can be accurately recognized by face recognition processing. Therefore, if at least the face area is accurately distinguished to some extent (to some extent), it is large even if the distinction for each user in other (skin color areas such as hands and feet) is not accurate. It doesn't matter.

  Subsequently, in step S162, the first control unit 70 calculates a feature amount for each user. As described above, the feature amount for each user is calculated by a known face recognition process. The calculated feature amount is temporarily stored in association with the user image including the face area having the feature amount. Note that the face area and the portion of the user image other than the face area are a series of areas and the positional relationship is substantially fixed, and therefore can be easily associated with each other.

  Next, in step S163, the first control unit 70 corrects the corresponding user image with the parameter value corresponding to the calculated feature amount for each user. As described above, in steps S126 and S127, it is stored in what setting state the correction mode should be corrected for each user image (having a predetermined feature amount). For example, the setting state of the correction mode for the user image indicating the feature amount A and the setting state of the correction mode for the user image indicating the feature amount B are stored. The first control unit 70 performs correction for each corresponding user image with the stored parameter value.

  Here, it is ideal that the same feature value is obtained under any condition, but in reality, the feature value is completely the same value for reasons such as changes in the user's facial expression and shooting conditions. It may not be obtained. However, even if the same value cannot be obtained, it is not normally considered that the value will change to the same or approximate value as the feature value of other users. On the premise of the range, when the feature amount is the same as or similar to the feature amount stored, there is no problem as long as it is the same user's face (feature amount). Specifically, among all the stored feature values (corresponding to the user), a feature value within a predetermined range from the calculated feature value or a feature value closest to the calculated feature value is associated. An example of identifying as a user is conceivable. Other identification methods may be used. As described above, the first control unit 70 corrects the user image corresponding to the feature amount with the parameter value corresponding to the feature amount that is the same as or approximate to the calculated feature amount for each user.

  Subsequently, in step S162, the first control unit 70 combines the user images corrected in step S163 with a chroma key composition of the background image corresponding to the selected shooting theme, that is, in step S130. By the same chroma key composition processing as the processing that is performed (strictly, the low-resolution through image is not chroma-keyed with the background image, but the captured image that is a high-resolution still image is chroma-keyed with the background image) The generated composite image is displayed on the photographing operation touch panels 20L and 20R as a graffiti target image. Note that the corrected photographed image for all members may be used as the graffiti target image.

  Thereafter, the process proceeds to step S165, where it is determined whether or not all the captured images have been corrected. If not corrected (No in step S165), the above processing is repeated until all the captured images are corrected. This is the case (S165 → S161 →... → S165), and when the correction for all the photographed images is completed (Yes in step S165), the graffiti target image generation process is completed.

  As described above, when the graffiti target image generation processing (S160) shown in FIG. 15 is completed, the second and subsequent shootings and the generation of graffiti images are repeated (S130 → S140 →. → S130), a graffiti target image is selected (S180), and the photographing process ends. Subsequent graffiti processing and output processing are also as described above.

<4. Modification>
<4.1 First Modification>
In the above embodiment, as shown in FIG. 12 and FIG. 13, a screen (any one of the shooting operation touch panels 20 </ b> L and 20 </ b> R) selected by a user's (here, pressing the face area) operation input; Although the feature quantity indicating the selected user is stored in association with each other, the configuration may be such that the association is automatically performed regardless of the user's operation input.

  FIG. 16 is a diagram illustrating an example of a shooting screen for automatically shooting all members. As shown in FIG. 16, the photographing operation touch panels 20L and 20R display a real-time preview area 201 similar to that during normal photographing and a face position guide 206 that is fixedly displayed in the real-time preview area 201. Is done. When this face position guide 206 is displayed, the user naturally moves the face position so that the face is in this frame and the face is full as in the case shown in FIG. Since it is moved, a suitable captured image for correction can be obtained.

  Here, in the above embodiment, in step S123 shown in FIG. 9, the first control unit 70 determines whether or not the OK button 205 (shown in FIG. 11) is pressed as the shooting timing. When each user's face area has an appropriate size within the two frames of the left and right screens of the face position guide 206, the first control unit 70 automatically takes a picture. . At this time, as shown in the upper part of the face position guide 206, the face feature amount in the left screen frame is associated with the left screen, and the face feature amount in the right screen frame is displayed on the right screen. Automatically associated. Therefore, according to the configuration of this modified example, the user does not need to accept the user selection in step S126, so that the correction for each user can be performed easily and quickly. Further, such automation of association can be performed in a manner as shown in FIG.

  FIG. 17 is a diagram illustrating another example of a shooting screen for automatically shooting all members. As shown in FIG. 17, the photographing operation touch panels 20L and 20R display a real-time preview area 201 similar to that during normal photographing and a center separation line 208 fixedly displayed in the real-time preview area 201. Is done. When the image of the user is divided on the left and right with the center separation line 208 as a boundary, the first controller 70 automatically takes a picture. Since the user's standing position can be naturally moved to the left and right in this way, the correspondence with the subsequent screen is naturally made. Also in this case, as in the case shown in FIG. 16, the feature amount of the face in the frame for the left screen is associated with the left screen, and the feature amount of the face in the frame for the right screen is displayed on the right screen. Automatically associated. Accordingly, since the user does not need to accept the user selection in step S126, the correction for each user can be performed easily and quickly. The automation of such association is based on the position of the user's face (or the position of the user's image), such as automatically determining in the order of the user's standing position, in addition to the mode shown in the above modification example, It can be done in various ways.

  Further, a configuration in which the association is automatically performed without performing the image display as shown in FIG. 16 or FIG. 17 from FIG. 11 to FIG. For example, instead of acquiring the whole body captured image, the user's face is recognized based on through image data for real-time display, and each user and the imaging operation touch panels 20L and 20R according to the position of the user. Is associated with Specifically, when there are three or more users, the user is divided into two groups on the left and right according to the position where each user stands, and the users (images of their faces) belonging to the group on the left are taken for the shooting operation touch panel 20L. In addition, users (images of their faces) belonging to the right group are respectively associated with the shooting operation touch panel 20R. Further, the association may be performed based on a predetermined condition (for example, gender and facial features determined by face recognition) different from the position where the user stands. Such an operation is the same even when the number of touch panels is three or more.

  Furthermore, when there are three or more users, a configuration in which at least one of the photographing operation touch panels 20L and 20R is divided into a plurality based on the through image data is also conceivable. Such an operation is the same even when the number of touch panels is three or more, and an operation screen equal to the number of users may be displayed even in the case of one.

  Each of the above associations is not based on the user's operation, but is performed regardless of the user's intention. For this reason, after the above association, the user may have to move to a position suitable for operation input. For example, "This person should operate the left (or right) screen" The problem can be solved by displaying a guidance screen including the face image of the user.

<4.2 Second Modification>
In the above embodiment, as shown in FIG. 2, the display and operation input are performed on the respective screens of the shooting operation touch panels 20L and 20R. However, as shown in FIG. However, it may be configured to be displayed on two screens.

  FIG. 18 is a front view showing a modification of the photographing unit 3. As shown in FIG. 18, only one shooting operation touch panel 20C is provided, and this shooting operation touch panel 20C displays two screens of the same size on the left and right. In this configuration, two operation screens are displayed by software, and different inputs are received on the respective screens. However, when two screens are displayed, the operation is substantially the same as in the above embodiment. However, since there are not necessarily two users, when there are three or more users, it is difficult to display at least three operation screens of the same size in the above embodiment. However, in the configuration of the second modification, the number of operation screens can be freely changed according to the number of users. For example, when the number of users is changed from two to three, by changing the display screen of the touch panel for photographing operation 20C from two divisions to three divisions, three operation screens can be obtained. When the number of persons is changed from two to one, the operation screen may be changed to be displayed as it is without dividing the display screen. In this configuration, the first control unit 70 functions as an input control unit that changes the number of input receiving units. As described above, in the second modification, an operation screen suitable for the number of users can be provided, and correction target determination processing can be performed.

  In addition, when the configuration of the second modification is applied to the above-described embodiment including two shooting operation touch panels, it is difficult to display an operation screen of the same size if the number of users is an odd number. However, the operation screen according to the number of users can be displayed in the configuration of the above embodiment. For example, when there are three users, a total of three operation screens can be obtained by dividing one of the shooting operation touch panels 20L and 20R into two.

  Furthermore, it is not essential that the number of users and the number of operation screens be the same, and even if the number of operation screens is smaller than the number of users, correction is performed in the same manner as in the above embodiment. Is possible. However, in this configuration, since images of two or more users are selected on one screen, it is not possible to perform correction reflecting the preferences of all users. However, since it is possible to perform correction in a manner that differs by at least the number of operation screens (for the user image selected on the screen), correction that reflects the user's preference to some extent can be performed quickly. The effect that it can be obtained.

  The plurality of operation screens have been described in the screen examples in the form of dividing the display screen of the shooting operation touch panel 20C. However, the operation screen may have any shape. A rectangular shape smaller than the display surface like a window screen or a shape like a balloon may be used. Also in this case, the number of operation screens may be smaller than the number of users, but a configuration that clearly indicates which user corresponds to which operation screen (by the shape of the figure or description) is preferable. .

  Further, as described above, the setting of the correction mode does not necessarily have to be performed at the beginning of shooting, and may be configured to be performed once or many times during shooting. Furthermore, there may be a case where the number of persons to be photographed (that is, the number of user images included in the photographed image) is changed. In this case, a configuration in which the number, shape, position, and the like of the operation screen are appropriately changed according to the number of user images included in the captured image is preferable. In addition, an operation screen for accepting the setting of the correction mode as described above may be displayed on one or more of a plurality of captured images obtained by the shooting after shooting is completed. In this configuration, the operation screen may be displayed immediately after the shooting is finished and before the output process is started. For example, the operation screen is displayed on the editing operation touch panel 400 of the editing unit 4 during the graffiti editing. May be displayed. If the user's face is recognized after the correction mode is set on the operation screen, the image of each user in each captured image can be individually corrected. Moreover, what is necessary is just a structure which receives the setting of the correction | amendment aspect by the said operation screen with respect to one part or all instead of one of several picked-up images.

  Next, an example in which a correction selection receiving screen example for receiving a correction mode selection operation for each user on the shooting screen in the configuration of the above-described modification is displayed will be described with reference to FIGS. 19 and 20. In the following screen example, a captured image including a user image is displayed. As described above, the captured image may be a still image or a through image.

  FIG. 19 is a diagram illustrating an example of a shooting screen including an operation input screen for each user. As shown in FIG. 19, the photographing operation touch panel 20 </ b> C includes a real-time preview area 201 that is the same as that during normal photographing, an image of two users in the real-time preview area 201, and the upper left of one user. A left correction selection reception window 209L for receiving a correction mode selection operation by the user, a right correction selection reception window 209R for receiving a correction mode selection operation by the user at the upper right of the other user, An OK button 205 is displayed.

  In the left correction selection acceptance window 209L and the right correction selection acceptance window 209R, as in the example of the correction selection acceptance screen shown in FIG. Each user can similarly press the button to set the correction mode (parameter setting). The first control unit 70 stores the image of the user corresponding to the window screen on which the above setting has been made and the set parameter value in association with each other. The first control unit 70 thus functions as an association unit that associates each user's (face) image with an operation input including an input of a correction mode setting state. Further, the set correction mode does not necessarily have to be reflected in the image of the user displayed on the correction selection reception screen, but is assumed to be reflected here.

  In this way, by displaying a window screen that accepts correction selection for each user, it is possible to make settings that each user prefers, and by checking each window screen, each user can check their own setting status. This makes it easy to check the (correction state).

  Note that FIG. 19 shows an example in which there are two users, but there may be three or more users. In that case, positions corresponding to the images of the respective users (for example, overhead as appropriate). A similar window screen is displayed at a remote position, and the correction mode can be set in the same manner.

  FIG. 20 is a diagram illustrating another example of a shooting screen including an operation input screen for each user. As shown in FIG. 20, the photographing operation touch panel 20C includes a real-time preview area 201 similar to that during normal photographing, images of two users in the real-time preview area 201, and each user's image. Shooting mode selection windows 219L and 219R and an OK button 205 are displayed near the chest position of the image.

  These shooting mode selection windows 219L and 219R are used to select a shooting mode, for example, to select an image quality (in this case, one of soft, soft image quality and cool image quality with transparency). A correction mode selection operation by a person is accepted.

  The display positions of the shooting mode selection windows 219L and 219R are merely examples, and may be displayed at any position corresponding to the user, but the relevance (correspondence) with the user can be easily determined. It is preferable to display the position. If it does so, it can make it easier to confirm a user's setting state (correction state) by each user confirming the said window screen.

<4.3 Third Modification>
In the above embodiment, the face recognition process is performed to associate the correspondence between the feature amount of the user's face and the screen, but the correspondence relationship between the screen and the user is used without using the feature amount. That is, a configuration in which face recognition processing is performed without using it is also conceivable.

  For example, if the configuration allows the user to select the user to be corrected in all the captured images, the user image to be corrected cannot be automatically determined, but the correction mode is determined for each captured image. Since it is not necessary, correction can be performed quickly for each user included in each captured image.

  In addition, it is assumed that the person standing on the left side (or the person standing on the right side) in the captured image is the same user, for example, based on the position of the user image in the captured image without using the user's face. A configuration is also conceivable in which the person is automatically determined. In this case, since it is not necessary for the user to select a user image in each captured image, it can be said that the user can quickly correct the image. However, since the shooting device for games often changes for each captured image, such as the user's position being changed, a configuration in which the user is correctly identified by face recognition processing is more preferable.

  Note that even in the face recognition process, the face area can be accurately distinguished from other areas even when only the process of recognizing the user image is performed without identifying the user. Such distinction can be made based on the chroma key composition process, but the above recognition process is suitable for accurately distinguishing only the face portion. Therefore, in a configuration in which the correspondence between the screen and the user is performed without using the feature amount, a configuration in which only the process of recognizing the user image is performed without identifying the user. According to this configuration, it is possible to accurately determine an important face portion (without performing chroma key composition processing).

<4.4 Other Modifications>
In the present embodiment, one camera 10 is provided, but two or more cameras may be provided. For example, an up-shooting camera that takes an enlarged image of the vicinity of the user's face, A configuration may be provided in which a whole body photographing camera for photographing a range from the whole body of the user to about half the body is provided. In this configuration, for example, a captured image used for the correction target determination process is acquired by the up-shooting camera, the setting state of the correction mode is determined, and the captured image acquired by the whole-body shooting camera in the determined setting state is determined. It is conceivable to perform correction. The reverse is also possible. Furthermore, instead of the correction target determination process using the up-shooting camera, or together with this, the whole-body shooting camera is used to take a suitable correction mode setting for the captured image acquired by the whole-body shooting camera. It may be configured to be determined based on an operation input by a person. For example, a configuration may be used in which correction is performed in a manner such as lengthening a foot or narrowing a body with respect to a captured image acquired by a whole-body imaging camera.

  In the present embodiment, the color or the like of a part of the user's image is changed. However, the predetermined image processing is performed on a part of the captured image related to the user's image. May be. For example, a belt-like additional image (hereinafter referred to as an “aura image”) having a predetermined pattern or color is arranged around the user's image, or a hat or An image (synthesizing) process for arranging an additional image showing a ring or the like can be considered. For example, when the aura image is arranged in the vicinity of the user's image, the user receives an operation input for designating the contents of the additional image corresponding to the image of the user's face on the photographing operation touch panels 20L and 20R. Then, image processing is performed in which the designated aura image is arranged around the image of the same user. Note that the same aura image need not be arranged around the same user image included in all the captured images. For example, an operation input for specifying the type of the aura image is accepted, and the received type A configuration in which aura images (selected in a predetermined order or randomly selected) are arranged on each captured image is considered. Further, a configuration may be employed in which an image such as a stamp image different from the aura image is disposed at a position separated from the user image by a predetermined distance. In addition, the relationship between a part of a captured image to be subjected to image processing and the user's image is not limited to the positional relationship (such as the above-mentioned surroundings and the vicinity), and it is sufficient if there is a predetermined correspondence relationship. .

  Furthermore, in the present embodiment, the correction for the captured image is to change at least one of the color and shape for a part of the image, but is not a change process for the image, and the second and subsequent shootings corresponding to the change. The imaging environment may be changed. For example, when correcting to make the user's skin white, the amount of light of the flash is increased, and when correcting to make the user's skin black, a configuration in which the amount of light of the flash is reduced or an appropriate color for the camera 10 is used. Various known configurations such as a configuration in which a well-known optical filter plate that imparts a correction effect (selectively applicable), a configuration in which light of a dedicated light source of a predetermined color (not shown) is irradiated, and the like can be considered. By such a change in the shooting environment, the same correction result as the correction mode performed using a well-known image processing method for all the captured images is realized without using the image processing method for other captured images. be able to.

  In step S120 of the present embodiment, the user selects a shooting mode, for example, image quality (specifically, a clear image quality with high contrast, a soft soft image quality, or a cool image quality with transparency). The correction mode may be selected such that the brightness is selected.

  Further, as shown in FIGS. 11 and 15, the face position guide 206 is displayed in a shape that is expected to be used by two users. By receiving an operation input by the user for selection, the face position guide 206 having a shape corresponding to the number of users (for example, a shape having a frame for the number of users) can be displayed. In addition, according to a known method such as the face recognition process described above, the face position guide 206 corresponding to the number of users can be automatically displayed without selecting the number of users by the user.

  In addition, when performing the above-mentioned graffiti editing, one or more of the plurality of graffiti target images that have been changed according to the determined parameter value are changed before being changed according to the determined parameter value. It may be configured to be able to return to the original state individually (for example, for each correction mode such as the eye shape) or collectively. Such a configuration can be easily realized, for example, by storing each image before the change (for each parameter). Moreover, the structure which receives the operation input which resets the value of each parameter individually or collectively, and changes according to the reset parameter value may be sufficient. In addition, when performing the above-described processing such as returning a plurality of graffiti target images to the original state, all of the plurality of graffiti target images may be changed at once, or the target graffiti target images may be changed. It may be specified and changed. Moreover, the structure which changes for every user contained in a graffiti object image may be sufficient. Furthermore, each of the above configurations may be applied before the graffiti editing process or during the shooting process.

  Furthermore, since the face recognition process only needs to be performed before correction, it may be performed based on the through image data for performing real-time display as described above, or for the face recognition process (static The image may be taken intermittently.

  In addition, in each of the shooting operation touch panels 20L and 20R, when receiving a background image selection operation by the user, as described above, each background image associated with each shooting theme is shot with the shooting operation touch panel 20L. It is displayed with exactly the same content on the operation touch panel 20R (that is, so that the selection target is common), and one of the shooting operation touch panels 20L and 20R is displayed on the first selected image (in the form of first-come-first-served basis). It may be confirmed. Then, the background image can be determined quickly, and playability can be improved (like competition).

  Furthermore, the contents of the selection operation may be shared by displaying different themes (and background images) on each screen. For example, among the six shooting themes, the first half may be displayed on the shooting operation touch panel 20L and the second half may be displayed on the shooting operation touch panel 20R, and the selection of each user may be accepted. By doing so, the background image can be quickly determined by sharing the work. Note that these selection targets can be similarly applied to selection items other than the background image, for example, selection items for determining the shooting method and correction mode, and the above-described effects can be obtained. .

  Still further, each of the photographing operation touch panels 20L and 20R may be configured to receive information related to the user. For example, a configuration in which personal information of a user is received on each screen and a stamp image used at the time of graffiti is generated based on the received information can be considered.

  Further, instead of the shooting operation touch panels 20L and 20R, an editing operation touch panel 400 (second and third display / operation units 81 and 82) functioning as a GUI display means for graffiti or input reception at the time of printing. The output operation touch panel 30 (fourth display / operation unit 91) functioning as a means is divided into two screens, each of which is associated with a parameter (such as a parameter for correcting the user's image). (Information) may be received.

<5. Effect>
As described above, the game shooting device of the embodiment or the modified example (hereinafter simply referred to as “this embodiment”) is received on the respective operation screens on the shooting operation touch panels 20L and 20R (here, the correction mode). The operation input (such as determination) is associated with the face images of a plurality of users identified by face recognition, for example, without performing an operation input for specifying an image processing mode for each captured image. By using the association between the facial images of multiple users and operation inputs that are easily targeted within a limited time (in this case, correcting the image), the intention of each user is assigned to each captured image. It can be reflected.

  Further, according to the present embodiment, in step S125 shown in FIG. 9, the face feature of each user is calculated by performing face recognition processing on the captured image, and the captured image obtained thereafter is calculated. In step S162 shown in FIG. 15, the user to be corrected is set so that the face image of the user having the amount indicating the same or similar feature is changed in the associated correction mode. The feature amount in the image is calculated. As described above, based on the feature amount of the face, it is possible to easily perform correction in which a plurality of users to be corrected are associated with correction contents within a limited time (and thus quickly).

  Furthermore, according to the present embodiment, in step S126 shown in FIG. 9, the user's image displayed on the respective operation screens on the photographing operation touch panels 20L and 20R is selected by the user, and the correction mode in step S127 is changed. Since the process of associating with the screen on which the setting is performed is performed based on the feature amount of the face (S128), correction that associates the correction target user with the correction content based on the feature amount of the face is performed quickly and easily. Can do.

  Further, according to the present embodiment, as shown in FIG. 16 or FIG. 17, correction is performed for each user based on the facial feature amount and the position of each user's face image included in the photographed image for all users. Corrections associated with the contents can be performed quickly and easily.

  Furthermore, according to the present embodiment, the image of the user can be easily extracted by the chroma key composition process, so that the correction can be performed with a simple configuration.

  Further, according to the modification of the present embodiment, the background image to be selected is displayed in common on each of the photographing operation touch panels 20L and 20R, and the image selected by the operation input accepted earliest is the background image. Confirm as Then, the background image can be determined quickly, and playability can be improved (like competition).

  Furthermore, according to the modification of the present embodiment, the background images to be selected are displayed differently (that is, the selection targets are shared) on each of the photographing operation touch panels 20L and 20R, and each user is displayed. Selection is accepted. By doing so, the background image can be quickly determined by sharing the work.

  Further, according to the present embodiment, by providing a plurality of display devices like the shooting operation touch panels 20L and 20R, it is possible to receive individual operation inputs from a plurality of users, and to perform correction quickly and easily. be able to.

  Furthermore, according to the present embodiment, by providing the same number of screens as users, it is possible to accept individual operation inputs by all users, and to perform corrections reflecting user preferences quickly and easily. Can do.

<6. Additional Structure>
In this embodiment,
The photographing means acquires a photographed image including all the images of the faces of all the users,
The plurality of input accepting means accepts an operation input for designating a face image of one or more users included in the photographed image for all members to be different on each screen on each of the plurality of screens,
The image processing means is an image of a face included in the plurality of photographed images, and has a quantity indicating the feature that is the same as or similar to the image of the user's face specified by the operation input. The image processing is performed in a manner designated by the operation input accepted on the same screen as the screen accepting the operation input designating the user's face image. A configuration of an imaging device for play is also conceivable.

In this embodiment,
The photographing means acquires a photographed image including all the images of the faces of all the users,
The image processing stage is configured to change the characteristics so that each of the plurality of screens is different on each screen based on the amount indicating the characteristics and the position of the face image of each user included in the whole-person photographed image. After associating the indicated amounts, the images of the faces of the user included in the plurality of captured images and having the amount indicating the feature that is the same as or similar to the amount indicating the associated feature On the other hand, there is also a configuration of an imaging device for a game characterized in that the image processing is performed in a mode specified by an operation input received on the same screen as the screen associated with the amount indicating the feature. Conceivable.

Furthermore, in this embodiment,
The plurality of input receiving means select an operation input for selecting a background image to be synthesized as a background with respect to the user image extracted by the extracting means from a plurality of candidate background images prepared in advance. Accepted on each screen,
The display means displays the plurality of candidate background images in common on the plurality of screens so that the operation input can be received,
The image processing means synthesizes a candidate background image selected by an operation input accepted earliest among the plurality of screens as the background image with the image of the user, The configuration of is also conceivable.

Furthermore, in this embodiment,
The plurality of input receiving means are operation inputs for selecting a background image to be synthesized as a background with respect to the user image extracted by the extracting means from a plurality of candidate background images prepared in advance, Accepting an operation input for selecting a background image to be combined with a different captured image on each of a plurality of screens,
The display means displays the plurality of candidate background images differently on the plurality of screens so that the operation input can be received,
The image processing means is configured to synthesize a candidate background image selected by an operation input received on each of the plurality of screens with the user image as the background image, Is also possible.

3 ... Shooting unit 4 ... Editing unit 5 ... Output unit 6 ... Network (LAN)
DESCRIPTION OF SYMBOLS 10 ... Camera 20L, 20R ... Touch panel for imaging operation 30 ... Touch panel for output operation 35 ... Network printer 31 ... Infrared port 32 ... Speaker 70 ... First control unit 72 ... First display / operation unit (touch panel for shooting operation)
80 ... second control unit 81, 82 ... second and third display / operation units (touch panel for editing operation)
91 ... Fourth display / operation unit (touch panel for output operation)
92 ... Print output section (network printer)
94 ... Non-contact communication part (infrared port)
201 ... Real-time preview area 207 ... Correction mode determination button 211 ... All-member photographed image 400 ... Touch panel for editing operation

Accordingly, the present invention provides a game shooting apparatus, a game shooting method, and a program capable of automatically associating correspondences between a plurality of users shown in a shot image and a plurality of operation screens for operation input. For the purpose.

The present invention provides a photographing means for photographing a user, a display means for displaying a photographed image on a first operation screen arranged on the left side and a second operation screen arranged on the right side, and the first and second The present invention relates to a game photographing apparatus comprising input means for the user to input an operation to the operation screen, and control means for controlling the means.
And in this invention, the said control means makes the said 1st user into the said 1st operation screen based on the positional relationship of the right and left of the image of the 1st and 2nd user contained in the said picked-up image. An association process for associating and associating the second user with the second operation screen is executed.

According to such a configuration of the present invention, since the control means executes the above association process, the plurality of users included in the photographed image and the plurality of operation screens for operation input are automatically associated with each other. It is Ru can.

According to the present invention, it is possible to automatically associate a plurality of users included in a captured image with a plurality of operation screens for operation input .

Claims (6)

An imaging device for games comprising a photographing means for photographing a plurality of users in a photographing space for photographing,
Display means for displaying a photographed image acquired by the photographing means;
A plurality of input receiving means for receiving operation inputs;
Recognizing means for identifying each of the plurality of user images included in the photographed image acquired by the photographing means;
Association means for associating the plurality of input receiving means with the images of the plurality of users identified by the recognition means;
In accordance with an operation input received by one or more of the plurality of input receiving means, image processing for changing a display mode of the user image associated with the input receiving means for receiving the operation input is performed on the captured image. And an image processing means for the game. The recognizing means is a face recognizing means for identifying each of the plurality of user face images included in the image acquired by the photographing means;
The associating means associates operation inputs received by the plurality of input receiving means with images of the plurality of user faces,
The display means includes a plurality of screens capable of displaying different images, and a plurality of screens capable of receiving operation inputs to be associated by the association means,
In response to an operation input received in one or more of the plurality of input receiving units, the image processing unit is configured to receive an image of the user's face associated with the input receiving unit that receives the operation input or the face The game shooting device according to claim 1, wherein a display mode of a portion of the shot image related to the image is changed. The photographing means acquires a plurality of photographed images by performing photographing a plurality of times,
The face recognizing unit calculates an amount indicating the feature of each user's face corresponding to the face image included in the captured image;
The image processing means is configured to apply an image of the face to an image of a user's face having an amount indicating the same or similar feature included in the plurality of captured images or a portion of the captured image related to the face image. The game photographing apparatus according to claim 2, wherein image processing is performed based on an aspect specified by an operation input associated with an image.   4. The apparatus according to claim 1, further comprising an input control unit that changes the number of the plurality of input receiving units according to the number of the plurality of users. 5. A shooting device for games. A shooting method for play,
A shooting step of shooting a plurality of users in a shooting space for shooting by the imaging means;
A display step of displaying on the display means a photographed image acquired by the photographing step;
An input step for receiving operation inputs to a plurality of input receiving means;
A recognition step for identifying each of the plurality of user images included in the photographed image acquired by the photographing means;
An association step for associating the plurality of input receiving means with the images of the plurality of users identified by the recognition step;
In accordance with an operation input received by one or more of the plurality of input receiving means, image processing for changing a display mode of the user image associated with the input receiving means for receiving the operation input is performed on the captured image. And an image processing step for the game. A shooting step of shooting a plurality of users in a shooting space for shooting by the imaging means;
A display step of displaying on the display means a photographed image acquired by the photographing step;
An input step for receiving operation inputs to a plurality of input receiving means;
A recognition step for identifying each of the plurality of user images included in the photographed image acquired by the photographing means;
An association step for associating the plurality of input receiving means with the images of the plurality of users identified by the recognition step;
In accordance with an operation input received by one or more of the plurality of input receiving means, image processing for changing a display mode of the user image associated with the input receiving means for receiving the operation input is performed on the captured image. And a computer-executable image processing step.