JP5750961B2 - Game shooting device, game shooting method, and program - Google Patents

Description

The present invention is amusement imaging apparatus, imaging method for play, and a program, and more particularly, taking the user with the camera, amusement imaging apparatus which outputs a composite image generated based on the captured image as a photograph or the like , A shooting method for playing games, and a program .

  2. Description of the Related Art Conventionally, there is known a photo creation device for a game in which a user is photographed with a camera and the photographed image is output as a photo sticker or a photo card. Such a play photo creation device is highly playable or entertaining, and therefore, a variety of background images and foreground images (foreground images) prepared in advance according to the user's preference are combined with images to be synthesized. In particular, many are configured so that the user can select from frame images) or draw freely using a touch pen. Since such an operation by the user is performed on the photographed image, it is called “graffiti”.

  In addition, since such a play photo creating apparatus is often used by a plurality of users, it is often configured to provide an operation screen operated by each of the plurality of users (for example, Patent Document 1).

JP 2007-67565 A

  As described above, in a game photo creating apparatus that is often used by a plurality of users, a plurality of users' faces are often included in the captured image. Therefore, unlike an automatic photo creation device for one person (typically for an ID photo), each user's face is included in various positions in the captured image.

  In such a case, particularly when combining an additional image (typically a stamp image) that is a relatively small image and can be combined at an arbitrary position among the foreground images used at the time of graffiti, Since it is possible to select a position that does not reach the face of each user, there is no particular problem. However, when a large additional image (typically a frame image) having a predetermined synthesis position is synthesized with a captured image, the image may be synthesized at a position approaching each user's face.

  In this respect, it is possible to move the additional image portion that approaches the user's face from a predetermined position. However, it is easy for the user (typically with a one-touch operation). ) An operation for partially moving the additional image to be synthesized is required. This operation is cumbersome for the user.

  Further, if the additional image such as the frame image is partially moved, the overall balance may be lost. Therefore, it is often difficult for the user to move the portion to a position where the image looks beautiful, and is troublesome. It is.

Therefore, in the present invention, the state of the additional image to be combined with the photographed image is reduced or eliminated without requiring the user's operation, the state of the additional image to be combined with the photographer's face portion, the photographing for the game It is an object to provide a method and a program .

The first invention is a photographing means for photographing a user ;
It detects the face of the previous Symbol shooting means a Subscriber that is part of the images picked up I'm in, and the face area setting means for setting a face area that includes at least a portion of the detected face,
Editing means for synthesizing the additional image including the specific element image, in which the combined position with respect to the captured image is set to a predetermined first combined position, with the captured image;
The editing means includes
If the range of the specific region occupied by the particular elements picture image have you when synthesizing the specific element image to the first combined position, where the range before Kikao regions overlap, reduce or eliminate overlapping ranges The specific element image is synthesized at a second synthesis position different from the first synthesis position,
When the range of the specific area and the range of the face area do not overlap, the specific element image is synthesized at the first synthesis position .

According to a second invention, in the first invention,
The editing means, among the multiple decorative elements image to be synthesized at a predetermined position in the captured image, or do not synthesize decorative element image that overlaps with the range before Kikao region, or of the face region It is characterized by synthesizing so as to be a background to at least one of the range and the range of the user image included in the captured image.

According to a third invention, in the first or second invention,
The editing unit includes the range of the specific area and the face area when the specific element image is to be combined with a plurality of candidate combination positions that are candidates for the combination position after the change and have been given priority in advance. range and are among the candidate synthetic position range can be a decrease is caused or disappear below a predetermined value which overlap, the candidate combination position, labeled the highest priority, and wherein the synthesis of the specific element image To do.

4th invention is 1st or 2nd invention,
The editing means attempts to synthesize the specific element image at a candidate composition position that is a candidate for a composition position after change calculated based on a predetermined calculation formula starting from the first composition position and away from the origin. In the case where the range of the specific region and the range of the face region overlap, among the candidate composite positions that can reduce or eliminate the range where the range of the face region overlaps below a predetermined value , It is characterized by composing element images.

According to a fifth invention, in any one of the first to fourth inventions,
The specific element image includes a plurality of images showing a series of characters, symbols, or patterns arranged on a center line extending in the vertical direction of the photographed image, and arranged in a direction different from the vertical direction. It is characterized by.

A sixth invention is any one of the first to fifth inventions,
It said editing means, the specific element image, characterized by combining in a position specified in the second direction from the first combined position.

According to a seventh invention, in any one of the first to sixth inventions,
A display means,
The display means synthesizes an operation screen, which is a screen for reducing and displaying an additional image in which the specific element image is arranged at the first synthesis position, and the additional image selected by the user with the captured image. An editing screen, which is a screen for displaying a composite image synthesized by the editing means , is simultaneously displayed .

An eighth aspect of the present invention is a photographing step for photographing a user;
Detects the face of a Subscriber that is part of the image captured me by the photographing step, a face region setting step of setting a face area that includes at least part of the detected face,
An editing step of synthesizing the additional image including the specific element image in which the synthesis position with respect to the captured image is set to a predetermined first synthesis position with respect to the captured image,
In the editing step,
If the range of the specific region occupied by the particular elements picture image have you when synthesizing the specific element image to the first combined position, where the range before Kikao regions overlap, reduce or eliminate overlapping ranges The specific element image is synthesized at a second synthesis position different from the first synthesis position,
When the range of the specific area and the range of the face area do not overlap, the specific element image is synthesized at the first synthesis position .

The ninth invention provides a computer,
A shooting step for shooting the user;
Detects the face of a Subscriber that is part of the image captured me by the photographing step, a face region setting step of setting a face area that includes at least part of the detected face,
A program for executing an editing step for synthesizing an additional image including a specific element image set to a predetermined first synthesis position with respect to the captured image, with respect to the captured image,
In the editing step,
If the range of the specific region occupied by the particular elements picture image have you when synthesizing the specific element image to the first combined position, where the range before Kikao regions overlap, reduce or eliminate overlapping ranges The specific element image is synthesized at a second synthesis position different from the first synthesis position,
When the range of the specific area and the range of the face area do not overlap , the program is a program for synthesizing the specific element image at the first synthesis position .

According to the first aspect, the range of the specific region occupied by the specific element image picture, if the range of the face region overlap, so as to reduce or eliminate the overlapping ranges, the second which is different from the first combination position When the specific element image is synthesized at the synthesis position and does not overlap, the specific element image is synthesized at the first synthesis position, so that the user needs to operate the state where the specific element image is approaching the user's face part. Can be reduced or eliminated automatically and without major design changes.

According to the second aspect, among the plurality of decoration element images to be combined at a predetermined position, the decoration element image overlapping the range of the face area is not combined (that is, erased as a result), Alternatively, since it is synthesized so as to be a background with respect to at least one of the range of the face area and the range of the user's image, the positional relationship and overall arrangement of the decoration image element and other image elements It will be possible to avoid significant changes in the design (typically overall) based on relationships.

  According to the third aspect, the combination position of the specific element image is changed to the candidate combination position with the highest priority among the candidate combination positions. If given, the design after synthesis becomes more preferable. For example, if priority is given based on a distance from a predetermined initial position, the design is not greatly changed from the predetermined initial state (design). be able to. In addition, since it is not necessary to obtain a candidate synthesis position by calculation, the configuration can be simplified.

According to the fourth aspect of the invention, since the specific element image is synthesized from the first synthesis position as the starting point to the candidate synthesis position closest to the starting point, the initial state (design) is not greatly changed. Can be. In addition, a more suitable position (typically in terms of design) can be calculated in some cases than a configuration in which a plurality of candidate composition positions are selected in advance, and all face positions can be calculated at candidate composition positions. Even if the region overlaps with the region, in some cases, a combined position that does not overlap with the face region can be calculated.

  According to the fifth aspect, the region occupied by the specific element image is applied to a center line extending in the vertical direction of the photographed image, and a plurality of characters indicating a series of characters, symbols, or patterns arranged in a direction different from the vertical direction Since the image includes an image, there is a high possibility that the specific element image will reach the face area, so the design position based on the meaning, continuity, etc. indicated by the specific element image can be changed by moving the composition position when the image is reached. At least not greatly change.

According to the sixth aspect, since the composite position after the change in the specific element image is determined downward from the first composite position, there is a possibility of reaching a face portion that is often in the upper half of the normal captured image. Can be lowered. In addition, since the blank part (background part) above the face part often includes graffiti (such as a pen or stamp) by the user, these graffiti are hidden by the specific element image by moving downward. Can be prevented.

According to the seventh aspect, the operation screen, which is a screen for reducing the additional image in which the specific element image is arranged at the first synthesis position, and the synthesized image obtained by synthesizing the additional image selected by the user with the photographed image. Since the editing screen, which is a screen for displaying images, is displayed at the same time, it is easy for the user to select an additional image on the operation screen, and the selected additional image can be selected (by changing the composite position in some cases). The synthesized result can be confirmed on the editing screen by the user.

  According to the eighth aspect of the invention, the effect of the first aspect of the invention can be similarly achieved in the method invention.

  According to the ninth aspect, the effect of the first device invention can be similarly achieved in the invention of the program.

It is a figure which shows the external appearance of the photo production apparatus for games which is an automatic photo production apparatus which concerns on one Embodiment of this invention. It is a front view of the imaging unit in the embodiment. It is a front view of the edit unit in the said embodiment. It is a front view of the output unit in the said embodiment. It is a schematic diagram which shows the display structure of the touchscreen for imaging operations in the said embodiment. It is a block diagram which shows the structure which looked at the principal part of the photo production apparatus for play concerning the said embodiment from the functional surface. It is a schematic diagram which shows an example of the display structure of the touch panel for edit operations in the said embodiment. It is a figure which shows the frame image selected in the said embodiment. It is a figure which shows the synthesized image obtained by simply synthesize | combining with the picked-up image which two users image the frame image shown in FIG. It is a figure which shows the synthesized image obtained by simply synthesize | combining with the picked-up image which three users image | photograph the frame image shown in FIG. In the said embodiment, it is a figure which shows the synthesized image obtained as a result of synthesize | combining after changing a frame image partially. It is a flowchart which shows the procedure of the imaging | photography process in the said embodiment. It is a flowchart which shows the procedure of the graffiti edit process in the said embodiment. It is a flowchart which shows the flow of the partial change process of the frame image in the said embodiment. In the said embodiment, it is a figure which shows the positional relationship of each element image of a frame image, and a user's face area. It is a figure which shows the positional relationship of the progress and result of the process in the said embodiment, and the frame image changed partially, and a face area. It is a figure for demonstrating the example which calculates the synthetic | combination position of the specific element image after a movement once in the modification of the said embodiment. It is a figure for demonstrating the example which does not calculate the synthetic | combination position of the specific element image after a movement in the modification of the said embodiment. In the modification of the said embodiment, it is a figure which shows the relationship between the frame image containing a specific element image and a some special foreground image, and a face area.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.
<1. Overall configuration>
FIG. 1 is a diagram showing an appearance of a game photo creation device that is an automatic photo creation device according to an embodiment of the present invention. More specifically, FIG. 1 (a) is an external side view of the play photo creation apparatus as viewed from the side, and FIG. 1 (b) is an external plan view as viewed from above. This play photo creation device accepts a shooting room 2 where a user enters, a shooting unit 3 that takes a picture of the user and receives selection of a background image and a foreground image, and an editing operation including graffiti (drawing operation) by the user. An editing unit 4 that generates a combined image combined with the photographed image and an output unit 5 that outputs the combined image are provided. FIG. 2 is a front view of the photographing unit 3, FIG. 3 is a front view of the editing unit 4, and FIG. 4 is a front view of the output unit 5. Hereinafter, the overall configuration of the game photo creation device according to the present embodiment will be described with reference to FIGS. 1 to 4.

  The photographing room 2 has a substantially rectangular parallelepiped shape, and the photographing unit 3 is arranged along the front surface of the photographing room 2 which is a front surface when viewed from the user entering the inside. Note that an opening for a user to enter and exit, and a light-shielding curtain that covers a part or all of the opening are provided on a part of each of the left and right side surfaces of the photographing room 2. In addition, a single color (in this case, blue or green) for chroma key composition processing is attached to the rear surface, which is the rear surface as viewed from the user who enters the photographing room 2. These colors are also attached to the floor surface.

  The photographing unit 3 includes a camera 10 as an imaging unit for photographing a user, strobes 11, 12, 13 L, 13 R, and 14 that are arranged at the top, bottom, left and right positions of the camera 10 and emit flash light, and below the camera 10. It is provided with a shooting operation touch panel 20 that is arranged and receives operations from a user, displays shot images, and the like.

  The camera 10 is typically a digital camera that generates a digital image signal using a CCD (Charge Coupled Device), captures a user, and outputs an image signal representing the captured image. The flashes 11 to 14 emit a flash toward the user in order to obtain sufficient light for photographing. The shooting operation touch panel 20 is configured to provide an operation screen for accepting various operations by the user during shooting, and to display an image based on the image signal in real time.

  FIG. 5 is a schematic diagram showing a display configuration of the touch panel 20 for shooting operation. As shown in FIG. 5, the shooting operation touch panel 20 has a real-time preview area 201 for displaying a shot image in real time, a pose sample display area 202 for displaying a pose sample, and a graffiti obtained by shooting. A graffiti target image display area 203 for displaying the target image is included.

  The photographing unit 3 is built around a computer and incorporates a control device for controlling each part, an I / O control device, a network adapter for communicating with the editing unit 4, and the like. The photographing unit 3 includes a coin insertion slot 26 at the lower front side.

  The editing unit 4 is configured around a computer similar to the photographing unit 3, and includes a control device that controls each part and the like, and a network adapter that communicates with the photographing unit 3 and the like. Further, as shown in FIG. 1B, the editing unit 4 is divided into two units 4a and 4b so that two sets of users can play. One of the units 4a includes an editing operation touch panel 400 that includes a graffiti area, an area for displaying a menu for graffiti, a tool, and the like and functions as a GUI (Graphical User Interface) display means, and the editing operation touch panel 400 Touch pens 49L, 49R, and 49C are provided as pointing devices used for an operation on the. The other unit 4b has the same configuration. Here, the unit 4a seen in the foreground in FIG. 1A is referred to as “graffiti booth A”, and the unit 4b on the opposite side (the back side in the figure) is referred to as “graffiti booth B”.

  The touch panel 400 for editing operation in the present embodiment has a display configuration in which each of the units 4a and 4b typically allows two users to simultaneously doodle. In this description, components used by the user on the left side are given reference signs including “L”, and components used by the user on the right side are assigned reference signs including “R”. ing.

  In addition, the display screen displayed on the editing operation touch panel 400 in the present embodiment is typically divided into two parts on the left and right sides so as to be suitable for the operation of two users. Hereinafter, the left operation screen of the display screen is referred to as a left operation screen, and the right operation screen is referred to as a right operation screen.

  Further, the editing operation touch panel 400 is configured to be able to simultaneously detect the operation positions of the four touch pens 49L1, 49L2, 49R1, and 49R2, and the detected operation positions are those of 49L1, 49L2, 49R1, and 49R2. It is possible to detect which of these operations is supported. For example, when a capacitive touch panel is used as the editing operation touch panel 400, simultaneous detection of such a plurality of operation positions and identification of the operated touch pen are possible.

  Two touch pens for left operation screen (hereinafter referred to as “left screen pen”) 49L1 and 49L2, or two touch pens for right operation screen (hereinafter referred to as “right screen pen”) 49R1 and 49R2, respectively. Although it can be used (input operation) at the same time, it is controlled so that only the touch pen that is active first (operation input is accepted first) and is continuously active can be input. Also good. By controlling in this way, the drawing response can be maintained at high speed.

  The number of touch pens is not particularly limited, and instead of the touch pen, a known pointing device capable of detecting coordinates at the same time (for example, a position determination based on a trackball, a cursor key, or a camera image) is used as an input means. May be.

  As shown in FIG. 4, the output unit 5 typically displays, for example, a material image such as a Deco-mail (registered trademark) image or a composite image obtained by grabbing a photographed image by an infrared port built in the mobile phone terminal. An output operation touch panel 30 that is operated by the user when transferring to the user's mobile phone terminal, and the above-described material image or the like arranged below the output operation touch panel 30 is directly transmitted to the mobile phone terminal as an infrared signal. An infrared port (non-contact communication port) 31 and a speaker 32 that informs the user by voice of operation methods and sound effects necessary for the communication. Further, the output unit 5 includes an outlet 33 for taking out a photo sticker, a photo card, or the like on which a composite image that has been edited by the editing unit 4 is printed.

  The touch panel 30 for output operation is a mobile phone provided with the non-contact communication function when the user wants to download the composite image from a server as well as a photo sticker or the like to view it on a mobile phone terminal. It is configured to provide an operation screen for accepting various operations necessary for transmission to the telephone terminal. This operation is mainly performed using the time until the photo sticker of the composite image is printed. Therefore, the user should use the time effectively until the photo sticker etc. is printed. Can do. A detailed display example will be described later.

  When the user wants to view the photo sticker on which the composite image is printed on the mobile phone terminal, the output operation touch panel 30 transmits the photo sticker to the mobile phone terminal having the infrared communication function (or other proximity wireless communication function). It is configured to provide an operation screen for accepting various operations necessary for this.

  Such an output unit 5 is also configured around a computer similar to the photographing unit 3, and includes a control device for controlling each part, a network adapter for communicating with the editing unit 4, etc. A network printer 35 for printing an image as a photo sticker or the like is provided.

  In the configuration as described above, after shooting in the shooting room 2, the user uses the graffiti booth A of the editing unit 4 or the touch panel 400 for the editing operation of the graffiti booth B to generate based on the shot image. Graffiti is performed on the graffiti target image. Then, the user prints the composite image generated by the graffiti by the network printer, transmits the image to the mobile phone terminal having the infrared communication function, and displays the image received by the mobile phone terminal on the terminal screen. .

<2. Functional configuration>
FIG. 6 is a block diagram showing the configuration of the main part of the play photo creating apparatus according to the present embodiment as seen from the functional aspect. 6 is functionally according to a photographing processing unit 7 for mainly performing a process of photographing a user (photographing process) and a graffiti operation of the user mainly on a graffiti target image. Edit processing unit 8 for performing the editing process of the graffiti target image, and output the graffiti target image subjected to the editing process as a photo sticker, etc. And an output processing unit 9 that performs processing (output processing) for outputting to a mobile phone terminal.

  The imaging processing unit 7 includes a first control unit 70, an imaging unit 71, a first display / operation unit 72, an I / O control unit 73, an illumination unit 74, and a first communication unit 75. It is configured. The edit processing unit 8 includes a second control unit 80, second display / operation units 81 and 82, and a second communication unit 83. The output processing unit 9 includes a third control unit 90, a third display / operation unit 91, a print output unit 92, an audio output unit 93, a non-contact communication unit 94, and a third communication unit 95. And a wireless communication unit 96. The first, second, and third communication units 75, 83, and 95 that are network adapters can communicate with each other via a network 6 that is a LAN (Local Area Network).

  The imaging unit 71 corresponds to the camera 10 configured using an imaging element such as a CCD, and captures an image in real time and outputs an image signal representing the image (captured image). This image signal is input to the first control unit 70 and temporarily stored as photographed image data in its internal memory. The captured image data is supplied as a captured image signal from the first control unit 70 to the first display / operation unit 72, and a captured image based on the captured image signal is displayed in real time.

  The first display / operation unit 72 corresponds to the shooting operation touch panel 20 and accepts an operation for selecting a background image and a foreground image to be added to the shot image, a shutter operation, and the like. Signals indicating these operations are input to the first control unit 70 as operation signals. Here, when a predetermined process for photographing the user (corresponding to the selected photographing menu) is started, guidance for the user is displayed on the first display / operation unit 72, and thereafter Based on an instruction from the first control unit 70, a flash is emitted from the flashes 11 to 14 in the shooting direction of the camera 10 after a predetermined time of about several seconds. At that time, an image signal output from the imaging unit 71 as a signal representing a photographed image of the user is input to the first control unit 70, a memory in the first control unit 70, a hard disk device as an auxiliary storage device, or the like. Stored as captured image data.

  The illumination unit 74 corresponds to the strobes 11, 12, 13 </ b> L, 13 </ b> R, 14 disposed at the top, bottom, left, and right positions of the camera 10. Turning off and dimming are controlled. The I / O control unit 73 corresponds to an I / O control device built in the photographing unit 3, and controls the illumination unit 74 based on an instruction from the first control unit 70. Further, an input signal such as a detection signal from a coin detection unit (not shown) described later is transferred to the first control unit 70. The first communication unit 75 corresponds to a network adapter built in the photographing unit 3 and functions as an interface for data transmission / reception via the network 6.

  The first control unit 70 is built in the photographing unit 3 and corresponds to a control device mainly composed of a computer including a CPU, a memory, a frame buffer, a timer, an auxiliary storage device and the like, and is stored in a predetermined memory stored in an internal memory. When the CPU executes the program, an instruction is given to each unit as described above in order to control each unit based on the operation signal or the like input as described above. A graffiti target image is generated based on the photographed image. The generated graffiti target image is written in the frame buffer and displayed on the first display / operation unit 72. Further, the first control unit 70 generates a composite image that is an image in which a predetermined background image or foreground image is drawn on the graffiti target image. As will be described in detail later, this graffiti target image has a background color that is a key color used to create a mask, and based on the well-known chroma key composition processing method, the image includes only the user's image. An image part is extracted and synthesized so that the photographed image part is inserted into the background image. The composite image generated in this way is displayed on the first display / operation unit 72 by being written in the frame buffer. When the shooting and the generation of the composite image are completed in this way, the generated composite image is appropriately selected according to the input operation of the user, and then the second corresponding to the editing unit 4 via the first communication unit 75. It is sent to the control unit 80.

  In addition to the above-described components, the photographing unit 3 is further provided with a coin detection unit (not shown) for detecting coins inserted into the coin insertion slot 26 in the photographing unit 3, and the first control unit 70 includes Based on the detection result of the coin detection unit, each unit is controlled so as to allow the user to play with the present photo creation device, such as shooting, selection of the background image and foreground image, and graffiti for a predetermined time. Since the detection operation by the coin detection unit and the control operation by the first control unit 70 based on the detection result are the same as those of the conventional game photo creation device and are well known, detailed description thereof will be omitted.

  The second control unit 80 is a built-in editing unit 4 and corresponds to a control device that is configured around a computer including a CPU, a memory, a frame buffer, an auxiliary storage device, and the like, and is a predetermined program stored in an internal memory. Is executed by the CPU to perform overall control related to the editing process. That is, the second control unit 80 functions as a GUI control unit that controls the second display / operation unit. In addition, the second control unit 80 adds a predetermined image to the graffiti target image based on an operation signal for performing graffiti processing on the graffiti target image (an image including a captured image) sent from the first control unit 70. A composite image, which is an image of drawing, is generated and an operation screen for graffiti operation is generated and controlled. The operation screen and the generated composite image or material image are displayed on the corresponding second display / operation units 81 and 82 in accordance with a user instruction. Further, the second control unit 80 performs a process of recognizing the user's face area included in the graffiti target image, so that the frame image portion does not reach the recognized user's face area. Performs characteristic operations that change the image partially. This operation will be described in detail later. When the generation of the composite image as described above is completed, the user receives an instruction to select a divided layout. Information indicating the selected divided layout and the generated composite image are sent to the output unit 5. If the print output unit 92 is outputting another composite image, a message to that effect is displayed and sent after waiting for completion.

  The second display / operation units 81 and 82 correspond to the editing operation touch panel 400 functioning as a graffiti GUI display means, and accept user operations using a touch pen. The second communication unit 83 corresponds to a network adapter built in the editing unit 4 and functions as an interface for data transmission / reception via the network 6.

  The third control unit 90 is built in the output unit 5 and corresponds to a control device mainly composed of a computer including a CPU, a memory, a frame buffer, a timer, an auxiliary storage device, and the like, and is stored in an internal memory. When the CPU executes a predetermined program, overall control relating to output processing is performed. The third control unit 90 stores the composite image sent from the second control unit 80 in the memory as composite image data. The print output unit 92 corresponds to the network printer 35 built in the output unit, and prints the composite image data stored in the memory as a photo sticker (or photo card) (which is appropriately laid out). The printed photo sticker or the like is taken out from an outlet 33 provided at the lower front of the output unit 5.

  Further, the third control unit 90 starts printing processing such as a photo sticker based on the divided layout information and the composite image sent from the second control unit 80, and at the same time accepts a user input operation. An operation screen to be described later is displayed on the third display / operation unit 91. The third display / operation unit 91 corresponds to the output operation touch panel 30 and functions as an input unit. The output operation touch panel 30 includes a monitor that functions as a display unit such as a liquid crystal display or a CRT (Cathode Ray Tube), and a touch panel for one person that is stacked on the upper surface and can recognize input coordinates. The monitor can display an operation screen divided into a plurality of screens, and the touch panel accepts an input operation using a user's touch pen for each of the plurality of divided screens, and the received input operation is used as an operation signal as a third signal. To the control unit 90.

  The third communication unit 95 corresponds to a network adapter built in the output unit 5 and functions as an interface for data transmission / reception via the network 6.

  Here, the third control unit 90 writes the demo image (demonstration image) stored in advance in the auxiliary storage device in the frame buffer from the end of the graffiti until the operation is started. Displayed on the display / operation unit 91. The audio output unit 93 corresponds to the speaker 32. The audio output unit 93 explains the input operation method to the user in conjunction with the operation screen displayed on the third display / operation unit 91, and the demo image is displayed on the third display / operation unit 91. When playing, play music etc. according to the demo image. The description of the input operation method, music, and the like are stored in advance in a hard disk device as an auxiliary storage device.

  Thereafter, the third control unit 90 provides the user with a mini-game to be described later until printing of the composite image is completed by the display of the third display / operation unit 91 or the voice or sound effect of the voice output unit 93. to continue. The contents of this mini game are similarly stored in advance in a hard disk device or the like.

  Here, the predetermined program executed in each control device is provided by, for example, a DVD-ROM which is a recording medium on which the program is recorded. That is, a DVD-ROM as a recording medium for the predetermined program is attached to a DVD-ROM driving device built in the control device as an auxiliary storage device, and the predetermined program is read from the DVD-ROM as an auxiliary storage device. Installed on the hard disk drive. The predetermined program may be provided via a recording medium (CD-ROM or the like) other than a DVD-ROM or a communication line. Then, when an operation for starting the present photo creating device is performed, the predetermined program installed in the hard disk device is transferred to the memory in the control device and temporarily stored therein, It is executed by the CPU. Thereby, the control process of each part by the control device is realized.

  The first to third control units 70, 80, 90 have been described as corresponding to devices including different computers built in different units, but such a configuration is an example, and The first to third control units 70, 80, 90 may be realized by two or less devices or four or more devices. In this case, a program corresponding to the function to be realized is executed in each device. In addition, the photographing unit 3, the editing unit 4, and the output unit 5 may be configured by two or less units or four or more units.

<3. Screen structure for editing operations>
The game photo creation device according to the present embodiment uses an operation screen used for an editing operation for graffiti on a graffiti target image (an image including a photographed image) generated based on a photographed image. The frame image selected by the operation has a feature. Hereinafter, a display configuration of the editing operation touch panel 400 that displays the operation screen will be described.

  FIG. 7 is a schematic diagram showing an example of the display configuration of the editing operation touch panel in the present embodiment. The graffiti screen 400 shown in FIG. 7 is divided into a left operation screen 400L and a right operation screen 400R, and a virtual graffiti is performed by displaying a composite image obtained by combining a captured image and a graffiti image corresponding thereto. Graffiti areas 401L and 401R, which are areas that can be photographed, palette areas 402L and 402R in which a plurality of tools 405L and 405R for various editing instructions are displayed, and first to first picked-up images for selecting graffiti objects. Fourth thumbnail image display areas 431L, 431R to 434L, and 434R, and a timer display area 450 indicating the remaining time for which graffiti is possible are included.

  Here, the editing instruction tools 405L and 405R included in the palette areas 402L and 402R select the type of editing operation (typically grouped and displayed) such as a stamp and a frame constituting the graffiti image. This is a tool that can be displayed, and is a tool for the user to perform various graffiti, that is, a tool for instructing various editing operations on the (selected) graffiti target image. Note that frame images, background images, and the like are often included in the palette areas 402L and 402R in the form of thumbnail images in order to display the image contents in an easy-to-see manner, but these thumbnail images are also displayed in a selectable form. Here, it is called a tool for convenience.

  Further, in the vicinity of the palette areas 402L and 402R, there are pen buttons 421L and 421R for enabling selection of a virtual graffiti pen type according to the type of the graffiti, and a small image serving as a foreground for the user. Stamp buttons 422L and 422R for making it possible to select a type of a stamp image, frame buttons 423L and 423R for making it possible to select a type of frame image that decorates the vicinity of the captured image, and the background of the user Background buttons 424L and 424R for enabling selection of the type of background image to be displayed are displayed. The user U selects one of these various operation button groups with one of the two touch pens 49L1 and 49L2 that make a pair with respect to the left operation screen 400L (that is, the pen tip on the displayed button image). Are performed), a plurality of graffiti tools of the corresponding type are displayed in the pallet areas 402L and 402R. Here, for convenience of explanation, it is assumed that the frame buttons 423L and 423R are selected.

  Also, a plurality of selectable tab areas 420L and 420R are provided near the upper sides of the palette areas 402L and 402R, and a plurality of tools associated with the selected tab area are selected by selecting one of them. 405L and 405R are displayed. When a tool indicating a certain stamp image is selected and an arbitrary position in the graffiti area 401L is touched with the touch pen in that state, a frame image corresponding to the selected tool is (combined) displayed at the position.

  As shown in FIG. 7, a graffiti area 401L of the left operation screen 400L displays a photographed image showing two users as a graffiti object, and three users are displayed in the graffiti area 401R of the right operation screen 400R. A photographed image showing is displayed as a graffiti target. The left user selects the third frame image from the upper left among the eight frame images included in the palette area 402L, and the right user also selects the eight frames included in the palette area 402R. Of the images, the same frame image as the user on the right side is selected.

  FIG. 8 is a diagram showing the frame image selected by two users. This frame image is synthesized as a foreground (in the form of overwriting) with the photographed image. Therefore, when the frame image is simply synthesized with the photographed image in which two users included in the graffiti area 401L are captured, FIG. When the frame image is simply combined with the captured image of the three users included in the graffiti area 401R, the combined image shown in FIG. 10 is obtained.

  Here, in the composite image shown in FIG. 9, the user's face is clearly visible without any sense of incongruity, but in the composite image shown in FIG. 10, the user's face shown in the center of the three users is shown. A part of the frame image is approaching the face, and the whole face of the central user is not clearly visible. That is, the character portion “JANUARY” constituting the frame image is extremely obstructive.

  Further, in the synthesized image shown in FIG. 10, a part of the frame image is approached on each user's face shown on the left and right sides of the three users, and one of the user's faces on both sides is shown. The part is somewhat hidden. That is, the heart-shaped image portion constituting the frame image is an obstacle.

  Therefore, in the present embodiment, the character portion “JANUARY” that is in the way is moved downward so that the face of the user can be clearly seen and the heart-shaped image that is in the way is deleted. Then, the frame image is partially changed and combined so that the user's face is not hidden.

  FIG. 11 is a diagram showing a composite image obtained as a result of combining after changing the frame image in the present embodiment. By displaying in this way, the frame image can be combined with the captured image in a form that can be clearly seen without hiding the user's face, and the additional image to be combined with the captured image is inserted into the user's face. The applied state can be reduced or eliminated without requiring user operation. Such a partial change of the frame image is performed in a graffiti editing process to be described later in the play photo creating apparatus, and therefore the processing procedure in the play photo creating apparatus will be described below.

<4. Processing procedure in a photo creation device for play>
As described above, the play photo creating apparatus includes the photographing unit 3, the editing unit 4, and the output unit 5. The photographing unit 3 performs photographing processing, the editing unit 4 performs later-described graffiti editing processing, and the output unit 5 performs output processing. It should be noted that when a certain user is playing with the photographing unit 3, another user can play with the editing unit 4, and yet another user can output a composite image with the output unit 5. ing. In other words, this game photo creation device can perform shooting processing, graffiti editing processing, and output processing in parallel. Below, the outline | summary of the procedure of an imaging | photography process, a graffiti edit process, and an output process is demonstrated.

<4.1 Shooting process>
FIG. 12 is a flowchart showing the procedure of the photographing process in the present embodiment. When the play photo creation device is not used (when no play is performed), a demonstration image is displayed on the shooting operation touch panel 20. When the user inserts a coin into the coin insertion slot 26 while displaying the demo image, play is started (step S100).

  When the play is started, the first control unit 70 accepts selection of a shooting mode by the user (step S110). In step S110, for example, image quality (specifically, one of clear image quality with high contrast, soft image quality with softness, or cool image quality with transparency) is selected, brightness is selected, Whether to shoot automatically or manually is selected. When shooting automatically, a shooting theme is selected. In this case, the first control unit 70 displays on the shooting operation touch panel 20 a screen for allowing the user to select one or more shooting themes from a plurality of shooting themes prepared in advance. The selection operation by the person is accepted. Then, the first control unit 70 acquires selection information based on a user's selection operation, and determines a combination of a frame and a background to be used for shooting based on the selected shooting theme. When shooting manually, the user can freely determine the frame and background. Here, the frame image is not selected and is described as being selected in the graffiti editing process described later, but the same process can be performed even when the frame image is selected here. Details will be described later. Then, it progresses to step S120 and imaging | photography is performed. By this shooting, the shot image data is stored in the memory of the first control unit 70.

  In step S <b> 130, a graffiti target image (an image including a captured image) generated based on the captured image is displayed on the capturing operation touch panel 20. Specifically, each time the process of step S130 is performed, graffiti target images are additionally displayed sequentially in the graffiti target image display area 203 of the photographing operation touch panel 20 shown in FIG. Thereafter, the process proceeds to step S140, and the first control unit 70 determines whether or not a predetermined number of images have been taken. As a result of the determination, if the number of images has been shot, the process proceeds to step S150. If the number of images has not been shot, the process returns to step S120. In practice, a time limit for photographing (for example, 3 minutes) is provided.

  In step S150, an image to be actually graffitied is selected (by the user) from a plurality of graffiti subject images. Specifically, the first control unit 70 displays a list of graffiti target images on the shooting operation touch panel 20 in order to allow the user to select an image to be used for graffiti and printing, and performs a selection operation by the user. Accept. Then, the first control unit 70 sends the image selected by the user to the second control unit 80 as an actual graffiti target image. After step S150 ends, the process proceeds to step S160. In step S160, a guidance screen is displayed. Specifically, the first control unit 70 displays a screen for guiding the user to any one of the editing units 4 (4 a or 4 b) on the photographing operation touch panel 20. Thereby, the photographing process is completed.

<4.2 Graffiti editing process>
FIG. 13 is a flowchart showing the procedure of graffiti editing processing in the present embodiment. The graffiti editing process is realized by the second control unit 80 operating as shown in FIG. 8 based on a predetermined program. In this process, after the above-described shooting process is completed, the second control unit 80 acquires a graffiti target image sent from the first control unit 70 via the network (LAN) 6 (step S200).

  Next, the second control unit 80 receives, from the first control unit 70, a plurality of graffiti target images acquired by the imaging process performed by the first control unit 70 and selected by the user (step 200). ) A face area recognition process is performed for each of the accepted graffiti target images (step S210). For the recognition process of the face area, a well-known method may be employed. For example, a template image is generated by enlarging, reducing, or rotating a model image stored in advance, and the feature as a face is determined based on the template image. When a captured image is included in a captured image, a method for recognizing the region as a face region, a well-known recognition method that does not use a template, for example, recognizing a face region based on the shape of a skin color region, and various patterns A recognition method using a recognition method can be employed. Detailed description of these known methods is omitted. If hardware such as a well-known face detection LSI chip is used, the recognition of the face area can be performed faster than in the case of software processing.

  After the face area recognition process (S210) is completed, the timer 46 is set to a predetermined time (specifically, a time when graffiti is permitted), and countdown is started (step S220).

  After the countdown of the timer 46 starts, a doodle editing operation screen is displayed on the editing operation touch panel 400 of each of the units 4a and 4b constituting the editing unit 4, and a graffiti operation (drawing operation) by the user is accepted (step S230). ~ S250). When performing an operation of synthesizing a frame image with a captured image (in this case, as a foreground) among the graffiti operations, a partial change process of the frame image based on the face area recognized in step S210 (if necessary) Done). Details of this processing will be described later. At the time of this graffiti editing process, the editing unit 4 may accept an editing operation for creating a material image such as a decomail image in addition to an editing operation on the graffiti target image based on the photographed image.

  Specifically, when one of the buttons and tools in the editing operation screen is touched with a touch pen, the coordinate value is input (S230), and the corresponding graffiti screen processing (S240) is performed. Thereafter, in step S250, the remaining time of the timer 46 becomes 0 (or the user performs an operation to end), and it is determined whether or not the graffiti has ended. If not (if No in step S250), Returning to step S230, the process is repeated until the graffiti ends. If the graffiti ends (Yes in step S250), the process proceeds to step S260.

  In step S260, the division pattern of the output photo is selected. Specifically, the second control unit 80 displays an operation screen on the editing operation touch panel 400 for causing the user to select one of a plurality of division patterns prepared in advance, and uses the operation screen. The selection operation by the person is accepted. And the 2nd control part 80 acquires selection information based on a user's selection operation. After the process of step S260 is completed, the process proceeds to step S270.

  In step S270, a guidance screen is displayed. Specifically, the second control unit 80 displays a screen for guiding the user to the output unit 5 on the editing operation touch panel 400. Thereby, the graffiti editing process ends. As described above, when the graffiti editing process is completed, the output unit 5 starts a printing process such as a photo sticker based on the composite image sent from the editing unit 4. Next, in the graffiti editing process performed in step S240, a partial change process of the frame image will be described in detail with reference to FIG.

<4.3 Partial change processing of frame image>
FIG. 14 is a flowchart showing a flow of partial frame image change processing. In step S500 shown in FIG. 14, among a plurality of element images constituting a frame image, a combination of element images (hereinafter referred to as “specific element images”) set so as to be able to change the combination position with respect to the captured image. The position is initially set to a predetermined position. The positional relationship between the element image constituting the frame image and the face area obtained by the face area recognition processing described above in step S210 shown in FIG. 13 will be described with reference to FIG.

  FIG. 15 is a diagram illustrating a positional relationship between each element image of the frame image and the face area of the user. A number of heart-shaped images arranged along the outer periphery of the photographed image shown in FIG. 15 are element images (hereinafter referred to as “decorative element images”) whose composition positions with respect to the photographed image cannot be changed. .

  This decoration element image is set so that the composition position cannot be changed because the design as a frame in which a large number of frames are arranged along the outer periphery of the photographed image is destroyed when the composition position is changed. Even in such a case, there is no particular limitation on the reason why the composition position is set so as not to be changed, for example, it is difficult to change the position because the distance between the constituent elements is short. Similarly, there is no limitation on the reason why the composition position is set so that the specific element image can be changed.

  In addition, the face areas F1 to F3 obtained by the face area recognition process shown in FIG. 15 are hatched for easy viewing. The face areas F1 to F3 correspond to the face portions of the images of three users included in the captured image shown in FIG. 10 or FIG. The method for recognizing the face areas F1 to F3 from the captured image is as described above.

  Note that, as described above, the face areas F1 to F3 and the actual face area do not have to be the same, and an area wider than the area occupied by the actual user's face image is set as the face area. Also good. If it does so, it can prevent that an element picture is arranged in the position which touched or approached the face. Conversely, a configuration may be adopted in which an area narrower than the area occupied by the actual user's face image is set as the face area. By doing so, it is possible to arrange the element image even in a portion that slightly overlaps the face area, so that it is possible to arrange many decoration element images while preventing the face from being largely hidden.

  Here, as can be seen with reference to FIG. 15, only the overlapping decorative element images 501 to 504 of the large number of decorative element images partially overlap with the face areas F1 and F3, and the characters JANUARY are arranged. The specific element image 550 is partially overlapped with the face area F2. The following processing is performed so that the user's face is not hidden by the frame image synthesized as the user's foreground or is not clearly visible.

  In step S510 shown in FIG. 14, the overlap amount between the specific element image and the face area is calculated. The amount of overlap between two images can be calculated by, for example, the number of pixels obtained by performing an AND operation on each pixel constituting the image, and an appropriate calculation method is adopted. Is possible. Further, the overlap amount may be expressed by any amount indicating overlap, such as an overlapping area or a ratio to the overlapping face regions. Here, for example, the face region F3 is assumed to overlap the specific element image 550 with 20% of the area thereof.

Subsequently, in step S520, it is determined whether or not the overlap amount is equal to or less than a predetermined value. Here, the predetermined value is set to an appropriate value so that the overlap is reduced to such an extent that the user's face is hidden or not clearly visible, but no overlap is allowed (the overlap is completely eliminated). In the case of elimination, 0 is set as an appropriate value. As a result of the determination, if the overlap amount is equal to or smaller than the predetermined value (Yes in step S520), the process proceeds to step S550, and if larger than the predetermined value (No in step S520), the process proceeds to step S550. Proceed to S530.

  In step S530, the composition position of the specific element image with respect to the captured image is changed to be lower by a predetermined amount. Specifically, assuming that the upper left corner of the captured image is the origin, the Y coordinate indicating the combined position is increased by L. Subsequently, in step S540, it is determined whether the combined position after the change is the lower limit position. Here, the lower limit position is typically a position outside of the captured image when the coordinates are changed downward by L next, but becomes a limit based on appropriate constraints such as a design point of the frame image. The power position may be determined. As a result of the determination, if the position is the lower limit position (Yes in step S540), the process proceeds to step S550. If the position is not the lower limit position (No in step S540), the process returns to step S510. Thereafter, the above process is repeated until the lower limit position is reached or the overlap amount becomes a predetermined value or less (S540 → S510 → S520 →... → S540). In this way, the specific element image is moved downward unless it reaches the lower limit, thereby eliminating the overlap between the specific element image and the face area.

  Next, in step S550, the amount of overlap between one of the plurality of decoration element images and the face area is calculated in a predetermined order. Here, 28 heart-shaped decoration element images are included, and for example, the amount of overlap between one decoration element image selected in order from the upper left corner and the face areas F1 to F3 is calculated. The calculation method of the overlap amount is as described in the specific element image.

  Subsequently, in step S560, it is determined whether or not the overlap amount obtained by the calculation in step S550 is larger than a predetermined value. The predetermined value here is as described in step S520. As a result of the determination, if the overlap amount is larger than the predetermined value (Yes in step S560), the decoration element image is erased from the target (compositing target) to be combined with the captured image (step S570). Various known methods can be applied as the erasing method. For example, an image including all decoration element images as a composition target may be generated, and the decoration element image may be actually erased from the image, or the composition may be composed. A configuration may be used in which the objects are listed and temporarily deleted from the list. Thereafter, the process proceeds to step S580. If the overlap amount is equal to or smaller than the predetermined value (No in step S560), the process proceeds to step S580.

  In step S580, it is determined whether or not the calculation of all decoration element images has been completed. If the calculation has not been completed, the process returns to step S550, and the above processing is repeated until the calculation of all decoration element images is completed (S580). → S550 → S560 →... → S580) Upon completion, all the unerased decoration element images that have not been deleted in step S570 and the specific element image (at the calculated combination position) are combined with the photographed image. Thus, a composite image is generated (step S590), and the partial change processing of the frame image ends.

  FIG. 16 is a diagram illustrating the positional relationship between the face image and the partially changed frame image as a result of the above process. As illustrated in FIG. 16, the combination position of the specific element image 550 is moved downward by L from the initial position, so that the overlap between the specific element image 550 and the face area F3 after combination is eliminated. Further, as can be seen by comparing FIG. 16 with FIG. 15, of the 28 heart-shaped decoration element images, only the overlapping decoration element images 501 to 504 partially overlap with the face areas F1 and F3, and thus the erasure is performed. Has been.

  In this way, among the decorative element images to be combined with the photographed image, the decorative element image that approaches the user's face is erased, and the specific element image has a combined position so that it does not reach the user's face. Moved. Therefore, the main image element of the frame image, which consists of a series of characters, symbols, patterns, etc. Unlike the case of the image, the composite position is moved without erasing a part of the image. Therefore, it is possible to retain (or at least not significantly change) the design based on the meaning or continuity indicated by the specific element image.

  In addition, it is an image element of a frame image, and it seems that moving the position is not preferable for reasons such as a positional relationship with other image elements or an arrangement relationship (typically an overall arrangement by providing a large number). If a simple image is set as a decoration element image, the decoration element image is deleted without moving its position, unlike the case of a specific element image. Therefore, it is possible to retain (or at least not greatly change) the design (typically overall) based on the positional relationship and overall arrangement relationship between the decorative image element and other image elements. It becomes.

<5. Effect>
As described above, according to the present embodiment, the state in which the additional image composed of the specific element image and the decoration element image to be combined with the photographed image approaches the face portion of the user is determined based on the photographed image. By recognizing, moving a specific element image, or partially erasing a decoration element image, it can be reduced or eliminated automatically without requiring a user's operation and without greatly changing the design.

<6. Modification>
In the present embodiment, the composition position is calculated by moving the specified element image downward from the initial composition position of the specific element image. However, the specific element image may be moved upward or in other directions. However, the face part included in the photographed image is usually in the upper half of the photographed image, and the blank part (background part) above the face part contains graffiti (such as a pen or stamp) by the user In many cases, it is often preferable to move downward so as to avoid the face portion and these graffiti portions. Furthermore, a plurality of images showing a series of characters, symbols, or patterns that are arranged in a direction different from the vertical direction (typically the left-right direction), on the center line extending in the vertical direction of the captured image of the specific element image If it is included, it is highly likely that the specific element image will reach the face area, and even if the specific element image is moved in the left-right direction, it is unlikely that the state of reaching the face area will be eliminated. Therefore, it can be said that it is preferable to move in the vertical direction, particularly downward for the reasons described above.

  Further, in the present embodiment, the composition position is calculated based on a calculation formula that moves L from the initially set composition position downward by L, but the composition position after movement that does not reach the user's face part is calculated. The calculation formulas for movement can be variously determined from the viewpoints of movement distance, designability, and ease of calculation. Typically, it is preferable to calculate so that it is (gradually) away from the default synthesis position, which is often set to a suitable position from the viewpoint of design, etc. It is preferable to determine the combined position after movement to a close position. Also, the calculation method is not to calculate gradually away as described above, but a method of calculating the combined position after the movement once as shown in FIG. 17 may be used.

  FIG. 17 is a diagram for explaining an example in which the combined position of the specific element image after movement is calculated once. The specific element image 550 shown in FIG. 17 is in the combined position after movement, and the position after movement is determined so that one of the upper side 601 and the lower side 602 is in contact with the lower end of the face area F3. That is, the combined position after movement is calculated so that the upper side 601 of the specific element image 550 is a tangent line that touches the face region F3 at the bottom. Such a calculation can be performed once based on a general equation or an approximate expression for calculating a tangent having a predetermined inclination with respect to the face region. In addition to the method using such a tangent equation, various known calculation methods can be applied. Also, a method in which the combined position after movement is not calculated by calculation can be considered. Hereinafter, a description will be given with reference to FIG.

  FIG. 18 is a diagram for explaining an example in which the combined position of the specific element image after movement is not calculated. FIG. 18 shows three candidate specific element images 551 to 553 that are candidates for specific element images, and these are given higher priority in order from the top of the figure. That is, the priority of the candidate specific element image 551 is first, the priority of the candidate specific element image 552 is second, and the priority of the candidate specific element image 553 is third.

First, among the candidate specifying element images 551 to 553 , those that do not have a portion overlapping with any one of the face areas F1 to F3 (here, the face area F3) are the candidate specifying element image 553 and the candidate specifying element. Of these, the image 552 having the highest priority is determined as the specific element image. Here, the candidate specific element image 552 having the second highest priority is determined as the specific element image and is combined with the captured image. In this way, among the plurality of specific element images that are predetermined candidates (to be combined at the combining position), the candidate specific element image that does not overlap the face area and has the highest priority is defined as the specific element image. By defining, it is possible to easily determine the synthesis position of the specific element image to be synthesized at a position that does not overlap with the face area without performing complicated calculation. In addition, if a plurality of specific element images that are candidates are limited to those that are suitable for design, it is often possible to synthesize them at positions that are suitable for design rather than the case where calculation is performed as described above. I can say. Further, the priority order may be determined in the order of superior design rather than in the order from the face area. If it does so, a specific element image can be synthesize | combined in a more suitable position on a design.

  However, as described above, the composition position calculated by calculation (typically once) is more (typically design) than the structure of selecting from a plurality of candidate composition positions in advance. Top) It is possible that a suitable position can be calculated, and it is possible to calculate a combined position that does not overlap the face area even if all of the candidate combined positions overlap the face area It can be said that it is excellent in that.

  In the present embodiment, the frame image has been described as including a specific element image and a plurality of decoration element images. However, the frame image may include only one or more specific element images. Further, the frame image may include a background image to be a background with respect to the user's image in addition to the specific element image which is the foreground image. Here, the background image refers to an image that should be the background for the entire user image (extracted by the above-described chroma key process), not just the user's face area. Therefore, it can be said that an image that becomes a background (visible as a background) only for the face area of the user is not a background image but a special foreground image. The frame image may include this special foreground image in addition to the specific element image.

  FIG. 19 is a diagram illustrating a relationship between a frame image including a specific element image and a plurality of special foreground images and a face area. As shown in FIG. 19, the specific element image 550 is synthesized at the synthesis position moved downward by L from the initially set synthesis position as in the above embodiment. Further, FIG. 19 shows a number of similar foreground images having the same heart shape in place of the decoration element image. Of these special foreground images, only four special foreground images 601 to 604 are partially hidden in the face areas F1 and F2 (when only this part is seen, it is a background). Thus, instead of deleting the decoration element image that overlaps the face area as in the decoration element image, if the structure is partially hidden from the face area as in the background image, the heart-shaped image is The state of reaching the user's face can be eliminated.

  In the present embodiment, an example in which there is one specific element image has been described, but there may be a plurality of elements, and the number of decoration element images is not particularly limited. When a plurality of specific element images are provided, the direction and amount of movement in the case of overlapping with the face area, the calculation method for movement, and the like need only be appropriately determined for each, and need to be the same. There is no. Further, the specific element image does not have to be moved while maintaining the shape, and may be partially (or entirely) deformed so as not to overlap the face area. In this case, it can be said that the composition position of the deformed portion is changed from a predetermined composition position.

3 ... Shooting unit 4 ... Editing unit 5 ... Output unit 6 ... Network (LAN)
DESCRIPTION OF SYMBOLS 10 ... Camera 20 ... Touch panel for imaging operation 30 ... Touch panel for output operation 35 ... Network printer 31 ... Infrared port 70 ... First control unit 72 ... First display / operation unit (touch panel for shooting operation)
80 ... second control unit 81, 82 ... second display / operation unit (touch panel for editing operation)
90 ... third control unit 91 ... third display / operation unit (touch panel for output operation)
92 ... Print output section (network printer)
94 ... Non-contact communication part (infrared port)
400 ... Touch panel for editing operation 550 ... Specific element image F1-F3 ... Face area

Claims (9)

Photographing means for photographing the user;
A face area setting means for detecting a user's face included in a photographed image photographed by the photographing means and setting a face area including at least a part of the detected face;
Editing means for synthesizing the additional image including the specific element image, in which the combined position with respect to the captured image is set to a predetermined first combined position, with the captured image;
The editing means includes
In the case where the specific element image is synthesized at the first synthesis position, the range of the specific area occupied by the specific element image and the range of the face area overlap, so that the overlapping range is reduced or eliminated. Synthesizing the specific element image at a second synthesis position different from the one synthesis position;
An imaging device for a game that synthesizes the specific element image at the first synthesis position when the range of the specific region and the range of the face region do not overlap.   The editing means does not synthesize a decoration element image that overlaps the range of the face area among a plurality of decoration element images to be combined at a predetermined position in the captured image, or the range of the face area and The game shooting device according to claim 1, wherein at least one of the ranges of the image of the user included in the shot image is combined to be a background. The editing unit includes the range of the specific area and the face area when the specific element image is to be combined with a plurality of candidate combination positions that are candidates for the combination position after the change and have been given priority in advance. range and are among the candidate synthetic position range can be a decrease is caused or disappear below a predetermined value which overlap, the candidate combination position, labeled the highest priority, and wherein the synthesis of the specific element image The imaging device for play according to claim 1 or 2. The editing means attempts to synthesize the specific element image at a candidate composition position that is a candidate for a composition position after change calculated based on a predetermined calculation formula starting from the first composition position and away from the origin. In the case where the range of the specific region and the range of the face region overlap, among the candidate composite positions that can reduce or eliminate the range where the range of the face region overlaps below a predetermined value , The game photographing apparatus according to claim 1 or 2, wherein element images are synthesized.   The specific element image includes a plurality of images showing a series of characters, symbols, or patterns arranged on a center line extending in the vertical direction of the photographed image, and arranged in a direction different from the vertical direction. The game photographing apparatus according to any one of claims 1 to 4, characterized in that:   The game shooting according to any one of claims 1 to 5, wherein the editing unit synthesizes the specific element image at a position determined downward from the first synthesis position. apparatus. A display means,
The display means synthesizes an operation screen, which is a screen for reducing and displaying an additional image in which the specific element image is arranged at the first synthesis position, and the additional image selected by the user with the captured image. The game photographing apparatus according to any one of claims 1 to 6, wherein an editing screen that is a screen for displaying a synthesized image synthesized by the editing means is displayed simultaneously . A shooting step for shooting the user;
A face area setting step of detecting a user's face included in the photographed image photographed by the photographing step and setting a face area including at least a part of the detected face;
An editing step of synthesizing the additional image including the specific element image in which the synthesis position with respect to the captured image is set to a predetermined first synthesis position with respect to the captured image,
In the editing step,
In the case where the specific element image is synthesized at the first synthesis position, the range of the specific area occupied by the specific element image and the range of the face area overlap, so that the overlapping range is reduced or eliminated. Synthesizing the specific element image at a second synthesis position different from the one synthesis position;
A game shooting method for combining the specific element image at the first combining position when the range of the specific area and the range of the face area do not overlap. On the computer,
A shooting step for shooting the user;
A face area setting step of detecting a user's face included in the photographed image photographed by the photographing step and setting a face area including at least a part of the detected face;
A program for executing an editing step for synthesizing an additional image including a specific element image set to a predetermined first synthesis position with respect to the captured image, with respect to the captured image,
In the editing step,
In the case where the specific element image is synthesized at the first synthesis position, the range of the specific area occupied by the specific element image and the range of the face area overlap, so that the overlapping range is reduced or eliminated. Synthesizing the specific element image at a second synthesis position different from the one synthesis position;
A program for synthesizing the specific element image at the first synthesis position when the range of the specific area and the range of the face area do not overlap.

Images