JP5904192B2 - Photo sticker creation apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to a photographic sticker creating apparatus, an image processing method, and a program, and more particularly, to a photographic sticker creating apparatus, an image processing method, and a program that can provide a user with a more satisfactory image.

  There is known a photo sticker that takes a picture of a user, causes the user to edit the shot image, and prints and provides the edited image on sticker paper. Such a photo sticker is installed in an entertainment facility.

  The flow of one game provided by the photo-seal machine usually shoots a user in the shooting space as a subject, moves the user to the editing space, edits the image according to operations performed in the editing space, The edited image, which is the edited image, is printed on a sticker sheet and discharged.

  In recent years, after editing work, during the waiting time until the edited image is printed on the sticker paper, the photographed image or edited image to be printed on the sticker paper is transmitted and stored to the server at the customer service. By accessing the server from the mobile terminal owned by the user and acquiring the stored image, the user can use the captured image or the edited image on the mobile terminal. For example, the user can upload the acquired image to an unspecified number of people by uploading the acquired image to a blog (Blog: web log) or the like managed on the web.

  Conventionally, there has been proposed a photo sticker that can individually capture a user's whole body and the vicinity of the face, and can individually print the whole body image and the up image on a sticker sheet (for example, Patent Document 1). reference).

  Furthermore, when photographing the whole body of the user, the up-image near the face is cropped and enlarged from the whole-body image, the whole-body image and the up-image are combined and displayed in live view, and the combined image of the whole-body image and the up-image is displayed. A photo sticker that can print on sticker paper has been proposed (see, for example, Patent Document 2).

JP 2012-39414 A JP 2010-258774 A

  The present invention makes it possible to provide an image that is highly satisfactory for the user.

A photo sticker creating apparatus according to one aspect of the present invention is a mobile phone that takes a picture of a user in a shooting space, prints an image obtained by processing the obtained shot image on a predetermined sticker sheet, or is connected via a communication network. A photo sticker creating apparatus for transmitting to a terminal, which captures an image including a plurality of users, captures the plurality of users, and a moving image captured by the capturing means within one area multiple causes displayed in real time, and live view display control means for controlling the display of the display unit so as to display a plurality of combined images around the moving image generated from images captured by the capture means a synthesizing means for generating a plurality of combined images by combining each of the combined images to the image, said combining means, the left of the user in the video image A first composite image is generated by combining the image and the image for synthesis displayed on the left side of the moving image, and is displayed on the right side of the moving image and the user image on the right side in the moving image. A second composite image is generated by combining the composite images.

  The synthesizing means can extract each of the user images from the photographed image, and can generate a plurality of the synthesized images by combining each of the user images with the images for synthesis.

Wherein the live view display control means causes display of the moving image in real time the center of the display screen of the display unit, it is possible to Ru to display the synthesis image to the left and right of the moving image.

  The image processing apparatus may further include an editing processing unit that receives an editing input for the captured image, a printing unit that prints an image on the sticker sheet, and a transmission unit that transmits the image to the portable terminal.

An image processing method according to one aspect of the present invention is a mobile terminal that captures an image of a user in an imaging space, prints an image obtained by processing the captured image on a predetermined sticker sheet, or is connected via a communication network An image processing method of a photo sticker creating apparatus for transmitting to a capturing step of capturing an image including a plurality of users and photographing the plurality of users, and a moving image captured by the processing of the capturing step Is displayed in one area in real time, and a live view display control step for controlling display of the display unit so as to display a plurality of compositing images around the moving image, and the processing of the capturing step. and each of said a plurality of images generated from the captured image viewed contains a combining step of generating a plurality of combined images by combining the synthesis image, before In the combining step, a first composite image is generated by combining the left user image in the moving image and the combining image displayed on the left side of the moving image, and the right side in the moving image A second synthesized image is generated by synthesizing the image of the user and the image for synthesis displayed on the right side of the moving image .

The program according to one aspect of the present invention shoots a user in a shooting space, prints an image obtained by processing the captured image on a predetermined sticker sheet, or transmits the image to a mobile terminal connected via a communication network. A program for causing a computer to execute a process for capturing, capturing an image including a plurality of users, capturing an image of the plurality of users, and a moving image captured by the processing of the capturing step Photographed in the live view display control step for controlling the display of the display unit so that a plurality of compositing images are displayed around the moving image and displayed in one area in real time, and taken by the processing of the capturing step A composite step of generating a plurality of composite images obtained by combining the composite images with a plurality of images generated from the photographed images. Only contains, in the combining step, to generate a first synthesized image by synthesizing the synthesis image which is displayed on the left side of the user's image in the moving image on the left side of the moving image, the A computer is caused to execute a process of generating a second synthesized image by synthesizing the right user image in the moving image and the synthesizing image displayed on the right side of the moving image .

In one aspect of the present invention, an image including a plurality of users is captured, the plurality of users are photographed, the captured moving images are displayed in real time, and a plurality of compositing images are provided around the moving images. By combining the image of the user on the left side in the moving image and the image for synthesis displayed on the left side of the moving image among the plurality of images generated from the captured image that is displayed. One composite image is generated, and a second composite image is generated by combining the right user image in the moving image and the combining image displayed on the right side of the moving image.

  According to one aspect of the present invention, it is possible to provide an image that is highly satisfactory for the user.

It is a perspective view which shows the structural example of the external appearance of a photograph sticker production apparatus. It is the perspective view which looked at the external appearance of the photograph sticker production apparatus from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of an imaging | photography part. It is a figure which shows the detailed structural example of an imaging | photography / display unit. It is a figure which shows the detailed structural example of a camera. It is a figure which shows the structural example of a camera support part. It is a figure which shows the structural example of a background part. It is a figure which shows the structural example of the external appearance of the floor of a background part. It is a figure explaining the effect acquired by the inclination of a floor. It is a figure explaining the sheet | seat for chroma keys of a background part. It is a figure which shows the structural example of an edit part. It is a figure which shows the structural example of a customer service part after the fact. It is a block diagram which shows the example of an internal structure of a photograph sticker production apparatus. It is a functional block diagram which shows the detailed structural example of a control part. It is a functional block diagram which shows the detailed structural example of an imaging | photography process part. It is a functional block diagram which shows the detailed structural example of an edit process part. It is a flowchart explaining the process which provides a photograph sticker creation game. It is a flowchart explaining an imaging | photography process. It is a flowchart explaining an imaging | photography process. It is a figure which shows the example of the live view display screen at the time of lower camera up photography. It is a figure which shows the example of the live view display screen at the time of upper camera up photography. It is a figure which shows the example of the guidance screen of an upper camera whole body imaging | photography. It is a figure which shows the example of the live view display screen at the time of upper camera whole body imaging | photography. It is a flowchart explaining an upper camera whole body imaging | photography process. It is a figure which shows the example of a live view image. It is a figure explaining the detection of a color range. It is a figure which shows the example of a corner image. It is a figure which shows the example of an upper camera whole body picked-up image. It is a flowchart explaining an upper camera whole body imaging | photography process. It is a figure explaining the detection of a color range. It is a flowchart explaining a corner point adjustment process. It is a figure which shows the example of a corner point adjustment screen. It is a figure which shows the example of a corner point adjustment screen. It is a figure explaining the distance of a camera and a to-be-photographed object in imaging | photography space. It is a flowchart explaining the cross combination imaging | photography process. It is a figure which shows the example of a live view display screen when performing upper camera whole body photography by cross combination photography. It is a figure explaining the non-photographing area | region of a captured image. It is a figure explaining trimming of a captured image. It is a figure which shows the example of the live view display screen when performing upper camera up photography by cross combination photography. It is a figure which shows the example of the confirmation screen of a cross combination image. It is a flowchart explaining the other example of a cross combination imaging | photography process. It is a figure which shows the example of the confirmation screen of the progress of the cross combination image. It is a flowchart explaining an edit process. It is a figure which shows the example of the selection screen which selects the size and brightness of eyes. It is a figure which shows the example of the selection screen which selects an own image. It is a figure which shows the example of a name input screen. It is a figure which shows the other example of a name input screen. It is a figure which shows the example of the selection screen of a background color. It is a figure which shows the example of the selection screen of the image for a synthesis | combination. It is a figure which shows the example of an edit screen. It is a figure which shows the example of a division | segmentation pattern. It is a figure which shows the other example of a division | segmentation pattern. It is a figure for demonstrating the other example of the production | generation method of a synthesized image. It is a figure for demonstrating the other example of the production | generation method of a synthesized image.

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings.

[External structure of photo sticker creation device]
FIG. 1 is a perspective view showing a configuration example of the appearance of a photo sticker creating apparatus 1 according to an embodiment of the present invention.

  The photo sticker creating apparatus 1 is a game machine that allows a user to perform operations such as shooting and editing as a game and receives a price from the user instead of providing a shot image or an edited image. The photo sticker creating apparatus 1 is installed in a store such as a game center. There may be one user or a plurality of users.

  The user who plays the game provided by the photo sticker creating apparatus 1 pays the price, takes a picture of himself as a subject, and synthesizes a handwritten line drawing or stamp image with the shot image obtained by the shooting. By editing using the editing function, the captured image becomes a rich image. The user receives the sticker sheet on which the edited image is printed and ends the series of games.

  As shown in FIG. 1, the photo sticker creating apparatus 1 mainly includes a photographing unit 11, an editing unit 12, and a subsequent customer service unit 13. The photographing unit 11 and the editing unit 12 are installed in contact with each other, and the editing unit 12 and the subsequent customer service unit 13 are installed in contact with each other.

  The photographing unit 11 includes a photographing unit 21 and a background unit 22. The photographing unit 21 and the background unit 22 are set apart by a predetermined distance, and a photographing operation is performed in a photographing space that is a space formed between the photographing unit 21 and the background unit 22.

  The photographing unit 21 is a device that allows a user to perform photographing work. The photographing unit 21 enters the photographing space and is located in front of the user who is performing the photographing work. A front panel 41 of the photographing unit 21 that constitutes a surface facing the photographing space in front is provided with a touch panel monitor used by the user during photographing work. When the left side as viewed from the user in the imaging space is the left side and the right side is the right side, the left side of the imaging unit 21 is constituted by a side panel 42A, and the right side is a side panel 42B (not shown). Consists of.

  The background unit 22 is attached to the left end of the rear panel 51 and the rear panel 51, which are plate-like members positioned on the rear side of the user who is taking a photo work facing the front, and has the same width as the side panel 42A. A side panel 52A, which is a plate-like member, and a side panel 52B (FIG. 2), which is a plate-like member attached to the right end of the rear panel 51 and having the same width as the side panel 42B.

  The side panel 42A constituting the left side surface of the photographing unit 21 and the side panel 52A of the background unit 22 are provided on substantially the same plane, and their upper portions are connected by a connecting part 23A that is a plate-like member. Further, the side panel 42B constituting the right side surface of the photographing unit 21 and the side panel 52B of the background portion 22 are provided on substantially the same plane, and their upper portions are connected by a connecting portion 23B which is a plate-like member.

  An opening formed by being surrounded by the side panel 42 </ b> A of the photographing unit 21, the connecting part 23 </ b> A, and the side panel 52 </ b> A of the background part 22 becomes an entrance G <b> 1 of the photographing space. Although not shown, an opening formed by being surrounded by the side panel 42B of the photographing unit 21, the connecting part 23B, and the side panel 52B of the background 22 is also an entrance G2 of the photographing space.

  An opening surrounded by the front panel 41 of the photographing unit 21, the connecting part 23A, the connecting part 23B, and the back panel 51 of the background part 22 is formed above the photographing space, and a ceiling strobe is formed so as to cover a part of the opening. A unit 24 is provided. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B. The ceiling strobe unit 24 has a built-in strobe that emits light toward the photographing space in accordance with photographing. A fluorescent lamp is provided inside the strobe constituting the ceiling strobe unit 24, and also functions as illumination of the photographing space.

  When the front-back direction of the user in the shooting space is the depth direction, the dimensions (depth, width, and height) of the shooting unit 11 are, for example, 1850 mm × 1800 mm × 2225 mm.

  The editing unit 12 is a device that allows a user to perform editing work for editing an image obtained by photographing work. The editing unit 12 is provided so as to be connected to the photographing unit 11 so that one side surface thereof is in contact with the back surface of the front panel 41 of the photographing unit 21. The editing unit 12 is provided with a configuration such as a tablet built-in monitor used by a user during editing work.

  If the configuration of the editing unit 12 shown in FIG. 1 is the configuration on the front side, the editing unit 12 is used for editing operations on the front side and the back side so that two sets of users can perform editing operations simultaneously. Each configuration is provided.

  The front side of the editing unit 12 is a surface perpendicular to the floor surface, and is composed of a surface 71 that is substantially parallel to the side panel 42A, and a slope 72 formed above the surface 71. The configuration used is provided on the slope 72. On the left side of the slope 72, a support portion 73A that has a columnar shape and supports one end of the lighting device 74 is provided. A support portion 73 </ b> B (FIG. 2) that supports the other end of the lighting device 74 is also provided on the right side of the slope 72. Further, on the left side of the support portion 73A, there is provided a support portion 73C having a plate-like shape and provided by connecting the subsequent customer service portion 13. A support portion 75 that supports the curtain rail 26 is provided on the upper surface of the support portion 73C.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C so that the shape when viewed from above is a U-shape. One end of the rails 26A and 26B provided in parallel is fixed to the connecting portion 23A and the connecting portion 23B, respectively, and both ends of the remaining one rail 26C are joined to the other end.

  A curtain is attached to the curtain rail 26 so that the inside of the space in front of the editing unit 12 and the space in front of the back cannot be seen from the outside. The space in front of the editing unit 12 and the space in front of the back, which are surrounded by the curtain attached to the curtain rail 26, serve as an editing space in which the user performs editing work.

  FIG. 2 is a perspective view of the photo sticker creating apparatus 1 as seen from another angle.

  The subsequent customer service unit 13 is a device for performing subsequent customer service to the user. At the time of the customer service, the photographed image and the edited image are transmitted to a mobile terminal such as a mobile phone.

  As shown in FIG. 2, the post-service customer unit 13 has a plate-like housing having a predetermined thickness, and is connected to the editing unit 12 so that the back surface thereof is in contact with the left side surface of the editing unit 12. Provided. A front face of the post-service section 13 is provided with a tablet built-in monitor used by the user at the time of post-service and a discharge port through which sticker paper on which a photographed image or an edited image is printed is discharged. The space in front of the post-service section 13 serves as a post-service space for performing post-service to users who are waiting for the printing on the sticker paper to end.

  Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described with reference to FIG. FIG. 3 is a plan view of the photo sticker creating apparatus 1 as viewed from above.

  The user of the photo sticker creating apparatus 1 is formed between the photographing part 21 and the background part 22 from the entrance G1 as indicated by the white arrow # 1 or from the entrance G2 as indicated by the white arrow # 2. The camera enters the shooting space A1 and performs a shooting operation using a camera or a touch panel monitor provided in the shooting unit 21.

  The user who has finished the photographing work exits the photographing space A1 using the doorway G1 as indicated by the white arrow # 3 and moves to the editing space A2-1, or as indicated by the white arrow # 4. To leave the shooting space A1 and move to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12, and the editing space A2-2 is an editing space on the back side of the editing unit 12. Which of the editing space A2-1 and the editing space A2-2 is moved is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the empty space of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing work. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing work at the same time.

  After the editing operation is completed, printing of the captured image and the edited image is started. The user who has finished the editing work during image printing moves from the editing space A2-1 to the post-service area A3 as indicated by the white arrow # 5 if the editing work has been performed in the editing space A2-1. After that, he gets a customer service. In addition, when the editing work is completed in the editing space A2-2, the user moves from the editing space A2-2 to the post-service area A3 as indicated by the white arrow # 6. Receive customer service in customer service space A3.

  When the printing of the image is finished, the user receives the sticker paper from the outlet provided in the post-service section 13 and finishes a series of photo sticker creation games.

  Next, the configuration of each device will be described.

[Configuration of shooting section]
FIG. 4 is a diagram illustrating a configuration example of the photographing unit 21. The photographing unit 21 is configured by attaching a front panel 41, a side panel 42A, and a side panel 42B to a base unit 43 having a box shape.

  The front panel 41 is positioned in front of the user who performs the shooting operation in the shooting space A1, and the side panel 42A and the side panel 42B are positioned on the left side and the right side of the user who performs the shooting operation in the shooting space A1, respectively. The connecting portion 23A is fixed above the side panel 42A, and the connecting portion 23B is fixed above the side panel 42B.

  An imaging / display unit 81 is provided in the approximate center of the front panel 41. The photographing / display unit 81 includes a camera 91, a camera strobe 92, and a touch panel monitor 93.

  The camera 91 is configured to include an imaging device having an imaging element such as a CCD (Charge Coupled Device), and images a user in the imaging space A1. A moving image (live view image) captured by the camera 91 is displayed on the touch panel monitor 93 in real time. An image captured by the camera 91 at a predetermined timing such as when a user gives an instruction to shoot is saved as a photographic image (still image). Note that an image captured by the camera 91, that is, a live view image and a captured image are collectively referred to as a captured image hereinafter.

  A camera strobe 92 is provided on the back side of the camera 91, and the camera 91 is driven (moved) in the vertical direction on the surface side of the camera strobe 92. The camera strobe 92 is composed of an acrylic plate constituting a light emitting surface and an illumination device such as a fluorescent lamp provided behind the light emitting surface, and emits light in accordance with photographing by the camera 91 like other strobes. In the camera strobe 92, a portion exposed according to the vertical position of the camera 91 is a light emitting surface. That is, the camera strobe 92 irradiates the vicinity of the user's face as a subject from above or below the camera 91 according to the vertical position of the camera 91.

  A touch panel monitor 93 provided on the lower side of the camera 91 includes a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 93 has a function as a live view monitor that displays a moving image captured by the camera 91 and a function that displays various GUI (Graphical User Interface) images and accepts a user's selection operation through the touch panel. ing. On the touch panel monitor 93, a moving image after an image such as a background is appropriately displayed is displayed.

  On the front panel 41, an upper strobe 82 is installed on the upper side with respect to the position of the photographing / display unit 81. A left strobe 83 is installed on the left side and a right strobe 84 is installed on the right side. A lower strobe 85 is provided at a position below the photographing / display unit 81 such that a part of the upper surface of the base portion 43 protrudes.

  The upper strobe 82 irradiates the user from the upper front. The left strobe 83 irradiates the user from the left front, and the right strobe 84 irradiates the user from the right front. The lower strobe 85 irradiates the user from the lower front.

  The base unit 43 is also provided with a foot strobe 86 that irradiates the user's foot. Fluorescent lamps are provided inside the upper strobe 82, left strobe 83, right strobe 84, lower strobe 85, and foot strobe 86, and together with the fluorescent lights inside the strobe constituting the ceiling strobe unit 24, photographing is performed. Used as illumination in the space A1. By adjusting the light emission amount of each fluorescent lamp, or by adjusting the number of fluorescent lamps to emit light, the brightness in the shooting space A1 depends on the content of the shooting work performed by the user. Adjust as appropriate.

  Further, a coin insertion / return port 87 through which a user inserts money is provided on the right side of the foot strobe 86.

  Further, on the left side of the touch panel monitor 93 on the upper side of the lower strobe 85, a monitor left strobe 88 that irradiates the user from the lower left front is provided, and on the right side of the touch panel monitor 93, the user is viewed from the lower right front. A monitor right strobe 89 for irradiating is provided.

  An illumination device other than the fluorescent lamp may be provided inside each strobe.

Spaces 43A and 43B formed on the left and right sides of the upper surface of the base portion 43 with the lower strobe 85 interposed therebetween are used as a luggage storage place for a user who performs a photographing operation to place baggage and the like.
Further, for example, near the ceiling of the front panel 41, there is also provided a speaker that outputs sound such as guidance sound for shooting processing, BGM (Back Ground Music), and sound effects for allowing the user to perform shooting operations.

  Here, the vertical drive of the camera 91 will be described.

  In the shooting process, the vertical position of the camera 91 is such that the user as a subject is shot from the front in front when viewed from the user, and the position from which the user is photographed obliquely from the front when viewed from the user. In addition, the camera 91 is driven in the vertical direction to perform shooting.

  Hereinafter, as appropriate, the camera 91 in a position where the user is photographed from the front in front is referred to as a lower camera, and the camera 91 in a position where the user is photographed from diagonally forward is referred to as the upper camera.

[Configuration example of shooting / display unit]
FIG. 5 shows a detailed configuration example of the photographing / display unit 81 including the camera 91 driven in the vertical direction.

  As shown in FIG. 5A, the photographing / display unit 81 is configured by providing a camera 91, a camera strobe 92, and a touch panel monitor 93 on one side of a casing having a vertically long rectangular parallelepiped shape. A frame-shaped cover 94 is provided around the camera 91 and the camera strobe 92, and the camera 91 is driven in the vertical direction within the range of the opening of the cover 94.

  FIG. 5B shows the photographing / display unit 81 from which the touch panel monitor 93 and the cover 94 are removed from the state of FIG. 5A. As shown in FIG. 5B, the camera 91 is configured integrally with an acrylic plate 95 that constitutes the light emitting surface of the camera strobe 92, and the acrylic plate 95 is driven in the vertical direction together with the camera 91. The side surface of the camera 91 is supported by a camera support unit 96 and is driven in the vertical direction according to a guide groove provided in the camera support unit 96.

  FIG. 5C shows the photographing / display unit 81 from which the acrylic plate 95 is removed from the state of FIG. 5B. As shown in FIG. 5C, an upper fluorescent lamp 97U is provided above the back of the camera 91, and a lower fluorescent lamp 97D is provided below the back of the camera 91. The camera 91 is configured integrally with an on-camera fluorescent lamp 97U and a lower-camera fluorescent lamp 97D as illumination devices constituting the camera strobe 92. The upper-camera fluorescent lamp 97U and the lower-camera fluorescent lamp 97D are vertically moved together with the camera 91. Drive in the direction.

  That is, as shown in FIG. 5A, when the camera 91 is positioned at the lower end of the opening of the cover 94 and is in the lower camera state, the acrylic plate 95 on the upper side of the camera 91 is exposed, and the on-camera fluorescent lamp 97U is By emitting light, the camera strobe 92 irradiates the vicinity of the user's face as a subject from above the camera 91.

  Although not shown, when the camera 91 is positioned at the upper end of the opening of the cover 94 and is in the upper camera state, the lower acrylic plate 95 of the camera 91 is exposed and the lower fluorescent lamp 97D emits light. Thus, the camera strobe 92 irradiates the vicinity of the user's face as a subject from below the camera 91.

[Camera configuration example]
FIG. 6 shows a detailed configuration example of the camera 91.

  The camera 91 is configured by mounting a camera body 91M, which is an imaging device, on a case 91C. The camera 91 is provided with a rotating portion 91R that rotates about an axis parallel to the optical axis of the lens of the camera body 91M by a predetermined driving mechanism. Further, a gear provided on the circumferential surface of the zoom ring 91F for adjusting the focal length of the camera body 91M and a gear (not shown) provided at one end of the rotating portion 91R are provided with ribs on the inner side. They are connected by a timing belt 91B.

  That is, when the rotating portion 91R rotates, the zoom ring 91F rotates via the timing belt 91B, and the focal length of the camera body 91M is adjusted. Thereby, for example, when the camera 91 is in the lower camera state, the focal length can be adjusted to zoom in, and when the camera 91 is in the upper camera state, the focal length can be adjusted to zoom out.

  Further, protrusions P1 and P2 are provided on the side surface of the case 91C. The camera 91 is driven in the vertical direction by the projections P1 and P2 being guided along the guide grooves g1 and g2 provided in the camera support portion 96 as shown in FIG. The guide grooves g1 and g2 may be formed so as to penetrate the camera support portion 96, or may be formed so as not to penetrate. Also, as shown in FIG. 7, the guide groove g2 is formed so as to draw an arc around the upper end of the guide groove g1 above the position corresponding to the upper end of the guide groove g1. Thus, after the protrusions P1 and P2 reach the positions corresponding to the upper end of the guide groove g1 and the upper end of the guide groove g1 of the guide groove g2, the camera 91 is centered on the upper end of the guide groove g1. The image is rotated in the left direction in the figure by a predetermined angle, and the lower direction of the photographing space is photographed.

  With such a structure, when the camera 91 is in the lower camera state, the user is photographed from the front front, and when the camera 91 is in the upper camera state, the user is photographed from diagonally forward.

[Configuration of the background]
FIG. 8 is a diagram illustrating a configuration example of the background portion 22 on the photographing space A1 side. FIG. 8A is a front view illustrating a configuration example of the background portion 22, and FIG. 8B is a perspective view illustrating a configuration example of the background portion 22.

  Near the center above the back panel 51, a back center strobe 101 for irradiating a user who is performing a shooting operation in the shooting space A1 from the back center is attached.

  A rear left strobe 102 that irradiates a user who is performing a photographing operation in the photographing space A1 from the left rear is provided above the rear panel 51 and on the doorway G1 side. Further, a rear right strobe 103 that irradiates a user who is performing a photographing operation in the photographing space A1 from the right rear is provided above the rear panel 51 and on the entrance / exit G2 side.

  In addition, a floor 104 is provided below the back panel 51 in a portion sandwiched between the side panel 52A and the side panel 52B in the imaging space A1. As shown in FIG. 9, the floor 104 is provided with an inclination of, for example, 7 ° with respect to the installation surface on which the photo sticker creating apparatus 1 is installed so that the floor 104 becomes higher as it is closer to the rear panel 51 side. .

  If the front-back direction of the user in the shooting space is the depth direction, the dimensions of the floor 104 (depth, width, and height on the back panel 51 side) are, for example, 550 mm × 1710 mm × 80 mm.

[Effects obtained by floor inclination]
Here, with reference to FIG. 10, the effect obtained by providing the floor 104 with an inclination will be described.

FIG. 10 shows a subject (user) 111 photographed by the camera 91 in the upper camera state in the photographing space A1. When shooting the whole body of the subject, shooting with the upper camera makes the face appear larger than shooting with the lower camera, so that a shot image with an enhanced face can be obtained. Further, the whole body image obtained by the upper camera can increase the ratio of the subject in the image than the whole body image obtained by the lower camera.
As described above, photographing with the upper camera is suitable for obtaining a whole body image of a subject.

  For example, in a shooting space of a general photo sticker creation apparatus, as shown in FIG. 10A, when the subject 111 takes a forward leaning posture so that the face is brought closer to the camera 91, shooting with a more emphasized face is performed. An image can be obtained.

  Further, by providing the inclined floor 104 as in the photo sticker creating apparatus 1 of the present invention, as shown in FIG. 10B, the same state as when the heel portion of the subject 111 is wearing shoes with heels. Thus, the length of the back of the foot with respect to the imaging surface of the camera 91 is longer than that in the case of FIG. 10A, so that a captured image in which the foot looks longer can be obtained.

  In particular, if the foot is the longest when the angle between the ground and the sole when wearing shoes with heel is 7 °, the inclination of the floor 104 is set to 7 °. Even a female junior and senior high school student who wears shoes with low heels can obtain a photographed image in which the legs look longer as in the case of wearing shoes with heels.

  Also, as shown in FIG. 10A, when the subject 111 is tilted forward and the camera 91 is viewed, a portion 111n from the bottom of the chin to the neck is irradiated by the strobe. It is difficult to understand the outline of the face, and the face may appear larger than necessary.

  On the other hand, by providing the floor 104 as shown in FIG. 10B, the subject 111 can be photographed in a posture that does not protrude forward and does not stick out the chin as shown in FIG. 10A. A shadow is formed on the portion 111n, and in the captured image, it is possible to prevent the face from being emphasized and the face from appearing larger than necessary.

  Furthermore, in FIG. 10A, when the subject 111 looks at the camera 91 without taking the forward tilted posture, the face taken up is in the captured image. On the other hand, since the line of sight of the subject 111 is increased by providing the floor 104 as shown in FIG. 10B, the subject 111 can naturally see the camera 91, and the photographed image has a face with an upper eye. Can be avoided.

[About chroma key sheet]
Further, in the present embodiment, the background portion 22 is configured without the winding-up type background curtain used for the background or the elevating curtain used as the chroma key curtain on the photographing space A1 side of the background portion 22. A chroma key sheet is affixed to the rear panel 51, the side panels 52 </ b> A and 52 </ b> B, and the surface of the floor 104.

  FIG. 11 is a diagram illustrating a chroma key sheet affixed to the photographing space A1 side of the background portion 22. FIG.

  As shown in FIG. 11, a chroma key sheet 121A is affixed to the back panel 51, a chroma key sheet 121B is affixed to the lower part of the side panel 52B, and a chroma key sheet 121C is affixed to the slope portion of the floor 104. The The chroma key sheets 121A to 121C are green chroma key sheets, whereby a so-called green back composition is performed. Although not shown, a chroma key sheet 121C 'similar to the chroma key sheet 121B is also attached to the lower portion of the side panel 52A. As shown in FIG. 11, the chroma key sheet 121B is attached only to the lower portion of the side panel 52B. However, the portion of the side panel 52B to which the chroma key sheet 121B is attached is the image of the camera 91. It may be wider than the part that enters the corner, and may be the entire surface of the side panel 52B, for example. The same applies to the chroma key sheet 121C 'attached to the side panel 52A.

  The chroma key sheets 121A, 121B, and 121C may be made of the same material or different materials. Specifically, for example, the chroma key sheet 121A serving as the back surface of the imaging space A1 may be made of cloth, the chroma key sheet 121B serving as the side face may be made of resin or cloth, and the chroma key sheet 121C may be made of resin such as rubber.

[Configuration of editorial department]
FIG. 12 is a diagram illustrating a configuration example of the front side of the editing unit 12 (the editing space A2-1 side).

  A tablet built-in monitor 131 is provided at substantially the center of the slope 72. A touch pen 132A is provided on the left side of the tablet built-in monitor 131, and a touch pen 132B is provided on the right side.

  The tablet built-in monitor 131 is configured by superimposing a tablet capable of inputting an operation using the touch pen 132A or 132B on an editing monitor such as an LCD. On the tablet built-in monitor 131, for example, an editing screen that is a screen used for editing a captured image is displayed. When two people perform editing work simultaneously, the touch pen 132A is used by one user, and the touch pen 132B is used by the other user.

  On the left side of the editing unit 12, a post-service unit 13 is provided.

[Composition of the customer service department]
FIG. 13 is a diagram illustrating a configuration example of the front side of the post-service unit 13.

  A monitor 161 with a built-in tablet is provided at the upper center of the post-service section 13. A touch pen 162A is provided on the left side of the tablet built-in monitor 161, and a touch pen 162B is provided on the right side. Similarly to the tablet built-in monitor 131, the tablet built-in monitor 161 is configured by providing a tablet capable of operating input using the touch pen 162A or 162B superimposed on a post-service monitor such as an LCD. On the tablet built-in monitor 161, a screen used for post-service processing for transmitting a captured image or an edited image to a mobile terminal such as a mobile phone is displayed.

  A non-contact type IC reader / writer 163 is provided under the tablet built-in monitor 161, and a sticker paper discharge port 164 is provided under the non-contact type IC reader / writer 163. A speaker 165 is provided below the sticker paper discharge port 164.

  The non-contact type IC reader / writer 163 communicates with a non-contact type IC that is in close proximity, and reads data from the non-contact type IC and writes data to the non-contact type IC.

  In the sticker paper discharge port 164, sticker paper on which an image created by the user of the editing space A2-1 is printed, or the user of the editing space A2-2 performs the editing work. The sticker paper on which the created image is printed is discharged. A printer is provided inside the editing unit 12, and printing of images is performed by the printer.

  The speaker 165 outputs sound such as guidance voice, BGM, and sound effects for the post-service processing.

[Internal configuration of photo sticker creation device]
Next, the internal configuration of the photo sticker creating apparatus 1 will be described. FIG. 14 is a block diagram illustrating an internal configuration example of the photo sticker creating apparatus 1. The same code | symbol is attached | subjected to the same structure as the structure mentioned above. Note that overlapping descriptions are omitted as appropriate.

  The control unit 201 includes a CPU (Central Processing Unit) and the like, executes a program stored in a ROM (Read Only Memory) 206 and a storage unit 202, and controls the overall operation of the photo sticker creating apparatus 1. A storage unit 202, a communication unit 203, a drive 204, a ROM 206, and a RAM (Random Access Memory) 207 are connected to the control unit 201. The control unit 201 is also connected with each configuration of the photographing unit 208, the editing unit 209, and the post-service unit 210.

  The storage unit 202 includes a non-volatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 201. Information stored in the storage unit 202 is appropriately read out by the control unit 201.

  A communication unit 203 is an interface of a network such as the Internet, and communicates with an external device according to control by the control unit 201.

  A removable medium 205 made of an optical disk, a semiconductor memory, or the like is appropriately attached to the drive 204. Computer programs and data read from the removable medium 205 by the drive 204 are supplied to the control unit 201 and stored in the storage unit 202 or installed.

  The ROM 206 stores programs and data executed by the control unit 201. The RAM 207 temporarily stores data and programs processed by the control unit 201.

  The imaging unit 208 includes a coin processing unit 221, an illumination device 222, a camera 91, a touch panel monitor 93, and a speaker 223 that are configured to perform imaging processing in the imaging space A1.

  The coin processing unit 221 detects the insertion of coins into the coin insertion / return port 87. When the coin processing unit 221 detects that a predetermined amount of coins such as 300 yen has been inserted, the coin processing unit 221 outputs an activation signal indicating that to the control unit 201.

  The illumination device 222 is a fluorescent lamp provided inside each strobe in the photographing space A1, and emits light according to an illumination control signal supplied from the control unit 201. As described above, in the photographing space A1, in addition to the strobe of the ceiling strobe unit 24, an upper strobe 82, a left strobe 83, a right strobe 84, a lower strobe 85, a foot strobe 86, and a monitor left strobe provided in the photographing section 21. 88, a monitor right strobe 89, a back center strobe 101 provided in the background portion 22, a back left strobe 102, and a back right strobe 103 are provided.

  In addition, the illumination device 222 adjusts the light emission amount according to the control by the control unit 201, thereby adjusting the brightness in the shooting space A1 according to the stage of the shooting work performed by the user.

  The camera 91 shoots according to the control by the control unit 201 and outputs an image obtained by the shooting to the control unit 201.

  The speaker 223 outputs sound such as guidance voice, BGM, and sound effects of shooting processing that causes the user to perform shooting work.

  The editing unit 209A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 231 provided on the front side of the editing unit 12 as a configuration for performing editing processing in the editing space A2-1. The editing unit 209B has the same configuration as the editing unit 209A, and performs editing processing in the editing space A2-2.

  The tablet built-in monitor 131 displays an editing screen on a built-in editing monitor under the control of the control unit 201, and detects a user operation on the editing screen (built-in tablet). A signal representing the content of the user's operation is supplied to the control unit 201, and the captured image to be edited is edited.

  The speaker 231 outputs sound such as guidance voice, BGM, and sound effect of editing processing that allows the user to perform editing work.

  The subsequent customer service unit 210 includes a tablet built-in monitor 161, touch pens 162A and 162B, a non-contact type IC reader / writer 163, a speaker 165, and a printer 241 that perform print processing in the subsequent customer service space A3. , And a sticker unit 242.

  Under the control of the control unit 201, the tablet built-in monitor 161 displays a screen used for the subsequent customer service on the built-in subsequent customer service monitor, and detects a user operation on the screen (built-in tablet). A signal representing the content of the user's operation is supplied to the control unit 201, and the customer service is performed afterwards.

  The printer 241 prints the photographed image or the edited image obtained by the editing process on the sticker paper stored in the sticker paper unit 242 attached to the printer 241 and discharges it to the sticker paper discharge port 164.

[Configuration of control unit]
Next, the control unit 201 will be described. FIG. 15 shows a configuration example of functional blocks realized by the control unit 201 executing a program stored in the ROM 206 or the like.

  The control unit 201 performs a process related to a charge input when starting the photo sticker creation game and a process related to a photographing work process of the photo sticker creation game such as photographing a user group. An editing processing unit 302 that performs processing related to the editing work process of the photo sticker creation game such as graffiti editing, a printing processing unit 303 that performs processing related to the printing process of the photo sticker creation game such as printing of sticker paper, and editing work. A post-service processing unit 304 is provided for performing processing related to the post-service process of the photo sticker creation game that serves the finished user group.

  That is, the control unit 201 controls processing related to each process of the photo sticker creation game.

[Configuration of shooting processing unit]
FIG. 16 is a functional block diagram illustrating a more detailed configuration example of the imaging processing unit 301 in FIG.

  In the example of FIG. 16, the shooting processing unit 301 includes a progress control unit 311, a shooting parameter setting unit 312, a live view display control unit 313, a shot image acquisition unit 314, an illumination control unit 315, a camera drive control unit 316, and a chroma key processing unit. 317, a corner point detection unit 318, a corner image generation unit 319, a composition processing unit 320, and a face recognition unit 321.

  The progress control unit 311 controls the progress of the photographing work process.

  The shooting parameter setting unit 312 performs processing related to setting of parameters relating to shooting such as image quality, brightness, and eye size.

  The live view display control unit 313 performs processing related to display on the touch panel monitor 93 (live view display).

  The captured image acquisition unit 314 performs processing related to imaging, particularly acquisition of captured images.

  The illumination control unit 315 performs processing related to light emission of the illumination device provided in the imaging space.

  The camera drive control unit 316 performs processing related to driving of the camera 91.

  The chroma key processing unit 317 performs chroma key processing for extracting the background area based on the color of the background area of the captured image captured by the camera 91.

  The corner point detection unit 318 detects a corner point, which is an intersection where the back surface, the side surface, and the floor surface of the shooting space intersect as a background region of the captured image captured by the camera 91.

  The corner image generation unit 319 generates a background image (hereinafter referred to as a corner image) including a corner line that is a line segment imitating an intersection line of two of the back surface, the side surface, and the floor surface of the imaging space.

  The composition processing unit 320 synthesizes the corner image generated by the corner image generation unit 319 with the captured image from which the background area has been extracted by the chroma key processing unit 317. Further, the composition processing unit 320 performs processing for extracting each user's image from a plurality of photographed images and generating a composite image combining only the same user's images.

  The face recognition unit 321 performs a process for recognizing a user's face in the captured image. For example, the face recognizing unit 321 identifies an individual based on the face shown in the photographed image, or detects the number of people in the photographed image.

[Configuration of edit processing section]
FIG. 17 is a functional block diagram illustrating a more detailed configuration example of the editing processing unit 302 of FIG.

  In the example of FIG. 17, the editing processing unit 302 includes a progress control unit 351, an editing preparation processing unit 352, an input reception control unit 353, an editing screen display control unit 354, and a graffiti editing processing unit 355.

  The progress control unit 351 controls the progress of the editing work process.

  The editing preparation processing unit 352 performs processing related to editing preparation.

  The input reception control unit 353 controls the tablet built-in monitor 131 and performs a process of receiving operation input performed by the user for various GUIs displayed on the tablet built-in monitor 131.

  The edit screen display control unit 354 performs processing related to display of an edit screen displayed on the tablet built-in monitor 131 and display of various GUIs on the edit screen.

  The graffiti editing processing unit 355 performs processing related to editing graffiti on the captured image in response to an input operation using the touch pen 132 by the user.

[Operation of photo sticker creation device]
Next, processing of the photo sticker creation apparatus 1 that provides a photo sticker creation game will be described with reference to the flowchart of FIG.

  In step S1, the photographing processing unit 301 of the control unit 201 of the photo sticker creating apparatus 1 determines whether or not a predetermined amount of coins has been inserted based on a signal supplied from the coin processing unit 221 and is inserted. Wait until it is determined.

  If it is determined in step S1 that a coin has been inserted, in step S2, the photographing processing unit 301 controls the photographing unit 208 to display a moving image of the subject captured by the camera 91 on the touch panel monitor 93 for live view. A photographing process is performed for photographing a user in the space A1 as a subject. The photographing process will be described later with reference to the flowcharts of FIGS. 19 and 20.

  In step S3, the imaging processing unit 301 guides the user in the imaging space A1 to move to the editing space A2-1 or the editing space A2-2. The guidance for movement to the editing space A2-1 or the editing space A2-2 is performed by displaying a screen on the touch panel monitor 93 of the photographing unit 208 or by outputting sound from the speaker 223.

  In step S4, the editing processing unit 302 selects the editing space (hereinafter referred to as the moving destination editing space) which is the moving destination of the user who has finished the photographing process, among the editing space A2-1 and the editing space A2-2. The editing unit 209 corresponding to is controlled to perform editing processing. Specifically, the editing processing unit 302 causes the user to select a synthesis image to be synthesized with the photographed image, synthesizes the selected composition image with the photographed image, and performs a user operation on the obtained synthesized image. Edit according to the editing operation. The editing process will be described later with reference to the flowchart of FIG.

  In step S5, the editing processing unit 302 guides the user who has finished the editing process in the editing space A2-1 or the editing space A2-2 to move to the post-service space A3. The guidance of the movement to the post-service space A3 is performed by displaying a screen on the tablet built-in monitor 131 or by outputting sound from the speaker 231.

  In step S <b> 6, the print processing unit 303 performs a printing process in which the edited image obtained by the editing process is output to the printer 241 and printed on a sticker sheet.

  In step S <b> 7, the subsequent customer service processing unit 304 controls the subsequent customer service unit 210 to perform the subsequent customer service process for a user who is waiting for printing completion. Specifically, the post-service processing unit 304 performs a mobile transmission game process for transmitting a captured image or an edited image to the mobile terminal as the post-service processing, and directly inputs the e-mail address of the mobile terminal. Display on the tablet built-in monitor 161 a selection screen for a transmission method that allows a user to select whether to transmit an image to a portable terminal by transmitting to a portable terminal or by communicating with a non-contact type IC. The image is transmitted according to the operation by the user.

  When the printing is completed, in step S8, the post-service processing unit 304 displays that the printing is completed on the tablet built-in monitor 161, and the printer 241 discharges the sticker paper on which the image is printed to the sticker paper discharge port 164. The process is terminated.

[Example of shooting process]
Next, an example of the flow of the photographing process in step S2 in the series of processes of the above-described photo sticker creation game will be described with reference to the flowcharts of FIGS.

  In step S31, the shooting parameter setting unit 312 displays a shooting selection screen on the touch panel monitor 93 and accepts shooting selection by the user. The image selection is selection of image quality such as hue and sharpness. The shooting parameter setting unit 312 adjusts the image quality of the image shot by the camera 91 according to the image selected by the user.

  In step S <b> 32, the progress control unit 311 displays a shooting method guidance screen on the touch panel monitor 93. Specifically, a guidance screen for performing lower camera up shooting for shooting the user's face or upper body from the front front is displayed. That is, at this time, the camera 91 is in a lower camera state. After displaying the guidance screen, the captured image acquisition unit 314 controls the camera 91 to start capturing an image.

  In step S33, the live view display control unit 313 displays the moving image (live view image) captured by the camera 91 on the touch panel monitor 93 (performs live view display).

  In step S34, the captured image acquisition unit 314 displays a countdown indicator on the touch panel monitor 93, and notifies the user of the capturing timing.

  When the shooting timing comes, in step S35, the captured image acquisition unit 314 controls the camera 91 to perform lower camera up shooting, and acquires a captured image that is a still image (lower camera up captured image).

  In step S <b> 36, the progress control unit 311 displays the captured image on the touch panel monitor 93 and allows the user to check the captured result.

  FIG. 21 shows an example of a live view display screen displayed on the touch panel monitor 93 during lower camera up shooting. The live view display screen of FIG. 21 includes a live view display area 411 that displays a live view image of the camera 91, and shooting result display areas 412-1 to 412-6 that display shot images obtained as a result of shooting. Has been. In the live view display screen of FIG. 21, when the number indicated by a countdown indicator (not shown) becomes 0, the live view image displayed in the live view display area 411 is obtained as the lower camera up photographed image. The obtained lower camera-up shot images are displayed in predetermined areas (specifically, the shooting result display areas 412-1 to 412-3) in the shooting result display areas 412-1 to 412-6 in the order of shooting. It will be displayed.

  Returning to the flowchart of FIG. 19, after step S <b> 36, in step S <b> 37, the progress control unit 311 determines whether or not shooting has been repeated a predetermined number of times. If it is determined in step S37 that shooting has not been performed a predetermined number of times, the process returns to step S33, and the above-described process is repeated. Specifically, the above-described processing is repeated until the lower camera up shooting is performed three times.

  On the other hand, if it is determined in step S37 that the lower camera up shooting has been repeated three times, the process proceeds to step S38, and the camera drive control unit 316 drives the camera 91 so as to move the camera 91 upward. To control. As a result, the camera 91 is brought into the upper camera state.

  In step S <b> 39, the progress control unit 311 displays a shooting method guidance screen on the touch panel monitor 93. Specifically, a guidance screen for performing upper camera-up shooting for shooting the user's face or upper body from diagonally forward is displayed. After displaying the guidance screen, the captured image acquisition unit 314 controls the camera 91 to start capturing an image.

  As described above, in the state of the upper camera, the focus of the camera 91 is adjusted so as to zoom out, but here, the digital zoom function is used to electrically change the magnification of the captured image, thereby Take a camera-up shot. Further, the focus of the camera 91 may be adjusted by the camera drive control unit 316 in accordance with the shooting method, in addition to being adjusted by the mechanism described with reference to FIG.

  In step S40, the live view display control unit 313 displays the moving image (live view image) captured by the camera 91 on the touch panel monitor 93 (performs live view display).

  In step S41, the captured image acquisition unit 314 displays a countdown indicator on the touch panel monitor 93 and notifies the user of the capturing timing.

  When the shooting timing comes, in step S42, the captured image acquisition unit 314 controls the camera 91 to perform upper camera up shooting and acquires a captured image (upper camera up captured image) that is a still image.

  In step S43, the progress control unit 311 displays the captured image on the touch panel monitor 93, and allows the user to check the captured result.

  FIG. 22 shows an example of a live view display screen displayed on the touch panel monitor 93 during upper camera up shooting. In the live view display screen of FIG. 22, when the number indicated by a countdown indicator (not shown) becomes 0, the live view image displayed in the live view display area 411 is obtained as the upper camera up photographed image. The upper camera up shooting is performed only once. Since the lower camera up photographed image is displayed in the photographing result display areas 412-1 to 412-3, the obtained upper camera up photographed image is displayed in the photographing result display area 412-4. .

  Returning to the flowchart of FIG. 19, after step S <b> 43, in step S <b> 44 of FIG. 20, the progress control unit 311 causes the touch panel monitor 93 to display a shooting method guidance screen. Specifically, a guidance screen is displayed to the effect that the upper camera whole body photographing is performed to photograph the whole body of the user from diagonally forward. After displaying the guidance screen, the captured image acquisition unit 314 controls the camera 91 to start capturing an image.

  FIG. 23 shows an example of an upper camera whole body photographing guidance screen displayed on the touch panel monitor 93. On the guidance screen of FIG. 23, a wording that the whole body photographing is performed and a word that prompts the user to stand in accordance with a foot mark that is a foot mark displayed on the touch panel monitor 93 are displayed. That is, on the touch panel monitor 93 (FIG. 24), a foot mark indicating the optimal standing position for performing the upper camera whole body photographing is displayed together with the live view image, and the user stands according to the foot mark, A suitable upper camera whole body photographed image is obtained.

  Then, in step S45, a moving image (live view image) captured by the camera 91 is displayed, and an upper camera whole body photographing process is performed in which the upper camera whole body photographing is performed at a predetermined photographing timing. The upper camera whole body imaging process will be described later with reference to the flowchart of FIG.

  FIG. 24 shows an example of a live view display screen displayed on the touch panel monitor 93 at the time of upper camera whole body photography. In the live view display screen of FIG. 24, when the number indicated by a countdown indicator (not shown) becomes 0, the live view image displayed in the live view display area 411 is obtained as the upper camera whole body captured image. The lower camera up shot image is displayed in the shooting result display areas 412-1 to 412-3, and the upper camera up shot image is displayed in the shooting result display area 412-4. The whole-body captured image is displayed in the imaging result display area 412-5.

  In the touch panel monitor 93 shown in FIG. 24, a foot mark is displayed outside the live view display area 411 (below the live view display area 411), but the live view displayed in the live view display area 411 is displayed. A foot mark may be displayed in the view image. Further, the foot mark may not be displayed on the touch panel monitor 93, but may be written in advance on the surface of the floor 104 (chroma key sheet 121C) so that the user can stand on the foot mark.

  Returning to the flowchart of FIG. 20, in step S <b> 46, the progress control unit 311 determines based on the elapsed time or the remaining time whether or not it is within the shootable time. If it is determined in step S46 that the time is within the available shooting time, additional shooting, so-called “bonus shooting” is performed.

  In step S <b> 47, the progress control unit 311 displays a bonus shooting guidance screen on the touch panel monitor 93. After displaying the guidance screen, the captured image acquisition unit 314 controls the camera 91 to start capturing an image.

  In step S48, the live view display control unit 313 displays the moving image (live view image) captured by the camera 91 on the touch panel monitor 93 (performs live view display).

  In step S49, the captured image acquisition unit 314 displays a countdown indicator on the touch panel monitor 93 and notifies the user of the capturing timing.

  When the shooting timing comes, in step S50, the captured image acquisition unit 314 controls the camera 91 to perform bonus shooting, and acquires a captured image (bonus captured image) that is a still image.

  In the bonus shooting process, since the camera 91 is in the upper camera state, either the upper camera up shooting or the upper camera whole body shooting is performed. Hereinafter, a case where upper camera whole body photographing is performed in the bonus photographing processing will be described as an example.

  In step S51, the progress control unit 311 displays the captured image on the touch panel monitor 93, and allows the user to check the captured result. At this time, the obtained bonus photographed image is displayed in the photographing result display area 412-6 shown in FIG. 21, FIG. 22, or FIG. Thereafter, the process proceeds to step S52.

  On the other hand, if it is determined in step S46 that the time is not within the shootable time, steps S47 to S51 are skipped, bonus shooting is not performed, and the process proceeds to step S52.

  Therefore, for example, when a predetermined time (for example, 300 seconds) has elapsed since the insertion of one coin, bonus shooting is not performed for a user who is taking a long time due to re-dressing or the like. For this reason, most users will shoot faster so that bonus shooting can be performed.

  Hereinafter, a case where bonus shooting is performed is referred to as normal shooting, and a case where bonus shooting is not performed is referred to as penalty shooting. Hereinafter, the captured images obtained until the bonus shooting is completed are collectively referred to as a standard captured image. Therefore, when normal shooting is performed, six standard captured images are obtained, and when penalty shooting is performed, five standard captured images are obtained. As will be described later, the standard captured image is an object to be printed on the sticker sheet.

  In step S52, the face recognition unit 321 determines whether the number of photographers is one or two. Specifically, the face recognition unit 321 performs face recognition processing on each of the five or six photographed images obtained up to now, and detects the number of photographers in each photographed image. Note that any method can be employed for the face recognition processing.

  The face recognition unit 321 determines that the number of photographed persons is one or two when the number of photographed persons is four or more, and the process proceeds to step S53.

  In step S53, a cross combination photographing process is executed. By this process, a cross combination image obtained by combining the whole body image and the up image near the face is obtained for each user as an image for transmission to the mobile terminal. The cross combination photographing process will be described later with reference to the flowchart of FIG.

  When the process of step S53 ends, the shooting process ends, and the process returns to step S2 of FIG.

  On the other hand, in step S52, the face recognition unit 321 determines that the number of photographed persons is not one or two when the number of photographed persons is less than four. Thereafter, the process in step S53 is skipped, the photographing process is terminated, and the process returns to step S2 in FIG.

[Upper camera whole body photographing process 1]
Next, with reference to the flowchart of FIG. 25, the details of the upper camera whole body imaging process in step S45 of FIG.

  In step S <b> 111, the chroma key processing unit 317 extracts a background area of a moving image (live view image) captured by the camera 91.

  FIG. 26 shows an example of a live view image captured by the camera 91. In the live view image 501 of FIG. 26, together with two subjects, the back panel 51, the side panel 52B, and the chroma key sheets 121A and 121B attached to the surface of the floor 104 that constitute the imaging space A1. , 121C are displayed.

  Here, if the chroma key sheets 121A, 121B, and 121C are made of different materials, the colors (appearance) of the chroma key sheets 121A, 121B, and 121C in the live view image 501 are also different.

  Therefore, the chroma key processing unit 317 has values indicating the colors of the three surfaces of the back surface, the side surface, and the floor surface (that is, the chroma key sheets 121A, 121B, and 121C) as the background region of the live view image 501. By detecting the range (color range), the chroma key parameter for each of the back surface, the side surface, and the floor surface is set.

  Specifically, in the live view image 501 (subject is omitted) shown in FIG. 27, the color range is detected based on the color value of the brightest region RmaxA and the color value of the darkest region RminA in the chroma key sheet 121A. Thus, the chroma key parameter of the chroma key sheet 121A is set. Similarly, by detecting the color range based on the color value of the brightest region RmaxB and the color value of the darkest region RminB in the chroma key sheet 121B, the chroma key parameter of the chroma key sheet 121B is set, and the chroma key By detecting the color range based on the color value of the brightest region RmaxC and the color value of the darkest region RminC in the sheet 121C, the chroma key parameter of the chroma key sheet 121C is set.

  Then, the chroma key processing unit 317 extracts a background region (back surface, side surface, and floor surface) from the live view image 501 using the chroma key parameters for each of the three surfaces.

  In step S <b> 112, the corner point detection unit 318 detects a corner point based on a boundary of values (color values) indicating the color of the background area of the live view image captured by the camera 91.

  As described above, since the colors of the chroma key sheets 121A, 121B, and 121C in the live view image 501 are different from each other in FIG. By detecting the range and obtaining the boundary of each color value, a corner point CP where the three surfaces of the back surface, the side surface, and the floor surface of the imaging space A1 intersect is detected.

  In step S113, the progress control unit 311 determines whether the corner point detection unit 318 has detected a corner point. If it is determined in step S113 that no corner point is detected, the process returns to step S112, and the process is repeated until a corner point is detected. If it is determined that a corner point has not been detected, an error message may be displayed on the touch panel monitor 93. At this time, the color range used to obtain the boundary between the color values may be changed (redetected).

  On the other hand, if it is determined in step S113 that a corner point has been detected, the process proceeds to step S114, and the corner image generation unit 319 displays the rear, side, and floor surfaces of the shooting space as shown in FIG. A corner image 521 is generated in which corner lines 522A, 522B, and 522C resembling the intersecting line where two of the surfaces intersect are drawn. In the corner image 521, the color of each surface corresponding to the back surface, the side surface, and the floor surface of the shooting space is, for example, white close to gray. The corner image 521 is a background image imitating a corner of the room.

  In step S115, the live view display control unit 313 displays the live view image captured by the camera 91 on the touch panel monitor 93 (performs live view display). Here, a live view image on which chroma key sheets 121A, 121B, and 121C are displayed is displayed together with two subjects as shown in FIG.

  In step S116, the captured image acquisition unit 314 displays a countdown indicator on the touch panel monitor 93 and notifies the user of the capturing timing.

  Here, the processes of steps S111 to S114 and the processes of steps S115 and S116 may be executed in parallel.

  When the shooting timing comes, in step S117, the captured image acquisition unit 314 controls the camera 91 to perform shooting, and the captured image (upper camera) is captured at that timing and is a still image with the background area extracted. A whole body image is acquired.

  In step S118, the composition processing unit 320 intersects the corner points CP detected by the corner point detection unit 318 in the upper camera whole body captured image and the corner lines 522A to 522C of the corner image 521 generated by the corner image generation unit 319. The corner image 521 is synthesized with the upper camera whole body photographed image from which the background region is extracted.

  In step S119, the progress control unit 311 displays the captured image on the touch panel monitor 93, and allows the user to check the captured result.

  According to the above processing, it is possible to obtain the upper camera whole body photographed image 541 shown in FIG. 29 from the head to the toe of the subject. The upper camera whole-body image 541 in FIG. 29 is a whole-body image with the face emphasized, taken obliquely from the front in front of the subject, and the boundary between the back surface, the side surface, and the floor is clearly shown. The image is suitable as an uploaded coordinate image. In this way, it is possible to provide a coordinated image that is more satisfactory for the user.

  Furthermore, since the floor 104 is inclined in the photographing space A1, a coordinate image that makes the legs look longer can be obtained. Furthermore, in the coordinated image, the inclination of the floor 104 can prevent the face from appearing larger than necessary, and it can be avoided that the face looks more than necessary. Will be obtained.

  In step S115, a live view image obtained by combining a corner image with a live view image from which background regions (back, side, and floor) are extracted may be displayed. As a result, the user can perform a shooting operation while imagining an upper camera whole body captured image actually obtained.

  In addition, when a corner image is synthesized with a live view image from which a background area has been extracted, not a corner point detected by the corner point detection unit 318 but an intersection of a preset corner point and a line segment of the corner image You may make it synthesize | combine so that may match. As a result, the corner image can be easily synthesized at an appropriate position with respect to the photographed image obtained by extracting the three surfaces of the back surface, the side surface, and the floor surface by the chroma key process, and as a coordinate image uploaded to the blog A suitable image can be obtained.

  Further, in the corner image, the corner line does not need to be drawn corresponding to the position and angle corresponding to the intersecting line where the back surface, the side surface, and the floor surface of the actual photographing space intersect. The color of each surface corresponding to the back surface, the side surface, and the floor surface of the space is not limited to the above-described color (white color close to gray), and may further be decorated with a corner of the room.

  Further, a plurality of types of corner images may be prepared in advance and may be selected by the user. As a result, it is possible to provide a coordinate image that better matches the user's preference.

[Upper camera whole body photographing process 2]
Next, another example of the upper camera whole body imaging process will be described with reference to the flowchart of FIG.

  Note that the processing in steps S215 to S219 in the flowchart in FIG. 30 is basically the same as the processing in steps S115 to S119 in the flowchart in FIG.

  In step S <b> 211, the chroma key processing unit 317 extracts the background area of the moving image (live view image) captured by the camera 91.

  Specifically, the chroma key processing unit 317 calculates the color ranges of all three surfaces of the back surface, the side surface, and the floor surface (that is, the chroma key sheets 121A, 121B, and 121C) as the background region of the live view image. By detecting, one chroma key parameter is set.

  That is, in the live view image 501 (subject is omitted) shown in FIG. 31, the color range is based on the color value of the brightest region Rmax and the color value of the darkest region Rmin in the chroma key sheets 121A, 121B, and 121C. When detected, the chroma key parameters of the chroma key sheets 121A, 121B, and 121C are set.

  Then, the chroma key processing unit 317 extracts a background area (back surface, side surface, and floor surface) from the live view image using the chroma key parameter.

  In step S212, the corner point detection unit 318 detects a corner point based on the color value of the background area of the live view image captured by the camera 91 and a predetermined threshold value.

  Here, in the shooting space, the intersection (the part corresponding to the corner point) where the three surfaces of the back, side, and floor intersect, and the intersection (the corner line) where two of the back, side, and floor intersect. In the vicinity of the corresponding part), the light from the strobe as the lighting device is difficult to reach and tends to be a shadow. Therefore, in the chroma key sheets 121A, 121B, and 121C of the live view image, the color in the vicinity of the portion corresponding to the corner point and the portion corresponding to the corner line is dark green.

  Accordingly, the corner point detection unit 318 includes a color value included in a predetermined color value range (a range of dark green color values) among the color values of the chroma key sheets 121A, 121B, and 121C in the live view image. By specifying the portion (pixel position) corresponding to, the corner point CP at which the three surfaces of the back surface, the side surface, and the floor surface of the imaging space A1 intersect is detected. For example, in the portion corresponding to the color value included in the range of color values that are dark green, the portion of the color value that is darkest green is detected as the corner point CP.

  In addition, in the part corresponding to the color value included in the color value range that is dark green, the corner point CP is detected (set) by detecting the part corresponding to the corner line and approximating the part with a straight line. You may make it do.

  At this time, the illumination control unit 315 controls the light emission of each strobe in the photographing space A1 so that the corner point detection unit 318 can detect the corner point CP (so that it can be easily detected). Also good. For example, the illumination control unit 315 suppresses the amount of light emitted from the lower strobe 85 or the foot strobe 86 so as to weaken the light emitted from the upper side to the lower side of the background region, or prevents the strobe from emitting light. The light emission can be controlled.

  In step S213, the progress control unit 311 determines whether the corner point detection unit 318 has detected a corner point. If it is determined in step S213 that a corner point has not been detected, the process returns to step S212, and the process is repeated until a corner point is detected. Here again, if it is determined that a corner point has not been detected, an error message may be displayed on the touch panel monitor 93. At this time, a threshold value (color value range) used for corner point detection may be changed.

  On the other hand, if it is determined in step S213 that a corner point has been detected, the process proceeds to step S214, and the corner image generation unit 319 generates a corner image using the color value of the background area. Specifically, the corner image generation unit 319, based on the color values included in the above-described dark green color value range among the color values of the chroma key sheets 121A, 121B, and 121C, for example, A pixel position is determined, and a corner image including a corner line according to the result is generated. At this time, the corner image generation unit 319 performs a process of applying a shadow corresponding to the color value of the corresponding part of the live view image to the part near the corner line in the corner image. As a result, it is possible to generate a realistic corner image that reproduces the shadow generated in the actual shooting space. Note that as a process for applying a shadow, a blurring process centering on a corner line in a corner image may be performed.

  As described above, the upper camera whole-body imaging process in FIG. 30 can achieve the same effects as the upper camera whole-body imaging process in FIG.

  Furthermore, since a realistic corner image is combined with the obtained upper-camera whole-body photographed image, it is possible to provide a coordinated image that is more satisfactory for the user.

  In step S215, a live view image obtained by synthesizing a corner image with a live view image from which background regions (back, side, and floor) are extracted may be displayed. As a result, the user can perform a shooting operation while imagining an upper camera whole body captured image actually obtained.

  By the way, in the above-mentioned upper camera whole-body photographed image, it is desirable that there is a corner point at a specific position in the image, so that a well-balanced upper camera whole-body photographed image can be obtained.

  However, it is conceivable that the detected corner point may deviate from a desired position due to a displacement of the mounting position of the camera 91, distortion of the photographing unit 21 and the background unit 22 constituting the photographing space A1, or the like.

  Therefore, in the following, a process for adjusting a corner point when the detected corner point is deviated from a desired position will be described.

[Corner point adjustment processing]
FIG. 32 is a flowchart for explaining corner point adjustment processing for adjusting a corner point when the detected corner point is shifted from a desired position. The corner point adjustment process of FIG. 32 may be executed before the upper camera whole body imaging process is executed in the imaging process, or by operating a maintenance button provided at a predetermined location of the photo sticker creating apparatus 1. The operation may be executed when the operation mode of the photo sticker creating apparatus 1 shifts to the maintenance mode.

  Note that the corner point adjustment processing in FIG. 32 is executed with the camera 91 in the upper camera state.

  Also, the processing of steps S311 to S313 in the flowchart of FIG. 32 may be performed by executing either the processing of steps S111 to S113 of the flowchart of FIG. 25 or the processing of steps S211 to S213 of the flowchart of FIG. Here, the description is omitted.

  That is, in step S314, the live view display control unit 313 displays the live view image captured by the camera 91 on the touch panel monitor 93 (performs live view display). At this time, as shown in FIG. 33, the live view image 601 includes chroma key sheets 121A, 121B, and 121C, detected corner points CP, and a set point CP0 indicating the position of the corner point to be set. Is displayed.

  In step S315, the live view display control unit 313 determines whether or not the detected corner point CP is displaced from the set point CP0 by a predetermined distance or more.

  If it is determined in step S315 that the corner point CP is deviated from the set point CP0, the process proceeds to step S316, and the live view display control unit 313 displays a display that prompts the user to move the live view image 601, for example, “corner” Please display a message such as “Please adjust the point”. At this time, the user can move the live view image (corner point CP) by touching (dragging) the live view image displayed in the live view display area of the touch panel monitor 93 with a finger or the like.

  As shown in FIG. 34, the live view image (corner point CP) may be moved by displaying an operation button 611 on the live view image 601 and causing the user to operate it.

  On the other hand, if it is determined in step S315 that the corner point CP is not deviated from the set point CP0, the process ends.

  According to the above processing, when the detected corner point is deviated from a desired position, the corner point can be adjusted.

  Note that the setting point CP0 displayed in step S315 may be set to a desired position by the operation of the user (operator).

  In the above description, the chroma key sheets 121A, 121B, and 121C are attached to the back surface, the side surface, and the floor surface of the shooting space A1 as the background region of the live view image (captured image). In addition, the chroma key sheets 121A, 121B, and 121C may not be attached to the vicinity of the intersection line where two of the floor surfaces intersect.

  Further, when the chroma key sheets 121A, 121B, and 121C are not affixed in the vicinity of the intersection line where two of the back surface, the side surface, and the floor surface of the imaging space A1 intersect, the portion where the chroma key sheet is affixed The boundary between the part and the part not attached is also subject to chroma key processing. Specifically, a boundary between a portion where the chroma key sheet 121A is affixed and a portion where the chroma key sheet 121A is affixed on the back panel 51, a portion where the chroma key sheet 121B is affixed and a portion where the chroma key sheet 121B is affixed on the side panel 52B, The chroma key processing may be executed in a color range that includes the boundary between the portion where the chroma key sheet 121C is affixed and the portion where the chroma key sheet 121C is not affixed on the surface of the floor 104. In addition, the color of the portion where the chroma key sheet is not attached on the back surface, the side surface, and the floor surface of the photographing space A1 is the color of each surface of the corner image combined with the photographed image (for example, white near gray). .

  As a result, a portion corresponding to a corner point or corner line (actual corner portion) remains without being extracted from the captured image, so that a more realistic background is reproduced in the captured image, and the captured image is more suitable for the coordinate image. Can be obtained.

  Further, in the above-described upper camera whole body photographing process, the process for detecting the corner point is performed on the live view image, but the provisional photographing is performed at the start of the upper camera whole body photographing process. You may make it detect a corner point with respect to a temporary picked-up image.

  Furthermore, as the upper camera whole body imaging process, the upper camera whole body imaging process described with reference to the flowchart of FIG. 25 and the upper camera whole body imaging process described with reference to FIG. 30 may be selectively performed. . For example, when a background image other than a corner image is synthesized, and the arrangement of the synthesized background image does not match the positions of the back, side, and floor of the actual shooting space, the top of FIG. When the entire camera photographing process is executed and the arrangement of the background image to be synthesized matches the positions of the back, side and floor of the actual photographing space, the upper camera whole body photographing process of FIG. 25 is executed. To be.

  Further, in the above description, as a corner point, an intersection where the rear panel 51, the right side panel 52B, and the floor 104 intersect in the imaging space A1 is detected. You may make it detect the intersection which 3A of side panel 52A of this and the floor 104 cross.

  By the way, most of the photos published in fashion magazines were taken in a photo studio with a certain size that imitated a corner of the room, and the finish has a sense of depth.

On the other hand, the shooting space A1 of the photo sticker creating apparatus 1 according to the present invention is never a wide space, and the distance between the shooting / display unit 81 including the camera 91 and the subject 111 is shown in FIG. Is 700 mm at the closest distance and 1000 mm at the farthest distance.
Usually, in such a photograph (photographed image) photographed in a photographing space where the distance between the camera and the subject is close, it is difficult to make the subject and the background light and dark, and the finish without a sense of depth.

  Therefore, in the photo sticker creating apparatus 1 of the present invention, as described above, the corner image imitating a corner of the room is synthesized with the image obtained by extracting the background region, so that the finish of the obtained captured image is set to the depth. It can be a feeling. Furthermore, in the process described with reference to the flowchart of FIG. 30, a corner image that reproduces a shadow generated in the actual shooting space is generated, so that a more natural sense of depth is reproduced in the obtained shot image. Will be able to.

  In the above, the intersection of the three surfaces of the back surface, the side surface, and the floor surface of the photographing space A1 is detected as a corner point. However, the intersection of three or more surfaces is detected according to the shape of the photographing space A1. You may make it do. For example, when the shooting space A1 has a structure that forms a regular octahedron, an intersection where four faces of an equilateral triangle intersect may be detected as a corner point.

[Cross combination shooting process 1]
Next, with reference to the flowchart of FIG. 36, the detail of the cross combination imaging | photography process of FIG.20 S53 is demonstrated.

  In step S <b> 201, the progress control unit 311 displays a shooting method guidance screen on the touch panel monitor 93. Specifically, there is a guidance screen for performing cross-combination shooting, in which two people simultaneously shoot the entire body and the vicinity of the face, and generate a cross-combination image that combines the whole body image and the close-up image of the face for each user. Is displayed on the touch panel monitor 93. After displaying the guidance screen, the captured image acquisition unit 314 controls the camera 91 to start capturing an image.

  In step S202, the live view display control unit 313 displays the moving image (live view image) captured by the camera 91 on the touch panel monitor 93 (performs live view display).

  FIG. 37 schematically shows an example of a live view display screen displayed on the touch panel monitor 93 at this time. In this case, each of the subject portions is trimmed with respect to the captured image 701 of the camera 91 shown on the left side of FIG. 37 in which two subjects are shown. On the live view display screen shown on the right side of FIG. 37, live view display areas 702L and 702R for individually displaying live images of the subjects trimmed from the captured image 701 of the camera 91 are displayed. That is, the left subject image trimmed from the captured image 701 is displayed in the live view display area 702L, and the right subject image trimmed from the captured image 701 is displayed in the live view display area 702R. .

  Then, the user adjusts the standing position, posture, and the like according to the guidance displayed at the bottom of the live view display screen so that each whole body enters the live view display areas 702L and 702R.

  By the way, in the captured image 701, when two subjects overlap, if each subject is trimmed, a part of the body such as each other's arm enters each trimmed image.

  Therefore, as shown in FIG. 38, in the captured image 701, an area 701a at the center with respect to the left-right direction is set as a non-photographing area where the subject is not photographed, and a warning sound is generated when the subject enters the area 701a. Etc. may be sounded.

  This prevents two subjects from overlapping each other in the captured image 701, so that each subject is reliably trimmed from the captured image 701.

  In this case, instead of the live view display screen of FIG. 37, an image obtained by masking the area 701a of the captured image 701 of FIG. 38 may be displayed as it is on the live view display screen.

  Also, as shown in FIG. 39A, in the captured image 701, when there is a large difference in height between two subjects, if they are trimmed in the same way, a wasteful area is generated in the trimmed image of the subject with a short height. An imbalanced photographed image is obtained.

  Therefore, as shown in FIG. 39B, in the captured image 701, for example, a trimming frame corresponding to the height of each subject is set based on the result of human recognition, and trimming is performed according to the trimming frame. Good. As a result, a well-balanced captured image can be obtained without generating a useless area in an image obtained by trimming each subject.

  Returning to the flowchart of FIG. 36, in step S203, the photographed image acquisition unit 314 displays a countdown indicator on the touch panel monitor 93 to notify the user of the photographing timing.

  In step S204, the imaging processing unit 301 performs upper camera whole body imaging. That is, imaging similar to that described above with reference to FIG. 25 or FIG. 30 is performed, and an upper camera whole body captured image is acquired.

  In step S205, the live view display control unit 313 displays the moving image (live view image) captured by the camera 91 on the touch panel monitor 93 (performs live view display).

  FIG. 40 shows an example of a live view display screen displayed on the touch panel monitor 93 at this time. In this case, a portion near the face of the subject is trimmed with respect to the captured image 721 of the camera 91 shown on the left side of FIG. 40 in which two subjects are shown. On the live view display screen shown on the right side of FIG. 40, live view display areas 722L and 722R for individually displaying live view images of each subject near the face trimmed from the captured image 721 of the camera 91 are displayed. That is, the live view display area 722L displays an image near the face of the left subject trimmed from the captured image 721, and the live view display area 722R displays the vicinity of the face of the right subject trimmed from the captured image 721. Is displayed.

  Then, the user adjusts the standing position, the posture, and the like according to the guidance displayed at the bottom of the live view display screen so that each face enters the live view display areas 722L and 722R well.

  As in the case described above with reference to FIG. 38, in the captured image 721, the central area in the left-right direction is set as a non-photographing area where the subject is not photographed, and the subject enters the non-photographing area. A warning sound or the like may be sounded. Further, an image obtained by masking the non-photographing area of the captured image 721 may be displayed as it is on the live view display screen.

  Also, for example, each user's face recognition is performed at the time of live view display at step S202 and step S205, and at the time of live view display at step S205, the recognition result of the left and right user faces is different from that at step S202. In such a case, a notification to that effect may be made. As a case where this notification is performed, for example, the left and right positions of the user are switched, one or two users are replaced with another person, or the number of users in the shooting space A1 is increased or decreased. Or the like.

  Further, when it is determined in step S52 in FIG. 20 that the number of photographers is one, in the live view display screen in FIG. 37 and the live view display screen in FIG. It is possible to omit photographing of the subject in the area. Alternatively, for example, in the live view display screen of FIG. 37, the display of the live view display area is not omitted, and in the live view display screen of FIG. 40, the presence of the user is recognized on the live view display screen of FIG. The display of the live view display area on the side different from the direction and the photographing of the subject in the area may be omitted.

  Returning to the flowchart of FIG. 36, in step S206, the captured image acquisition unit 314 displays a countdown indicator on the touch panel monitor 93 to notify the user of the capturing timing.

  In step S207, similar to the process in step S42 of FIG. 19, the upper camera up shooting is performed, and the upper camera up shooting image is acquired.

  In step S208, the composition processing unit 320 generates a cross combination image. Specifically, the composition processing unit 320 individually trims (extracts) the whole body image of each subject from the upper camera whole body captured image acquired in the process of step S204. In addition, the composition processing unit 320 individually trims (extracts) an image near the face of each subject from the upper camera-up captured image acquired in the process of step S207. Then, the synthesis processing unit 320 generates a cross combination image by synthesizing the extracted whole body image and the up image with a predetermined image for synthesis for each user. Thereby, a plurality of composite images (cross combination images) in which the same user's whole body and face up are combined are generated for each user.

  In step S209, the progress control unit 311 displays the cross combination image on the touch panel monitor 93, and allows the user to check the photographing result.

  FIG. 41 shows a display example of a cross combination image confirmation screen displayed on the touch panel monitor 93 at this time. The confirmation screen shown in FIG. 41 includes shooting result display areas 741L and 741R in which a cross combination image is displayed.

  In the cross combination image displayed in the imaging result display area 741L, the whole body image of the subject on the left side of the upper camera whole body captured image acquired in the process of step S204 is arranged on the left side, and the upper camera up acquired in the process of step S207 is displayed. An up image near the face of the subject on the left side of the photographed image is arranged on the upper right. In addition, a predetermined image for synthesis is synthesized on the background of the whole body image and the up image, and on the lower right of the cross combination image.

  Similarly, in the cross combination image displayed in the imaging result display area 741R, the whole body image of the subject on the right side of the upper camera whole body captured image acquired in the process of step S204 is arranged on the left side, and acquired in the process of step S207. An up image near the face of the subject on the right side of the upper camera up shot image is arranged on the upper right. In addition, a predetermined image for synthesis is synthesized on the background of the whole body image and the up image, and on the lower right of the cross combination image.

  These cross-combination images are transmitted to the user's mobile terminal in the above-described post-service process in step S7 of FIG.

  Note that the cross combination image is suitable for an image posted on a fashion coordination posting site, for example. That is, the whole body fashion can be confirmed in detail by the whole body image, and the face of the subject can be confirmed in detail by the up image. In addition, since the whole body image and the up image are shot separately, it is possible to shoot separately the image for capturing the fashion and the image for capturing the facial expression. Can be obtained.

  In addition, cross-combination images are grouped for each user, so you can post them on your own site such as a blog or SNS (Social Networking Service) without considering the portrait rights or privacy of others. can do.

  In addition, even though two users have taken pictures at the same time, each user is provided with a different image from the one in which the whole body image and the up image are combined. It can be given and user satisfaction is improved.

[Cross combination shooting process 2]
Next, another example of the cross combination photographing process will be described with reference to the flowchart of FIG.

  Note that the processing in steps S251 to S254 in the flowchart in FIG. 42 is basically the same as the processing in steps S201 to S204 in the flowchart in FIG. Also, the processing of steps S257 to S259 in the flowchart of FIG. 42 is basically the same as the processing of steps S205 to S207 in the flowchart of FIG.

  In step S255, the composition processing unit 320 synthesizes the whole body image. Specifically, the composition processing unit 320 individually trims (extracts) the whole body image of each subject from the upper camera whole body captured image acquired in the process of step S254. Then, the synthesis processing unit 320 synthesizes the extracted whole body image into a predetermined synthesis image for each user. Thereby, a plurality of images showing only the whole body of the user are generated for each user.

  In step S256, the progress control unit 311 displays a confirmation screen of the progress of the cross combination image on the touch panel monitor 93, and allows the user to confirm the generation process of the cross combination image.

  FIG. 43 shows a display example of a confirmation screen displayed on the touch panel monitor 93 at this time. The confirmation screen shown in FIG. 43 includes imaging result display areas 761L and 761R in which a cross combination image being generated is displayed.

  The cross combination image displayed in the imaging result display area 761L is an image obtained by removing the upper right up image from the cross combination image displayed in the imaging result display area 741L of FIG. Similarly, the cross combination image displayed in the shooting result display area 761R is an image obtained by removing the upper right up image from the cross combination image displayed in the shooting result display area 741R of FIG.

  Thereafter, after the processing of steps S257 to S259 is performed, in step S260, the composition processing unit 320 composes the up image. Specifically, the composition processing unit 320 individually trims (extracts) an image near the face of each subject from the upper camera-up captured image acquired in step S259. Then, the synthesis processing unit 320 completes the cross combination image by synthesizing an up image near the face of the same user as the whole body image with each cross combination image generated in the process of step S255.

  It should be noted that any method can be employed to determine whether the whole body image and the up image belong to the same person. For example, when a predetermined feature amount is extracted from an image near the face and an up-image of the whole body image, and the difference between the extracted feature amounts is equal to or less than a predetermined threshold value, it is possible to determine that they are the same person.

  In step S261, the same processing as step S209 in FIG. 36 is performed, and for example, the above-described confirmation screen shown in FIG. 41 is displayed on the touch panel monitor 93.

  In this way, each time a captured image is captured, the image of each user is trimmed (extracted) from the captured image, and the extracted images are combined with the corresponding cross combination images, whereby each cross combination. The image is updated. Each time the cross combination image is updated, each updated cross combination image is displayed on the touch panel monitor 93. Therefore, the user can check the process in which the images are combined in the order of the whole body image and the up image while performing cross combination shooting.

[Edit processing]
Next, details of the editing process in step S4 in FIG. 18 will be described with reference to the flowchart in FIG.

  In step S <b> 301, the progress processing unit 351 controls the editing unit 209 of the editing space (moving destination editing space) of the movement destination of the user who has finished the photographing process, and displays the start screen on the tablet built-in monitor 131. Specifically, a predetermined demonstration screen is displayed on the tablet built-in monitor 131 in the destination editing space before the editing process is started. Then, after the process of step S3 in FIG. 18, the progress processing unit 351 controls the editing unit 209 in the destination editing space to display a start screen for notifying the start of the editing process on the tablet built-in monitor 131.

  Hereinafter, unless otherwise specified, in this processing, the editing unit 209, the tablet built-in monitor 131, the touch pens 132A and 132B, and the speaker 231 in the processing indicate those in the destination editing space. .

  In step S302, the edit processing unit 302 accepts selection of eye size and brightness. Specifically, the editing screen display control unit 354 controls the editing unit 209 to display, for example, the selection screen shown in FIG.

  On this selection screen, captured images 801-1 to 801-6 are displayed side by side on the upper side. These captured images are unprocessed images (standard captured images) obtained by capturing with the camera 91 in the capturing process in step S2 of FIG.

  When penalty shooting is performed, that is, when bonus shooting is not performed and five standard captured images are obtained, the captured image 801-5 and captured image 801-6 are processed in step S45 of FIG. The upper camera whole body image obtained in the above is displayed. That is, the captured image 801-5 and the captured image 801-6 are the same image.

  Three eye size selection buttons 802-1 to 802-3 are displayed side by side in the horizontal direction slightly below the center of the selection screen.

  The eye size selection button 802-1 displays an eye image of a model with a natural eye size, and the eye size selection button 802-2 displays a slightly larger eye size (for example, a natural size). An image of a model eye is displayed. The eye size selection button 802-3 displays an image of a model eye having a relatively large eye size (for example, about 20% larger than the natural size).

  The user can select the eye size by selecting the eye size selection button 802-1 to the eye size selection button 802-3. Hereinafter, the eye size selection button 802-1 to the eye size selection button 802-3 are also simply referred to as an eye size selection button 802 when it is not necessary to distinguish them.

  Further, five brightness selection buttons 803-1 to 803-5 are displayed in the horizontal direction at the lower side of the selection screen. Models with different brightness levels are displayed on the brightness selection buttons 803-1 to 803-5, respectively.

  The user can select the brightness of the subject by selecting any one of the brightness selection buttons 803-1 to 803-5. Hereinafter, the brightness selection buttons 803-1 to 803-5 are also simply referred to as brightness selection buttons 803 when it is not necessary to distinguish them.

  Furthermore, a determination button 804 that is operated when determining the size and brightness of the subject's eyes is displayed on the lower right side of the selection screen. When the enter button 804 is operated, the size and brightness of the user's eyes shown in the photographed image 801-1 to the photographed image 801-6 are collectively changed. That is, the eye size and brightness of the subject on the photographed image are changed to the eye size determined by the selected eye size selection button 802 and the brightness determined by the selected brightness selection button 803. The

  Using the touch pen 132A or the touch pen 132B, the user operates the tablet built-in monitor 131 on which the selection screen of FIG. 45 is displayed, and selects the eye size and brightness of each captured image. When the user performs an operation on this selection screen, information corresponding to the user's operation is supplied from the tablet built-in monitor 131 to the input reception control unit 353. Furthermore, the graffiti editing processing unit 355 changes the eye size and brightness of each captured image in accordance with a user operation.

  Then, when the selection process ends, the process proceeds to step S303.

  In step S303, the progress control unit 351 determines whether or not cross combination shooting has been performed. If it is determined that cross combination shooting has been performed, the process proceeds to step S304.

  In step S304, the edit processing unit 302 accepts image selection. Specifically, the editing screen display control unit 354 controls the editing unit 209 to display, for example, the selection screen shown in FIG.

  This selection screen is basically configured by arranging screens having the same configuration symmetrically on the left and right. For example, a user standing on the left side of the tablet built-in monitor 131 (hereinafter referred to as a left side user) selects his / her image on the left half of the selection screen using the touch pen 132A and stands on the right side. A user (hereinafter referred to as a right user) selects his / her image on the right half of the editing screen using the touch pen 132B.

  An image selection unit 821L is disposed above the left side of the selection screen. In the image selection unit 821L, the up images of the two users obtained in the above-described cross combination shooting are displayed side by side as an image 822L-1 and an image 822L-2, respectively.

  On the other hand, an image selection unit 821R is arranged above the right side of the selection screen. In the image selection unit 821R, an image 822R-1 that is the same image as the image 822L-1 in the image selection unit 821L and an image 822R-2 that is the same image as the image 822L-2 are displayed side by side. Yes.

Using the touch pen 132A or the touch pen 132B, the user operates the tablet built-in monitor 131 on which the selection screen of FIG. 46 is displayed, and selects his / her image.
For example, the left user operates the touch pen 132A and selects his / her image from the image 822L-1 or the image 822L-2. On the other hand, the right user operates the touch pen 132B to select his / her image from the image 822R-1 or the image 822R-2. When the user performs an operation on this selection screen, information corresponding to the user's operation is supplied from the tablet built-in monitor 131 to the input reception control unit 353.

  Note that when an image is selected by either the image selection unit 821L or the image selection unit 821R, the other image selection unit automatically selects an image different from the selected image. Further, if the image is not selected within a predetermined time, the left image 822L-1 is automatically selected by the image selection unit 821L, and the right image 822R-2 is automatically selected by the image selection unit 821R. Selected.

  The image selected in the image selection unit 821L is associated with the name input in the name input unit 841L in the next process, and the image selected in the image selection unit 821R is input in the name input unit 841R in the next process. Associated with the name. That is, by selecting an image on this selection screen, the correspondence between the user's image and name is input.

  It should be noted that the whole body image of the user obtained in the cross combination photographing may be used for the images 822L-1 to 822R-2 instead of the user's up image.

  Then, when the selection process ends, the process proceeds to step S305.

  In step S305, the edit processing unit 302 receives an input of a name. Specifically, the editing screen display control unit 354 controls the editing unit 209 to display, for example, the name input screen shown in FIG.

  This name input screen is basically configured by arranging screens having the same configuration in a symmetrical manner on the left and right. For example, the left user inputs his name on the left half of the name input screen using the touch pen 132A, and the right user inputs his name on the right half of the name input screen using the touch pen 132B. Will do.

  Specifically, an image selection unit 821L is arranged above the left side of the name input screen, as in the selection screen of FIG. Similarly, an image selection unit 821R is arranged above the right side of the name input screen, as in the selection screen of FIG. Therefore, even after the user selects his / her image on the selection screen of FIG. 46, the user can re-select his / her image on the name input screen.

  A name input unit 841L is arranged below the image selection unit 821L. Above the name input portion 841L, a name display portion 842L that displays characters (names) input by hiragana input is displayed. On the right side of the name display portion 842L, one back button 843L for erasing the last character displayed on the name display portion 842L, and on the right side, all the characters displayed on the name display portion 842L are deleted. A button 844L for deleting all is displayed.

  Below the name display portion 842L, a hiragana character input portion 845L that is pressed when inputting each character of hiragana, a determination button 846L that is operated when determining name input below, and a name A cancel button 847L for canceling the input is displayed.

  A name input unit 841R having the same configuration as the name input unit 841L is disposed below the image selection unit 821R.

  Using the touch pen 132A or the touch pen 132B, the user operates the tablet built-in monitor 131 on which the name input screen of FIG. 47 is displayed, and inputs his / her name, nickname, and the like. For example, the left user operates his / her hiragana character input unit 845L using the touch pen 132A to input his / her name, nickname, and the like. Similarly, the right user operates his / her hiragana character input unit 845R using the touch pen 132B to input his / her name, nickname, and the like. When the user performs an operation on this name input screen, information corresponding to the user's operation is supplied from the tablet built-in monitor 131 to the input reception control unit 353.

  The name input on the name input screen is used for an editing tool called “name stamp” and an editing tool called “name frame”, for example.

  Further, the image selected by the image selection unit 821L and the name input by the name input unit 841L are associated with each other, and an image indicating the associated name is displayed on the foreground or background of the cross combination image including the selected image. Synthesized. Similarly, the image selected by the image selection unit 821R is associated with the name input by the name input unit 841R, and the image indicating the name associated with the foreground or background of the cross combination image including the selected image Is synthesized.

  When the name input process ends, the process proceeds to step S307.

  On the other hand, if it is determined in step S303 that cross combination shooting has not been performed, the process proceeds to step S306.

  In step S306, the edit processing unit 302 receives an input of a name. Specifically, the edit screen display control unit 354 controls the edit unit 209 to display, for example, the name input screen shown in FIG.

  The name input screen of FIG. 48 has a screen configuration in which the image selection unit 821L and the image selection unit 821R are deleted from the name input screen of FIG. That is, since cross combination shooting is not performed, on this name input screen, an image is not selected and only a name is input.

  When the name input process ends, the process proceeds to step S307.

  In step S <b> 307, the progress control unit 351 controls the editing unit 209 to display a guidance screen on the tablet built-in monitor 131 for selecting a composition image to be combined with the captured image.

  In step S308, the edit processing unit 302 accepts selection of a background color. Specifically, the editing screen display control unit 354 controls the editing unit 209 to display, for example, the background color selection screen shown in FIG.

  On this background color selection screen, a background color selection area 861 and a background color selection area 862 are displayed side by side.

  Using the touch pen 132A or the touch pen 132B, the user can select the background color by operating the tablet built-in monitor 131 on which the selection screen of FIG. 49 is displayed. That is, the user selects a background color to be used for the composition image by selecting either the background color selection area 861 or the background color selection area 862 on the background color selection screen using the touch pen 132A or the touch pen 132B. be able to. Specifically, when the background color selection area 861 is selected, the composition image can be set to a clear vivid color, and when the background color selection area 862 is selected, a pastel color that softens the composition image. Can be set to taste. When the user performs an operation on this selection screen, information corresponding to the user's operation is supplied from the tablet built-in monitor 131 to the input reception control unit 353.

  When the background color selection process ends, the process proceeds to step S309.

  In step S309, the editing processing unit 302 accepts selection of a composition image. Specifically, the editing screen display control unit 354 controls the editing unit 209 to display, for example, the composition image selection screen shown in FIG.

  On the composite image selection screen, a composite image classification button display area 881, a composite image display area 882, and a composite image display area 883 are displayed. A normal button 884, a pattern button 885, and a set button 886 are displayed in the display area 881 of the composition image classification button. In the example of FIG. 50, a state in which the normal button 884 that is highlighted in black is selected is shown.

  The normal button 884 and the pattern button 885 are operated when the user selects a desired composition image from a plurality of composition images prepared in advance. By selecting the normal button 884, a desired composition image can be selected from among the composition images having various colors. Also, by selecting the pattern button 885, a desired composition image can be selected from among composition images composed of various patterns.

  The set button 886 is operated when the user selects a desired set of compositing images from a plurality of compositing image sets. For example, a set of compositing images is prepared in advance by combining arbitrary types of compositing images according to the number of shots (six) from among a plurality of types of compositing images having various colors and patterns. Yes.

  A plurality of photographed composite images are displayed in the photographed composite image display area 882. The captured composite image is an image in which the subject of the captured image and the composite image are combined together. Also, in the photographed composite image display area 882, a photographed composite image in which the composite images classified according to the selection of the normal button 884, the pattern button 885, and the set button 886 are combined is displayed. In the example of FIG. 50, the normal button 884 is selected, and 27 images (3 rows × 9 columns) in which images for synthesis composed of various colors are synthesized as the background of the user who is the subject of the captured image. A photographed composite image is shown.

  For example, when the user selects an arbitrary photographed composite image from a plurality of photographed composite images displayed in the photographed composite image display area 882, a composite image synthesized with the photographed composite image is selected. Is done. Then, in the captured composite image selected by the user, an “already” mark indicating that it has already been selected is displayed. In addition, a character “SELECT” indicating that the user has just selected is displayed in the photographed composite image selected immediately before.

  A captured composite image 887 and a captured image 888 are displayed in the display area 883 for the captured image and the captured composite image. In the example of FIG. 50, four captured composite images 887-1 to 887-4 and two captured images 888-5 and 888-6 are displayed in the display area 883 of the captured image and the captured composite image. ing. Cancel buttons 889-1 to 889-4 are respectively displayed below the captured composite images 887-1 to 887-4.

  For example, when the composite image selection screen is first displayed, six captured images 888 corresponding to the standard captured images are displayed in the captured image and captured composite image display area 883 in the order in which they were captured from the left. Is done. The captured image 888 is an image in which the size and brightness of the subject's eyes have been changed by the processing in step S302 described above.

  When penalty shooting is performed, that is, when bonus shooting is not performed and five standard captured images are obtained, the upper camera whole body captured image obtained by the process of step S45 in FIG. 20 is captured. An image 888-5 and a captured image 888-6 are displayed. That is, the captured image 888-5 and the captured image 888-6 are the same image.

  Then, the user selects a desired photographed composite image from the plurality of photographed composite images displayed in the photographed composite image display area 882 with respect to the first photographed image 888. A compositing image synthesized with the photographed composite image is selected. Accordingly, the display of the first photographed image 888 is updated to the photographed composite image 887-1 selected by the user. That is, instead of the first photographed image 888, a photographed composite image 887-1 in which the composition image selected by the user is synthesized is displayed on the background of the subject of the first photographed image 888. Further, a cancel button 889-1 is displayed below the photographed composite image 887-1.

  Hereinafter, similarly, when the user sequentially selects a composite image for the second photographed image 888, the third photographed image 888, and the fourth photographed image 888, photographing is performed according to the selection. The composite images 887-2 to 887-4 are displayed. Further, cancel buttons 889-2 to 889-4 are displayed below the captured composite images 887-2 to 887-4, respectively. By operating the cancel button 889, selection of the composition image synthesized with the photographed composition image 887 displayed above it can be canceled, and the composition image can be selected again.

  As described above, FIG. 50 shows a selection screen for a composition image when a composition image is selected for the fourth photographed image 888 and the photographed composite image 887-4 is displayed. Yes.

  Therefore, on this composition image selection screen, the composition image for the photographed image 888-5 is selected. In order to suggest this, the cursor C is displayed so as to surround the photographed image 888-5, and “select the fifth background!” Above the display area 883 of the photographed image and the photographed composite image! Characters are displayed.

A button 890 for erasing a person is displayed on the right side of the display area 882 for the photographed composite image.
The erase button 890 is used to change the display of the composite image displayed in the composite image display area 882 to a state where the subject is not composited, that is, in the display of the composite image display area 882. To be used as a composition image. For example, normally, a photographed composite image in which the subject of the photographed image and the composite image are combined is displayed in the display region 882 of the photographed composite image, but it is difficult to confirm the color or pattern of the composite image by the subject. It is assumed that there is. In such a case, when the user operates the button 890 for deleting a person, a composite image (that is, only the background) is displayed in the display area 882 of the photographed composite image. This makes it easier to confirm the color and pattern of the image for synthesis.

  Further, when the erase button 890 is operated to display the composite image in the captured composite image display area 882, the character displayed on the erase button 890 is changed to “display person”. Be changed. When the display of the photographed composite image display area 882 is a composite image, when the user operates the button 890 for deleting a person, the photographed composite image display area 882 returns to the original state, as shown in FIG. Then, a captured composite image in which the composite image is combined with the background of the subject is displayed.

  Using the touch pen 132A or the touch pen 132B, the user operates the tablet built-in monitor 131 on which the selection screen of FIG. 50 is displayed, and selects a composite image to be combined with each captured image. When the user performs an operation on this selection screen, information corresponding to the user's operation is supplied from the tablet built-in monitor 131 to the input reception control unit 353. Furthermore, the graffiti editing processing unit 355 synthesizes the selected composition image with each photographed image in response to a user operation, and generates six photographed composite images. When penalty shooting is performed, the fifth and sixth shot composite images are images obtained by combining different composite images with the same shot image (upper camera whole-body shot image).

  When the composition image selection process ends, the process proceeds to step S310.

  In step S310, the edit processing unit 302 receives image editing. Specifically, the editing screen display control unit 354 controls the editing unit 209 to display, for example, the editing screen shown in FIG.

  This editing screen is basically configured by arranging screens having the same configuration in a symmetrical arrangement on the left and right. For example, the left user edits the captured composite image in the left half of the editing screen using the touch pen 132A, and the right user uses the touch pen 132B to edit the right side of the editing screen in parallel with the editing by the left user. In half, the photographed composite image is edited.

  An image selection unit 903L is arranged above the left side of the editing screen, and the six photographed composite images generated by the process of step S310 are displayed side by side in the order of photographing from the left. When penalty shooting is performed, the second shot composite image from the right and the rightmost shot composite image are shot composite images generated based on the same shot image (upper camera whole-body shot image). .

  In the editing target image display unit 901L formed under the image selection unit 903L, the captured composite image selected from the image selection unit 903L is displayed in an enlarged manner. In the example of FIG. 51, among the six photographed composite images, the second photographed composite image from the right is selected by the cursor C1 as an editing target. The rightmost photographed composite image is selected by the cursor C2. What is selected by the cursor C2 in the image selection unit 903L is that the rightmost photographed composite image among the six photographed composite images is to be edited on the right side of the editing screen, and the same image is to be edited on the left side. Indicates that it cannot be selected.

  Similarly, an image selection unit 903R is arranged above the right side of the editing screen, and the same six captured composite images as the images displayed on the image selection unit 903L are displayed in the same arrangement on the image selection unit 903R. Is done. In the image selection unit 903R, the rightmost photographed composite image among the six photographed composite images is selected by the cursor C2 as an editing target.

  Further, the second photographed composite image from the right is selected by the cursor C1. What is selected by the cursor C1 in the image selection unit 903R is that the leftmost photographed composite image among the six photographed composite images is to be edited on the left side of the editing screen, and that same image is to be edited on the right side. Indicates that it cannot be selected. That is, on the editing screen, an image selected as an editing target on one of the left and right screens cannot be selected as an editing target on the other screen.

  A content palette 902L is displayed below the edit target image display unit 901L. In the content palette 902L, tabs of various editing tools such as a pen tool selected when inputting a handwritten image and a stamp tool selected when inputting a stamp image are displayed. By selecting a tab, The editing tools can be switched. The user can select an editing tool from the content palette 902L, and input characters, a pattern, and the like to the edited composite image displayed on the editing target image display unit 901L.

  On the right side of the edit target image display unit 901L, a button display unit 904L on which various buttons are displayed is displayed. In the example of FIG. 51, an end button that is operated when the editing of the captured composite image is ended, an eraser button that is used when the image input to the edit target image display unit 901L is partially erased, and editing from the beginning. Buttons that are operated when redoing, buttons that are operated when returning to the previous set, buttons that are operated when returning the editing contents to the state after one operation, and editing contents that are one operation before A button operated when returning is displayed on the button display portion 904L.

  On the right side of the editing screen, an editing target image display unit 901R, a content palette 902R, an image corresponding to the editing target image display unit 901L, the content palette 902L, the image selection unit 903L, and the button display unit 904L displayed on the left side. A selection unit 903R and a button display unit 904R are displayed.

  In the center of the editing screen, a GUI used for selecting BGM is displayed.

  Using the touch pen 132A or the touch pen 132B, the user operates the tablet built-in monitor 131 on which the editing screen of FIG. 51 is displayed, and edits each captured composite image. For example, the left user operates the touch pen 132A and uses an editing tool such as a stamp tool or a pen tool to doodle the captured composite image displayed on the editing target image display unit 901L. On the other hand, the user on the right side operates the touch pen 132B and uses an editing tool such as a stamp tool or a pen tool to doodle the captured composite image displayed on the editing target image display unit 901R.

  When the user performs an operation on the editing screen, information corresponding to the user's operation is supplied from the tablet built-in monitor 131 to the input reception control unit 353. Furthermore, the graffiti editing processing unit 355 synthesizes the graffiti input to the photographed composite image in accordance with the user's operation.

  As a result, six edited images obtained by editing each photographed composite image are generated.

  When the editing process ends, the process proceeds to step S311.

  Hereinafter, the edited image generated from the lower camera up photographed image is referred to as a lower camera up edited image. Hereinafter, an edited image generated from the upper camera-up captured image is referred to as an upper camera-up edited image. Further, the edited image generated from the upper camera whole body captured image is hereinafter referred to as an upper camera whole body edited image. Hereinafter, the edited image generated from the bonus photographed image is referred to as a bonus edited image.

  When penalty shooting is performed, as described above, since different editing inputs can be performed on the same upper camera whole body image, a total of two upper camera whole body edited images are generated. When it is necessary to individually distinguish these upper camera whole body edited images, the upper camera whole body edited image that becomes the fifth edited image is referred to as the upper camera whole body edited image A, and becomes the sixth edited image. The upper camera whole body edited image is referred to as an upper camera whole body edited image B.

In step S <b> 311, the edit processing unit 302 receives selection of a division pattern.
Specifically, the editing screen display control unit 354 controls the editing unit 209 to display a plurality of division patterns on the tablet built-in monitor 131 and allow the user to select any one. Here, the division pattern indicates a layout for printing an edited image on a sticker sheet.

  52 and 53 show examples of types of division patterns. FIG. 52 shows an example of a division pattern when normal shooting is performed, and FIG. 53 shows an example of a division pattern when penalty shooting is performed.

  When normal shooting is performed, the user can select, for example, one of the divided patterns of patterns 1A to 3A in FIG.

  In the pattern 1A, six edited images 931A-1 to 931A-6 are arranged side by side in 3 rows × 2 columns. The edited images 931A-1 to 931A-3 correspond to the lower camera up edited image, the edited image 931A-4 corresponds to the upper camera up edited image, and the edited image 931A-5 is the upper camera whole body edited image. The edited image 931A-6 corresponds to the bonus edited image.

  In the pattern 2A, six edited images 941A-1 to 941A-6 are arranged in a size smaller than the pattern 1A and arranged in 3 rows × 2 columns. The edited images 941A-1 to 941A-3 correspond to the lower camera up edited image, the edited image 941A-4 corresponds to the upper camera up edited image, and the edited image 941A-5 is the upper camera whole body edited image. The edited image 941A-6 corresponds to the bonus edited image. Further, in the pattern 2A, one edited image 942A selected from the six edited images is arranged on the edited images 941A-1 to 941A-6. The size of the edited image 942A is set larger than the edited images 941A-1 to 941A-6.

  In the pattern 3A, six edited images 951A-1 to 951A-6 are arranged in a size smaller than the pattern 1A and arranged in 3 rows × 2 columns. Below that, edited images 952A-1 to 952A-6 are arranged in a size of 2 rows x 3 columns in a size smaller than the edited images 951A-1 to 951A-6. Note that the edited images 951A-1 to 951A-3 and the edited images 952A-1 to 952A-3 correspond to the lower camera up edited image, and the edited images 951A-4 and 952A-4 are the upper camera up. Corresponding to the edited image, the edited image 951A-5 and the edited image 952A-5 correspond to the upper camera whole body edited image, and the edited image 951A-6 and the edited image 952A-6 correspond to the bonus edited image.

  In each division pattern, for example, the aspect ratio of the lower camera up edit image and the upper camera up edit image in which the subject is up is set to 1.2: 1, and the upper camera in which the entire body of the subject is shown The aspect ratio of the whole body edited image and the bonus edited image is set to 4: 3, for example. However, the aspect ratio of each image is an example, and for example, the aspect ratio of all images may be set to the same value.

  On the other hand, when penalty shooting is performed, the user can select, for example, one of the divided patterns of patterns 1B to 3B in FIG.

  In the pattern 1B, the edited image is arranged in basically the same layout as the pattern 1A in FIG. However, the edited images 931B-1 to 931B-5 are the same as the edited images 931A-1 to 931A-5 in the pattern 1A of FIG. 52, but the edited image 931A-6 is a bonus edited image. On the other hand, the edited image 931B-6 becomes the upper camera whole body edited image B.

  In the pattern 2B, the edited image is arranged in basically the same layout as the pattern 2A in FIG. However, like the pattern 1B, the edited image 941B-6 is an upper camera whole body edited image B, unlike the edited image 941A-6 of the pattern 2A.

  In the pattern 3B, edited images are arranged with basically the same layout as the pattern 3A in FIG. However, like the pattern 1B, the edited image 951B-6 and the edited image 952B-6 are different from the edited image 951A-6 and the edited image 952A-6 of the pattern 3A and become the upper camera whole body edited image B. .

  That is, in the patterns 1B to 3B, a plurality of edited images generated from the same upper camera whole body captured image are arranged on one sticker sheet.

  When a selection screen for selecting such a division pattern is displayed on the tablet built-in monitor 131, the user operates the tablet built-in monitor 131 to select a division pattern. When the user performs a selection operation, information corresponding to the user's operation is supplied from the tablet built-in monitor 131 to the editing processing unit 302.

  When the selection process ends, the editing process ends, and the process returns to step S4 in FIG.

  Then, in the process of step S6 in FIG. 18 described above, each edited image is printed on the sticker sheet based on the division pattern selected by the user.

  As described above, in this editing process, all standard captured images except for the cross combination image are to be edited and are finally printed on sticker paper without selecting the image to be edited. Therefore, the time required for the editing process can be shortened. Further, since the edited image is always printed on the sticker paper with the optimum layout prepared by the photo sticker creating apparatus 1, it is possible to provide sticker paper having a good appearance. Furthermore, since the user cannot select an image to be edited later, the user concentrates on one shot at a time so that a better shot image can be obtained, and the completeness of each image is improved. As a result, the user's satisfaction with the finished sticker is improved.

In addition, the number of captured images (standard captured images) that can be obtained differs between normal shooting and penalty shooting. However, as described above, a plurality of different editing inputs can be performed on the same captured image, thereby enabling editing input. The total number of images that can be captured is the same. In addition, by arranging a plurality of the same captured images (edited images generated from the same) at the time of penalty shooting on the sticker paper, the number of shot images printed on one sticker paper at the time of normal shooting and the time of penalty shooting is the same. become.
Therefore, it is possible to make the layout of the sticker paper common during normal photography and during penalty photography, and it is possible to provide sticker paper with high user satisfaction during penalty photography as well as during normal photography. it can.

  Furthermore, when penalty shooting is performed, different editing inputs can be performed on the same captured image, and as a result, two images with different editing effects can be obtained on the same subject. It is done.

  Hereinafter, modifications of the above-described embodiment of the present invention will be described.

[Variation related to cross combination shooting processing]
In the above description, an example in which a cross combination image is generated by combining a whole-body image and an up-image near the face has been shown, but the combination of images is not limited to this example.

  For example, two or more whole body images of the same user may be combined. In this case, for example, a plurality of whole body images obtained by photographing the same user from different directions such as front and back and front and side can be combined into one cross combination image.

  Further, for example, two or more face up images of the same user may be combined. In this case, for example, a plurality of up images having different facial expressions of the same user can be combined into one cross combination image.

  Further, the target of the up image is not necessarily limited to the face, and for example, a part different from the face, such as a user's fashion coordination point, may be set as the target of the up image. In this case, for example, the user may be allowed to designate a part that the user wants to up. And you may make it produce | generate a cross combination image using the up image of such parts other than a face.

  Furthermore, a cross combination image may be generated by extracting and combining images of the same user from three or more photographed images. That is, in this case, three or more types of images of the same user are combined in one cross combination image. Further, for example, an image used for a cross combination image may be selected from three or more types of user images.

  Alternatively, three or more users may be photographed a plurality of times, and a cross combination image may be generated individually for each user. For example, three users A to C may be photographed a plurality of times, and three cross combination images may be generated for each user. In this case, it is desirable to display each user in a different live view display area on the live view display screen of FIG. 37 or 40.

  Furthermore, when there are three or more users, a plurality of user images may be combined in one cross combination image. For example, three users A to C are photographed a plurality of times, and in one cross combination image, the whole body images and up images of user A and user B are combined, and in the other cross combination image, user C You may make it combine a whole body image and an up image. In this case, in the live view display screens of FIGS. 37 and 40, each user may be displayed in the live view display area in the same combination as the cross combination image, or each user may be displayed in a different live view display area. May be displayed. For example, in the example of the previous users A to C, in the former case, the user A and the user B are displayed in the same live view display area, and the user C is displayed in a different live view display area. In this case, users A to C are displayed in different live view display areas.

  In the above description, an example in which the cross combination image is an image dedicated to transmission to the mobile terminal has been described. However, the cross combination image may be printed on a sticker sheet.

  Further, the whole body image or the up image of each user before being combined with the cross combination image may be individually transmitted to the portable terminal or uploaded to the server. Thereby, the user can combine the images with his / her favorite pattern. Further, when uploading to the server, the user can combine not only images obtained in the same game but also images obtained in different games when the game is played a plurality of times.

  Further, in the above description, the cross combination image is excluded from editing, but editing input may be performed on the cross combination image. Further, for example, the user may be able to change the layout of each image in the cross combination image. For example, in the example of FIG. 41, the left and right positions of the whole body image and the up image may be interchanged, or the up and down positions of the up image may be moved.

[Variation related to penalty shooting]
In the above description, when penalty shooting is performed, an example of fixing a captured image (captured image that can be edited in duplicate) that can be edited and input to the upper camera whole body captured image is shown. The user may be allowed to select. For example, this selection may be performed when it is determined that a bonus image is not shot at the time of shooting the fifth shot image or after shooting.

  Further, the difference in the number of shots between normal shooting and penalty shooting may be set to two or more. In this case, for example, the types of photographed images that can be input with different edits may be increased, or the number of different edit inputs for the same captured image may be increased. For example, when the number of shots for normal shooting is six and the number of shots for penalty shooting is four, in the former case, for example, a lower camera up shot image, an upper camera up shot image, and an upper camera whole body shot image It is possible to edit and print two of each of the two types. On the other hand, in the latter case, for example, the same photographed image can be edited for three sheets and printed.

  Further, for example, it is possible to stop editing at the time of penalty shooting and to use different division patterns with appropriate layouts according to the number of shots for normal shooting and penalty shooting.

  In addition, when penalty shooting is performed and a plurality of different editing inputs are performed on the same captured image, a part of the edited image is edited as a print image, printed on sticker paper, and the rest for transmission to a mobile terminal. You may make it edit as an image and transmit to a portable terminal.

[Other variations]
In the above description, an example is shown in which images of each user are extracted from a plurality of captured images, a plurality of combined images (cross combination images) are generated by combining only the images of the same user, and provided to the user. However, for example, an image of each user may be extracted from one photographed image, and a plurality of composite images may be generated by combining the extracted images and a predetermined composite image and provided to the user. Is possible.

  For example, at the time of shooting, as shown in FIG. 54, a live view display screen 1001 is displayed at the center of the touch panel monitor 93, and predetermined composite images 1002L and composite images 1002R are displayed on the left and right. Finally, the images of the user 1003L and the user 1003R are extracted from the captured image corresponding to the central live view display screen 1001, and as shown in FIG. 55, the image of the user 1003L and the composition image 1002L are extracted. An image 1011L obtained by combining the images 1011R, and an image 1011R obtained by combining the image of the user 1003R and the composition image 1002R may be provided to the user.

  By the way, the above-described series of processes can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 14, the recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the main body of the apparatus. Disk), optical disk (including CD-ROM and DVD), magneto-optical disk (including MD), or removable media 205 made of semiconductor memory, etc., but also pre-installed in the main unit The ROM 206 that stores the program and the hard disk included in the storage unit 202 are distributed to the administrator.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

DESCRIPTION OF SYMBOLS 1 Photo sticker creation apparatus 11 Shooting unit 12 Editing unit 21 Shooting unit 81 Shooting / display unit 91 Camera 92 Camera strobe 93 Touch panel monitor 131 Built-in tablet monitor 132A, 132B Touch pen 201 Control unit 208 Shooting unit 209 Editing unit 210 Post customer service unit 301 Shooting Processing unit 302 Editing processing unit 303 Print processing unit 304 Post-service processing unit 311 Progress control unit 312 Shooting parameter setting unit 313 Live view display control unit 314 Captured image acquisition unit 315 Lighting control unit 316 Camera drive control unit 317 Chroma key processing unit 318 Corner Point detection unit 319 Corner image generation unit 320 Composition processing unit 321 Face recognition unit 351 Progress control unit 352 Edit preparation processing unit 353 Input reception control unit 354 Edit screen display control unit 355 drop Writing edit processing section

Claims (6)

A photo sticker creation device that takes a picture of a user in a shooting space and prints an image obtained by processing the obtained shot image on a predetermined sticker sheet or transmits it to a mobile terminal connected via a communication network. And
Capture means for capturing an image including a plurality of users and photographing the plurality of users;
Live view display control means for controlling the display of the display unit so that the moving image captured by the capturing means is displayed in one area in real time and a plurality of synthesis images are displayed around the moving image. ,
Combining means for generating a plurality of synthesized images obtained by combining each of the images for synthesis with a plurality of images generated from the photographed images photographed by the capturing means ,
The synthesizing unit generates a first synthesized image by synthesizing the left user image in the moving image and the synthesizing image displayed on the left side of the moving image, and generates a first synthesized image in the moving image. A photographic sticker creating apparatus for generating a second composite image by combining a right user image and the composite image displayed on the right side of the moving image . The said synthetic | combination means produces | generates several said synthesized image by extracting each said user's image from the said picked-up image, and combining each said image for a synthesis | combination with each said user's image. Photo sticker creation device. The live view display control means, photo described in conjunction with displaying the moving image in real time the center of the display screen of the display unit, to claim 1 or 2, wherein the synthetic image to the left and right Ru to display of the moving image Seal making device. Editing processing means for receiving an editing input for the captured image;
Printing means for printing an image on the sticker paper;
The photo sticker creating apparatus according to claim 1, further comprising: a transmitting unit that transmits an image to the portable terminal. An image of a photo sticker creation device that takes a picture of a user in a shooting space and prints an image obtained by processing the obtained shot image on a predetermined sticker sheet or transmits it to a mobile terminal connected via a communication network A processing method,
A capturing step of capturing an image including a plurality of users and photographing the plurality of users;
Live view display control for controlling the display of the display unit so that the moving image captured by the processing of the capturing step is displayed in real time in one area and a plurality of compositing images are displayed around the moving image. Steps,
Look including a combining step of generating a plurality of combined images by combining each of the combined images to the plurality of images generated from images captured by the process of the incorporation step,
In the synthesizing step, a first synthesized image is generated by synthesizing the left user image in the moving image and the synthesizing image displayed on the left side of the moving image. An image processing method for generating a second synthesized image by synthesizing a right user image and the synthesizing image displayed on the right side of the moving image . Causes a computer to execute processing for photographing a user in a photographing space and printing an image obtained by processing the obtained photographed image on a predetermined sticker sheet or transmitting it to a portable terminal connected via a communication network A program for
A capturing step of capturing an image including a plurality of users and photographing the plurality of users;
Live view display control for controlling the display of the display unit so that the moving image captured by the processing of the capturing step is displayed in real time in one area and a plurality of compositing images are displayed around the moving image. Steps,
Look including a combining step of generating a plurality of combined images by combining each of the combined images to the plurality of images generated from images captured by the process of the incorporation step,
In the synthesizing step, a first synthesized image is generated by synthesizing the left user image in the moving image and the synthesizing image displayed on the left side of the moving image. A program for causing a computer to execute a process of generating a second synthesized image by synthesizing the right user image and the synthesis image displayed on the right side of the moving image .

Images