JP2016028463A - Photograph seal creation device and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To more easily provide an interesting image.SOLUTION: A composite processing part recognizes the face of a user in a captured image captured by a camera that photographs the user as a subject to adjust the size and direction of an image for composition corresponding to a predetermined portion of the face of the user according to the size and direction of the recognized face of the user, and composes the image for composition at the predetermined portion of the face of the user in the captured image. A display control part controls display of the captured image having the image for composition composed at the predetermined portion of the face of the user. The present invention can be applied to a photograph seal creation device.SELECTED DRAWING: Figure 16

Description

  The present invention relates to a photographic sticker creation apparatus and a display method, and more particularly to a photographic sticker creation apparatus and a display method capable of providing an interesting image.

  There is known a photo sticker that takes a picture of a user, causes the user to edit the shot image, and prints and provides the edited image on sticker paper. Such a photo sticker is installed in an entertainment facility.

  The flow of one game provided by the photo-seal machine usually shoots a user in the shooting space as a subject, moves the user to the editing space, edits the image according to operations performed in the editing space, The edited image, which is the edited image, is printed on sticker paper.

  Some of these photo sticker machines specify a body part of a human image, for example, a face part or a head part, and add a decorative image to a background area excluding the specified body part. Yes (see, for example, Patent Document 1). Thereby, it is possible to avoid the decorative image from overlapping the face portion and the head portion.

  Furthermore, there is a photo sticker that detects the outline of a person and places a decorative image on the detected outline (see, for example, Patent Document 2).

  Also, an image processing apparatus that is not a photo sticker but detects a face area in a photographic image and arranges a decoration image related to the face at a predetermined relative position based on the detected face area is known. (For example, see Patent Document 3).

  As described above, in a photographed image, an image having interestingness is provided to a user by synthesizing a synthesis image with various designs in the face area or the vicinity thereof.

Japanese Patent No. 2985879 JP 2008-203960 A Japanese Patent No. 4621396

  However, in the above-described patent document, the synthesis image such as the decoration image and the decoration image is synthesized regardless of the size and orientation of the person's face.

  For example, in a photo sticker, when a foreground image to be combined with a user's face such as glasses is displayed as a composition image on a live view image displayed at the time of shooting, the user It was necessary for the user to change the standing position and posture according to the foreground image, which was troublesome for the user.

  The present invention has been made in view of such a situation, and makes it possible to more easily provide an interesting image.

  According to another aspect of the present invention, there is provided a photo sticker creating apparatus that photographs a user as a subject, edits the acquired photographed image according to an input by the user, and seals the photographed image that has been edited. A photo sticker creating apparatus that prints on paper, wherein a camera that takes a photograph of the user as a subject, and the user's face in the captured image captured by the camera, The composition image corresponding to the predetermined part is adjusted in size and direction according to the recognized size and direction of the user's face, and is applied to the predetermined part of the user's face in the captured image. A synthesis processing unit for synthesis, and a display control unit for controlling display of the captured image in which the synthesis image is synthesized at a predetermined part of the user's face.

  When the captured image is a live view image that is displayed in real time before the captured image is acquired, the composition processing unit recognizes the user's face in the captured image, thereby combining the composition. The image for use can be combined with a predetermined part of the face of the user in the captured image in accordance with the movement of the user in the captured image.

  The synthesizing processing unit can synthesize the synthesizing image that is different for each user with a predetermined part of the face of each of the users in the captured image.

  The synthesis processing unit may cause the synthesis image to be synthesized with a predetermined part of the user's face in the captured image when a course related to photographing selected by the user is a predetermined course. it can.

  In the synthesis processing unit, the synthesis image corresponding to the background image that is the background of the user in the captured image, selected by the user before shooting, is stored in the predetermined image of the user's face in the captured image. Can be synthesized at the site.

  When the number of users is less than a predetermined number, the combining processing unit can combine the combining image with a predetermined part of the user's face in the captured image.

  When the captured image is the captured image as a captured result, an editing unit that edits the captured image in accordance with an input by the user is provided, and the editing unit includes the editing image. Predetermined editing according to the input by the user can be performed on the synthesized image.

  According to the display method of one aspect of the present invention, a user is photographed as a subject, the obtained photographed image is edited according to an input by the user, and the photographed image that has been edited is applied to a sticker sheet. A method for displaying a photo sticker creating apparatus for printing, wherein a predetermined part of the user's face is recognized by recognizing the user's face in a captured image captured by a camera that captures the user as a subject. The synthesized image corresponding to the user's face is adjusted in accordance with the size and orientation of the recognized user's face according to the size and orientation of the face, and synthesized to a predetermined part of the user's face in the captured image And displaying the captured image obtained by synthesizing the synthesis image on a predetermined part of the user's face.

  In one aspect of the present invention, by recognizing a user's face in a captured image captured by a camera that captures a user as a subject, a composition image corresponding to a predetermined part of the user's face is obtained. The recognized user's face is adjusted in size and orientation according to the size and orientation of the face, and is synthesized with a predetermined part of the user's face in the captured image, and the predetermined part of the user's face The captured image in which the image for synthesis is combined is displayed.

  According to the present invention, an interesting image can be provided more easily.

It is a perspective view which shows the structural example of the external appearance of the photograph sticker production apparatus which concerns on one embodiment of this invention. It is the perspective view which looked at the external appearance of the photograph sticker production apparatus from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of a prior customer service part. It is a figure which shows the structural example of an imaging | photography part. It is a figure which shows the structural example of a background part. It is a figure which shows the structural example of the front of an edit unit. It is a figure which shows the structural example of the side surface of an edit unit. It is a block diagram which shows the example of an internal structure of a photograph sticker production apparatus. It is a block diagram which shows the function structural example of a control part. It is a flowchart explaining the example of the flow of photograph sticker creation game processing. It is a flowchart explaining a prior customer service process. It is a figure which shows the example of a set background selection screen. It is a flowchart explaining an imaging | photography process. It is a figure which shows the example of an imaging | photography screen. It is a block diagram which shows the function structural example of the photograph sticker production apparatus of this invention. It is a flowchart explaining a display process. It is a figure which shows the example of a live view image. It is a figure which shows the example of a live view image. It is a figure which shows the example of a live view image. It is a figure which shows the example of a live view image. It is a figure which shows the example of a live view image. It is a figure which shows the example of an edit screen. It is a figure explaining an eraser button. It is a figure which shows the example of a collage photography image. It is a figure which shows the example of a collage photography image. It is a flowchart explaining an imaging | photography process. It is a figure which shows the example of a course selection screen. It is a flowchart explaining an edit process. It is a figure which shows the example of a sex selection screen. It is a figure which shows the example of a set background selection screen. It is a figure which shows the example of a set background selection screen. It is a figure which shows the example of a set background selection screen. It is a figure which shows the example of a picked-up image. It is a figure which shows the example of a picked-up image. It is a figure which shows the example of a set background selection screen.

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings.

<External structure of photo sticker creation device>
FIG. 1 and FIG. 2 are perspective views showing a configuration example of the appearance of the photographic sticker creating apparatus 1.

  The photo sticker creating apparatus 1 is a game machine that provides a photographed image or an edited image. The provision of the image may be performed in a form printed on a sticker sheet or may be performed in such a manner that the image transmitted to the server can be viewed on the user's portable terminal. The photo sticker creating apparatus 1 is installed in a facility or store such as an amusement facility. Users are mainly high school girls and young women. Although there may be one user, it is mainly a plurality of people such as 2 or 3 people per group.

  A user who plays with the photo sticker creating apparatus 1 takes a picture of himself / herself as a subject, and edits an image selected from the shot images obtained by shooting by combining handwritten characters and stamp images. , Make the shot image rich and colorful. The user receives the sticker sheet on which the photographed image and the edited image are printed, and ends the series of games.

  As shown in FIG. 1, the photo sticker creating apparatus 1 is basically configured by being installed in a state where a photographing unit 11 and an editing unit 12 are in contact with each other.

  The photographing unit 11 includes a pre-service section 20, a photographing section 21, and a background section 22. The pre-service section 20 is installed on both side surfaces of the photographing section 21, and the respective front spaces are pre-service areas for performing pre-service processes. In addition, the photographing unit 21 and the background unit 22 are set apart by a predetermined distance, and a space formed between the photographing unit 21 and the background unit 22 becomes a photographing space for performing photographing processing.

  The pre-service section 20 is a device that performs pre-service processing that performs guidance for introducing a game provided by the photo sticker creation device 1 and performs various settings in shooting processing performed in a shooting space. The customer service unit 20 is provided with a coin slot for receiving a price from the user, a tablet built-in monitor used for various operations, and a touch pen. The prior customer service unit 20 appropriately guides the user in the prior customer service space to the photographing space according to the vacant state of the photographing space.

  The photographing unit 21 is a device that performs photographing processing with a user as a subject. The photographing unit 21 is located in front of the user who has entered the photographing space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the photographing unit 21 facing the photographing space. When the right side as viewed from the user in the shooting space is the right side and the left side is the left side, the right side of the shooting unit 21 is constituted by the side panel 41A, and the left side is constituted by the side panel 41B (FIG. 3). Further, the front surface is constituted by the front panel 42. In addition, the pre-service section 20 described above is installed on each of the side panels 41A and 41B.

  The background portion 22 is attached to the right end of the rear panel 51, which is a plate-like member located on the back side of the user who is taking a picture facing the front, and has a plate shape with a narrower width than the side panel 41A. And a side panel 52B (FIG. 3), which is a plate-like member attached to the left end of the back panel 51 and having a narrower width than the side panel 41B.

  The side panel 41A constituting the right side surface of the photographing unit 21 and the side panel 52A of the background unit 22 are provided on substantially the same plane. In the side panel 41A and the side panel 52A, the upper part is connected by a connecting part 23A which is a plate-like member, and the lower part is connected by a connecting part 23A 'which is a metal member provided on the floor surface. Similarly, the side panel 41B and the side panel 52B of the background unit 22 constituting the left side of the photographing unit 21 are also provided on substantially the same plane, and are connected by a connecting part 23B (not shown) in the upper part and the connecting part 23B in the lower part. Connected by '(not shown).

  An opening formed by being surrounded by the side panel 41A of the imaging unit 21, the connecting unit 23A, and the side panel 52A of the background unit 22 serves as an entrance to the imaging space. An opening formed by being surrounded by the side panel 41B of the photographing unit 21, the connecting part 23B, and the side panel 52B of the background 22 is also an entrance of the photographing space.

  The background curtain unit 25 is provided above the background portion 22 so as to be supported by the back panel 51, the side panel 52A, and the side panel 52B. The background curtain unit 25 stores a background curtain of a predetermined color that appears in the background of the user in a photographed image obtained by photographing. The background curtain unit 25 appropriately lowers, for example, a green chroma key curtain in the shooting space in conjunction with shooting.

  Note that a chroma key curtain may be previously attached to the back panel 51 which is the back of the shooting space. When shooting is performed using the chroma key curtain as a background, multiple types of composite background images are prepared, and the chroma key processing is performed in the shooting process and editing process, so that the background image desired by the user is displayed in the curtain part. To be able to synthesize.

  Above the photographing space, a ceiling surrounded by the front of the photographing unit 21, the connecting part 23A, the connecting part 23B, and the background curtain unit 25 is formed, and a ceiling strobe unit 24 is provided as a part of the ceiling. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B. The ceiling strobe unit 24 has a built-in strobe that emits light toward the photographing space in accordance with photographing. Inside the ceiling strobe unit 24, a fluorescent lamp is provided in addition to the strobe, and also functions as illumination of the photographing space.

  The editing unit 12 is an apparatus that performs a captured image editing process. The editing unit 12 is provided so as to be connected to the photographing unit 11 so that one side surface is in contact with the back surface of the photographing unit 21.

  If the configuration of the editing unit 12 visible in FIGS. 1 and 2 is the front side configuration, the editing unit 12 is used for editing on the front side and the back side so that two sets of users can edit simultaneously. Each configuration is provided.

  The front side of the editing unit 12 is a surface perpendicular to the floor surface, and includes a surface 61 that is substantially parallel to the side panel 41 </ b> A of the photographing unit 21, and a slope 62 formed above the surface 61. The The slope 62 is provided with a tablet built-in monitor and a touch pen as a configuration used for editing work. On the right side of the slope 62, a columnar support portion 63A that supports one end of the lighting device 64 is provided. A columnar support portion 63 </ b> B that supports the other end of the lighting device 64 is also provided on the left side of the slope 62. A support portion 65 that supports the curtain rail 26 is provided on the upper surface of the support portion 63A.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C so that the shape when viewed from above becomes a U-shape. One end of the rails 26A and 26B provided in parallel is fixed to the connecting portion 23A and the connecting portion 23B, and both ends of the rail 26C are joined to the other end.

  A curtain is attached to the curtain rail 26 so that the inside of the space in front of the editing unit 12 and the space in front of the back cannot be seen from the outside. A space in front of the editing unit 12 and a space behind the back of the editing unit 12 surrounded by a curtain attached to the curtain rail 26 serve as an editing space in which a user edits a captured image.

  As will be described later, the right side surface of the editing unit 12 is provided with a discharge port through which printed sticker paper is discharged. The space in front of the right side surface of the editing unit 12 is a print waiting space where the user waits for the printed sticker sheet to be discharged.

<About user movement>
Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described. FIG. 3 is a plan view of the photo sticker creating apparatus 1 as viewed from above.

  First, in the advance customer service space A0-1 or advance customer service space A0-2, which is the space in front of the advance customer service section 20, the user who has paid the coin insertion slot makes various settings according to the screen displayed on the tablet built-in monitor. Is performed using a touch pen. In the pre-service spaces A0-1 and A0-2, for example, selection of conditions relating to shooting performed in the shooting space is performed as pre-service work.

  The user who has completed the customer service is formed between the photographing unit 21 and the background unit 22 from the entrance G1 as indicated by the white arrow # 1 or from the entrance G2 as indicated by the white arrow # 2. The camera enters the shooting space A1 and performs shooting using a camera or a touch panel monitor provided in the shooting unit 21. The doorway G1 is an opening between the side panel 41A and the side panel 52A, and the doorway G2 is an opening between the side panel 41B and the side panel 52B.

  In addition, in each of the pre-serving space A0-1 and the pre-serving space A0-2, two sets of users can perform the pre-serving work at the same time. You are guided to the shooting space A1. At this time, the pre-service section 20 waits until the user who has entered the photographing space A1 finishes photographing by giving guidance regarding photographing processing to a user who has not finished pre-serving work. To.

  The user who has finished shooting uses the doorway G1 to move out of the shooting space A1 as indicated by the white arrow # 3 and moves to the editing space A2-1 or opens the doorway G2 as indicated by the white arrow # 4. Use to move out of the shooting space A1 and move to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12, and the editing space A2-2 is an editing space on the back side of the editing unit 12. Which of the editing space A2-1 and the editing space A2-2 is to be moved is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the free one of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing the captured image. The user of the editing space A2-1 and the user of the editing space A2-2 can edit simultaneously.

  After the editing is completed, printing of the captured image and the edited image is started. When the printing of the image is completed, the user who has finished editing in the editing space A2-1 moves from the editing space A2-1 to the print waiting space A3 as indicated by a white arrow # 5. In addition, the user who has finished editing in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as indicated by a white arrow # 6.

  The user who has moved to the print waiting space A3 receives the sticker paper from the discharge port provided on the right side of the editing unit 12, and finishes a series of photo sticker creation games.

  Next, the configuration of each device will be described.

<Composition of the customer service department>
FIG. 4 is a diagram showing a configuration example of the front side of the pre-serving section 20 installed on the side panel 41A (or the side panel 41B).

  A tablet built-in monitor 71 is provided above the customer service unit 20. A touch pen 72A is provided on the left side of the tablet built-in monitor 71, and a touch pen 72B is provided on the right side. The tablet built-in monitor 71 is configured by providing a tablet capable of operating input using the touch pen 72A or 72B so that the display is exposed. On the tablet built-in monitor 71, a screen used for pre-service processing such as course selection and background selection is displayed. When two users perform pre-service work at the same time, the touch pen 72A is used by the user on the left side toward the monitor 71 with a built-in tablet, and the touch pen 72B is used by the user on the right side with respect to the monitor 71 with a built-in tablet. It is done.

  A speaker 73 is provided under the tablet built-in monitor 71 to output pre-service processing guidance voice, BGM (Back Ground Music), sound effects, and the like. Under the speaker 73, a user inserts a coin. A coin insertion / return port 74 is provided.

<Configuration of the shooting unit>
FIG. 5 is a diagram illustrating a configuration example of the front of the photographing unit 21. The photographing unit 21 is configured by attaching a side panel 41A, a side panel 41B, and a front panel 42 to a base part 43 having a box shape.

  A camera unit 81 is provided at the center of the front panel 42. The camera unit 81 includes a camera 91, a touch panel monitor 92, and a front strobe 93.

  The camera 91 is a single-lens reflex camera, for example, and is attached inside the camera unit 81 so that the lens is exposed. The camera 91 has an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and photographs a user in the photographing space A1. A moving image (hereinafter also referred to as a live view image) captured by the camera 91 is displayed on the touch panel monitor 92 in real time. A still image captured by the camera 91 at a predetermined timing such as when a user gives an instruction to shoot is stored as a photographic image.

  A front strobe 93 provided on the camera 91 has one horizontally long elliptical light emitting surface and two vertically elliptical light emitting surfaces made of a milky white acrylic plate. The front strobe 93 illuminates the vicinity of the user's face as a subject from the front by emitting light in accordance with shooting by the camera 91.

  The touch panel monitor 92 provided under the camera unit 81 is configured by a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 92 has a function as a live view monitor that displays a moving image captured by the camera 91 and a function that displays various GUIs (Graphical User Interfaces) and accepts a user's selection operation. On the touch panel monitor 92, a moving image (live view image) and a still image (captured image) captured by the camera 91 are displayed.

  Above the camera unit 81, an upper strobe 82 with a curved light emitting surface facing the user is installed. The upper strobe 82 illuminates the user from above by emitting light in accordance with shooting by the camera 91.

  At the center of the base portion 43, a foot strobe 83 for irradiating the lower body and feet of the user is provided.

  Spaces 84 </ b> A and 84 </ b> B are formed on the upper surface of the base portion 43 on both sides of the upper surface of the foot strobe 83. The spaces 84A and 84B are used as a luggage storage place for a user who takes a picture to put baggage or the like. Although not shown, a speaker that outputs sound such as guidance sound for shooting processing, BGM, and sound effects is also provided near the ceiling of the front panel 42, for example.

<Configuration of background part>
FIG. 6 is a diagram illustrating a configuration example of the background portion 22 on the photographing space A1 side.

  As described above, the background curtain unit 25 is provided above the back panel 51. Near the center of the background curtain unit 25, a back center strobe 101 that irradiates a user who is performing a photographing process in the photographing space A1 from the rear center is attached.

  A rear right strobe 102 for irradiating a user who is performing a photographing process in the photographing space A1 from the right rear is attached to a position of the rear panel 51 on the doorway G1 side. Further, a rear left strobe 103 that irradiates a user who is performing a photographing process in the photographing space A1 from the left rear is attached to the rear panel 51 on the doorway G2 side.

<Configuration of editing unit>
FIG. 7 is a diagram illustrating a configuration example of the editing unit 12 on the front side (editing space A2-1 side).

  A tablet built-in monitor 131 is provided in the approximate center of the slope 62. A touch pen 132A is provided on the left side of the tablet built-in monitor 131, and a touch pen 132B is provided on the right side.

  The tablet built-in monitor 131 is configured by providing a tablet capable of operating input using the touch pen 132A or the touch pen 132B so that the display is exposed. On the tablet built-in monitor 131, for example, an editing screen used for editing a captured image is displayed. When two users perform editing work at the same time, the touch pen 132A is used by a user on the left side of the tablet built-in monitor 131, and the touch pen 132B is used by a user on the right side of the tablet built-in monitor 131. .

  FIG. 8 is a diagram illustrating a configuration example of the right side surface of the editing unit 12.

  A seal paper discharge port 161 is provided below the right side surface of the editing unit 12. A printer is provided inside the editing unit 12, and an image showing a user of the editing space A2-1 or an image showing a user of the editing space A2-2 is printed on a sticker sheet with a predetermined layout. The paper is discharged from the sticker paper outlet 161.

<Internal configuration of photo sticker creation device>
FIG. 9 is a block diagram illustrating an internal configuration example of the photo sticker creating apparatus 1. In FIG. 9, the same components as those described above are denoted by the same reference numerals, and redundant description will be omitted as appropriate.

  The control unit 201 includes a CPU (Central Processing Unit) and the like, executes a program stored in a ROM (Read Only Memory) 206 and a storage unit 202, and controls the overall operation of the photo sticker creating apparatus 1. A storage unit 202, a communication unit 203, a drive 204, a ROM 206, and a RAM (Random Access Memory) 207 are connected to the control unit 201. The control unit 201 is also connected with each configuration of the customer service units 208A and 208B, the photographing unit 209, the editing units 210A and 210B, and the printing unit 211.

  The storage unit 202 includes a nonvolatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 201. Information stored in the storage unit 202 is appropriately read out by the control unit 201.

  A communication unit 203 is an interface of a network such as the Internet, and communicates with an external device according to control by the control unit 201. For example, the communication unit 203 transmits a captured image or an edited image to the server. The image transmitted from the communication unit 203 is allocated and stored in a predetermined storage area in the server, and is displayed or downloaded on a mobile terminal that has accessed the server.

  A removable medium 205 made of an optical disk, a semiconductor memory, or the like is appropriately attached to the drive 204. Computer programs and data read from the removable medium 205 by the drive 204 are supplied to the control unit 201 and stored in the storage unit 202 or installed.

  The ROM 206 stores programs and data executed by the control unit 201. The RAM 207 temporarily stores data and programs processed by the control unit 201.

  The pre-service section 208A performs pre-service processing for users in the pre-service space A0-1. The pre-service section 208A includes a tablet built-in monitor 71, touch pens 72A and 72B, a speaker 73, and a coin processing section 221. The pre-service section 208B has the same configuration as the pre-service section 208A and performs pre-service processing for users in the pre-service area A0-2. In the following description, the prior customer service sections 208A and 208B are simply referred to as the prior customer service section 208 unless otherwise distinguished.

  The tablet built-in monitor 71 displays various selection screens under the control of the control unit 201, and detects user operations on the selection screens. An input signal representing the content of the user's operation is supplied to the control unit 201, and various selection processes are performed.

  The coin processing unit 221 detects the insertion of coins into the coin insertion / return port 74. When the coin processing unit 221 detects that a predetermined amount of coins such as 400 yen has been inserted, the coin processing unit 221 outputs an activation signal indicating that to the control unit 201.

  The photographing unit 209 performs photographing processing for a user in the photographing space A1. The photographing unit 209 includes a background control unit 231, a lighting device 232, a camera 91, a touch panel monitor 92, and a speaker 233.

  The background control unit 231 controls the raising / lowering of the background curtain by the background curtain unit 25 according to the background control signal supplied from the control unit 201.

  The illumination device 232 is each strobe in the imaging space A1, and emits light according to an illumination control signal supplied from the control unit 201. In the photographing space A1, in addition to the strobe of the ceiling strobe unit 24, the front strobe 93, the upper strobe 82, the foot strobe 83, the back center strobe 101 of the background unit 22, the back right strobe 102, and the back left strobe 103 is provided.

  The camera 91 shoots according to the shutter control by the control unit 201, and outputs an image (image data) obtained by the shooting to the control unit 201.

  The editing unit 210A performs an editing process for a user in the editing space A2-1. The editing unit 210A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 241. The editing unit 210B has the same configuration as the editing unit 210A, and performs editing processing for the user in the editing space A2-2. Hereinafter, when the editing units 210A and 210B are not particularly distinguished, they are simply referred to as the editing unit 210.

  The tablet built-in monitor 131 displays an editing screen according to control by the control unit 201, and detects a user operation on the editing screen. An input signal representing the content of the user's operation is supplied to the control unit 201, and the captured image to be edited is edited.

  The printing unit 211 performs a printing process for providing a printed sticker sheet to a user in the print waiting space A3. The printing unit 211 is configured to include a printer 251. A sticker sheet unit 252 is attached to the printer 251.

  Based on the print data supplied from the control unit 201, the printer 251 prints the photographed image or the edited image on the sticker paper 261 stored in the sticker paper unit 252 and discharges it to the sticker paper discharge port 161.

<Configuration of control unit>
FIG. 10 is a block diagram illustrating a functional configuration example of the control unit 201. At least a part of the functional blocks shown in FIG. 10 is realized by a predetermined program being executed by the CPU in the control unit 201.

  In the control unit 201, a pre-service processing unit 301, a photographing processing unit 302, an editing processing unit 303, and a print processing unit 304 are realized.

  The pre-service processing unit 301 controls each part of the pre-service unit 208 and performs pre-service processing. The imaging processing unit 302 controls each unit of the imaging unit 209 and performs imaging processing. The editing processing unit 303 controls each unit of the editing unit 210 and performs editing processing. The print processing unit 304 controls the printer 251 of the printing unit 211 to perform print processing.

<Operation of photo sticker creation device>
Here, with reference to the flowchart of FIG. 11, operation | movement of the photo sticker production apparatus 1 which provides a photo sticker production game is demonstrated.

  In step S1, the pre-service processing unit 301 determines whether or not a predetermined amount of coins has been inserted based on an activation signal supplied from the coin processing unit 221, and waits until it is determined that the coins have been inserted.

  If it is determined in step S1 that coins have been inserted, in step S2, the pre-service customer processing unit 301 performs advance advance of one of the pre-service spaces A0-1 and A0-2 in which coins have been inserted. By controlling the pre-serving section 208 corresponding to the customer service space, the user performs selection of shooting conditions and further selection of BGM flowing in the shooting space, thereby performing pre-service processing for performing various settings.

  The shooting conditions include the background image that is the background of the subject in the shot image obtained by shooting performed in the shooting space, the category for classifying the background image, the image processing performed on the shot image, and the illumination at the time of shooting. There is a subject image determined by the control.

  In step S <b> 3, the pre-service processing unit 301 determines whether or not the user performing the pre-service service can move to the shooting space A <b> 1. Specifically, the customer service processing unit 301 determines whether or not the shooting space A1 is in use based on the progress of the shooting work of the previous group of users, and the shooting space A1 is in use. If it is determined that it is impossible for the user performing the pre-service operation to move to the shooting space A1, the process returns to step S2, and the pre-service process is continued by performing, for example, guidance regarding the shooting process. And do it.

  If it is determined in step S3 that the shooting space A1 is not in use and can be moved to the shooting space A1, the process proceeds to step S4, and the pre-service processing unit 301 selects the pre-service space A0-1 or The user in the pre-service space A0-2 is guided to move to the shooting space A1. Guidance of movement to the imaging space A1 is performed by displaying a guidance screen on the tablet built-in monitor 71 of the pre-service section 208 or by outputting sound from the speaker 73.

  In step S5, the imaging processing unit 302 controls the imaging unit 209 to display the moving image of the subject captured by the camera 91 on the touch panel monitor 92, and shoots the user in the imaging space A1 as the subject. A photographing process for acquiring a photographed image is performed.

  In the photographing process, for example, seven photographings are performed, and seven photographed images are obtained as photographing results. Of course, the number of times of shooting is not limited to seven.

  In step S6, the imaging processing unit 302 guides the user in the imaging space A1 to move to the editing space A2-1 or the editing space A2-2. The guidance for moving to the editing space A2-1 or the editing space A2-2 is performed by displaying a guidance screen on the touch panel monitor 92 of the photographing unit 209 or by outputting sound from the speaker 233.

  In step S <b> 7, the editing processing unit 303 controls the editing unit 210 corresponding to the editing space of the editing space A <b> 2-1 and the editing space A <b> 2-2 as the destination of the user who has finished the shooting process, The user performs a graffiti edit on the photographed image obtained by the photographing process, and performs an edit process for generating an edited image subjected to the graffiti edit. In the editing process, a sticker representing the layout (including color and design) of an area other than the area where the edited image or the photographed image is arranged on the sticker paper, or the arrangement of the edited image or the photographed image printed on the sticker paper. The layout is also determined by user selection.

  Note that the edited image and the captured image are transmitted to a mobile terminal such as a mobile phone owned by the user via an external server. Therefore, in the editing process, the mobile terminal is made to input a mail address of the mobile terminal that is necessary for the mobile terminal to receive a mail in which a URL necessary for accessing the server is described.

  As a result, the server transmits a mail describing a URL necessary for the mobile terminal to access the server to the mail address input by the user. Based on the URL, the portable terminal owned by the user accesses the server via a network such as the Internet, so that the edited image or the photographed image transmitted to the server is provided to the portable terminal. .

  In step S <b> 8, the print processing unit 304 performs a printing process in which the photographed image obtained by the photographing process or the edited image obtained by the editing process is output as a print image to the printer 251 and printed on the sticker paper ( Start).

  When printing is completed, in step S9, the printer 251 discharges the sticker sheet on which the image is printed to the sticker paper discharge port 161, and ends the process. At this time, the editing processing unit 303 causes the user who has finished the editing processing in the editing space A2-1 or the editing space A2-2 to display that the printing is completed on the tablet built-in monitor 131, thereby waiting for printing. Guide the movement to the space A3. The guidance for movement to the print waiting space A3 may be performed by outputting sound from the speaker 241.

  Note that the user may be allowed to play a predetermined game during the time from the end of the editing process to the end of the sticker paper printing. For example, a so-called mistake search is performed in which two images that seem to be the same and include several different points are displayed on the tablet built-in monitor 131 and the user finds the different points within a predetermined time. I will let you.

  Accordingly, the user can spend the time from the end of the editing process to the end of the printing of the sticker paper without being bored.

<Flow of prior customer service>
Next, with reference to the flowchart of FIG. 12, the flow of the pre-service process in step S2 in the series of processes of the photo sticker creation game described above will be described.

  When the pre-service processing is started, the pre-service processing unit 301 controls the tablet built-in monitor 71, the speaker 73, and the like, and outputs images and sounds that guide the flow of the photo sticker creation game to the user. Guidance on the photo sticker creation game is given.

  In step S31, the customer service processing unit 301 displays a background course selection screen on the monitor 71 with a built-in tablet and accepts an instruction from the user using the touch pens 72A and 72B, thereby giving the user a background course. Let them choose. The pre-service processing unit 301 selects one of a plurality of background courses as one of the shooting conditions based on the reception result of the instruction from the user. The background course selection screen is a screen used to select a background course that determines the type of background image to be combined with the photographed image. In the background course, for example, as a type of the background image, a photographed image in which the background image is synthesized is provided with a background image that provides a fun and pleasant atmosphere finish, and a background image is synthesized. There is a “Beautiful Shot” course in which the photographed image provides a background image with a calm and slightly matured finish.

  In step S32, the pre-service processing unit 301 displays a reflection course selection screen on the tablet built-in monitor 71 and accepts an instruction from the user using the touch pens 72A and 72B, thereby allowing the user to select a reflection course. . The pre-service processing unit 301 selects one of a plurality of shooting courses as one of shooting conditions based on a result of receiving an instruction from the user. The reflection course selection screen is a screen used for selection of a reflection course that determines the reflection of a subject in a captured image.

  In step S33, the customer service processing unit 301 displays a name input screen on the tablet built-in monitor 71 and accepts an instruction from the user using the touch pens 72A and 72B, thereby inputting each user's name. The name input screen is a screen used for inputting a name by the user.

  In step S34, the customer service processing unit 301 displays a set background selection screen on the tablet built-in monitor 71 and accepts an instruction from the user using the touch pens 72A and 72B, thereby allowing the user to select a set background. . The prior customer service processing unit 301 selects any one of a plurality of set backgrounds as one of the shooting conditions based on the reception result of the instruction from the user.

  The set background is configured as a set of a plurality of background images unified with a predetermined theme. Here, the set background is composed of a background image of a type corresponding to the background course selected in step S31. Is displayed on the set background selection screen.

  FIG. 13 is a diagram illustrating an example of a set background selection screen displayed when a set background is selected.

  In the set background selection screen, the set background is switched and displayed by the buttons 421 to 424 for each category such as “recommended”, “color”, “design”, and “event”. Then, the “recommend” button 421 is selected. On the set background selection screen on which the “recommend” button 421 is selected, six set backgrounds 431 to 436 are displayed for each theme.

  Although not shown, for example, on the set background selection screen when the “event” button 424 is selected, a set background on the theme of an event according to the season or an anniversary such as a birthday is displayed. become.

  The set background displayed on the set background selection screen of FIG. 13 is the set background when the “enjoy shot” course is selected as the background course in step S31. The background image that constitutes the set background when the “Enjoy shot” course is selected includes foreground images such as a stamp image and a frame image combined with the background of the subject in addition to the image combined with the background of the subject in the captured image. About 1 or 2 background images are prepared. For example, foreground images are included in two background images corresponding to the second and sixth shootings out of six background images corresponding to the first to sixth shootings among the seven shootings performed in the shooting process. It is assumed that the foreground image is included in all six background images.

  Returning to the flowchart of FIG. 12, in step S <b> 35, the pre-service processing unit 301 displays a collage shooting course selection screen on the tablet built-in monitor 71 and accepts an instruction from the user using the touch pens 72 </ b> A and 72 </ b> B. Let the person choose a shooting course for collage shooting. The pre-service processing unit 301 selects one of a plurality of collage shooting courses as one of shooting conditions based on a result of receiving an instruction from the user.

  Collage shooting is the seventh shooting out of the seven shootings performed in the shooting process, and the seventh shot image obtained by this shooting is arranged on a design image with a predetermined design. It is taken to obtain a collage photographed image that is a composite image. The collage shooting course selection screen is a screen used for course selection for determining whether or not to perform predetermined image processing on the collage shooting image.

  In step S36, the pre-service processing unit 301 displays a BGM selection screen on the tablet built-in monitor 71, and accepts an instruction from the user using the touch pens 72A and 72B, thereby allowing the user to receive the BGM flowing in the shooting space. Let them choose. The prior customer service processing unit 301 selects a BGM that flows in the imaging space based on the result of receiving an instruction from the user.

  When BGM is selected, the process returns to step S2 in FIG. 11, and the subsequent processes are performed.

<Flow of shooting process>
Next, the flow of the photographing process in step S5 in the series of processes of the photo sticker creation game described above will be described with reference to the flowchart of FIG.

  When the photographing process is started, the photographing processing unit 302 displays a message such as “Please touch!” On the touch panel monitor 92 and accepts an instruction from the user. Starts outputting the BGM (musical piece) selected by the user in the pre-service process via the speaker 233. At this time, the touch panel monitor 92 displays the music selected by the user, that is, the music name of the music output from the speaker 233.

  The output of BGM is not started by the user's operation on the touch panel monitor 92, but the output of BGM is started when a predetermined time has elapsed since the movement of the user to the shooting space has been detected. You may do it.

  Subsequently, the imaging processing unit 302 controls the touch panel monitor 92, the speaker 233, and the like to provide guidance for up-shooting that captures an image in which the face and upper body of the user standing upright are straight, and then step S52. In the up-shooting.

  Specifically, the imaging processing unit 302 controls the camera 91 to start capturing an image showing a range from the top of the user's head to the vicinity of the waist, and a moving image (live view) captured by the camera 91 is started. Image) is displayed on the touch panel monitor 92 (live view display is performed). Next, the imaging processing unit 302 displays a countdown indicator on the touch panel monitor 92 and notifies the user of the imaging timing. When the shooting timing comes, the shooting processing unit 302 controls the camera 91 to perform shooting, and obtains an up shot image that is a still image in which the face and upper body of the user standing straight are directly reflected. . The acquired up-captured image is displayed on the touch panel monitor 92 as a shooting result.

  When the up-shooting is performed twice in step S52, the shooting processing unit 302 controls the touch panel monitor 92, the speaker 233, and the like so that the face of the user standing upright and the upper body of the user are tilted to the left or right. After performing the guidance for the lick shooting for shooting, the lick shooting is performed twice in step S53.

  The details of the licking are basically the same as the up-shooting, so the explanation is omitted. However, the licking shoots the face and upper body of the user standing upright. A licked image that is a still image is acquired.

  When the slant photographing is performed twice in step S53, the photographing processing unit 302 controls the touch panel monitor 92, the speaker 233, and the like, and performs whole body photographing guidance for photographing an image showing the whole body of the user standing upright. After that, in step S54, the whole body imaging is performed twice.

  The details of the whole body photography are also basically the same as the up photography, so the explanation is omitted, but the whole body photography shows a whole body photography image that is a still image of the whole body of a standing user. To be acquired.

  In this way, the first to sixth shootings out of the seven shootings are performed. During this time, the music selected in the pre-service process is output as BGM via the speaker 233.

  Here, an example of a shooting screen displayed on the touch panel monitor 92 during the first to sixth shooting will be described with reference to FIG.

  In the lower area of the shooting screen, there are six images obtained by combining each of the six background images included in the set background selected in the pre-service process and each of the six model images shot using the model as a subject. Sample images 521-1 to 521-6 are displayed. In the example of FIG. 15, six background images constituting the set background 431 selected in the pre-service process are combined with the sample images 521-1 to 521-6 and displayed.

  The background image combined with each of the sample images 521-1 to 521-6 is combined with each of the captured images obtained by the first to sixth capturing. That is, for example, the background image combined with the sample image 521-1 is combined with the up-captured image obtained by the first shooting, and the background image combined with the sample image 521-3 is acquired by the third shooting. The background image combined with the sampled licked image and combined with the sample image 521-5 is combined with the whole-body captured image obtained by the fifth imaging.

  On the shooting screen, when n (n is an integer from 1 to 6) shooting is performed, the sample image 521-n is displayed in a large size, and the live view image display area is displayed at approximately the center of the shooting screen. In 522, the live view image captured by the camera 91 is displayed on the background image synthesized with the sample image 521-n.

  In the example of FIG. 15, the sample image 521-2 is displayed in a large size, and the live view image 531-2 is combined with the background image combined with the sample image 521-2 and displayed in the live view image display area 522. ing. That is, FIG. 15 shows an example of a shooting screen when the second shooting is performed.

  Here, as described above, the background image corresponding to the second shooting includes the foreground image combined with the foreground of the subject in addition to the image combined with the background of the subject. Specifically, in the example of FIG. 15, a stamp image 551 imitating a cap on the head of each of the two users shown in the live view image 531-2 is a heart-shaped stamp image 552 in the approximate center of the live view image. Are synthesized as foreground images.

  In the live view image, the stamp image 551 is combined with the position of each user's head, with the size and orientation adjusted according to the size and orientation of each user's face (head). On the other hand, the stamp image 552 is synthesized at a predetermined position regardless of the positions of the two users and the size and orientation of the face.

  On the left side of the live view image display area 522 on the shooting screen, the background image combined with the sample image 521-1 is displayed by being combined with the shot image 531-1 obtained by the first shooting. On the right side of the view image display area 522, a background image 531-3 synthesized with the sample image 521-3 and a background image 531-4 synthesized with the sample image 521-4 are three-dimensionally superimposed. It is displayed as it is.

  When the second shooting is finished, the up shot image obtained as a result of shooting is displayed symmetrically with the background images 531-3 and 531-4 on the left side of the live view image display area 522 on the shooting screen. In the area where the sample image 521-2 was displayed, the up-captured image obtained by the second shooting is displayed instead of the sample image 521-2.

  Next, when the third shooting is performed, the sample image 521-3 is displayed in a large size, and the background image 531-3 displayed on the right side of the live view image display area 522 is displayed in the live view image display area 522. Moves and is combined with a live view image (the subject is not shown) and displayed.

  In this way, when the shooting is performed sequentially and the sixth shooting is finished, the shooting processing unit 302 controls the touch panel monitor 92, the speaker 233, and the like to provide guidance for collage shooting. Collage shooting is performed as the second shooting.

  By collage shooting, a collage shooting image in which an image of a subject is arranged on a design image having a predetermined design is obtained as a seventh shooting image.

  When the seventh shooting is finished, in step S56, the shooting processing unit 302 displays an eye / brightness selection screen on the touch panel monitor 92, and accepts an instruction from the user, whereby the subject (user) in the shot image is displayed. The eye size and skin brightness of the subject are selected, and the eye size and skin brightness of the subject in the first to seventh photographed images are changed to the selected eye size and skin brightness. Process to change.

  After a predetermined time has elapsed after the processing of step S56, the imaging processing unit 302 stops outputting the BGM (music) that is output via the speaker 233 and selected by the user in the pre-service process. Thereafter, the process returns to step S5 in FIG. 11, and the subsequent processes are performed.

  As described above, in the photo sticker creating apparatus according to the present embodiment, in the live view image, the stamp image corresponding to a predetermined part (organ) of the user's face corresponds to the size and orientation of the user's face. The size and orientation of the image are adjusted and combined with the face of the user in the live view image.

  Therefore, in the following, a configuration and processing flow for realizing the display of the live view image as described above will be described.

<Functional Configuration Example of Photo Sticker Making Device of the Present Invention>
FIG. 16 is a block diagram showing a functional configuration example of the photo sticker creating apparatus 1 of the present invention. Of the functional blocks shown in FIG. 16, the composition processing unit 611 and the display control unit 612 are realized by a predetermined program being executed by the CPU in the control unit 201.

  The synthesis processing unit 611 synthesizes a synthesis image (stamp image) corresponding to a predetermined part of the user's face in the captured image captured by the camera 91. The captured image may be a live view image that is a moving image that is displayed in real time, or a captured image that is a still image captured by the camera 91 at a predetermined timing such as when shooting is instructed by the user. It may be.

  The display control unit 612 causes the monitor 613 to display a captured image in which the stamp image is combined with a predetermined part of the user's face by the combining processing unit 611.

  The monitor 613 is configured as a touch panel monitor provided in the photo sticker creating apparatus 1 and performs display based on the control of the display control unit 612.

<Display Process by Photo Sticker Making Device of the Present Invention>
Next, with reference to the flowchart of FIG. 17, the display process performed by the photo sticker creation apparatus 1 of FIG. 16 will be described. The display process in FIG. 17 is executed, for example, when the live view image 531-2 is displayed on the shooting screen shown in FIG.

  In step S71, the composition processing unit 611 recognizes the user's face in the live view image captured by the camera 91 as the captured image. Face recognition is performed by extracting features such as the relative position and size of each part of the face (such as eyes and nose), shape, and face contour. According to face recognition, the number of faces (that is, the number of users), face orientation, gender, age, facial expression, and the like can be estimated.

  In step S72, the composition processing unit 611 determines whether there are four or less users based on the recognition result of the user's face. If it is determined that there are four or less, the process proceeds to step S33.

  It should be noted that the number of users may be determined based on the number of persons appearing in a captured image obtained by already performed shooting, instead of the recognition result of the user's face.

  In step S73, the composition processing unit 611 synthesizes the stamp image corresponding to the user's face part with the user's face part recognized in the live view image. At this time, the composition processing unit 611 adjusts the size and orientation of the stamp image in accordance with the recognized size and orientation of the user's face, and uses the stamp image in the user corresponding to the live view image. Synthesize to the face part of.

  Note that the orientation of the user's face includes not only the orientation on the two-dimensional plane in the live view image, but also the orientation of shaking the face left and right and the orientation of nodding up and down. In this case, the orientation of the stamp image is adjusted so as to be deformed in the depth direction in addition to the orientation on the two-dimensional plane in the live view image. Therefore, for example, when the user's face is facing obliquely sideways, the stamp image combined with the eye portion is compared with the stamp image combined when the user's face is facing front. It becomes a shape that seems to collapse vertically. Also, when the user's face is facing diagonally upward, the stamp image that is combined with the eye portion is horizontal compared to the stamp image that is combined when the user's face is facing the front. The shape looks like it is crushed.

  Here, the stamp image is assumed to be a still image, but may be an animation image.

  In step S <b> 74, the display control unit 612 displays the live view image combined with the stamp image on the monitor 613 configured as the touch panel monitor 92.

  Since the live view image is a moving image displayed in real time, in step S33, the stamp image has a size and orientation that matches (follows) the movement of the user in the live view image. Synthesized while adjusting. In this case, an average value of the motion amount may be obtained for each predetermined number of frame images constituting the moving image, and the size and orientation of the stamp image may be adjusted based on the average value. .

  On the other hand, if it is determined in step S72 that the number of users is not four or less, that is, more than five, no stamp image is displayed on the live view image, and the process ends.

  According to the above processing, in the live view image displayed on the shooting screen of FIG. 15, each user's head is matched with the size and orientation of the user's face in accordance with the movement of the two users. Since the stamp image 551 is synthesized and displayed, there is no need for the user to change the standing position and posture according to the stamp image displayed in advance on the live view image, and it is easier and more interesting. It is possible to provide a certain image.

  In addition, when the number of users is large and the stamp image is combined with each user's face, the appearance of the finally obtained captured image may be complicated. Therefore, in the above processing, when the number of users is more than five, the stamp image is not displayed, so that the appearance of the finally obtained captured image is avoided from being complicated. Will be able to.

  In the example of FIG. 15, the shape of the stamp image is deformed according to the position of each user's face. Specifically, when the position of each user's face is closer than a predetermined distance, the cap collar of the stamp image 551 synthesized on each user's head is directed outward (in the direction where there is no user). In addition, the shape of the stamp image 551 is deformed.

  As a result, the stamp images 551 are combined with each other without overlapping each other.

  When the number of users is three or more, the collars of the caps of the stamp image 551 that are combined with the heads of users other than the users at both ends are combined with at least the heads of the adjacent users. The shape is deformed so as not to overlap the stamp image 551. For example, even when a stamp image imitating a ponytail of a hairstyle is synthesized on the user's head as a stamp image, the ponytail portion overlaps at least the stamp image synthesized on the head of the adjacent user. The shape is deformed so that it does not become.

  In addition, when the stamp images 551 overlap with each other, a message notifying that effect may be displayed on the shooting screen, sound may be output from the speaker 233, or either one of the stamp images 551 may be displayed. The overlapping part or the whole may be erased.

  Furthermore, depending on the orientation and size of the user's face and the shape of the combined stamp image, a part of the combined stamp image may be displayed in a live view image. Also, in this case, a message prompting the user to change the standing position is displayed on the shooting screen, such as “Please lower a little!” So that the shape of the combined stamp image is appropriate, You may make it output from the speaker 233. FIG.

  In the above, an example of a stamp image synthesized on the user's head as a predetermined part of the user's face has been described, but a stamp image synthesized on other parts other than the user's head is prepared. You may make it do.

  18 to 22 show examples of live view images in which other stamp images are combined.

  In the example of FIG. 18, a stamp image 631 that imitates a flame is synthesized as a foreground image on both eyes of each of two users shown in the live view image 531.

  In the live view image 531, the stamp image 631 is synthesized in the position of both eyes of each user, with the size and orientation adjusted according to the size and orientation of each user's face.

  In the example of FIG. 19, a stamp image 632 simulating sunglasses is synthesized as a foreground image on each of both eyes of two users shown in the live view image 531.

  In the live view image 531, the stamp image 632 is combined with the position of both eyes of each user, with the size and orientation adjusted according to the size and orientation of each user's face.

  In the example of FIG. 20, a stamp image 633 simulating lips is synthesized as a foreground image on each mouth portion of two users shown in the live view image 531.

  In the live view image 531, the stamp image 633 is synthesized in the position of each user's mouth, with the size and orientation adjusted according to the size and orientation of each user's face.

  In the example of FIG. 21, a stamp image 634 simulating a blond female wig is synthesized as a foreground image on the head of each of the two users shown in the live view image 531.

  In the live view image 531, the stamp image 634 is combined with the position of the head of each user, with the size and orientation adjusted according to the size and orientation of each user's face.

  The above-described stamp image is determined by the set background selected in the pre-service process. However, when there are a plurality of users, different stamp images may be combined for each user. . Specifically, a stamp image corresponding to the gender and age of each user identified by face recognition is synthesized for each user.

  For example, when two users appearing in the live view image 531 shown in FIG. 22 are identified by the face recognition, the right user is identified as a female and the left user is identified as a male. A stamp image 634 simulating a blond female wig is synthesized with the head portion of the user, and a stamp image 635 simulating a male wig is synthesized with the head portion of the left user.

  Note that the gender and age of each user may not be identified by face recognition, but may be selected by the user himself before shooting. In this case, guidance for guiding the user's standing position is output so as not to change the positional relationship of the user such that the right user is a female and the left user is a male.

  In addition to the above-described stamp image, a stamp image to be combined with the user's nose portion or ear portion may be prepared.

  If face recognition is not correctly performed in the live view image and a part of the face is not detected, a stamp image corresponding to the detected part may be synthesized. For example, when the user closes his eyes, a stamp image simulating sunglasses is not synthesized, but a stamp image simulating a wig is synthesized.

  Further, the smile level of the user may be determined by face recognition, and the stamp image to be combined may be changed based on the determined level.

  Furthermore, the stamp image to be combined may be changed according to the position of each user's face. When each user's face position is closer than a predetermined distance, each user is assumed to be a close friend or a couple. For example, in the example of FIG. 15, each stamp image 551 imitating a cap is used. Instead, a stamp image imitating a combined umbrella covering the heads of two users may be synthesized.

  As described above, it is possible to provide a more interesting image.

  In the above, an example of displaying a live view image when up-shooting is performed as a live view image has been described, but a live view image when performing full-body shooting includes hands, feet, A stamp image corresponding to a predetermined part of the user's body such as the waist (for example, a stamp image simulating gloves, boots, a tail, etc.) may be synthesized. In this case, in order to recognize the user's body in the live view image, the stamp image is synthesized based on the result of person detection processing using identification of the skin color area, motion capture, or the like.

  In the above description, a button for preventing the stamp image displayed in the live view image from being displayed may be provided on the shooting screen.

  In addition, the stamp image described above is also synthesized with a photographed image as a photographing result, and the photographed image obtained by synthesizing the stamp image is an object to be edited in the editing process.

<Example of editing screen>
Here, an example of an editing screen displayed in the editing process will be described with reference to FIG.

  The editing screen is provided with two main configurations except for a part, but the editing screen shown in FIG. 23 shows only the left half of the editing screen displayed on the tablet built-in monitor 131. Yes.

  In the image to be edited display area 711, a photograph corresponding to a thumbnail image selected by the user from thumbnail images P1 to P6 corresponding to six photographed images of the seven photographed images shown on the upper side is displayed. An image is displayed as an image to be edited.

  In the example of FIG. 23, the stamp image 551 is combined with the head portion of each of the two users in the editing target image, and the stamp image 552 is combined approximately at the center of the editing target image.

  On the left side of the editing target image display area 711, a mobile phone bonus button 712 that is operated when editing an image to be transmitted to the server, and a predetermined graffiti editing for the editing target image can be performed by one operation. A one-time scribing button 713 operated when performing is displayed.

  When the mobile phone bonus button 712 is operated, a mobile phone bonus (a standby image for a mobile terminal or an image attached to an e-mail, a blog, or the like) can be created. Further, when the one-time scribing button 713 is operated, an edited image in which a plurality of compositing images are combined can be created by a single operation.

  Further, on the lower side of the one-time scribing button 713, when the graffiti editing dedicated to the photographed image is performed on one photographed image that is not displayed as the thumbnail images P1 to P6 among the seven photographed images. A special graffiti button 714 to be operated is displayed.

  Below the editing target image display area 711, the user selects an editing tool that provides an editing function for performing graffiti editing on the editing target image displayed in the editing target image display area 711. The editing palette 715 is displayed.

  In the editing palette 715, editing tools are classified and displayed in tabs for each category such as “Recommendation”, “Pen”, “Stamp”, “Message”, “Makeup”, and “Prank”. In the example of FIG. 23, the “mischievous” tab is selected.

  Further, as shown in FIG. 23, the “mischievous” tab includes editing tools such as “one-shot mischief”, “mischievous”, “match”, “balloon”, and “sunglasses / glasses”. In the example of FIG. 23, the “one shot mischief” button is selected in the editing palette 715.

  In the editing palette 715 for which the “one shot mischief” button has been selected, as a set of a plurality of stamp images classified for each group, a glasses stamp image group 731, a fake ear stamp image group 732, and a Hana stamp image group 733 and a part stamp image group 734 are displayed.

  Here, as the stamp images included in each group (stamp image group), stamp images classified according to a predetermined part of the user in the image to be edited, specifically, a part of the face, are displayed. When one of the stamp images is selected, each part of the face is recognized by the editing processing unit 303 based on the face recognition process, and the selected stamp image is displayed on the face corresponding to the group. Synthesized at the site.

  For example, the glasses stamp image group 731 is composed of images for synthesis classified into a group of stamp images imitating glasses and sunglasses, which are synthesized with the eyes of the user in the editing target image. When one of the stamp images included in the glasses stamp image group 731 is selected in the editing palette 715, the stamp image is displayed on each of the user's eyes in the editing target image displayed in the editing target image display area 711. This part is synthesized in a lump.

  Note that the editing function using the “one shot mischief” button is such that the display process described with reference to FIG. 17 is performed with the captured image as the editing target image in the configuration described with reference to FIG. Can be realized.

  An eraser button 716 for erasing a part or all of the stamp image corresponding to the part of the user's face combined with the part of the user's face in the photographing process is provided above the right side of the edit target image display area 711. ing.

  Here, the details of the eraser button 716 will be described with reference to FIG.

  The eraser button 716 is provided with a sticking and mischievous eraser button 751, a frame eraser button 752, and a dedicated eraser button 753.

  The sticking and mischievous eraser button 751 is a button for erasing a stamp image corresponding to the part of the user's face synthesized in the photographing process. Note that the stamp image corresponding to the part of the user's face in the imaging process is hereinafter referred to as “sticking mischief” as appropriate.

  As shown on the left side of FIG. 24, when the sticking / erasing eraser button 751 is pressed by the user's input in a state where “sticking / erasing / erasing” button 751 is displayed, the sticking / erasing button 751 is stuck in the editing target image. The mischief is erased, and the display of the sticky mischief eraser button 751 changes to “return sticky mischief” as shown on the right side of FIG.

  On the contrary, as shown in the right side of FIG. 24, when the sticking / erasing eraser button 751 is pressed by the user's input in the state where the sticking / erasing eraser button 751 is displayed as “return to sticking / missing”, the editing target is displayed. The stuck mischief erased in the image is displayed again, and the display of the stuck mischievous eraser button 751 changes to “tacking mischief mischief” as shown on the left side of FIG.

  The frame eraser button 752 displays a stamp image (for example, a stamp image 552) combined at a predetermined position in the shooting process regardless of the position of the two users and the size and orientation of the face in addition to the sticking and mischief. It is a button for deleting.

  As shown on the left side of FIG. 24, when the frame eraser button 752 is pressed by a user input while the frame eraser button 752 is displayed as “frame erase”, in the shooting process on the image to be edited. All the combined stamp images are erased, and the display of the frame eraser button 752 changes to “return to frame” as shown on the right side of FIG.

  On the contrary, as shown on the right side of FIG. 24, when the frame eraser button 752 is pressed by the user's input while “return frame” is displayed on the frame eraser button 752, the image to be edited is erased. The stamp image synthesized in the photographing process is displayed again, and the display of the frame eraser button 752 changes to “frame erase” as shown on the left side of FIG.

  The dedicated eraser button 753 is a button for partially erasing the stamp image synthesized in the photographing process including the sticking-up mischief. When the dedicated eraser button 753 is pressed by the touch pen 132A or 132B and a part of the stamp image synthesized in the photographing process such as the sticking mischief synthesized in the image to be edited is selected, these stamp images The selected part is erased.

  As described above, the stamp image synthesized in the photographing process is edited according to the user's input.

  It should be noted that, as a stamp image displayed on the editing palette 715, a stamp image identical to the stamp image (sticking mischief) synthesized in the photographing process is prepared, and when the stamp image is selected, the face recognition process is performed. The selected stamp image may be combined with the corresponding facial part after each part of the face is recognized based on the recognition result. As a result, even if the position at which the sticking mischief is combined is shifted in the photographing process, the position can be corrected to an appropriate position in the editing process. In the editing process, the position at which the sticking mischief is combined may be determined by a user input.

  Furthermore, when the fine adjustment button for finely adjusting the position of the stamp image combined with the image to be edited is provided on the editing screen, the position where the sticking mischief is combined in the shooting process is shifted. Even so, the position can be corrected to an appropriate position in the editing process.

<Example of collage image>
As described above, in the shooting process, collage shooting is performed as the seventh shooting, and a collage shooting image is obtained.

  Here, an example of a collage photographed image will be described with reference to FIGS. 25 and 26.

  In the example of FIG. 25, the captured images 811 and 812 are arranged vertically so as to be adjacent to each other on the left side of the collage captured image 810, and the captured images 813, 814, and 815 are adjacent to each other on the right side of the collage captured image 810. Are arranged vertically. A design image having a predetermined design is arranged between the captured images 811 and 812 and the captured images 813, 814 and 815.

  The captured images 811 to 815 are all the seventh captured images obtained by the seventh capturing, and the captured images 811 to 813 and 815 are a part thereof, and the captured image 814 is all of them. The captured image 811 and the captured image 815 are images obtained by dividing the seventh captured image at a certain position, and the captured image 812 and the captured image 813 are the seventh captured image at another certain position. This is a divided image. That is, the image obtained by combining the photographed image 811 and the photographed image 815 and the image obtained by combining the photographed image 812 and the photographed image 813 are both the seventh photographed image.

  In the example of FIG. 26, the captured image 821 is disposed on the left side of the collage captured image 820, and the captured images 822 to 824 are vertically disposed on the right side of the collage captured image 820 so as to be adjacent to each other. A design image having a predetermined design is arranged between the captured image 821 and the captured images 822 to 824.

  Each of the captured images 821 to 824 is also a seventh captured image obtained by the seventh capturing operation. The captured images 822 to 824 are a part of the captured image and the captured image 821 is the entire captured image. The photographed images 822 to 824 are all the same part of the seventh photographed image, and are each subjected to different image processing (filter processing for changing the brightness, transparency, and color tone of the image).

  As described above, according to the collage shooting in the photo sticker creating apparatus 1 of the present embodiment, it is possible to provide a user with an image with a finish that has never been achieved.

  In the above-described example, the photographed image arranged in the collage photographed image is based on one photographed image obtained by the seventh photographing, but is obtained by the first to seventh photographing. Alternatively, seven photographed images may be arranged.

  In the above-described example, the plurality of photographed images arranged in the collage photographed image are arranged vertically so as to be adjacent to each other, but may be arranged horizontally or in a matrix form. It may be arranged.

  Also, at the time of the seventh shooting (collage shooting), a predetermined sticking prank (a stamp image corresponding to a predetermined part of the face) may be combined with the live view image. In this case, in the collage photographed image, a photographed image that reflects the composition of the sticking and mischief and a photographed image that does not reflect the composition of the sticking and mischief may be arranged.

  As described above, in the pre-service process performed before the shooting process, the background image (set background) is selected in the editing process performed after the shooting process after the user selects a background image (set background). ) May be selected again to change the background image combined with the captured image.

  In addition, in the pre-service process performed before the shooting process, the user does not select the background image (set background), but in the editing process performed after the shooting process, the background image (set background) is displayed to the user. You may make it select.

  In this case, for example, each of the captured images obtained by the imaging process may be combined with each of the background images constituting the set background displayed on the set background selection screen.

<Other embodiments>
By the way, in the photo sticker creating apparatus of the above-described embodiment, the pre-serving process is performed in the pre-service section 208, but the pre-service section 208 is not provided and the pre-service process is not performed. Good. In this case, the coin insertion / return port 74 is provided in the photographing unit 21, and the coin processing unit 221 is provided in the photographing unit 209.

  That is, in the processing of the photo sticker creating apparatus 1 described with reference to the flowchart of FIG. 11, in step S1, the photographing processing unit 302 determines whether or not a predetermined amount of coins has been inserted in the photographing space. The determination is made based on the signal supplied from 221. If it is determined that a coin has been inserted, steps S2 to S4 are skipped, and the subsequent shooting process and editing process are performed.

<Flow of shooting process>
Here, with reference to the flowchart of FIG. 27, the flow of the imaging process in the present embodiment will be described.

  In step S <b> 111, the imaging processing unit 302 displays a course selection screen on the touch panel monitor 92. The course selection screen is a screen used for selecting a shooting course according to the number of users.

  FIG. 28 is a diagram illustrating an example of a course selection screen.

  A message “Please select the course you want to shoot” is displayed at the upper center of the course selection screen, and a selection button 901 that is operated (selected) when selecting a two-person course is provided on the lower left side of the message. . The selection button 901 displays a sample of an image obtained when shooting is performed in a course for two people. A selection button 902 that is operated when selecting a couple course is provided on the right side of the selection button 901. The selection button 902 displays a sample of an image obtained when shooting is performed in a couple course.

  Below the course selection screen, a selection button 903 that is operated when selecting a course for three persons, a selection button 904 that is operated when selecting a course for four persons, and an ID photo course are selected. A selection button 905 to be operated is provided side by side. The selection button 903 displays a sample of an image obtained when shooting in a course for three people, and the selection button 904 displays a sample of an image obtained when shooting in a course for four people. Has been. The selection button 905 displays a sample of an image obtained when the ID photo course is taken.

  Although the detailed explanation is omitted, the ID photo course is a course for receiving ID photo images that can be used for ID photos. In the ID photo course, a predetermined pose for the ID photo is provided. The process of taking the image, adjusting the ID photo image selected from the photo images obtained by the image taking, and printing the adjusted ID photo image are performed.

  In the following, processing when a shooting course other than the ID photo course is selected will be described.

  In step S112, the imaging processing unit 302 performs imaging according to the course selected on the course selection screen.

  For example, when a course for 2 people, a couple course, and a course for 3 people are selected, a total of 7 shootings are performed, and when a course for 4 people is selected, a total of 6 times is taken. Shooting is performed. In addition, the captured images obtained in the courses of two-person course, couple course, three-person course, and four-person course have different aspect ratios. Specifically, as the number of people increases, the obtained captured image becomes a horizontally long image.

  In each course, a photographed image obtained by the first photographing is a target of a retouch process performed in an editing process described later. The retouch process is a process for processing a predetermined portion of a subject (user) in a captured image based on a user operation.

  Further, in each course, the last shooting (that is, the seventh shooting when the two-person course, the couple course, and the three-person course are selected, and the sixth shooting when the four-person course is selected). The second shooting) is shooting for obtaining an image to be transmitted to the mobile terminal.

  If a predetermined time elapses after the coin is inserted and before the first shooting is performed, shooting one time before the last shooting (that is, two-person course, couple course, and 3 When the human course is selected, the sixth shooting is skipped, and when the four-person course is selected, the fifth shooting) is skipped.

  The photographing process is performed as described above.

<Editing process flow>
Next, the flow of editing processing in the present embodiment will be described with reference to the flowchart in FIG.

  When the editing process is started, in step S131, the editing processing unit 303 displays a name input screen on the tablet built-in monitor 131. The name input screen is a screen used for inputting a user's name.

  In step S <b> 132, the edit processing unit 303 displays a sex selection screen on the tablet built-in monitor 131. The gender selection screen is a screen used for selecting the gender of the user. The sex selection screen is displayed only when a couple course is selected in the shooting process. If a course for two, three, or four is selected in the shooting process, step S132 is displayed. Is skipped.

  FIG. 30 is a diagram illustrating an example of a sex selection screen.

  A message “Please choose gender” is displayed at the upper center of the gender selection screen, and a face image display area 911L and a face image display area 911R are provided separately below. The face image display area 911L is an area in which a face of a person shown on the left side, which is trimmed from a shot image showing two users obtained by the first shooting in the shooting process, is enlarged and displayed. The face image display area 911R is an area in which the face of a person shown on the right side is displayed in an enlarged manner.

  Gender selection buttons 912L and 912R are provided on the left side of the face image display area 911L and on the right side of the face image display area 911R, respectively. The sex selection buttons 912L and 912R are buttons for selecting the gender of the person displayed in the corresponding face image display areas 911L and 911R, respectively. When either “female” or “male” is selected on one of the sex selection buttons 912L, 912R, the other of the sex selection buttons 912L, 912R is not selected on one of the sex selection buttons 912L, 912R. The gender is automatically selected.

  In the example of FIG. 30, a male face is displayed in the face image display area 911L, and “male” is selected in the sex selection button 912L. On the other hand, a female face is displayed in the face image display area 911R, and “female” is selected in the sex selection button 912R.

  Based on the gender selected here, an editing tool corresponding to the standing position with respect to the tablet built-in monitor 131 is provided in the graffiti editing process described later.

  In step S133, the edit processing unit 303 displays a retouch screen on the tablet built-in monitor 131. The retouch screen is a screen for accepting changes in the size and brightness of the subject's eyes, the size of the face, and the brightness of the skin for each subject (user) that appears in the captured image. On the retouch screen, an image obtained by trimming the face area of each subject from the photographed image obtained by the first photographing in the photographing process is displayed. When the user performs a predetermined operation on the retouch screen, a retouch process is performed to change the size and brightness of the subject's eyes, the size of the face, and the brightness of the skin in each captured image.

  In step S134, the edit processing unit 303 displays a set background selection screen on the tablet built-in monitor 131.

  When the set background is selected, the tablet built-in monitor 131, the speaker 241 and the like are controlled, and images and voices for guiding the flow of the graffiti work are output, so that the graffiti work guidance is given to the user. .

  Thereafter, in step S135, the editing processing unit 303 displays an editing screen on the tablet built-in monitor 131.

  In step S136, the editing processing unit 303 controls each unit of the editing unit 210A or the editing unit 210B (one in which the user performs editing work), and performs a graffiti editing process for receiving a graffiti work on the photographed image by the user. Do.

  When the graffiti work is completed, in step S137, the editing processing unit 303 displays a division number selection screen on the tablet built-in monitor 131. The division number selection screen is a screen for selecting the division number of the sticker paper, and the sticker layout is determined by the user selecting the division number of the sticker paper.

  In step S138, the edit processing unit 303 causes the tablet built-in monitor 131 to display a mobile transmission confirmation screen. The mobile transmission confirmation screen displays whether a captured image obtained by the photographing process or an edited image obtained by the editing process is transmitted to a portable terminal such as a cellular phone owned by the user via an external server. This is a screen for letting the user select.

  The editing process is performed as described above.

<Example of set background selection screen>
Here, the set background selection screen displayed in step S134 of the editing process of FIG. 29 will be described.

(Example of set background selection screen for 2-person course, 3-person course, or 4-person course)
FIG. 31 shows an example of a set background selection screen that is displayed when a course for two people, a course for three people, or a course for four people is selected in the photographing process.

  In the upper center of the set background selection screen, a message “Please choose your favorite set background” is displayed, and below it, six captured images are displayed in 2 rows and 3 columns. As described above, the set background is a set of preset background images, and is composed of a plurality of background images selected along a predetermined theme. When there are six captured images, one set background is composed of a combination of six background images. The user can select a set background to be combined with the captured images 921-1 to 921-6 on the set background selection screen.

  The photographed images 921-1 to 921-3 are arranged in order from the left in the upper part of the six photographed images, and the photographed images 921-4 to 921-6 are arranged in order from the left in the lower part. The captured images 921-1 to 921-6 are arranged in the order of shooting, for example. The background of the user shown in the captured images 921-1 to 921-6 is immediately changed according to the selection of the background image.

  Below the photographed images 921-1 to 921-6, a set background palette 922, which is a horizontally long area in which a set background as an option is displayed, is provided, and on the right side of the photographed images 921-1 to 921-6. In addition, an OK button 923 for determining the set background selected in the set background palette 922 as a set background to be combined with the captured images 921-1 to 921-6 is provided.

  In the set background palette 922, the set background is displayed on tabs for each genre such as “naughty”, “pastel”, “vivid”, and “color”. In the example of FIG. The tab is selected. The “Color” tab includes “Monochrome Set”, “Gray White Set”, “Nudy Set”, “Pastel Set”, “Gray x Pink Set”, “Pastel Blue Set”, “Mint Pastel Set”, “Monotone Wall” Eight set backgrounds 931 to 938 of “set” are displayed for each theme.

  Each of the set backgrounds 931 to 938 displayed on the “Color” tab is given a theme indicating the type of color, and each of the set backgrounds 931 to 938 displayed on the “Color” tab is in accordance with the theme. Six background images with a sense of unity are arranged.

  Further, a person ON button 941 and a person OFF button 942 are provided on the lower right side of the set background palette 922. When the person ON button 941 is selected, each of the set backgrounds displayed on the set backgrounds 931 to 938 displayed on the set background palette 922 is displayed in a state where six photographed images are combined. When the person OFF button 942 is selected, each set background is displayed in a state in which six photographed images are not combined.

  In the example of FIG. 31, the person OFF button 942 is selected, and each of the set backgrounds 931 to 938 displayed on the set background palette 922 is displayed in a state where six photographed images are not combined.

  FIG. 32 shows an example of a set background selection screen when the person ON button 941 is selected from the state of FIG. 31. Each of the set backgrounds 931 to 938 displayed on the set background palette 922 has six sheets. The captured image is displayed in a synthesized state.

  Thus, by displaying each set background as an option displayed on the set background palette 922 in combination with the captured image, the user can confirm the finish of the captured image after combining the set background. The set background can be selected.

  Note that, in the set background, the background images are arranged in the shooting order of the shot images to be combined.

  FIG. 33 shows an example of a set background selection screen when the “mischievous” tab is selected in the set background palette 922.

  In the “Prank” tab, “Prank Set 1”, “Prank Set 2”, “Prank Set 3”, “Prank Set 4”, “Prank Set 5”, “Prank Set 6”, “Prank Set 7”, “ Eight set backgrounds 951 to 958 of “Naughty set 8” are displayed for each theme. Each of the set backgrounds 951 to 958 displayed on the “Naughty” tab is given various themes that express the fun with illustrations and designs. The set backgrounds 951 to 958 displayed on the “Mischief” tab are also configured by arranging six background images with a sense of unity that match each theme.

  When the “mischievous” tab is selected in the set background palette 922, the set background palette 922 is not provided with the person ON button 941 and the person OFF button 942, and the set background 951 displayed on the set background palette 922 is displayed. Each of 958 to 958 is displayed in a state where six photographed images are combined.

  That is, in the set background palette 922 in which the “mischievous” tab is selected, each of the set backgrounds 951 to 958 is always displayed in a state where six captured images are combined.

  Further, as a background image constituting the set background displayed on the set background palette 922 in which the “mischievous” tab is selected, in addition to an image combined with the background of the subject in the photographed image, a stamp combined with the foreground of the subject Background images including foreground images such as images and frame images are prepared. This foreground image is also adapted to the theme of each set background. It is assumed that the foreground image is included in all six background images constituting the set background, but the foreground image may be included in a predetermined number of background images among the six background images.

  Specifically, as shown in FIG. 34, stamp images simulating the ears of rabbits are placed on the heads of the two users shown in the photographed image 921-1 displayed on the set background selection screen of FIG. 961 is below the photographed image 921-1, a heart-shaped stamp image 962 and a stamp image 963 including a predetermined character string are respectively synthesized as a foreground image.

  In the photographed image 921-1, the stamp image 961 is synthesized in the position of each user's head, with the size and orientation adjusted according to the size and orientation of each user's face (head). . On the other hand, the stamp images 962 and 963 are synthesized at predetermined positions regardless of the positions of the two users and the size and orientation of the faces.

  Further, as shown in FIG. 35, the nose and both cheeks of the two users shown in the captured image 921-4 displayed on the set background selection screen of FIG. 33 are the noses of animals such as dogs and cats. A stamp image 971 imitating a beard is combined with a stamp image 972 including a predetermined character string below the photographed image 921-4 as a foreground image.

  In the photographed image 921-4, the size and direction of the stamp image 971 are adjusted according to the size and direction of each user's face, and are combined at the positions of the user's nose and both cheeks. . On the other hand, the stamp image 972 is synthesized at a predetermined position regardless of the positions of the two users and the size and orientation of the face.

  In addition to the stamp image described with reference to FIGS. 34 and 35, the lip image imitating lipstick and the cheek image imitating the cheek applied to the user's cheek, etc. A stamp image may be prepared. With such a stamp image, it is possible to provide a photographed image as if the user himself / herself applied makeup to high school girls and other users who do not usually make up, and to improve user satisfaction Can do.

  Further, the stamp images 962 and 963 in FIG. 34 and the stamp image 972 in FIG. 35 are synthesized at predetermined positions, but depending on the position of the user in the captured image, for example, the face of the user It may be arranged in a position where it does not overlap with the image.

  In the example of FIG. 33, the subjects of the captured images 921-1 to 921-3, 921-5, and 921-6 are all shown in the same pose and arrangement, but actually, different poses and arrangements are used. It will be reflected in. Therefore, the stamp image as the foreground image is adjusted to the size, orientation, and position according to the pose and arrangement of the subject (user) that appears in each captured image, and is combined with each captured image.

  The display function in the “mischievous” tab can be realized by performing the display process described with reference to FIG. 17 using the captured image as the captured image in the configuration described with reference to FIG. it can.

  In the example of FIGS. 31 to 33, when the “pastel” tab or the “vivid” tab is selected in the set background palette 922, the case of the set background palette 922 is the same as when the “color” tab is selected. It is assumed that a person ON button 941 and a person OFF button 942 are displayed on the lower right.

  Also, in step S134 of the editing process of FIG. 29, it is assumed that the “mischievous” tab is selected in the set background palette 922 when the set background selection screen is initially displayed (initial state).

  In the above, the example of the set background selection screen displayed when the course for 2 persons, the course for 3 persons, or the course for 4 persons is selected in the shooting process has been described. An example of a set background selection screen displayed when a couple course is selected will be described.

(Example of couple background set background selection screen)
FIG. 36 shows an example of a set background selection screen displayed when a couple course is selected in the shooting process.

  The set background selection screen shown in FIG. 36 is configured basically in the same manner as the set background selection screen shown in FIG. 31 and the like, but in the set background palette 922, the “naughty” tab, “pastel” tab, “ In addition to the “Vivid” tab and the “Color” tab, a “Couple” tab is provided.

  In the example of FIG. 36, the “couple” tab is selected. In the “couple” tab, there are four set backgrounds 951 to 954 of “mischievous set 1”, “mischievous set 2”, “mischievous set 3”, and “mischievous set 4” displayed on the “mischievous” tab described above. In addition, four set backgrounds 981 to 984 of “couple set 1”, “couple set 2”, “couple set 3”, and “couple couple 4” unique to the “couple” tab are displayed.

  Each of the set backgrounds 981 to 984 displayed on the “Couple” tab is given, for example, a theme representing the goodness of the couple. The set backgrounds 981 to 984 displayed on the “Couple” tab are configured by arranging six background images with a sense of unity that match each theme.

  A person ON button 941 and a person OFF button 942 are provided at the lower right of the set background palette 922. With the person ON button 941 and the person OFF button 942, among the set backgrounds displayed on the set background palette 922, each of the set backgrounds 981 to 984 is displayed in a state where six photographed images are combined, or six sheets are displayed. Can be displayed in a state where the captured images are not synthesized.

  Of the set backgrounds displayed on the set background palette 922, each of the set backgrounds 951 to 954 is displayed in a state in which six photographed images are always combined regardless of the person ON button 941 and the person OFF button 942. Is done.

  As described above, when the “couple” tab is selected in the set background palette 922, the set background palette 922 includes a set background according to the theme about the couple, and a set background according to the theme of the “naughty” tab. Are displayed together.

  The display function in the “couple” tab is the same as the display function in the “mischievous” tab, and the display process described with reference to FIG. 17 is performed using the captured image as the captured image in the configuration described with reference to FIG. It can be realized by making it.

  In a couple course, when a background image including a foreground image that constitutes a set background displayed on a “mischief” tab or the like is combined with a photographed image, the foreground image is combined with a subject (user) It depends on gender. For example, when a background image including the above-described lip image is combined with a photographed image, a lip image imitating a lip with a thick lipstick is combined with a lip portion of a user for a woman, and the use of a man A lip image is synthesized on the lip portion of the person's lips with a lip painted thinly.

  In the couple course, when the set background selection screen is initially displayed (initial state) in step S134 of FIG. 29, the “couple” tab is selected in the set background palette 922. To do.

  In the set background selection screen in the present embodiment, the OK button 923 is operated in a state where a predetermined set background displayed on the set background palette 922 is selected, so that the selected set background is captured. Assume that the set background to be combined with the image is determined. If the OK button 923 is not operated within a predetermined time after the set background selection screen is displayed, the set background selected at that time is determined as the set background to be combined with the captured image. .

  In the above description, the person ON button 941 and the person OFF button 942 are not displayed on the set background palette 922 in which the “tamper” tab is selected. However, the person ON button 941 and the person OFF button 942 are not displayed. It may be displayed. In this case, by selecting the person OFF button 942, the stamp image (foreground image) included in the background image may not be displayed together with the subject (user) combined with the background image.

  Furthermore, in the above description, it is assumed that a stamp image corresponding to a predetermined part of the face is combined with each subject (user) shown in the captured image, but when there are more users than a predetermined number, The stamp image may not be combined with the photographed image, or the “mischievous” tab itself may not be displayed.

  In the above, the background image corresponding to a plurality of photographed images is selected at a time by selecting the set background on the set background selection screen. However, the background images corresponding to the plurality of photographed images are individually selected. You may make it select.

  Further, in the background image including the foreground image described above, the background image and the foreground image are associated with each other on a one-to-one basis. A plurality of matching foreground images may be associated. In this case, with respect to the background image, the user selects a foreground image to be combined with a captured image from a plurality of foreground images.

  Further, when the pre-service process is performed and the user is allowed to select a background image (set background) in the pre-service process, the set background selection screen shown in FIG. Instead of the images 921-1 to 921-6, a model image with the model as a subject may be displayed. Here, when a background image including a stamp image as a foreground image is combined with a model image, in the model image, the stamp image has a size and direction corresponding to the size and orientation of each face of the model. It is adjusted and synthesized at a predetermined position of the model face. The live view image at the time of shooting is displayed in the same manner as described with reference to FIG.

  In the above, an example of displaying a captured image when the up-shooting is performed as the captured image has been described. However, the captured image when the whole-body shooting is performed includes hands, feet, and hips other than the face. A stamp image corresponding to a predetermined part of the user's body (for example, a stamp image imitating a glove, boot, tail, etc.) may be synthesized. In this case, in order to recognize the user's body in the captured image, the stamp image is synthesized based on the identification of the skin color area and the result of the predetermined person detection process.

  Furthermore, in the above, since the aspect ratio of the photographed image differs depending on the photographing course, the stamp image included in the background image constituting the set background displayed on the “prank” tab is changed according to the aspect ratio. It may be. For example, when the aspect ratio of the photographed image is portrait, the stamp image included in the background image constituting the set background displayed on the “tamper” tab may be replaced with a stamp image having a length in the vertical direction. .

  Further, since the stamp image corresponding to a predetermined part of the user's face is in a layer structure and is higher than the photographed image, the stamp image is displayed on the editing screen displayed during the graffiti editing process. After being displayed so as to be selectable by an operation, it can be enlarged / reduced, moved, rotated, and the like in the same manner as other images for synthesis (stamp image or the like).

  Furthermore, when a shot image obtained by combining a stamp image corresponding to a predetermined part of the user's face is transmitted to the mobile terminal, the stamp image is used as an animation image on the shot image displayed on the mobile terminal. The stamp image may be moved and displayed.

  In the above-described embodiment, the photo sticker creating apparatus 1 employs a configuration in which the obtained photographed image or edited image is printed on a sticker sheet and transmitted to the server to be provided to the user's portable terminal. However, it is possible to adopt a configuration in which the photographed image or edited image is only provided to the user's mobile terminal by sending it to the server without printing it on the sticker paper, or conversely, the photographed image or edited image. It is also possible to adopt a configuration that only prints on a sticker sheet without transmitting to the server.

  The series of processes described above can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 9, the recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the main body of the apparatus. Disk), optical disk (including CD-ROM and DVD), magneto-optical disk (including MD), or removable media 205 made of semiconductor memory, etc., but also pre-installed in the main unit The ROM 206 that stores the program and the hard disk included in the storage unit 202 are distributed to the administrator.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  In the above, the printing medium is not limited to sticker paper or photographic paper. For example, printing on a predetermined size of paper or film, poster paper, a card such as a telephone card, or a cloth such as a T-shirt. You may make it do.

  The embodiments of the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus 11 Shooting unit 12 Editing unit 21 Advance customer service part 22 Shooting part 23 Background part 201 Control part 208 Advance customer service part 209 Shooting part 210 Editing part 211 Printing part 301 Advance customer service part 302 Shooting process part 303 304 Print processing unit 611 Composition processing unit 612 Display control unit

Claims (8)

A photograph sticker creating apparatus that photographs a user as a subject, edits the acquired photographed image according to an input by the user, and prints the edited photographed image on a sticker sheet,
A camera for taking a picture of the user as a subject;
By recognizing the user's face in the captured image captured by the camera, an image for synthesis corresponding to a predetermined part of the user's face is recognized. And a composition processing unit that adjusts the size and orientation in accordance with the image and composes it on a predetermined part of the user's face in the captured image;
A photo sticker creating apparatus comprising: a display control unit configured to control display of the captured image in which the synthesis image is synthesized at a predetermined part of the user's face. When the captured image is a live view image displayed in real time before the captured image is acquired,
The synthesis processing unit recognizes the user's face in the captured image, and matches the image for synthesis with the movement of the user in the captured image to match the user's face in the captured image. The photo sticker creating apparatus according to claim 1, wherein the photo sticker creating apparatus synthesizes the predetermined part. The photographic sticker creating apparatus according to claim 1, wherein the composition processing unit synthesizes the composition image that is different for each user with a predetermined part of the face of each of the users in the captured image. The synthesizing processing unit synthesizes the synthesis image with a predetermined part of the user's face in the captured image when a course related to shooting selected by the user before shooting is a predetermined course. Item 4. The photo sticker creating apparatus according to any one of Items 1 to 3. The composition processing unit selects the composition image selected by the user according to a background image serving as a background of the user in the captured image as a predetermined part of the user's face in the captured image. The photo sticker creating apparatus according to claim 1, wherein the photo sticker creating apparatus is combined. 6. The composition processing unit, when the number of users is less than a predetermined number, combines the composition image with a predetermined part of the user's face in the captured image. The photo sticker making apparatus as described. When the captured image is the captured image as a captured result,
An editing unit that edits the captured image according to input by the user,
The photo sticker creating apparatus according to claim 1, wherein the editing unit performs predetermined editing in accordance with an input by the user with respect to the combining image combined with the captured image. In a display method of a photo sticker creating apparatus that takes a photograph of a user as a subject, edits the acquired photographed image according to an input by the user, and prints the edited photographed image on a sticker sheet. There,
By recognizing the user's face in a captured image captured by a camera that captures the user as a subject, a composite image corresponding to a predetermined part of the user's face is recognized. Adjusting the size and orientation of the person's face according to the size and orientation of the face, and synthesizing it to a predetermined part of the user's face in the captured image,
A display method including a step of displaying the captured image in which the synthesis image is synthesized at a predetermined part of the user's face.

Images