JP5975190B1 - Image processing apparatus and image processing method - Google Patents

Abstract

The present invention provides a user with an image exactly as the user imagines, and improves the satisfaction of the user. A photographing processing unit photographs at least one of a plurality of photographings as a special photographing for acquiring a photographed image taken by one user. A plurality of different sample images are generated by performing image processing on the captured image taken by a person, and the image processing applied to the sample image selected by the user is performed among the plurality of captured images. Is applied to at least one other sheet. The present invention can be applied to, for example, a photo sticker creating apparatus that photographs a user as a subject. [Selection] Figure 10

Description

  The present invention relates to an image processing apparatus and an image processing method, and more particularly to an image processing apparatus and an image processing capable of providing a user with an image as the user imagines and improving user satisfaction. Regarding the method.

  Photo provided to the user by shooting the user, allowing the user to edit the image obtained by the shooting, and printing the edited image on sticker paper or sending it to the user's mobile terminal Sealing machines are known. Such a photo sticker is installed in an entertainment facility.

  The flow of one game provided by the photo-seal machine usually shoots a user in the shooting space as a subject, moves the user to the editing space, edits the image according to operations performed in the editing space, The edited image, which is the edited image, is printed on a sticker sheet and discharged.

  In such a photo-seal machine, by analyzing a photographed image obtained by photographing, an advice image for giving advice on makeup, a pose, etc. is presented to the user, and photographing is performed again. There is a photographic seal machine (see, for example, Patent Document 1). Thus, the user can obtain a better finished photographed image while confirming the advice image as a sample.

  In addition, there is a photo sticker that takes a picture after allowing the user to select image processing contents such as reflection and brightness, and applies the image processing selected by the user to the shot image (for example, Patent Document 2).

JP 2004177761 A JP 2007-295114 A

  However, according to the technique of Patent Document 1, the finish of the photographed image obtained by performing the photographing again is not always equal to the finish of the advice image, no matter how good the finish of the sample advice image is.

  Further, in the technique of Patent Document 2, the user cannot know what kind of image processing is actually performed on the photographed image, that is, what kind of finished photographed image can be obtained. It was.

  As described above, in the conventional technique, the image as the user imagined cannot be provided to the user, and the user's satisfaction may be reduced.

  The present invention has been made in view of such a situation, and provides the user with an image as the user imagined, thereby improving the satisfaction of the user.

An image processing apparatus according to an aspect of the present invention performs a plurality of times of shooting with a user as a subject, acquires a plurality of shot images, and at least one of the plurality of shot images. An image processing unit that generates a plurality of different sample images by performing image processing on the image;
A display control unit that controls display of the sample image on a display unit; and a selection reception unit that receives selection of the sample image displayed on the display unit by the user. At least one of the times of shooting is shot as a special shooting for acquiring the shot image taken by the user alone, and the image processing unit takes the shot taken by the user alone. A plurality of different sample images are generated by performing image processing on the image on the image, and the image processing applied to the sample image selected by the user is performed on a plurality of the captured images. Apply to at least one other of them.

An image processing method according to an aspect of the present invention is directed to at least one of a plurality of photographed images, a photographing processing unit that captures a user a plurality of times and obtains a plurality of photographed images. An image processing unit that generates a plurality of different sample images by performing image processing on the image;
An image processing method of an image processing apparatus, comprising: a display control unit that controls display of the sample image on a display unit; and a selection reception unit that receives selection of the sample image displayed on the display unit by the user. The photographing processing unit performs photographing as special photographing for acquiring the photographed image taken by the user alone by at least one of the plural photographings, and the image processing unit A plurality of different sample images are generated by performing image processing on the captured image taken by the user alone, and the sample image selected by the user is applied to the sample image. The image processing includes a step of performing image processing on at least another one of the plurality of photographed images.

  According to one aspect of the present invention, at least one of a plurality of shootings is shot as a special shooting for acquiring a shot image taken by one user, and the user is shot alone. A plurality of different sample images are generated by performing image processing on the captured image, and image processing applied to the sample image selected by the user is at least one of the plurality of captured images. It is applied to the other sheet.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide a user with the image as the user imaged, and to improve a user's satisfaction.

It is a perspective view which shows the structural example of the external appearance of the photograph sticker production apparatus which concerns on one embodiment of this invention. It is the perspective view which looked at the external appearance of the photograph sticker production apparatus from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of an imaging | photography part. It is a figure which shows the structural example of a background part. It is a figure which shows the structural example of an edit part. It is a figure which shows the structural example of a customer service part after the fact. It is a block diagram which shows the example of an internal structure of a photograph sticker production apparatus. It is a functional block diagram which shows the detailed structural example of a control part. It is a functional block diagram which shows the detailed structural example of the imaging | photography process part of FIG. It is a flowchart explaining a photograph sticker creation game process. It is a flowchart explaining the detail of a reflection selection process. It is a figure which shows an example of a reflection selection screen. It is a figure which shows another example of a reflection selection screen. It is a flowchart explaining the detail of a reflection selection process. It is a figure which shows an example of a sample imaging | photography guidance screen. It is a figure which shows an example of special imaging | photography. It is a flowchart explaining the detail of a reflection selection process. It is a flowchart explaining a photograph sticker creation game process. It is a flowchart explaining a photograph sticker creation game process. It is a figure which shows an example of a brightness selection screen. It is a figure which shows an example of an eye size selection screen. It is a flowchart explaining the detail of eye size brightness determination processing. It is a flowchart explaining a photograph sticker creation game process. It is a figure which shows an example of the use selection screen of a sample image. It is a figure which shows an example of the image selection screen for a synthesis | combination. It is a figure which shows an example of a process image. It is a flowchart explaining the detail of a process. It is a figure which shows an example of the image selection screen for a synthesis | combination. It is a figure which shows an example of a process image. It is a figure which shows an example of the image selection screen for a synthesis | combination. It is a figure which shows an example of the process which a process part performs. It is a figure which shows an example of the process which a process part performs. It is a figure which shows an example of a collage image. It is a figure which shows another example of a collage image. It is a figure which shows an example of a name input screen. It is a figure which shows an example of the content palette of a person stamp. It is a figure which shows an example of the picked-up image with which the edit using a person stamp was performed.

  Hereinafter, embodiments of the present invention will be described.

[External structure of photo sticker creation device]
FIG. 1 is a perspective view showing a configuration example of the appearance of the photographic sticker creating apparatus 1.

  The photo sticker creating apparatus 1 is a game machine that allows a user to perform operations such as shooting and editing as a game and receives a price from the user instead of providing a shot image or an edited image. The photo sticker creating apparatus 1 is installed in a store such as a game center. Although there may be one user, there are mainly two or three users.

  A user who plays in the game provided by the photo sticker creating apparatus 1 pays the price, takes a picture of himself as a subject, and selects an image to be edited selected from the shot images obtained by shooting. A photographed image is edited into a rich image by using an editing function that combines a composition image that becomes a background or foreground image, a handwritten line drawing, or a stamp image. The user receives the sticker sheet on which the edited image is printed and ends the series of games.

  As shown in FIG. 1, the photo sticker creating apparatus 1 mainly includes a photographing unit 11, an editing unit 12, and a subsequent customer service unit 13. The photographing unit 11 and the editing unit 12 are installed in contact with each other, and the editing unit 12 and the subsequent customer service unit 13 are installed in contact with each other.

  The photographing unit 11 includes a photographing unit 21 and a background unit 22. The photographing unit 21 and the background unit 22 are installed with a predetermined distance apart, and photographing processing is performed in a photographing space that is a space formed between the photographing unit 21 and the background unit 22.

  The photographing unit 21 is a device that performs photographing processing for photographing a user. The photographing unit 21 enters the photographing space and is located in front of the user who is performing the photographing process. A front panel 41 of the photographing unit 21 that constitutes a surface facing the photographing space in front is provided with a touch panel monitor or the like used by the user during photographing processing. When the left side as viewed from the user in the imaging space is the left side and the right side is the right side, the left side of the imaging unit 21 is constituted by a side panel 42A, and the right side is a side panel 42B (not shown). Consists of.

  The side panel 42A is provided with an LED light emitting unit 43 in which a plurality of LEDs (Light Emitting Diodes) are embedded. The surface of the side panel 42A is composed of an acrylic plate or the like on which advertisements of products or services of a manufacturer of the photo sticker creating apparatus 1 or a company affiliated with the manufacturer are printed so as to cover the entire surface of the side panel 42A. The POP advertisement to be attached is attached. Information particularly appealing as an advertisement is printed on the portion corresponding to the LED light emitting unit 43 of the POP advertisement, and the information is emphasized by the light emission of the LED light emitting unit 43. The LED light emitting unit 43 may be provided also on the side panel 42B (not shown), or may be provided only on one of the side panel 42A and the side panel 42B.

  The background unit 22 is attached to the left end of the rear panel 51 and the rear panel 51, which are plate-like members positioned on the rear side of the user who is performing the photographing process facing the front, and is a plate having a narrower width than the side panel 42A. The side panel 52A (not shown) is a plate-shaped member that is attached to the right end of the rear panel 51 and the side panel 52B and has a narrower width than the side panel 42B.

  The side panel 42A constituting the left side surface of the photographing unit 21 and the side panel 52A of the background unit 22 are provided on substantially the same plane, and each lower part is formed by, for example, a connecting part 23A having a plate-like member. It is connected by a connecting portion 23A ′, which is a metal substantially U-shaped member. Although not shown, the side panel 42B that constitutes the right side surface of the photographing unit 21 and the side panel 52B of the background unit 22 are provided on substantially the same plane, and each upper part is connected by a connecting unit 23B that is a plate-like member. Each lower part is connected by connection part 23B 'which is a substantially U-shaped member made of metal, for example.

  An opening formed by being surrounded by the side panel 42 </ b> A of the imaging unit 21, the connecting unit 23 </ b> A, and the side panel 52 </ b> A of the background unit 22 becomes an entrance G <b> 1 of the imaging space. Although not shown, an opening formed by being surrounded by the side panel 42B of the photographing unit 21, the connecting part 23B, and the side panel 52B of the background 22 is also an entrance G2 of the photographing space.

  The background curtain unit 25 is provided above the background portion 22 so as to be supported by the back panel 51, the side panel 52A, and the side panel 52B. The background curtain unit 25 stores a plurality of winding-type background curtains having different colors or patterns and used for the background. The background curtain unit 25 operates in conjunction with photographing by a camera or the like provided in the photographing unit 21. At the time of photographing, for example, the curtain of the color selected by the user is lowered and the other curtains are wound up.

  In addition, as a background curtain accommodated in the background curtain unit 25, an elevating curtain that uses a plurality of curtains as one chroma key curtain may be prepared. In addition, a curtain for the chroma key is pasted on the rear panel 51 which is the back of the shooting space in advance, and a plurality of types of background images for synthesis are prepared, and a background image desired by the user is captured in the shooting process and editing process. It may be possible to synthesize it into parts.

  An opening surrounded by the front panel 41 of the photographing unit 21, the connecting part 23A, the connecting part 23B, and the background curtain unit 25 is formed above the photographing space, and the ceiling strobe unit 24 covers the part of the opening. Provided. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B. The ceiling strobe unit 24 has a built-in strobe that emits light toward the photographing space in accordance with photographing. A fluorescent lamp is provided inside the strobe constituting the ceiling strobe unit 24, and also functions as illumination of the photographing space.

  The editing unit 12 is a device that allows a user to perform editing processing, which is processing for editing an image obtained by shooting processing. The editing unit 12 is provided so as to be connected to the photographing unit 11 so that one side surface thereof is in contact with the back surface of the front panel 41 of the photographing unit 21. The editing unit 12 is provided with a configuration such as a tablet built-in monitor used by the user during editing processing.

  If the configuration of the editing unit 12 shown in FIG. 1 is a front-side configuration, the editing unit 12 is used for editing processing on the front side and the back side so that two sets of users can perform editing processing simultaneously. Each configuration is provided.

  The front side of the editing unit 12 is a surface perpendicular to the floor surface, and is composed of a surface 71 that is substantially parallel to the side panel 42A, and a slope 72 formed above the surface 71. The configuration used is provided on the slope 72. On the left side of the slope 72, a support portion 73A that has a columnar shape and supports one end of the lighting device 74 is provided. A support portion 75 that supports the curtain rail 26 is provided on the upper surface of the support portion 73A. A support portion 73 </ b> B (FIG. 2) that supports the other end of the lighting device 74 is also provided on the right side of the slope 72.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C so that the shape when viewed from above is a U-shape. One end of the rails 26A and 26B provided in parallel is fixed to the connecting portion 23A and the connecting portion 23B, respectively, and both ends of the remaining one rail 26C are joined to the other end.

  A curtain is attached to the curtain rail 26 so that the inside of the space in front of the editing unit 12 and the space in front of the back cannot be seen from the outside. The space in front of the editing unit 12 and the space in front of the back of the editing unit 12 surrounded by the curtain attached to the curtain rail 26 are editing spaces in which the user performs editing processing.

  FIG. 2 is a perspective view of the photo sticker creating apparatus 1 as seen from another angle.

  The subsequent customer service unit 13 is a device that allows the user to perform the subsequent customer service process. Subsequent customer service processing includes processing for transmitting a photographed image or edited image to a mobile terminal such as a mobile phone, processing for allowing a user to play a mini game, processing for answering a questionnaire, and the like.

  As shown in FIG. 2, the post-service unit 13 has a plate-shaped housing having a predetermined thickness as a part thereof, and the remaining part is provided integrally with the left side surface of the editing unit 12. On the front side of the post-service unit 13, there are provided a tablet built-in monitor used by the user at the time of post-service processing, a discharge port through which sticker paper on which a photographed image or an edited image is printed is discharged. The space in front of the front-end customer service unit 13 becomes a rear-end customer service space where a user waiting for printing on the sticker paper to perform post-service processing.

  Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described with reference to FIG. FIG. 3 is a plan view of the photo sticker creating apparatus 1 as viewed from above.

  The user of the photo sticker creating apparatus 1 is formed between the photographing unit 21 and the background unit 22 from the entrance G1 as indicated by the white arrow # 1 or from the entrance G2 as indicated by the white arrow # 2. The camera enters the shooting space A1 and performs a shooting process using a camera, a touch panel monitor or the like provided in the shooting unit 21.

  The user who has finished the shooting process exits the shooting space A1 and moves to the editing space A2-1 using the doorway G1 as indicated by the white arrow # 3, or moves to the editing space A2-1 as indicated by the white arrow # 4. To leave the shooting space A1 and move to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12, and the editing space A2-2 is an editing space on the back side of the editing unit 12. Which of the editing space A2-1 and the editing space A2-2 is moved is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the empty space of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing processing. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing processing at the same time.

  After the editing process is finished, printing of an image selected from the photographed image and the edited image is started. During printing of the image, the user who has finished the editing process moves from the editing space A2-1 to the subsequent customer service space A3 as indicated by the white arrow # 5 if the editing process has been performed in the editing space A2-1. Then, the customer service is processed after the fact. In addition, when the editing process is completed in the editing space A2-2, the user who has finished the editing process moves from the editing space A2-2 to the post-service area A3 as indicated by the white arrow # 6. Post service processing is performed in the customer service space A3.

  When the printing of the image is finished, the user receives the sticker paper from the outlet provided in the post-service section 13 and finishes a series of photo sticker creation games.

  Next, the configuration of each device will be described.

[Configuration of shooting section]
FIG. 4 is a diagram illustrating a configuration example of the front of the photographing unit 21. The photographing unit 21 is configured by attaching a front panel 41, a side panel 42A, and a side panel 42B to a base unit 43 having a box shape.

  The front panel 41 is positioned in front of the user who performs the shooting process in the shooting space A1, and the side panel 42A and the side panel 42B are positioned on the left side and the right side of the user who performs the shooting process in the shooting space A1, respectively.

  An imaging / display unit 81 is provided in the approximate center of the front panel 41. The photographing / display unit 81 includes a camera 91, a touch panel monitor 92, and a milky white acrylic plate 93.

  The camera 91 is configured by an imaging element such as a lens or a CCD (Charge Coupled Device), and photographs a user in the photographing space A1. The moving image captured by the camera 91 is displayed on the touch panel monitor 92 in real time. An image captured by the camera 91 at a predetermined timing such as when a user gives an instruction to shoot is saved as a photographic image (still image).

  The touch panel monitor 92 provided on the lower side of the camera 91 includes a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 92 has a function as a live view monitor that displays a moving image captured by the camera 91 and a function that displays various GUI (Graphical User Interface) images and accepts a user's selection operation through the touch panel. ing. On the touch panel monitor 92, a still image as a photographing result and a moving image after an image such as a background is combined are displayed as appropriate.

  Like the other strobes, behind the milky white acrylic plate 93 provided so as to surround the upper side and the left and right sides of the camera 91, light is emitted in accordance with the shooting by the camera 91, and the vicinity of the user's face as the subject is in front. There are provided a fluorescent lamp and an illuminating device capable of flash emission.

  On the front panel 41, an upper strobe 82 is installed above the photographing / display unit 81, and the upper strobe 82 irradiates the user from the upper front.

  The base unit 43 is also provided with a foot strobe 83 that irradiates the user's foot. A fluorescent lamp is provided inside the upper strobe 82 and the foot strobe 83, and is used as illumination in the photographing space A1 together with the fluorescent lamp inside the strobe constituting the ceiling strobe unit 24. By adjusting the light emission amount of each fluorescent lamp, or by adjusting the number of fluorescent lamps to emit light, the brightness in the shooting space A1 depends on the content of the shooting process performed by the user. Adjust as appropriate.

  On the right side of the foot strobe 83, a coin insertion / return port 84 through which a user inserts money is provided.

  Spaces 43A and 43B formed on the left and right of the upper surface of the base portion 43 are used as a luggage storage place for a user who performs photographing processing to place baggage and the like. For example, near the ceiling of the front panel 41, a speaker for outputting sound such as guidance sound for photographing processing, BGM (Back Ground Music), and sound effects is also provided.

[Configuration of the background]
FIG. 5 is a diagram illustrating a configuration example of the background portion 22 on the photographing space A1 side.

  As described above, the background curtain unit 25 is provided above the back panel 51. Near the center of the background curtain unit 25, a back center strobe 101 that irradiates a user who is performing a photographing process in the photographing space A1 from the rear center is attached.

  A rear left strobe 102 for irradiating a user who is performing a photographing process in the photographing space A1 from the left rear is attached to the rear panel 51 on the doorway G1 side. Further, a rear right strobe 103 that irradiates a user who is performing a photographing process in the photographing space A1 from the right rear is attached to a position of the rear panel 51 on the doorway G2 side.

[Configuration of editorial department]
FIG. 6 is a diagram illustrating a configuration example of the editing unit 12 on the front side (editing space A2-1 side).

  A tablet built-in monitor 131 is provided at substantially the center of the slope 72. A touch pen 132A is provided on the left side of the tablet built-in monitor 131, and a touch pen 132B is provided on the right side.

  The tablet built-in monitor 131 is configured by superimposing a tablet capable of operation input using the touch pen 132A or 132B on a monitor such as an LCD. On the tablet built-in monitor 131, for example, an editing screen that is a screen used for editing a captured image selected as an image to be edited is displayed. When two people perform editing work simultaneously, the touch pen 132A is used by one user, and the touch pen 132B is used by the other user.

  On the left side of the editing unit 12, a post-service unit 13 is provided.

[Composition of the customer service department]
FIG. 7 is a diagram illustrating a configuration example of the front side of the post-service unit 13.

  A monitor 161 with a built-in tablet is provided at the upper center of the post-service section 13. A touch pen 162A is provided on the left side of the tablet built-in monitor 161, and a touch pen 162B is provided on the right side. Similarly to the tablet built-in monitor 131, the tablet built-in monitor 161 is configured by superimposing a tablet capable of operation input using the touch pen 162 </ b> A or 162 </ b> B on a monitor such as an LCD. On the tablet built-in monitor 161, a screen used for post-service processing such as a mini game is displayed.

  A photo sticker outlet 163 is provided below the tablet built-in monitor 161, and a speaker 164 is provided above the tablet built-in monitor 161.

  In the photo sticker discharge port 163, a sticker sheet on which an image created by the user of the editing space A2-1 is edited or a user of the editing space A2-2 performs the editing process. The sticker paper on which the created image is printed is discharged. A printer is provided inside the editing unit 12, and printing of images is performed by the printer.

  The speaker 164 outputs sounds such as guidance voice, BGM, and sound effects for post-service processing.

[Internal configuration of photo sticker creation device]
Next, the internal configuration of the photo sticker creating apparatus 1 will be described. FIG. 8 is a block diagram illustrating an internal configuration example of the photo sticker creating apparatus 1. The same code | symbol is attached | subjected to the same structure as the structure mentioned above. The overlapping description will be omitted as appropriate.

  The control unit 201 includes a CPU (Central Processing Unit) and the like, executes a program stored in a ROM (Read Only Memory) 206 and a storage unit 202, and controls the overall operation of the photo sticker creating apparatus 1. A storage unit 202, a communication unit 203, a drive 204, a ROM 206, and a RAM (Random Access Memory) 207 are connected to the control unit 201. The control unit 201 is also connected with the components of the photographing unit 208, the editing unit 209, and the post-service unit 210.

  The storage unit 202 includes a non-volatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 201. Information stored in the storage unit 202 is appropriately read out by the control unit 201.

  A communication unit 203 is an interface of a network such as the Internet, and communicates with an external device according to control by the control unit 201.

  A removable medium 205 made of an optical disk, a semiconductor memory, or the like is appropriately attached to the drive 204. Computer programs and data read from the removable medium 205 by the drive 204 are supplied to the control unit 201 and stored in the storage unit 202 or installed.

  The ROM 206 stores programs and data executed by the control unit 201. The RAM 207 temporarily stores data and programs processed by the control unit 201.

  The imaging unit 208 includes a coin processing unit 221, a background control unit 222, a lighting device 223, a camera 91, a touch panel monitor 92, and a speaker 224 that are configured to perform imaging processing in the imaging space A1.

  The coin processing unit 221 detects the insertion of coins into the coin insertion / return port 87. When the coin processing unit 221 detects that a predetermined amount of coins such as 400 yen has been inserted, the coin processing unit 221 outputs an activation signal indicating that to the control unit 201.

  The background control unit 222 raises and lowers the background curtain stored in the background curtain unit 25 according to the background control signal supplied from the control unit 201. The background curtain may be manually selected by the user.

  The illumination device 223 is a fluorescent lamp provided inside each strobe in the imaging space A1, and emits light according to an illumination control signal supplied from the control unit 201. As described above, in the photographing space A1, in addition to the strobe of the ceiling strobe unit 24, the upper strobe 82 provided in the photographing unit 21, the rear center strobe 101 provided in the background unit 22, the rear left strobe 102, and the rear right strobe. 103 is provided. Further, a fluorescent lamp as the illumination device 223 is also provided behind the milky white acrylic plate 93.

  Further, the lighting device 223 adjusts the brightness in the shooting space A1 according to the stage of the shooting work performed by the user by adjusting the light emission amount according to the control by the control unit 201.

  The camera 91 shoots according to the control by the control unit 201 and outputs an image obtained by the shooting to the control unit 201.

  The editing unit 209A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 231 provided on the front side of the editing unit 12 as a configuration for performing editing processing in the editing space A2-1. The editing unit 209B has the same configuration as the editing unit 209A, and performs editing processing in the editing space A2-2.

  The tablet built-in monitor 131 displays an editing screen according to control by the control unit 201, and detects a user operation on the editing screen. A signal representing the content of the user's operation is supplied to the control unit 201, and the captured image to be edited is edited.

  The subsequent customer service unit 210 includes a tablet built-in monitor 161 that is configured to perform the subsequent customer service in the subsequent customer service space A3, touch pens 162A and 162B, a speaker 164, a printer 241 that performs a printing process, and a sticker unit 242. The

  The printer 241 prints the photographed image or the edited image obtained by the editing process on the sticker paper stored in the sticker paper unit 242 attached to the printer 241, and discharges it to the sticker paper discharge port 163.

[Configuration of control unit]
Next, the control unit 201 will be described. FIG. 9 shows an example of the functional block configuration realized by the control unit 201 executing a program stored in the ROM 206 or the like.

  The control unit 201 performs a process related to a charge input when starting the photo sticker creation game and a process related to a photographing work process of the photo sticker creation game such as photographing a user group. An editing processing unit 302 that performs processing related to a photo sticker creation game editing process such as graffiti editing, a printing processing unit 303 that performs processing related to a photo sticker creating game printing process such as printing of sticker paper, and editing work. A post-service processing unit 304 is provided for performing processing related to the post-service process of the photo sticker creation game that serves the finished user group.

  That is, the control unit 201 controls processing related to each process of the photo sticker creation game.

[Details of shooting processing section]
FIG. 10 shows a detailed configuration example of the imaging processing unit 301 in FIG.

  The imaging processing unit 301 controls the camera 91 to perform imaging a plurality of times with the user as a subject, and acquire a plurality of captured images.

  The imaging processing unit 301 includes an image processing unit 321, a display control unit 322, a selection receiving unit 323, and a processing unit 324.

  The image processing unit 321 performs predetermined image processing on at least one captured image acquired by the imaging processing unit 301.

  The display control unit 322 controls display on the touch panel monitor 92.

  The selection receiving unit 323 receives a user's selection operation on the touch panel monitor 92.

  The processing unit 324 processes the captured image into an image suitable for a predetermined application.

[Explanation of operation of photo sticker creation device]
Next, processing of the photo sticker creating apparatus 1 that provides a photo sticker creating game will be described with reference to the flowchart of FIG.

  In step S1, the imaging processing unit 301 determines whether or not a predetermined amount of coins has been inserted based on a signal supplied from the coin processing unit 221, and waits until it is determined that the coin has been inserted.

  If it is determined in step S1 that a coin has been inserted, in step S2, the imaging processing unit 301 performs a reflection selection process for selecting a reflection set for a captured image obtained by imaging. The details of the shot selection process will be described in detail with reference to the flowchart of FIG.

  In step S <b> 3, the shooting processing unit 301 controls the shooting unit 208 to display a moving image of the subject captured by the camera 91 on the touch panel monitor 92 in a live view so that the user in the shooting space A <b> 1 is shot as a subject. Process. In the photographing process, an up-photographing for photographing the user's face or upper body is performed.

  In step S4, the image processing unit 321 of the imaging processing unit 301 performs a reflection setting process corresponding to the reflection selected in the reflection selection process of step S2 for the captured image obtained by the imaging process.

  In step S5, the imaging processing unit 301 guides the user in the imaging space A1 to move to the editing space A2-1 or the editing space A2-2. The guidance for movement to the editing space A2-1 or the editing space A2-2 is performed by displaying a screen on the touch panel monitor 92 of the photographing unit 208 or by outputting sound from the speaker 224.

  In step S6, the editing processing unit 302 controls the editing unit 209 corresponding to the editing space of the editing space A2-1 and the editing space A2-2 that is the destination of the user who has finished the shooting process, Edit processing. Specifically, the editing processing unit 302 causes the user to select a synthesis image to be synthesized with the captured image selected as the editing target image, synthesizes the selected synthesis image with the captured image, and obtains the obtained synthesis. The image is edited according to the editing operation by the user.

  In step S7, the editing processing unit 302 guides the user who has finished the editing process in the editing space A2-1 or the editing space A2-2 to move to the post-service space A3. The guidance for the movement to the post-service space A3 is performed by displaying a screen on the tablet built-in monitor 131 or by outputting sound from the speaker 231.

  In step S8, for example, the print processing unit 303 performs (starts) a print process of outputting an image selected by the user from the photographed image or the edited image to the printer 241 and printing it on a sticker sheet.

  When a start button for post-service processing displayed on the tablet built-in monitor 161 is selected, in step S9, the post-service processing unit 304 performs post-service processing for a user who is waiting for completion of printing. Specifically, the post-service processing unit 304 performs a mobile transmission game process in which a captured image or an edited image is transmitted to the mobile terminal as the post-service processing, and directly inputs the e-mail address of the mobile terminal. Display on the tablet built-in monitor 161 a selection screen for a transmission method that allows a user to select whether to transmit an image to a mobile terminal by transmitting to a terminal or communicating with a non-contact type IC. The image is transmitted according to the operation by the user.

  When the printing is completed, in step S10, the post-service processing unit 304 displays that the printing is completed on the tablet built-in monitor 161, and the printer 241 discharges the sticker sheet on which the image is printed to the sticker paper discharge port 163. The process is terminated.

[Details of image selection processing]
Next, with reference to the flowchart of FIG. 12, the details of the shot selection process in step S2 of FIG. 11 will be described.

  In step S <b> 21, the photographing processing unit 301 controls the camera 91 to perform sample photographing that is photographing for generating a sample image with the user as a subject.

  Here, the sample image is an image serving as a sample (sample) for allowing the user to confirm the processing content (processing result) of the image processing related to the image applied to the captured image. That is, the sample image is an image generated by performing image processing related to the captured image.

  In addition, image processing related to reflection refers to image processing that adjusts at least one of saturation, brightness, sharpness, and contrast for a captured image. That is, the reflection is determined by saturation, brightness, sharpness, and contrast. By applying image processing relating to this reflection to the captured image, the captured image is set. For example, there are cute images and beautiful images. If the image is cute, image processing with reduced sharpness and blur is applied. ) Image processing for red system is performed on the captured image. In the following, image processing related to reflection is referred to as reflection setting processing.

  Note that since the sample shooting in step S21 is the first shooting for the user, it can be positioned as a test shooting that is a test shooting.

  Further, in the sample shooting, the up shooting for shooting the user's face or upper body is performed, but the whole body shooting for shooting the whole body of the user may be performed.

  In step S <b> 22, the image processing unit 321 performs a reflection setting process on one photographed image acquired by sample photographing by the photographing processing unit 301. Then, the image processing unit 321 generates a plurality of different sample images and supplies them to the display control unit 322. Specifically, the image processing unit 321 has a plurality of sample images that are adjusted so that any one or all of saturation, brightness, sharpness, and contrast are different from one captured image acquired by sample imaging. Is generated.

  That is, the plurality of sample images to be generated may be a plurality of images having different saturations or a plurality of images having different brightness, sharpness, and contrast. In addition, multiple sample images can be obtained by combining a sample image acquired by sample shooting with only saturation, one with only lightness, one with only sharpness, and one with only contrast. It is good.

  In step S23, the display control unit 322 causes the touch panel monitor 92 to display, for example, a reflection selection screen as illustrated in FIG. 13 based on the sample image from the image processing unit 321.

  FIG. 13 shows an example of a reflection selection screen for allowing the user to select a reflection of the reflection setting process performed on the captured image in step S4 of the flowchart of FIG.

  Selection indications 341 and 342 are shown on the reflection selection screen of FIG.

  The selection display 341 displays a sample image 341a that has been subjected to a reflection setting process corresponding to a reflection of the A course (for example, a reflection for allowing the user on the captured image to be cute). The sample image 341a is generated by the image processing unit 321 being subjected to a reflection setting process corresponding to the A course for the captured image.

  In the selection display 342, a sample image 342a that has been subjected to a reflection setting process corresponding to a reflection of the B course (for example, a reflection that allows the user on the captured image to be clearly displayed) is displayed. The sample image 342a is generated by the image processing unit 321 performing a reflection setting process corresponding to the B course for the sample image.

  When one of the sample images 341a and 342a displayed on the touch panel monitor 92 is selected by the user, the selection accepting unit 323 accepts a sample image selecting operation on the touch panel monitor 92 by the user in step S24. . Then, the selection receiving unit 323 determines the reflection setting process applied to the selected sample image as the reflection setting process to be applied to the captured image, and notifies the image processing unit 321 to that effect.

  Thereafter, the processing after step S3 in FIG. 11 is performed, and in step S4, the reflection setting processing corresponding to the reflection selected by the user is performed on, for example, six captured images acquired by the imaging processing in step S3. Applied.

  That is, the image processing unit 321 generates a plurality of different sample images by performing a reflection setting process on at least one photographed image acquired by sample photographing among the photographing performed a plurality of times. In addition, the image processing unit 321 performs, for example, six shootings acquired by shooting in the shooting process (step S3) among shootings that are performed a plurality of times for the shooting setting process performed on the sample image selected by the user. Apply to images. As a result, a photographed image selected by the user is obtained.

  According to the above processing, the user can check the sample image that has been subjected to the reflection setting process with the user himself as the subject, and can select the reflection, so that the image as the user imagined Can be provided to the user, and the satisfaction of the user can be improved.

  In the above-described processing, it is assumed that the sample image obtained by sample photographing (trial photographing) and subjected to the reflection setting process is stored in the storage unit 202 together with the captured image subjected to the reflection setting process. Note that the sample images stored in the storage unit 202 may be only sample images selected by the user, or all sample images including those not selected by the user. Similar to the captured image, the sample image is an image to be edited, an image to be printed on sticker paper, or an image to be transmitted to a mobile terminal owned by the user.

  Note that the sample image stored in the storage unit 202 may be deleted when the reflection selection process is completed or when the reflection setting process to be performed on the photographed image is determined.

  In the above-described processing, the sample photographing is performed as the trial photographing before the photographing processing in step S3. However, the sample photographing may be performed after the photographing processing. That is, the shot selection process is performed between the shooting process in step S3 and the shot setting process for the shot image in step S4.

  In this case, the user can take a sample image without tension in the same atmosphere as the image capturing process. In addition, since the user can perform sample shooting after grasping a desired standing position, close-up state, and the like by shooting processing, it is possible to perform sample shooting under better conditions for the user.

  Furthermore, the sample photographing may be performed as any one of a plurality of times (for example, six times) of photographing performed in the photographing process in step S3. In other words, the image selection process is performed between the image capturing process in step S3 and the image capturing process for the captured image in step S4. In the image capturing process, one of the captured images acquired by the image capturing process is selected. A sample image is generated by allowing the user to select a sheet.

  In this case, the user can select a photographed image that he / she likes as a sample image from a plurality of photographed images. Similarly to the case where sample shooting is performed after the shooting process, sample shooting can be performed without tension in the same atmosphere as the shooting process, and the desired standing position, close-up condition, etc. can be obtained by the shooting process. Since the sample shooting can be performed after grasping, the sample shooting can be performed under better conditions for the user.

  Further, in the above-described processing, the shooting setting processing for the captured image may be determined for each captured image provided to the user. In this case, the user selects, for each captured image, a sample image that has been subjected to the image capture setting process desired to be performed on the captured image.

  When the reflection setting process is performed for each captured image, the user can change the reflection setting process applied to the captured image according to the user's atmosphere, behavior, facial expression, and the like in the captured image. Therefore, the photograph sticker creating apparatus 1 can provide the user with a photographed image on which a desired image setting process has been performed for each photographed image as sticker paper or the like, thereby improving user satisfaction. Can do.

  Further, the reflection setting process may be performed for each different area on the captured image.

  For example, in the captured image, different image setting processing is performed on a person area that is an area in which a subject is captured and a background area that is an area other than the person area. In this case, the sample image selected by the user is also subjected to a different image setting process for each area, and the image setting process applied to each area of the selected sample image is applied to each area of the captured image. Is done. Thereby, it is possible to make the user's reflection in the captured image more prominent.

  In addition, when there are a plurality of users, it is possible to select, for each user, a shooting setting process for a person area on a captured image. In this case, a desired image setting process can be performed for each user.

  For example, as shown in FIG. 13, when two users U1 and U2 exist, the user U1 and the user U2 are used from a plurality of sample images that have been subjected to different image setting processing. A sample image on which a desired reflection setting process has been performed is selected for each person.

  Then, the reflection setting process performed on the sample image selected by the user U1 is determined as the reflection setting process for the person area where the user U1 is displayed on the captured image. Further, the reflection setting process performed on the sample image selected by the user U2 is determined as the reflection setting process for the person area where the user U2 is displayed on the captured image.

  In this case, the image processing unit 321 discriminates each of the user U1 and the user U2 using a technique such as face recognition, and based on the discrimination result, the person area where the user U1 on the captured image is displayed. Then, the person area where the user U2 on the photographed image is displayed is detected. Then, the image processing unit 321 performs the determined image setting process for the detected person area.

  Note that the image processing unit 321 uses a technique such as face recognition to detect a person area for each user, and in response to a user operation that designates a person area on a captured image using a touch pen or a finger. Thus, the person area for each user may be detected.

  Further, the photographing processing unit 301 detects a face area (area representing a face) from a photographed image photographed by the photographing process, and determines the number of face areas to detect the number of photographers. May be. When detecting the number of photographers, when six photographed images are acquired, the photographing processing unit 301 preferably detects a face area from all the six photographed images and determines the number of photographers for each photographed image. . For example, it is conceivable that five people are photographed, but only two people are photographed in a certain photographed image and five persons are photographed in another certain photographed image. Therefore, it is desirable that the photographing processing unit 301 calculates the number of photographers for every photographed image, and detects the largest number of people as the number of photographers. In addition, the shooting processing unit 301 may detect the number of people in four shot images among the six shot images. In other words, if the number of people shown in the four shot images is three and the number of people shown in the remaining two shot images is four among the six shot images, the shooting processing unit 301 takes a picture. Three people are detected as the number of people.

  Further, it is preferable to use the technique disclosed in Japanese Patent Application Laid-Open No. 2009-17135 and the like to identify the detected face in each photographed image and calculate how many people are photographed. . For example, four users photograph two people, and three photographed images showing two users (users U1 and U2) and two people (user U3 and use) Assume that three photographed images showing the user U4) are acquired. At this time, when the obtained six captured images are analyzed, the user U1, the user U2, the user U3, and the user U4 are detected. Even in such a case, it is possible to determine that there are four users.

  Note that, in the above, the reflection setting process performed on the sample image selected by the user is performed on the captured image as the still image acquired in the capturing process of step S3. You may make it perform with respect to the live view image which is a user's real-time moving image displayed on the monitor 92. FIG. As a result, the user can perform shooting while confirming the live view image of the photograph that he / she has selected, and can make facial expressions and poses that match the photograph, resulting in a result. , User satisfaction can be increased.

  By the way, in the copy selection screen of FIG. 13, two types of shots of course A and course B are simultaneously displayed as shots. However, the screens may be switched to display one type at a time. . Further, the reflection is not limited to two types and can be three or more types.

  FIG. 14 shows an example of a shot selection screen that displays three or more types of shots.

  On the shot selection screen shown in FIG. 14A, selection displays 361 to 366 for courses A to F are displayed.

  Only the A course selection display 361 of A to F courses is displayed on the shot selection screen shown in FIG. 14B. Further, on the reflection selection screen shown in FIG. 14B, a button 371 operated when displaying a selection display different from the selection display 361 being displayed is also displayed. On this button 371, characters “view other courses” are displayed.

  As shown in FIG. 14A, the display control unit 322 can display selection displays 361 to 366 for the A to F courses on one screen as the images that can be selected by the user. In this case, the user can select a sample image after confirming all the shots at once.

  Further, the display control unit 322 can display a selection display of one of the selection displays 361 to 366 as shown in FIG. 14B. In this case, the display control unit 322 can display the sample image 361a larger than in the case of FIG. 14A.

  Therefore, even when a large number of users are shown in the sample image 361a, the sample image 361a is displayed large on the touch panel monitor 92, so that it is easy to understand the reflection of the user who is originally displayed in a small size.

[Other details of reflection selection processing]
Next, with reference to the flowchart of FIG. 15, details of the reflection selection process when the reflection selection screen as shown in FIG. 14B is displayed and the user selects a reflection will be described.

  Note that, in the shot selection process of FIG. 15, description is made assuming that one shot is determined from two types of A course and B course, but the type of shot is not limited to two.

  In step S41, the imaging processing unit 301 controls the camera 91 to perform sample imaging with the user as the subject.

  In step S <b> 42, the image processing unit 321 performs A course image setting processing for the captured image acquired by the sample capturing by the capturing processing unit 301, and the sample image 361 a obtained as a result is displayed on the display control unit 322. Supply.

  In step S43, the display control unit 322 causes the touch panel monitor 92 to display the selection display 361 including the sample image 361a from the image processing unit 321 and the button 371 as illustrated in FIG. 14B.

  When one of the selection display 361 or the button 371 is selected by the user, in step S44, the selection receiving unit 323 receives a sample image selection operation on the touch panel monitor 92 by the user, and the image of the A course is selected. Whether the selection display 361 has been selected or whether the button 371 has been selected is determined.

  If it is determined in step S44 that the A course has been selected, the imaging processing unit 301 advances the process to step S45.

  In step S45, the selection receiving unit 323 determines the image to be A course, notifies the image processing unit 321 to that effect, returns the processing to step S2 in FIG. 12, and the subsequent processing is performed.

  On the other hand, if it is determined in step S44 that the image of course A has not been selected, the imaging processing unit 301 advances the process to step S46.

  In step S46, the imaging processing unit 301 controls the camera 91 to perform another new sample imaging with the user as a subject.

  In step S <b> 47, the image processing unit 321 performs a B course reflection setting process on a new sample image acquired by sample shooting by the shooting processing unit 301, and displays a sample image 362 a obtained as a result as a display control unit. 322 is supplied.

  Here, in step S46, the image processing unit 321 controls the camera 91 so as to perform another new sample shooting because the shooting conditions are changed between the A course and the B course. Intended.

  For example, when the light emission amount of the illumination device 223 at the time of shooting processing, that is, the brightness in the shooting space A1 is different between the A course and the B course, the sample shooting at step S41 is performed during the shooting processing of the A course. Sample photographing is performed with the light emission amount, and in the sample photographing in step S46, sample photographing is performed with the light emission amount at the time of the B course photographing processing. In this case, since the light emission amount is changed for each image, a difference for each image can be found by a method other than the image setting process.

  If the shooting conditions are the same for the A course and the B course, the process of step S46 can be omitted. In step S47, the image processing unit 321 performs the B course reflection setting process for the sample image acquired by the imaging processing unit 301 in the process of step S41.

  In step S48, the display control unit 322 causes the touch panel monitor 92 to display the selection display 362 including the sample image 362a from the image processing unit 321 and the button 371.

  When one of the selection display 362 or the button 371 is selected by the user, in step S49, the selection receiving unit 323 receives a sample image selection operation on the touch panel monitor 92, and whether or not the B course is selected. That is, it is determined whether the selection display 362 is selected or the button 371 is selected.

  If it is determined in step S49 that the B course has not been selected, the imaging processing unit 301 returns the process to step S41, and thereafter the same process is performed.

  On the other hand, if it is determined in step S49 that the B course has been selected, the imaging processing unit 301 advances the process to step S50.

  In step S50, the selection receiving unit 323 determines the image to be the B course, notifies the image processing unit 321 to that effect, returns the processing to step S2 in FIG. 12, and the subsequent processing is performed.

  According to the above processing, since the reflection selection screen as shown in FIG. 14B can be displayed as the reflection selection screen, for example, even if the user is a large number of people, it is displayed on the sample image. The user's face does not become small, and the user can confirm the appearance of the image set over the details.

  FIG. 16 shows an example of a sample shooting guide screen displayed on the touch panel monitor 92 when sample shooting is performed.

  On the sample shooting guide screen shown in FIG. 16, a message “I will do sample shooting!” Is displayed. With this message, it is possible to make the user recognize that shooting different from shooting in shooting processing is performed.

  In the sample shooting guide screen shown in FIG. 16, a button 381 such as “shoot with two or less” and a button 382 such as “shoot with three or more” are also displayed.

  When the user operates the button 381 on the sample shooting guide screen shown in FIG. 16, sample shooting is performed by special shooting. Here, special shooting refers to shooting that generates a plurality of shot images by one shooting.

  Specifically, for example, special shooting is performed by shooting two people at the same time, and by trimming the user's face, upper body, etc. one by one from an image obtained by the shooting, one user is shown at a time. This refers to shooting that generates two shot images.

  Note that special shooting can be performed with one user as the subject. In this case as well, an image showing one user is generated by trimming the face of one user from an image obtained by photographing one person.

  In addition, in the sample shooting guide screen shown in FIG. 16, when the user operates the button 382, three or more users are photographed by shooting performed in the above shooting process (hereinafter also referred to as normal shooting). Sample shooting is performed. In normal shooting, one image is generated by one shooting.

  FIG. 17 shows an example of special shooting.

  FIG. 17A shows an example of a screen displayed when special shooting is performed.

  In FIG. 17A, a user image display unit 401 and a user image display unit 402 are provided on the upper side of the screen.

  In FIG. 17A, a pose display unit 403 for displaying a sample pose is provided on the lower side of the screen. The user can perform special shooting with reference to the pose displayed on the pose display unit 403. In addition, the user can check his / her face displayed on the user image display units 401 and 402 and confirm the pose and expression. When the special shooting is performed in the state of FIG. 17A, the shooting result is displayed as shown in FIG. 17B.

  In FIG. 17B, a captured image for each user obtained by special imaging is displayed on each of the imaging result display unit 421 and the imaging result display unit 422. The captured image is a sample image and an image to be edited. The user can check the result of shooting by special shooting from such a screen.

[Still another example of image selection processing]
Next, still another example of the reflection selection process in step S2 of FIG. 11 will be described with reference to the flowchart of FIG. Here, the details of the shot selection processing when performing sample shooting by either normal shooting or special shooting depending on whether or not the number of shots is three or more will be described.

  In step S71, the display control unit 322 causes the touch panel monitor 92 to display a sample photographing guide screen as shown in FIG.

  When one of the button 381 or the button 382 for sample shooting guidance screen guidance is selected by the user, in step S72, the selection receiving unit 323 receives a selection operation on the touch panel monitor 92 by the user, and the number of photographers is three. It is determined whether or not the user is more than a person, that is, whether the button 382 has been operated or the button 381 has been operated.

  If it is determined in step S72 that the number of photographers is not three or more, the photographing processing unit 301 advances the process to step S73.

  In step S <b> 73, the imaging processing unit 301 controls the camera 91 and performs sample imaging by special imaging with the user as a subject. Thereby, the captured image for every user is acquired. For example, when the number of photographers is two, two photographed images with each user as a subject are acquired by special photographing.

  On the other hand, when it is determined in step S72 that the number of photographers is three or more, the photographing processing unit 301 advances the process to step S74.

  In step S74, the imaging processing unit 301 controls the camera 91 to perform sample imaging by normal imaging with a user as a subject. Here, one photographed image showing three or more users is acquired.

  In steps S75 to S77, processing similar to that in steps S22 to S24 in FIG. 13 is performed. Thereafter, the processing returns to step S2 in FIG. 12, and the subsequent processing is performed. When two shot images are acquired by special shooting, in step S75, the reflection setting process is performed on each of the two shot images.

  According to the above processing, sample photographing can be performed by a photographing method according to the number of photographers.

  In the shot selection process of FIG. 18, in step S75, the same shot setting process is performed on the shot image regardless of whether or not the number of shots is three or more. A reflection setting process (for example, when there are two or less users, a reflection setting process for two or less users) may be performed.

  By the way, in the photo sticker creation game process of FIG. 11, the photo selection process is necessarily performed, but the user can select whether or not to perform the photo selection process.

[Description of other operations of photo sticker creation device]
Here, with reference to the flowchart of FIG. 19, the photo sticker creation game process in which the user can select whether or not to perform the shot selection process will be described.

  In step S91, processing similar to that in step S1 in FIG. 12 is performed. When it is determined in step S91 that a coin has been inserted, the display control unit 322 determines whether to display a screen for selecting whether to perform sample shooting, that is, a sample image on the touch panel monitor 92. A screen for setting is displayed on the touch panel monitor 92.

  When the user selects whether to perform sample shooting on the screen displayed on the touch panel monitor 92, the selection receiving unit 323 performs a selection operation on the touch panel monitor 92 by the user in step S92. If it is received, it is determined whether or not sample shooting is performed, and if it is determined that sample shooting is performed, the process proceeds to step S93.

  In step S <b> 93, the imaging processing unit 301 performs the reflection selection process described with reference to FIGS. 13, 15, and 18.

  In this example, it is considered that the user who chooses to perform sample shooting is very concerned about the user's reflection on the shot image. Therefore, it is desirable for such a user to select a desired image from a relatively large number of courses.

  Therefore, in the shot selection process in step S93, more sample images may be displayed and the number of selectable shots may be increased as compared with the case where sample shooting is always performed. That is, in the reflection selection process in step S93, more image setting processes are performed on the photographed image so that more selectable sample images can be displayed.

  In step S92, if the selection operation for selecting whether or not to perform sample shooting is not performed on the touch panel monitor 92 within a predetermined time from when the coin is inserted, the sample shooting is performed. You may make it determine with what is performed.

  On the other hand, if it is determined in step S92 that sample shooting is not performed, the selection receiving unit 323 advances the process to step S94.

  In step S <b> 94, the display control unit 322 displays a plurality of different model images obtained by performing a reflection setting process in advance for a model image with a model as a subject instead of a captured image with the user as a subject. The image selection screen including the image is displayed on the touch panel monitor 92.

  When one of the model images displayed on the touch panel monitor 92 is selected by the user, in step S95, the selection accepting unit 323 accepts an operation for selecting the model image on the touch panel monitor 92 by the user, and the user The reflection setting process performed on the model image selected by the above is determined as the reflection setting process for the captured image.

  In steps S96 to S103, processing similar to that in steps S3 to S10 in FIG. 11 is performed.

  According to the above processing, since the user is allowed to select whether or not to perform sample shooting, the user can select whether or not to perform sample shooting according to the mood of the day. . Further, for example, when the user does not have time, the user can omit the time taken for sample photographing by not performing the sample photographing, and can obtain the sticker paper more quickly. In addition, if the user is not interested in the difference between the shots, it is not necessary to take a sample shot in order to select the shot. You can also

  In addition, when sample shooting is not performed, it is possible to give a privilege such as increasing the number of shootings in the shooting process of step S96 compared to when sample shooting is performed. Not preferred.

  This is because, regardless of whether or not sample shooting has been performed, if the shooting process is performed with the same number of shots, the user can acquire a larger number of shot images when sample shooting is performed. By being able to do it and becoming unfair.

  As another privilege, for example, a privilege such as increasing time spent for editing processing or the like may be given.

  In the above description, the image processing unit 321 performs the reflection setting process as the image process for the photographed image, but other image processes can also be performed.

[Other operations of photo sticker creation device]
Here, with reference to the flowchart of FIG. 20, processing of the photo sticker creating apparatus 1 in which image processing other than the shot setting processing is performed on the captured image will be described.

  In steps S121 to S124, processing similar to that in steps S1 to S4 in FIG. 11 is performed.

  In step S125, the imaging processing unit 301 performs an eye size / brightness determination process for determining the brightness and eye size of the user on the captured image, and the process proceeds to step S126.

  In steps S126 through S131, the same processing as in steps S5 through S10 in FIG. 11 is performed.

  Note that the eye size / brightness determination process is performed after the shooting setting process for the captured image (the process of step S124), but may be performed before the process.

  Next, with reference to FIGS. 21 to 23, details of the eye size brightness determination process in step S125 of FIG. 20 will be described.

  FIG. 21 shows an example of a brightness selection screen used for selecting the brightness (skin color) of the user on the captured image using the captured image captured by the user himself.

  A photographed image 441 obtained by the photographing process is displayed on the brightness selection screen. For example, when six shots are taken, six shot images are obtained, and six shot images 441-1 to 441-6 are displayed on the left side of the screen on the brightness selection screen. Note that the captured images 441-1 to 441-6 displayed on the brightness selection screen are, for example, captured images that reflect the image selected by the user.

  On the right side of the brightness selection screen, five brightness selection buttons 442-1 to 442-5 are displayed in order from the top. On the brightness selection buttons 442-1 to 442-5, numerical values from “1” to “5” are respectively displayed, and brightness images 451 to 455 having different brightness are respectively displayed.

  The brightness images 451 to 455 are images in which any one of the captured images 441-1 to 441-6 has different brightness. In addition, the brightness images 451 to 455 are images in which only the user's face portion is extracted.

  Note that sample images generated in the shot selection process may be used as the brightness images 451 to 455. Note that even if the sample image has a lower image quality (for example, lower resolution) than the captured image, the image is displayed as a smaller image on the brightness selection screen. Therefore, it is possible to avoid impairing user satisfaction. In addition, since the sample image is selected by the user when selecting the brightness following the selection of the image in the image selection process, the user can perform the selection operation with peace of mind. Become.

  The numerical values from “1” to “5” of the brightness selection buttons 442-1 to 442-5 indicate the degree of brightness. The larger the numerical value, the darker the user as the subject.

  In addition, on the right side of the brightness selection buttons 442-1 to 442-5, characters “whitening”, “recommended”, and “beautiful black” are displayed in order from the top to the bottom. That is, in the arrangement of the brightness selection buttons 442-1 to 442-5, it is suggested that the upper side brightens the subject and the lower side darkens the subject.

  In addition, a determination button 443 that is operated when determining the brightness of the subject is displayed on the lower right side of the brightness selection screen. The determination button 443 displays characters “Determination”. .

  When such a brightness selection screen is displayed on the touch panel monitor 92 and the user selects any of the brightness selection buttons 442-1 to 442-5, the image processing unit 321 displays the brightness selected by the user. Then, image processing is performed to collectively change the brightness of the subjects of the captured images 441-1 to 441-6 so that the subject is captured.

  Note that when the user selects a captured image for which the brightness is desired to be changed from the captured images 441-1 to 441-6, the image processing unit 321 selects the subject of the captured image selected by the user. Only the brightness may be changed.

  When the user selects the determination button 443 after selecting the brightness of the subject, the selection of the brightness of the subject is performed with the brightness reflected in the captured images 441-1 to 441-6 at that time. Is determined.

  Note that on the brightness selection screen of FIG. 21, the display of the captured images 441-1 to 441-6 and the display of the brightness selection buttons 442-1 to 442-5 may be switched. As a result, the brightness selection buttons 442-1 to 442-5 can be displayed large on the entire screen, and the brightness images 451 to 455 displayed on the brightness selection buttons 442-1 to 442-5 are displayed large. The user can easily confirm the difference between the brightness images 451 to 455.

  FIG. 22 shows an example of an eye size selection screen used to select the size of the user's eyes on the captured image using the captured image taken by the user himself.

  A photographed image 461 obtained by the photographing process is displayed on the eye size selection screen. For example, when photographing is repeated six times, six photographed images are obtained, and six photographed images 461-1 to 461-6 are displayed on the left side of the screen on the eye size selection screen. Note that the captured images 461-1 to 461-6 displayed on the eye size selection screen are, for example, captured images 441-1 to 441-6 that reflect the brightness in addition to the image.

  On the right side of the eye size selection screen, three eye size selection buttons 462-1 to 462-3 are displayed in order from the top. On the eye size selection button 462-1, characters "natural eye" and an eye size image 471 which is an image of the eyes of the user having a natural eye size are displayed.

  The eye size selection button 462-2 is an image in which the characters "Patch Lee" and the eyes of the user having a slightly larger eye size (for example, about 10% larger than the natural size) are displayed. An eye size image 472 is displayed. Further, on the eye size selection button 462-2, a “recommended” character indicating that it is recommended to select an eye size of this size is displayed together with a heart-shaped figure.

  The eye size selection button 462-3 includes a character “volume eye” and an eye size image 473 which is an image of a user's eye having a relatively large eye size (for example, about 20% larger than the natural size). And are displayed.

  The eye size images 471 to 473 are images in which any one of the captured images 441-1 to 441-6 has a different eye size. The eye size images 471 to 473 are images in which only the eyes of the user are extracted.

  Further, as the eye size images 471 to 473, sample images generated in the shot selection process may be used. Note that even if the sample image has a lower image quality (for example, lower resolution) than the captured image, the sample image is displayed as a smaller image on the eye size selection screen. Therefore, it is possible to avoid impairing user satisfaction. In addition, the sample image can be selected by the user when selecting the eye size following the selection of the image in the image selection process, so that the user can perform the selection work with peace of mind. Become.

  In addition, an arrow from the top to the bottom is displayed on the right side of the eye size selection buttons 462-1 to 462-3, and the word “natural” is displayed above the arrow. The word “big” is displayed. That is, it is suggested that the eye size increases as the eye size selection button 462-1, the eye size selection button 462-2, and the eye size selection button 462-3 move downward in this order.

  In addition, a determination button 463 that is operated when determining the selection of the eye size is displayed on the lower right side of the eye size selection screen. The determination button 463 displays characters “OK”. Yes.

  When such an eye size selection screen is displayed on the touch panel monitor 92 and the user selects any of the eye size selection buttons 462-1 to 462-3, the image processing unit 321 selects the size selected by the user. Image processing is performed to collectively change the size of the subject's eye size in the captured images 461-1 to 461-6 so that the eye image is displayed.

  Then, when the user selects the eye size after selecting the eye size, the eye size of the subject is selected with the size reflected in the captured images 461-1 to 461-6 at that time. Is determined.

  Note that, on the eye size selection screen in FIG. 22, the display of the captured images 461-1 to 461-6 and the display of the eye size selection buttons 462-1 to 462-3 may be switched. As a result, the eye size selection buttons 462-1 to 462-3 can be displayed large on the entire screen, so that the eye size images 471 to 473 displayed on the eye size selection buttons 462-1 to 462-3 are displayed large. The user can easily check the difference between the eye size images 471 to 473.

[Details of eye size brightness determination processing]
Next, details of the eye size brightness determination process in step S125 of FIG. 20 will be described with reference to the flowchart of FIG.

  In step S151, the image processing unit 321 generates image having different brightness, that is, brightness images 451 to 455 by performing image processing for changing the brightness of the user on the captured image. And supplied to the display control unit 322.

  In step S152, the display control unit 322 shows the brightness images 451 to 455 from the image processing unit 321 and the captured images 441-1 to 441-6 on which the image setting process has been performed in step S124, as shown in FIG. Such a brightness selection screen is displayed on the touch panel monitor 92.

  In step S153, when the user selects the brightness of the subject by performing an operation (touch) on any of the brightness selection buttons 442-1 to 442-5 on the brightness selection screen, the selection receiving unit 323 displays the touch panel. Based on the information supplied from the monitor 92, the selection by the user is accepted.

  In step S154, the image processing unit 321 performs image processing for collectively changing the brightness of the subjects of all the captured images 441-1 to 441-6 so that the subject has the brightness selected by the user. Do.

  In step S155, the display control unit 322 displays the captured images 441-1 to 441-6 in which the brightness of the subject is changed on the touch panel monitor 92, and allows the user to check the brightness change result.

  In step S156, the selection receiving unit 323 determines whether or not the determination button 443 has been pressed based on the information supplied from the touch panel monitor 92. If it is determined that the determination button 443 has not been pressed, the process returns to step S153. The processing from step S153 to step S155 is repeated.

  On the other hand, if it is determined in step S156 that the enter button 443 has been pressed, in step S157, the image processing unit 321 determines the brightness selected in the immediately preceding step S153 as the brightness of the captured images 441-1 to 441-6. Determine as. Then, the image processing unit 321 supplies the captured images 441-1 to 441-6 after determining the brightness to the display control unit 322 as the captured images 461-1 to 461-6.

  In step S <b> 158, the image processing unit 321 performs image processing for changing the eye size of the user for the captured image, thereby obtaining images with different eye sizes, that is, a plurality of eye size images 471. To 473 are generated and supplied to the display control unit 322.

  In step S159, the display control unit 322 converts the eye size images 471 to 473 from the image processing unit 321 and the captured images 441-1 to 441-6 subjected to the reflection setting processing into the eyes as illustrated in FIG. It is displayed on the touch panel monitor 92 as a size selection screen.

  In step S160, when the user selects an eye size by performing an operation (touch) on any of the eye size selection buttons 462-1 to 462-3 on the eye size selection screen, the selection receiving unit 323 displays the touch panel monitor. Based on the information supplied from 92, the selection by the user is accepted.

  In step S161, the image processing unit 321 collectively sets the size of the user's eyes that appear in all the captured images 461-1 to 461-6 so that the image of the size selected by the user is captured. Then, change the image processing.

  In step S162, the display control unit 322 displays the captured images 461-1 to 461-6 whose eye size has been changed on the touch panel monitor 92, and allows the user to check the result of the eye size change.

  In step S163, the selection receiving unit 323 determines whether or not the determination button 463 is pressed based on the information supplied from the touch panel monitor 92. If it is determined that the determination button 463 is not pressed, the selection receiving unit 323 returns to step S160 and thereafter. , Steps S160 to S162 are repeated.

  On the other hand, if the selection receiving unit 323 determines in step S163 that the enter button 463 has been pressed, the process proceeds to step S164. In step S164, the image processing unit 321 stores the captured images 461-1 to 461-6 after changing the eye size in a built-in memory (not shown) or the like, and returns to step S125 of FIG. Note that the captured images 461-1 to 461-6 after changing the eye size are, for example, the targets of the editing process in step S127 of FIG.

  According to the above processing, the eye size / brightness determination processing can be performed as an image processing other than the shooting setting processing on the photographed image subjected to the shooting setting processing.

  In the above, the reflection setting process and the eye size / brightness determination process as the image processing for the photographed image are performed separately, but the reflection setting process and the eye size / brightness determination process are performed collectively. It may be.

  Specifically, the eye size and brightness corresponding to the image are determined in advance, and in step S124 in the flowchart of FIG. 20, the image setting process corresponding to the selected image is performed, and the image corresponding to the image is selected. Eye size brightness determination processing is performed.

  Thereby, it is possible for the user to save time and effort for selecting the eye size and brightness, and to shorten the time.

[Application of sample image]
By the way, the sample image can be used for the purpose of determining the user's image, eye size, user brightness, and the like, and for the same purpose as the captured image provided to the user.

  For example, the sample image is processed by the processing unit 324 to be printed on a sticker sheet, an image to be displayed on a terminal connected to the outside via a network, such as a personal computer or a mobile terminal, Specifically, it can be used as an image displayed on a standby screen of a user's mobile terminal, an image to be posted on a web page, an image inserted in the text of an email, or the like.

  Furthermore, the sample image is an image that is transmitted to the user's mobile terminal by the mobile transmission game at the subsequent customer service, and is a “usable pre-image” that is an image used after mobile transmission that is used by the user on the mobile terminal. Can be used. Note that “useable pre-images” include “celebration mail”, “blog deco”, and “corde album”.

  Here, “celebration mail” means that an image transmitted to a mobile terminal is transmitted to a user's friend or the like via an email or a dedicated site instead of a greeting card including a message for the user's friend or the like. This is the intended use. “Blog Deco” is intended to use an image sent to a mobile terminal as a decoration image (deco image) attached to text data (email or blog) exchanged via a communication network (Internet). It is a use. The “corde album” is used for recording the image transmitted to the mobile terminal to record the user's state at the time of shooting or saving, specifically the user's clothes (fashion) at the time of shooting. This is intended to be stored as an image.

  The sample image can be used as a collage image.

  A collage image refers to an image obtained by combining images of a plurality of subjects (for example, a photographed image or a sample image).

  Furthermore, the sample image can be used as an image for posting. Here, “post” refers to registration in the individual photo sticker creating apparatus 1, and registration in the photo sticker creating apparatus 1 allows the user to see a state seen by other users, that is, an image to be disclosed. Is to set. Registering such a public image is called posting.

  For example, if a sample image is used as an image for posting, the time taken by sample shooting can be registered in a state that is open to other users without wasting time, so the image was cute or beautiful. The user can see the image, and even if the image cannot be used as an image to be printed on the sticker paper, the number of photographing is not wasted.

  The posted image is a target of voting from other users, for example, and a user who has posted an image with the largest number of acquired votes is given a right to become a luxury product or a model.

  The sample image can be used as an image to be displayed on the tablet built-in monitor 161.

  Furthermore, the sample image can be used as a person stamp.

  In the photo sticker creation game process of FIG. 11, the sample image is used only for the purpose of the sample. However, the sample image can be processed and used for the purpose provided to the user as described above. .

[Still another example of photo sticker creation game processing]
Here, with reference to the flowchart of FIG. 24, the process of the photograph sticker production apparatus 1 which processed the sample image and used for the use provided to a user is demonstrated.

  In steps S181 through S184, the same processing as in steps S1 through S4 in FIG. 11 is performed.

  In step S185, the processing unit 324 performs a processing process that processes the sample image for a purpose such as a congratulatory email, blog deco, or a coordination album.

  After step S185 is completed, in steps S186 to S191, the same processing as in steps S5 to S10 in FIG. 11 is performed.

  FIG. 25 shows an example of an application selection screen for sample images displayed on the touch panel monitor 92.

  There are three uses of sample images, for example, congratulatory mail, blog deco, and coordination album, and use images 481 to 483 representing the respective uses are displayed on the use selection screen shown in FIG.

  When the user selects a use image corresponding to the use of the sample image from the use images 481 to 483, the display control unit 322 selects a composite image to be combined with the sample image according to the use of the sample image. A composite image selection screen (GUI) for selection is displayed on the touch panel monitor 92.

  FIG. 26 shows an example of a composition image selection screen displayed when selecting a composition image for “celebration mail” displayed on the touch panel monitor 92.

  The composition image selection screen shown in FIG. 26 includes tabs 501 to 503 for three purposes “celebration mail”, “blog deco”, and “corde album”. In the example of FIG. 6 images for composition of “celebration mail” selected on the application selection screen are synthesized and displayed on an image of a model as a subject. The composition image of “celebration mail” includes a foreground image composed of messages such as “Happy Birthday” and “congratulations” synthesized as the foreground of the subject in the photographed image, and a message image synthesized outside (around) the photographed image. It is an image containing. The message image is an image including a fixed sentence (fixed sentence) related to a message such as “Happy Birthday” or “Congratulations” as the foreground image. Note that the background color of the captured image may be selected by a color palette displayed at the right end of the tab 501 or may be determined according to the selected composition image. When the user selects a compositing image, the compositing image is displayed in the selected compositing image display area 504, and when the determination button 505 is selected, the compositing image is confirmed. Note that, when the tab 502 or the tab 503 is selected on the composition selection screen shown in FIG. 26, an image for composition of “blog deco” or “code album” is displayed.

  In addition to the sample image, the captured image can be used as a “useable pre-image”. In this case, the composition image may be displayed in a state synthesized with the sample image so that the actual finish can be easily confirmed. The processing unit 324 performs processing for combining the sample image with the image for synthesis.

[An example of using a sample image for "congratulation mail"]
Next, FIG. 27 shows an example of a processed image obtained by processing a sample image for use as a congratulatory mail.

  On the left side of FIG. 27, there is shown a post-mobile-use use image 521 that is used for congratulatory mail.

  On the right side of FIG. 27, a sample image 522 generated by the image processing unit 321 is shown.

  The processing unit 324 synthesizes a synthesis image (message image) with the sample image 522 generated by the image processing unit 321 to generate a use image (usable pre-image) 521 after mobile transmission.

  Then, the display control unit 322 displays the use image after mobile transmission (usable pre-image) 521 along with the sample image 522 on the touch panel monitor 92 or the like, and displays the use image after mobile transmission (usable pre-image) 521 to the user as a sample. The image 522 is confirmed as a processing result.

  As a processing result displayed on the touch panel monitor 92, as shown in FIG. 27, a pre-image 521 that can be used for a congratulatory mail application, and a sample image 522 obtained by combining the foreground image of the images for composition However, the sample image 522 may be displayed so as to be larger, or only the usable pre-image 521 may be displayed. Alternatively, the sample image 522 may be displayed first in time, and the pre-image 521 that can be used thereafter may be displayed, or vice versa. Furthermore, from the state where the image for synthesis (message image obtained by removing the sample image 522 from the usable pre-image 521) and the sample image 522 are displayed separately, as shown by the thick arrows in the figure, the image for synthesis ( The pre-image 521 that can be used may be finally displayed by displaying an animation representing how the sample image 522 is combined with the message image).

[Details of processing]
Here, the details of the processing in step S185 of FIG. 24 will be described with reference to the flowchart of FIG.

  In the processing of FIG. 28, a case where a sample image is processed will be described, but a captured image may be processed.

  In step S211, the display control unit 322 causes the touch panel monitor 92 to display an application selection screen as shown in FIG.

  In step S212, the selection receiving unit 323 determines whether or not the use of the sample image has been selected by the user based on the information from the touch panel monitor 92, that is, for example, any of the use images 481 to 483 on the use selection screen. It is determined whether or not is selected. The touch panel monitor 92 outputs information corresponding to the selection of the application image by the user to the processing unit 324.

  In step S212, the selection receiving unit 323 repeats the process of step S212 until it is determined that the use of the sample image is selected based on the information from the touch panel monitor 92.

  In step S212, when the selection receiving unit 323 determines that the use of the sample image is selected based on the information from the touch panel monitor 92, the process proceeds to step S213. In FIG. 28, the following description will be given on the assumption that the user has selected “celebration mail”, that is, the usage image 481 as the usage of the sample image.

  In step S213, the display control unit 322 displays a composition image selection screen as shown in FIG. 26 on the touch panel monitor, for example, based on the information from the touch panel monitor 92 on which the user selects the application image 481. 92.

  In step S214, the selection receiving unit 323 determines whether or not the image for synthesis is selected by the user based on the information from the touch panel monitor 92, and continues until step S214 determines that the image for synthesis is selected. Repeat the process.

  In step S214, if the selection receiving unit 323 determines that the compositing image is selected based on the information from the touch panel monitor 92, the process proceeds to step S215. Here, it is assumed that the user has selected “birthday set” (FIG. 26) as the composition image.

  In step S <b> 215, the processing unit 324 combines the sample image with the synthesis image (message image) selected by the user, generates a use image after mobile transmission (usable pre-image), and supplies the generated image to the display control unit 322. To do.

  In step S216, the display control unit 322 displays the use image after mobile transmission (usable pre-image) together with the sample image on the touch panel monitor 92 or the like, and displays the use image after mobile transmission (usable pre-image) to the user. Let me check. Thereafter, the process returns from step S216 to step S185 in FIG. 24, and the subsequent processes are performed.

  According to the above processing, the sample image is processed into a use image after mobile transmission. Note that even if the sample image has a lower image quality (for example, lower resolution) than the captured image, it is displayed as a small-sized image on the mobile terminal. It can avoid impairing user satisfaction.

  In FIG. 26 to FIG. 28, the case where the usage image 481 (“celebration mail”) is selected on the usage selection screen in FIG. 25 has been described, but the usage image 482 (“blog” is described with reference to FIG. 29 and FIG. 30. A case where “deco” is selected will be described. In addition, a case where the usage image 483 (“corde album”) is selected will be described with reference to FIGS. 31 to 33.

  FIG. 29 shows an example of a composition image selection screen displayed on the touch panel monitor 92 when selecting a composition image for “blog deco”.

  Note that, in FIG. 29, the same reference numerals are given to portions configured in the same manner as in FIG. 26, and therefore, description thereof will be appropriately omitted below. The same applies to FIG. 31 described later.

  In the example of FIG. 29, an image for composition of “blog deco” selected on the usage selection screen of FIG. 25 is displayed. That is, in the composition image selection screen of FIG. 29, “Thank you”, “Love Love”, “Congratulations”, “Thanks”, “Greeting”, “Sorry” Eight types (eight images) of images for synthesis of “system”, “sleep system”, and “jiyu system” are combined with a photographed image with a model as a subject and displayed. The composition image for “Blog deco” is an image including a balloon image to be synthesized so as to be adjacent to a part of the photographed image (specifically, the face part of the subject) (on the left side in the example of FIG. 29). The balloon image is an image including a balloon for making the subject in the sample image appear to speak a word and a predetermined fixed sentence displayed in the balloon. Note that the background color of the sample image may be selected by the color palette displayed at the right end of the tab 502, or may be determined according to the selected composition image. When the user selects a compositing image, the compositing image is displayed in the selected compositing image display area 504, and when the determination button 505 is selected, the compositing image is confirmed.

[An example of using sample images for “Blog Deco”]
FIG. 30 shows an example of a processed image obtained by processing a sample image for the use of “blog deco”.

  The processing unit 324 synthesizes the image for synthesis with the sample image 541 generated by the image processing unit 321, and generates a use image after mobile transmission (usable pre-image) 542.

  For example, the processing unit 324 detects a face area representing a face from the sample image 541, and extracts an image 541a including the detected face area. As a method for detecting a face area, for example, a method of detecting a skin color portion in the sample image 541 as a face area can be adopted, but the detection method is not limited to this.

  In addition, the processing unit 324 combines the extracted image 541a with the image for synthesis, and generates a use image after mobile transmission (usable pre-image) 542. As described above, the use image after mobile transmission refers to an image that is transmitted to the user's mobile terminal by the mobile transmission game at the subsequent customer service and that is used by the user on the mobile terminal.

  The display control unit 322 displays the use image after mobile transmission (usable pre-image) 542 together with the sample image 541 on the touch panel monitor 92 or the like, and displays the use image after mobile transmission (usable pre-image) 542 to the user as a sample. The image 541 is confirmed as a processing result.

[An example of using a sample image for “Cord Album”]
FIG. 31 shows an example of a composition image selection screen displayed on the touch panel monitor 92 when selecting a composition image for “code album”.

  In the example of FIG. 31, a composition image of “corde album” selected on the usage selection screen of FIG. 25 is displayed. In other words, on the composition image selection screen of FIG. 31, six composition images are displayed as a composition image of the “corde album” combined with an image having a model as a subject. Of the six images for composition, the lower three images are one-person composition images (one-person composition images), and the upper three images are two-person composition images (two people). Composite image). The single-person composite image is a composite image that is combined with a trimmed image obtained by trimming each subject from the sample image even if there are two users (subjects). It is an image for composition combined with sample images of two subjects. The composition image (one-person composition image and two-person composition image) of the “code album” is a foreground image synthesized as a foreground of a subject in a sample image (trimming image), and a background synthesized as a background of the subject. It is an image including an image and an item stamp that is an image for introducing an item worn by a user (subject). Note that the color of the background image may be selected by the color palette displayed at the right end of the tab 503, or may be determined according to the selected composition image. When the user selects a compositing image, the compositing image is displayed in the selected compositing image display area 504, and when the determination button 505 is selected, the compositing image is confirmed. When a single-person composition image is selected and confirmed, another single-person composition image can be selected. That is, two images for one person (two people) are selected.

  FIG. 32 shows an example of processing performed by the processing unit 324 when “code album” is selected as the use and a single-use composite image is selected as the composite image.

  The left side of FIG. 32 shows a sample image 561 in which two users are photographed as subjects.

  On the right side of FIG. 32, mobile use post-transmission images 562 and 563 obtained by processing the sample image 561 are shown. The use image 562 after carrying transmission is an image obtained by synthesizing the image 562a of one of the two subjects with the image for synthesis 562b for one person. Further, the use image 563 after carrying transmission is an image obtained by combining the image 563a of the other subject of the two people with the image for composite 563b for one person.

  The processing unit 324 extracts the image 562a from the sample image 561 generated by the image processing unit 321, and combines the extracted image 562a with the one-person composition image 562b, thereby generating the use image 562 after portable transmission. To do.

  Further, the processing unit 324 extracts the image 563a on which the user on the right side in the drawing is displayed from the sample image 561 generated by the image processing unit 321, and synthesizes the single-use composition image 563b with the extracted image 563a. By doing this, the post-mobile-transmission use image 563 is generated.

  The display control unit 322 displays the use images after mobile transmission (usable pre-images) 562 and 563 together with the sample image 561 on the touch panel monitor 92 and the like, and displays the use images after mobile transmission (usable pre-images) 562 and 563 is confirmed as a processing result of the sample image 561.

  FIG. 33 shows an example of processing performed by the processing unit 324 when “code album” is selected as the use and a two-person composite image is selected as the composite image.

  On the left side of FIG. 33, a sample image 561 showing two subjects (users) is shown.

  On the right side of FIG. 33, a use image 581 after carrying transmission obtained by processing the sample image 561 is shown. The post-mobile-use use image 581 is an image obtained by synthesizing (part of) a sample image 561 of two subjects with a two-person composition image 581a.

  The processing unit 324 generates the use image 581 after carrying transmission by combining the sample image 561 generated by the image processing unit 321 with the two-person combining image 581a.

  Then, the display control unit 322 displays the use image after portable transmission (usable pre-image) 581 together with the sample image 561 on the touch panel monitor 92 and the like, and displays the use image after portable transmission (usable pre-image) 581 to the user as a sample. The image 561 is confirmed as a processing result.

  In this way, the sample image is processed into a use image after mobile transmission. Note that even if the sample image has a lower image quality (for example, lower resolution) than the captured image, it is displayed as a small-sized image on the mobile terminal. It can avoid impairing user satisfaction.

  Note that an image transmitted to a portable terminal (an image for portable transmission) such as the above-described use image after portable transmission is subjected to color processing such as monochrome or sepia and transmitted to the portable terminal. ing. In this case, even if a low-quality sample image is transmitted to the portable terminal as the portable transmission image, color processing such as monochrome or sepia is performed, so that the low-quality image is not conspicuous and the user's You can avoid sacrificing satisfaction.

  By the way, the sample image can be used for a collage image (also referred to as a combination pre or the like).

  The collage image is generated by the processing unit 324 based on, for example, a sample image generated by the image processing unit 321 or a photographed image.

[Example when using sample images as collage images]
Here, the design pattern of the collage image will be described in detail. As described above, the processing unit 324 generates a collage image based on the sample image and the captured image. At this time, the processing unit 324 is configured to generate a plurality of collage images based on a predetermined design pattern. For example, the processing unit 324 generates collage images corresponding to the design pattern X and the design pattern Y, respectively.

  34 and 35 show an example of a collage image. For example, the collage image shown in FIG. 34 is a collage image corresponding to the design pattern X, and the collage image shown in FIG. 35 is a collage image corresponding to the design pattern Y.

  The collage image shown in FIG. 34 is configured by combining images 621 to 625, and is printed on the seal 601 as a single image in which these images are combined. Note that the seal 601 here is, for example, a seal in an area corresponding to a collage image in the entire sticker paper on which a plurality of stickers are arranged. For example, the image 621 is a sample image, and the images 622 to 625 are images obtained by the first to fourth shootings in the shooting process.

  The images 621 to 624 are images having the same aspect ratio as a general captured image (hereinafter referred to as a normal print image) printed on sticker paper, and the image 625 is an image having a different aspect ratio from the normal print image. Is done. In this example, the images 621 to 624 are shown as substantially square images. Note that each of the images 621 to 624 is an image that forms a collage image in a state where a white border or the like is applied (a frame is added), for example. The image 625 is a horizontally long rectangular image, but is not bordered.

  For example, the image 625 is displayed so as to be superimposed on the image 623 and the image 624 in a state where the background area of the user who is the subject is transparent. That is, the image 625 is a person image that does not display a rectangular frame or the like and has a transparent background, and is displayed as a larger image (enlarged image) than other images.

  The collage image shown in FIG. 35 is configured by combining images 661 to 665, and is printed on the sticker 641 as one image in which these images are combined. The sticker 641 here is, for example, a sticker paper in an area corresponding to a collage image in the whole sticker paper on which a plurality of stickers are arranged. For example, the image 661 is a sample image, and the images 662 to 665 are photographed images obtained by the first to fourth photographing in the photographing process. Therefore, for example, in the collage image, since the sample image obtained by the sample photographing can be added in addition to the photographed image obtained by the photographing process, the variation of the images constituting the collage image can be further increased.

  The image 662 and the image 663 have the same aspect ratio as the normal print image, and the image 661, the image 664, and the image 665 have different aspect ratios from the normal print image. In this example, the image 662 and the image 663 are shown as substantially square images. The images 661 and 664 are vertically long rectangular images, and the image 665 is a horizontally long rectangular image.

  The image 662 is displayed superimposed on the image 661. A part of the balloon (“want suu !!!”) of the image 664 is displayed superimposed on the image 661. As for the image 663, only the image of the user on the left side in the figure is superimposed on the image 661, and the other portions are displayed with the image 661 superimposed on the image 663.

  That is, the subject image of the image 661 is superimposed on the background image of the image 663, and the subject image of the image 663 is further superimposed on the subject image of the image 661. In this way, a collage image with high designability can be provided by changing the overlapping of images.

  The image 662 is an image having the same size as the normal print image, but the image 661, the image 663, and the image 665 are displayed larger (enlarged) than the image 662. Further, the image 664 is displayed smaller (reduced) than the image 661.

  In the collage image design pattern, for example, the arrangement position, angle, size, superimposition relationship between the images, and the like of five images are defined in advance. The processing unit 324 generates a collage image by arranging five images according to the design pattern. For example, the images 621 to 624 in FIG. 34 are arranged at an angle slightly inclined with respect to the direction of the seal 601, and the image 662 in FIG. 35 is arranged at an angle slightly inclined with respect to the direction of the seal 641. .

  Furthermore, for example, the image 625 in FIG. 34 is an image having a size larger than that of other images. The image 661, the image 663, and the image 665 in FIG. 35 are images larger in size than the image 662, and the image 664 is an image smaller in size than the image 661.

  Alternatively, the size of the image constituting the collage image may be determined according to the size of the face of the subject in the image. For example, when two users are shooting, the average of the face sizes of the two users or the size of the face of one of the two users is used as a reference for the images constituting the collage image. Each size may be determined. By doing so, it is possible to generate a collage image with a well-balanced configuration centered on the face.

  Here, an example of a collage image in which five figures are combined has been described, but the number of images to be combined may be other than five. In FIG. 34, the image 621 is a sample image, but any of the images 622 to 625 may be a sample image. The same applies to FIG.

  Thus, for example, collage images corresponding to the above-described design pattern X and design pattern Y are generated. That is, in the photo sticker creating apparatus 1 of the present invention, a plurality of collage images obtained by combining a plurality of images in different ways can be automatically generated and presented to the user.

  In this way, the sample image is processed into a collage image. Even if the sample image has a lower image quality (for example, lower resolution) than the photographed image, the sample image is displayed sufficiently smaller than the collage image, so that the image quality is not conspicuous. , It can avoid impairing user satisfaction.

  As each image constituting the collage image, for example, an edited image may be automatically arranged, or an image designated by the user may be arranged. Further, only a part of the images constituting the collage image may be designated by the user.

  For example, collage images corresponding to the design pattern X and the design pattern Y are displayed on the tablet built-in monitor 161 together with a predetermined GUI or the like, and the user configures the collage image by operating the GUI. You may be able to do that. In this way, for example, a more original collage image can be provided.

  Moreover, you may make it use the image for 1 person as an image which comprises a collage image. For example, you may make it use the image for 1 person obtained by special imaging | photography as an image which comprises a collage image. By doing in this way, for example, a collage image suitable for an anniversary of one user among a plurality of users can be obtained.

  Furthermore, when playing a game with a plurality of users, for example, a design pattern of a collage image may be selected for each user.

  In the example described above with reference to FIG. 34 and FIG. 35, an example in which the five images constituting the collage image are different from each other has been described. A plurality of sheets may be arranged. In this way, for example, a collage image can be generated by eliminating images that the user does not like.

  By the way, there is provided an editing tool called a stamp that enables a stamp image prepared in advance to be superimposed on a photographed image only by touching with a touch pen or the like during editing processing. Some of these stamp tools use the input user's name as a stamp image (hereinafter also referred to as a name stamp). The “name stamp” is, for example, a tool for stamping a user's name on an image printed as a photo sticker, or a character printed on the edge of a sticker or a frame.

[Example when displaying sample images on the name input screen]
FIG. 36 shows an example of a name input screen displayed on the tablet built-in monitor 131.

  This name input screen is displayed on the tablet built-in monitor 131 before the process of step S6 of FIG. 11 is performed, for example. And after a name is input and the name stamp is produced | generated by the process part 324, the process of step S6 is performed.

  On the tablet built-in monitor 131, for example, a name input screen is displayed on which two users can input names on the right side and the left side simultaneously as shown in FIG.

  Specifically, a name display portion 681L that displays characters (names) input by hiragana input is displayed on the left half of the name input screen. On the right side of the name display portion 681L, one back button 683L for erasing the last character displayed on the name display portion 681L, and on the right side, all the characters displayed on the name display portion 681L are deleted. A delete button 684L is displayed.

  Then, on the lower side of the name display portion 681L, the hiragana character input portion 682L that is pressed when inputting each character of the hiragana character, the name input is determined further below the image displayed on the lower side. A determination button 687L that is sometimes operated and a cancel button 688L for canceling the name input are displayed.

  A screen having a similar configuration is also displayed on the right side of the screen.

  An image display unit 685L and an image display unit 686L are provided below the hiragana character input unit 682L. The same applies to the right side of the screen. The images displayed on the image display unit 685L and the image display unit 686L are, for example, sample images taken by special shooting.

  The imaging processing unit 301 acquires sample images for two persons obtained by special imaging from the camera 91 and supplies them to the display control unit 322. The display control unit 322 displays the sample images for two persons from the imaging processing unit 301 on the image display units 685L and 685R and the image display units 686L and 686R, respectively. For example, the sample image of the user U1 is displayed on the image display unit 685L, and the sample image of the user U2 is displayed on the image display unit 686L. Similarly, sample images for two persons are displayed on the image display unit 685R and the image display unit 686R, respectively. For this reason, sample images of the same user, for example, the user U1, are displayed on the image display unit 685L and the image display unit 685R. Similarly, sample images of the same user, for example, the user U2, are displayed on the image display unit 686L and the image display unit 686R.

  For example, the user U1 inputs a name using the left screen, and the user U2 inputs a name using the right screen. User U1 selects image display unit 685L, which is his sample image, and operates his / her hiragana character input unit 682L to input his name. Similarly, the user U2 selects the image display unit 686R which is his sample image, operates the hiragana character input unit 682R, and inputs his name.

  In this way, by allowing the user to select his / her sample image and inputting the name on the sample image, it is possible to make sure that the name of the poster and the sample image match. That is, since the user can confirm the image that may be posted and the name of the user of the image, and can input the name and the image, the photo sticker creating apparatus 1 can input the name and the image. Accurate association is possible. Although the name is described here, it may be the user's real name or a nickname.

  The name entered on this name entry screen is displayed when the post image is displayed as the name of the person displayed on the editing tool called "Name Stamp" or the post image. .

  As shown in FIG. 36, the sample image is displayed relatively small. For this reason, even when sample shooting is performed with lower image quality than shooting processing, there is no inconvenience in using the sample image obtained by sample shooting for the purpose described with reference to FIG.

  By the way, there is provided an editing tool called a stamp that enables a stamp image prepared in advance to be superimposed on a photographed image only by touching with a touch pen or the like during editing processing. Some of these stamp tools use a photographed user's own image as a stamp image (also called a person stamp).

  In the photo sticker creating apparatus 1, the sample image can be used as a person stamp.

[Example when displaying sample images in the content palette]
FIG. 37 shows an example of a content palette of person stamps used in the editing process.

  This content palette is displayed on, for example, the tablet built-in monitor 131.

  In the content palette in FIG. 37, a plurality of person stamps 702-1 to 702-6 are displayed in an area 701, and these person stamps are generated from sample images and photographed images, respectively.

  For example, the processing unit 324 generates a person stamp 702-1 by extracting a person region in which a person (user) is displayed from the sample image generated by the image processing unit 321. Similarly, the processing unit 324 generates person stamps 702-2 to 702-6 by extracting a person region from each captured image generated by the image processing unit 321.

  For example, the user taps one of the images 702-1 to 702-6 displayed in the region 701 using the touch pen 162A or the touch pen 162B, and selects and stamps the person stamp image. It can be superimposed on the image.

  In this example, the images 702-1 to 702-6 are all horizontally long images. That is, the images 702-1 to 702-6 are images having an aspect ratio different from that of the normal print image.

  FIG. 38 shows an example of a photographed image that has been edited using a person stamp. For example, as shown in FIG. 38, the person image of the person stamp 702-1 is superimposed on the image to be edited.

  The person stamp is smaller than the captured image, so even if sample shooting is performed at a lower image quality than the shooting process, it is not noticeable that the image quality is low, so sample shooting is possible without sacrificing user satisfaction. The sample image obtained by the above can be sufficiently used as a person stamp.

  By the way, in step S21 of FIG. 12, the imaging processing unit 301 acquires a captured image used for generating a sample image by sample imaging. However, the photographing processing unit 301 extracts a user's face or the like on a photographed image obtained by sample photographing (or a photographed image obtained by photographing processing), and expands the extracted image such as a face as a sample image. You may make it acquire as a picked-up image used for producing | generating.

  In this case, the sample image displayed on the touch panel monitor 92 or the like is used for the reflection setting process performed on the user's face or the like even when the ratio of the user's face or the like is small in the captured image obtained by the sample shooting. Therefore, it is possible to accurately grasp.

  In addition, when the selection receiving unit 323 determines the shooting setting process for each area where the user is displayed on the captured image, the shooting processing unit 301 obtains the sample shooting. A sample image for each user may be acquired from the captured image.

  That is, for example, the imaging processing unit 301 may acquire an extracted image obtained by extracting the user U from a captured image obtained by sample imaging as a captured image of the user U. The sample image generated from the sample image is selected by the user U, and the image setting process performed on the selected sample image is performed for the area on the captured image where the user U is displayed. It is determined as a setting process.

  When sample shooting is performed with lower image quality than shooting processing, the print processing unit 303 may make the size of the sample image smaller than the shot image and print it on sticker paper. In this case, it can be made inconspicuous that the sample image has a low image quality as compared with the case where the sample image is printed on the sticker paper with the same size as the photographed image.

  For example, a relatively large image is printed on a sticker sheet, and a small image is printed on the remaining margin as an extra image. When the sample image is printed as a small image in the margin, there is no problem even if the sample image has a low image quality. For this reason, the sample image has an image quality suitable for printing as a small image.

  By the way, the above-described series of processes can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 8, the recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the apparatus main body, and is a magnetic disk (flexible disk) on which the program is recorded. Disk), optical disk (including CD-ROM and DVD), magneto-optical disk (including MD), or removable media 205 made of semiconductor memory, etc., but also pre-installed in the device body The ROM 206 that stores the program and the hard disk included in the storage unit 202 are distributed to the administrator.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  In the above, the print medium is not limited to sticker paper or photographic paper. For example, it is printed on paper or film of a predetermined size, paper for posters, cards such as telephone cards, or cloths such as T-shirts. You may make it do.

  The embodiments of the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus 11 Image pick-up unit 12 Editing part 13 Subsequent customer service part 201 Control part 208 Image pick-up part 209 Editing part 210 Subsequent customer service part 301 Photographing process part 302 Edit process part 303 Print process part 304 Subsequent customer service part 322 Image processing part 322 Display control unit 323 Selection receiving unit 324 Processing unit

Claims (5)

A shooting processing unit that takes a user multiple times and obtains a plurality of shot images;
An image processing unit that generates a plurality of different sample images by performing image processing on the image on at least one of the plurality of captured images;
A display control unit for controlling display on the display unit of the sample image;
A selection receiving unit that receives selection of the sample image displayed on the display unit by the user, and
The photographing processing unit performs at least one of a plurality of photographings as a special photographing for acquiring the photographed image taken by the user alone,
The image processing unit
A plurality of different sample images are generated by performing image processing on the captured image taken by the user alone.
An image processing apparatus that performs the image processing applied to the sample image selected by the user on at least another one of the plurality of captured images. If there are two users,
The imaging processing unit performs at least one of a plurality of shootings as the special shooting for acquiring the shot image in which the user is captured one by one,
2. The image according to claim 1, wherein the image processing unit generates a plurality of different sample images by performing image processing on the captured image with respect to each of the captured images in which the user is captured one by one. Processing equipment. The image processing device according to claim 1, wherein the photographing processing unit performs up photographing for photographing the user's face or upper body as the special photographing. The image processing apparatus according to claim 1, wherein the image processing unit performs image processing for adjusting at least one of saturation, brightness, sharpness, and contrast on the captured image. A shooting processing unit that takes a user multiple times and obtains a plurality of shot images;
An image processing unit that generates a plurality of different sample images by performing image processing on the image on at least one of the plurality of captured images;
A display control unit for controlling display on the display unit of the sample image;
An image processing method of an image processing apparatus comprising: a selection receiving unit that receives selection of the sample image displayed on the display unit by the user,
The photographing processing unit shoots at least one of a plurality of photographings as a special photographing for acquiring the photographed image taken by the user alone,
The image processing unit
A plurality of different sample images are generated by performing image processing on the captured image taken by the user alone.
An image processing method including a step of performing the image processing applied to the sample image selected by the user on at least another one of the plurality of captured images.

Images