JP2014131246A - Device and method for generating photograph seal and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To paste a synthesis image without discomfort with simple operation, to improve a satisfaction level of a user, and to shorten time required for editing work.SOLUTION: A synthesis image superposition section 321 superposes a synthesis image which a user selects on an editing screen at a position which a user designates on an image of an editing object. A superposed partial image processing section 322 performs image processing so that a prescribed feature amount of the synthesis image and a prescribed feature amount of the image of the editing object become closer values in the vicinity of the portion where the synthesis image is superposed in the image of the editing object on which the synthesis image is superposed by the synthesis image superposition section 321. An organ image recognition section 323 recognizes prescribed organs (the eyes, the nose, the mouth, the cheek, the chin, and the like, for example) in the face image.

Description

  The present technology relates to an apparatus and method for creating a photo sticker, and a program. In particular, the present invention makes it possible to paste a compositing image that does not feel uncomfortable with a simple operation, increasing user satisfaction and reducing the time required for editing. The present invention relates to an apparatus and method for creating a photo sticker that can be shortened, and a program.

  There is known a photo sticker that takes a picture of a user, causes the user to edit the shot image, and prints and provides the edited image on sticker paper. Such a photo sticker is installed in an entertainment facility.

  The flow of one game provided by the photo-seal machine usually shoots a user in the shooting space as a subject, moves the user to the editing space, edits the image according to operations performed in the editing space, The edited image, which is the edited image, is printed on a sticker sheet and discharged.

  In recent photo stickers, for example, various editing composite images (for example, stamp images) are provided so as to achieve an original finish.

  For example, when editing is performed in the flow of the game, a palette is displayed as an editing GUI, and the user responds to the editing contents with the editing tool selected by operating a button on the palette. A stamp image can be selected. When the user designates a desired position on the photographed image, an image in which the selected stamp image is pasted at the designated position on the photographed image is obtained as a composite image (see, for example, Patent Document 1). .

  However, according to Patent Document 1, the user can paste a desired composition image on a captured image by designating a finger position. However, in the stage before pasting the composition image on the captured image, I can't confirm the image of the composite image pasted on the image. That is, the image image of the captured image and the composition image can be confirmed at the stage after pasting, but the captured image and the composition image may not be mixed.

  Possible causes of unfamiliar images include, for example, differences in image images such as brightness, sharpness, appearance, brightness, and contrast.

  If the captured image and the composite image do not match, select the redo button for pasting the composite image, cancel the pasting editing operation, select another composite image, and paste it at the desired position. Editing work must be performed, which is time consuming for the user.

  In view of this, there is also a photo sticker that displays a button for selecting an image image (for example, shading, line thickness) related to the image for synthesis on the editing screen, and a button for selecting the degree of five levels in the image image. It has been proposed (see, for example, Patent Document 2).

  According to the technique of Patent Document 2, the stamp image can be repeatedly changed while being displayed on the editing target image, and the stamp image and the editing target image can be changed without performing a procedure such as canceling the selected stamp image. The stamp image can be changed while checking the overlap, and the stamp image that matches the image can be selected.

JP 2012-29072 A JP 2007-221748 A

  However, in the technique of Patent Document 2, the composition image can be adjusted in five stages. However, there are cases where the adjustment in the five stages is not sufficient, and the captured image and the composition image may not match. there were.

  Some users forgot to press the button for this adjustment.

  Furthermore, it is desirable to be able to further shorten the time required for the work for selecting the degree of five steps in the image.

  The present invention has been made in view of such a situation, and it is possible to paste a compositing image without a sense of incongruity with a simple operation, increasing user satisfaction and reducing the time required for editing work. It can be shortened.

  An image processing apparatus according to an aspect of the present invention performs an editing input operation for inputting editing information on a captured image that is an image of the user obtained by a shooting operation with a user as a subject. In the photo sticker creating apparatus that provides the user with the edited user image, the composition image is superimposed on the captured image or superimposed on the captured image in the editing input operation. A synthesis image superimposing unit that further superimposes a synthesis image on the synthesis image; and an image processing unit that performs image processing on at least one of the captured image and the synthesis image; The feature amount of the image for synthesis is associated in advance, and the image processing unit is configured so that the feature amount of the image for synthesis approaches the feature amount associated in advance, or before As closer to the feature amount by the feature that said associated in advance of the captured image, a photo sticker creation apparatus for performing the image processing.

  The feature amount of the photographed image can be a feature amount determined according to a photographing parameter set at the time of photographing.

  The image processing means includes an image configured as a whole or a part of the synthesis image, and an image configured with pixels within a predetermined range around a position where the synthesis image is superimposed on the captured image. The image processing can be performed on at least one of the above.

  The image processing means can perform a blurring process.

  The image processing means may perform a process for increasing the transparency of the composition image.

  The image processing means may perform image processing for changing a gamma value related to gamma correction of the shooting image or the composition image.

  The image processing means may perform image processing for changing a tone curve characteristic of the shooting image or the composition image.

  The image processing means may perform image processing for changing an average luminance value of the shooting image or the composition image.

  The image processing means may perform image processing for changing a contrast value of the shooting image or the composition image.

  The image processing unit may perform image processing for changing an edge enhancement degree of the shooting image or the composition image.

  A color on which image processing is performed so that the color of the image for synthesis is a color corresponding to the color of an image composed of pixels within a predetermined range around the position where the image for synthesis is superimposed on the captured image A change means can be further provided.

  Organ recognition means for recognizing a predetermined organ in the face image of the user in the captured image is further provided, and the composition image superimposing means superimposes the composition image on the organ recognized by the organ recognition means. Can be.

  The composition image is superimposed on the user's face image in the captured image, so that makeup can be applied to the user's face image.

  One aspect of the present invention allows an editing input operation for inputting editing information to a captured image that is an image of the user obtained by a shooting operation with a user as a subject, and further provides an edited image obtained. In the photo sticker creating method of the photo sticker creating device for providing the user image of the user, the composition image superimposing means superimposes the composition image on the photographed image in the editing input operation, or A step of superimposing a composite image on the composite image superimposed on the photographed image, and a step of performing image processing on at least one of the photographed image or the composite image. The feature amount of the photographed image and the feature amount of the composition image are associated in advance, and the image processing unit associates the feature amount of the composition image with the feature amount. So as to approach more or the like characteristic of the photographed image is closer to the feature amount the associated advance, a photo sticker creation method of applying the image processing.

  One aspect of the present invention allows an editing input operation for inputting editing information to a captured image that is an image of the user obtained by a shooting operation with a user as a subject, and further provides an edited image obtained. A program for causing a computer to execute processing in the photo sticker creating apparatus that provides the user's image to the user, wherein the composition image superimposing means applies the composition image to the photographed image in the editing input operation. A step of superimposing or superimposing a composition image on a composition image superimposed on the photographed image, and an image processing means performs image processing on at least one of the photographed image or the composition image A process including a step, wherein the feature amount of the photographed image and the feature amount of the image for synthesis are associated in advance, and the image processing means The program for performing the image processing so that the feature amount of the image for synthesis approaches the feature amount associated in advance or the feature amount of the photographed image approaches the feature amount associated in advance. It is.

  In one aspect of the present invention, in the editing input operation, a composite image is superimposed on the captured image, or a composite image is further superimposed on the composite image superimposed on the captured image, and the photographing is performed. Image processing is performed on at least one of the image and the composition image, the feature amount of the captured image and the feature amount of the composition image are associated in advance, and the image processing means The image processing is performed so that the feature amount of the image approaches the feature amount associated in advance or the feature amount of the captured image approaches the feature amount associated in advance.

  According to the present invention, it is possible to paste a compositing image without a sense of incongruity by a simple operation, and it is possible to increase the satisfaction of the user and reduce the time required for editing work.

It is a perspective view which shows the structural example of the external appearance of the photograph sticker production apparatus which concerns on one embodiment of this invention. It is the perspective view which looked at the external appearance of the photograph sticker production apparatus from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of an imaging | photography part. It is a figure which shows the structural example of a background part. It is a figure which shows the structural example of an edit part. It is a figure which shows the structural example of a customer service part after the fact. It is a block diagram which shows the example of an internal structure of a photograph sticker production apparatus. It is a functional block diagram which shows the detailed structural example of a control part. It is a block diagram which shows the detailed structural example of the edit process part of FIG. It is a flowchart explaining the example of the flow of photograph sticker creation game processing. It is a figure which shows the example of the edit screen displayed in the edit process of FIG. It is a figure explaining the example of inversion of the image for a synthesis | combination. It is a figure explaining the example of the depth rotation of the image for a synthesis | combination. It is a figure which shows another example of the edit screen displayed in the edit process of FIG. It is a figure explaining a highlight in detail. It is a figure explaining the highlight of a nasal muscle in detail. It is a figure explaining a shading in detail. It is a figure explaining an example of an eyeline. It is a flowchart explaining the example of an image composition process.

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings.

  FIG. 1 is a perspective view showing a configuration example of the appearance of the photographic sticker creating apparatus 1.

  The photo sticker creating apparatus 1 is a game machine that allows a user to perform operations such as shooting and editing as a game and receives a price from the user instead of providing a shot image or an edited image. The photo sticker creating apparatus 1 is installed in a store such as a game center. There may be one user, but there are mainly two or three users.

  A user who plays in the game provided by the photo sticker creating apparatus 1 pays the price, takes a picture of himself as a subject, and selects an image to be edited selected from the shot images obtained by shooting. Editing is performed using an editing function for synthesizing a background image or foreground image, a handwritten line drawing, or a stamp image, thereby making the photographed image rich and colorful. The user receives the sticker sheet on which the edited image is printed and ends the series of games.

  As shown in FIG. 1, the photo sticker creating apparatus 1 mainly includes a photographing unit 11, an editing unit 12, and a subsequent customer service unit 13. The photographing unit 11 and the editing unit 12 are installed in contact with each other, and the editing unit 12 and the subsequent customer service unit 13 are installed in contact with each other.

  The photographing unit 11 includes a photographing unit 21 and a background unit 22. The photographing unit 21 and the background unit 22 are installed with a predetermined distance apart, and photographing processing is performed in a photographing space that is a space formed between the photographing unit 21 and the background unit 22.

  The photographing unit 21 is a device that allows a user to perform photographing processing. The photographing unit 21 enters the photographing space and is located in front of the user who is performing the photographing process. The front panel 41 of the photographing unit 21 that constitutes a surface facing the photographing space in front is provided with a touch panel monitor used by the user during photographing processing. When the left side as viewed from the user in the imaging space is the left side and the right side is the right side, the left side of the imaging unit 21 is constituted by a side panel 42A, and the right side is a side panel 42B (not shown). Consists of.

  The side panel 42A is provided with an LED light emitting unit 42L configured by embedding a plurality of LEDs (Light Emitting Diodes). The surface of the side panel 42A is made of an acrylic plate or the like on which advertisements such as products and services of the manufacturer of the photo sticker creating apparatus 1 and companies affiliated with the manufacturer are printed so as to cover the entire surface of the side panel 42A. A POP advertisement is attached. In the POP advertisement, information particularly appealing as an advertisement is printed on a portion corresponding to the LED light emitting unit 42L, and the information is emphasized (conspicuous) by the light emission of the LED light emitting unit 42L. The LED light emitting unit 42L may be provided also on the side panel 42B (not shown), or may be provided only on one of the side panel 42A and the side panel 42B.

  The background unit 22 is attached to the left end of the rear panel 51 and the rear panel 51, which are plate-like members positioned on the rear side of the user who is performing the photographing process facing the front, and is a plate having a narrower width than the side panel 42A. The side panel 52A (not shown) is a plate-like member that is attached to the right end of the rear panel 51 and is narrower than the side panel 42B.

  The side panel 42A constituting the left side surface of the photographing unit 21 and the side panel 52A of the background unit 22 are provided on substantially the same plane, and each lower part is formed by, for example, a connecting part 23A having a plate-like member. It is connected by a connecting portion 23A ′, which is a metal substantially U-shaped member. Although not shown, the side panel 42B that constitutes the right side surface of the photographing unit 21 and the side panel 52B of the background unit 22 are provided on substantially the same plane, and each upper part is connected by a connecting unit 23B that is a plate-like member. Each lower part is connected by connection part 23B 'which is a substantially U-shaped member made of metal, for example.

  An opening formed by being surrounded by the side panel 42 </ b> A of the photographing unit 21, the connecting part 23 </ b> A, and the side panel 52 </ b> A of the background part 22 becomes an entrance G <b> 1 of the photographing space. Although not shown, an opening formed by being surrounded by the side panel 42B of the photographing unit 21, the connecting part 23B, and the side panel 52B of the background 22 is also an entrance G2 of the photographing space.

  The background curtain unit 25 is provided above the background portion 22 so as to be supported by the back panel 51, the side panel 52A, and the side panel 52B. The background curtain unit 25 stores a plurality of winding-type background curtains having different colors or patterns and used for the background. The background curtain unit 25 operates in conjunction with photographing by a camera or the like provided in the photographing unit 21. At the time of photographing, for example, the curtain of the color selected by the user is lowered and the other curtains are wound up.

  In addition, as a background curtain accommodated in the background curtain unit 25, you may prepare the raising / lowering curtain which uses several curtains as one curtain for curtains. In addition, a black curtain is pasted on the rear panel 51, which is the back of the shooting space, and a plurality of background images for synthesis are prepared, and the background image desired by the user is captured in the shooting process and editing process. It may be possible to synthesize it into parts.

  An opening surrounded by the front panel 41 of the photographing unit 21, the connecting part 23A, the connecting part 23B, and the background curtain unit 25 is formed above the photographing space, and the ceiling strobe unit 24 covers the part of the opening. Provided. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B. The ceiling strobe unit 24 has a built-in strobe that emits light toward the photographing space in accordance with photographing. A fluorescent lamp is provided inside the strobe constituting the ceiling strobe unit 24, and also functions as illumination of the photographing space.

  In the shooting process, shooting parameters for changing the image of the subject in the shot image are set.

  The image of the subject is selected by the user before or after shooting in the shooting process, and determines the brightness of the subject in the shot image. For example, “cute” and “beautiful” are available. Has been. The shooting parameters set in the shooting process are stored in association with the shot image, for example.

  The editing unit 12 is a device that allows a user to perform editing processing, which is processing for editing an image obtained by shooting processing. The editing unit 12 is provided so as to be connected to the photographing unit 11 so that one side surface thereof is in contact with the back surface of the front panel 41 of the photographing unit 21. The editing unit 12 is provided with a configuration such as a tablet built-in monitor used by the user during editing processing.

  If the configuration of the editing unit 12 shown in FIG. 1 is a front-side configuration, the editing unit 12 is used for editing processing on the front side and the back side so that two sets of users can perform editing processing simultaneously. Each configuration is provided.

  The front side of the editing unit 12 is a surface perpendicular to the floor surface, and is composed of a surface 71 that is substantially parallel to the side panel 42A, and a slope 72 formed above the surface 71. The configuration used is provided on the slope 72. On the left side of the slope 72, a support portion 73A that has a columnar shape and supports one end of the lighting device 74 is provided. A support portion 75 that supports the curtain rail 26 is provided on the upper surface of the support portion 73A. A support portion 73 </ b> B (FIG. 2) that supports the other end of the lighting device 74 is also provided on the right side of the slope 72.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C so that the shape when viewed from above is a U-shape. One end of the rails 26A and 26B provided in parallel is fixed to the connecting portion 23A and the connecting portion 23B, respectively, and both ends of the remaining one rail 26C are joined to the other end.

  A curtain is attached to the curtain rail 26 so that the inside of the space in front of the editing unit 12 and the space in front of the back cannot be seen from the outside. The space in front of the editing unit 12 and the space in front of the back of the editing unit 12 surrounded by the curtain attached to the curtain rail 26 are editing spaces in which the user performs editing processing.

  FIG. 2 is a perspective view of the photo sticker creating apparatus 1 as seen from another angle.

  The subsequent customer service unit 13 is a device that allows the user to perform the subsequent customer service process. Subsequent customer service processing includes processing for transmitting a photographed image or edited image to a mobile terminal such as a mobile phone, processing for allowing a user to play a mini game, processing for answering a questionnaire, and the like.

  As shown in FIG. 2, the post-service customer unit 13 has a plate-shaped casing having a predetermined thickness, and is provided by being joined to the left side surface of the editing unit 12. On the front side of the post-service unit 13, there are provided a tablet built-in monitor used by the user at the time of post-service processing, a discharge port through which sticker paper on which a photographed image or an edited image is printed is discharged. The space in front of the front-end customer service unit 13 becomes a rear-end customer service space where a user waiting for printing on the sticker paper to perform post-service processing.

  Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described with reference to FIG. FIG. 3 is a plan view of the photo sticker creating apparatus 1 as viewed from above.

  The user of the photo sticker creating apparatus 1 is formed between the photographing part 21 and the background part 22 from the entrance G1 as indicated by the white arrow # 1 or from the entrance G2 as indicated by the white arrow # 2. The photographing space A1 is entered, and photographing processing is performed using a camera or a touch panel monitor provided in the photographing unit 21.

  The user who has finished the shooting process exits the shooting space A1 and moves to the editing space A2-1 using the doorway G1 as indicated by the white arrow # 3, or moves to the editing space A2-1 as indicated by the white arrow # 4. To leave the shooting space A1 and move to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12, and the editing space A2-2 is an editing space on the back side of the editing unit 12. Which of the editing space A2-1 and the editing space A2-2 is moved is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the empty space of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing processing. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing processing at the same time.

  After the editing process is finished, printing of an image selected from the photographed image and the edited image is started. During printing of the image, the user who has finished the editing process moves from the editing space A2-1 to the subsequent customer service space A3 as indicated by the white arrow # 5 if the editing process has been performed in the editing space A2-1. Then, the customer service is processed after the fact. In addition, when the editing process is completed in the editing space A2-2, the user who has finished the editing process moves from the editing space A2-2 to the post-service area A3 as indicated by the white arrow # 6. Post service processing is performed in the customer service space A3.

  When the printing of the image is finished, the user receives the sticker paper from the outlet provided in the post-service section 13 and finishes a series of photo sticker creation games.

  Next, the structure of each part which comprises the photograph sticker production apparatus 1 is demonstrated.

  FIG. 4 is a diagram illustrating a configuration example of the front of the photographing unit 21. The photographing unit 21 is configured by attaching a front panel 41, a side panel 42A, and a side panel 42B to a base unit 43 having a box shape.

  The front panel 41 is positioned in front of the user who performs the shooting process in the shooting space A1, and the side panel 42A and the side panel 42B are positioned on the left side and the right side of the user who performs the shooting process in the shooting space A1, respectively.

  A photographing / display unit 81 is provided above the center of the front panel 41. The photographing / display unit 81 includes a camera 91, a touch panel monitor 92, and a front strobe 93.

  The camera 91 is configured by an imaging device such as a lens or a CCD (Charge Coupled Device), and photographs a user in the photographing space A1. The moving image captured by the camera 91 is displayed on the touch panel monitor 92 in real time. An image captured by the camera 91 at a predetermined timing such as when a user gives an instruction to shoot is saved as a photographic image (still image).

  Further, the camera 91 is installed at a higher position as compared with the conventional photo sticker creating apparatus. Specifically, the height from the installation surface of the photo sticker creating apparatus 1 to the lens center of the camera 91 is 1630 mm, and the angle (forward tilt angle) between the optical axis of the lens and the horizontal plane is 24 °. With such a structure, the user can take an image from diagonally forward. As a result, in the photographed image, the user looks up slightly, the user's eyes are large, and the face appears as a small face.

  The touch panel monitor 92 provided on the lower side of the camera 91 includes a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 92 has a function as a live view monitor that displays a moving image captured by the camera 91 and a function that displays various GUI (Graphical User Interface) images and accepts a user's selection operation through the touch panel. ing. On the touch panel monitor 92, a still image as a photographing result and a moving image after an image such as a background is combined are displayed as appropriate.

  A front strobe 93 provided with a light emitting surface (a plurality of milky white acrylic plates) so as to surround the upper and left and right sides of the camera 91 emits light in accordance with the photographing by the camera 91 and is a user as a subject. Irradiate near the face of.

  On the front panel 41, an upper strobe 82 is installed above the photographing / display unit 81. The upper strobe 82 irradiates the user from the upper front.

  The base unit 43 is also provided with a foot strobe 83 that irradiates the user's foot. A fluorescent lamp is provided inside the upper strobe 82 and the foot strobe 83, and is used as illumination in the photographing space A1 together with the fluorescent lamp inside the strobe constituting the ceiling strobe unit 24. By adjusting the light emission amount of each fluorescent lamp, or by adjusting the number of fluorescent lamps to emit light, the brightness in the shooting space A1 depends on the content of the shooting process performed by the user. Adjust as appropriate.

  On the right side of the foot strobe 83, a coin insertion / return port 84 through which a user inserts money is provided.

  Spaces 43A and 43B formed on the left and right sides of the upper surface of the base portion 43 are used as a luggage storage place for a user who performs a photographing process to place baggage and the like. For example, near the ceiling of the front panel 41, a speaker for outputting sound such as guidance sound for photographing processing, BGM (Back Ground Music), and sound effects is also provided.

  FIG. 5 is a diagram illustrating a configuration example of the background portion 22 on the photographing space A1 side.

  As described above, the background curtain unit 25 is provided above the back panel 51. Near the center of the background curtain unit 25, a back center strobe 101 that irradiates a user who is performing a photographing process in the photographing space A1 from the rear center is attached.

  A rear left strobe 102 for irradiating a user who is performing a photographing process in the photographing space A1 from the left rear is attached to the rear panel 51 on the doorway G1 side. Further, a rear right strobe 103 that irradiates a user who is performing a photographing process in the photographing space A1 from the right rear is attached to a position of the rear panel 51 on the doorway G2 side.

  FIG. 6 is a diagram illustrating a configuration example of the editing unit 12 on the front side (editing space A2-1 side).

  A tablet built-in monitor 131 is provided at substantially the center of the slope 72. A touch pen 132A is provided on the left side of the tablet built-in monitor 131, and a touch pen 132B is provided on the right side.

  The tablet built-in monitor 131 is configured by superimposing a tablet capable of operation input using the touch pen 132A or 132B on a monitor such as an LCD. On the tablet built-in monitor 131, for example, an editing screen that is a screen used for editing a captured image selected as an image to be edited is displayed. When two people perform editing work simultaneously, the touch pen 132A is used by one user, and the touch pen 132B is used by the other user.

  On the left side of the editing unit 12, a post-service unit 13 is provided.

  FIG. 7 is a diagram illustrating a configuration example of the front side of the post-service unit 13.

  A monitor 161 with a built-in tablet is provided at the upper center of the post-service section 13. A touch pen 162A is provided on the left side of the tablet built-in monitor 161, and a touch pen 162B is provided on the right side. Similarly to the tablet built-in monitor 131, the tablet built-in monitor 161 is configured by superimposing a tablet capable of performing an operation input using the touch pen 162A or 162B on a monitor such as an LCD. On the tablet built-in monitor 161, a screen used for post-service processing such as a mini game is displayed.

  A sticker paper discharge port 163 is provided below the tablet built-in monitor 161, and a speaker 164 is provided above the tablet built-in monitor 161.

  In the sticker paper outlet 163, sticker paper on which an image created by the user of the editing space A2-1 is edited or printed by the user of the editing space A2-2 is edited. The sticker paper on which the created image is printed is discharged. A printer is provided inside the editing unit 12, and printing of images is performed by the printer.

  The speaker 164 outputs sounds such as guidance voice, BGM, and sound effects for post-service processing.

  Next, the internal configuration of the photo sticker creating apparatus 1 will be described. FIG. 8 is a block diagram illustrating an internal configuration example of the photo sticker creating apparatus 1. The same code | symbol is attached | subjected to the same structure as the structure mentioned above. The overlapping description will be omitted as appropriate.

  The control unit 201 includes a CPU (Central Processing Unit) and the like, executes a program stored in a ROM (Read Only Memory) 206 and a storage unit 202, and controls the overall operation of the photo sticker creating apparatus 1. A storage unit 202, a communication unit 203, a drive 204, a ROM 206, and a RAM (Random Access Memory) 207 are connected to the control unit 201. The control unit 201 is also connected with each configuration of the photographing unit 208, the editing unit 209, and the post-service unit 210.

  The storage unit 202 includes a nonvolatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 201. Information stored in the storage unit 202 is appropriately read out by the control unit 201.

  A communication unit 203 is an interface of a network such as the Internet, and communicates with an external device according to control by the control unit 201.

  A removable medium 205 made of an optical disk, a semiconductor memory, or the like is appropriately attached to the drive 204. Computer programs and data read from the removable medium 205 by the drive 204 are supplied to the control unit 201 and stored in the storage unit 202 or installed.

  The ROM 206 stores programs and data executed by the control unit 201. The RAM 207 temporarily stores data and programs processed by the control unit 201.

  The imaging unit 208 includes a coin processing unit 221, a background control unit 222, a lighting device 223, a camera 91, a touch panel monitor 92, and a speaker 224 that are configured to perform imaging processing in the imaging space A1.

  The coin processing unit 221 detects the insertion of coins into the coin insertion / return port 84. When the coin processing unit 221 detects that a predetermined amount of coins such as 400 yen has been inserted, the coin processing unit 221 outputs an activation signal indicating that to the control unit 201.

  The background control unit 222 raises and lowers the background curtain stored in the background curtain unit 25 according to the background control signal supplied from the control unit 201. The background curtain may be manually selected by the user.

  The illumination device 223 is a fluorescent lamp provided inside each strobe in the imaging space A1, and emits light according to an illumination control signal supplied from the control unit 201. As described above, in the photographing space A1, in addition to the strobe of the ceiling strobe unit 24, the upper strobe 82 provided in the photographing unit 21, the foot strobe 83, the front strobe 93, the back center strobe 101 provided in the background unit 22, A back left strobe 102 and a back right strobe 103 are provided.

  Further, the lighting device 223 adjusts the brightness in the shooting space A1 according to the stage of the shooting work performed by the user by adjusting the light emission amount according to the control by the control unit 201.

  The camera 91 shoots according to the control by the control unit 201 and outputs an image obtained by the shooting to the control unit 201.

  The editing unit 209A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 231 provided on the front side of the editing unit 12 as a configuration for performing editing processing in the editing space A2-1. The editing unit 209B has the same configuration as the editing unit 209A, and performs editing processing in the editing space A2-2.

  The tablet built-in monitor 131 displays an editing screen according to control by the control unit 201, and detects a user operation on the editing screen. A signal representing the content of the user's operation is supplied to the control unit 201, and the captured image to be edited is edited.

  The subsequent customer service unit 210 includes a tablet built-in monitor 161 that is configured to perform subsequent customer service in the subsequent customer service space A3, touch pens 162A and 162B, a speaker 164, a printer 241 that performs print processing, and a sticker unit 242. The

  The printer 241 prints the photographed image or the edited image obtained by the editing process on the sticker paper stored in the sticker paper unit 242 attached to the printer 241 and discharges it to the sticker paper discharge port 163.

  Next, the control unit 201 will be described. FIG. 9 shows an example of the functional block configuration realized by the control unit 201 executing a program stored in the ROM 206 or the like.

  The control unit 201 performs a process related to a charge input when starting the photo sticker creation game and a process related to a photographing work process of the photo sticker creation game such as photographing a user group. An editing processing unit 302 that performs processing related to the editing work process of the photo sticker creation game such as graffiti editing, a printing processing unit 303 that performs processing related to the printing process of the photo sticker creation game such as printing of sticker paper, and editing work. A post-service processing unit 304 is provided for performing processing related to the post-service process of the photo sticker creation game that serves the finished user group.

  That is, the control unit 201 controls processing related to each process of the photo sticker creation game.

  FIG. 10 is a block diagram illustrating a detailed configuration example of the editing processing unit 302 of FIG. As shown in the figure, the edit processing unit 302 has a composition image superimposing unit 321, a superimposed partial image processing unit 322, an organ image recognizing unit 323, and an edit control unit 324.

  The composition image superimposing unit 321 controls processing for superimposing the composition image on the editing target image. Here, the composition image is, for example, a stamp image or a frame image selected by the user. Alternatively, a character image, a line image, or the like may be used as the composition image.

  The composition image superimposing unit 321 superimposes the composition image selected by the user on the editing screen displayed on the tablet built-in monitor 131 at the position designated by the user on the editing target image.

  The superimposed partial image processing unit 322 performs image processing on or near the portion where the synthesis image is superimposed on the editing target image on which the synthesis image is superimposed by the synthesis image superimposing unit 321. The superimposed partial image processing unit 322, for example, the predetermined feature amount of the synthesis image and the predetermined feature amount of the editing target image so that the superimposed synthesis image does not feel uncomfortable in the editing target image. Image processing is performed so that becomes a closer value.

  Here, the feature amount may be a value such as a luminance value or a contrast value obtained by analyzing the image, or may be a vector amount composed of a plurality of values. Note that specific feature amounts may indicate the degree of general image processing such as transparency, edge enhancement, gamma value for gamma correction, values used for color change, and the like. That's fine. Note that the degree of edge strength is appropriately referred to as edge enhancement.

  In the photographing process performed by the photographing processing unit 301 described above, for example, photographing parameters selected by the user before or after photographing, for example, photographing parameters such as “cute” and “beautiful” are set. It is prepared. For example, an image shot with “clean” shooting parameters set is an image with high edge enhancement, and an image shot with “cute” shooting parameters set is edge enhancement. Is a low image. By performing the image processing by the superimposed partial image processing unit 322, for example, a synthesis image having a hue and brightness that is well suited to the shooting parameters set in the shooting processing is generated.

  That is, each shooting parameter (or edge enhancement, which is a feature amount of the shot image) such as “cute” and “beautiful”, and a feature amount (for example, transparency) of the composite image are associated in advance. It has been. For example, a predetermined high value of transparency is associated with the “cute” imaging parameter, and a predetermined low value of transparency is associated with the “clean” imaging parameter.

  In this case, the superimposed partial image processing unit 322 increases the transparency of the composition image to be combined (superposed) with the editing target image that is the user's image captured with the “cute” imaging parameter. Apply. Alternatively, the superimposing partial image processing unit 322 reduces the transparency of the compositing image that is synthesized (superimposed) on the editing target image that is the user's image captured with the “clean” imaging parameter. Apply.

  Note that, as described above, the superimposed partial image processing unit 322 may execute image processing for changing the values of pixels constituting the composition image, or the composition image is superimposed on the editing target image. You may make it perform the image process which changes the value of the pixel in the predetermined range around a position.

  For example, when a compositing image with high transparency is superimposed on an editing target image for which a “clean” shooting parameter is set, it is within a predetermined range around the position where the compositing image is superimposed on the editing target image. Image processing may be performed so that an image composed of pixels corresponds to an image shot with “cute system” shooting parameters. Examples of such image processing include edge processing (for example, sharpness processing for strengthening edges and blurring processing for weakening edges), color tone changing processing, and the like. In the following, blur processing will be described in detail as an example of edge processing.

  Alternatively, image processing for changing the values of the pixels constituting the image for synthesis and the values of pixels within a predetermined range around the position where the image for synthesis is superimposed on the editing target image is executed. Also good.

  For example, when a compositing image with high transparency is superimposed on an editing target image for which a “clean” shooting parameter is set, it is within a predetermined range around the position where the compositing image is superimposed on the editing target image. Image processing that lowers the transparency of the image for synthesis may be performed in addition to image processing that weakens the edge of the image composed of pixels.

  For example, the organ image recognition unit 323 recognizes the face image and the face direction (direction) in the image to be edited. Then, the organ image recognition unit 323 recognizes a predetermined organ (for example, eyes, nose, mouth, cheek, jaw) in the face image.

  The organ image recognition unit 323 is configured to recognize a predetermined region with the recognized organ as a reference. Here, the recognized predetermined area is, for example, a highlighted area to be highlighted or a shading area to be shaded, as will be described later.

  Note that the composition image superimposed by the composition image superimposing unit 321 includes, for example, images such as eyelines and false eyelashes drawn around the eyes of the user's face image. When the images are superimposed, the composition image superimposing unit 321 generates a composition image corresponding to the size and position of the organ recognized by the organ image recognition unit 323 so that the composition image is superimposed. Has been made.

  Furthermore, the composition image superimposed by the composition image superimposing unit 321 includes, for example, a makeup image (described later) that forms a highlight area from the forehead to the nose in the user's face image, and from the cheek to the chin. It is assumed that a makeup image constituting the shading area is also included, and when such a composition image is superimposed, the composition image superimposing unit 321 includes a highlight region or a shading region recognized by the organ image recognition unit 323. By generating a makeup image corresponding to the size and position, the composition image is superimposed.

  The editing control unit 324 controls other processing related to editing work.

  Next, processing of the photo sticker creating apparatus 1 that provides a photo sticker creating game will be described with reference to the flowchart of FIG.

  In step S1, the imaging processing unit 301 of the photo sticker creating apparatus 1 determines whether or not a predetermined amount of coins has been inserted based on a signal supplied from the coin processing unit 221 until it is determined that the coins have been inserted. stand by.

  If it is determined in step S1 that a coin has been inserted, in step S2, the imaging processing unit 301 controls the imaging unit 208 to display a moving image of the subject captured by the camera 91 on the touch panel monitor 92 in a live view. Then, a photographing process for photographing a user in the photographing space A1 as a subject is performed. In the photographing process, an up-photographing for photographing the user's face or upper body is performed, but a full-body photographing for photographing the whole body of the user may be performed.

  In step S3, the imaging processing unit 301 guides the user in the imaging space A1 to move to the editing space A2-1 or the editing space A2-2. The guidance for movement to the editing space A2-1 or the editing space A2-2 is performed by displaying a screen on the touch panel monitor 92 of the photographing unit 208 or by outputting sound from the speaker 224.

  In step S4, the editing processing unit 302 controls the editing unit 209 corresponding to the editing space of the editing space A2-1 and the editing space A2-2 that is the destination of the user who has finished the shooting process, Edit processing. Specifically, the editing processing unit 302 causes the user to select a synthesis image to be synthesized with the captured image selected as the editing target image, synthesizes the selected synthesis image with the captured image, and obtains the obtained synthesis. The image is edited according to the editing operation by the user.

  In step S5, the editing processing unit 302 guides the user who has finished the editing process in the editing space A2-1 or the editing space A2-2 to move to the post-service space A3. The guidance of the movement to the post-service space A3 is performed by displaying a screen on the tablet built-in monitor 131 or by outputting sound from the speaker 231.

  In step S <b> 6, the print processing unit 303 performs (starts) a print process in which the image selected by the user is output to the printer 241 and printed on a sticker sheet.

  Further, when the post-service processing start button displayed on the tablet built-in monitor 161 is selected, in step S7, the post-service processing unit 304 performs post-service processing for a user who is waiting for completion of printing. Specifically, the post-service processing unit 304 performs a mobile transmission game process for transmitting a captured image or an edited image to the mobile terminal as the post-service processing, and directly inputs the e-mail address of the mobile terminal. Display on the tablet built-in monitor 161 a selection screen for a transmission method that allows a user to select whether to transmit an image to a portable terminal by transmitting to a portable terminal or by communicating with a non-contact type IC. The image is transmitted according to the operation by the user.

  When the printing is completed, in step S8, the post-service processing unit 304 displays that the printing has been completed on the tablet built-in monitor 161, and the printer 241 discharges the sticker paper on which the image is printed to the sticker paper discharge port 163. The process is terminated.

  In this way, the photo sticker creation game process is executed.

  In the editing process executed in step S4 described above, an editing screen is displayed on the tablet built-in monitor 131, and the user performs an operation input using the touch pen 132A or the touch pen 132B based on the GUI of the editing screen. Editing processing is performed on the image to be edited.

  At this time, for example, an editing screen as shown in FIG. 12 is displayed on the tablet built-in monitor 131. Actually, the editing screen for the “right person” and the editing for the “left person” so that two users who are lined up on the left and right in the editing section 209A or the editing section 209B can perform editing work simultaneously. A screen is displayed. In FIG. 12, only the editing screen for “left person” is displayed to simplify the description.

  As shown in FIG. 12, an editing target image 351 is displayed on the editing screen. The editing target images are a predetermined number of images selected from a plurality of images captured in the process of step S2 in FIG. 11, and one of the predetermined number of images is displayed as the editing target image 351 in FIG. Has been.

  The GUI shown at the bottom of the editing screen in FIG. 12 is referred to as an editing palette. In the editing palette 352, a large number of icons corresponding to stamp images used in editing work are arranged. When the user taps a desired icon in the editing palette 352 with the touch pen 132A or the touch pen 132B, a stamp image corresponding to the icon can be superimposed on the editing target image 351 as a composition image.

  In the example of FIG. 12, a heart-shaped stamp image 361-1 and a stamp image 361-2 are superimposed on the editing target image 351. At this time, the composition image superimposing unit 321 controls the process of superimposing the stamp image 361-1 and the stamp image 361-2 on the editing target image 351 based on the operation of the touch pen 132A or the touch pen 132B.

  Note that the editing target image 351 shown in FIG. 12 is, for example, an image obtained by setting a “cute system” shooting parameter at the time of shooting, and is an image having a soft color as a whole.

  For example, an image shot with a “clean” shooting parameter set is an image with a weak edge, and an image shot with a “cute” shooting parameter set is an image with a strong edge. Shall be.

  FIG. 12A is a diagram showing a state in which the stamp image 361-1 and the stamp image 361-2 are superimposed by the compositing image superimposing unit 321 and the image processing by the superimposed partial image processing unit 322 is not executed.

  On the other hand, FIG. 12B is a diagram illustrating a state after the stamp image 361-1 and the stamp image 361-2 are superimposed by the compositing image superimposing unit 321 and the image processing by the superimposed partial image processing unit 322 is performed. .

  In the case of FIG. 12A, the heart-shaped stamp image 361-1 and the stamp image 361-2 are displayed in bright red, for example. In this case, the stamp image 361-1 and the stamp image 361-2 are clearly displayed, but are uncomfortable among the editing target images 351.

  On the other hand, in the case of FIG. 12B, the heart-shaped stamp image 361-1 and the stamp image 361-2 are displayed in, for example, translucent red. That is, the superimposed partial image processing unit 322 performs image processing for increasing the transparency of the stamp image 361-1 and the stamp image 361-2, so that the stamp image 361-1 and the stamp image 361-2 are translucent. Displayed in red.

  As shown in FIG. 12B, by increasing the transparency of the compositing image (in this case, the stamp image 361-1 and the stamp image 361-2) superimposed on the editing target image 351, the compositing image is displayed on the back side thereof. The editing target image 351 is an image having characteristics similar to changes in brightness and texture. That is, compared with the case of FIG. 12A, the clear impression of the stamp image 361-1 and the stamp image 361-2 is faded, and the image has a soft impression.

  As a result, the stamp image 361-1 and the stamp image 361-2 in FIG. 12B coincide with the “cute system” images.

  For example, the blur radius is set to 2 to 10 pixels in the feature amount relating to the strength of the edge of the editing target image 351. The shooting parameter of “cute system” is set to a large radius and is 10 pixels in order to display it softly. On the other hand, the shooting parameter of “clean system” is set to have a small radius and 2 pixels because it is desired to display more clearly than “cute system”. This numerical value is arbitrarily set depending on the photographing parameter.

  Further, in the feature amount relating to the level of transparency of the stamp image 361-1 and the stamp image 361-2 in FIG. 12A, the transparency is set to 0.1 to 0.5. Since the stamp image of “cute” is displayed softly, the transparency is set high and is 0.5. On the other hand, the “clean” stamp has a lower transparency and is set to 0.1 because it is more clearly displayed than the “cute” stamp image. This numerical value is arbitrarily set according to the parameters of the compositing image, like the edge strength.

  Note that the value representing the transparency is a setting value relating to the α channel for changing the transparency.

  In the editing target image 351, when the blur radius is 5 pixels, the width of the blur radius is 8 (2 to 10) pixels, so that the edit target is obtained by division ((8-5) / 8). The feature amount for the blur radius of the image 351 is set to 37.5%. Based on the feature amount of 37.5%, the transparency values of the stamp image 361-1 and the stamp image 361-2 are calculated.

  The width of the stamp image 361-1 and the stamp image 361-2 with respect to the level of transparency is 0.4 (= 0.5-0.1). Accordingly, the numerical value of 0.25 is calculated by multiplying the feature amount 37.5% of the image to be edited 351 (0.4 × 37.5 + 0.1). Therefore, in order to perform the process such that the stamp image 361-1 and the stamp image 361-2 are adapted to the editing target image 351, an image process such as changing the transparency of the stamp image to 0.25 is performed. Executed by the processing unit 322

  That is, the feature amount related to the strength of the edge, which is one of the feature amounts of the editing target image 351 (or the captured image), and the feature amount related to the transparency, which is one of the feature amounts of the image for synthesis, are associated with each other. Then, image processing is performed so that the values of the respective feature amounts match. Note that in this case, the matching is made in advance so as to match the feature amount 37.5%.

  Alternatively, as described above, image processing may be performed so that the feature amount approaches even if the feature amount does not match. For example, image processing may be performed so as to approach the feature amount of 37.5% regarding the level of transparency of the stamp image 361-1 and the stamp image 361-2. In this case, for example, the feature amount allows a width of ± 10%, and may be between 27.5% and 47.5%.

  Here, an example in which the feature amount of the editing target image associated with each other and the feature amount of the compositing image are different from each other has been described. The feature amount of the image may be the same. For example, the edge enhancement degree of the editing target image 351 may be associated with the edge enhancement degree of the composition image.

  Further, here, a case has been described in which one feature amount of the image to be edited is associated with one feature amount of the image for synthesis, but one feature amount (for example, edge enhancement level) of the image to be edited is described. And a plurality of feature amounts (for example, edge enhancement and transparency) of the image for synthesis may be associated with each other. In this case, for example, image processing is performed such that at least one of the plurality of feature amounts of the composition image approaches the feature amount of the editing target image.

  Alternatively, a plurality of feature amounts (for example, edge enhancement and transparency) of the image to be edited are associated with a plurality of feature amounts (for example, edge enhancement and transparency) of the image for synthesis. May be. In this case, the superimposed partial image processing unit 322 may execute image processing in which both feature amounts are vector amounts and the inner product of the vectors is reduced.

  Further, here, the feature amount of the image to be edited (or the photographed image) and the feature amount of the image for synthesis have been described as being associated with each other. However, the photographing parameter (for example, “cute system” of the photographed image) (Shooting parameters set at the time of shooting) may be associated with the feature amount of the composition image.

  Alternatively, for example, information that identifies different types, such as “cute” and “beautiful”, is stored in association with the photographed image, and information related to the photographing is stored. May be used as the feature amount of the image to be edited.

  As described above, by performing the image processing by the superimposed partial image processing unit 322, the stamp image superimposed on the image to be edited becomes less uncomfortable. In addition, since the image processing by the superimposed partial image processing unit 322 is performed as described above, for example, it is necessary for editing work as compared with the case of selecting an image that fits the edited image from a plurality of stamp images. Time can be shortened.

  In the photo sticker creation game by the photo sticker creation device 1, when the photographing process is being executed, or when the editing process is being executed in another editing space, the time limit for editing work is set. Yes. For this reason, it is possible to provide a photo sticker with a higher degree of satisfaction for the user by reducing the time required for the editing work.

  In this example, image processing for increasing the transparency of the composition image is performed. For example, in the editing target image 351, a predetermined range in the vicinity of the stamp image 361-1 and the stamp image 361-2 superimposed. The enhancement degree of the edge of the image formed by the pixels may be increased.

  Alternatively, the emphasis degree of an image composed of pixels within a predetermined range around the position where the synthesis image is superimposed on the editing target image 351 is increased, and the stamp image 361-1 and the stamp image 361- Image processing for increasing the transparency of 2 may be performed.

  That is, the superimposed partial image processing unit 322 may execute image processing for changing the values of the pixels constituting the composition image, or may be a predetermined area around the position where the composition image is superimposed on the editing target image. Image processing for changing the value of a pixel within the range of the image may be executed, the value of the pixel constituting the composition image, and a predetermined area around the position where the composition image is superimposed on the editing target image Image processing for changing the value of each pixel within the range may be executed.

  Note that the image processing related to the edge enhancement change and transparency change as described above may be executed, for example, every time a stamp image is superimposed, or a plurality of stamp images are superimposed. After that, they may be executed collectively.

  For example, when the stamp image 361-1 is pasted on the editing target image 351, the value of the pixel constituting the stamp image 361-1 and / or the stamp image 361-1 is pasted on the editing target image 351. When image processing for changing the value of a pixel within a predetermined range around the position is performed and the stamp image 361-2 is pasted on the editing target image 351, the value of the pixel constituting the stamp image 361-2, Alternatively, image processing for changing the value of a pixel within a predetermined range around the position where the stamp image 361-2 is pasted in the editing target image 351 may be executed.

  Alternatively, for example, when a predetermined operation is performed after the stamp image 361-1 and the stamp image 361-2 are pasted on the editing target image 351, the stamp image 361-1 and the stamp image 361-2 are configured. Image processing for changing the pixel value and / or the pixel value within a predetermined range around the position where the stamp image 361-1 and the stamp image 361-2 are pasted in the editing target image 351 is executed. You may do it.

  Furthermore, for example, when a stamp image is pasted, a stamp image that has already been subjected to the image processing relating to the change in edge enhancement and the change in transparency as described above may be pasted. For example, when a stamp image is pasted on the editing target image, a stamp image having a color different from that of the stamp image in the editing palette 352 may be pasted. That is, for example, an editing screen as shown in FIG. 12B may be displayed at the time of pasting.

  In this example, the case where the superimposed partial image processing unit 322 performs image processing for changing the transparency and the strength of the edge has been described. However, for example, the composition image and / or the image to be edited is blurred. Processing may be performed.

  Further, examples of image processing performed by the superimposed partial image processing unit 322 include, for example, changing a gamma value related to gamma correction, changing a tone curve characteristic, changing an average luminance value, and changing a contrast value. To do. In addition, the superimposed partial image processing unit 322 may perform processing for changing color shading, smoothing processing, Gaussian filter processing, bilateral filter processing, and the like.

  Alternatively, the color of the compositing image may be changed by the superimposed partial image processing unit 322 according to the shooting parameters at the time of shooting the editing target image. For example, when the original red stamp image 361-1 and the stamp image 361-2 are superimposed on the “cute” editing target image 351, the stamp image 361-1 and the stamp image 361-2 are changed to orange. You may do it.

  Alternatively, for example, the stamp image 361-1 is subjected to image processing in which the edge enhancement is reduced and the transparency is increased, and the stamp image 361-2 is changed to orange. Image processing may be performed.

  In the example of FIG. 12, image processing by the superimposed partial image processing unit 322 is performed on the entire composition image (stamp image 361-1 and stamp image 361-2), but a part of the composition image (for example, The image processing may be performed only on the outer edge portion.

  Here, an example in which the heart-shaped stamp image selected from the editing palette 352 is directly pasted and superimposed on the editing target image 351 has been described. However, when a predetermined operation is performed, for example, the heart-shaped stamp image is superimposed. The stamp image may be rotated clockwise.

  Alternatively, the stamp image may be reversed by performing a predetermined operation. For example, the direction of the moon may be reversed like a stamp image in the shape of the moon shown in FIG.

  Alternatively, the stamp image may be rotated in depth by performing a predetermined operation. For example, as shown in FIG. 14, when a predetermined operation is performed when the stamp image 371 is in the starting state, the stamp image 371 is displayed on an arrow 381 with a straight line on the editing screen (plane) as an axis. As shown, the left side of the image rotates in the direction (counterclockwise) toward the back side. Alternatively, when a predetermined operation is performed while the stamp image 371 is in the starting state, the stamp image 371 is displayed on the editing screen (plane) with the straight line on the editing screen (plane) as an axis, as indicated by an arrow 382. It rotates in the direction that the right side goes to the back side (clockwise).

  Furthermore, when the touch pen 132A or the touch pen 132B is moved, the stamp image is continuously pasted along the locus of the touch pen, and the stamp image is moved to the vicinity of the predetermined image. A function such as "Pitto Stamp" that is automatically pasted at the same position may be employed.

  Also in such a case, the superimposed partial image processing unit 322 again uses the pixel values constituting the stamp image and / or the pixels within a predetermined range around the position where the stamp image is pasted in the editing target image. Image processing for changing the value is executed.

  In the example of FIG. 12, an example in which a heart-shaped stamp image is used as a composition image has been described. For example, a stamp image such as a hat, glasses, a ribbon, a color contact lens (color contact lens), or false eyelashes is used as a composition image. You may make it do.

  In the example of FIG. 12, the example in which the heart-shaped stamp image is used as the synthesis image has been described. However, the frame image may be used as the synthesis image. The frame image is configured as, for example, a pattern or a figure arranged around the person image. Even when such a frame image is superimposed on the image to be edited, image processing by the superimposed partial image processing unit 322 is also performed.

  Further, the pen image may be used as a composition image. The pen image is, for example, a linear figure drawn along the trajectory of the touch pen 132A or the touch pen 132B. However, the pen image is not limited to a simple line. For example, the pen image has a jagged edge. However, a cloud-shaped border may be used. Even when such a pen image is superimposed on the image to be edited, image processing by the superimposed partial image processing unit 322 is also performed.

  In the example of FIG. 12, an example in which a heart-shaped stamp image is used as a composition image has been described. However, for example, effects such as eyeline, highlight, shading, and the like can be obtained as if makeup was applied to the user's image. The makeup image may be used as a composition image.

  FIG. 15 is a diagram showing another example of the editing screen displayed on the tablet built-in monitor 131 in the editing process executed in step S4 described above. On the editing screen shown in FIG. 15, an editing target image 411-1 and an editing target image 411-2 are displayed, and an editing palette 412-1 and an editing palette 412-2 are displayed.

  In the case of FIG. 15, the “left person” edits the editing target image 411-1 using the editing palette 412-1, and the “right person” uses the editing palette 412-2 to edit the editing target image 411-. Edit 2.

  In the editing palette 412-1 and the editing palette 412-2, a highlight shading palette 421 and an eyeline palette 422 are displayed, respectively. Note that the highlight shading palette 421 and the eyeline palette are selected when the “recommended” tab is selected and the “highlight / shading” tab is selected in the edit palette 412-1 and the edit palette 412-2. 422 is displayed.

  The highlight shading palette 421 is a palette for highlighting or shading a user's face image or drawing an eyeline. Here, the highlight is one of makeup methods, and for example, a bright color foundation is applied from the center of the forehead to the nose. Thereby, it is possible to improve the stereoscopic effect of the face. In addition, shading is supposed to have a dark foundation from under the ear to the chin. This makes it possible to make the face look smaller.

  The highlight shading palette 421 can be used to perform image processing such that highlighting and / or shading is applied to the user's face in the image to be edited. That is, the highlight shading palette 421 is related to an editing operation that brightens or darkens a part of the user's face image.

  For example, when the left person taps the button 431-2 of the highlight shading palette 421 with the touch pen 132A, the portion indicated by the dotted ellipse in the editing target image 411-1 is highlighted. At this time, for example, a bright cosmetic image is superimposed on a portion indicated by a dotted ellipse in the editing target image 411-1. When the button 431-1 of the highlight shading palette 421 is tapped, the makeup image is deleted, and the highlight of the user's face image in the editing target image 411-1 is deleted. Here, the cosmetic image is an image in which the organ recognized by the organ image recognition unit 323 or an area in the face is extracted and the color or the like is changed.

  Note that an image of a model with highlight makeup is displayed in the background of the buttons 431-1 and 431-2. Or you may make it display the image of the user who did highlight makeup on the background of button 431-1 and button 431-2. In this case, the right person and the left person are individually discriminated, and the image of the left person is displayed on the background of the buttons 431-1 and 431-2 of the editing palette 412-1. An image of the right person may be displayed in the background of the button 431-1 and the button 431-2 of 412-2.

  Also, for example, when the left person taps the button 432-2 of the highlight shading palette 421 with the touch pen 132A, the portion indicated by the solid oval in the editing target image 411-1 is shaded. At this time, for example, a dark-colored cosmetic image is superimposed on a portion indicated by a solid oval in the editing target image 411-1. Details of the area to be highlighted and shaded will be described later. When the button 432-1 of the highlight shading palette 421 is tapped, the makeup image is deleted and the shading of the user's face image in the editing target image 411-1 is deleted.

  Note that an image of a model with shading makeup is displayed in the background of the buttons 432-1 and 432-2. Or you may make it display the image of the user who made the shading makeup on the background of the button 432-1 and the button 432-2. In this case, the right person and the left person are individually discriminated, and the image of the left person is displayed on the background of the buttons 431-1 and 431-2 of the editing palette 412-1. An image of the right person may be displayed in the background of the button 431-1 and the button 431-2 of 412-2.

  FIG. 16 is a diagram for explaining the highlight in more detail. In the figure, a T-shaped frame and a portion indicated by an ellipse are areas to be highlighted, and a cosmetic image corresponding to the area is generated.

  When generating a highlight makeup image, for example, the organ image recognition unit 323 first recognizes the face image of the user in the image to be edited. Then, the eye area in the face image is recognized, and a substantially rectangular area from the center of the black eye part of the two eyes downward (when the face is regarded as two-dimensional and the height direction is expressed in the vertical direction) The nose muscle part is recognized by recognizing. Further, the area under the hair above the eyes is recognized as the forehead area. Further, if necessary, the area under the left and right eyes is recognized as the cheek area.

  Further, the nose muscle portion may be recognized in more detail. For example, after the face image of the user in the editing target image is recognized, the nose portion is recognized. Then, as shown in FIG. 17A, a predetermined region 452 along the center line of the user's nose 451 may be recognized as a region to be highlighted. By doing so, the nose can be shown more three-dimensionally (the nose looks higher).

  Furthermore, a predetermined area 453 including the entire user's nose 451 may be recognized as an area to be highlighted.

  A cosmetic image to be superimposed on the area thus detected is generated. The color of the makeup image is, for example, a bright color (for example, a light skin color or white).

  In the above-described example, it has been described that a makeup image to be superimposed on the detected area is generated. However, a predetermined area in the editing target image is detected without generating a makeup image, and direct image processing is performed. It is also possible to apply.

  FIG. 18 is a diagram illustrating shading in more detail. In the figure, the hatched portion is an area to be shaded, and a cosmetic image corresponding to the area is generated.

  When generating a makeup image for shading, for example, a user's face image in the image to be edited is first recognized. Then, as shown in FIG. 18A, the contour line of the face image is recognized, and a predetermined region upward from the contour line below the face is recognized as a chin region. A cosmetic image for making the recognized area darker such as gray is generated.

  Alternatively, the region is moved downward from the jaw recognized in FIG. 18A, and as shown in FIG. 18B, a predetermined region downward from the lower outline of the face is recognized as a region to be shaded. It may be. In this region, the portion close to the jaw in the neck is not the region of the user's face image, but by making the image in this region darker, the user's face appears to be small.

  Alternatively, as shown in FIG. 18C, a predetermined area in the downward direction from the lower outline of the face and including the neck may be recognized as an area to be shaded. In the case of FIG. 18C, unlike the case of FIG. 18B, shading is applied to a predetermined region in the upward direction from the lower outline of the face and a region including almost the entire neck.

  A cosmetic image to be superimposed on the area thus detected is generated. The color of the makeup image is, for example, a dark color (for example, dark skin color or gray).

  Note that the brightness of the color (for example, white density) and the darkness of the color (for example, gray density) in the makeup image may be changed by the user's selection.

  Returning to the description of FIG.

  As described above, the highlight shading palette 421 is a palette for highlighting and / or shading the user's face image and drawing an eyeline. Here, the eye line is one of makeup methods, and is drawn around the eye, for example, near the eyelashes. As a result, it is possible to make the eyes look larger or to show a deeply carved feature.

  For example, the right person can select the color of the eyeline by tapping the button 433 of the highlight shading palette 421 with the touch pen 132B. In this example, the color of the eyeline can be selected from black, deep black, and brown.

  Further, for example, the right person can select the shape of the eyeline by tapping the icons 434-1 to 434-3 of the highlight shading palette 421 with the touch pen 132B. Further, when any of the icons 434-1 to 434-3 is tapped, an eyeline is attached around the eyes in the face image of the user of the editing target image 411-2. In the example of FIG. 15, by selecting the icon 434-3, an eyeline is attached around the eyes in the face image of the user of the editing target image 411-2.

  The eyeline is drawn by changing the color of the makeup image around the eyes in the face image of the user of the editing target image 411-2.

  When generating a makeup image for eyeline, the organ image recognition unit 323 first recognizes a user's face image in the image to be edited, for example. Then, the eyes in the face image are recognized, and a predetermined area along the outline of the eyes is recognized as an area for drawing an eyeline. A cosmetic image to be superimposed on the recognized area is generated. At this time, the color of the cosmetic image is selected by the button 433, and the shape of the cosmetic image is a shape corresponding to the one selected from the icons 434-1 to 434-3. .

  The icon 434-1 is selected when drawing a general eyeline. The icon 434-2 is selected when an eyeline with a slightly raised eyeline is drawn. The icon 434-3 is selected when drawing an eyeline with sharply raised eyes.

  The icon 434-2 and the icon 434-3 are referred to as a cat line. By drawing such an eye line, for example, a so-called cat eye makeup as shown in FIG. 19 can be applied. In the figure, an image with sharply raised eyes (portion surrounded by a circle) is shown.

  Returning to FIG. 15, for example, when the button 435-1 of the highlight shading palette 421 is tapped, the cosmetic image rotates clockwise or counterclockwise.

  For example, when the button 435-2 of the highlight shading palette 421 is tapped, the size of the makeup image is changed. When the button 435-2 is tapped, for example, the cosmetic image is extended in the horizontal direction. Of course, after the cosmetic image is stretched, it can be restored.

  A button for erasing the eyeline may be provided as necessary, and when the button is pressed, the eyeline cosmetic image may be erased.

  As described above, highlight, shading, and eyeline makeup are performed by superimposing cosmetic images. The makeup image is superimposed on the image to be edited by the composition image superimposing unit 321 as one of the composition images. That is, a makeup image corresponding to the region recognized by the organ image recognition unit 323 is generated by the synthesis image superimposing unit 321 and superimposed on the editing target image.

  Even when the makeup image is superimposed on the editing target image as a composition image, image processing by the superimposed partial image processing unit 322 is executed.

  For example, when a highlight makeup image is superimposed on an editing target image that is a user's image captured with a “clean” shooting parameter set, the superimposed partial image processing unit 322 displays the makeup image. Image processing for increasing the luminance of the pixel is executed. In addition, for example, when a shading makeup image is superimposed on an editing target image that is a user's image shot with a “clean” shooting parameter set, the superimposed partial image processing unit 322 displays the makeup image. Image processing for lowering the luminance of the pixels is executed.

  By doing so, highlights and shading are clearly displayed, and the image is well suited to a user's image shot with a “clean” shooting parameter set.

  Further, for example, image processing may be performed in which the color of the eyeline is changed according to the skin color of the user's face in the editing target image. For example, when a makeup image of an eyeline is superimposed on a face image of a user who is colored black, the superimposed partial image processing unit 322 executes image processing that makes the color of the eyeline darker. Further, for example, when the eyeline makeup image is superimposed on the face image of the fair user, the superimposed partial image processing unit 322 executes image processing that makes the eyeline color lighter. .

  By doing in this way, it becomes possible to apply the makeup which adjusts well to the user's skin color.

  Similar to the case described above with reference to FIG. 12, when a makeup image is synthesized, the superimposed partial image processing unit 322 executes image processing for changing the values of the pixels constituting the synthesis image. Alternatively, image processing for changing the value of a pixel within a predetermined range around the position where the composition image is superimposed on the image to be edited may be executed, or the composition image may be configured. It is also possible to execute image processing for changing the value of the pixel to be changed and the value of the pixel within a predetermined range around the position where the synthesis image is superimposed on the editing target image.

  Further, the image processing by the superimposed partial image processing unit 322 described above may be different for each editor (for example, “right person” and “left person”). For example, when “left person” edits, image processing is performed such that the transparency of the composite image is changed according to the shooting parameters, and when “right person” edits, the average brightness of the composite image Image processing may be performed such that the value is changed according to the shooting parameter.

  Further, in the above-described example, it has been described that the image processing by the superimposed partial image processing unit 322 is automatically executed when the composition image is superimposed on the editing target image. When the image is superimposed on the target image, the image processing by the superimposed partial image processing unit 322 may be executed when there is a command based on a user operation.

  For example, the image processing by the superimposed partial image processing unit 322 may be executed when the user pastes the stamp image at a desired position of the image to be edited and then taps the stamp image.

  Alternatively, the image processing by the superimposed partial image processing unit 322 may be selected and executed from a plurality of stages. For example, after the user pastes the stamp image at a desired position of the image to be edited, each time the user taps the stamp image, the image processing is performed more strongly (for example, the transparency is changed more greatly). You may do it. Alternatively, for example, after the user pastes the stamp image at a desired position in the image to be edited, the brightness of the pixels of the stamp image becomes higher according to the time when the pen tip of the touch pen is pressed against the stamp image. You may make it fall or be lowered.

  In the above description, the example in which the compositing image is superimposed on the editing target image has been described. Of course, the compositing image may be further superimposed on the compositing image superimposed on the editing target image. it can. For example, a heart-shaped stamp image may be pasted on a shading makeup image. Also in this case, as described above, the image processing by the superimposed partial image processing unit 322 is performed.

  Next, an example of an image composition process executed as part of the editing process in step S4 of FIG. 11 will be described with reference to the flowchart of FIG. This process is executed, for example, when an edit screen as shown in FIG. 12 or 15 is displayed on the edit screen.

  In step S21, it is determined whether or not makeup editing is performed. For example, when the editing palette 352 of FIG. 12 is displayed on the editing screen, it is determined that the makeup editing is not performed.

  If it is determined in step S21 that the editing is not makeup, the process proceeds to step S22. In step S <b> 22, the composition image superimposing unit 321 accepts selection of a composition image. At this time, for example, selection of a predetermined stamp image from the stamp images displayed on the editing palette 352 is accepted.

  On the other hand, for example, when the editing palette 412-1 or the editing palette 412-2 of FIG. 15 is displayed on the editing screen, the process proceeds to step S23.

  In step S23, the organ image recognition unit 323 recognizes the face image of the user in the editing target image.

  In step S24, the organ image recognition unit 323 recognizes a predetermined organ in the face image of the user recognized in the process of step S23. At this time, for example, areas such as eyes, nose, and chin in the user's face image are recognized as necessary.

  In step S25, the organ image recognition unit 323 recognizes a predetermined area based on the position of the organ in the face image recognized in the process of step S24. At this time, for example, a highlight area, a shading area, an eyeline drawing area, and the like are recognized.

  In step S26, the composition image superimposing unit 321 generates a makeup image corresponding to the predetermined area recognized in step S25. At this time, for example, a makeup image for highlight, a makeup image for shading, a makeup image for eyeline, and the like are generated.

  In step S27, the compositing image superimposing unit 321 uses the compositing image (for example, a stamp image or the like) selected in the processing in step S22 or the cosmetic image generated in the processing in step S26 for compositing. The image is superimposed on the image to be edited.

  In step S28, the superimposed partial image processing unit 322 performs image processing on the image to be edited and / or the synthesis image that has undergone the processing in step S27. At this time, for example, image processing for changing transparency and edge enhancement, image processing for changing luminance and color, and the like are performed.

  In this way, the image composition process is executed.

  By the way, the above-described series of processes can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 8, the recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the apparatus main body, and is a magnetic disk (flexible disk) on which the program is recorded. Disk), optical disk (including CD-ROM and DVD), magneto-optical disk (including MD), or removable media 205 such as a semiconductor memory, as well as being pre-installed in the main unit The ROM 206 that stores the program and the hard disk included in the storage unit 202 are distributed to the administrator.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  In the above, the printing medium is not limited to sticker paper or photographic paper. For example, printing on a predetermined size of paper or film, poster paper, a card such as a telephone card, or a cloth such as a T-shirt. You may make it do.

  The embodiments of the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus 11 Shooting unit 12 Editing part 13 Subsequent customer service part 201 Control part 208 Photographing part 209 Editing part 210 Subsequent customer service part 301 Photographing process part 302 Editing process part 303 Print processing part 304 Post-service customer process part 321 Composite image superimposition Unit 322 superimposed partial image processing unit 323 organ image recognition unit 324 editing control unit

An image processing apparatus according to an aspect of the present invention performs an editing input operation for inputting editing information on a captured image that is an image of the user obtained by a shooting operation with a user as a subject. In the photo sticker creating apparatus that provides the user with the edited user image, the composition image is superimposed on the captured image or superimposed on the captured image in the editing input operation. a synthesis image superimposing means for superimposing the further synthesis image in the synthesized image, and an image processing means for performing image processing on at least one of the photographed image or the composite image, the image processing means, wherein feature of the synthetic image is, as closer to the pre-correlated obtained feature amount to the imaging parameters for changing the reflecting of the subject in the captured image, or the photographed parameters Of but set it captured the captured image, feature quantity determined in accordance with the imaging parameters, so as to approach by the feature of the synthetic image is a photo sticker creation apparatus for performing the image processing.

One aspect of the present invention allows an editing input operation for inputting editing information to a captured image that is an image of the user obtained by a shooting operation with a user as a subject, and further provides an edited image obtained. In the photo sticker creating method of the photo sticker creating device for providing the user image of the user, the composition image superimposing means superimposes the composition image on the photographed image in the editing input operation, or A step of superimposing a composite image on the composite image superimposed on the photographed image, and a step of performing image processing on at least one of the photographed image or the composite image . wherein the image processing means, the feature amount of the synthetic image is closer to the pre-correlated obtained feature amount to the imaging parameters for changing the reflecting of the subject in the captured image , Or in the imaging parameter is set to captured the captured image, feature quantity determined in accordance with the imaging parameters, so as to approach by the feature of the synthetic image, created photo sticker performing the image processing Is the method.

One aspect of the present invention allows an editing input operation for inputting editing information to a captured image that is an image of the user obtained by a shooting operation with a user as a subject, and further provides an edited image obtained. A program for causing a computer to execute processing in the photo sticker creating apparatus that provides the user's image to the user, wherein the composition image superimposing means applies the composition image to the photographed image in the editing input operation. A step of superimposing or superimposing a composition image on a composition image superimposed on the photographed image, and an image processing means performs image processing on at least one of the photographed image or the composition image the process comprising the steps is executed by a computer, said image processing means, the feature amount of the combined images is to change the reflecting of the subject in the captured image So as to approach the previously correlated obtained feature amount to the imaging parameters, or, the imaging parameter is set to captured the captured image, feature quantity determined in accordance with the imaging parameters, the feature quantity of the images to be combined It is a program that performs the image processing so as to be closer.

In one aspect of the present invention, in the editing input operation, a composite image is superimposed on the captured image, or a composite image is further superimposed on the composite image superimposed on the captured image, and the photographing is performed. Image processing is performed on at least one of the image and the image for synthesis , and the image processing unit associates the feature amount of the image for synthesis in advance with a shooting parameter for changing the image of the subject in the shot image. so as to approach the obtained feature amount, or, the imaging parameter is set to captured the captured image, as characteristic amount determined in accordance with the imaging parameters, closer to the feature value of the images to be combined, the Image processing is performed.

Claims (15)

An editing input operation for inputting editing information is performed on a captured image that is an image of the user obtained by a photographing operation with the user as a subject, and the obtained edited image of the user is further displayed. In the photo sticker creation device provided to the user,
In the editing input work, a composition image superimposing unit that superimposes a composition image on the photographed image or further superimposes a composition image on the composition image superimposed on the photographed image;
Image processing means for performing image processing on at least one of the captured image or the composition image,
The feature amount of the captured image and the feature amount of the composition image are associated in advance,
The image processing means includes
A photo sticker that performs the image processing so that the feature amount of the image for synthesis approaches the feature amount associated in advance or the feature amount of the photographed image approaches the feature amount associated in advance. Creation device. The photo sticker creating apparatus according to claim 1, wherein the feature amount of the photographed image is a feature amount determined according to a photographing parameter set at the time of photographing. The image processing means includes
At least one of an image configured as a whole or a part of the image for synthesis and an image configured by pixels within a predetermined range around a position where the image for synthesis is superimposed on the captured image. The photo sticker creating apparatus according to claim 1, wherein the image processing is performed. The image processing means includes
The photo sticker creating apparatus according to claim 1, wherein blurring processing is performed. The image processing means includes
The photographic sticker creating apparatus according to claim 1, wherein a process for increasing the transparency of the composite image is performed. The image processing means includes
The photo sticker creating apparatus according to claim 1, wherein image processing is performed to change a gamma value related to gamma correction of the shooting image or the composition image. The image processing means includes
The photo sticker creating apparatus according to claim 1, wherein image processing is performed to change a tone curve characteristic of the image for photographing or the image for synthesis. The image processing means includes
The photo sticker creating apparatus according to claim 1, wherein image processing is performed to change an average luminance value of the image for photographing or the image for synthesis. The image processing means includes
The photo sticker creating apparatus according to claim 1, wherein image processing for changing a contrast value of the image for photographing or the image for synthesis is performed. The image processing unit
The photo sticker creating apparatus according to claim 1, wherein image processing is performed to change an enhancement degree of an edge of the image for photographing or the image for synthesis. A color on which image processing is performed so that the color of the image for synthesis is a color corresponding to the color of an image composed of pixels within a predetermined range around the position where the image for synthesis is superimposed on the captured image The photo sticker creating apparatus according to claim 1, further comprising changing means. Organ recognizing means for recognizing a predetermined organ in the face image of the user in the captured image;
The photographic sticker creating apparatus according to claim 1, wherein the composition image superimposing unit superimposes the composition image on the organ recognized by the organ recognition unit. The photo sticker creating apparatus according to claim 12, wherein makeup is applied to the face image of the user by superimposing the composition image on the face image of the user in the captured image. An editing input operation for inputting editing information is performed on a captured image that is an image of the user obtained by a photographing operation with the user as a subject, and the obtained edited image of the user is further displayed. In the photo sticker creating method of the photo sticker creating device provided to the user,
A composition image superimposing means, in the editing input work, superimposing a composition image on the photographed image, or further superimposing a composition image on the composition image superimposed on the photographed image;
Image processing means includes performing image processing on at least one of the captured image and the composition image,
The feature amount of the captured image and the feature amount of the composition image are associated in advance,
The image processing means
A photo sticker that performs the image processing so that the feature amount of the image for synthesis approaches the feature amount associated in advance or the feature amount of the photographed image approaches the feature amount associated in advance. How to make. An editing input operation for inputting editing information is performed on a captured image that is an image of the user obtained by a photographing operation with the user as a subject, and the obtained edited image of the user is further displayed. A program for causing a computer to execute processing in the photo sticker creating apparatus provided to the user,
A composition image superimposing means, in the editing input work, superimposing a composition image on the photographed image, or further superimposing a composition image on the composition image superimposed on the photographed image;
An image processing means for causing a computer to execute processing including a step of performing image processing on at least one of the captured image and the composition image;
The feature amount of the captured image and the feature amount of the composition image are associated in advance,
The image processing means
A program for performing the image processing so that the feature amount of the image for synthesis approaches the feature amount associated in advance or the feature amount of the photographed image approaches the feature amount associated in advance.

Images