JP2013137406A - Image processing system, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing system which provides an image that looks good.SOLUTION: In an image processing system, a face is detected from an image photographed by a photographic seal creating device. Further, a region such as cheeks, a jaw, and a forehead is extracted from the detected face. Color and brightness of skin within each of these extracted regions are corrected to become suitable color and brightness for each region. Since the correction is performed for each face or each region within the face, an image that looks good is created for each face. Further, corrections such as enlarging a mouth or eyes or adjusting positions thereof are also performed. With such corrections performed for each face, the image that looks good can be provided to a user. The technology can be applied to the photographic seal creating device.

Description

  The present technology relates to an image processing apparatus, an image processing method, and a program. Specifically, the present invention relates to an image processing apparatus, an image processing method, and a program for correcting an image so that an optimum image is obtained for each person when a plurality of persons are photographed.

  2. Description of the Related Art A photo sticker creation apparatus is known that takes a picture of a user, causes the user to edit the photographed image, and prints and provides the edited image on sticker paper. Such a photo sticker creating apparatus is installed in an entertainment facility. The flow of one game provided by the photo sticker creating apparatus usually shoots a user in the shooting space as a subject, moves the user to the editing space, and edits the image according to operations performed in the editing space. Then, the edited image, which is an edited image, is printed on a sticker sheet and discharged.

  In such a photo sticker creating apparatus, in order to provide a photo sticker that satisfies the user, the photographed user image may be processed. For example, in Patent Document 1, a first mask image, a second mask image obtained by extracting a contour of a subject, and a blurred image of a photographic image are generated from a line segment region connecting a plurality of nodes on the face of the subject. It has been proposed to perform image processing by superimposing a photographic image of the region covered by the first and second mask images and a blurred image of the region other than the region covered by the first and second mask images. .

  In addition, although it is not a photo sticker creation device, skin color recognition is performed on the basis of an average value of pixel values in an area defined in a portion straddling the face-like nose of a subject as image processing for a captured user image. It has been proposed to generate a mask image showing a skin area (see Patent Document 2).

JP 2006-031195 A JP 2005-276182 A

  It is assumed that a plurality of users use the photo sticker creating apparatus at the same time. In such a photo sticker creation apparatus, if image processing is performed so that each image has a predetermined value, when a plurality of people are photographed in one image, the images are processed so that the plurality of people have a uniform value. End up. As a result, since the color of the background varies from person to person, one person may be too bright (a person with a bright background will become brighter), which may result in a photographic image with a soft impression.

  In addition, in the case of Patent Document 1, by performing blurring processing on the face skin portion of the subject other than the eyes and nose standing and contours, it is possible to provide a photographic image with a smooth and beautiful texture while maintaining the sharpness of the eyes and nose standing and contours. Since blur processing is performed on the entire face skin portion of the subject, there is a possibility that a photographic image with a poor expression and a soft impression will be formed.

  In addition, in the case of Patent Document 2, since a skin region can be extracted from a wide variety of human images, image processing can be performed on the subject skin region, but image processing of the entire subject skin region is performed. As in Patent Document 1, there is a possibility that the photographed image has a poor impression and a soft impression.

  The present technology has been made in view of such a situation, and can provide a user with an image that has been processed so as to obtain an optimal image for each photographed person. It is.

  An image processing apparatus according to an aspect of the present technology acquires a captured image obtained by capturing a subject, and detects, from the captured image, a detection unit that detects the number of subjects, and two or more subjects are detected by the detection unit. A processing unit that performs image processing for each detected subject, and the processing unit is extracted by the extraction unit that extracts a predetermined face area for each of a plurality of subjects from the captured image, and the extraction unit. And a correction unit that corrects at least one of the color and brightness in the region so as to be a color set for each of the predetermined face regions. .

  The extraction unit may extract a region including any of a forehead, a cheek, and a chin region excluding the eye, nose, and mouth regions as the predetermined face region.

  The correction unit calculates an average value of the luminance values in the extracted face area, and the average value in the face area is set to a value close to the luminance value related to the set color. It is possible to correct the color.

  The extraction unit extracts at least one of the eye, nose, and mouth regions as the predetermined face region from the photographed image, and the correction unit extracts the extracted eye, nose, and mouth regions. For at least one of the above, at least one of color, position, and size may be further corrected.

  An imaging unit that performs a shooting operation for the user as the subject, an editing unit that performs an editing operation for inputting editing information on the user's image obtained by the shooting operation, and the obtained edited The image of the user is printed on a predetermined sticker paper, the printed sticker paper is ejected, and an output unit is provided to the user as a photo sticker. The user's image obtained by photographing work is acquired as the photographed image, and the photographed image processed by the processing unit is set as an image to be edited by the editing unit. it can.

  An image processing method according to an aspect of the present technology acquires a captured image obtained by capturing a subject, detects the number of subjects from the captured image, and detects two or more subjects for each detected subject. The step of performing image processing includes extracting a predetermined face area for each of a plurality of subjects from the photographed image, and for each of the extracted predetermined face areas, And a step of correcting so that at least one of color and brightness is set to a color set for each predetermined face area.

  A program according to an aspect of the present technology acquires a photographed image obtained by photographing a subject, detects the number of subjects from the photographed image, and detects two or more subjects, and detects an image for each detected subject. A step of performing processing, wherein the step of performing image processing includes extracting a predetermined face area for each of a plurality of subjects from the captured image, and for each of the plurality of extracted face areas extracted, A computer is caused to execute a process including a step of correcting so that at least one of the colors of brightness becomes a color set for each of the predetermined face areas.

  In the image processing device, the image processing method, and the program according to one aspect of the present technology, the number of subjects is detected from a captured image obtained by photographing the subject, and when two or more subjects are detected, each detected subject is detected. Image processing is performed. In the image processing, a predetermined face area for each of a plurality of subjects is extracted from the photographed image, and at least one of the colors in the area and the brightness of each of the extracted predetermined face areas has a predetermined color. This is performed by correcting the color to be set for each face area.

  According to one aspect of the present technology, it is possible to perform a process for obtaining an optimum image for each photographed person. Then, an image subjected to such processing can be provided to the user, and the satisfaction of the user can be increased.

It is a perspective view which shows the structural example of the external appearance of a photograph sticker production apparatus. It is the perspective view which looked at the external appearance of the photograph sticker production apparatus from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of an imaging | photography part. It is a figure which shows the structural example of a background part. It is a figure which shows the structural example of an edit part. It is a figure which shows the structural example of a customer service part after the fact. It is a block diagram which shows the example of an internal structure of a photograph sticker production apparatus. It is a functional block diagram which shows the detailed structural example of the control part of FIG. It is a flowchart explaining the process which provides a photograph sticker creation game. It is a flowchart explaining an edit process. It is a flowchart for demonstrating image processing. It is a figure for demonstrating image processing. It is a figure for demonstrating image processing.

  Hereinafter, embodiments of the present technology will be described with reference to the drawings.

[Configuration example of photo sticker creation device]
FIG. 1 is a perspective view showing a configuration example of the appearance of a photo sticker creating apparatus 1 according to an embodiment of the present invention.

  The photo sticker creating apparatus 1 is a game machine that allows a user to perform operations such as shooting and editing as a game and receives a price from the user instead of providing a shot image or an edited image. The photo sticker creating apparatus 1 is installed in a store such as a game center. There may be one user or a plurality of users.

  A user who plays in the game provided by the photo sticker creating apparatus 1 pays the price, takes a picture of himself as a subject, and selects an image to be edited selected from the shot images obtained by shooting. Editing is performed using an editing function for synthesizing handwritten line drawings and stamp images, thereby making the photographed image rich and colorful. The user receives the sticker sheet on which the edited image is printed and ends the series of games.

  The photo sticker creating apparatus 1 mainly includes a photographing unit 11, an editing unit 12, and a subsequent customer service unit 13 provided in a photographing space described later. The photographing unit 11 and the editing unit 12 are installed in contact with each other, and the editing unit 12 and the subsequent customer service unit 13 are installed in contact with each other.

  The photographing unit 11 includes a photographing unit 21 and a background unit 22. The photographing unit 21 and the background unit 22 are installed with a predetermined distance apart, and photographing processing is performed in a photographing space that is a space formed between the photographing unit 21 and the background unit 22.

  The photographing unit 21 is a device that allows a user to perform photographing processing. The photographing unit 21 enters the photographing space and is located in front of the user who is performing the photographing process. The front panel 41 of the photographing unit 21 that constitutes a surface in which the photographing space is desired in front is provided with a touch panel monitor used by the user during photographing processing. When the left side is the left side and the right side is the right side as viewed from the user in the imaging space, the left side of the imaging unit 21 is configured by the side panel 42A, and the right side is configured by the side panel 42B.

  A live view monitor that displays the user's live view (moving image) may be provided separately from the touch panel monitor that accepts the user's operation input.

  The background unit 22 is attached to the left end of the rear panel 51 and the rear panel 51, which are plate-like members positioned on the rear side of the user who is performing the photographing process facing the front, and is a plate having a narrower width than the side panel 42A. The side panel 52A is a plate-like member, and the side panel 52B is a plate-like member that is attached to the right end of the back panel 51 and has a narrower width than the side panel 42B.

  The side panel 42A constituting the left side surface of the photographing unit 21 and the side panel 52A of the background unit 22 are provided on substantially the same plane, and their upper portions are connected by a connecting part 23A that is a plate-like member. Further, the side panel 42B constituting the right side surface of the photographing unit 21 and the side panel 52B of the background portion 22 are provided on substantially the same plane, and their upper portions are connected by a connecting portion 23B which is a plate-like member.

  An opening formed by being surrounded by the side panel 42 </ b> A of the photographing unit 21, the connecting part 23 </ b> A, and the side panel 52 </ b> A of the background part 22 becomes an entrance G <b> 1 of the photographing space. An opening that is located on the opposite side of the entrance / exit G1 and is surrounded by the side panel 42B of the photographing unit 21, the connecting part 23B, and the side panel 52B of the background 22 is also the entrance / exit G2 of the photographing space.

  The background curtain unit 25 is provided on the upper portion of the background portion 22 so as to be supported by the rear panel 51, the side panel 52A, and the side panel 52B located on the opposite side of the side panel 52A. The background curtain unit 25 stores a plurality of roll-up type background curtains having different colors or patterns and used for the background. The background curtain unit 25 operates in conjunction with photographing by a camera or the like provided in the photographing unit 21. At the time of photographing, for example, the curtain of the color selected by the user is lowered and the other curtains are wound up.

  In addition, as a background curtain accommodated in the background curtain unit 25, you may prepare the raising / lowering curtain which uses several curtains as one curtain for curtains. In addition, a black curtain is pasted on the rear panel 51 which is the back of the shooting space, and a plurality of background images for synthesis are prepared. In an editing process described later, a background image desired by the user is displayed on the curtain portion. It may be possible to synthesize.

  An opening surrounded by the front panel 41 of the photographing unit 21, the connecting part 23A, the connecting part 23B, and the background curtain unit 25 is formed above the photographing space, and the ceiling strobe unit 24 covers the part of the opening. Provided. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B. The ceiling strobe unit 24 has a built-in strobe that emits light toward the photographing space in accordance with photographing. A fluorescent lamp is provided inside the strobe constituting the ceiling strobe unit 24, and also functions as illumination of the photographing space.

  The editing unit 12 is a device that allows a user to perform editing processing, which is processing for editing an image obtained by shooting processing. The editing unit 12 is provided so as to be connected to the photographing unit 11 so that one side surface thereof is in contact with the back surface of the front panel 41 of the photographing unit 21. The editing unit 12 is provided with a configuration such as a tablet built-in monitor used by the user during editing processing.

  If the configuration of the editing unit 12 shown in FIG. 1 is a front-side configuration, the editing unit 12 is used for editing processing on the front side and the back side so that two sets of users can perform editing processing simultaneously. Each configuration is provided.

  The front side of the editing unit 12 is a surface perpendicular to the floor surface, and is composed of a surface 71 that is substantially parallel to the side panel 42A, and a slope 72 formed above the surface 71. The configuration used is provided on the slope 72. On the left side of the slope 72, a support portion 73A that has a columnar shape and supports one end of the lighting device 74 is provided. A support portion 75 that supports the curtain rail 26 is provided on the upper surface of the support portion 73A. A support portion 73 </ b> B that supports the other end of the lighting device 74 is also provided on the right side of the slope 72.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C so that the shape when viewed from above is a U-shape. One end of the rails 26A and 26B provided in parallel is fixed to the connecting portion 23A and the connecting portion 23B, respectively, and both ends of the remaining one rail 26C are joined to the other end.

  A curtain is attached to the curtain rail 26 so that the inside of the space in front of the editing unit 12 and the space in front of the back cannot be seen from the outside. The space in front of the editing unit 12 and the space in front of the back of the editing unit 12 surrounded by the curtain attached to the curtain rail 26 are editing spaces in which the user performs editing processing.

  FIG. 2 is a perspective view of the photo sticker creating apparatus 1 as seen from another angle.

  The subsequent customer service unit 13 is a device that allows the user to perform the subsequent customer service process. Subsequent customer service processing includes processing for transmitting a photographed image or edited image to a mobile terminal such as a mobile phone, processing for allowing a user to play a mini game, processing for answering a questionnaire, and the like.

  As shown in FIG. 2, the post-service customer unit 13 has a plate-like housing having a predetermined thickness, and is connected to the editing unit 12 so that the back surface thereof is in contact with the left side surface of the editing unit 12. Provided. On the front side of the post-service unit 13, there are provided a tablet built-in monitor used by the user at the time of post-service processing, a discharge port through which sticker paper on which a photographed image or an edited image is printed is discharged. The space in front of the front-end customer service unit 13 becomes a rear-end customer service space where a user waiting for printing on the sticker paper to perform post-service processing.

  Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described with reference to FIG. FIG. 3 is a plan view of the photo sticker creating apparatus 1 as viewed from above.

  The user of the photo sticker creating apparatus 1 is formed between the photographing part 21 and the background part 22 from the entrance G1 as indicated by the white arrow # 1 or from the entrance G2 as indicated by the white arrow # 2. The photographing space A1 is entered, and photographing processing is performed using a camera or a touch panel monitor provided in the photographing unit 21.

  The user who has finished the shooting process exits the shooting space A1 and moves to the editing space A2-1 using the doorway G1 as indicated by the white arrow # 3, or moves to the editing space A2-1 as indicated by the white arrow # 4. To leave the shooting space A1 and move to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12, and the editing space A2-2 is an editing space on the back side of the editing unit 12. Which of the editing space A2-1 and the editing space A2-2 is moved is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the empty space of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing processing. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing processing at the same time.

  After the editing process is finished, printing of an image selected from the photographed image and the edited image is started. During printing of the image, the user who has finished the editing process moves from the editing space A2-1 to the subsequent customer service space A3 as indicated by the white arrow # 5 if the editing process has been performed in the editing space A2-1. Then, the customer service is processed after the fact. In addition, when the editing process is completed in the editing space A2-2, the user who has finished the editing process moves from the editing space A2-2 to the post-service area A3 as indicated by the white arrow # 6. Post service processing is performed in the customer service space A3.

  When the printing of the image is finished, the user receives the sticker paper from the outlet provided in the post-service section 13 and finishes a series of photo sticker creation games.

  Next, the configuration of each part of the apparatus will be described.

  FIG. 4 is a diagram illustrating a configuration example of the front of the photographing unit 21. The photographing unit 21 is configured by attaching a front panel 41, a side panel 42A, and a side panel 42B to a base unit 43 having a box shape.

  The front panel 41 is positioned in front of the user who performs the shooting process in the shooting space A1, and the side panel 42A and the side panel 42B are positioned on the left side and the right side of the user who performs the shooting process in the shooting space A1, respectively. The connecting portion 23A is fixed above the side panel 42A, and the connecting portion 23B is fixed above the side panel 42B.

  An imaging / display unit 81 is provided in the approximate center of the front panel 41. The photographing / display unit 81 includes a camera 91, a front strobe 92, and a touch panel monitor 93.

  The camera 91 is configured by an image sensor such as a CCD (Charge Coupled Device), and photographs a user in the photographing space A1. The moving image captured by the camera 91 is displayed on the touch panel monitor 93 in real time. An image captured by the camera 91 at a predetermined timing such as when a user gives an instruction to shoot is saved as a photographic image (still image).

  A front strobe 92 provided with a light emitting surface so as to surround the camera 91 emits light in accordance with photographing by the camera 91 like other strobes, and irradiates the vicinity of the user's face as a subject from the front.

  The touch panel monitor 93 provided on the lower side of the camera 91 includes a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 93 has a function as a live view monitor that displays a moving image captured by the camera 91 and a function that displays various GUI (Graphical User Interface) images and accepts a user's selection operation through the touch panel. ing. On the touch panel monitor 93, a moving image after an image such as a background is appropriately displayed is displayed.

  On the front panel 41, an upper strobe 82 is installed on the upper side with respect to the position of the photographing / display unit 81. A left strobe 83 is installed on the left side and a right strobe 84 is installed on the right side. A lower strobe 85 is provided at a position below the photographing / display unit 81 such that a part of the upper surface of the base portion 43 protrudes.

  The upper strobe 82 irradiates the user from the upper front. The left strobe 83 irradiates the user from the left front, and the right strobe 84 irradiates the user from the right front. The lower strobe 85 irradiates the user from the lower front.

  The base unit 43 is also provided with a foot strobe 86 that irradiates the user's foot. Fluorescent lamps are provided inside the upper strobe 82, left strobe 83, right strobe 84, lower strobe 85, and foot strobe 86, and together with the fluorescent lights inside the strobe constituting the ceiling strobe unit 24, photographing is performed. Used as illumination in the space A1. On the right side of the foot strobe 86, a coin insertion / return port 87 through which a user inserts money is provided.

  Spaces 43A and 43B formed on the left and right sides of the upper surface of the base portion 43 with the lower strobe 85 interposed therebetween are used as a luggage storage place for a user who performs photographing processing to place baggage and the like. For example, near the ceiling of the front panel 41, a speaker for outputting sound such as guidance sound for photographing processing, BGM (Back Ground Music), and sound effects is also provided.

  FIG. 5 is a diagram illustrating a configuration example of the background portion 22 on the photographing space A1 side.

  As described above, the background curtain unit 25 is provided above the back panel 51. Near the center of the background curtain unit 25, a back center strobe 101-1 and a back center strobe 101-2 for irradiating a user who is performing a photographing process in the photographing space A1 from the rear center are attached.

  A rear left strobe 102 that irradiates a user who is performing a photographing process in the photographing space A1 from the left rear is provided above the rear panel 51 and on the doorway G1 side. Further, a rear right strobe 103 that irradiates a user who is performing a photographing process in the photographing space A1 from the right rear is provided above the rear panel 51 and on the entrance / exit G2 side.

  FIG. 6 is a diagram illustrating a configuration example of the editing unit 12 on the front side (editing space A2-1 side).

  A tablet built-in monitor 131 is provided at substantially the center of the slope 72. A touch pen 132A is provided on the left side of the tablet built-in monitor 131, and a touch pen 132B is provided on the right side.

  The tablet built-in monitor 131 is configured by superimposing a tablet capable of operation input using the touch pen 132A or 132B on a monitor such as an LCD. On the tablet built-in monitor 131, for example, an editing screen that is a screen used for editing a captured image selected as an image to be edited is displayed. When two people perform editing work simultaneously, the touch pen 132A is used by one user, and the touch pen 132B is used by the other user.

  On the left side of the editing unit 12, a post-service unit 13 is provided.

  FIG. 7 is a diagram illustrating a configuration example of the front side of the post-service unit 13.

  A monitor 161 with a built-in tablet is provided at the upper center of the post-service section 13. A touch pen 162A is provided on the left side of the tablet built-in monitor 161, and a touch pen 162B is provided on the right side. Similarly to the tablet built-in monitor 131, the tablet built-in monitor 161 is configured by superimposing a tablet capable of performing an operation input using the touch pen 162A or 162B on a monitor such as an LCD. On the tablet built-in monitor 161, a screen used for post-service processing such as a mini game is displayed.

  A non-contact type IC reader / writer 163 is provided under the tablet built-in monitor 161, and a sticker paper discharge port 164 is provided under the non-contact type IC reader / writer 163. A speaker 165 is provided below the sticker paper discharge port 164.

  The non-contact type IC reader / writer 163 communicates with an adjacent non-contact type IC, reads data from the non-contact type IC, and writes data to the non-contact type IC.

  In the sticker paper discharge port 164, sticker paper on which an image created by the user of the editing space A2-1 is edited, or the user of the editing space A2-2 performs the editing process. The sticker paper on which the created image is printed is discharged. A printer is provided inside the editing unit 12, and printing of images is performed by the printer.

  The speaker 165 outputs sound such as guidance voice, BGM, and sound effects for the post-service processing.

  Next, the internal configuration of the photo sticker creating apparatus 1 will be described. FIG. 8 is a block diagram illustrating an internal configuration example of the photo sticker creating apparatus 1. The same code | symbol is attached | subjected to the same structure as the structure mentioned above. The overlapping description will be omitted as appropriate.

  The control unit 201 includes a CPU (Central Processing Unit) and the like, executes a program stored in a ROM (Read Only Memory) 206 and a storage unit 202, and controls the overall operation of the photo sticker creating apparatus 1. A storage unit 202, a communication unit 203, a drive 204, a ROM 206, and a RAM (Random Access Memory) 207 are connected to the control unit 201. The control unit 201 is also connected with the components of the photographing unit 21, the editing unit 12, the post-service unit 13, and the printing unit 211.

  The storage unit 202 includes a non-volatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 201. Information stored in the storage unit 202 is appropriately read out by the control unit 201.

  A communication unit 203 is an interface of a network such as the Internet, and communicates with an external device according to control by the control unit 201.

  A removable medium 205 made of an optical disk, a semiconductor memory, or the like is appropriately attached to the drive 204. Computer programs and data read from the removable medium 205 by the drive 204 are supplied to the control unit 201 and stored in the storage unit 202 or installed.

  The ROM 206 stores programs and data executed by the control unit 201. The RAM 207 temporarily stores data and programs processed by the control unit 201.

  The imaging unit 21 includes a coin processing unit 221, a background control unit 222, an illumination control unit 223, a camera 91, a touch panel monitor 93, and a speaker 224 that are configured to perform imaging processing in the imaging space A1.

  The coin processing unit 221 detects the insertion of coins into the coin insertion / return port 87. When the coin processing unit 221 detects that a predetermined amount of coins such as 300 yen has been inserted, the coin processing unit 221 outputs an activation signal indicating that to the control unit 201.

  The background control unit 222 raises and lowers the background curtain stored in the background curtain unit 25 according to the background control signal supplied from the control unit 201. The background curtain may be manually selected by the user.

  The illumination control unit 223 controls the light emission of each strobe in the imaging space A1 according to the illumination control signal supplied from the control unit 201. As described above, in the photographing space A1, in addition to the strobe of the ceiling strobe unit 24, an upper strobe 82, a left strobe 83, a right strobe 84, a lower strobe 85, a foot strobe 86, and a background portion provided in the photographing unit 21 are provided. 22 is provided with a back center strobe 101-1, a back center strobe 101-2, a back left strobe 102, and a back right strobe 103. A fluorescent lamp is also provided inside each strobe.

  In addition, the illumination control unit 223 adjusts the light emission amount of the fluorescent lamp provided inside each strobe, or adjusts the number of fluorescent lamps to emit light, thereby performing a shooting process performed by the user. The brightness in the shooting space A1 is adjusted according to the above.

  The camera 91 shoots according to the control by the control unit 201 and outputs an image obtained by the shooting to the control unit 201.

  The editing unit 12A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 231 provided on the front side of the editing unit 12 as a configuration for performing editing processing in the editing space A2-1. The editing unit 12B has the same configuration as the editing unit 12A, and performs editing processing in the editing space A2-2.

  The tablet built-in monitor 131 displays an editing screen according to control by the control unit 201, and detects a user operation on the editing screen. A signal representing the content of the user's operation is supplied to the control unit 201, and the captured image to be edited is edited.

  The subsequent customer service unit 13 includes a tablet built-in monitor 161, touch pens 162A and 162B, a non-contact type IC reader / writer 163, and a speaker 165 that are configured to perform subsequent customer service in the subsequent customer service space A3.

  The printing unit 211 includes a printer 241 and a sticker sheet unit 242 that are configured to perform printing processing. The printer 241 prints the photographed image or the edited image obtained by the editing process on the sticker paper stored in the sticker paper unit 242 attached to the printer 241 and discharges it to the sticker paper discharge port 164. The subsequent customer service unit 13 and the printing unit 211 shown surrounded by the one-dot chain line are configured to perform processing for the user in the subsequent customer service space A3.

  Note that the use of the image created in the photo sticker creation game is not limited to printing on sticker paper. For example, the image data of the image created in the photo sticker creation game is transmitted to the user's portable terminal via the communication unit 203, the non-contact type IC reader / writer 163, etc., and the images are displayed on the portable terminal. It is also possible. For example, a user can also use an image created in a photo sticker creation game as an image on a standby screen of a mobile phone.

  Next, the control unit 201 will be described. FIG. 9 shows an example of the functional block configuration realized by the control unit 201 executing a program stored in the ROM 206 or the like.

  The control unit 201 performs a process relating to a process of taking a photo sticker creation game, such as a process related to a price input when starting the photo sticker creation game and a photograph of a user group. An editing processing unit 283 that performs processing related to the editing work process of the photo sticker creation game such as graffiti editing, a printing processing unit 284 that performs processing related to the printing process of the photo sticker creation game such as printing of sticker paper, and editing work. A post-service processing unit 285 is provided for performing a process related to the post-service process of the photo sticker creation game for serving the completed user group.

  That is, the control unit 201 controls processing related to each process of the photo sticker creation game.

  Next, processing of the photo sticker creating apparatus 1 that provides a photo sticker creating game will be described with reference to the flowchart of FIG.

  In step S11, the photographing processing unit 282 of the control unit 201 of the photo sticker creating apparatus 1 determines whether or not a predetermined amount of coins has been inserted based on a signal supplied from the coin processing unit 221 and is inserted. Wait until it is determined.

  If it is determined in step S11 that a coin has been inserted, in step S12, the imaging processing unit 282 controls the imaging unit 208 and executes imaging processing. At this time, for example, a shooting process is performed in which the moving image of the subject captured by the camera 91 is displayed in live view on the touch panel monitor 93 and the user in the shooting space A1 is taken as a subject.

  In step S13, the photographing processing unit 282 guides the user in the photographing space A1 to move to the editing space A2-1 or the editing space A2-2. The guidance for movement to the editing space A2-1 or the editing space A2-2 is performed by displaying a screen on the touch panel monitor 93 of the photographing unit 208 or by outputting sound from the speaker 224.

  In step S14, the editing processing unit 283 controls the editing unit 209 corresponding to the editing space of the editing space A2-1 and the editing space A2-2 that is the destination of the user who has finished the shooting process, Edit processing and pre-print setting processing are performed. Specifically, the editing processing unit 283 causes the user to select a synthesis image to be synthesized with the photographed image selected as the editing target image, and synthesizes the selected composition image with the photographed image. The image is edited according to the editing operation by the user.

  Details of the editing process and the pre-print setting process will be described later with reference to FIG.

  In step S15, the editing processing unit 283 guides the user who has finished the editing process in the editing space A2-1 or the editing space A2-2 to move to the subsequent customer service space A3. The guidance of the movement to the post-service space A3 is performed by displaying a screen on the tablet built-in monitor 131 or by outputting sound from the speaker 231.

  In step S <b> 16, the print processing unit 284 performs print processing for outputting the image selected by the user to the printer 241 and printing it on the sticker sheet.

  In step S <b> 17, the post-service processing unit 285 controls the post-service unit 210 to perform post-service processing for a user who is waiting for completion of printing. Specifically, the post-service processing unit 285 performs, for example, a mobile transmission game process in which a captured image or an edited image is transmitted to the mobile terminal as the post-service processing, and an e-mail address input screen of the mobile terminal or transmission A screen for selecting an image to be displayed is displayed on the tablet built-in monitor 161, and the image is transmitted according to an operation by the user.

  When printing is completed, in step S18, the customer service processing unit 285 displays that the printing is completed on the tablet built-in monitor 161, and the printer 241 discharges the sticker paper on which the image is printed to the sticker paper discharge port 164. The process is terminated.

  Next, a detailed example of the editing process and the pre-print setting process in step S14 in FIG. 10 will be described with reference to the flowchart in FIG.

  In step S51, the editing processing unit 283 displays the editing target image on the tablet built-in monitor 131 in the editing space of the editing space A2-1 and the editing space A2-2, which is the moving destination of the user who has finished the photographing process. A selection screen is displayed and selection by the user is accepted. For example, a list of the captured images obtained by the imaging process is displayed on the selection screen for the editing target image.

  In step S52, an image for synthesis is selected. For example, a selection screen for a composition image used for selecting a composition image to be combined with the photographed image is displayed, and the user selects a desired composition image.

  In step S53, the editing processing unit 283 performs image processing on the captured image. As a result, an image (compositing image) such as a background or foreground to be combined with the subject image is selected, and the combining image is combined with the subject image. Further, the subject image is processed so as to obtain an optimum image for each subject, and the processing is also executed in step S53. The process in step S53, particularly the process that provides the optimum image for each subject will be described later.

  In step S54, the edit processing unit 283 accepts input of the user's name. The user name input here is used for an editing tool called “name stamp”, for example. The “name stamp” is, for example, a tool for stamping a user's name on an image printed as a photo sticker.

  In step S55, the editing processing unit 283 displays the image that has been selected as the image to be edited and has been subjected to the processing in step S53 on the tablet built-in monitor 131, and accepts editing input by the user. Thereby, so-called graffiti editing using the touch pen 132A and the touch pen 132B is performed. At this time, the user doodles the image to be edited using an editing tool such as a stamp tool or a pen tool.

  In step S56, the edit processing unit 283 determines whether a predetermined time (time limit) has elapsed or the end button has been operated, and the time limit has not been reached, and the end button is also operated. If it is determined that it is not, the editing processing unit 283 returns the process to step S55 and repeats the subsequent processes.

  If it is determined in step S56 that a predetermined time has elapsed or the end button has been operated, the editing processing unit 283 advances the process to step S57. In step S57, the edit processing unit 283 generates a collage image. The collage image is an image for printing on a sticker paper a combination of a plurality of subject images as a sticker image. That is, the collage image is a single image obtained by combining a plurality of images including an image obtained by trimming a predetermined area from a captured image.

  The collage image does not require the user to take an image for generating the collage image, and the collage image is automatically generated based on the taken image. A plurality of collage images may be generated based on a predetermined design pattern. For example, collage images corresponding to design pattern A and design pattern B are generated. Depending on the design pattern, for example, the arrangement position of each image constituting the collage image may be determined.

  In step S58, the edit processing unit 283 causes the user to select a collage image. At this time, for example, collage images corresponding to a plurality of design patterns are displayed on the tablet built-in monitor 131, respectively. Then, one of the collage images of a plurality of design patterns is selected by the user.

  In step S59, the editing processing unit 283 causes the user to select the number of divisions of the photo sticker. At this time, for example, a plurality of division patterns are displayed on the tablet built-in monitor 131. Then, one of the plurality of division patterns is selected by the user.

  In this way, the editing process is executed.

[Image processing]
Image processing will be described. Although the image processing is described here as being performed in step S53 (FIG. 11), it may of course be performed at another timing. The image processing described here is, for example, processing for converting the color of the cheek portion of the photographed user's face into an appropriate color, and the timing at which an image subjected to such processing is provided is Any timing is acceptable.

  For example, in step S12 (FIG. 10), the shooting process is performed. When the shooting process is performed, the moving image of the subject captured by the camera 91 is displayed on the touch panel monitor 93 as a live view. The image displayed in live view may be an image after image processing. In such a case, the image processing described below is included in the processing in step S12. In the processing after step S12, the image presented to the user is an image that has been subjected to image processing.

  Alternatively, the image displayed in the live view may not be subjected to image processing, and the captured image that is a display of the captured result may be an image after image processing.

  Further, for example, in step S14 (FIG. 10), an editing process is performed. When this editing process is performed, a screen for selecting an image to be edited is displayed on the tablet built-in monitor 131 in the editing space. At least one of the plurality of images selected as the editing target image and the selected image to be edited may be an image after image processing. In such a case, the image processing described below is included in the processing in step S14. In the processing after step S14, the image presented to the user is an image that has been subjected to image processing. Here, description will be continued by taking such a case as an example.

  Further, for example, in step S16 (FIG. 10), the printing process is performed. When this printing process is performed, the image process may be performed and the image subjected to the image process may be printed. In such a case, the image processing described below is included in the processing in step S16.

  Further, although not shown here, for example, when configured to be provided from the photo sticker creating apparatus 1, an image that has been shot and edited on a mobile terminal such as a mobile phone is provided, Image processing may be performed.

  FIG. 12 is a flowchart for explaining processing related to image processing. In step S101, a face is detected from the photographed image, and the number of photographers is determined based on the number of faces. As a technique for detecting a face from an image, an existing technique can be applied. Here, it is assumed that not only a face is detected but also a part (area) of the face is detected. Facial parts are organs such as eyebrows, eyes, nose, mouth, and ears that make up a person's face.

  In step S102, the number of persons is detected according to the number of faces detected from the captured image, and it is determined whether or not there are two or more persons. If it is determined in step S102 that there are two or more people, the process proceeds to step S103. In step S103, a predetermined region of the detected face, for example, a region is extracted from the eye position or the face outline. In step S104, a predetermined correction is performed on the extracted area.

  The extracted predetermined areas of the face are, for example, areas such as cheeks, jaws, and foreheads, and when these areas are extracted, the skin color in which the skin tone in the area is considered to be beautiful It is converted to a color close to the taste or corrected to an appropriate brightness. In addition, since face parts (regions) are also detected, these parts are also corrected to be considered beautiful. These processes will be described with reference to FIG. 13 and thereafter, and the flowchart will be described first.

  The correction is a correction in which at least one of brightness, color shading, hue, saturation, brightness, and contrast is converted. Further, in the following description, the fact that any one of these conversions is performed will be described as appropriate when the color is converted.

  When correction in the extracted area is performed in step S104, it is determined in step S105 whether or not there is an unprocessed face. If it is determined in step S105 that there is an unprocessed face, the process returns to step S103, and the processes in and after step S103 are repeated for the face determined to be an unprocessed face. On the other hand, if it is determined in step S105 that there is no unprocessed face, the image processing is terminated.

  On the other hand, if it is determined in step S102 that the number of faces detected from the captured image is not two or more, in other words, if it is determined that there is only one person, the process proceeds to step S106. In step S106, a predetermined area of the detected face of one person is extracted, and in step S107, the extracted area is corrected. The processing of step S106 and step S103 is basically the same as the processing of step S103 and step S104.

  As described above, in the present embodiment, correction is performed for each person (for each face) by repeating the processes of steps S103 to S105. For example, when two or more faces are detected from the captured image, correction is performed for each detected face, in other words, for each person. In other words, in the present embodiment, correction is not performed for each image but for each person in the image. Therefore, correction suitable for each person can be performed.

  For example, consider correcting a captured image in which two persons are captured. At this time, when the correction for converting the brightness in image units is performed, in other words, when the same correction for converting the brightness is uniformly performed on the entire captured image, one person is corrected to an appropriate brightness. Even so, there is a possibility that the correction is made such that the other person is too bright. This is because, since the color of the background varies from person to person, if the same brightness correction is performed, a person with a bright background will be corrected more brightly. When such correction is performed in units of images, there is a possibility that the image itself becomes a flat image.

  However, as in the present embodiment, when correction is performed to convert the brightness in units of persons in the image, for example, one person with a bright background does not convert the brightness, and the other person with a bright background does not convert the brightness. It is possible to make corrections such as converting. Therefore, each person can be corrected to an appropriate brightness. By performing such correction, it is possible to obtain an optimal image for each person, and to obtain a better image with a rich expression and a three-dimensional effect.

  Further, in the present embodiment, correction is performed for each face and for each area detected from the face. For example, there are various parts of the face, such as bright and non-bright parts, and parts that look beautiful when not bright. Therefore, if the same correction is performed on one face, for example, a brightening correction, there is a possibility that the face is corrected to a face having an appropriate brightness portion and an excessively bright portion. is there.

  However, in the present embodiment, correction is performed for each predetermined region in the face so as to be an appropriate color as the skin color in that region, so that there are portions where the brightness is appropriate and portions that are too bright The face is not corrected to a certain face, and the entire face can be corrected to have an appropriate brightness.

  If it is determined in step S102 that there is only one face, the processing in steps S106 and S107 may be omitted and the image processing may be terminated. In the case of one person, the user does not make a judgment as to whether the color is bright or the color is strange compared to other persons in the image. It seems that there is little that lowers satisfaction. Therefore, in the case of one person, the image processing process may be omitted.

[Region extraction and correction]
Next, face detection, extraction of a predetermined area from the face, and correction in the extracted area will be described. Here, as shown in FIG. 13, a case where two persons are photographed will be described as an example. When an image as illustrated in FIG. 13 is a processing target, two faces of the face 321 and the face 322 are detected in the process of step S101. In step S102, since two faces are detected, it is determined that the number of photographers is two, and the process proceeds to step S103.

  When a face is detected, each of eyes, nose, and mouth is detected. Existing techniques can be applied to face detection and detection of facial parts such as eyes, nose and mouth.

  As shown in FIG. 13, when face 321 and face 322 are photographed, face detection processing is executed in step S101, and when face 321 and face 322 are detected in this order, processing targets are set in this detection order. Is done. Therefore, in this case, the face 321 is the processing target first, and then the face 322 is the processing target.

  That is, in this case, first, the processes of steps S103 and S104 are performed on the face 321. Then, when it is determined in step S105 that there is an unprocessed face, it is determined that there is a face 322 as an unprocessed face, and the process in steps S103 and S104 is performed again on the face 322. Is repeated. In this way, processing is performed for each face.

  Since the processes for the face 321 and the face 322 are basically the same, the description is continued here taking the face 321 as an example. When the face 321 is set as a processing target, a predetermined region of the face 321 is extracted as shown in FIG. For example, the region 341 is extracted as a predetermined region including the cheek portion, and the region 342 is extracted as the predetermined region including the chin portion.

  The region 341 including the cheek portion can be set using, for example, the already detected eye position and mouth position. For example, a region between the lower side of the eye and the upper side of the mouth, and a predetermined shape, that is, a region surrounded by a rectangle in FIG. 14, is set as the region 341 including the cheek. Considering the shape of the cheek as the predetermined shape, each side of the square may be a curve such as a semicircular shape.

  Further, when the cheek portion is further extracted, the cheek portion can be left by removing the nose region from the region 341. When the cheek portion (region 341) is extracted in this manner, the skin in the region 341 is corrected. One of the correction contents in step S104 is correction that brightens the cheek portion. By brightening the cheeks, it is possible to obtain a face image that reflects a gentle atmosphere with a natural smile.

  The degree of brightness can be determined using, for example, a luminance value. An average value of luminance values in the area is calculated, and correction is performed so that the average value of the luminance values (described as average luminance value) is close to a preset luminance value (described as set luminance value). It can be configured to be done. The set luminance value is a luminance value derived from the brightness of the cheek that is considered beautiful.

  The average brightness value is corrected to a near brightness value instead of matching with a preset brightness value. For example, when there is a gap between the average brightness value and the set brightness value, such as when the skin color is bright or the skin color is dark, if the average brightness value is corrected to the set brightness value, The color may be different from the original user's skin color, and the user may have an unpleasant feeling such as discomfort. Therefore, a plurality of set brightness values are provided instead of one, and the set brightness value is selectively used according to the average brightness value, and the average brightness value is corrected to a value close to the set brightness value. You may make it.

  Further, the luminance values in the area 341 are not corrected so as to be all set luminance values, but are corrected so that, for example, the central part of the cheek is brightest and gradually becomes darker from the center depending on the position in the area. The The set brightness value has a width, and the brightness value can be corrected so that the brightness value in the region falls within the width.

  In addition, as one of the correction contents in step S104, in the case of cheek correction, correction that reflects the color of cheek (blusher) can be performed. Reflecting the color of the cheek means that when the user is applying a cheek, the cheek color is corrected to a brightness and color that makes the cheek color appear more beautiful. In addition, when the user is not cheeked, the cheek color of the user is corrected based on the luminance value as described above, and the cheek's blood color etc. looks more beautiful according to the luminance value. Corrections such as adding a color to a predetermined portion of the image may be performed. That is, when the user does not apply cheeks, image processing may be performed on the cheeks that are applied with cheeks.

  As in the case of the cheek, as one of the correction contents in step S104, the region 342 including the chin can be set as a region having a predetermined shape from the lower side of the mouth to the tip of the chin. Then, as in the case of the cheek described above, correction such as brightening is performed on the skin in the region 342 including the jaw. By brightening the chin part, it is possible to provide an image with a clear chin.

  Note that when a technique that can detect the contour of the face with a certain degree of accuracy is used, the shape of the region 341 or the region 342 may be a shape that partially matches the contour. By making the shape coincident with the contour, it is possible to correct even a finer portion.

  Further, by correcting the inside of the area, there is a possibility that the brightness and color are different between the inside and outside of the area, and the difference is recognized by the user. Therefore, it is preferable to process the vicinity of the boundary of the region so that the brightness and color gradually change so that the corrected portion and the uncorrected portion cannot be distinguished from each other. Processing is also included.

  Although not shown in FIG. 14, forehead, nasal muscles, under the nose, and the like may be extracted and corrected. As for the forehead, a rectangular region between the hairs from the upper side of the eyebrows can be detected, and the region can be processed as a portion of the forehead. In the case of a forehead, if the forehead is bright, the amount of the forehead is too conspicuous, which may result in an undesirable image. Therefore, by correcting the forehead a little darker, it is possible to provide an image with more reflection as a whole.

  In this way, when correcting the face, the brightness and color tone suitable for the part of the face are corrected. In the present embodiment, each part of the face is detected and different corrections are performed, so that such correction suitable for each part of the face can be performed.

  When detecting the face, if the position of the nose is also detected, the nose is detected, and the nose may be corrected as one of the correction contents in step S104. The center portion detected as the nose is set as an area to be corrected, and correction is performed so that the skin color in the area becomes brighter. By brightening the nose (with highlights), it is possible to provide a face with a nose and a good image.

  When a nose is detected, a portion between the nose and the mouth may be detected as a correction area and corrected. If there is a shadow between the nose and the mouth, for example, it may look like a mustache. It is possible to provide a better image by correcting the portion between the nose and the mouth so as to prevent this from happening.

  Such correction is performed for each person in the captured image. That is, in the case of the captured image shown in FIG. 13, since two people are captured, the face 321 is corrected, and then the face 322 is corrected. Note that the correction for the face 321 and the face 322 may be processed in parallel, instead of sequentially performing the correction.

  In addition, here, it has been described that brightness and color are corrected for each person (for each face). This correction is such that each face has a brightness close to the set luminance value. Furthermore, one of a plurality of faces in the image may be used as a reference face, and the brightness and color of each face may be corrected relative to the face. For example, when three faces are detected in the image, the color of one of the faces is used as a reference, and a person whose face is darker than the reference face is corrected to be brighter. Corrections such as correcting a darker face for a brighter face may be performed. By performing such correction, the brightness of the face in the image can be made uniform, and a better image can be provided for the entire image.

  It is also possible to change the set luminance value according to the sex of the subject. For example, when shooting, a frame for each gender is displayed in the live view, and the user's gender is taken so that the user fits within the frame for each gender so that the gender of the user can be determined. May be. When gender is determined, a set luminance value is provided for each gender, and the set luminance value provided for each gender is corrected so that the average luminance value calculated from each user's image approaches. Is done.

  Or you may comprise so that it may detect to sex at the time of face detection. When the gender is detected, the feature amount extracted from the male face image and the feature amount extracted from the female face image are retained, and the feature amount and the feature amount extracted from the subject face image The gender is determined by matching. The feature amount is a value calculated from, for example, the distance between parts constituting the face such as eyebrows, eyes, nose, mouth, and ears, and the size of each part. Such a feature amount is calculated by processing a plurality of male sample images and a plurality of female sample images, respectively, so that a feature amount for men and a feature amount for women are calculated.

  By performing matching processing using such feature amounts, gender is detected, and correction is made so that the average luminance value calculated from each user's image approaches the set luminance value provided for each gender. You may make it.

  Further, if the sample images are classified by age (age group) and the feature amount is calculated for each age, the age can be determined by matching the feature amounts in the same manner. Therefore, it is possible to provide a set luminance value for each age so that correction according to the age of the user is performed.

  As described above, in addition to correcting the color and brightness suitable for each person, the position and shape of the eyes and mouth may be corrected as one of the correction contents in step S104. When correcting the eyes, correction is performed to enlarge the entire eye, adjust the positions of the corners of the eyes and the eyes, and enlarge the black eye portion. By performing such eye correction, it is possible to provide an image of a natural smile with a gentle atmosphere.

  When correcting the position of the mouth, the positions of the mouth and the mouth corner are corrected so as to make a smile. As correction performed so as to make a smile, there is correction such as moving the mouth corner position upward. Also, the thickness of the lips may be corrected. Further, color correction such as redness on the lips may be performed. In this way, by correcting the positions of the mouth and the corner of the mouth, it is possible to provide an image of a natural smile with a gentle atmosphere.

  By performing such eye and mouth correction as well, it is possible to provide the user with a more realistic image and to increase the satisfaction of the user.

  Such extraction and correction are performed as processing in steps S106 and S107 even when the number of photographers is one. Therefore, even if one person shoots, an image can be provided to the user based on the image. It is possible to increase the user satisfaction.

  As described with reference to the flowchart of FIG. 11, a composite image is selected in step S52, and image processing is performed in subsequent step S53. Can be done. Therefore, it is possible to entertain an action such as editing (graffiti) in the photo sticker creating apparatus 1 without making the user aware of the fact that image processing has been performed.

  When the image processing for correcting the color, brightness, and position adjustment described above is performed after the synthesis image is selected, correction such as color, brightness, and position adjustment in consideration of the selected image for synthesis is performed. It may be performed. For example, if the selected composition image is a relatively bright image, each face may be corrected to a color and brightness suitable for the brightness.

  In this way, for each person in the captured image, a predetermined area of the face such as the cheek is extracted, color and lightness correction is performed, and correction such as position adjustment of the facial parts is performed for each person. Done. Therefore, correction suitable for each person can be performed, and an image that is optimal for each person can be provided to the user. In addition, it is possible to provide a better image with a rich expression and a three-dimensional appearance.

  By applying image processing to all images that are live view and shooting results at the time of shooting, a better image can be provided from the time of shooting, and any image can be selected as the image to be edited by the user. It is possible to provide a better image. In addition, if image processing is performed on an image selected as an image to be edited after selection of the image to be edited, image processing can be performed only on an image that the user likes and wants to edit. Therefore, it is possible to provide a better captured image with respect to the captured image intended by the user.

  In the correction method described above, there is a rule for correcting according to the purpose for each region or organ, for example, a correction rule for making a smile as described above, and correction is performed according to the rule. Such correction rules can be separately managed, and can be configured such that rule contents can be added or deleted. For example, in addition to the correction rule for smiling, a correction rule for making a sad face or a correction rule for an angry face may be added or deleted.

  In the embodiment described above, the face is detected and the face is corrected. However, a part other than the face may be detected, and a part other than the face may be corrected. For example, a portion of clothes may be detected, and correction according to the color of the clothes, for example, if the clothes are patterned, may be corrected to a color that makes the pattern appear beautiful.

[About recording media]
The series of processes described above can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 8, the recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the apparatus main body, and is a magnetic disk (flexible disk) on which the program is recorded. Disk), optical disk (including CD-ROM and DVD), magneto-optical disk (including MD), or removable media 205 made of semiconductor memory, etc., but also pre-installed in the main unit The ROM 206 that stores the program and the hard disk included in the storage unit 202 are distributed to the administrator.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

  The embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology.

  DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus, 11 Image pick-up unit, 12 Editing part, 201 Control part, 202 Storage part, 282 Image pick-up processing part, 283 Edit processing part, 284 Print processing part, 285 Subsequent customer service part

Claims (7)

A detection unit that acquires a captured image of a subject and detects the number of subjects from the captured image;
A processing unit that performs image processing for each detected subject when two or more subjects are detected by the detection unit;
The processor is
An extraction unit for extracting a predetermined face area for each of a plurality of subjects from the captured image;
For each of a plurality of predetermined face areas extracted by the extraction unit, correction is performed so that at least one of the colors or brightness in the area becomes a color set for each of the predetermined face areas. An image processing apparatus comprising: The image processing according to claim 1, wherein the extraction unit extracts an area including any of a forehead, a cheek, and a chin area excluding an eye, nose, and mouth area as the predetermined face area. apparatus. The correction unit calculates an average value of the luminance values in the extracted face area, and the average value in the face area is set to a value close to the luminance value related to the set color. The image processing apparatus according to claim 1, wherein the color is corrected. The extraction unit extracts at least one of eye, nose, and mouth regions as the predetermined face region from the captured image,
The correction unit further corrects at least one of a color, a position, and a size with respect to at least one of the extracted eye, nose, and mouth regions. Image processing apparatus. A shooting unit for performing a shooting operation with the user as the subject;
An editing unit for performing editing work for inputting editing information on the image of the user obtained by the shooting work;
An output unit for printing the obtained image of the edited user on a predetermined sticker sheet, discharging the printed sticker sheet, and providing the user as a photo sticker;
The detection unit acquires the image of the user obtained by the shooting operation of the shooting unit as the shot image,
The image processing apparatus according to claim 1, wherein the captured image processed by the processing unit is an image to be edited by the editing unit. Obtain a photographed image of the subject, detect the number of subjects from the photographed image,
A step of performing image processing for each detected subject when two or more subjects are detected;
The step of performing the image processing includes:
Extracting a predetermined face area for each of a plurality of subjects from the captured image,
Correcting for each of a plurality of extracted predetermined face areas so that at least one of the colors or brightness in the area becomes a color set for each of the predetermined face areas Image processing method. Obtain a photographed image of the subject, detect the number of subjects from the photographed image,
A step of performing image processing for each detected subject when two or more subjects are detected;
The step of performing the image processing includes:
Extracting a predetermined face area for each of a plurality of subjects from the captured image,
Correcting for each of a plurality of extracted predetermined face areas so that at least one of the colors or brightness in the area becomes a color set for each of the predetermined face areas A program that causes a computer to execute processing.

Images