JP6376421B1 - Photo creation game machine, display method, and program - Google Patents

Abstract

An image desired by a user is provided. A shooting processing unit acquires a shot image by shooting a user, a display control unit displays the shot image on a screen, and a recognition unit recognizes at least a part of the face in the shot image. The image processing unit performs image processing on a part of the face recognized in the captured image. Part of the face is a pair of face parts, and the display control unit displays a photographed image that has been subjected to image processing on only one of the face parts in response to a user operation on the screen. The present technology can be applied to a photo sticker creating apparatus. [Selection] Figure 14

Description

  The present technology relates to a photo creation game machine, a display method, and a program, and more particularly, to a photo creation game machine, a display method, and a program that can provide an image desired by a user.

  Conventionally, a photo sticker installed in an amusement facility or the like is known. The photo sticker machine photographs a user and edits the photographed image according to the user's operation. The photo sticker prints the edited photographed image on sticker paper.

  In recent photo stickers, image processing is performed to better show the user's own face in a captured image.

  For example, in Patent Document 1, by letting a user select the size of an eye, an image that sets the size of a person's eye in all captured images obtained by shooting to the size of the selected eye. Processing is disclosed.

  However, when a user winks (closes one eye) in the captured image, when image processing is performed to change the size of the eyes, the shape of the eyes is changed. There was a risk of unnatural shapes unintended by the user.

  On the other hand, in Patent Document 2, based on the extracted eye contour point, the length in the vertical direction with respect to the length in the horizontal direction of the eye is calculated, and when the value is smaller than a predetermined value, It is disclosed that the above-described image processing is not performed on the assumption that the user is winking.

JP2013-55625A JP-A-2015-163924

  By the way, in the image processing performed on the eyes of a person shown in a photographed image, both eyes have been processed. For this reason, even when image processing is normally performed, there is a possibility that only one eye may have an uncomfortable finish depending on how the eyes are reflected depending on the face orientation, how the eyes are opened at the shooting timing, and the like.

  The present technology has been made in view of such a situation, and makes it possible to provide an image desired by a user.

The photo creation game machine of the present technology recognizes at least a part of a face in the captured image, a shooting processing unit that acquires a captured image by shooting a user, a display control unit that displays the captured image on a screen, and A recognition unit that performs image processing on a part of the face recognized in the captured image, wherein the part of the face is a pair of face parts, and the display control unit Includes a first release button for releasing the image processing applied to one of the facial parts, and the other of the facial parts, in addition to the captured image obtained by performing the image processing on both of the facial parts. A second cancel button for canceling the image processing applied to the screen is displayed on the screen, and when the first cancel button is operated, the image processing unit includes the facial part in the photographed image. The image applied to one of the Releasing the processing, when the second release button is operated, in the captured image, to release the image processing performed on the other of the face parts.

In the display method of the present technology, a photo creation game machine captures a captured image by capturing a user, a display processing unit that displays the captured image on a screen, and at least a face of the captured image. A recognition unit that recognizes a part, and an image processing unit that performs image processing on a part of the face recognized in the captured image, wherein the part of the face is a pair of face parts, In addition to the captured image in which the image processing is performed on both of the face parts , the display control unit includes a first release button for canceling the image processing performed on one of the face parts, When a second release button for releasing the image processing applied to the other face part is displayed on the screen, and the image processing unit operates the first release button, in the captured image , Apply to one of the face parts Releasing the image processing that, when the second release button is operated, in the captured image, to release the image processing performed on the other of the face parts.

The program of the present technology recognizes at least a part of a face in the photographed image, a photographing processing unit that obtains a photographed image by photographing a user, a display control unit that displays the photographed image on a screen, and the like. And a program for causing a part of the face recognized in the captured image to function as an image processing unit, wherein the part of the face is a pair of face parts. And the display control unit includes a first release button for releasing the image processing applied to one of the facial parts, in addition to the captured image subjected to the image processing applied to both of the facial parts. A second release button for releasing the image processing applied to the other of the face parts is displayed on the screen, and the image processing unit is configured to display the shooting when the first release button is operated. On the image There are, to release the image processing that has been subjected to one of the face parts, when the second release button is operated, in the captured image, to release the image processing performed on the other of said face parts It is a program.

In the present technology, a photographed image is acquired by photographing a user, the photographed image is displayed on a screen, at least a part of a face is recognized in the photographed image, and the face recognized in the photographed image is detected. Image processing is performed on a part of the face, and part of the face is a pair of face parts. In addition to the captured image on which the image processing is applied to both of the face parts, one of the face parts A first release button for canceling the image processing applied to the image and a second release button for canceling the image processing applied to the other of the face parts are displayed on the screen. When the 1 release button is operated, the image processing applied to one of the face parts is canceled in the photographed image, and when the second release button is operated, the face is displayed in the photographed image. Of parts The image processing performed towards is released.

  According to the present technology, an image desired by a user can be provided.

It is a perspective view which shows the structural example of the external appearance of the photo sticker production apparatus of this technique. It is the perspective view which looked at the external appearance of the photograph sticker production apparatus from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of a preselection part. It is a figure which shows the structural example of an imaging | photography part. It is a figure which shows the structural example of a background part. It is a perspective view which shows a flooring. It is a figure which shows the structural example of the front of an edit unit. It is a figure which shows the structural example of the side surface of an edit unit. It is a figure which shows the example of a sticker paper. It is a figure which shows the example of a layer structure of an edit image. It is a block diagram which shows the structural example of a photograph sticker production apparatus. It is a block diagram which shows the function structural example of a photograph sticker production apparatus. It is a block diagram which shows the function structural example of an edit process part. It is a flowchart explaining a photograph sticker creation game process. It is a flowchart explaining an edit process. It is a figure which shows the example of a retouch screen. It is a flowchart explaining a retouch OFF process. It is a figure which shows the example of an edit screen. It is a figure explaining the display of the frame which shows a process target. It is a figure explaining the display of the frame which shows a process target. It is a figure which shows the other example of a retouch OFF selection area | region. It is a figure which shows the other example of a retouch OFF selection area | region. It is a figure which shows the other example of an edit screen. It is a figure explaining expansion of a whole-body image. It is a figure which shows the further another example of an edit screen. It is a flowchart explaining a retouch process. It is a figure which shows the further another example of an edit screen. It is a figure which shows the example of a face part. It is a figure which shows the further another example of an edit screen. It is a figure which shows the example of a division number selection screen. It is a figure which shows the example of a live view display screen. It is a figure which shows the example of an imaging | photography result display screen. It is a figure which shows the example of the display screen of a portable terminal.

<Appearance of photo sticker creation device>
FIG. 1 and FIG. 2 are perspective views showing a configuration example of the appearance of the photographic sticker creating apparatus 1.

  The photo sticker creating apparatus 1 is a game machine that provides a photographed image and an edited image. The photo sticker creating apparatus 1 provides an image to the user by printing the image on a sticker sheet or making the image viewable on the user's mobile terminal. The photo sticker creating apparatus 1 is installed in an amusement facility or a store such as a game center.

  The users of the photo sticker creating apparatus 1 are mainly high school girls and young women. In the photo sticker creating apparatus 1, a plurality of users such as two or three people can mainly enjoy the game per group. Of course, in the photo sticker creating apparatus 1, one user can enjoy the game.

  In the photo sticker creating apparatus 1, the user performs photographing work with himself / herself as a subject. The user synthesizes an image for synthesis such as a handwritten character or a stamp image with an image selected from the captured images obtained by shooting through an editing operation. As a result, the captured image is edited into a rich image. The user receives a sticker sheet on which an edited image that is an edited image is printed, and ends a series of games.

  The photo sticker creating apparatus 1 can be said to be a photo creating game machine that provides a photo creating game.

  As shown in FIG. 1, the photo sticker creating apparatus 1 is basically configured by being installed in a state where a photographing unit 11 and an editing unit 12 are in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected.

  The photographing unit 11 has a box-shaped housing having a size that allows a person to enter inside, and includes a pre-selection unit 20, a photographing unit 21, and a background unit 22. The pre-selection unit 20 is installed on the side surface of the imaging unit 21. The space ahead of the preselection unit 20 is a preselection space in which preselection processing is performed. In addition, the photographing unit 21 and the background unit 22 are set apart by a predetermined distance. A space formed between the imaging unit 21 and the background unit 22 is an imaging space in which imaging processing is performed.

  The pre-selection unit 20 performs guidance for introducing a game provided by the photo sticker creating apparatus 1 as pre-selection processing, and performs various settings in shooting processing performed in the shooting space. The pre-selection unit 20 is provided with a coin slot into which a user inserts a price, a touch panel monitor used for various operations, and the like. The pre-selection unit 20 guides the user in the pre-selection space to the shooting space as appropriate according to the availability of the shooting space.

  The photographing unit 21 is a device for photographing a user as a subject. The photographing unit 21 is located in front of the user who has entered the photographing space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the photographing unit 21 facing the photographing space.

  If the left side is the left side and the right side is the right side as viewed from the user facing the front in the imaging space, the left side of the imaging unit 21 is configured by the side panel 41A, and the right side is configured by the side panel 41B. Is done. Further, the front surface of the photographing unit 21 is constituted by a front panel 42. The pre-selection unit 20 described above is installed on the side panel 41A. The pre-selection unit 20 may be installed on the side panel 41B.

  The background portion 22 includes a back panel 51, a side panel 52A, and a side panel 52B. The back panel 51 is a plate-like member located on the back side of the user facing the front. The side panel 52A is a plate-like member attached to the left end of the back panel 51 and having a narrower width than the side panel 41A. The side panel 52B is a plate-like member that is attached to the right end of the back panel 51 and has a narrower width than the side panel 41B.

  The side panel 41A and the side panel 52A are provided on substantially the same plane. The upper portions of the side panel 41A and the side panel 52A are connected by a connecting portion 23A that is a plate-like member. The lower portions of the side panel 41A and the side panel 52A are connected by a connecting portion 23A 'that is a metal member provided on the floor surface. Similarly, the side panel 41B and the side panel 52B are provided on substantially the same plane. The upper portions of the side panel 41B and the side panel 52B are connected by a connecting portion 23B. The lower portions of the side panel 41B and the side panel 52B are connected by a connecting portion 23B '.

  A floor material 27, which is a plate-like member, is laid on the floor of the imaging space.

  For example, a green chroma key sheet is attached to the surface of the rear panel 51 on the photographing space side. The photo sticker creating apparatus 1 performs chroma key composition in photographing processing and editing processing by photographing a chroma key sheet as a background. As a result, a desired background image is synthesized with the background portion of the user in which the sheet is reflected.

  An opening formed by being surrounded by the side panel 41A, the connecting portion 23A, and the side panel 52A serves as an entrance / exit of the imaging space. An opening formed by being surrounded by the side panel 41B, the connecting portion 23B, and the side panel 52B also serves as an entrance / exit of the imaging space.

  A ceiling surrounded by the front surface of the photographing unit 21, the connecting portion 23A, and the connecting portion 23B is formed above the photographing space. A ceiling strobe unit 24 is provided in a part of the ceiling. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B.

  The ceiling strobe unit 24 has a built-in strobe that emits light toward the photographing space in accordance with photographing. In addition to the strobe, a fluorescent lamp is provided inside the ceiling strobe unit 24. Thereby, the ceiling strobe unit 24 also functions as illumination of the photographing space.

  The editing unit 12 is a device for editing a captured image. The editing unit 12 is connected to the photographing unit 11 such that one side surface is in contact with the front panel 42 of the photographing unit 21.

  If the configuration of the editing unit 12 shown in FIG. 1 is a front side configuration, a configuration used for editing work is provided on each of the front side and the back side of the editing unit 12. With this configuration, two sets of users can perform editing work simultaneously.

  The front side of the editing unit 12 includes a surface 61 and a slope 62 formed above the surface 61. The surface 61 is a surface perpendicular to the floor surface and substantially parallel to the side panel 41A of the photographing unit 21. The slope 62 is provided with a tablet built-in monitor and a touch pen as a configuration used for editing work. On the left side of the slope 62, a columnar support portion 63A that supports one end of the lighting device 64 is provided. A columnar support portion 63B that supports the other end of the lighting device 64 is provided on the right side of the slope 62. A support portion 65 that supports the curtain rail 26 is provided on the upper surface of the support portion 63A.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C. The three rails 26A to 26C are combined so that the shape when viewed from above becomes a U-shape. One end of the rail 26A and the rail 26B provided in parallel is fixed to the connecting portion 23A and the connecting portion 23B, respectively, and the other end of the rail 26A and the rail 26B is joined to both ends of the rail 26C.

  A curtain is attached to the curtain rail 26 so that the space in front of the editing unit 12 and the space in front of the back are not visible from the outside. A space in front of the editing unit 12 surrounded by the curtain and a space in the rear rear of the editing unit 12 are editing spaces in which the user performs editing operations.

  As will be described later, the left side surface of the editing unit 12 is provided with a discharge port through which printed sticker paper is discharged. The space in front of the left side surface of the editing unit 12 becomes a print waiting space where the user waits for the printed sticker paper to be discharged.

<About user movement>
Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described.

  FIG. 3 is a plan view of the photo sticker creating apparatus 1 as viewed from above.

  The user inserts money into the coin slot in the pre-selected space A0 that is the space in front of the pre-selecting unit 20. Next, the user performs various settings according to the screen displayed on the touch panel monitor. The user performs, for example, selection of a course related to shooting performed in the shooting space as a pre-selection operation.

  The user who has completed the pre-selection operation, as indicated by the white arrow # 1, has a shooting space A1 formed between the shooting unit 21 and the background unit 22 from the entrance G1 between the side panel 41A and the side panel 52A. to go into. A user performs a shooting operation using a camera or a touch panel monitor provided in the shooting unit 21.

  The user who has finished the shooting work exits the shooting space A1 from the doorway G1 as indicated by the white arrow # 2 and moves to the editing space A2-1, or the doorway G2 as indicated by the white arrow # 3. Exits the shooting space A1 and moves to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12. On the other hand, the editing space A2-2 is an editing space on the back side of the editing unit 12. Whether the user moves to the editing space A2-1 or the editing space A2-2 is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the free one of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing work. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing work at the same time.

  After the editing operation is finished, printing of the edited image is started. When printing is started, the user who has finished the editing work in the editing space A2-1 moves from the editing space A2-1 to the print waiting space A3 as indicated by a white arrow # 4. Further, the user who has finished the editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as indicated by the white arrow # 5.

  The user who has moved to the print waiting space A3 waits for the printing to end. When printing is completed, the user receives the sticker paper discharged from the discharge port provided on the right side of the editing unit 12 and finishes a series of photo sticker creation games.

  Next, the configuration of each device will be described.

<Configuration of preselection unit>
FIG. 4 is a diagram illustrating a configuration example of the preselection unit 20.

  A touch panel monitor 71 is provided above the preselection unit 20. The touch panel monitor 71 includes a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 71 has a function of displaying various GUIs (Graphical User Interfaces) and accepting a user's selection operation. The touch panel monitor 71 displays a screen used for selecting the number of users.

  A speaker 72 is provided below the touch panel monitor 71. The speaker 72 outputs guidance voice, BGM (Back Ground Music), sound effects, etc. for the pre-selection process. A coin insertion / return port 73 into which a user inserts coins is provided so as to be adjacent to the speaker 72.

<Configuration of the shooting unit>
FIG. 5 is a diagram illustrating a configuration example of the front of the photographing unit 21. The photographing unit 21 is configured to be surrounded by the side panel 41A, the side panel 41B, and the front panel 42.

  A camera unit 81 is provided slightly above the center of the front panel 42. In front of the camera unit 81, a camera 91, a touch panel monitor 92, and a front strobe 93 are provided.

  The camera 91 is a single-lens reflex camera, for example, and is attached inside the camera unit 81 so that the lens is exposed. The camera 91 includes an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and photographs a user in the photographing space A1. The camera 91 functions as a photographing unit that performs photographing using a user as a subject.

  A moving image (hereinafter also referred to as a live view image) captured by the camera 91 is displayed on the touch panel monitor 92 in real time. A still image captured by the camera 91 at a predetermined timing such as when shooting is instructed is saved as a captured image.

  The touch panel monitor 92 is provided below the camera 91. The touch panel monitor 92 includes a monitor such as an LCD and a touch panel laminated thereon. The touch panel monitor 92 has a function as a live view monitor that displays a moving image captured by the camera 91 and a function that displays various GUIs and accepts a user's selection operation.

  The front strobe 93 is provided above the camera 91. The front strobe 93 has a crescent-shaped light emitting surface made of a milky white acrylic plate. The front strobe 93 illuminates the vicinity of the user's face as a subject from the front by emitting light in accordance with shooting by the camera 91.

  Above the camera unit 81, an upper strobe unit 82 with a curved light emitting surface facing the user is installed. The upper strobe unit 82 irradiates light on the user's face and upper body from the upper front of the user.

  Below the camera unit 81, a foot strobe unit 83 that irradiates light to the lower body and feet of the user is provided.

  The upper strobe unit 82 and the foot strobe unit 83 are configured by a fluorescent lamp and an illumination device capable of strobe light emission. The upper strobe unit 82 and the foot strobe unit 83 illuminate the shooting space to ensure the user's operability and safety, and to constantly illuminate the shooting space and improve the image quality of the shot image. Strobe light is emitted at the shooting timing to illuminate the user who is the subject.

  A box-shaped portion 84 is provided between the foot strobe unit 83 and the side panel 41A. A box-shaped portion 85 is provided between the foot strobe unit 83 and the side panel 41B. The upper surfaces of the box-shaped portions 84 and 85 form a surface that is substantially horizontal to the installation surface of the photo sticker creating apparatus 1 and is used as a luggage storage place for a user who performs a photographing operation to place baggage.

  Although not shown, a speaker is provided near the ceiling of the front panel 42, for example. The speaker outputs shooting process guidance voice, BGM, sound effects, and the like.

<Configuration of background part>
FIG. 6 is a diagram illustrating a configuration example of the background portion 22 on the photographing space A1 side.

  Above the rear panel 51, a rear upper strobe 101 is installed. The rear upper strobe 101 irradiates the user with light from the upper rear side.

  In the drawing, a rear left strobe 102 is installed on the left side of the rear panel 51. The back left strobe 102 irradiates the user from the right side of the back. In the drawing, a rear right strobe 103 is installed on the right side of the rear panel 51. The rear right strobe 103 irradiates the user from the left rear side.

  A chroma key sheet 121 is attached to the surface of the rear panel 51 on the photographing space A1 side (the front side in the drawing). The color of the chroma key sheet 121 is, for example, green.

  Although not shown, a chroma key sheet is also attached to the lower side (floor side) of the surface of the side panels 52A and 52B on the photographing space A1 side in the same manner as the chroma key sheet 121.

  FIG. 7 is a perspective view showing the flooring 27. For convenience of explanation, illustration of the photographing unit 21, the side panel 41A, and the like is omitted.

  At a position closer to the rear of the flooring 27, a horizontally long rectangular floor sheet 27 </ b> A is attached so that its long side is substantially parallel to the back panel 51. In FIG. 7, the direction in which the rear panel 51 is located is the rear of the photographing space A1, and the direction in which the photographing unit 21 is indicated by the white arrow is the front of the photographing space A1.

  Mark figures 28-1 to 28-4 are printed side by side on the front side of the floor sheet 27A, and mark figures 28-5 to 28-8 are printed side by side behind them. The landmark figures 28-1 to 28-8 arranged in 2 rows × 4 columns are visually different figures, and the whole is painted black, for example.

  The mark figure 28-1 in the first line is a diamond-shaped mark, and the mark figure 28-2 is a heart-shaped mark. The mark figure 28-3 is a four-leaf clover type mark, and the mark figure 28-4 is a square mark.

  The mark figure 28-5 in the second row is a flower-shaped mark composed of four petals, and the mark figure 28-6 is a star-shaped mark. The mark figure 28-7 is a circular mark, and the mark figure 28-8 is a petal-like mark of a tulip.

  Each mark figure has a size that fits within a range of about 30 cm × 30 cm so that one user can put both feet on it. Each size may be different.

  The mark figures 28-1 to 28-8 are used as marks for guiding the standing position at the time of photographing for each user.

  For example, when the number of users is two and an image of a large upper body is taken, a four-leaf clover-type landmark figure 28-is used as the standing position of the user standing on the right side of the camera 91. 3 is designated, and a heart-shaped landmark figure 28-2 is designated as the standing position of the user standing on the left side.

  Each of the mark figures 28-1 to 28-8 is printed at a position where an optimum standing position can be designated according to the number of users, the angle of view (range) of the image to be taken, and the like. . Note that the optimal standing position means a position where the light from the strobe is sufficiently irradiated to the subject, a position that does not deviate from the shooting range of the camera 91, a position where the balance between the background and the face size is improved, and the like.

  As the mark figure, a figure with a color other than black, a figure with a predetermined pattern, or a figure with a color and a pattern may be used. It is also possible to change at least one of the shape, size, pattern, and color for each mark figure. The mark figures 28-1 to 28-8 shown in FIG. 7 are figures that are the same color as black, but have different shapes.

<Configuration of editing unit>
FIG. 8 is a diagram illustrating a configuration example of the editing unit 12 on the front side (editing space A2-1 side).

  A tablet built-in monitor 131 is provided in the approximate center of the slope 62. On the left side of the tablet built-in monitor 131, a touch pen 132A is provided. On the right side of the tablet built-in monitor 131, a touch pen 132B is provided.

  The tablet built-in monitor 131 is configured by stacking a tablet and a display. The tablet enables operation input using the touch pen 132A or the touch pen 132B. On the tablet built-in monitor 131, for example, an editing screen used for editing work is displayed. When two users perform editing work at the same time, the touch pen 132A is used by a user on the left side of the tablet built-in monitor 131, and the touch pen 132B is used by a user on the right side of the tablet built-in monitor 131. .

  The operation using the touch pen 132A and the operation using the touch pen 132B are distinguished. As appropriate, only the operation using the touch pen 132A is possible for the left side display of the tablet built-in monitor 131, and only the operation using the touch pen 132B is possible for the right side display. Hereinafter, when it is not necessary to distinguish the touch pen 132A and the touch pen 132B as appropriate, they are collectively referred to as the touch pen 132.

  FIG. 9 is a diagram illustrating a configuration example of the left side surface of the editing unit 12.

  A sticker paper discharge port 161 is provided below the left side surface of the editing unit 12. A printer is provided inside the editing unit 12. The printer prints an image showing the user of the editing space A2-1 or an image showing the user of the editing space A2-2 on a sticker sheet with a predetermined layout, and discharges it from the sticker paper outlet 161.

<Example of sticker paper>
FIG. 10 is a diagram illustrating an example of a sticker sheet created by the photographic sticker creator 1.

  For example, when there are two users, two sticker sheets on which photographs (edited images) are printed in a layout as shown in FIG. 10 are created and provided to the user. The layout shown in FIG. 10 is one of a plurality of layouts prepared, and the user can select a favorite layout.

  An edit image printing area 181A having a substantially business card size and a bonus image printing area 181B having a horizontally long strip shape are formed on one sticker sheet. The edited image 191-1 is printed largely in the left half of the edited image printing area 181A, and four edited images 191-2 to 191-5 are displayed on the right side of the edited image 191-1. X Printed in two rows.

  The edited images 191-1 to 191-5 are images generated by performing editing on the up image, which is an image in which the face and upper body of the subject are large. In practice, a background image that is an image of a predetermined color or pattern is appropriately combined with the background of the user, and a foreground image such as a handwritten character or a stamp image is combined with the foreground of the user.

  In the photographing process, in addition to the up image, photographing of a wide range from the top of the head to the vicinity of the knee (or the vicinity of the toes) is also performed. This image is used, for example, to leave a coordinate of the clothes. Hereinafter, an image having a wider shooting range than the up image, which is used to leave the coordinates of the clothes appropriately, is referred to as a whole body image.

  The up image and the whole body image have different aspect ratios. For example, the ratio between the horizontal length and the vertical length of the up image is 1: 1.2, and the ratio between the horizontal length and the vertical length of the whole-body image is 1: 1.5. Note that only the whole body image may not be printed on the sticker paper.

  In the bonus image printing area 181B, the captured images 192-1 to 192-5 trimmed in a simple shape similar to the mark figures 28-1 to 28-8 printed on the floor sheet 27A are printed side by side. The The image printed in the bonus image printing area 181B is cut out with scissors, for example.

  The edited image (the same image as the edited images 191-1 to 191-5) may be trimmed and printed as the captured images 192-1 to 192-5 instead of the image before editing.

  A seal ID or the like is printed in the margin of the bonus image print area 181B. The seal ID is used when an image transmitted from the photo sticker creating apparatus 1 to the server is viewed on a mobile terminal such as a smartphone.

  The transmission of the image to the portable terminal is performed via a server that manages an image acquisition site that is a Web site for taking (saving) the image transmitted from the photo sticker creating apparatus 1 into the portable terminal. Users can use images captured on mobile devices by posting them on SNS (Social Networking Service) or setting them as wallpaper. Hereinafter, the server that manages the image acquisition site is referred to as an image acquisition site management server as appropriate.

  FIG. 11 is a diagram illustrating an example of a layer structure of an edited image.

  The leftmost edited image P1 is an image generated by editing. The edited image P1 is composed of images of each layer of a background image P11, a person image P12, and a foreground image P13.

  In the example of FIG. 11, the background image P <b> 11 is an image of a wall pattern on which bricks are stacked. The foreground image P13 is an image including a handwritten character image of “Love my friend” and a heart-shaped image. The handwritten character image of “Love my friend” is a pen image input by the user using the pen tool. The heart-shaped image is a stamp image input by a user using a stamp tool.

  As described above, the edited image P1 is generated by superimposing the person image P12, which is an image of the person region extracted from the captured image by the chroma key process, on the background image P11 and superimposing the foreground image P13 thereon. It is also possible to input a pen image or a stamp image on the background image P11 and display it on the background of the subject. Foreground images and background images may be combined with the photographed image, and even after editing processing, it may not be combined depending on the operation of the user.

<Internal configuration of photo sticker creation device>
FIG. 12 is a block diagram illustrating a configuration example of the photo sticker creating apparatus 1. In FIG. 12, the same components as those described above are denoted by the same reference numerals. The overlapping description will be omitted as appropriate.

  As shown in FIG. 12, the photo sticker creating apparatus 1 has a PC (Personal Computer) unit 301 with a pre-selection unit 302, an imaging unit 304, editing units 305 </ b> A and 305 </ b> B, and a printing unit 306. It is configured by being connected via The PC unit 301 serving as an information processing unit is housed inside the casing of the editing unit 12, for example.

  A CPU (Central Processing Unit) 311, a ROM (Read Only Memory) 312, and a RAM (Random Access Memory) 313 that constitute the PC unit 301 are connected to each other via a bus 314.

  The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating apparatus 1. The ROM 312 stores programs and data executed by the CPU 311. The RAM 312 temporarily stores data and programs processed by the CPU 311.

  An input / output interface 315 is further connected to the bus 314. A storage unit 316, a communication unit 317, and a drive 318 are connected to the input / output interface 315.

  The storage unit 316 is a non-volatile storage medium such as a hard disk or a flash memory. The storage unit 316 stores various setting information supplied from the CPU 311. Information stored in the storage unit 316 is appropriately read out by the CPU 311.

  The communication unit 317 is a network interface such as the Internet. The communication unit 317 communicates with an external device according to control by the CPU 311. The communication unit 317 transmits the image selected by the user to, for example, an image acquisition site management server managed by the manufacturer of the photo sticker creating apparatus 1. The image transmitted from the communication unit 317 is allocated and stored with a predetermined storage area, and is displayed on a portable terminal that has accessed the image acquisition site management server or downloaded to the portable terminal.

  A removable medium 319 made of an optical disk, a semiconductor memory, or the like is appropriately attached to the drive 318. Programs and data read from the removable medium 319 by the drive 318 are supplied to the CPU 311 and stored in the storage unit 316 or installed.

  An external input / output interface 303 is connected to the input / output interface 315. Control of each unit by the PC unit 301 is performed via the external input / output interface 303.

  The preselection unit 302 realizes a preselection process for the user in the preselection space A0. The preselection unit 302 includes a touch panel monitor 71, a speaker 72, and a coin processing unit 321.

  The touch panel monitor 71 displays various selection screens according to control by the PC unit 301 and accepts user operations on the selection screens. An input signal representing the content of the user's operation is supplied to the PC unit 301 and various settings are performed.

  The coin processing unit 321 detects the insertion of coins into the coin insertion / return port 73. When the coin processing unit 321 detects that a predetermined amount of coins has been inserted, the coin processing unit 321 outputs an activation signal instructing the start of the game to the PC unit 301.

  The photographing unit 304 realizes photographing processing for a user in the photographing space A1. The photographing unit 304 includes a lighting device 331, a camera 91, a touch panel monitor 92, and a speaker 332.

  The illumination device 331 is each strobe unit in the imaging space A1, and emits light according to an illumination control signal supplied from the PC unit 301.

  The camera 91 shoots according to shutter control by the PC unit 301, and outputs a captured image (image data) obtained by the shooting to the PC unit 301.

  The editing unit 305A realizes editing processing for users in the editing space A2-1. The editing unit 305A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 341. The editing unit 305B realizes editing processing for users in the editing space A2-2, and has the same configuration as the editing unit 305A. Hereinafter, the editing units 305A and 305B are simply referred to as the editing unit 305 unless they are particularly distinguished.

  The tablet built-in monitor 131 displays an editing screen according to control by the PC unit 301 and accepts a user operation on the editing screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and the captured image to be edited is edited.

  The printing unit 306 is configured to include a printer 351. A sticker unit 352 is attached to the printer 351.

  The printer 351 drives the built-in head 361 and prints an image on a roll-shaped sticker sheet 363 stored in the sticker sheet unit 352 based on print data supplied from the PC unit 301. Further, the printer 351 cuts the sticker paper 363 on which an image is printed at a predetermined cutting position by the cutter 362 and discharges the sticker paper 363 to the sticker paper discharge port 161.

<Example of functional configuration of photo sticker creation device>
FIG. 13 is a block diagram illustrating a functional configuration example of the photo sticker creating apparatus 1. At least a part of the functional units shown in FIG. 13 is realized by the CPU 311 executing a predetermined program.

  In the photo sticker creating apparatus 1, a pre-selection processing unit 401, a photographing processing unit 402, an editing processing unit 403, and a print processing unit 404 are realized.

  The preselection processing unit 401 executes the preselection processing by controlling each unit of the preselection unit 302. By the pre-selection process, selection of the number of users, selection of a background image, and the like are performed. Information representing the content selected by the user is supplied to the imaging processing unit 402.

  The imaging processing unit 402 performs imaging processing by controlling each unit of the imaging unit 304. The imaging processing unit 402 outputs the captured image data obtained by performing the imaging process to the editing processing unit 403. Data of a plurality of photographed images obtained by performing photographing a plurality of times is supplied from the photographing processing unit 402 to the editing processing unit 403.

  The editing processing unit 403 performs editing processing by controlling each unit of the editing unit 305. The editing process includes a process of adjusting the shape and size of the user's eyes shown in the captured image, a process of editing the captured image, and the like.

  After finishing editing the captured image, the edit processing unit 403 generates print data by arranging the edited image in a predetermined layout, and outputs the print data to the print processing unit 404.

  The print processing unit 404 outputs print data to the printer 351 and prints an edited image.

<Configuration example of edit processing unit>
FIG. 14 is a block diagram illustrating a functional configuration example of the editing processing unit 403.

  The edit processing unit 403 includes a display control unit 431, a recognition unit 432, an image processing unit 433, an edit control unit 434, and a communication control unit 435.

  The display control unit 431 controls display on the tablet built-in monitor 131. For example, the display control unit 431 displays a selection screen for selecting a type of image processing to be performed on a face part to be described later on the captured image on the tablet built-in monitor 131 or an editing operation for the captured image. Display the edit screen.

  The recognition unit 432 recognizes a face or a part of the face by performing face recognition processing on the captured image. In the face recognition process, a contour point of a part to be recognized in a captured image is extracted, and it is determined whether or not a region connecting them is a face or a part of the face. Is recognized. Part of the face includes face parts such as eyes, nose, mouth (lips), and ears, as well as eyebrows, eyelashes, cheeks, chin, forehead, and hair. Note that the number of contour points to be extracted is arbitrary, and may be changed depending on a recognized part.

  The recognition unit 432 may recognize the face of the user by generating a person mask image from the distance image acquired by the distance image sensor, in addition to recognizing the face by the face recognition process. . In this case, for example, the position of the facial parts such as eyes, eyebrows, and eyelashes may be specified by specifying the hair region in the distance image.

  Further, the recognizing unit 432 identifies the eye region by extracting the color of the eye part (white and black), and determines the size of the face, the center point of the face, and the like from the position and size (area). The position of the face part may be estimated.

  The image processing unit 433 performs, on the captured image, the type of image processing selected by the user on the selection screen for the face part recognized by the recognition unit 432 in the captured image. In particular, in the present embodiment, the facial parts to be subjected to image processing are arranged on both the left and right (or top and bottom) of the face, such as eyes, eyebrows, eyelashes, lips and mouth corners, cheek contours, ears and nose. It is considered as a face part to make a pair.

  The edit control unit 434 edits the captured image in response to an operation on the edit screen. Specifically, the edit control unit 434 synthesizes the composition image selected by the user on the edit screen at a predetermined position of the captured image.

  The communication control unit 435 controls the communication unit 317 and performs processing related to communication via a network such as the Internet. For example, the communication control unit 435 controls the communication unit 317 to transmit a captured image obtained in the photographing process or an edited image obtained in the editing process to the above-described server.

<Operation of photo sticker creation device>
Here, with reference to the flowchart of FIG. 15, operation | movement of the photo sticker production apparatus 1 which provides a photo sticker production game is demonstrated.

  In step S1, the preselection processing unit 401 determines whether or not a predetermined amount of coins has been inserted based on an activation signal supplied from the coin processing unit 321 and waits until it is determined that coins have been inserted. To do.

  If it is determined in step S1 that a coin has been inserted, the process proceeds to step S2. In step S <b> 2, the preselection processing unit 401 performs the preselection process by controlling the preselection unit 302. Specifically, the pre-selection processing unit 401 is obtained as a course related to shooting performed in the shooting space by a number of courses for determining the type of game performed according to the number of users or shooting performed in the shooting space. Various settings are performed by allowing the user to select a background image as a background of the captured image.

  In step S <b> 3, the photographing processing unit 402 performs photographing processing by controlling the photographing unit 304. Specifically, the shooting processing unit 402 displays a moving image of the subject captured by the camera 91 on the touch panel monitor 92, captures a user in the shooting space A1 as a subject, and generates a shot image.

  In the shooting process of the present embodiment, a total of six shootings are performed. The six captured images obtained by the six capturing operations are subject to editing processing and printed on sticker paper, and can also be subject to transmission to a portable terminal.

  As six times of shooting, five times of up shooting and one time of whole body shooting are performed, but only six times of shooting may be performed as six times of shooting.

  The up-shooting is a shooting with the subject's face and upper body in the shooting range. By the up-shooting, an up-image that captures the face and upper body of the subject is obtained as a captured image. On the other hand, whole body imaging is imaging in which the entire body of the subject is captured. Whole body imaging provides a whole body image that shows the entire body of the subject as a captured image. In whole body photography, a whole body image showing the whole body of the subject viewed from diagonally above may be obtained, or a whole body image showing the whole body of the subject seen from the front may be obtained.

  In this way, six shot images are acquired in the shooting process.

  In step S4, the editing processing unit 403 controls the editing unit 305 corresponding to the editing space of the editing space A2-1 and the editing space A2-2 that is the destination of the user who has finished the shooting process. Then, edit processing is performed. Specifically, the editing processing unit 403 generates an edited image that has been edited by causing the user to perform an editing operation on the captured image obtained by the imaging process.

  In step S <b> 5, the print processing unit 404 performs (starts) print processing by controlling the printer 351. Specifically, the print processing unit 404 outputs the edited image obtained by the editing process to the printer 351 and prints it on a sticker sheet. Note that a photographed image obtained by the photographing process may be printed on sticker paper.

  When the printing is completed, in step S6, the printer 351 discharges the sticker paper on which the image is printed to the sticker paper discharge port 161, and ends the processing.

<Details of editing process>
Next, with reference to the flowchart of FIG. 16, the details of the editing process in step S4 in the series of processes of the photo sticker creation game described above will be described.

  When the editing process is started, in step S31, the display control unit 431 displays a retouch screen on the tablet built-in monitor 131.

  The retouch screen is a screen used for selecting the type of image processing to be performed on the face parts of the person shown in the photographed image.

  FIG. 17 is a diagram illustrating an example of a retouch screen.

  A captured image display area 511 is provided on the upper center side of the retouch screen. In the photographed image display area 511, one photographed image (for example, a photographed image obtained by the first photographing) is displayed.

  Three buttons 512a, 512b, and 512c are provided on the lower side of the retouch screen. The button 512a is a button for changing the shape of the eyes to a shape with a raised eye (cat eye), and the button 512b is a button for changing the shape of the eye to a shape with lowered eyes (sag). is there. Further, the button 512c is a button for making the shape of the eye an overall round shape (round eye).

  Specifically, when the button 512a is selected, the vicinity of each of the end points is such that the end points of the left eye corner and the right eye corner are moved upward by a predetermined distance with respect to the eye region. A process of locally expanding, reducing, or moving the area is performed.

  When the button 512b is selected, the regions near the end points are locally moved so that the end points of the left eye corner and the right eye corner are moved downward by a predetermined distance with respect to the eye region. A process of enlarging, reducing, or moving is performed.

  When the button 512c is selected, the upper endpoints of the left and right eyes are moved upward by a predetermined distance with respect to the eye region, and the lower endpoints of the left and right eyes are moved downward by a predetermined distance. As described above, processing for locally expanding, reducing, or moving the area in the vicinity of each end point is performed.

  When one of the buttons 512a, 512b, and 512c for selecting the eye shape is selected on the retouch screen, the image processing unit 433 changes the eye shape recognized by the recognition unit 432 to the selected button. Apply image processing to change to the corresponding eye shape. The captured image that has been subjected to image processing is displayed in a captured image display area 511.

  That is, each time the user operates any of the buttons 512a, 512b, and 512c, image processing corresponding to the button is performed on the captured image and displayed. However, the present invention is not limited to this, and a captured image that has been subjected to image processing for changing the shape of the eye to the shape of the eye corresponding to each button may be generated and stored in advance. In this case, every time one of the buttons 512a, 512b, and 512c is operated by the user, a captured image that has been subjected to image processing corresponding to the button is read out and displayed.

  Instead of image processing that changes the shape of the eyes, make-up images that show the shape of the eyes in the shape of cat eyes, saucers, and round eyes are prepared in advance, and makeup images corresponding to the selected buttons are prepared. A process of combining the eye area in the captured image may be performed.

  Here, it is assumed that the image processing corresponding to the selected button is performed on both eyes of all users regardless of the number of users appearing in the captured image. The image processing corresponding to the selected button is also performed on the other five captured images that are not displayed on the retouch screen.

  The user selects any one of the buttons 512a, 512b, and 512c and presses an OK button 513. As a result, the shape of the user's eyes appearing in the captured image is determined, and the process proceeds to step S32.

  In step S <b> 32, the display control unit 431 displays the mode selection screen while watching the tablet built-in monitor 131.

  The mode selection screen as it is viewed is a screen used for selecting whether or not the captured image is horizontally reversed. On the mode selection screen as it is seen, a button for selecting “No inversion” that does not flip the captured image left and right, and a state in which the user is reflected in the mirror by flipping the captured image left and right A button for selecting “with inversion” is displayed.

  When the “inverted” button is selected on the mode selection screen as it is seen, the image processing unit 433 performs image processing that horizontally inverts all captured images, and the process proceeds to step S33. When the “no inversion” button is selected, any captured image is not subjected to image processing for horizontally inversion.

  In step S33, the display control unit 431 displays an address input screen on the tablet built-in monitor 131.

  The address input screen is a screen used for inputting a mail address of a mobile terminal owned by the user. The address input screen displays an alphabet or symbol that can be used for the mail address, a button for selecting a carrier of the mobile terminal, and a text box that displays a character string corresponding to the selected button.

  When the input of the mail address is completed on the address input screen, the process proceeds to step S34.

  In step S34, the display control unit 431 displays an editing screen on the tablet built-in monitor 131.

  The editing screen is a screen used for editing a captured image to be edited. On the editing screen, a captured image to be edited and various editing tools (compositing images) such as a stamp image and a pen image used for editing are displayed.

  The user uses the touch pen 132 to superimpose a stamp image, a pen image, or the like at a predetermined position on the photographed image to be edited, thereby synthesizing the composition image with the photographed image to be edited.

  That is, in step S35, the edit control unit 434 edits the captured image to be edited in accordance with the user's operation.

  When the editing operation is completed, in step S36, the display control unit 431 displays a division number selection screen on the tablet built-in monitor 131.

  The division number selection screen is a screen used to select the number of divisions of sticker paper to be finally output and the sticker layout. The sticker layout is a layout (placement pattern) that determines the number, position, and size of an edited image (photographed image) placed on one sticker sheet. Here, an image in which an edited image is arranged in accordance with a sticker layout selected by the user, that is, an image that is finally printed on sticker paper and output is called a layout image. The sticker paper image representing the layout image is stored in the storage unit 316.

  Therefore, on the division number selection screen, for example, a plurality of layout images in which edited images obtained by editing each of six photographed images are arranged in different sticker layouts are displayed.

  When one of the layout images is selected on the division number selection screen, the process proceeds to step S37.

  In step S <b> 37, the display control unit 431 displays the portable transmission image selection screen on the tablet built-in monitor 131.

  The mobile transmission image selection screen is a screen used for selecting a mobile transmission image. The mobile transmission image is a photographed image that is displayed on the mobile terminal owned by the user or downloaded to the mobile terminal via the above-described image acquisition site management server. On the mobile transmission image selection screen, for example, six edited images after being edited and images dedicated to mobile transmission created on the editing screen are displayed. Note that the captured image before editing may be displayed on the portable transmission image selection screen instead of the edited image.

  When one of the images is selected as the portable transmission image on the portable transmission image selection screen, the process proceeds to step S38.

  In step S38, the communication control unit 435 controls the communication unit 317 so that the mobile transmission image selected by the user via the network such as the Internet is input to the address input screen by the user. Along with the address, it is sent to the image acquisition site management server.

  The image acquisition site management server transmits a mail describing a URL necessary for the mobile terminal to access the server to the mail address input by the user. Based on the URL, the mobile terminal owned by the user accesses the image acquisition site management server via the network, so that the image transmitted to the image acquisition site management server is provided to the mobile terminal.

  Thereafter, in step S39, the editing processing unit 403 guides the user who has finished the editing work to move to the print waiting space A3. The guidance for moving to the print waiting space A3 is performed by displaying a guidance screen on the tablet built-in monitor 131 of the editing unit 305 or by outputting sound from the speaker 341.

  The editing process is performed as described above.

<Retouch OFF processing>
As described above, in the editing process, image processing is performed in which the shape of the eyes of a person in all captured images obtained by shooting is changed to the shape of the eyes selected on the retouch screen. Further, in the editing process, the image processing for changing the shape of the eyes applied to the photographed image can be canceled by an operation on the editing screen.

  Therefore, in the following, retouch OFF processing for canceling image processing for changing the shape of an eye applied to a captured image will be described.

  FIG. 18 is a flowchart for explaining the retouch OFF process.

  In step S51, the display control unit 431 determines whether or not the retouch OFF button provided on the editing screen for canceling the image processing for changing the shape of the eye applied to the captured image is operated.

  Until the retouch OFF button is operated, the process of step S51 is repeated. If it is determined that the retouch OFF button has been operated, the process proceeds to step S52.

  In step S52, the image processing unit 433 cancels the image processing (here, the image processing applied to the eyes) performed on the face part.

  In step S53, the display control unit 431 displays the captured image from which the image processing has been canceled on the editing screen.

<Example of editing screen>
Here, the configuration of the editing screen will be described.

  The edit screen is basically configured by providing main components symmetrically. The left half area is an area used by a user on the left side of the tablet built-in monitor 131. The right half area is an area used by the user on the right side of the tablet built-in monitor 131. With such an editing screen configuration, mainly two users can simultaneously perform editing work.

  FIG. 19 shows a left half area (left half area) of the editing screen.

  A thumbnail display area 531 is provided at the upper center of the left half area. The thumbnail display area 531 is a display area for thumbnail images representing captured images. The user selects a captured image to be edited by selecting a thumbnail image displayed in the thumbnail display area 531.

  In the example of FIG. 19, thumbnail images representing six captured images are displayed side by side in the thumbnail display area 531.

  An edit area 532 is provided in the approximate center of the left half area. The editing area 532 is a display area for a captured image selected as an editing target. The user selects an editing tool using the touch pen 132 </ b> A and edits the captured image displayed in the editing area 532.

  An edit palette 533 is displayed below the left half area. The editing palette 533 is used to select various editing tools (composition images) such as pen images and stamp images.

  In the editing palette 533, each editing tool is prepared for each tab provided on the editing screen center side of the editing palette 533. The user switches the editing tool displayed on the editing palette 533 by selecting each tab. For example, a tab named “Pen” is a tab operated when selecting a pen image, and a tab named “Stamp” is operated when selecting a stamp image. It is a tab.

  A person selection area 534 and a retouch OFF area 535 are provided on the left side of the editing area 532.

  The person selection area 534 is a display area for a button for selecting a user who is a target of the retouch OFF process among users appearing in the captured image.

  Buttons 541 to 543 are displayed in the person selection area 534. The button 541 is a button for setting one of the two users shown in the photographed image (for example, the user shown on the left side) as a target for the retouch OFF process. The button 542 is a button for setting the other of the two users shown in the photographed image (for example, the user shown on the right side) as a target for the retouch OFF process. The button 543 is a button for setting two users appearing in the photographed image as targets for the retouch OFF process. Each of the buttons 541 and 542 displays a face image obtained by cutting out the face portion of the user to be subjected to the retouch OFF process from the photographed image.

  When the button 541 or 542 is operated, in the captured image displayed in the editing area 532, a frame indicating that it is a target for the retouch OFF process is displayed on the face portion of the user corresponding to the operated button. The In the example of FIG. 19, when the button 541 is operated, among the users shown in the captured image displayed in the editing area 532, the face portion of the user shown on the left side is the target of the retouch OFF process. A frame F534 is displayed.

  In this way, the user can specify a person who is the target of the retouch OFF process on the editing screen.

  Here, in the operation for the person selection area 534, a game for two users is provided as the number of courses selected in order to provide a game according to the number of users in the pre-selection process 2 It shall be valid when a human course is selected. When a couple course that provides a game for users of two men and women is selected, the operation on the person selection area 534 may be validated.

  Further, the frame F534 indicating that it is a target of the retouch OFF process is displayed only when two faces are detected by the face recognition process on the captured image.

  That is, the frame F534 is displayed when the two-person course (or couple course) is selected as the number-of-persons course, and two faces are detected by the face recognition process for the captured image.

  Even when two faces are detected by the face recognition process for the photographed image, when an adult course that provides a game for three or more users is selected as the number of people course, The frame F534 is not displayed, and all users appearing in the photographed image are targeted for the retouch OFF process.

  The retouch OFF area 535 is a display area of a button for selecting an eye that is a target of cancellation of image processing among eyes of a person (user) designated as a target of retouch OFF processing in the captured image.

  Buttons 551 to 553 are displayed in the retouch OFF area 535. The button 551 is a button for setting both eyes of a person designated as a target for the retouch OFF process to be a target for canceling the image processing. The button 552 is a button for setting the left eye of the eyes of the person designated as the target for the retouch OFF process to be the target for canceling the image processing. The button 553 is a button for setting the right eye among the eyes of the person designated as the target for the retouch OFF process to be the target for canceling the image processing.

  When the button 551 is operated, the image processing unit 433 performs image processing (an image that changes the shape of the eyes) applied to both eyes of the person designated as the target of the retouch OFF process in the captured image displayed in the editing area 532. Cancel processing. When the button 552 is operated, the image processing unit 433 cancels the image processing applied to the left eye of the person designated as the target of the retouch OFF process in the captured image displayed in the editing area 532. When the button 553 is operated, the image processing unit 433 cancels the image processing applied to the right eye of the person designated as the target of the retouch OFF process in the captured image displayed in the editing area 532.

  In this way, the retouch OFF process allows the user to perform the image processing applied to both the left and right eyes as well as one of the eyes in the captured image subjected to the image processing that changes the shape of the eyes. Only image processing can be canceled.

  The operation for the buttons 552 and 553 is effective when a course for two persons (or a couple course) is selected as the number of persons course in the pre-selection process. Therefore, when the adult course is selected as the number of people course, both eyes of all users appearing in the photographed image are targeted for cancellation of the image processing.

  According to the above processing, even if the image processing is performed depending on how the eyes are reflected by the orientation of the face, the opening timing of the shooting timing, etc. Image processing applied to one eye can be canceled. As a result, an image desired by the user can be provided.

  Note that the captured image that is the target of the retouch OFF process may be only the captured image displayed in the editing area 532, or all captured images including the captured image displayed in the editing area 532. Also good. In particular, when only the photographed image displayed in the editing area 532 is a photographed image to be subjected to the retouch OFF process, the user can adjust the finish of each photographed image with a high degree of freedom. Can do.

<About frame display>
In the photographed image in the editing area 532, the frame indicating that it is a target for the retouch OFF process is displayed on the left and right sides of the editing screen when different editing faces are displayed when the editing screen is initially displayed (default state). Is displayed.

  20 and 21 show examples of simplified editing screens.

  In the editing area 532L provided on the left side of the editing screen and the editing area 532R provided on the right side of the editing screen, different captured images are displayed. For example, in the default state of the editing screen, a captured image obtained by the first photographing is displayed in the editing area 532L, and a photographed image obtained by the second photographing is displayed in the editing area 532R. .

  For example, as shown in FIG. 20, in the editing area 532 </ b> L provided on the left side of the editing screen, among the users A and B that appear in the captured image, a frame is placed on the face portion of the user A that appears on the left side. F534L is displayed. On the other hand, in the editing area 532R provided on the right side of the editing screen, a frame F534R is displayed on the face portion of the user B shown on the right side among the users A and B shown on the captured image.

  Here, in the editing area 532R, the frame F534R is not simply displayed on the face portion of the right user of the two persons shown in the captured image. Specifically, the frame F534R is displayed in the face part of the user B different from the face of the user A in which the frame F534L is synthesized in the captured image of the editing area 532L by the face recognition process.

  Therefore, as shown in FIG. 21, the captured image in the editing area 532R is used even when the positions of the users A and B are switched in the left and right positions compared to the captured image in the editing area 532L. A frame F534R is displayed on the face of the user B who is not the face of the user A.

  Note that the frames F534L and F534R are displayed for each captured image selected as the editing target.

  These frames F534L and F534R may be displayed at all times from the default state of the editing screen until the editing operation is completed, or displayed on the designated user's face. May be displayed only until a predetermined time elapses.

<Modification>
Below, the modification of this Embodiment is demonstrated.

(From retouch OFF to retouch ON)
In the above description, when any button is operated in the retouch OFF area 535 of the editing screen, the image processing applied to both or one of the eyes corresponding to the button is cancelled.

  Furthermore, image processing may be performed again on both or one of the eyes whose image processing has been canceled in accordance with the user's further operation on the operated button.

  For example, as shown on the left side of FIG. 22, when the button 552 is operated in the retouch OFF area 535, the image processing applied to the left eye of the person designated as the target of the retouch OFF process is cancelled. At this time, the retouch OFF area 535 transitions to the display state shown on the right side of FIG.

  In the retouch OFF area 535 shown on the right side of FIG. 22, the expression “left eye only” is changed to “left eye ON”. When the button 552 is operated again in the state on the right side of FIG. 22, image processing for changing the shape of the eyes is performed again on the left eye whose image processing has been canceled.

  Also, as shown on the left side of FIG. 23, when the button 551 is operated in the retouch OFF area 535, the image processing applied to both eyes of the person designated as the target of the retouch OFF process is cancelled. At this time, the retouch OFF area 535 transitions to the display state shown on the right side of FIG.

  In the retouch OFF area 535 shown on the right side of FIG. 23, the notation “both eyes OFF” is changed to “both eyes ON”. When the button 551 is operated again in the state on the right side of FIG. 23, image processing for changing the shape of the eyes is performed again on both eyes whose image processing has been canceled.

  Thereby, the range of selection for the image processing of the user can be widened.

(Image processing selection timing)
In the above, the image processing (eye shape) for changing the eye shape is selected by the user on the retouch screen, but may be selected by the user on the edit screen.

  FIG. 24 is a diagram illustrating another example of the edit screen.

  In the editing screen of FIG. 24, a retouch palette 561 is provided between the person selection area 534 and the retouch OFF area 535.

  The retouch palette 561 is an area used for selecting the type of image processing to be performed on the facial parts of a person shown in a captured image, as in the retouch screen of FIG.

  The retouch palette 561 is provided with three buttons 571a, 571b, and 571c. The button 571a is a button for making the eye shape a cat eye, and the button 571b is a button for making the eye shape a saucer. In addition, the button 571c is a button for making the shape of the eye round.

  When any of the buttons 571a, 571b, and 571c for selecting the eye shape is selected in the retouch palette 561, the image processing unit 433 selects the eye shape recognized by the recognition unit 432 as the selected button. The image processing is performed to change the eye shape corresponding to. The captured image that has undergone image processing is displayed in the editing area 532.

  In the example of FIG. 24, the target of the image processing for changing the shape of the eyes is both two users appearing in the photographed image, but the user corresponding to the button operated in the person selection area 534 Also good.

  With such a configuration, the user can perform an editing operation while selecting the shape of a person's eyes that appear in the captured image, so that the entire captured image can be brought close to a desired finish.

  Furthermore, the image processing (eye shape) for changing the eye shape may be selected by the user on a screen displayed before shooting.

  For example, the shape of the eyes may be selected by the user on the course selection screen or background image selection screen displayed in the pre-selection process. In this case, a model image is displayed instead of a photographed image on the number of course selection screen and the background image selection screen, and the shape of the selected eye is reflected in the model image. As a result, the user can select the shape of the eye while confirming the model image.

(Retouch OFF operation)
In the above, the person who is the target of the retouch OFF process and the eye whose image process is to be canceled are selected by operating the buttons in the person selection area 534 and the retouch OFF area 535.

  However, the present invention is not limited to this, and the person who is the target of the retouch OFF process and the eye whose image process is to be canceled may be selected by a direct operation with the touch pen 132 on the editing area 532.

  For example, among the users appearing in the captured image displayed in the editing area 532, the left eye of the left user or an area in the vicinity thereof is pressed by the touch pen 132, and applied to the left user's left eye. Image processing is canceled.

  As shown on the left side of FIG. 25, when the captured image displayed in the editing area 532 is a whole body image, the area of the user's eyes for the entire image is smaller than the up image. Therefore, an enlargement button is provided at an arbitrary position on the editing screen, and when the enlargement button is pressed, the face (eye) portion that appears in the whole body image is displayed in the editing area 532 as shown on the right side of FIG. Enlarge the display. At this time, the face portion of each user recognized by the face recognition process for the whole body image may be an object to be enlarged and displayed.

  Thereby, even if it is a case where the image processing performed on the eyes of the person shown in the whole body image is canceled, the user can operate while easily confirming the state.

(Display of person to be retouched OFF)
In the above, the person who is the target of the retouch OFF process is indicated by the frame displayed in the captured image of the editing area 532, but the person is shown at a position different from the editing area 532 on the editing screen. An image may be further displayed.

  For example, as shown in FIG. 26, a trimming image 581 is displayed in the retouch OFF area 535 in addition to the buttons 551 to 553. The trimmed image 581 is, for example, a face image of a person (user) that is a target of the retouch OFF process, which is cut out from the captured image obtained by the first capturing. In the example of FIG. 26, the face image of the left user among the users shown in the captured image displayed in the editing area 532 is displayed as a trimmed image 581. Note that a character string of “selected” is displayed below the trimmed image 581.

  In the example of FIG. 26, each time the area of the trimmed image 581 is pressed by the touch pen 132, the face image displayed as the trimmed image 581 is switched, and the person who is the target of the retouch OFF process is switched.

  For example, in the state of FIG. 26, when the area of the trimmed image 581 is pressed with the touch pen 132, the face image of the right user among the users shown in the captured image displayed in the editing area 532 is the trimmed image. 581 is displayed. At this time, the person who is the target of the retouch OFF process is the user on the right side among the users shown in the captured image displayed in the editing area 532. In the example of FIG. 26, the person selection area 534 is not provided.

  In this state, when the region of the trimmed image 581 is pressed with the touch pen 132, the characters “two people at the same time” are displayed as the trimmed image 581. At this time, the persons to be subjected to the retouch OFF process are two users who appear in the captured image displayed in the editing area 532.

  Further, in this state, when the area of the trimmed image 581 is pressed with the touch pen 132, the face image of the left user among the users shown in the captured image displayed in the editing area 532 is displayed as the trimmed image 581. Is done. That is, returning to the state of FIG. 26, the above-described state is repeated each time the region of the trimmed image 581 is pressed by the touch pen 132.

  In the example of FIG. 26, a frame F534 indicating that the image is displayed in the editing area 532 is a target of retouch OFF processing is displayed. However, when the trimming image 581 is displayed, the frame F534 is displayed. F534 may not be displayed.

  The user confirms one of the frame F534 displayed on the captured image in the editing area 532 and the trimming image 581 displayed in the retouch OFF area 535, so that the person who is the target of the retouch OFF process. (User) can be recognized.

  When all users appearing in the captured image displayed in the editing area 532 are to be subjected to the retouch OFF process, the frame F534 is not displayed on each face portion.

  Specifically, when one of the two users shown in the captured image is a target for the retouch OFF process, a frame F534 is displayed on the face portion of the user. Then, when both of two users appearing in the photographed image are to be subjected to the retouch OFF process, the frame F534 is not displayed.

  Further, for example, when the frame F534 is displayed even when the number of users is three, when one or two of the three users are subjected to the retouch OFF process. The frame F534 is displayed on the face portion of the user. Then, when all three users appearing in the photographed image are to be subjected to the retouch OFF process, the frame F534 is not displayed.

<Retouch ON processing>
In the above, the retouch OFF processing for canceling the image processing for changing the eye shape applied to the photographed image has been described, but in the editing processing, the image processing for changing the eye shape to the photographed image by the operation on the editing screen is performed. You may make it give.

  Therefore, in the following, a retouch ON process for performing an image process for changing the shape of an eye on a captured image will be described.

  FIG. 27 is a flowchart illustrating the retouch ON process. The process of FIG. 27 is started at the timing when the editing screen is displayed, for example.

  In step S71, the recognition unit 432 recognizes a facial part in the captured image.

  In step S72, the display control unit 431 determines whether or not a button provided on the editing screen for selecting a type of image processing (here, eye shape) to be performed on the captured image is selected. .

  Until the button (image processing type) is operated, the process of step S72 is repeated. If it is determined that the button has been operated, the process proceeds to step S73.

  In step S <b> 73, the display control unit 431 determines whether or not a retouch ON button provided on the editing screen for performing image processing on the face part of the photographed image is operated.

  Until the retouch ON button is operated, the process of step S73 is repeated. If it is determined that the retouch ON button has been operated, the process proceeds to step S74.

  In step S74, the image processing unit 433 performs image processing (here, image processing for changing the shape of the eyes) on the face part.

  In step S75, the display control unit 431 displays the captured image on which image processing has been performed on the editing screen.

  FIG. 28 is a diagram illustrating an example of an edit screen that enables execution of the retouch ON process.

  28, a retouch palette 611 and a retouch ON area 621 are provided below the person selection area 534.

  The retouch palette 611 is an area used for selecting the type of image processing to be performed on a human face part shown in a captured image.

  The retouch palette 611 is provided with three buttons 621a, 621b, and 621c. The button 621a is a button for making the eye shape a cat eye, and the button 621b is a button for making the eye shape a saucer. Further, the button 621c is a button for making the shape of the eyes full.

  The retouch ON area 612 is a button display area for selecting an eye to be subjected to image processing among the eyes of a person (user) designated as a target for the retouch ON process in the captured image. A person to be subjected to the retouch ON process is designated by an operation on the person selection area 534.

  Buttons 631 to 633 are displayed in the retouch ON area 612. The button 631 is a button for setting both eyes of a person designated as a target of the retouch ON process as a target of the image processing. The button 632 is a button for setting the left eye among the eyes of the person designated as the target of the retouch ON process as the target of the image processing. The button 633 is a button for setting the right eye among the eyes of the person designated as the target of the retouch ON process as the target of the image processing.

  When the button 631 is operated, image processing (image processing for changing the shape of the eyes) is performed on both eyes of the person designated as the target of the retouch ON processing in the captured image displayed in the editing area 532. When the button 632 is operated, image processing is performed on the left eye of the person designated as the target of the retouch ON process in the captured image displayed in the editing area 532. When the button 633 is operated, image processing is performed on the right eye of the person designated as the target of the retouch ON process in the captured image displayed in the editing area 532.

  In this way, the retouch ON process allows the user to perform image processing on only one of both eyes as well as performing image processing on both the left and right eyes in the captured image.

  According to the above processing, even if the result is a feeling of strangeness due to the way the eyes are reflected by the orientation of the face or the degree of opening of the eyes at the shooting timing, image processing is performed only on the one eye that feels strange. Can do. As a result, an image desired by the user can be provided.

<Other examples of image processing>
In the above, the same type of image processing is applied to both the left and right eyes. For example, the left eye shape is a cat and the right eye shape is a saucer. The image processing may be performed.

  In the above, an example in which image processing for changing the shape of an eye recognized in a captured image has been described, but other image processing may be performed.

(Image processing that changes the size of the eyes)
Image processing for changing the size of the eyes recognized in the captured image may be performed.

  In this case, even if the size of the left and right eyes is different depending on how the eyes look according to the orientation of the face and how the eyes of the shooting timing are open, adjust the size of the left and right eyes. Can do. In particular, it is said that “the width of the face should be a width where five eyes are arranged side by side based on the width of the eyes”, so by adjusting the size of the eyes to achieve this, shooting The face in the image can be shown beautifully.

  For example, when the distance L1 between the left eye corner and the eye corner and the distance L2 between the right eye corner and the eye head are in a relationship of L1> L2, that is, when the right eye is smaller than the left eye, L2 becomes L1. As described above, processing for enlarging the right eye is performed. At this time, the enlargement ratio is set to L1 / L2 so that the right eye is enlarged.

  However, when the entire right eye is enlarged at such an enlargement ratio, it is enlarged not only in the left-right direction connecting the corner of the eye and the eye, but also in the vertical direction thereof. There is a risk that the balance of the thickness will deteriorate. Therefore, an upper limit may be set for the enlargement ratio, or the enlargement ratio in the vertical direction of the eyes may be lowered.

  In the above-described example, the enlargement ratio may be adjusted in steps by operating a plurality of enlargement / reduction buttons and sliders, or only while a predetermined area of the editing screen is being touched with the touch pen 132. The eyes may be enlarged.

(Image processing to change the eye position)
Image processing that changes the position of the eyes may be performed on the eyes recognized in the captured image.

  In this case, even if the balance of the left and right eye positions has deteriorated due to the way the eyes look according to the orientation of the face or the degree of eye opening at the shooting timing, the left and right eye positions should be adjusted appropriately. Can do. Further, by moving the position of the eyes toward the lower side of the face, the entire face looks small and a cute impression can be given. Furthermore, by moving the position of the eyes toward the upper side of the face, the entire face can be seen as a face length, and a half-faced impression can be given.

  For example, the touch pen 132 performs a process of changing the position of the eye by designating the eye area in the captured image displayed in the editing area 532 and dragging and dropping it. In addition, by providing a plurality of buttons indicating relative eye positions (for example, an upper position, an intermediate position, a lower position, etc.) in the entire face in an area different from the editing area 532, according to the operated button. The eye position may be changed so as to move to a different position.

<Other examples of facial parts>
In the above, the example in which the left and right eyes are subjected to image processing as the paired face parts has been described, but other face parts may be subjected to image processing.

(eyebrows)
As a pair of face parts, as shown in FIG. 29A, left and right eyebrows 641L and 641R may be subject to image processing.

  In this case, for example, the recognizing unit 432 recognizes the eyes in the captured image, and extracts a black region included in a region obtained by translating a line segment connecting the corners of the eyes and the eyes to the upper side of the face by a predetermined distance, Identify the eyebrow area.

  The eyebrow region recognized in the photographed image is subjected to image processing for changing the color of the eyebrows to, for example, brown or black.

  Further, image processing for changing the shape of the eyebrows and image processing for changing the thickness of the eyebrows may be performed on the eyebrows recognized in the captured image. According to the image processing for changing the shape of the eyebrows, the position of the top of the eyebrows near the center of the eyebrows and the length of the entire eyebrows from the eyebrows to the buttocks can be changed. Further, according to the image processing for changing the thickness of the eyebrows, the thickness of the entire eyebrows can be changed or the thickness of a part of the eyebrows can be changed.

(Eyelashes)
As a pair of face parts, as shown in FIG. 29B, left and right eyelashes 642L and 642R may be image processing targets.

  In this case, for example, the recognition unit 432 identifies the eyelash region by recognizing the eye in the captured image and extracting the black region near the contour point of the upper eyelid.

  The eyelash region recognized in the photographed image is subjected to image processing that changes the color of the eyelash. By darkening the color of the eyelashes (black), the eyes can be enlarged, the entire face can be made smaller, and a three-dimensional effect or a depth can be given to the eyes.

  In addition, it is good also considering the upper eyelash and lower eyelash of each of right and left eyes as a pair as face parts. In this case, it is possible to perform image processing to make the upper eyelash and the lower eyelash different in color (darkness).

(lips)
As a pair of face parts, as shown in FIG. 29C, the upper lip 643U and the lower lip 643D may be image processing targets.

  Image processing for changing the color of the lips to, for example, pink or red is performed on the lip area recognized in the captured image.

  Further, a process for synthesizing a makeup image imitating a lip and a gloss applied to the lips and an image process for changing the shape of the lips may be performed on the lip area recognized in the photographed image. For example, according to the process of synthesizing a makeup image imitating gloss only on the lower lip 663D, it is possible to give a cute impression that the lips are full. Further, according to the image processing for changing the shape of the lips, the lips can be made thicker or thinner.

  Furthermore, although not shown as a pair of face parts, the left and right mouth corners may be subject to image processing.

  In this case, the left and right mouth corner regions recognized in the captured image are subjected to image processing for moving the position in the vertical direction. As a result, the face reflected in the photographed image can be finished to a naturally smiling face.

(Contour)
As the face parts to be paired, the left and right contours of the face (contours from the chin to the cheek) may be image processing targets.

  Image processing for moving the position in the vertical direction is performed on the left and right contours of the face recognized in the captured image. When hair is applied to either the left or right contour of the face and the ear, the contour (particularly the cheek portion) that is not covered with hair may be visible. Therefore, by moving the contour of the hair that is not applied upward, it is possible to prevent the portion from being visible.

(ear)
As a pair of face parts, left and right ears may be subject to image processing.

  For example, image processing for changing the position and size of the ear is performed on the ear region recognized in the captured image.

(nose)
As a pair of face parts, the left and right holes of the nose may be subject to image processing.

  For example, image processing for reducing the left and right holes of the nose and image processing for adjusting the shapes of the left and right holes of the nose are performed on the nose region recognized in the captured image.

<Image processing to align left and right eye sizes>
In the above, image processing for changing the size of the eyes has been described as an example of image processing performed on the eyes recognized in the captured image. However, when the size of the left and right eyes is different, the editing screen is displayed. The image processing for aligning the size of the left and right eyes may be performed by the operation on.

  FIG. 30 is a diagram showing still another example of the editing screen.

  In the editing screen of FIG. 30, a “repair” button 661 is provided on the left side of the editing area 532.

  The “repair” button 661 is a button operated to make the size of the left and right eyes of the user shown in the photographed image the same.

  When the “repair” button 661 is operated, the image processing unit 433 performs image processing on the captured image so that the sizes of the left and right eyes are the same. Specifically, the image processing unit 433 calculates the length of a line segment that connects the corners of the left and right eyes and the corners of the recognized eye outline points. Then, the image processing unit 433 enlarges the size of the eye corresponding to the shorter line segment so that the shorter line segment has the same length as the longer line segment.

  In this way, even when the size of the left and right eyes is different, the user can perform image processing to make the size of the left and right eyes the same simply by operating the “repair” button 661. Will be given. The process of making the eyes the same size is performed when one area of the left and right eyes is touched with the touch pen 132 in the photographed image after the “repair” button 661 is operated. Also good.

  Note that the person who is the target of image processing in the captured image may be all users appearing in the captured image, or may be a person specified by the user's operation.

<Retouch OFF timing>
In the above description, the operation unit (retouch OFF area) for executing the retouch OFF process is displayed on the editing screen, but may be displayed on a screen displayed at a timing other than this. .

(Division number selection screen)
FIG. 31 is a diagram showing an example of the division number selection screen displayed in step S36 of the editing process (FIG. 16).

  The division number selection screen is configured as a layout selection screen for selecting a sticker layout of a layout image printed and output on sticker paper. On the division number selection screen, a tab display for classifying the seal layout (layout image) for each type is performed. The type of seal layout is determined by the number of divisions. That is, on the division number selection screen, a layout image is displayed by a tab for each division number.

  In the division number selection screen of FIG. 31, the “divided division” tab among the four tabs is selected, and the corresponding layout image is displayed. In the division number selection screen of FIG. 31, the main components are provided symmetrically. With such a screen configuration, two users can simultaneously select a layout image.

  In the division number selection screen of FIG. 31, a seal layout selection area 681L is provided below the left half area. The seal layout selection area 681L is an area where a plurality of layout images as options are displayed. In the example of FIG. 31, six layout images are displayed.

  A selected layout image 682L as a print image is displayed above the seal layout selection area 681L. The selected layout image 682L is a layout image selected in the sticker layout selection area 681L. In the example of FIG. 31, the selected layout image 682L is the upper left layout image surrounded by a thick frame in the sticker layout selection area 681L.

  An OK button 683L is provided below the seal layout selection area 681L.

  When the OK button 683L is selected, the selected layout image 682L displayed as the print image is determined as the layout image that is printed on the sticker paper and output.

  Further, on the left side of the selected layout image 682L, among the eyes of a person (user) designated in the captured image arranged in the selected layout image 682L, an eye for selecting an image processing release target is selected. A retouch OFF area 684L, which is a button display area, is provided. The retouch OFF area 684L has the same function as the retouch OFF area 535 in the editing screen of FIG.

  In the division number selection screen of FIG. 31, the right half area has a seal layout selection area 681R, a selected layout image 682R, an OK button 683R, and a retouch OFF at positions symmetrical to the respective configurations in the left half area. A region 684R is provided.

  As described above, by providing the retouch OFF area 684L (684R) on the division number selection screen, the user can select the eye for canceling the image processing while selecting the seal layout. It is possible to provide an image desired by the user.

(Screen displayed during shooting process)
The retouch OFF area is not limited to the screen displayed in the editing process, but may be displayed on the screen displayed in the shooting process.

  FIG. 32 is a diagram illustrating an example of a live view display screen displayed in the photographing process.

  An image display area 711 is provided in the approximate center of the live view display screen. In the image display area 711, a live view image showing two users is displayed in real time. The above-described image processing is performed on the eye area of the user shown in the live view image.

  Below the image display area 711, a button for selecting an eye that is a target of cancellation of image processing among eyes of a person (user) designated in the live view image displayed in the image display area 711. A retouch OFF area 712, which is a display area of, is provided. The retouch OFF area 712 has the same function as the retouch OFF area 535 in the editing screen of FIG.

  As described above, by providing the retouch OFF area 712 on the live view display screen, the user can select an eye for canceling the image processing while confirming the live view image. It is possible to provide a desired photographed image.

  FIG. 33 is a diagram illustrating an example of a photographing result confirmation screen displayed in the photographing process.

  An image display area 721 is provided substantially at the center of the photographing result confirmation screen. In the image display area 721, a photographed image obtained by photographing is displayed. The above-described image processing is performed on the eye area of the user that appears in the captured image.

  Below the image display area 721, a button for selecting an eye to be subjected to image processing cancellation among the eyes of a person (user) designated in the captured image displayed in the image display area 721. A retouch OFF area 722 which is a display area is provided. The retouch OFF area 722 has the same function as the retouch OFF area 535 in the editing screen of FIG.

  As described above, by providing the retouch OFF area 722 on the shooting result confirmation screen, the user can select an eye for canceling the image processing while checking the shot image as the shooting result, and thus more reliably. It is possible to provide a photographed image desired by the user.

  For example, the retouch OFF area 722 may be displayed only on the shooting result confirmation screen of the first shooting out of the six shootings. In this case, by preventing the retouch OFF area 712 from being displayed on the live view display screen in each shooting, the size of the image display area 711 on the live view display screen can be increased, and the visibility of the live view image can be increased. Can be improved. In addition, since the number of times of selecting the eye for canceling the image processing is only once, it is possible to concentrate the user on the shooting work that is often conscious, such as posing for each shooting and moving the standing position. it can.

<Processing on mobile terminal>
In the above description, the retouch OFF process is executed in the photo sticker creating apparatus 1, but may be executed in the user's portable terminal.

  In this case, the image to be processed may be an image transmitted from the photo sticker creating apparatus 1 to the mobile terminal, or may be an image taken by a camera built in the mobile terminal. .

  FIG. 34 is a diagram illustrating an example of a display screen of the mobile terminal.

  An image display unit 761 is provided in the approximate center of the portable terminal 751 shown in FIG. The image display unit 761 displays an image transmitted from the photo sticker creating apparatus 1 to the mobile terminal 751 and an image taken by a camera built in the mobile terminal 751. The above-described image processing is applied to the eye area of the person appearing in the image.

  Below the image display unit 761, a retouch that is a display region of a button for selecting an eye that is a target of image processing cancellation among the eyes of a person designated in the image displayed on the image display unit 761. An OFF area 762 is provided. The retouch OFF area 762 has the same function as the retouch OFF area 535 in the editing screen of FIG.

  As described above, the user can select the eye for canceling the image processing even in the mobile terminal, and thus can provide a captured image desired by the user more reliably.

  31 to 34, the example in which the retouch OFF area is provided has been described. However, a retouch ON area may be provided instead of the retouch OFF area, and the retouch ON process may be executed.

  31 to 34, the user to be processed may be directly designated (selected) by the touch pen 132 or the finger, or may be designated by the same configuration as the person selection area 534. It may be.

  In the above-described embodiment, the photo sticker creating apparatus 1 is configured to print the obtained photographed image or edited image on the sticker paper and to send it to the server by sending it to the server. . However, the present invention is not limited to this, and it is also possible to adopt a configuration in which a photographed image or an edited image is only provided to a user's mobile terminal by being transmitted to a server without being printed on sticker paper. On the contrary, it is possible to adopt a configuration in which the photographed image or the edited image is only printed on the sticker paper without being transmitted to the server.

  The series of processes described above can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 12, this recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the main body of the apparatus, and the magnetic disk on which the program is recorded ( A removable medium 319 including a flexible disk, an optical disk (including a CD-ROM and a DVD), a magneto-optical disk, or a semiconductor memory. In addition to these, the recording medium includes a ROM 312 in which a program distributed to an administrator in a state of being incorporated in the apparatus main body is recorded, a hard disk included in the storage unit 316, and the like.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  In the above, the printing medium is not limited to sticker paper or photographic paper. For example, an image may be printed on a predetermined size of paper or film, a card such as a prepaid card or an IC (Integrated Circuit) card, or a cloth such as a T-shirt. In this case, a sticker layout image in which one or a plurality of photographed images are arranged may be printed on these print media.

  The embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology.

DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus 401 Pre-selection process part 402 Image | photographing process part 403 Edit process part 404 Print process part 431 Display control part 432 Recognition part 433 Image process part 434 Edit control part 435 Communication control part

Claims (15)

A shooting processing unit that acquires a shot image by shooting a user;
A display control unit for displaying the captured image on a screen;
A recognition unit for recognizing at least a part of the face in the captured image;
An image processing unit that performs image processing on a part of the face recognized in the captured image,
A part of the face is a pair of face parts;
The display control unit includes a first release button for releasing the image processing applied to one of the facial parts, in addition to the captured image subjected to the image processing applied to both of the facial parts, A second release button for releasing the image processing applied to the other face part is displayed on the screen;
The image processing unit
When the first release button is operated, in the captured image, the image processing applied to one of the face parts is canceled,
A photo creation game machine that cancels the image processing applied to the other face part in the captured image when the second release button is operated . The display control unit displays the first screen for performing the image processing on both of the facial parts in the captured image, and then adds the captured image to which the image processing has been performed on both of the facial parts. , Displaying a second screen having the first release button and the second release button,
The image processing unit
In response to the user's operation on the first screen, the image processing is performed on both of the facial parts in the captured image,
When the first release button is operated on the second screen, the image processing applied to one of the face parts is canceled in the captured image,
If the second release button in the second screen is operated, the in the photographing image, photograph creation game machine according to claim 1 for releasing the image processing performed on the other of the face parts. The image processing unit is configured to detect one or the other of the facial parts for which the image processing has been canceled in the photographed image in response to the user's further operation on the first or second release button on the second screen. The photo creation game machine according to claim 2 , wherein the image processing is performed. When the image processing unit includes a plurality of persons in the captured image,
When the first release button is operated, the image processing applied to one of the facial parts of the person designated by the user in the captured image is released,
When the second release button is operated, in the captured image, in any one of claims 1 to 3 for releasing the image processing performed on the other of said face parts of the designated person by the user The described photo creation game machine. The display control unit performs the image processing on both the photographed image obtained by performing the image processing on one or the other of the facial parts and the facial part in accordance with an operation of the user on the screen. photography game machine according to any of claims 1 to 4 for displaying by switching between the captured images. The image processing photography game machine according to any of claims 1 to 5, which is a process of changing the eye shape as the face parts. The image processing photography game machine according to any of claims 1 to 5, which is a process of changing the size of the eye as the face parts. The image processing photography game machine according to any of claims 1 to 5, which is a process of changing the position of the eyes as the face parts. The image processing photography game machine according to any of claims 1 to 5, which is a process of changing the color of eyebrow as the face parts. The image processing photography game machine according to any of claims 1 to 5, which is a process of changing the shape of the eyebrow as the face parts. The photo creation game machine according to any one of claims 1 to 5 , wherein the image processing is processing for changing a density of eyelashes as the face part. The image processing photography game machine according to any of claims 1 to 5, which is a process of changing the color of the lips as the face parts. The image processing photography game machine according to any of claims 1 to 5, which is a process of changing the shape of the lips as the face parts. A photo creation game machine
A shooting processing unit that acquires a shot image by shooting a user;
A display control unit for displaying the captured image on a screen;
A recognition unit for recognizing at least a part of the face in the captured image;
An image processing unit that performs image processing on a part of the face recognized in the captured image,
A part of the face is a pair of face parts;
In addition to the captured image in which the image processing is performed on both of the face parts , the display control unit includes a first release button for canceling the image processing performed on one of the face parts, A second release button for releasing the image processing applied to the other face part is displayed on the screen;
The image processing unit
When the first release button is operated, in the captured image, the image processing applied to one of the face parts is canceled,
A display method for canceling the image processing applied to the other of the facial parts in the photographed image when the second release button is operated . Computer
A shooting processing unit that acquires a shot image by shooting a user;
A display control unit for displaying the captured image on a screen;
A recognition unit for recognizing at least a part of the face in the captured image;
A program for causing a part of the face recognized in the captured image to function as an image processing unit that performs image processing,
A part of the face is a pair of face parts;
The display control unit includes a first release button for releasing the image processing applied to one of the facial parts, in addition to the captured image subjected to the image processing applied to both of the facial parts, A second release button for releasing the image processing applied to the other face part is displayed on the screen;
The image processing unit
When the first release button is operated, in the captured image, the image processing applied to one of the face parts is canceled,
A program for canceling the image processing applied to the other face part in the photographed image when the second cancel button is operated .

Images