JP2018125764A - Photography creation game machine and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image of high satisfaction level more reliably.SOLUTION: A region specification section specifies a region becoming an image processing object in a captured image, an image processing section applies selected image processing to the specified region, by accepting selection of image processing applied to the specified region, and a region designation section accepts designation of a region including at least a part of the specified region to which the selected image processing is applied. The image processing section makes reselection of the image processing applied to the entire specified region acceptable according to the size of the designated region in a specific region, or makes reselection of the image processing applied to a region other than the designated region in the specific region acceptable. The technique is applicable to a photography seal creation device.SELECTED DRAWING: Figure 15

Description

  The present technology relates to a photo creation game machine and an image processing method, and more particularly, to a photo creation game machine and an image processing method capable of improving operability in editing work.

  Conventionally, a photo sticker installed in an amusement facility or the like is known. The photo sticker machine photographs a user and edits the photographed image according to the user's operation. The photo sticker prints the edited photographed image on sticker paper.

  Such a photo sticker usually has an eraser function for erasing part or all of a pen or stamp in a photographed image edited using a pen or stamp.

  On the other hand, there is a photographic sticker that provides an image with makeup on the user's face. For example, Patent Document 1 discloses a photo sticker creating apparatus that performs image processing for changing the color of a lip portion recognized in a captured image to a color selected by a user.

  In the technique as disclosed in Patent Document 1, there is a case where even a peripheral region other than the lips is recognized as a lip due to the relationship between the color of the lips and the color of the surrounding skin. As a result, the color of the area other than the lips is also changed to the color selected by the user.

  In this case, in order to improve the appearance of the image, the user erases the color of the region other than the lips by using the eraser function, but then selects another color as the lip color (reselection). ), The color of the region other than the lips is changed again to the color reselected by the user. Then, the user again erases the color of the area other than the lips using the eraser function.

  That is, in the case described above, in order to improve the appearance of the image, the user needs to erase the color of the extra portion by using the eraser function every time the lip color is selected.

  On the other hand, there is a photo sticker that does not reflect a color reselected afterwards in a portion where the color is erased by using the eraser function.

JP, 2014-131160, A

  By the way, in the above-described photo sticker, when the user erases the color of a necessary part by mistake, the color of the entire lips may be erased by using the eraser function. At this time, if there is any unerased color, the reselected color is reflected only in the unerased part.

  Normally, there are only a few unerased parts, so the user does not notice that the reselected color is reflected in that part, and the reselected color is not reflected in the entire lips. May be confused.

  As described above, the conventional eraser function has not always been highly operable.

  The present technology has been made in view of such a situation, and is intended to improve operability in editing work.

  The photo creation game machine of the present technology receives an area specifying unit that specifies an area to be subjected to image processing and a selection of the image processing applied to the specified specific area in a captured image obtained by shooting. An image processing unit that performs the selected image processing on the specific region; and an area specifying unit that receives a specification of a region including at least a part of the specific region on which the selected image processing has been performed. The image processing unit can accept reselection of the image processing applied to the entire specific area according to the size of the specified area specified in the specific area.

  The image processing method of the present technology is selected by specifying a region to be subjected to image processing in a captured image obtained by shooting and receiving the selection of the image processing applied to the specified specific region. Applying the image processing to the specific area, accepting designation of an area including at least a part of the selected specific area subjected to the image processing, and according to the size of the designated area specified in the specific area A step of accepting reselection of the image processing applied to the entire specific area.

  In the present technology, in the captured image obtained by shooting, an area to be subjected to image processing is specified, and the selected image processing is received by receiving selection of the image processing to be performed on the specified specific area. Is applied to the specific area, designation of an area including at least a part of the selected specific area on which the selected image processing has been performed is accepted, and according to the size of the designated area specified in the specific area The re-selection of the image processing applied to the entire specific area can be accepted.

  According to the present technology, operability in editing work can be improved.

It is a perspective view which shows the structural example of the external appearance of the photo sticker production apparatus of this technique. It is the perspective view which looked at the external appearance of the photograph sticker production apparatus from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of a preselection part. It is a figure which shows the structural example of an imaging | photography part. It is a figure which shows the structural example of a background part. It is a perspective view which shows a flooring. It is a figure which shows the structural example of the front of an edit unit. It is a figure which shows the structural example of the side surface of an edit unit. It is a figure which shows the example of a sticker paper. It is a figure which shows the example of a layer structure of an edit image. It is a block diagram which shows the structural example of a photograph sticker production apparatus. It is a block diagram which shows the function structural example of a photograph sticker production apparatus. It is a block diagram which shows the function structural example of an edit process part. It is a block diagram which shows the function structural example of an edit control part. It is a flowchart explaining a photograph sticker creation game process. It is a flowchart explaining an edit process. It is a figure which shows the example of an edit screen. It is a flowchart explaining a makeup process and an eraser process. It is a figure explaining the detail of an eraser function. It is a figure explaining the specific example of an area | region. It is a figure explaining the example of designation | designated of an area | region. It is a figure which shows the example of the locus | trajectory of a touch pen.

<Appearance of photo sticker creation device>
FIG. 1 and FIG. 2 are perspective views showing a configuration example of the appearance of the photographic sticker creating apparatus 1.

  The photo sticker creating apparatus 1 is a game machine that provides a photographed image and an edited image. The photo sticker creating apparatus 1 provides an image to the user by printing the image on a sticker sheet or making the image viewable on the user's mobile terminal. The photo sticker creating apparatus 1 is installed in an amusement facility or a store such as a game center.

  The users of the photo sticker creating apparatus 1 are mainly high school girls and young women. In the photo sticker creating apparatus 1, a plurality of users such as two or three people can mainly enjoy the game per group. Of course, in the photo sticker creating apparatus 1, one user can enjoy the game.

  In the photo sticker creating apparatus 1, the user performs photographing work with himself / herself as a subject. The user synthesizes an image for synthesis such as a handwritten character or a stamp image with an image selected from the captured images obtained by shooting through an editing operation. As a result, the captured image is edited into a rich image. The user receives a sticker sheet on which an edited image that is an edited image is printed, and ends a series of games.

  The photo sticker creating apparatus 1 can be said to be a photo creating game machine that provides a photo creating game.

  As shown in FIG. 1, the photo sticker creating apparatus 1 is basically configured by being installed in a state where a photographing unit 11 and an editing unit 12 are in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected.

  The photographing unit 11 has a box-shaped housing having a size that allows a person to enter inside, and includes a pre-selection unit 20, a photographing unit 21, and a background unit 22. The pre-selection unit 20 is installed on the side surface of the imaging unit 21. The space ahead of the preselection unit 20 is a preselection space in which preselection processing is performed. In addition, the photographing unit 21 and the background unit 22 are set apart by a predetermined distance. A space formed between the imaging unit 21 and the background unit 22 is an imaging space in which imaging processing is performed.

  The pre-selection unit 20 performs guidance for introducing a game provided by the photo sticker creating apparatus 1 as pre-selection processing, and performs various settings in shooting processing performed in the shooting space. The pre-selection unit 20 is provided with a coin slot into which a user inserts a price, a touch panel monitor used for various operations, and the like. The pre-selection unit 20 guides the user in the pre-selection space to the shooting space as appropriate according to the availability of the shooting space.

  The photographing unit 21 is a device for photographing a user as a subject. The photographing unit 21 is located in front of the user who has entered the photographing space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the photographing unit 21 facing the photographing space.

  If the left side is the left side and the right side is the right side as viewed from the user facing the front in the imaging space, the left side of the imaging unit 21 is configured by the side panel 41A, and the right side is configured by the side panel 41B. Is done. Further, the front surface of the photographing unit 21 is constituted by a front panel 42. The pre-selection unit 20 described above is installed on the side panel 41A. The pre-selection unit 20 may be installed on the side panel 41B.

  The background portion 22 includes a back panel 51, a side panel 52A, and a side panel 52B. The back panel 51 is a plate-like member located on the back side of the user facing the front. The side panel 52A is a plate-like member attached to the left end of the back panel 51 and having a narrower width than the side panel 41A. The side panel 52B is a plate-like member that is attached to the right end of the back panel 51 and has a narrower width than the side panel 41B.

  The side panel 41A and the side panel 52A are provided on substantially the same plane. The upper portions of the side panel 41A and the side panel 52A are connected by a connecting portion 23A that is a plate-like member. The lower portions of the side panel 41A and the side panel 52A are connected by a connecting portion 23A 'that is a metal member provided on the floor surface. Similarly, the side panel 41B and the side panel 52B are provided on substantially the same plane. The upper portions of the side panel 41B and the side panel 52B are connected by a connecting portion 23B. The lower portions of the side panel 41B and the side panel 52B are connected by a connecting portion 23B '.

  A floor material 27, which is a plate-like member, is laid on the floor of the imaging space.

  For example, a green chroma key sheet is attached to the surface of the rear panel 51 on the photographing space side. The photo sticker creating apparatus 1 performs chroma key composition in photographing processing and editing processing by photographing a chroma key sheet as a background. As a result, a desired background image is synthesized with the background portion of the user in which the sheet is reflected.

  An opening formed by being surrounded by the side panel 41A, the connecting portion 23A, and the side panel 52A serves as an entrance / exit of the imaging space. An opening formed by being surrounded by the side panel 41B, the connecting portion 23B, and the side panel 52B also serves as an entrance / exit of the imaging space.

  A ceiling surrounded by the front surface of the photographing unit 21, the connecting portion 23A, and the connecting portion 23B is formed above the photographing space. A ceiling strobe unit 24 is provided in a part of the ceiling. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B.

  The ceiling strobe unit 24 has a built-in strobe that emits light toward the photographing space in accordance with photographing. In addition to the strobe, a fluorescent lamp is provided inside the ceiling strobe unit 24. Thereby, the ceiling strobe unit 24 also functions as illumination of the photographing space.

  The editing unit 12 is a device for editing a captured image. The editing unit 12 is connected to the photographing unit 11 such that one side surface is in contact with the front panel 42 of the photographing unit 21.

  If the configuration of the editing unit 12 shown in FIG. 1 is a front side configuration, a configuration used for editing work is provided on each of the front side and the back side of the editing unit 12. With this configuration, two sets of users can perform editing work simultaneously.

  The front side of the editing unit 12 includes a surface 61 and a slope 62 formed above the surface 61. The surface 61 is a surface perpendicular to the floor surface and substantially parallel to the side panel 41A of the photographing unit 21. The slope 62 is provided with a tablet built-in monitor and a touch pen as a configuration used for editing work. On the left side of the slope 62, a columnar support portion 63A that supports one end of the lighting device 64 is provided. A columnar support portion 63B that supports the other end of the lighting device 64 is provided on the right side of the slope 62. A support portion 65 that supports the curtain rail 26 is provided on the upper surface of the support portion 63A.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C. The three rails 26A to 26C are combined so that the shape when viewed from above becomes a U-shape. One end of the rail 26A and the rail 26B provided in parallel is fixed to the connecting portion 23A and the connecting portion 23B, respectively, and the other end of the rail 26A and the rail 26B is joined to both ends of the rail 26C.

  A curtain is attached to the curtain rail 26 so that the space in front of the editing unit 12 and the space in front of the back are not visible from the outside. A space in front of the editing unit 12 surrounded by the curtain and a space in the rear rear of the editing unit 12 are editing spaces in which the user performs editing operations.

  As will be described later, the left side surface of the editing unit 12 is provided with a discharge port through which printed sticker paper is discharged. The space in front of the left side surface of the editing unit 12 becomes a print waiting space where the user waits for the printed sticker paper to be discharged.

<About user movement>
Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described.

  FIG. 3 is a plan view of the photo sticker creating apparatus 1 as viewed from above.

  The user inserts money into the coin slot in the pre-selected space A0 that is the space in front of the pre-selecting unit 20. Next, the user performs various settings according to the screen displayed on the touch panel monitor. The user performs, for example, selection of a course related to shooting performed in the shooting space as a pre-selection operation.

  The user who has completed the pre-selection operation, as indicated by the white arrow # 1, has a shooting space A1 formed between the shooting unit 21 and the background unit 22 from the entrance G1 between the side panel 41A and the side panel 52A. to go into. A user performs a shooting operation using a camera or a touch panel monitor provided in the shooting unit 21.

  The user who has finished the shooting work exits the shooting space A1 from the doorway G1 as indicated by the white arrow # 2 and moves to the editing space A2-1, or the doorway G2 as indicated by the white arrow # 3. Exits the shooting space A1 and moves to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12. On the other hand, the editing space A2-2 is an editing space on the back side of the editing unit 12. Whether the user moves to the editing space A2-1 or the editing space A2-2 is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the free one of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing work. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing work at the same time.

  After the editing operation is finished, printing of the edited image is started. When printing is started, the user who has finished the editing work in the editing space A2-1 moves from the editing space A2-1 to the print waiting space A3 as indicated by a white arrow # 4. Further, the user who has finished the editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as indicated by the white arrow # 5.

  The user who has moved to the print waiting space A3 waits for the printing to end. When printing is completed, the user receives the sticker paper discharged from the discharge port provided on the right side of the editing unit 12 and finishes a series of photo sticker creation games.

  Next, the configuration of each device will be described.

<Configuration of preselection unit>
FIG. 4 is a diagram illustrating a configuration example of the preselection unit 20.

  A touch panel monitor 71 is provided above the preselection unit 20. The touch panel monitor 71 includes a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 71 has a function of displaying various GUIs (Graphical User Interfaces) and accepting a user's selection operation. The touch panel monitor 71 displays a screen used for selecting the number of users.

  A speaker 72 is provided below the touch panel monitor 71. The speaker 72 outputs guidance voice, BGM (Back Ground Music), sound effects, etc. for the pre-selection process. A coin insertion / return port 73 into which a user inserts coins is provided so as to be adjacent to the speaker 72.

<Configuration of the shooting unit>
FIG. 5 is a diagram illustrating a configuration example of the front of the photographing unit 21. The photographing unit 21 is configured to be surrounded by the side panel 41A, the side panel 41B, and the front panel 42.

  A camera unit 81 is provided slightly above the center of the front panel 42. In front of the camera unit 81, a camera 91, a touch panel monitor 92, and a front strobe 93 are provided.

  The camera 91 is a single-lens reflex camera, for example, and is attached inside the camera unit 81 so that the lens is exposed. The camera 91 includes an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and photographs a user in the photographing space A1. The camera 91 functions as a photographing unit that performs photographing using a user as a subject.

  A moving image (hereinafter also referred to as a live view image) captured by the camera 91 is displayed on the touch panel monitor 92 in real time. A still image captured by the camera 91 at a predetermined timing such as when shooting is instructed is saved as a captured image.

  The touch panel monitor 92 is provided below the camera 91. The touch panel monitor 92 includes a monitor such as an LCD and a touch panel laminated thereon. The touch panel monitor 92 has a function as a live view monitor that displays a moving image captured by the camera 91 and a function that displays various GUIs and accepts a user's selection operation.

  The front strobe 93 is provided above the camera 91. The front strobe 93 has a crescent-shaped light emitting surface made of a milky white acrylic plate. The front strobe 93 illuminates the vicinity of the user's face as a subject from the front by emitting light in accordance with shooting by the camera 91.

  Above the camera unit 81, an upper strobe unit 82 with a curved light emitting surface facing the user is installed. The upper strobe unit 82 irradiates light on the user's face and upper body from the upper front of the user.

  Below the camera unit 81, a foot strobe unit 83 that irradiates light to the lower body and feet of the user is provided.

  The upper strobe unit 82 and the foot strobe unit 83 are configured by a fluorescent lamp and an illumination device capable of strobe light emission. The upper strobe unit 82 and the foot strobe unit 83 illuminate the shooting space to ensure the user's operability and safety, and to constantly illuminate the shooting space and improve the image quality of the shot image. Strobe light is emitted at the shooting timing to illuminate the user who is the subject.

  A box-shaped portion 84 is provided between the foot strobe unit 83 and the side panel 41A. A box-shaped portion 85 is provided between the foot strobe unit 83 and the side panel 41B. The upper surfaces of the box-shaped portions 84 and 85 form a surface that is substantially horizontal to the installation surface of the photo sticker creating apparatus 1 and is used as a luggage storage place for a user who performs a photographing operation to place baggage.

  Although not shown, a speaker is provided near the ceiling of the front panel 42, for example. The speaker outputs shooting process guidance voice, BGM, sound effects, and the like.

<Configuration of background part>
FIG. 6 is a diagram illustrating a configuration example of the background portion 22 on the photographing space A1 side.

  Above the rear panel 51, a rear upper strobe 101 is installed. The rear upper strobe 101 irradiates the user with light from the upper rear side.

  In the drawing, a rear left strobe 102 is installed on the left side of the rear panel 51. The back left strobe 102 irradiates the user from the right side of the back. In the drawing, a rear right strobe 103 is installed on the right side of the rear panel 51. The rear right strobe 103 irradiates the user from the left rear side.

  A chroma key sheet 121 is attached to the surface of the rear panel 51 on the photographing space A1 side (the front side in the drawing). The color of the chroma key sheet 121 is, for example, green.

  Although not shown, a chroma key sheet is also attached to the lower side (floor side) of the surface of the side panels 52A and 52B on the photographing space A1 side in the same manner as the chroma key sheet 121.

  FIG. 7 is a perspective view showing the flooring 27. For convenience of explanation, illustration of the photographing unit 21, the side panel 41A, and the like is omitted.

  At a position closer to the rear of the flooring 27, a horizontally long rectangular floor sheet 27 </ b> A is attached so that its long side is substantially parallel to the back panel 51. In FIG. 7, the direction in which the rear panel 51 is located is the rear of the photographing space A1, and the direction in which the photographing unit 21 is indicated by the white arrow is the front of the photographing space A1.

  Mark figures 28-1 to 28-4 are printed side by side on the front side of the floor sheet 27A, and mark figures 28-5 to 28-8 are printed side by side behind them. The landmark figures 28-1 to 28-8 arranged in 2 rows × 4 columns are visually different figures, and the whole is painted black, for example.

  The mark figure 28-1 in the first line is a diamond-shaped mark, and the mark figure 28-2 is a heart-shaped mark. The mark figure 28-3 is a four-leaf clover type mark, and the mark figure 28-4 is a square mark.

  The mark figure 28-5 in the second row is a flower-shaped mark composed of four petals, and the mark figure 28-6 is a star-shaped mark. The mark figure 28-7 is a circular mark, and the mark figure 28-8 is a petal-like mark of a tulip.

  Each mark figure has a size that fits within a range of about 30 cm × 30 cm so that one user can put both feet on it. Each size may be different.

  As will be described in detail later, the mark figures 28-1 to 28-8 are used as marks for guiding the standing position at the time of photographing for each user.

  For example, when the number of users is two and an image of a large upper body is taken, a four-leaf clover-type landmark figure 28-is used as the standing position of the user standing on the right side of the camera 91. 3 is designated, and a heart-shaped landmark figure 28-2 is designated as the standing position of the user standing on the left side.

  Each of the mark figures 28-1 to 28-8 is printed at a position where an optimum standing position can be designated according to the number of users, the angle of view (range) of the image to be taken, and the like. . Note that the optimal standing position means a position where the light from the strobe is sufficiently irradiated to the subject, a position that does not deviate from the shooting range of the camera 91, a position where the balance between the background and the face size is improved, and the like.

  As the mark figure, a figure with a color other than black, a figure with a predetermined pattern, or a figure with a color and a pattern may be used. It is also possible to change at least one of the shape, size, pattern, and color for each mark figure. The mark figures 28-1 to 28-8 shown in FIG. 7 are figures that are the same color as black, but have different shapes.

<Configuration of editing unit>
FIG. 8 is a diagram illustrating a configuration example of the editing unit 12 on the front side (editing space A2-1 side).

  A tablet built-in monitor 131 is provided in the approximate center of the slope 62. On the left side of the tablet built-in monitor 131, a touch pen 132A is provided. On the right side of the tablet built-in monitor 131, a touch pen 132B is provided.

  The tablet built-in monitor 131 is configured by stacking a tablet and a display. The tablet enables operation input using the touch pen 132A or the touch pen 132B. On the tablet built-in monitor 131, for example, an editing screen used for editing work is displayed. When two users perform editing work at the same time, the touch pen 132A is used by a user on the left side of the tablet built-in monitor 131, and the touch pen 132B is used by a user on the right side of the tablet built-in monitor 131. .

  The operation using the touch pen 132A and the operation using the touch pen 132B are distinguished. As appropriate, only the operation using the touch pen 132A is possible for the left side display of the tablet built-in monitor 131, and only the operation using the touch pen 132B is possible for the right side display. Hereinafter, when it is not necessary to distinguish the touch pen 132A and the touch pen 132B as appropriate, they are collectively referred to as the touch pen 132.

  FIG. 9 is a diagram illustrating a configuration example of the left side surface of the editing unit 12.

  A sticker paper discharge port 161 is provided below the left side surface of the editing unit 12. A printer is provided inside the editing unit 12. The printer prints an image showing the user of the editing space A2-1 or an image showing the user of the editing space A2-2 on a sticker sheet with a predetermined layout, and discharges it from the sticker paper outlet 161.

<Example of sticker paper>
FIG. 10 is a diagram illustrating an example of a sticker sheet created by the photographic sticker creator 1.

  For example, when there are two users, two sticker sheets on which photographs (edited images) are printed in a layout as shown in FIG. 10 are created and provided to the user. The layout shown in FIG. 10 is one of a plurality of layouts prepared, and the user can select a favorite layout.

  An edit image printing area 181A having a substantially business card size and a bonus image printing area 181B having a horizontally long strip shape are formed on one sticker sheet. The edited image 191-1 is printed largely in the left half of the edited image printing area 181A, and four edited images 191-2 to 191-5 are displayed on the right side of the edited image 191-1. X Printed in two rows.

  The edited images 191-1 to 191-5 are images generated by performing editing on the up image, which is an image in which the face and upper body of the subject are large. In practice, a background image that is an image of a predetermined color or pattern is appropriately combined with the background of the user, and a foreground image such as a handwritten character or a stamp image is combined with the foreground of the user.

  In the photographing process, in addition to the up image, photographing of a wide range from the top of the head to the vicinity of the knee is also performed. This image is used, for example, to leave a coordinate of the clothes. Hereinafter, an image having a wider shooting range than an up image, which is used to leave a coordinate of clothes as appropriate, is referred to as a coordinated image.

  The aspect ratio of the up image and the coordinated image is different. For example, the ratio between the horizontal length and the vertical length of the up image is 1: 1.2, and the ratio between the horizontal length and the vertical length of the coordinated image is 1: 1.5. In this example, the coordinated image is not printed on the sticker paper.

  In the bonus image printing area 181B, the captured images 192-1 to 192-5 trimmed in a simple shape similar to the mark figures 28-1 to 28-8 printed on the floor sheet 27A are printed side by side. The The image printed in the bonus image printing area 181B is cut out with scissors, for example.

  The edited image (the same image as the edited images 191-1 to 191-5) may be trimmed and printed as the captured images 192-1 to 192-5 instead of the image before editing.

  A seal ID or the like is printed in the margin of the bonus image print area 181B. The seal ID is used when an image transmitted from the photo sticker creating apparatus 1 to the server is viewed on a mobile terminal such as a smartphone.

  The transmission of the image to the portable terminal is performed via a server that manages an image acquisition site that is a Web site for taking (saving) the image transmitted from the photo sticker creating apparatus 1 into the portable terminal. Users can use images captured on mobile devices by posting them on SNS (Social Networking Service) or setting them as wallpaper. Hereinafter, the server that manages the image acquisition site is referred to as an image acquisition site management server as appropriate.

  FIG. 11 is a diagram illustrating an example of a layer structure of an edited image.

  The leftmost edited image P1 is an image generated by editing. The edited image P1 is composed of images of each layer of a background image P11, a person image P12, and a foreground image P13.

  In the example of FIG. 11, the background image P <b> 11 is an image of a wall pattern on which bricks are stacked. The foreground image P13 is an image including a handwritten character image of “Love my friend” and a heart-shaped image. The handwritten character image of “Love my friend” is a pen image input by the user using the pen tool. The heart-shaped image is a stamp image input by a user using a stamp tool.

  As described above, the edited image P1 is generated by superimposing the person image P12, which is an image of the person region extracted from the captured image by the chroma key process, on the background image P11 and superimposing the foreground image P13 thereon. It is also possible to input a pen image or a stamp image on the background image P11 and display it on the background of the subject. Foreground images and background images may be combined with the photographed image, and even after editing processing, it may not be combined depending on the operation of the user.

<Internal configuration of photo sticker creation device>
FIG. 12 is a block diagram illustrating a configuration example of the photo sticker creating apparatus 1. In FIG. 12, the same components as those described above are denoted by the same reference numerals. The overlapping description will be omitted as appropriate.

  As shown in FIG. 12, the photo sticker creating apparatus 1 has a PC (Personal Computer) unit 301 with a pre-selection unit 302, an imaging unit 304, editing units 305 </ b> A and 305 </ b> B, and a printing unit 306. It is configured by being connected via The PC unit 301 serving as an information processing unit is housed inside the casing of the editing unit 12, for example.

  A CPU (Central Processing Unit) 311, a ROM (Read Only Memory) 312, and a RAM (Random Access Memory) 313 that constitute the PC unit 301 are connected to each other via a bus 314.

  The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating apparatus 1. The ROM 312 stores programs and data executed by the CPU 311. The RAM 312 temporarily stores data and programs processed by the CPU 311.

  An input / output interface 315 is further connected to the bus 314. A storage unit 316, a communication unit 317, and a drive 318 are connected to the input / output interface 315.

  The storage unit 316 is a non-volatile storage medium such as a hard disk or a flash memory. The storage unit 316 stores various setting information supplied from the CPU 311. Information stored in the storage unit 316 is appropriately read out by the CPU 311.

  The communication unit 317 is a network interface such as the Internet. The communication unit 317 communicates with an external device according to control by the CPU 311. The communication unit 317 transmits the image selected by the user to, for example, an image acquisition site management server managed by the manufacturer of the photo sticker creating apparatus 1. The image transmitted from the communication unit 317 is allocated and stored with a predetermined storage area, and is displayed on a portable terminal that has accessed the image acquisition site management server or downloaded to the portable terminal.

  A removable medium 319 made of an optical disk, a semiconductor memory, or the like is appropriately attached to the drive 318. Programs and data read from the removable medium 319 by the drive 318 are supplied to the CPU 311 and stored in the storage unit 316 or installed.

  An external input / output interface 303 is connected to the input / output interface 315. Control of each unit by the PC unit 301 is performed via the external input / output interface 303.

  The preselection unit 302 realizes a preselection process for the user in the preselection space A0. The preselection unit 302 includes a touch panel monitor 71, a speaker 72, and a coin processing unit 321.

  The touch panel monitor 71 displays various selection screens according to control by the PC unit 301 and accepts user operations on the selection screens. An input signal representing the content of the user's operation is supplied to the PC unit 301 and various settings are performed.

  The coin processing unit 321 detects the insertion of coins into the coin insertion / return port 73. When the coin processing unit 321 detects that a predetermined amount of coins has been inserted, the coin processing unit 321 outputs an activation signal instructing the start of the game to the PC unit 301.

  The photographing unit 304 realizes photographing processing for a user in the photographing space A1. The photographing unit 304 includes a lighting device 331, a camera 91, a touch panel monitor 92, and a speaker 332.

  The illumination device 331 is each strobe unit in the imaging space A1, and emits light according to an illumination control signal supplied from the PC unit 301.

  The camera 91 shoots according to shutter control by the PC unit 301, and outputs a captured image (image data) obtained by the shooting to the PC unit 301.

  The editing unit 305A realizes editing processing for users in the editing space A2-1. The editing unit 305A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 341. The editing unit 305B realizes editing processing for users in the editing space A2-2, and has the same configuration as the editing unit 305A. Hereinafter, the editing units 305A and 305B are simply referred to as the editing unit 305 unless they are particularly distinguished.

  The tablet built-in monitor 131 displays an editing screen according to control by the PC unit 301 and accepts a user operation on the editing screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and the captured image to be edited is edited.

  The printing unit 306 is configured to include a printer 351. A sticker unit 352 is attached to the printer 351.

  The printer 351 drives the built-in head 361 and prints an image on a roll-shaped sticker sheet 363 stored in the sticker sheet unit 352 based on print data supplied from the PC unit 301. Further, the printer 351 cuts the sticker paper 363 on which an image is printed at a predetermined cutting position by the cutter 362 and discharges the sticker paper 363 to the sticker paper discharge port 161.

<Example of functional configuration of photo sticker creation device>
FIG. 13 is a block diagram illustrating a functional configuration example of the photo sticker creating apparatus 1. At least a part of the functional units shown in FIG. 13 is realized by the CPU 311 executing a predetermined program.

  In the photo sticker creating apparatus 1, a pre-selection processing unit 401, a photographing processing unit 402, an editing processing unit 403, and a print processing unit 404 are realized.

  The preselection processing unit 401 executes the preselection processing by controlling each unit of the preselection unit 302. By the pre-selection process, selection of the number of users, selection of a background image, and the like are performed. Information representing the content selected by the user is supplied to the imaging processing unit 402.

  The imaging processing unit 402 performs imaging processing by controlling each unit of the imaging unit 304. The imaging processing unit 402 outputs the captured image data obtained by performing the imaging process to the editing processing unit 403. Data of a plurality of photographed images obtained by performing photographing a plurality of times is supplied from the photographing processing unit 402 to the editing processing unit 403.

  The editing processing unit 403 performs editing processing by controlling each unit of the editing unit 305. The editing process includes a process of adjusting the size of the user's eyes and the brightness of the skin appearing in the photographed image, a process of editing the photographed image, and the like.

  The editing process in the game provided by the photo sticker creating apparatus 1 includes a process of generating a moving image using a captured image. This moving image is composed of frame images obtained by combining captured images, which are still images, and is a moving image with a short reproduction time such as 7 seconds.

  After the game is over, the user can access the image acquisition site management server, import the moving image into his / her mobile terminal, and post it to SNS for use. Hereinafter, a moving image generated using a photographed image is referred to as a portable mini video as appropriate.

  After finishing editing the captured image, the edit processing unit 403 generates print data by arranging the edited image in a predetermined layout, and outputs the print data to the print processing unit 404.

  The print processing unit 404 outputs print data to the printer 351 and prints an edited image.

<Configuration example of edit processing unit>
FIG. 14 is a block diagram illustrating a functional configuration example of the editing processing unit 403.

  The edit processing unit 403 includes a display control unit 431, an edit control unit 432, and a communication control unit 433.

  The display control unit 431 controls display on the tablet built-in monitor 131. For example, the display control unit 431 causes the tablet built-in monitor 131 to display a selection screen for selecting the degree of image processing to be performed on the captured image and an editing screen for editing work on the captured image.

  The edit control unit 432 edits the captured image in accordance with a user operation on the edit screen. For example, the editing control unit 432 adds graffiti to the photographed image by compositing a composition image (stamp image or pen image) selected by the user on the editing screen at a predetermined position of the photographed image.

  Further, the edit control unit 432 performs a makeup process on the captured image in accordance with a user operation on the edit screen. Makeup processing refers to image processing that changes a user's face in a captured image to a face that has undergone makeup (makeup).

  Furthermore, the edit control unit 432 implements an eraser function for erasing part or all of the contents of image processing such as graffiti and makeup processing applied to the photographed image in accordance with a user operation on the editing screen. Also, the edit control unit 432 returns the photographed image that has undergone editing such as graffiti or makeup processing to the previous state or the previous state according to the user's operation on the edit screen. Proceed or return to a state where no graffiti or makeup treatment has been applied.

  The communication control unit 433 controls the communication unit 317 and performs processing related to communication via a network such as the Internet. For example, the communication control unit 433 controls the communication unit 317 to transmit a captured image obtained in the photographing process or an edited image obtained in the editing process to the image acquisition site management server.

  Next, a functional configuration example of the editing control unit 432 will be described with reference to FIG.

  The edit control unit 432 includes an area specifying unit 451, an image processing unit 452, and an area specifying unit 453.

  The area specifying unit 451 specifies an area to be subjected to image processing in the captured image. For example, the area specifying unit 451 specifies an area including the entire face of a person shown in the photographed image, facial organs (face parts) such as lips, eyes, and nose, and a part of the face such as a cheek.

  The image processing unit 452 accepts selection of image processing to be performed on a region specified by the region specifying unit 451 (hereinafter, referred to as a specific region as appropriate), and performs the selected image processing on the specific region. For example, the image processing unit 452 accepts selection of makeup processing to be performed on the area of the specified facial part, and performs the selected makeup processing on that area.

  The area designating unit 453 accepts designation of an area including at least a part of the specific area subjected to the selected image processing. Specifically, the area designating unit 453 accepts designation of an area for erasing contents such as a given graffiti and a makeup process by an eraser function. For example, the area designating unit 453 accepts designation of a part of the area of the face part that has been subjected to the makeup process in accordance with a user operation on the editing screen.

  Further, the image processing unit 452 executes eraser processing for realizing an eraser function on the contents such as graffiti and makeup processing applied to the region designated by the region designating unit 453 (hereinafter referred to as designated region as appropriate). To erase. That is, the image processing unit 452 can accept a graffiti or makeup process applied again to the designated area designated by the area designating unit 453.

<Operation of photo sticker creation device>
Here, with reference to the flowchart of FIG. 16, operation | movement of the photo sticker production apparatus 1 which provides a photo sticker production game is demonstrated.

  In step S1, the preselection processing unit 401 determines whether or not a predetermined amount of coins has been inserted based on an activation signal supplied from the coin processing unit 321 and waits until it is determined that coins have been inserted. To do.

  If it is determined in step S1 that a coin has been inserted, the process proceeds to step S2. In step S <b> 2, the preselection processing unit 401 performs the preselection process by controlling the preselection unit 302. Specifically, the pre-selection processing unit 401 is obtained as a course related to shooting performed in the shooting space by a number of courses for determining the type of game performed according to the number of users or shooting performed in the shooting space. Various settings are performed by allowing the user to select a background image as a background of the captured image.

  In step S <b> 3, the photographing processing unit 402 performs photographing processing by controlling the photographing unit 304. Specifically, the shooting processing unit 402 displays a moving image of the subject captured by the camera 91 on the touch panel monitor 92, captures a user in the shooting space A1 as a subject, and generates a shot image.

  In step S4, the editing processing unit 403 controls the editing unit 305 corresponding to the editing space of the editing space A2-1 and the editing space A2-2 that is the destination of the user who has finished the shooting process. Then, edit processing is performed. Specifically, the editing processing unit 403 generates an edited image that has been edited by causing the user to perform an editing operation on the captured image obtained by the imaging process.

  In step S <b> 5, the print processing unit 404 performs (starts) print processing by controlling the printer 351. Specifically, the print processing unit 404 outputs the edited image obtained by the editing process to the printer 351 and prints it on a sticker sheet. Note that a photographed image obtained by the photographing process may be printed on sticker paper.

  When the printing is completed, in step S6, the printer 351 discharges the sticker paper on which the image is printed to the sticker paper discharge port 161, and ends the processing.

<Details of editing process>
Next, with reference to the flowchart of FIG. 17, the details of the editing process in step S4 in the series of processes of the photo sticker creation game described above will be described.

  When the editing process is started, in step S31, the display control unit 431 displays an eye size / brightness selection screen on the tablet built-in monitor 131.

  The eye size / brightness selection screen is a screen used to select the size of the user's eyes and the brightness of the skin in the captured image.

  When the eye size and the skin brightness are selected on the eye size / brightness selection screen, the process proceeds to step S32.

  In step S <b> 32, the display control unit 431 displays a name input screen on the tablet built-in monitor 131.

  The name input screen is a screen used for inputting a name by the user. On the name input screen, a button for selecting hiragana that can be used for inputting a name and a text box for displaying a character string corresponding to the selected button are displayed.

  When the input of the name is completed on the name input screen, the process proceeds to step S33.

  In step S <b> 34, the display control unit 431 displays an editing screen on the tablet built-in monitor 131.

  The editing screen is a screen used for editing a captured image to be edited. On the editing screen, a captured image to be edited, various editing tools (images for synthesis) such as a stamp image and a pen image used for editing, and a makeup tool described later are displayed.

  The user uses the touch pen 132 to superimpose a stamp image, a pen image, or the like at a predetermined position on the photographed image to be edited, thereby synthesizing the composition image with the photographed image to be edited.

  That is, in step S34, the editing control unit 432 edits the captured image to be edited in accordance with a user operation.

  When the editing operation is completed, in step S35, the display control unit 431 displays a division number selection screen on the tablet built-in monitor 131.

  The division number selection screen is a screen used to select the number of divisions of sticker paper to be finally output and the sticker layout. The sticker layout is a layout (placement pattern) that determines the number, position, and size of edited images (photographed images) placed on one photo sticker. Here, an image in which an edited image is arranged according to a sticker layout selected by the user, that is, an image printed on sticker paper and finally output is called a layout image.

  Accordingly, on the division number selection screen, for example, a plurality of layout images in which edited images obtained by editing each of five photographed images are arranged in different sticker layouts are displayed.

  When one of the layout images is selected on the division number selection screen, the process proceeds to step S36.

  In step S <b> 36, the display control unit 431 displays the mini game screen on the tablet built-in monitor 131.

  The mini game screen is a screen for playing a game for hitting (selecting) a moving image transmitted to a mobile terminal owned by the user in addition to an image for mobile transmission described later. Although detailed description is omitted, the moving image is generated using a plurality of captured images obtained by the capturing process.

  When a game is played on the mini game screen and a moving image to be transmitted to the mobile terminal is determined, the process proceeds to step S37.

  In step S <b> 37, the display control unit 431 displays the portable transmission image selection screen on the tablet built-in monitor 131.

  The mobile transmission image selection screen is a screen used for selecting a mobile transmission image to be transmitted to a mobile terminal owned by the user. On the mobile transmission image selection screen, in addition to the five captured images, an image dedicated to mobile transmission, in which a predetermined edit is performed on any of them, is displayed.

  If any of the images is selected on the portable transmission image selection screen, the process proceeds to step S38.

  In step S38, the display control unit 431 displays a mail address input screen on the tablet built-in monitor 131.

  The e-mail address input screen is a screen used for inputting the e-mail address of the mobile terminal owned by the user. On the e-mail address input screen, a text box for displaying alphabets and symbols that can be used for the e-mail address, a button for selecting a carrier of the mobile phone, and a character string corresponding to the selected button is displayed. .

  When the input of the mail address is completed on the mail address input screen, the process proceeds to step S39.

  In step S39, the communication control unit 433 controls the communication unit 317 so that the mobile transmission image selected by the user via the network such as the Internet is displayed together with the mail address input by the user. Sent to the acquisition site management server.

  The image acquisition site management server transmits a mail describing a URL (Uniform Resource Locator) necessary for the mobile terminal to access the image acquisition site management server to the mail address input by the user. Based on the URL, the mobile terminal owned by the user accesses the image acquisition site management server via the network, so that the mobile transmission image transmitted to the image acquisition site management server is provided to the mobile terminal. Is done.

  In step S40, the edit processing unit 403 guides the user who has finished the editing work to move to the print waiting space A3. The guidance for moving to the print waiting space A3 is performed by displaying a guidance screen on the tablet built-in monitor 131 of the editing unit 305 or by outputting sound from the speaker 341.

The editing process is performed as described above.
<Example of editing screen>
Here, the editing screen displayed in step S34 of the editing process described above will be described with reference to FIG.

  The edit screen is basically configured by providing main components symmetrically. The left half area is an area used by a user on the left side of the tablet built-in monitor 131. The right half area is an area used by the user on the right side of the tablet built-in monitor 131. With such an editing screen configuration, mainly two users can simultaneously perform editing work.

  In FIG. 18, the left half area (left half area) of the editing screen is shown.

  A thumbnail display area 511 is provided at the upper center of the left half area. The thumbnail display area 511 is a display area for thumbnail images representing captured images. The user selects a captured image to be edited by selecting a thumbnail image displayed in the thumbnail display area 511.

  In the example of FIG. 18, thumbnail images representing five captured images are displayed side by side in the thumbnail display area 511.

  An edit area 512 is provided substantially at the center of the left half area. The editing area 512 is a display area for a captured image selected as an editing target. The user selects an editing tool using the touch pen 132 </ b> A and edits the captured image displayed in the editing area 512.

  An edit palette 513 is displayed below the left half area. The editing palette 513 is used to select various editing tools (composition images) such as pen images and stamp images.

  In the editing palette 513, each editing tool is prepared for each tab. The user switches the editing tool displayed on the editing palette 513 by selecting each tab. For example, a tab named “stamp” is a tab operated when selecting a stamp image, and a tab named “pen” is operated when selecting a pen image. It is a tab.

  On the left side of editing area 512, makeup palette 514 is displayed.

  The makeup palette 514 is an icon display area for selecting a makeup tool. The makeup tool is an editing tool for executing the makeup process described above. By selecting the makeup tool, a makeup process corresponding to the selected makeup tool is performed on the face in the photographed image.

  In the example of FIG. 18, as a makeup tool, “lip” that can change the color of the lips, “teak” that can change the color of the cheeks, “shape of the eye” that can change the shape of the eyes, and There are four types of “mascara” that can change the volume of the eyelashes. The makeup process corresponding to the makeup tool is performed by a user's selection operation on the makeup palette 514 (specifically, by pressing the “two simultaneous” button or the “one person” button provided on the makeup palette 514). It can be applied to each user in the captured image at the same time, or can be applied to each user. For example, when there are two users and the “simultaneous two people” button is pressed, a makeup process corresponding to the selected makeup tool is performed on each of two subjects in the captured image, and “1 When the “person-by-person” button is pressed, a makeup process corresponding to the selected makeup tool is performed on one of the two subjects (one of the selected subjects) in the captured image. become.

  A correction tool selection area 515 is provided on the right side of the editing area 512. In the correction tool selection area 515, an eraser button for using the eraser function, a return button for returning an edited photographed image to the previous state, and conversely, for proceeding to the previous state A correction tool such as a forward button and a button for returning the captured image to a state in which any editing or image processing is not performed is displayed.

<Make treatment and eraser treatment>
Next, an example of makeup processing and eraser processing will be described with reference to the flowchart of FIG.

  For example, when “lip” is selected as a makeup tool in the makeup palette 514 on the editing screen, makeup processing is started.

  In step S51, the area specifying unit 451 specifies an area of a face or a face part (here, lips) in a captured image selected as an editing target, and masks the area (transmits an area other than the area). ) Generate a mask image.

  For example, the area specifying unit 451 detects the face by face recognition in the captured image, extracts the lip contour points, and determines whether or not the area connecting the lips is the lip. Identify. At this time, the number of contour points to be extracted is arbitrary.

  In addition, the area specifying unit 451 may specify a face or face part area by detecting a color in the captured image. For example, an area of a specific size in which skin color is detected is used as a face area, an area in which a color close to red or pink is detected in the face area is used as a lip area, or white and black The detected area is set as the eye area.

  Furthermore, the area specifying unit 451 may specify a face or face part area by extracting a person area by chroma key processing on a captured image.

  Here, it is only necessary to finally specify the lip region, and the lips may be detected without detecting the face.

  In step S52, the area specifying unit 451 generates an eraser mask image that is larger than the mask image that masks the lip area. For example, as shown in FIG. 20A, when the lip region 531 is specified, an eraser mask image 532 that is slightly larger than the lip region 531 shown in FIG. 20B is generated. The eraser mask image 532 is larger than the lip region 531 because the region around the lips may be erroneously detected as a lip region. However, the eraser mask image 532 has the same size as the lip region 531. Also good.

  In step S <b> 53, the image processing unit 452 determines whether a lip color is selected on the makeup palette 514.

  The process of step S53 is repeated until the lip color is selected, and when the lip color is selected, the process proceeds to step S54.

  In step S54, the image processing unit 452 changes the color of the lip region to the selected color. Specifically, the image processing unit 452 changes the color of the lip region by changing the color of the lip mask image to the selected color and superimposing the lip mask image on the upper layer of the captured image.

  As a result, the lip region 531 of the photographed image is in a color-added state as shown in FIG.

  In step S55, the image processing unit 452 determines whether an eraser is used. Specifically, the image processing unit 452 determines whether or not a “lip eraser” button for realizing an eraser function dedicated to “lip” is selected in the makeup palette 514 of the editing screen. The eraser function is effective for an area designated by the locus of the touch pen 132.

  Until the eraser is used, the process of step S55 is repeated. When the eraser is used, the process proceeds to step S56, and the eraser process is started.

  In step S56, the area designating unit 453 receives designation of an area where the eraser is used in the lip area, and whether or not the area exceeds a predetermined ratio of the size of the eraser mask image (or the size of the lip area). Determine whether. Specifically, if the area of the area where the eraser is used is R and the area of the eraser mask image is EM, whether R is larger than a value obtained by multiplying EM by a predetermined constant α (α <1). Is determined.

  If it is determined in step S56 that the area where the eraser is used exceeds the predetermined ratio of the size of the eraser mask image, that is, if R ≧ αEM, the process proceeds to step S57.

  In step S57, the image processing unit 452 deletes all colors of the lip region.

  For example, as shown in FIG. 20D, when most of the lip region 531 is designated by the locus R1 of the touch pen 132 in the eraser function, as shown in FIG. It is erased and returns to the state before the color was added.

  In this case, further selection of the color to be added to the entire lip region, that is, reselection, can be accepted, and the subsequently reselected color is reflected on the entire lip region.

  On the other hand, if it is determined in step S56 that the area where the eraser is used does not exceed a predetermined ratio of the size of the eraser mask image, that is, if R <αEM, the process proceeds to step S58.

  In step S58, the image processing unit 452 erases only the color of the area where the eraser is used in the lip area.

  For example, as shown in F of FIG. 20, when only the left end portion of the lip region 531 is designated by the locus R2 of the touch pen 132 in the eraser function, as shown in G of FIG. Only the area where the eraser is used will be erased.

  In this case, it becomes possible to accept reselection of the color added to the area other than the part where the color is erased, and the reselected color is reflected in the area other than the part where the color is erased. Further, the reselected color is not reflected in the portion where the color is erased.

  If the lip color is reselected after step S57 or S58, processing similar to the processing after step S54 is executed.

  According to the above processing, after using the “lip” makeup tool for the lip area, the user accidentally erases the color of the necessary part, and the color of the entire lip using the eraser function. Even when there is a slight unerased when erasing, the color of the entire lip is erased. Therefore, when another color is selected again thereafter, the newly selected color is reflected on the entire lips. As described above, when erasing the color of the entire lip using the eraser function, it is possible to improve the operability in the editing work without requiring an operation without leaving an unerased portion.

<Regarding the area>
In the above description, the lip region is specified by selecting “lip” as the makeup tool. However, when “teak” is selected, the cheek region is specified and “eye” is selected. When “shape” or “mascara” is selected, the eye area is specified. When “mascara” is selected, after the eye region is specified, the region of the eyelash portion is specified.

  Note that the image processing (make processing) performed by specifying the eye region is performed on the region of one eye (for example, the right eye), and then the same image processing is performed on the other eye (for example, the left eye). ). Thereby, the balance of the left and right eyes can be maintained.

  For face parts that are likely to fail detection in face recognition, the area may be specified based on the detection results of other face parts. For example, if the user wears glasses, the possibility of eye detection failure increases, so the nose and lips that can be detected more reliably are detected, and the eye area is determined based on their positions. To be identified.

  Further, not only the face parts but also the entire face area may be specified as an area to be subjected to predetermined image processing.

  In addition to specifying an area to be subjected to image processing by face recognition, an area surrounded by the touch pen 132 operated by the user may be specified as an area to be subjected to image processing. Good. In this case, an area having an arbitrary shape can be specified regardless of the shape of the face or face part. For example, a rectangular or circular area surrounding the lips can be identified and used as an image processing target.

  Further, the entire person area in the captured image may be specified as an area to be subjected to predetermined image processing. For example, the person area is specified by separating the person area and the background area by chroma key processing. In this case, since face recognition processing is not performed, it is possible to reduce the possibility that an erroneous region is specified by the recognition failure.

  Furthermore, a stamp image combined with a captured image to be edited may be specified as a region to be subjected to predetermined image processing.

  Further, as shown in FIG. 21A, the entire original image 551 of the photographed image may be specified as a region to be subjected to predetermined image processing, or as shown in FIG. 21B. The entire captured image 552 cut out from the original image 551 by trimming may be specified as a region to be subjected to predetermined image processing. The range that is cut out as the captured image 552 is the height of the subject in the case of a full-length image in which the entire body of the subject is captured according to the detection result of the size of the face in the case of an up image where the face and upper body of the subject are large It may be determined according to the calculation result. Therefore, the cut-out range is determined according to the user's standing position (distance from the camera 91) at the time of shooting.

<Specification other than areas>
In the above, an example in which an area to be subjected to image processing is specified has been described. However, an image processing target is not limited to an area, and may be a line or a point.

  When the target of the image processing is a line, for example, a line segment connecting any two points on the photographed image or a contour line connecting the contour points of the face or the face part is specified as a line to be image processed. . Further, a line (trajectory) drawn by the touch pen 132 operated by the user may be specified as a line to be subjected to image processing. In this case, predetermined image processing is performed on the identified line.

  When the target of image processing is a point, an arbitrary point on the captured image is specified, or a point selected by the touch pen 132 operated by the user is specified as a point to be subjected to image processing. It may be.

<Regarding the area designation for the eraser function>
As described above, the designation of the area in the eraser function is performed by the touch pen 132 operated by the user. For example, the range of the area specified by the locus of the touch pen 132 may be determined on a pixel-by-pixel basis, such as the pixel p1 completely included in the locus L shown in FIG. The pixel p1 completely included in the locus L and the surrounding 8 pixels shown in B of FIG.

  The designation of the area in the eraser function may be performed by operating a button in addition to the touch pen 132, for example. Specifically, a button for deleting the color of the entire lip area, a button for deleting the color of the area near the mouth corner of the lips, etc. are prepared so that the area corresponding to the selected button is designated. To do. When an area is designated, the color added to the area is deleted in the same manner as the above-described processing.

  In the eraser function, an area for erasing a color is designated. Conversely, an area for leaving a color (not erased) in a specific area (for example, a lip area) may be designated. In this case, if the specified area does not exceed the specified size, the color of the entire specified area is deleted, and if the specified area exceeds the specified size, the specified area is specified. Try to leave the color of the area. Thereby, when the area | region which wants to delete a color becomes wide, operation by a user can be simplified. Furthermore, the user may be allowed to select whether to specify an area for deleting the color or an area for leaving the color, or by providing a function different from the eraser function, An area to be left may be designated.

  In the above, an example in which the color of the entire region or the designated region is erased in the region of the face part (for example, lips) to which the color is added has been described. In the face part area, the contents of the image processing applied to the entire area or the specified area may be deleted.

<Determining the size of the specified area>
In the above, when the area R of the area where the eraser is used (designated area) and the area EM of the eraser mask image satisfy R ≧ αEM, the entire lip area is erased, and R <αEM In this case, only the color of the area where the eraser is used in the lip area is erased.

  In addition to this, when R> αEM, all colors of the lip area are erased, and when R <αEM, only colors of areas where the eraser is used in the lip area are erased. In the case of αEM, the user may be able to select whether to erase the entire color of the lip area or only the color of the area where the eraser is used.

  Also, when R ≧ αEM, the color of the entire lip area is erased. When R <αEM, the color of the entire lip area is erased or only the color of the area where the eraser is used is erased. May be selected by the user.

  Further, using a constant β (β <α <1) that is smaller than the constant α, when R> αEM, the color of the entire lip area is erased, and when R <βEM, the eraser is erased in the lip area. Use only whether to erase all colors of the lip area or erase only the color of the area where the eraser is used when βEM <R <αEM. The user may be able to select.

  For example, a slider operated to adjust the values of the constants α and β may be provided in a predetermined area on the editing screen, and the constants α and β may be adjusted by the user. . Further, a more detailed determination condition may be provided using a constant other than the constants α and β.

  Further, depending on the contact time between the touch pen 132 and the editing screen (tablet built-in monitor 131) instead of the size of the designated area specified by the touch pen 132 operated by the user, Alternatively, only the color of a predetermined partial area in the lip area may be erased. Specifically, when the contact time between the touch pen 132 and the editing screen (lip region) is longer than a predetermined time, all colors of the lip region are erased, and when the contact time is shorter than the predetermined time, a predetermined one in the lip region is deleted. Only the color of the part area is erased.

  Further, according to the trajectory of the touch pen 132, the color of the entire lip region may be deleted, or only the color of a predetermined partial region in the lip region may be deleted. Specifically, when a straight line as shown in FIG. 23A is drawn in a predetermined area on the editing screen, the entire lip area is erased, and a curve as shown in FIG. When drawn, only the color of a predetermined partial area in the lip area is erased.

  Further, depending on whether or not the designated area designated by the touch pen 132 operated by the user is within the predetermined range (position), the color of the entire lip area is deleted or a predetermined area in the lip area is deleted. Only the colors of some areas may be erased.

  By the way, as an eraser button in the correction tool selection area 515 on the editing screen and a “lip eraser” button on the makeup palette 514, a plurality of (for example, “thick” and “thick” in the example of FIG. Three buttons ("medium" and "thin") are prepared.

  For example, when the “thick” button is selected, the color of the wide area along the locus of the touch pen 132 is deleted in the colored lip area, and when the “thin” button is selected, the color is In the lip region marked with, the color of the narrow region along the locus of the touch pen 132 is erased. That is, the user can erase the color of the desired area with fewer operations by selecting the “thick” button as the eraser button.

  Therefore, depending on the thickness button selected as the eraser button, the color of the entire lip region may be deleted, or only the color of a predetermined partial region in the lip region may be deleted. Specifically, when the “thick” button is selected as the eraser button, the entire lip area is erased, and when the “middle” or “thin” button is selected as the eraser button, it is specified in the lip area. Delete only the color of the selected area.

  Note that the back button, the forward button, and the button from the beginning of the correction tool selection area 515 are applied to the makeup process and the eraser process performed by the “make tool” in addition to the graffiti applied to the photographed image. Therefore, after erasing the color given to the lip area by “Lip” of “Makeup Tool” using the eraser function, the lip area is returned to the state before the color was erased by selecting the return button. In this state, the user can proceed to the state after deleting the color of the lip region by selecting the forward button. Furthermore, by selecting a button from the beginning, the lip region can be returned to a state where no color is given by the “lip” of the “make tool”.

<About processing target>
The makeup process and the eraser process described above can be performed simultaneously on each person (user) shown in the photographed image by pressing the “simultaneous two people” button provided on the makeup palette 514. By pressing the “one by one” button, it can be applied to each person (user) in the captured image.

<Other examples of image processing>
In the above description, the image processing performed on the specific region has been described as processing for changing the color of the lip region. However, other image processing may be used.

  For example, the image processing performed on the specific area may be a process of changing the transparency of the specific area. In this case, according to the contact time between the touch pen 132 and the specific area, the transparency of the specific area is set to 100%, or the transparency corresponding to the contact time is set. Specifically, when the contact time between the touch pen 132 and the specific region is longer than a predetermined time, the transmittance of the specific region is set to 100%, and when the contact time is shorter than the predetermined time, the transmittance of the specific region is The transparency corresponding to time is set.

  Further, as a function different from the eraser function, the type of image processing applied to the entire specific area may be changed according to the size of the specified area specified in the specific area. For example, when the designated area exceeds a predetermined size, the image processing applied to the entire specific area is the first processing process, and when the designated area does not exceed the predetermined size, the entire specific area is processed. The image processing to be performed is set as the second processing process.

  In the above-described embodiment, the photo sticker creating apparatus 1 is configured to print the obtained image on a sticker sheet and send it to the user's mobile terminal by transmitting it to the image acquisition site management server. . However, the present invention is not limited to this, and it is also possible to adopt a configuration in which an image is not provided on a sticker sheet, but only provided to the user's mobile terminal by being transmitted to the image acquisition site management server. Conversely, it is possible to adopt a configuration in which the image is not printed to the image acquisition site management server, but only printed on sticker paper.

  That is, the present technology can be applied not only to a photo sticker creating apparatus that creates a photo sticker in which an image is printed on sticker paper, but also to a photo creating game machine that simply provides a game for creating an image.

  The series of processes described above can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 12, this recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the main body of the apparatus, and the magnetic disk on which the program is recorded ( A removable medium 319 including a flexible disk, an optical disk (including a CD-ROM and a DVD), a magneto-optical disk, or a semiconductor memory. In addition to these, the recording medium includes a ROM 312 in which a program distributed to an administrator in a state of being incorporated in the apparatus main body is recorded, a hard disk included in the storage unit 316, and the like.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  In the above, the printing medium is not limited to sticker paper or photographic paper. For example, an image may be printed on a predetermined size of paper or film, a card such as a prepaid card or an IC (Integrated Circuit) card, or a cloth such as a T-shirt. In this case, a sticker layout image in which one or a plurality of photographed images are arranged may be printed on these print media.

  The embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology.

DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus 401 Pre-selection process part 402 Image | photographing process part 403 Edit process part 404 Print process part 431 Display control part 432 Edit control part 433 Communication control part 451 Area specification part 452 Image process part 453 Area designation part

Claims (9)

In a captured image obtained by shooting, an area specifying unit that specifies an area to be subjected to image processing;
An image processing unit that applies the selected image processing to the specific region by accepting selection of the image processing to be performed on the specified specific region;
An area designating unit for accepting designation of an area including at least a part of the specific area on which the selected image processing has been performed, and
The photo processing game machine in which the image processing unit can accept reselection of the image processing applied to the entire specific area according to the size of the specified area specified in the specific area. The image processing unit
When the specified area exceeds a predetermined size, reselection of the image processing applied to the entire specific area can be accepted,
The photo creation game machine according to claim 1, wherein when the specified area does not exceed a predetermined size, reselection of the image processing applied to an area other than the specified area in the specific area can be accepted. The image processing unit
When the specified area exceeds a predetermined size, the content of the image processing applied to the entire specific area is erased,
The photo creation game machine according to claim 2, wherein when the designated area does not exceed a predetermined size, the contents of the image processing applied to the designated area in the specific area are deleted. The image processing unit can accept reselection of the image processing applied to the entire specific area according to whether the size of the designated area exceeds a predetermined ratio of the size of the specific area. The photo creation game machine according to claim 1, wherein reselection of the image processing applied to an area other than the designated area in the specific area can be accepted. The photo creation game machine according to any one of claims 1 to 4, wherein the area specifying unit specifies an area including all or part of a face of a person shown in the captured image. The area specifying unit specifies an area including the whole or a part of the face for each person shown in the captured image,
The photo creation game machine according to claim 5, wherein the image processing unit receives selection of the image processing performed on the specific area for each person. The region specifying unit specifies a region including lips in the captured image,
The photo creation game machine according to claim 5, wherein the image processing unit receives selection of a color of the specified lip region. The area designating unit accepts designation of an area for erasing a selected color in the lip area,
The image processing unit can accept a change in the color of the entire lip area according to the size of the specified area specified in the lip area, or an area other than the specified area in the lip area The photo creation game machine according to claim 7, wherein a change in the color of the image can be received. In the captured image obtained by shooting, specify the area to be subjected to image processing,
By accepting the selection of the image processing applied to the specified specific area, the selected image processing is applied to the specific area,
Accepting designation of an area including at least a part of the specific area subjected to the selected image processing;
An image processing method including a step of accepting reselection of the image processing applied to the entire specific area in accordance with the size of the specified area specified in the specific area.

Images