JP6646202B2 - Photo sticker making device and display method - Google Patents

Description

  The present technology relates to a photo sticker creating apparatus and a display method, and more particularly, to a photo sticker creating apparatus and a display method that enable the user to image the finish of an image.

  2. Description of the Related Art Conventionally, a photo sticker installed in an amusement facility or the like is known. The photo sticker shoots a user and edits the shot image according to the operation of the user. The photo sticker machine prints the edited photographed image on sticker paper.

  In such a photo sticker, a user performs a photographing operation while checking a live view image in which the user is photographed.

  For example, Patent Literature 1 describes a photo sticker that displays a selection button on a live view display screen for making the size of an eye for each user appearing in a live view image. When the selection button is operated, the size of the eyes of the user corresponding to the selection button is changed to the size corresponding to the selection button in the live view image.

  Patent Document 2 discloses a photo sticker that performs a predetermined correction on an image in a range selected by a user in a live view image.

Japanese Patent No. 5550551 JP 2005-277772 A

  In the above-described photo sticker, image processing is performed on a live view image by a user performing some operation. However, a user who is not accustomed to the game of the photo sticker machine may be puzzled by these operations, and may not be able to perform a shooting operation smoothly.

  In particular, image processing has not been performed on a person area in a live view image without a user performing any operation. Therefore, the user cannot easily imagine the finish of the image subjected to such image processing.

  The present technology has been made in view of such a situation, and is intended to easily image the finish of an image.

According to one embodiment of the present technology, there is provided a photo sticker creating device that determines a camera for photographing a subject and an upper body region of a person region in a moving image captured by the camera without a direct selection by a user. An image processing unit that performs image processing of the, and a display control unit that displays a live view display screen in which the moving image subjected to the image processing is displayed in real time, the display control unit includes: A photo sticker creating device that, when the image processing is performed, enlarges a display area where the entire moving image is displayed on the live view display screen, as compared with a case where the image processing is not performed on the moving image .

  The image processing unit may perform a plurality of types of the image processing on the upper body region in the moving image.

  The image processing unit may perform the image processing using the result of the face recognition on the upper body region specified by performing the face recognition.

  The image processing unit may cause the image processing using the result of the face recognition to be performed on the face area specified by performing the face recognition.

  The image processing unit may cause the image processing using the mask image to be performed on the upper body region specified by generating a mask image for acquiring the person region.

  The photo sticker creation device may further include an area determination unit that determines the validity of the specified upper body area using at least one of the color, shape, and size of the person area.

  The image processing unit performs image processing with different parameters for the upper body region when performing up-shooting that captures the face and upper body of the subject and performing full-body imaging that captures the whole body of the subject. Can be applied.

  The display control unit, before the live view display screen is displayed, displays a course selection screen for allowing the user to select a course related to shooting, the image processing unit, in the course selection screen The image processing according to the selected course can be performed on the upper body region in the moving image.

  The image processing unit may perform the image processing on a still image obtained as a result of shooting.

A display method according to one aspect of the present technology is a display method of a photo sticker creating device including a camera for photographing a subject, and a method for displaying a user image in a moving image captured by the camera, in which Performs a predetermined image processing regardless of direct selection by the user, displays a live view display screen in which the moving image subjected to the image processing is displayed in real time, and the image processing is performed on the moving image. In this case, the method includes a step of enlarging a display area where the entire moving image is displayed on the live view display screen, as compared with a case where the image processing is not performed on the moving image .

In one aspect of the present technology, predetermined image processing is performed on an upper body region of a human region in a moving image captured by a camera without direct selection by a user, and image processing is performed. The live view display screen where the moving image is displayed in real time is displayed, and when the image processing is performed on the moving image, the entire moving image is displayed on the live view display screen as compared with the case where the image processing is not performed on the moving image. The displayed display area increases.

  According to the present technology, it is possible to easily imagine the finish of an image.

BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a perspective view illustrating a configuration example of an appearance of a photo sticker creating device of the present technology. FIG. 4 is a diagram illustrating movement of a user. FIG. 3 is a diagram illustrating a configuration example of a photographing unit. FIG. 3 is a diagram illustrating a configuration example of a background unit. FIG. 3 is a diagram illustrating a configuration example of an editing unit. It is a figure showing the example of composition of the right side of an edit unit. It is a block diagram showing the example of composition inside a photograph sticker creation device. FIG. 3 is a block diagram illustrating a functional configuration example of a control unit. FIG. 3 is a block diagram illustrating a functional configuration example of a photographing processing unit. It is a flowchart explaining a photo sticker creation game process. It is a flowchart explaining a photography process. It is a flowchart explaining an example of a live view image display process. It is a figure explaining an example of small face processing. It is a figure explaining an example of small face processing. It is a figure showing an example of a live view display screen. It is a figure showing an example of a live view display screen. It is a block diagram showing other examples of functional composition of a photography processing part. It is a flowchart explaining another example of a live view image display process. It is a flowchart explaining an example of a reflection course selection process. It is a figure showing an example of a reflection course selection screen. It is a flowchart explaining an example of lighting control processing. It is a figure showing the example of composition of appearance of the strobe unit on the back. It is a figure showing the example of composition of appearance of the strobe unit on the back. It is a figure showing the example of composition inside the back strobe unit. FIG. 3 is a diagram illustrating a configuration example of a strobe light emitting unit. It is a figure showing the example of composition of the appearance of the back right strobe unit. It is a figure showing the example of composition inside the back right strobe unit. FIG. 9 is a diagram illustrating another configuration example of the strobe light emitting unit.

  Hereinafter, specific embodiments to which the present technology is applied will be described in detail with reference to the drawings.

<Appearance of photo sticker making device>
FIG. 1 is a perspective view showing a configuration example of the external appearance of the photo sticker creating device 1.

  The photo sticker creating device 1 is a game machine that provides a photographed image and an edited image. The photo sticker creation device 1 provides an image to a user by printing the image on a sticker or transmitting the image to a server so that the image can be viewed on the user's mobile terminal. The photo sticker creating device 1 is installed in an amusement facility or a store. Users of the photo sticker creating device 1 are mainly young women such as high school girls and female college students. In the photo sticker creation device 1, a plurality of users, such as two or three, can enjoy the game per set. Of course, one user can enjoy the game.

  In the photo sticker creating apparatus 1, a user performs a photographing operation with himself / herself as a subject. The user composes an image selected from photographed images obtained by photographing with an image for composition such as a handwritten character or a stamp image by an editing operation. As a result, the captured image is edited into a colorful image. The user receives the sticker sheet on which the edited image, which is the edited image, is printed, and ends the series of games.

  The photo sticker creating device 1 is configured by being installed in a state where the photographing unit 11 and the editing unit 12 are in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected. The imaging unit 11 has a box-shaped housing having a size that allows a person to enter the inside.

  The imaging unit 11 includes an imaging unit 21 and a background unit 22. The imaging unit 21 and the background unit 22 are set apart. The space provided between the photographing unit 21 and the background unit 22 is a photographing space where the user performs a photographing operation.

  The photographing unit 21 is a device that photographs a user as a subject. A camera or the like is provided in front of the photographing unit 21 facing the photographing space. A front panel 41 is provided on a surface of the imaging unit 21 that is in contact with the editing unit 12. Assuming that the right side is the right side and the left side is the left side when viewed from the user in the photographing space, the right side of the photographing unit 21 is constituted by the side panel 42A, and the left side is constituted by the side panel 42B (FIG. 2). Be composed.

  The background portion 22 includes a back panel 51, a side panel 52A, and a side panel 52B (FIG. 2), each of which is a plate-shaped member. The back panel 51 is located on the back side of the user facing the front. The side panel 52A is attached to the right end of the back panel 51, and the side panel 52B is attached to the left end of the back panel 51.

  The side panel 42A and the side panel 52A are provided on a substantially same plane at a predetermined interval. The upper portions of the side panel 42A and the side panel 52A are connected by a connecting portion 31A which is a plate-shaped member. The side panel 42A and the lower portion of the side panel 52A are connected by a connecting portion 34 provided on the floor surface, for example, a metal member.

  Similarly, the side panel 42B and the side panel 52B are provided on substantially the same plane. The upper portions of the side panel 42B and the side panel 52B are connected by a connecting portion 31B. The side panel 42A and the lower part of the side panel 52A are connected by a metal member (not shown) provided on the floor surface.

  An opening formed by being surrounded by the side panel 42A, the connecting portion 31A, and the side panel 52A serves as a doorway of the photographing space. Further, an opening formed by being surrounded by the side panel 42B, the connecting portion 31B, and the side panel 52B also serves as a doorway to the photographing space.

  Above the shooting space, an opening is formed which is surrounded by the front panel 41 of the shooting unit 21, the connection unit 31 </ b> A, the connection unit 31 </ b> B, and the back panel 51 of the background unit 22. A ceiling strobe unit 32 is provided in the opening to cover a part thereof. One end of the ceiling strobe unit 32 is fixed to the connecting portion 31A, and the other end is fixed to the connecting portion 31B.

  The ceiling strobe unit 32 has a built-in strobe light emitting tube that irradiates light into the shooting space. Inside the ceiling strobe unit 32, a fluorescent lamp is provided in addition to the strobe light emitting tube. Thereby, the ceiling strobe unit 32 also functions as illumination of the shooting space.

  The editing unit 12 is a device for editing a captured image. The editing unit 12 is connected to the photographing unit 11 such that one side surface is in contact with the front panel 41 of the photographing unit 21.

  Assuming that the configuration of the editing unit 12 shown in FIG. 1 is a configuration on the front side, a configuration used for editing work is provided on each of the front side and the back side of the editing unit 12. With this configuration, two sets of users can edit at the same time.

  The front side of the editing unit 12 includes a surface 12A and a slope 12B formed above the surface 12A. The surface 12A is perpendicular to the floor surface and is substantially parallel to the side panel 42A of the photographing unit 21. A monitor with a built-in tablet and a touch pen are provided on the slope 12B as a configuration used for editing work.

  On the upper right side of the slope 12B, a columnar support portion 71A (FIG. 5) that supports one end of the lighting device 73 is provided. On the left side of the slope 12B, a columnar support portion 71B that supports the other end of the lighting device 73 is provided. A plate-like panel 72 is provided on the right side of the support portion 71A. On the upper surface of the panel 72, a support portion 74 for supporting the curtain rail 75 is provided.

  A curtain rail 75 is attached above the editing unit 12. The curtain rail 75 is configured by combining three rails 75A to 75C. The three rails 75A to 75C are combined so that the shape when viewed from above becomes a U-shape. One ends of the rails 75A and 75B provided in parallel are fixed to the connecting portions 31A and 31B, respectively, and the other ends of the rails 75A and 75B are respectively joined to both ends of the rail 75C.

  A curtain is attached to the curtain rail 75 so that the space in front of the editing unit 12 and the space in front of the editing unit 12 are not visible from the outside. The space in front of the editing unit 12 and the space behind the back of the editing unit 12 surrounded by the curtain serve as an editing space where the user performs editing work.

  As will be described later, a discharge port for discharging printed seal paper is provided on the right side surface of the editing unit 12. The space in front of the right side of the editing unit 12 is a print waiting space where the user waits for printing to be completed.

<About user movement>
Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described.

  FIG. 2 is a plan view of the photo sticker creating device 1 as viewed from above.

  First, the user takes a photographing space formed between the photographing unit 21 and the background unit 22 from the entrance G1 as shown by the outline arrow # 1 or from the entrance G2 as shown by the outline arrow # 2. Enter A1. The entrance G1 is an opening between the side panel 42A and the side panel 52A, and the entrance G2 is an opening between the side panel 42B and the side panel 52B. The user performs a photographing operation in the photographing space A1 using a camera, a touch panel monitor, or the like provided in the photographing unit 21.

  The user who has completed the photographing operation exits the photographing space A1 from the entrance G1 and moves to the editing space A2-1 as shown by the outline arrow # 3, or moves to the entrance G2 as shown by the outline arrow # 4. Out of the photographing space A1 and move to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12. On the other hand, the editing space A2-2 is an editing space on the back side of the editing unit 12. Which of the editing space A2-1 and the editing space A2-2 the user moves to is guided by a screen display on a touch panel monitor of the photographing unit 21 or the like. For example, a vacant one of the two editing spaces is guided as a destination.

  The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing work. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing work at the same time.

  After the editing work is completed, printing of the edited image is started. When printing is started, the user who has completed the editing work in the editing space A2-1 moves from the editing space A2-1 to the print waiting space A3 as indicated by the white arrow # 5. Further, the user who has completed the editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as indicated by the outline arrow # 6. While waiting for printing to end, the user who has moved to the print waiting space A3 performs, for example, selection of an image to be transmitted to the server and input of the mail address of the mobile terminal held by the user as post-selection work.

  When printing is completed, the user receives the sticker sheet discharged from the discharge port provided on the right side of the editing unit 12, and ends a series of photo sticker creation games.

  Next, the configuration of each unit will be described.

<Configuration of imaging unit>
FIG. 3 is a diagram illustrating a configuration example of the front of the imaging unit 21. The imaging unit 21 is configured to be surrounded by a front panel 41, a side panel 42A, and a side panel 42B.

  A camera unit 81 is provided substantially at the center of the front panel 41. The camera unit 81 includes a camera 91, a front strobe unit 92, and a touch panel monitor 93.

  The camera 91 is, for example, a single-lens reflex camera, and is mounted inside the camera unit 81 so that the lens is exposed. The camera 91 has an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and shoots a user in the shooting space A1. A moving image (hereinafter, also referred to as a live view image) captured by the camera 91 is displayed on the touch panel monitor 93 in real time. A still image captured by the camera 91 at a predetermined timing such as when a photographing instruction is given is stored as a photographed image.

  The front strobe unit 92 is provided above the camera 91. The front strobe unit 92 emits light when photographed by the camera 91, like the other strobe units. The front strobe unit 92 irradiates light near the user's face as a subject from the front.

  The touch panel monitor 93 is provided below the camera 91. The touch panel monitor 93 includes a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated on the monitor. The touch panel monitor 93 has a function as a live view monitor for displaying a moving image captured by the camera 91, and a function for receiving a user's selection operation by displaying various GUI (Graphical User Interface) parts. . On the touch panel monitor 93, a moving image (live view image) or a still image (captured image) captured by the camera 91 is displayed.

  On the front panel 41, an upper strobe unit 82 is installed above the camera unit 81. A left strobe unit 83 is installed on the left side of the camera unit 81, and a right strobe unit 84 is installed on the right side of the camera unit 81. Further, a box-shaped foot strobe unit 85 is provided below the camera unit 81.

  The upper strobe unit 82 emits light to the user from the upper front. The left strobe unit 83 emits light to the user from the front left side. The right strobe unit 84 emits light to the user from the front right side. The foot strobe unit 85 emits light to the feet of the user.

  Fluorescent lamps are provided inside the upper strobe unit 82, the left strobe unit 83, the right strobe unit 84, and the foot strobe unit 85. These fluorescent lamps are used as illumination in the photographing space A1 together with fluorescent lamps inside the ceiling strobe unit 32. By adjusting the amount of light emitted from each fluorescent lamp, or by adjusting the number of fluorescent lamps that emit light, the brightness in the imaging space A1 is appropriately adjusted.

  On the left and right of the foot strobe unit 85, box-shaped parts 86A, 86B having a lower height than the foot strobe unit 85 are provided. The upper surface of each of the box-shaped portions 86A and 86B serves as a luggage storage space for a user to store baggage and the like.

  Further, the box-shaped portion 86A is provided with a coin insertion slot 87 into which a user inserts a coin.

  Although not shown, a speaker is provided on the front panel 41, for example, near the ceiling. The speaker outputs guidance sounds, background music, sound effects, and the like relating to the shooting operation.

<Structure of background part>
FIG. 4 is a diagram illustrating a configuration example of the background unit 22 on the imaging space A1 side.

  An upper back strobe unit 121 is provided at the upper center of the back panel 51. A rear right strobe unit 122 is provided on the upper right side (the left side in the figure) of the rear panel 51, and a rear left strobe unit 123 is provided on the upper left side (the right side in the figure) of the rear panel 51.

  The upper rear strobe unit 121 emits light to the user from the upper rear side. The rear right strobe unit 122 emits light to the user from the rear right side. The rear left strobe unit 123 emits light to the user from the rear left side.

  A rear curtain 124 is attached to a surface of the rear panel 51 on the photographing space A1 side (the front side in the figure). The color of the back curtain 124 is, for example, green. Although not shown, a side curtain similar to the back curtain 124 is also attached to the imaging space A1 side of each of the side panels 52A and 52B. The color of the side curtain is the same as the color of the back curtain 124.

  These curtains are used as chroma key curtains. Thereby, the chroma key processing is performed on the photographed image, and the background image desired by the user can be synthesized with the background portion of the photographed image. The color of these curtains may be any color that can perform chroma key processing, and may be other colors such as blue.

<Configuration of editing unit>
FIG. 5 is a diagram illustrating a configuration example on the front side (the editing space A2-1 side) of the editing unit 12.

  A tablet built-in monitor 131 is provided substantially at the center of the slope 12B. A touch pen 132A is provided on the left side of the monitor 131 with a built-in tablet. A touch pen 132B is provided on the right side of the tablet built-in monitor 131.

  The tablet built-in monitor 131 is configured such that the tablet is provided so as to expose the display. The tablet enables operation input using the touch pen 132A or the touch pen 132B. On the tablet built-in monitor 131, for example, an editing screen used for editing work is displayed. When two users perform editing work at the same time, the touch pen 132A is used by a user on the left side toward the tablet built-in monitor 131, and the touch pen 132B is used by a user on the right side toward the tablet built-in monitor 131. .

  FIG. 6 is a diagram illustrating a configuration example of the right side surface of the editing unit 12.

  A panel built-in monitor 141 is provided on a panel 72 constituting a part of the right side surface of the editing unit 12. A screen used for a post-selection operation is displayed on the monitor 141 with a built-in tablet.

  At the lower part on the right side of the editing unit 12, a seal paper outlet 142 is provided. A printer is provided inside the editing unit 12. The printer prints an image of the user of the editing space A2-1 or an image of the user of the editing space A2-2 on a sticker sheet in a predetermined layout (hereinafter referred to as a sticker layout). It is discharged from the outlet 142.

  A speaker 143 is provided below the monitor 141 with a built-in tablet. The speaker 143 outputs guidance voice, BGM, sound effects, and the like related to the post-selection work.

<Internal configuration of photo sticker creation device>
FIG. 7 is a block diagram showing an example of the internal configuration of the photo sticker creating device 1. As shown in FIG. 7, the same components as those described above are denoted by the same reference numerals. Duplicate descriptions will be omitted as appropriate.

  The control unit 201 includes a CPU (Central Processing Unit) and the like. The control unit 201 executes a program stored in a ROM (Read Only Memory) 206 or a storage unit 202, and controls the overall operation of the photo sticker creating device 1. The storage unit 202, the communication unit 203, the drive 204, the ROM 206, and the RAM (Random Access Memory) 207 are connected to the control unit 201. The control unit 201 is also connected to the components of the imaging unit 208, the editing units 209A and 209B, and the post-selection unit 210.

  The storage unit 202 is a non-volatile storage medium such as a hard disk or a flash memory. The storage unit 202 stores various setting information and the like supplied from the control unit 201. The information stored in the storage unit 202 is appropriately read by the control unit 201.

  The communication unit 203 is an interface of a network such as the Internet. The communication unit 203 communicates with an external device under the control of the control unit 201. The communication unit 203 transmits, for example, a photographed image or an edited image selected by the user to the server. The image transmitted from the communication unit 203 is allocated and stored in a predetermined storage area in the server, and is displayed on a portable terminal accessing the server or downloaded.

  In the drive 204, a removable medium 205 formed of an optical disk, a semiconductor memory, or the like is appropriately mounted. The programs and data read from the removable medium 205 by the drive 204 are supplied to the control unit 201, and are stored or installed in the storage unit 202.

  The ROM 206 stores programs and data executed by the control unit 201. The RAM 207 temporarily stores data and programs processed by the control unit 201.

  The imaging unit 208 implements an imaging process for a user in the imaging space A1. The imaging unit 208 includes a coin processing unit 221, an illumination device 222, a camera 91, a touch panel monitor 93, and a speaker 223.

  The coin processing unit 221 detects insertion of a coin into the coin insertion slot 87. When detecting that a predetermined amount of coins, such as 400 yen, has been inserted, the coin processing unit 221 outputs a start signal to instruct the start of the game to the control unit 201.

  The illumination device 222 is each strobe unit in the photographing space A1, and emits light in accordance with an illumination control signal supplied from the control unit 201.

  The camera 91 performs shooting in accordance with shutter control by the control unit 201 and outputs a shot image (image data) obtained by shooting to the control unit 201.

  The editing unit 209A implements an editing process for a user in the editing space A2-1. The editing unit 209A includes a monitor 131 with a built-in tablet, touch pens 132A and 132B, and a speaker 231. The editing unit 209B implements an editing process for a user in the editing space A2-2, and has the same configuration as the editing unit 209A. In the following, when the editing units 209A and 209B are not particularly distinguished, they are simply referred to as the editing unit 209.

  The tablet built-in monitor 131 displays the editing screen according to the control of the control unit 201, and accepts a user operation on the editing screen. An input signal indicating the content of the user operation is supplied to the control unit 201, and the captured image to be edited is edited.

  The post-selection unit 210 implements post-selection processing for users in the print waiting space A3. The post-selection process is a process for causing the user to perform a post-selection operation. The post-selection unit 210 includes a monitor 141 with a built-in tablet, a speaker 143, and a printer 241. The printer 241 has a seal paper unit 242 mounted thereon.

  The tablet built-in monitor 141 displays various selection screens and the like under the control of the control unit 201, and accepts user operations on the screens. An input signal indicating the content of the user's operation is supplied to the control unit 201, and various settings are performed.

  The printer 241 prints the edited image on the sticker sheet stored in the sticker sheet unit 242 based on the print data supplied from the control unit 201. The printer 241 discharges the seal paper on which the edited image is printed in a predetermined seal layout to the seal paper discharge port 142.

<Configuration of control unit>
FIG. 8 is a block diagram illustrating a functional configuration example of the control unit 201. At least a part of the functional units illustrated in FIG. 8 is realized by executing a predetermined program by the CPU in the control unit 201.

  The control unit 201 includes a photographing processing unit 301, an editing processing unit 302, a print processing unit 303, and a post-selection processing unit 304.

  The imaging processing unit 301 performs an imaging process by controlling each unit of the imaging unit 208. The editing processing unit 302 performs an editing process by controlling each unit of the editing unit 209. The print processing unit 303 performs print processing by controlling the printer 241 of the post-selection unit 210. The post-selection processing unit 304 performs post-selection processing by controlling the tablet built-in monitor 141 of the post-selection unit 210.

<Example of configuration of photographing processing unit>
FIG. 9 is a block diagram illustrating a functional configuration example of the photographing processing unit 301.

  The imaging processing unit 301 includes a display control unit 311, an imaging control unit 312, an image processing unit 313, and an illumination control unit 314.

  The display control unit 311 controls display on the touch panel monitor 93. For example, the display control unit 311 causes the touch panel monitor 93 to display the live view image captured by the camera 91 or to display a captured image as a captured result.

  By controlling the camera 91, the imaging control unit 312 captures a moving image in which a subject is captured as a live view image, or captures a still image obtained at the timing of imaging as a captured image.

  The image processing unit 313 performs predetermined image processing on the live view image or the captured image captured by the camera 91.

  The illumination control unit 314 controls light emission of the illumination devices 222 (each strobe unit) in the photographing space A1.

<Operation of the photo sticker creation device>
Here, the operation of the photo sticker creating device 1 that provides the photo sticker creating game will be described with reference to the flowchart of FIG. The process of FIG. 10 is started when a predetermined amount of coins is inserted into the coin insertion slot 87.

  In step S1, the photographing processing unit 301 performs a photographing process by controlling the photographing unit 208. Specifically, the photographing processing unit 301 displays a live view image of the subject captured by the camera 91 on the touch panel monitor 93, captures a user in the capturing space A1 as a subject, and generates a captured image.

  In step S2, the editing processing unit 302 performs the editing process by controlling the editing unit 209 corresponding to the editing space that is the destination of the user who has completed the shooting process. Specifically, the editing processing unit 302 generates an edited edited image by causing the user to perform an editing operation on the captured image obtained by the shooting processing.

  In step S3, the print processing unit 303 starts print processing by controlling the printer 241. Specifically, the print processing unit 303 outputs the edited image obtained by the editing process to the printer 241 and prints the edited image on a sticker sheet. Note that the photographed image obtained by the photographing process may be printed on a sticker sheet.

  In step S4, the post-selection processing unit 304 performs post-selection processing by controlling the tablet built-in monitor 141. Specifically, the post-selection processing unit 304 causes the user waiting for the printing to be completed to perform the post-selection work, and transmits the selected captured image or edited image to the user's mobile terminal. The image is transmitted to the server.

  When the printing is completed, in step S5, the printer 241 discharges the seal paper on which the image is printed to the seal paper outlet 142, and ends the process.

<Details of shooting processing>
Next, with reference to the flowchart of FIG. 11, the details of the photographing process of step S1 in the series of processes of the above-described photo sticker creation game will be described.

  When the photographing process is started, in step S21, the display control unit 311 causes the touch panel monitor 93 to display a reflection course selection screen.

  The reflection course selection screen is a screen used to select a reflection course for determining the reflection of a subject in a captured image. The reflection course includes a “Light course” and a “Clear course”. The Light course is a reflection course for making the skin texture of a subject appearing in a captured image natural and moist by making the skin color slightly yellowish. The Clear course is a reflection course for making the skin texture of a subject appearing in a captured image fair and transparent by making the skin color slightly bluish.

  The image of the subject determined by the shooting course is determined by image processing performed on the captured image. For example, the appearance of a subject is determined by adjusting at least one of saturation, brightness, sharpness, contrast, and the like of a person region in a captured image. Further, the image of the subject may be determined by controlling the light emission of each strobe unit in the photographing space A1.

  When one of the shooting courses is selected by operating the shooting course selection screen, the imaging control unit 312 starts capturing a moving image by controlling the camera 91. The display control unit 311 displays the captured moving image on the touch panel monitor 93 as a live view image.

  The user can confirm how the user is projected by viewing the live view image displayed on the touch panel monitor 93.

  When a predetermined time has elapsed since the start of the display of the live view image, in step S22, the imaging control unit 312 performs the first imaging.

  In this photographing process, six photographings are performed. Of the six shots performed, up shooting is performed as the first to third shots, oblique shooting is performed as the fourth and fifth shots, and whole body shooting is performed as the sixth shooting.

  The up photographing is photographing for obtaining a photographed image (hereinafter, also referred to as an up image) in which the user's face and upper body are captured. Oblique photographing is photographing for obtaining a photographed image (hereinafter, also referred to as a slanted image) in which a user's face and upper body are photographed at an angle. Whole-body imaging is imaging for obtaining a captured image (hereinafter, also referred to as a full-body image) of the whole body of the user.

  Therefore, in step S22, up shooting is performed as the first shooting.

  Thereafter, in steps S23 and S24, the photographing control unit 312 performs up photographing as the second and third photographing, respectively.

  In step S25, the imaging processing unit 301 provides guidance for oblique imaging. Specifically, the display control unit 311 causes the touch panel monitor 93 to display a screen explaining how to perform oblique imaging. Thereafter, when it is time to shoot while the live view image is displayed on the touch panel monitor 93, in step S26, the shooting control unit 312 performs oblique shooting as the fourth shooting.

  Thereafter, in step S27, the imaging control unit 312 performs oblique imaging as the fifth imaging.

  In step S28, the imaging processing unit 301 provides guidance on the standing position. Specifically, the display control unit 311 causes the touch panel monitor 93 to display a screen describing a standing position away from the camera 91 for whole body imaging. Thereafter, when it is time to take a picture while the live view image is displayed on the touch panel monitor 93, in step S29, the photography control unit 312 performs the whole body photography as the sixth photography.

  As described above, three up images, two oblique images, and one whole body image are obtained as six captured images (still images).

  In step S30, the image processing unit 313 performs image processing according to the shooting course on each of the six captured images.

  Specifically, when the Light course is selected, the image processing unit 313 sets the saturation and lightness of each of the six captured images so that the texture of the skin of the subject becomes natural and moist. , Sharpness, and contrast (brightness).

  When the Clear course is selected, the image processing unit 313 sets the saturation, brightness, and sharpness of each of the six captured images so that the texture of the skin of the subject is fair and transparent. , And contrast (brightness).

  After that, the photographing processing unit 301 causes the storage unit 202 to store the six photographed images that have been subjected to the image processing according to the shooting course.

  In step S31, the shooting processing unit 301 guides the user who has finished shooting to move to the editing space A2-1 or the editing space A2-2. The guidance of the movement to the editing space is performed by displaying a guidance screen on the touch panel monitor 93 or by outputting a sound from the speaker 231.

  In the above-described shooting processing, a live view image is displayed at the time of shooting. Therefore, in the following, details of the process of displaying the live view image will be described.

<Details of live view image display processing>
FIG. 12 is a flowchart illustrating an example of the live view image display processing. Here, a live view image display process when up-shooting is performed will be described.

  First, in step S51, the display control unit 311 causes the touch panel monitor 93 to display a live view display screen on which a live view image is displayed.

  In step S52, the imaging control unit 312 controls the camera 91 to capture a moving image of the user.

  In step S53, the image processing unit 313 specifies a person area in the moving image. Here, since the up-photographing is performed, the person region in the moving image is an upper body region that is the region of the subject's upper body. Note that the upper body region includes a face region which is a region of the face of the subject.

  Specifically, the image processing unit 313 identifies a person area (face area) in the moving image by performing face recognition on the captured moving image. For example, the image processing unit 313 recognizes one face in a moving image based on the relative positions and sizes of face parts such as eyes and nose, and the shapes of cheekbones and jaw contours. It should be noted that the face may be recognized by another face recognition algorithm.

  In step S54, the image processing unit 313 performs image processing on the person area specified in the moving image. Here, as the image processing using the result of the face recognition, the following image processing is performed on the person area.

(1) Small Face Processing For example, as shown on the left side of FIG. 13, first, contour points f11 to f15 and f21 to f25 of the faces of two subjects appearing in the captured moving image 411 are extracted. Next, as shown in the center of FIG. 13, based on the extracted contour points, rectangular areas F1 and F2 including them are set. Then, as shown in the right side of FIG. 13, a process of reducing the set rectangular area with its upper side fixed is performed.

  Specifically, a deformation process is performed on a region near the boundary of the rectangular region such that the region outside the rectangular region is extended so that the region inside the rectangular region is contracted. In this way, in the region near the boundary of the rectangular region, the rectangular region is reduced without causing pixel loss.

  In addition, first, as shown on the left side of FIG. 14, the outlines L1 and L2 of the faces of the two subjects appearing in the captured moving image 411 are specified. Then, as shown on the right side of FIG. 14, by moving the specified outlines L1 and L2 to the inside of the face area, new outlines C1 and C2 are set.

  Specifically, for the boundary region having a predetermined width around the contour lines L1 and L2, the deformation process is performed by expanding the region outside the boundary region so as to shrink the region inside the boundary region. Apply. In this way, the contour lines C1 and C2 are set in the boundary area without causing any pixel loss.

  Through the processing described above, the face of the subject is reduced.

(2) Eye Size Change Processing First, an image of an eye area is extracted from a face area of a subject appearing in a moving image. Then, the image of the extracted eye region is enlarged at a predetermined enlargement ratio. Several patterns of enlargement ratios may be prepared.

  The eye size is changed by such processing.

(3) Nasal processing First, an image of a nose region is extracted from a face region of a subject appearing in a moving image. Then, part or all of the extracted image of the nose region is reduced at a predetermined reduction ratio. Several patterns of reduction ratios may be prepared.

  Through such processing, the size and shape of the nose are changed.

(4) Mouth Size Change Processing First, an image of the mouth area is extracted from the face area of the subject shown in the moving image. Then, the extracted image of the mouth region is enlarged at a predetermined enlargement ratio or reduced at a predetermined reduction ratio. An enlargement ratio and a reduction ratio of several patterns may be prepared.

  Through such processing, the size of the mouth is changed.

(5) Eye shape change processing First, the outer corner or the inner corner of the eye is specified in the face area of the subject shown in the moving image. Then, the specified outer or outer corner of the eye is moved upward (toward the head), downward (toward the chin), or another direction by a predetermined distance.

  Through such processing, the shape of the eyes is changed, and the impression of the eyes, such as the sagging eyes and the crossed eyes, is changed.

(6) Mouth Change Process First, a corner of the mouth is specified in the face area of the subject shown in the moving image. Then, the specified mouth corner portion is moved upward (toward the head) by a predetermined distance.

  By such processing, the shape of the lip is changed, and the lip is changed to the lip when smiling. If the corner of the mouth is too high, the shape of the mouth may be changed by moving the corner of the mouth downward.

(7) Skin Color Change Processing First, a skin area is specified. Then, the color of the specified skin area is adjusted.

  Through such processing, the skin color is changed.

(8) Hair Color Change Processing First, a hair area is specified. Then, the color of the specified hair region is adjusted.

  By such processing, the color of the hair is changed.

(9) Makeup Processing First, a cheek portion and a lip portion are specified in a face region of a subject reflected in a moving image. Then, the color of the specified cheek or lip region is changed to pink or red.

  By such processing, the face is changed to a face with makeup such as teak or lipstick.

(10) Beautiful Skin Processing Blur processing is performed on the entire moving image and the skin area of the subject appearing in the moving image.

  By such processing, the skin is made to look beautiful.

  In step S54, at least two or more types of image processing among the above-described image processing are performed on the person area. Note that these image processings are performed regardless of any selection by the user.

  Returning to the flowchart of FIG. 12, in step S55, the display control unit 311 displays, on a live view display screen, a moving image on which a plurality of types of image processing has been performed as a live view image in real time.

  FIG. 15 is a diagram illustrating an example of the live view display screen.

  An image display area 451 is provided substantially at the center of the live view display screen. In the image display area 451, a moving image showing two users is displayed in real time. Below the image display area 451, shooting result display areas 461 to 466 are provided. In the photographing result display areas 461 to 466, photographed images obtained as a result of photographing performed six times are displayed each time photographing is completed.

  In the example of FIG. 15, it is assumed that a moving image displayed in the image display area 451 has been subjected to a plurality of types of image processing.

  Then, in step S56, the imaging control unit 312 determines whether or not the imaging timing has come. If it is determined that the shooting timing has not been reached, the process returns to step S52. That is, a live view image on which a plurality of types of image processing have been performed is continuously displayed.

  On the other hand, if it is determined in step S56 that the shooting timing has come, the display of the live view image ends, and shooting is performed.

  According to the above processing, the image processing is performed on the person area in the live view image without performing any operation by the user. Thereby, the user can easily imagine the finish of the image.

  When the user is standing at the end of the shooting range of the camera 91, face recognition is not performed, and the above-described image processing may not be performed. Therefore, the user can stand at an appropriate standing position by checking the live view image and trying to better reflect it.

  In the above description, the image processing using the result of the face recognition is performed on the face area.

  However, the present invention is not limited thereto, and a mask image for acquiring a face area or a skin color area may be generated, and image processing using the mask image may be performed on the face area.

  Furthermore, in the live view image display processing when whole body imaging is performed, a mask image for acquiring the entire human area may be generated, and image processing using the mask image may be performed on the human area. Good. Image processing using the mask image of the entire human area includes leg length processing for lengthening the subject's leg and slimming processing for making the subject's body thinner.

  Note that the above-described live view image display processing is performed for each of the shootings performed six times. In this case, the same image processing as that of the live view image is performed on each of the six captured images obtained as a result of capturing.

  Note that the live view image display processing described above may not be performed for a predetermined number of times of imaging performed six times.

  For example, for the first shooting, the live view image display processing described above is not performed. Thus, the user can clearly recognize the effect of the image processing due to the difference between the live view image at the time of the first shooting and the live view image at the time of the second shooting. In this case, the photographed image obtained as a result of the first photographing may not be printed on a sticker sheet or transmitted to the portable terminal. Further, the photographed image may be transmitted to the portable terminal without being printed on the sticker paper.

  Further, the photo sticker creating device 1 may store a moving image on which a plurality of types of image processing have been performed. Further, the moving image stored in the photo sticker creating device 1 may be transmitted to the user's portable terminal via the server. This allows the user to upload a moving image on which a plurality of types of image processing have been performed to a blog, an SNS (Social Networking Service), or the like.

  In this case, a moving image on which a plurality of types of image processing have been performed may be stored before and after the shooting timing.

  Conventionally, when a user closes his / her eyes at an original shutter timing, for example, there is a possibility that an eye area cannot be specified in an obtained captured image. In this case, image processing cannot be performed on the eye region.

  Therefore, a moving image obtained by performing image processing on the eye region is stored before and after the photographing timing. Thus, even in the case described above, a captured image (still image) in which image processing has been performed on the eye region can be obtained from frames before and after the shutter timing.

<About cases where image processing is performed>
The image processing described above may be performed on the live view image only in a specific case.

(Case where image processing is performed according to the shooting range)
For example, whether or not the above-described image processing is performed may be determined according to the shooting range. Even if image processing is performed on a face part in a moving image when the whole body is photographed, it is difficult for a user to confirm the image processing. Therefore, the image processing may be performed on the face part in the moving image only when the close-up shooting is performed. That is, when full-body imaging is performed, image processing may not be performed on face parts in a moving image. Further, the leg length processing and the slimming processing described above may be performed on the person region in the moving image only when the whole body imaging is performed. Furthermore, a part of the body to be subjected to image processing in a person region in a moving image may be changed between a case where whole body imaging is performed and a case where close-up imaging is performed.

  In addition, image processing may be performed with different parameters depending on whether up-shooting is performed or when whole-body shooting is performed.

  More specifically, in the case where close-up shooting is performed rather than where full-body shooting is performed, the parameters of image processing (small face size, eye size, etc.) applied to the face parts are increased. Since the close-up image has a larger face than the whole-body image, the user can easily confirm the result of the image processing.

  Conversely, the parameters of the image processing performed on the face parts are higher when the whole body is photographed than when the close-up photographing is performed. In this case, when the user enlarges the whole-body image, he or she notices that image processing has been performed on the details in the same manner as the up image. Thereby, the user can handle the whole body image as the photographing result not only for recording the coordination of the day, but also for recording the face part like an up image.

  Of course, the image processing may be performed with the same parameters when the up-photographing is performed and when the whole-body photographing is performed.

  Note that the image sticker creating apparatus 1 sets parameters of image processing (including the strength of image processing and ON / OFF (presence / absence) of image processing) in the case where the close-up shooting is performed and the case where the whole body shooting is performed. This may be done or the user may set it.

(Case where image processing is performed according to the shooting course)
In addition, whether or not the above-described image processing is performed may be determined according to a course regarding shooting. The shooting course is for determining what kind of processing is performed as various processing related to shooting. The course for shooting is determined by the user's choice. That is, whether or not the above-described image processing is performed is determined in accordance with an indirect selection of selecting a course related to photographing, without depending on a direct selection by the user.

  For example, in a case where the user selects the above-described image capturing course before photographing, the above-described image processing is performed when a specific image capturing course is selected.

  Further, before photographing, the user may be allowed to select a number course for determining the type of photographing according to the number of subjects.

  At this time, whether or not image processing is performed is determined according to the selected number course. As the number of subjects increases, the faces of the subjects overlap in the live view image, and the possibility of face recognition failure increases. Therefore, when a number course in which shooting corresponding to a large number of people is performed is selected, image processing is not performed. Conversely, when a number course in which photographing corresponding to a small number of persons such as one person or two persons is performed is selected, image processing is performed.

  Further, before shooting, the user may be allowed to select a background course that determines the type of background image that is the background of the shot image. In this case, the background image of the selected background course is also combined with the background of the live view image.

  At this time, it is determined whether or not the image processing is to be performed according to the selected background course. For example, when a background course in which a background image based on white is combined is selected, especially in the up image, the face region is conspicuous, so that image processing is performed. On the other hand, when a background course in which a background image of a color in which the face area is not conspicuous in the up image is selected, image processing is not performed. Note that the parameters of the image processing (the strength of the image processing) may be changed according to the selected background course.

  Furthermore, the user may be allowed to select an image for synthesis (stamp image) to be synthesized with the shot image before shooting. In this case, the stamp image may be selected independently, or may be selected in combination with the background image.

  A stamp image corresponding to a face part is prepared as such a stamp image. This stamp image is synthesized with the corresponding face part in the captured image by face recognition of the captured image (still image).

  At this time, whether or not image processing is to be performed is determined according to the selected stamp image. For example, when a stamp image corresponding to a face part is selected, a stamp image is eventually combined with the face part, so that image processing is not performed on the face part.

  In the photographing process, for example, photographing for identifying the faces of a plurality of users may be performed as the first photographing. In this case, the user may be made to select whether or not to perform image processing on the face area of the user shown in the live view image using the identification result. Note that this selection may be made for all shootings performed a plurality of times, or this selection may be made for each shooting.

  Furthermore, the content of the image processing performed on the live view image or the captured image as a captured result may be changed by the user in the editing process. Thus, for example, when the user does not like the result of the eye size changing process performed in the photographing process, the eye size in the photographed image can be corrected to a desired size in the editing process.

<Control of hardware configuration according to image processing>
The hardware configuration in the shooting space A1 is controlled according to whether or not image processing is performed on the live view image, or according to the level of image processing to be performed and the number of types of the image processing. It may be.

(Emission control of lighting equipment)
First, in accordance with image processing performed on a live view image, emission of steady light emitted from a lighting device 222 (fluorescent lamp provided in each strobe unit) provided in the imaging space A1 is controlled. It may be. Specifically, the presence / absence of light emission of each strobe unit and the amount of light emission are controlled.

  When image processing is performed on the live view image, the user gazes at the touch panel monitor 93 in order to confirm that the image processing has been performed. Therefore, when image processing is performed on the live view image, the light emission amount of the front strobe unit 92 provided near the touch panel monitor 93 is increased. This makes it easier for the user to check the live view image displayed on the touch panel monitor 93.

  In the example described above, whether or not image processing is performed is determined according to the shooting range. In this case, the light emission of each strobe unit may be controlled in accordance with the shooting range. For example, when full-body imaging is performed, all strobe units in the imaging space A1 are caused to emit light. On the other hand, when the up-photographing is performed, among the strobe units in the photographing space A1, the strobe units excluding the ceiling strobe unit 32, the back right strobe unit 122, and the back left strobe unit 123 are caused to emit light.

(Camera parameter control)
Further, according to the image processing performed on the live view image, the F value, the shutter speed, and the ISO sensitivity are controlled as parameters of the camera 91.

  Furthermore, when sufficient brightness cannot be secured due to the user's standing position, the F-number, shutter speed, and ISO sensitivity of the camera 91 are controlled as in the following example. As a first example, only the F value is reduced. As a second example, only the ISO sensitivity is increased. As a third example, the F value and the ISO sensitivity are increased and the shutter speed is reduced. In this way, sufficient brightness is ensured.

  Further, white balance (color temperature) may be controlled as a parameter of the camera 91 in accordance with image processing performed on the live view image. For example, when a process for converting a live view image to a reddish image or a process for converting the image to a bluish image is performed, the white balance is controlled to correspond to these colors. Thereby, the load of image processing can be reduced.

<Display control of live view image according to image processing>
Furthermore, the display of the live view image itself may be controlled according to whether or not the above-described image processing is performed on the live view image.

  For example, the size of the display area of the live view image on the live view display screen is changed depending on whether or not image processing is performed on the live view image (in accordance with the presence or absence of the image processing). I do. Specifically, when image processing is performed on the live view image, the display area of the live view image is changed from the image display area 451 to a larger image as shown in the live view display screen of FIG. The display area is changed to the display area 451A. When the image processing is not performed on the live view image, the size of the display area of the live view image is not changed while the image display area 451 remains. Thereby, the user can often confirm the live view image on which the image processing has been performed.

  The display area of the live view image may be enlarged / reduced by a user operation such as pressing an enlarge / reduce button.

  Further, the display time of the live view image on the live view display screen is changed according to whether or not image processing is performed on the live view image. Specifically, when image processing is performed on the live view image, the display time of the live view image is lengthened. When image processing is not performed on the live view image, the display time of the live view image is shortened. Thereby, the user can often confirm the live view image on which the image processing has been performed.

  Further, the user may be able to select a shutter timing depending on whether or not image processing is performed on the live view image. Specifically, when image processing is performed on a live view image, a user can select a shutter timing. Thus, the user can leave a pose or expression at a desired moment in the captured image while checking the live view image on which the image processing has been performed.

<Face recognition errors and countermeasures>
By the way, erroneous recognition may occur in face recognition performed when performing image processing on a live view image.

  For example, when the user poses such that his / her hand is placed on the chin, the area of the hand may be included in the face recognition target. Further, when the user is wearing a T-shirt or the like on which the face of a person is printed, the printed face may be subjected to face recognition in addition to the face of the user.

  Therefore, in the following, a configuration and an operation in which measures against erroneous face recognition are taken will be described.

<Another configuration example of the photographing processing unit>
FIG. 17 is a diagram illustrating another configuration example of the photographing processing unit.

  Note that the configuration of the imaging processing unit 301 in FIG. 17 is basically the same as the configuration of the imaging processing unit 301 in FIG. 9, but differs in further including an area determination unit 501.

  The region determination unit 501 determines the validity of the person region in the moving image captured by the camera 91 and specified by the image processing unit 313.

<Other example of live view image display processing>
FIG. 18 is a flowchart illustrating another example of the live view image display processing.

  The processes in steps S61 to S63 and S65 to S67 in the flowchart in FIG. 18 are the same as those in steps S51 to S56 in the flowchart in FIG. 12, and a description thereof will be omitted.

  In step S63, it is assumed that a person area in the moving image is specified by performing face recognition on the captured moving image.

  In step S64, the area determination unit 501 determines the validity of the specified person area using the color, shape, size, and the like of the person area.

(Example 1)
For example, in the case of up-shooting, the region determination unit 501 extracts a region of a flesh-colored portion in a captured moving image. Here, for example, in the moving image, it is determined whether or not the R component of the hue, the luminance, and the RGB is equal to or more than a predetermined value, or is a value within a predetermined range. Is specified. Then, the region determination unit 501 determines the validity of the region based on whether or not the region specified as the face region corresponds to the extracted skin color region. At this time, the validity of the area specified as the face area may be determined based on the shape and size of the skin color area.

(Example 2)
In the case of close-up shooting, the area determination unit 501 acquires the shape and size of the face part included in the area specified as the face area, and the shape and size of the contour of the area specified as the face area. The area determination unit 501 determines the validity of the area specified as the face area by comparing the shape and size of the acquired face parts and contours with data prepared in advance.

(Example 3)
Further, in the case of close-up shooting, the area determination unit 501 calculates the inclination of the area considered to be a face area by extracting a predetermined contour point of the area specified as the face area. The area determining unit 501 determines the validity of the area specified as the face area based on whether the calculated inclination is within a predetermined range.

(Example 4)
In addition, the area determination unit 501 extracts an area excluding the background area from the captured moving image. The area determination unit 501 determines the validity of the area specified as the person area based on the extracted area. The background region may be specified from a moving image or a photographed result taken in the past, or may be specified based on the color.

  As described above, the validity of the region specified as the person region is determined.

  Then, in step S65, image processing is performed on the person area determined to be valid.

  According to the above-described processing, even when erroneous recognition occurs in face recognition, as a result, image processing is appropriately performed on a person region in a live view image. As a result, the user can easily and reliably imagine the finish of the image.

  In addition, as a result of the validity determination in the above-described processing, if erroneous recognition has occurred in face recognition, the erroneous recognition such as “Failed in face recognition” is displayed in a predetermined area of the live view display screen. May be displayed. With this message, the user can reset the pose.

<Modification>
In the above example, the parameters of the image processing (the strength of the image processing) are determined without direct selection by the user. However, the image processing parameters may be determined by the user's selection.

  For example, a selection screen for selecting an eye size is displayed before the live view display screen is displayed. On the selection screen, for example, buttons corresponding to three types of eye sizes are displayed. When any button is selected on the selection screen, an eye size change process corresponding to the selected button is performed on the live view image displayed on the live view display screen.

  Thus, the image processing desired by the user is performed on the live view image, so that the user can better image the finish of the image.

  Further, a background image to be combined with the background of the live view image may be selectable on the live view display screen. These background images may include a stamp image synthesized with the foreground of the subject as a foreground image.

  In this case, the user can switch the background image displayed by being synthesized with the background of the live view image. In other words, the user can select a background image that matches the pose or facial expression of the user, and image the finish.

<Course selection issues>
By the way, in the related art, when selecting a course related to shooting, not a few users have selected the course without understanding the difference between the courses.

  For example, it is assumed that two buttons for selecting a Light course and a Clear course are provided on the above-mentioned reflection course selection screen. On each button, a model image that has been subjected to image processing according to each course is displayed. In the vicinity of each button, a message is described which describes what the captured image looks like in each of the shooting courses.

  Even with such a reflection course selection screen, the user could not imagine the finish of the image obtained when each of the courses was selected. As a result, the user may not be able to provide a desired image.

  Therefore, in the photo sticker creating apparatus 1 of the present embodiment, a live view image is displayed on the reflection course selection screen, and image processing corresponding to the selected course is performed on the live view image.

<Example of reflection course selection processing>
FIG. 19 is a flowchart illustrating an example of the reflection course selection process.

  First, in step S71, the display control unit 311 causes the touch panel monitor 93 to display a reflection course selection screen.

  FIG. 20 is a diagram illustrating an example of the reflection course selection screen.

  An image display area 511 is provided from the upper center to the middle of the reflection course selection screen. The image display area 511 is an area where a moving image (live view image) captured by the camera 91 is displayed.

  A button 521 is provided on the left side of the image display area 511, and a button 522 is provided on the right side of the image display area 511. The button 521 is a button for selecting the Light course as the reflection course. The button 522 is a button for selecting a Clear course as a reflection course.

  An OK button 523 is provided below the button 522. The OK button 523 is a button for confirming the shooting course selected by operating the button 521 or the button 522.

  Returning to the flowchart of FIG. 19, in step S72, the imaging control unit 312 captures a moving image reflecting the user by controlling the camera 91.

  In step S73, the display control unit 311 accepts selection of a shooting course based on an operation on the button 521 or the button 522.

  In step S74, the image processing unit 313 performs image processing corresponding to the selected shooting course on the moving image captured by the camera 91.

  Specifically, when the button 521 is selected (when the Light course is selected), the image processing unit 313 determines that the texture of the skin of the subject is natural for the person region of the moving image captured by the camera 91. Adjust saturation, brightness, sharpness, and contrast (brightness) so that the image will be moist.

  Further, when the button 522 is selected (when the Clear course is selected), the image processing unit 313 changes the texture of the subject's skin to a transparent and light-colored image for the person region of the moving image captured by the camera 91. Adjust the saturation, lightness, sharpness, and contrast (brightness) so that there is something.

  In step S75, the display control unit 311 causes the moving image subjected to any image processing to be displayed in real time in the image display area 511 of the shooting course selection screen as a live view image.

  Then, in step S76, the display control unit 311 determines whether the OK button 523 has been pressed. If it is determined that the OK button 523 has not been pressed, the process returns to step S72. That is, the reflection course selection screen (live view image) is continuously displayed.

  On the other hand, if it is determined in step S76 that the OK button 523 has been pressed, the shooting course selected at that time is determined. If the OK button 523 has not been pressed when a predetermined time has elapsed since the display course selection screen was displayed, one of the reflection courses (for example, the Light course) is determined. Thereafter, the display of the reflection course selection screen ends, and the first shooting is performed (step S22 in FIG. 11).

  According to the above processing, the live view image on which the image processing corresponding to the imaging course selected by the user has been performed is displayed in real time on the imaging course selection screen. This allows the user to check the difference between the live view images depending on the respective shooting courses. That is, the user can imagine the finish of the image obtained when each course is selected. As a result, an image desired by the user can be provided.

  In the example described above, a background image according to the selected shooting course may be combined with the background area in the live view image.

  As in the above-described Clear course, for example, in the case where a process for converting a live view image to a bluish image is performed, a bluish background image is combined with a background region in the live view image. I do. As a result, it is possible to reduce the processing for the background area and reduce the load of image processing.

<Display example of live view image>
In the above-described example, the number of the reflection courses is two, but may be three or more. If the number of shooting courses is large, the degree of freedom in selecting the shooting can be increased.

  Further, the image processing corresponding to the shooting course may be switched and performed on the live view image at predetermined time intervals. This allows the user to confirm the difference between the live view images depending on the respective shooting courses without performing a selection operation.

  Further, the display time and display size of the live view image may be changed according to the number of users.

  For example, when the number of users is large, it takes time for each user to check the live view image. Therefore, when the number of users is large, the display time of the live view image is lengthened. In this case, the number of times of shooting may be reduced. When the number of users is large, the display size of the live view image is increased. Thereby, the visibility from each user can be improved.

<Timing of selection of reflection course>
In the example described above, the selection of the shooting course is performed before the first shooting. The present invention is not limited to this, and the selection of the shooting course may be performed before another shooting.

  For example, the shooting course may be selected before the last shooting (after the fifth shooting) of the six shootings. The user is accustomed to taking facial expressions and poses every time the number of times of shooting is increased, and can perform shooting work with a margin. Therefore, by making the selection of the shooting course before the last shooting, the user can select the shooting course with a margin.

  In this case, the image processing corresponding to the last selected shooting course may be performed on the six shot images (still images) obtained by the shooting performed six times, and displayed as a shooting result. .

  In addition, image processing corresponding to a shooting course other than the shooting course selected before the first shooting may be performed on, for example, a live view image displayed at the time of the last shooting.

  Further, the user may be allowed to select which time the photographing course is selected before photographing.

  Further, there may be two or more timings at which the shooting course is selected. For example, on the live view display screen at the time of the second or subsequent shooting, a button for changing the shooting course selected before the first shooting is displayed. Thus, when the user is not satisfied with the initially selected shooting course, another shooting course can be selected.

  Furthermore, the selection of the shooting course may be performed before (for example, each time of) each of the six shootings. In this case, each photographed image has a different atmosphere, and a variety of seal papers can be obtained.

  When the shooting course is selected when the live view image is displayed, the display time of the live view image in the current shooting may be set longer than the display time of the live view image in another shooting. Thereby, the user can confirm the live view image on which the image processing has been performed until the user is satisfied. It should be noted that a user accustomed to the game can select a shooting course without taking much time, so that the extra time, for example, the time of the editing process may be extended.

<Other course selection examples>
In addition, a live view image on which image processing corresponding to the selected course has been performed may be displayed on a selection screen for selecting another course related to shooting without being limited to the shooting course.

  Courses related to shooting include, for example, a number course and a background course.

  The number course is a course for determining the type of shooting according to the number of subjects. The number-of-person course includes, for example, a one-person course in which shooting suitable for one user is performed, a two-person course in which shooting suitable for two users is performed, and There are a large number of courses in which shooting suitable for three or more, particularly four or more, is performed.

  For example, a button for selecting the above-described number course is provided on the number course selection screen for selecting such a number course. In addition, the number course selection screen is provided with an image display area in which a moving image (live view image) captured by the camera 91 is displayed.

  When one of the buttons (number course) is selected on the number course selection screen, image processing corresponding to the selected number course is performed on the moving image captured by the camera 91. The moving image on which the image processing has been performed is displayed in real time in the image display area as a live view image. At this time, a frame indicating the position where the faces of the selected number of courses should be accommodated may be superimposed and displayed on the live view image.

  On the other hand, the background course is a course for determining the type of background of a captured image obtained by shooting. For the background course, a background image with a color based on black and white with low saturation is prepared, so that the finish of the captured image is refined and calm atmosphere, and the primary color with high saturation There is a background course for preparing a background image of a color based on the image to make the finish of the captured image a gorgeous atmosphere.

  On the background course selection screen for selecting such a background course, for example, a button for selecting the above-described background course is provided. The background course selection screen is provided with an image display area in which a moving image (live view image) captured by the camera 91 is displayed.

  When any button (background course) is selected on the background course selection screen, the moving image captured by the camera 91 is subjected to image processing corresponding to the selected background course. The moving image on which the image processing has been performed is displayed in real time in the image display area as a live view image. At this time, a background image suitable for the atmosphere of the selected background course may be combined and displayed on the live view image.

  Furthermore, the live view image to which the selected image processing itself has been applied is displayed on the selection screen for selecting the image processing to be applied to the captured image, not limited to the above-described course related to the imaging. Good.

The image processing selected on the selection screen includes, for example, the above-described processes (1) to (10) described above.
(1) Small face processing (2) Eye size change processing (3) Beauty nose processing (4) Mouth size change processing (5) Eye shape change processing (6) Mouth change processing (7) Skin color change processing (8) Hair color Change processing (9) Makeup processing (10) Beautiful skin processing

  The selection screen is provided with, for example, buttons for selecting these image processing parameters (image processing strength and ON / OFF). Further, the selection screen is provided with an image display area in which a moving image (live view image) captured by the camera 91 is displayed.

  When any of the buttons is selected on the selection screen, the moving image captured by the camera 91 is subjected to image processing using the selected parameters. The moving image on which the image processing has been performed is displayed in real time in the image display area as a live view image.

  The image processing may include image processing for the whole body of the subject, such as the above-described leg length processing and slimming processing, in addition to the image processing for the face parts as described above.

  Here, when there are a plurality of users, the image processing with the selected parameters may be performed collectively on each of the subjects shown in the live view image, or may be performed on the selected subjects. May be applied individually.

  As a selection screen, not only a selection screen for selecting any one of the above-described courses or image processing related to shooting is displayed, but also a plurality of selection screens are sequentially displayed one by one. Is also good. For example, a selection screen for small face processing may be displayed after a reflection course selection screen, a number course selection screen, and a background course selection screen are displayed in this order. Further, after the reflection course selection screen is displayed, a selection screen for small face processing and a selection screen for eye size change processing may be displayed in order.

  Note that image processing for face parts, such as eye size change processing, is a highly important function in recent photo stickers. Therefore, the image processing on the face part may not be performed on the live view image, but may be performed on the captured image on which the image processing corresponding to the course related to the imaging has been performed. This allows the user to more reliably make his or her own face appearing in the captured image a desired face.

<Control of hardware configuration according to course>
Further, the hardware configuration in the imaging space A1 may be controlled according to the selected course related to imaging.

  Specifically, the emission of the steady light emitted by the illumination device 222 (fluorescent lamp provided in each strobe unit) provided in the shooting space A1 is controlled according to the selected course related to the shooting. .

  FIG. 21 is a flowchart illustrating an illumination control process of the illumination device 222. The process of FIG. 21 is started when a shooting course is selected on the shooting course selection screen.

  In step S81, the illumination control unit 314 determines whether or not the illumination device 222 (fluorescent lamp provided in each strobe unit) emits light, the amount of light emission, the emission color (color temperature), and the emission time according to the selected imaging course. And control.

  For example, when a process for converting a live view image to a reddish image or a process for converting it to a bluish image is performed in accordance with the selected shooting course, each of the processes is performed so as to correspond to these colors. The color temperature of the steady light emitted from the fluorescent lamp provided in the strobe unit is controlled. Thereby, the load of image processing can be reduced. As a result, the image processing speed is improved, and the image subjected to the desired image processing is output (displayed) faster.

  When the emission color is controlled, a three-color LED (Light Emitting Diode) or the like is provided inside each strobe unit instead of the fluorescent lamp.

  In the above-described photo sticker creating apparatus 1, one camera 91 and one touch panel monitor 93 are provided in the photographing space A1. However, for example, two cameras and two touch panel monitors may be provided in the vertical and vertical directions. Thereby, for example, in addition to photographing the subject from the front, it is possible to photograph the subject obliquely from above.

  Further, as a function of the photo sticker creating device 1, a configuration in which the camera is movable in the vertical direction may be adopted. In this configuration, for example, the subject can be photographed from the front, and also the subject can be photographed diagonally from above.

  Further, a camera and a touch panel monitor may be provided outside the shooting space (for example, the side panels 42A and 42B). Thereby, before the photographing process is performed, a course related to photographing can be selected, and a live view image on which image processing according to the selected course has been performed can be displayed.

  In the example described above, the emission of the steady light emitted from the fluorescent lamp provided in each strobe unit is controlled according to the selected course relating to the shooting.

  By the way, each strobe unit provided in the photographing space has a strobe light emitting tube that emits light in accordance with photographing and a steady light source that emits steady light. Note that the left strobe unit 83 and the right strobe unit 84 do not have a strobe arc tube, but have only a stationary light source. Of course, the left strobe unit 83 and the right strobe unit 84 may have a strobe light emitting tube and a steady light source.

  At the time of shooting, the strobe light emitting tube emits light in synchronization with shooting, thereby providing a shooting environment in which the subject is brightly photographed in the shooting space. On the other hand, in a time zone before photographing, the strobe light emitting tube does not emit light, but only the stationary light source emits light. Therefore, the shooting space in the time zone before shooting has a shooting environment different from the shooting space at the shooting timing.

  Therefore, the live view image displayed in the time zone before shooting has a different image from the shot image displayed as the shooting result. As a result, the user performs the photographing operation while feeling uncomfortable with the difference in the appearance of the live view image and the photographed image.

  Therefore, hereinafter, a configuration will be described in which the shooting space in the time zone before shooting is set to the same shooting environment as the shooting space at the shooting timing.

<Structure example of strobe unit>
(Example of the configuration of the upper flash unit)
22 and 23 show a configuration example of the appearance of the upper rear strobe unit 121.

  FIG. 22 shows a configuration example of the appearance of the upper rear strobe unit 121 as viewed from the imaging section 21 (camera 91) in the imaging space A1. FIG. 23 shows a configuration example of the appearance of the upper rear strobe unit 121 as viewed from the user's standing position in the photographing space A1.

  The light emitting surface of the upper rear strobe unit 121 is directed to a user (subject) standing in the photographing space A1. That is, the upper rear strobe unit 121 is installed so as to form a predetermined angle with the horizontal plane so that its light emitting surface faces a user standing in the photographing space A1.

  The light emitting surface of the upper rear strobe unit 121 is constituted by a flat transparent acrylic plate 611. A louver 612 is provided behind the transparent acrylic plate 611. Further, a flat milky acrylic plate (not shown) is provided behind the louver 612. Light from inside the upper strobe unit 121 is diffused by the milky white acrylic plate, and the light is guided by the louver in the direction of the user's standing position.

  FIG. 24 shows a configuration example of the inside of the upper strobe unit 121 with the transparent acrylic plate 611, the louver 612, and the like removed.

  The inside of the upper rear strobe unit 121 is a horizontally long box-shaped space on the left and right. Inside the upper back strobe unit 121, a strobe light emitting unit 621 is provided at the center position in the left-right direction.

  FIG. 25 shows the configuration of the strobe light emitting unit 621.

  The strobe light emitting unit 621 includes a strobe light emitting tube 631 that emits light at the timing of shooting, a V-shaped reflector 632, and a circuit unit 633.

  The strobe light emitting tube 631 has a cylindrical shape, and emits light in a 360 ° direction from the circumferential surface thereof.

  The V-shaped reflection plate 632 is composed of two planes forming a V-shape in a side view. The V-shaped reflector 632 is provided on the opposite side of the light emitting surface when viewed from the strobe light emitting tube 631. The light generated by the flash light emitting tube 631 is reflected toward the light emitting surface side by the reflecting surface on the inner corner side of the V character of the V-shaped reflecting plate 632. Since this reflected light is directly radiated to the subject side, the distance becomes short.

  With such a configuration, a hard light (light that directly hits a subject from a light source) is emitted to a user in the imaging space A1.

  The V-shaped reflection plate 632 is made of an aluminum plate. It should be noted that the present invention is not limited to the aluminum plate, and may be made of another metal plate or a resin plate as long as the reflectance of the reflection surface is equal to or more than that. When the V-shaped reflector 632 is made of an aluminum plate or another material, the reflectance of the reflection surface is increased by increasing the brightness of the color of the reflection surface or by making the reflection surface a color such as white or yellow. Height can be kept.

  The circuit unit 633 has a built-in circuit for causing the strobe light emitting tube 631 to emit light.

  Referring back to FIG. 24, a stationary light source 622 is provided on the left side of the strobe light emitting unit 621, and a stationary light source 623 is provided on the right side of the strobe light emitting unit 621.

  The stationary light sources 622 and 623 are constituted by LED light bulbs and are constantly turned on regardless of the photographing timing. That is, the stationary light sources 622 and 623 radiate the stationary light into the imaging space A1 via the milky white acrylic plate, the louver 612, and the transparent acrylic plate 611 (not shown).

  The stationary light sources 622 and 623 are arranged at positions where the light emitting portions thereof are close to the strobe light emitting unit 621. Thereby, the light emission of the stationary light sources 622 and 623 can be made closer to the light emission of the strobe light emitting tube 631. Specifically, the direction of light emission of the stationary light sources 622 and 623 can be substantially the same as the direction of light emission of the strobe light emitting tube 631. That is, the stationary light sources 622 and 623 can irradiate a user in the photographing space A1 with light similar to that of the strobe light emitting tube 631. As a result, the shooting space in the time zone before shooting can be set to the same shooting environment as the shooting space at the shooting timing.

  When the stationary light sources 622 and 623 are configured by light bulb-type fluorescent lamps, the light emitting portions generate heat. Therefore, it is necessary to dispose the stationary light sources 622 and 623 apart from the strobe light emitting unit 621. . Therefore, by configuring the stationary light sources 622 and 623 to be constituted by LED bulbs, the stationary light sources 622 and 623 can be arranged close to the strobe light emitting unit 621 without generating heat at the light emitting portion. .

(Example of rear left / right strobe unit)
Next, a configuration example of the rear right strobe unit 122 and the rear left strobe unit 123 will be described. Since the rear right strobe unit 122 and the rear left strobe unit 123 basically have the same configuration, a configuration example of the rear right strobe unit 122 will be described below as a representative.

  FIG. 26 shows a configuration example of the appearance of the rear right strobe unit 122.

  FIG. 26 shows a configuration example of the appearance of the rear right strobe unit 122 viewed from the direction of the entrance G2.

  The light emitting surface 651 of the rear right strobe unit 122 is directed to a user (subject) standing in the photographing space A1. The light emitting surface 652 is oriented in a direction parallel to the surface of the back panel 51. That is, the rear right strobe unit 122 is installed such that the light emitting surface 651 forms a predetermined angle with the surface of the rear panel 51, and the light emitting surface 652 forms a right angle with the surface of the rear panel 51.

  The light emitting surfaces 651 and 652 have the same configuration as the light emitting surface of the upper rear strobe unit 121 described above.

  FIG. 27 shows an example of the internal configuration of the rear right strobe unit 122 with the light emitting surface 651 removed.

  The inside of the rear right strobe unit 122 is a vertically elongated box-shaped space vertically. Inside the rear right strobe unit 122, a strobe light emitting unit 661 is provided at the upper end position in the vertical direction.

  The strobe light emitting unit 661 includes a strobe light emitting tube that emits light at the time of shooting. Note that, unlike the strobe light emitting unit 621 described with reference to FIG. 25, the strobe light emitting unit 661 does not include a V-shaped reflector. That is, the light emitted by the strobe light emitting tube of the strobe light emitting unit 621 is irradiated in a 360 ° direction from the circumferential surface.

  With such a configuration, soft light (light that indirectly hits a subject from a light source by being reflected or diffused) is emitted to a user in the imaging space A1.

  A stationary light source 662 is provided below the strobe light emitting unit 661.

  The stationary light source 662 is constituted by an LED light bulb and is constantly turned on regardless of the photographing timing. That is, the stationary light source 662 radiates the stationary light into the imaging space A1 via the light emitting surfaces 651 and 652.

  When the stationary light source 662 is configured by an LED light bulb, the light emitting portion can be arranged so as to be close to the strobe light emitting portion 661 similarly to the strobe unit 121 on the rear surface. Thereby, the light emission of the steady light source 662 can be made closer to the light emission of the strobe light emitting unit 661. Specifically, the direction of light emission of the stationary light source 662 can be substantially the same as the direction of light emission of the strobe light emitting unit 661. That is, the stationary light source 662 can irradiate a user in the imaging space A1 with light similar to that of the strobe light emitting unit 661. As a result, the shooting space in the time zone before shooting can be set to the same shooting environment as the shooting space at the shooting timing.

  Note that the strobe light emitting unit 661 can also adopt the configuration shown in FIG.

  The strobe light emitting portion 661 of FIG. 28 has a configuration similar to that of the strobe light emitting portion 621 of FIG. 25 (a strobe light emitting tube 631 (not shown), a V-shaped reflector 632, and a circuit unit 633), and a flat reflector 671. Have.

  The flat reflecting plate 671 is provided on the light emitting surface 651 side as viewed from the strobe light emitting tube 631. The plane reflecting plate 671 reflects, on its reflecting surface, light emitted to the light emitting surface 651 side by the light emission of the strobe light emitting tube 631 to the opposite side of the light emitting surface 651.

  The length in the height direction of the plane reflector 671 is longer than that of the V-shaped reflector 632, and the length in the width direction is longer than that of the V-shaped reflector 632.

  With such a configuration, the light emitted by the flash tube 631 does not directly travel to the light emitting surface side.

  In other words, the light emitted by the strobe light emitting tube 631 is reflected by the plane reflector 671 and the V-shaped reflector 632, and advances into the space inside the rear right strobe unit 122 opposite to the light emitting surface 651. . Then, the light reflected in the space inside the rear right strobe unit 122 proceeds to the light emitting surface 651 or the light emitting surface 652 side. That is, the light emitted by the flash tube 631 indirectly travels toward the light emitting surface 651 or the light emitting surface 652 as reflected light.

  With such a configuration, it is possible to irradiate a soft light to the user in the photographing space A1.

<Light intensity of strobe unit>
The upper back strobe unit 121 irradiates hard light to the top of the user's head as a subject. As a result, the entire hair of the user appears bright in the captured image.

  On the other hand, the rear right strobe unit 122 and the rear left strobe unit 123 irradiate soft light to both left and right sides of the user as a subject. Thereby, in the captured image, the boundary between the background and the person (user) becomes prominent.

  Here, when the light amounts of the rear right strobe unit 122 and the rear left strobe unit 123 are made equal to the light amount of the rear upper strobe unit 121, the user's face, particularly both cheeks, is irradiated with strong light. As a result, there is a possibility that "flash" may occur on the face of the user. "Terikari" means that the forehead and cheeks look shiny.

  When the light amount of the upper back strobe unit 121 is made equal to the light amount of the rear right strobe unit 122 and the rear left strobe unit 123, the entire hair of the user becomes dark. As a result, the three-dimensional appearance of the user's face may be impaired.

  Therefore, in the photo sticker creating apparatus 1 of the present embodiment, the light amount of the rear upper strobe unit 121 is made larger than the light amount of the rear right strobe unit 122 and the rear left strobe unit 123. As a result, it is possible to suppress "light" generated on the user's face and to maintain the three-dimensional appearance of the user's face.

  In this case, the light amount of the strobe light emitting tube 631 of the rear upper strobe unit 121 is set to be larger than the light amount of the strobe light emitting tube (strobe light emitting unit 661) of each of the rear right strobe unit 122 and the rear left strobe unit 123.

  Specifically, the wattage of the strobe light emitting tube 631 of the upper back strobe unit 121 is 9 W, and the wattage of each of the strobe light emitting tubes of the back right strobe unit 122 and the back left strobe unit 123 is 7 W.

  In accordance with this, the light amounts of the stationary light sources 622 and 623 of the rear upper strobe unit 121 are set to be larger than the light amounts of the stationary light sources 662 of the rear right strobe unit 122 and the rear left strobe unit 123, respectively.

  Specifically, the wattage of each of the stationary light sources 622 and 623 of the rear upper strobe unit 121 is 8.4 W (16.8 W in total), and the stationary light sources of the rear right strobe unit 122 and the rear left strobe unit 123 are respectively. 662 each have a wattage of 10W.

  Here, it is preferable that the brightness of the strobe light emitting tube of each strobe unit is equal to the brightness of the steady light source. Thus, the shooting space in the time zone before shooting can be set to the same shooting environment as the shooting space at the shooting timing. However, the brightness of the flash tube due to light emission depends on the capacitor capacity of the flash tube, the flash duration, the F-number of the camera 91 and the ISO sensitivity. Therefore, it is not easy to control the brightness by the light emission of the strobe light tube to be equal to the brightness by the light emission of the stationary light source.

  Therefore, the ratio of the light amount of the strobe light emitting tube 631 included in the rear upper strobe unit 121 to the light amount of the strobe light emitting tube (strobe light emitting unit 661) included in each of the rear right strobe unit 122 and the rear left strobe unit 123 is calculated by using the upper rear strobe. The ratio between the light amounts of the stationary light sources 622 and 623 of the unit 121 and the light amounts of the stationary light sources 662 of the rear right strobe unit 122 and the rear left strobe unit 123 is substantially the same.

  Specifically, for example, the EV value of the stationary light source of the rear upper strobe unit is set to be about 2.3 EV larger than the EV value of the stationary light source of each of the rear right strobe unit and the rear left strobe unit. These can be confirmed by measurement with a light meter.

  Further, the EV value of the strobe light emitting tube of the rear upper strobe unit is set to be about 2.3 EV larger than the EV value of the strobe light emitting tube of each of the rear right strobe unit and the rear left strobe unit. These can be confirmed by a conversion formula using the AV value calculated from the F value and the TV value calculated from the shutter speed.

  According to the above configuration, the shooting space in the time zone before shooting can be set to the same shooting environment as the shooting space at the shooting timing. As a result, the live view image displayed in the time zone before image capturing has almost the same appearance as the captured image displayed as the image capturing result. As a result, the user can perform the photographing operation without feeling uncomfortable with the difference between the live view image and the photographed image.

<Modification>
In the above, the configuration of the upper rear strobe unit 121, the rear right strobe unit 122, and the rear left strobe unit 123 provided on the back side of the user in the photographing space A1 have been described.

  Here, the upper strobe unit 82, the left strobe unit 83, and the right strobe unit 84 provided on the front side of the user in the photographing space A1 may adopt the above-described configuration.

  Specifically, each of the upper strobe unit 82, the left strobe unit 83, and the right strobe unit 84 is provided with a strobe light emitting tube that emits light in accordance with shooting and a steady light source that emits steady light.

  Then, the light amount of the upper strobe unit 82 is made larger than the light amounts of the left strobe unit 83 and the right strobe unit 84.

  Specifically, the light amount of the strobe light emitting tube of the upper strobe unit 82 is set to be larger than the light amount of the strobe light emitting tube of each of the left strobe unit 83 and the right strobe unit 84. Here, the amount of light of the strobe light emitting tube of the upper strobe unit 82 may be larger than the total amount of light of the strobe light emitting tube of each of the left strobe unit 83 and the right strobe unit 84.

  In accordance with this, the light amount of the steady light source of the upper strobe unit 82 is set to be larger than the light amount of the steady light source of each of the left strobe unit 83 and the right strobe unit 84. Also in this case, the amount of light of the steady light source of the upper strobe unit 82 may be larger than the total amount of light of the steady light source of each of the left strobe unit 83 and the right strobe unit 84.

  Further, the ratio of the light amount of the strobe light emitting tube of the upper strobe unit 82 to the light amount of the strobe light emitting tube of each of the left strobe unit 83 and the right strobe unit 84 is determined by the light amount of the steady light source of the upper strobe unit 82, The ratio between the light amount of the stationary light source of each of the left strobe unit 83 and the right strobe unit 84 is substantially the same.

  Even in such a configuration, the shooting space in the time zone before shooting can be set to the same shooting environment as the shooting space at the shooting timing, and as a result, the user can obtain the live view image and the shot image. The photographing operation can be performed without feeling uncomfortable with the difference in the image.

  By controlling the light amounts of the left strobe unit 83 and the right strobe unit 84 so that they do not interfere with the light of the upper strobe unit 82, the difference in brightness from the center of the user's face to the left and right thereof is reduced. It becomes gentle and can create a three-dimensional effect on the user's face. Further, in such a configuration, the left strobe unit 83 and the right strobe unit 84 can function as a catchlight. As a result, it is possible to provide a captured image in which the user's face is better captured.

  In addition, when the whole-body imaging described above is performed, it is necessary to make the irradiation range of the light by the upper rear strobe unit 121 and the upper strobe unit 82 wider than in the case where the close-up imaging is performed. .

  Therefore, the light amounts of the upper rear strobe unit 121 and the upper strobe unit 82 when the whole body is photographed may be made larger than those when the up photographing is performed.

  In the above-described embodiment, the photograph sticker creating apparatus 1 employs a configuration in which the obtained photographed image or edited image is printed on a sticker sheet and transmitted to a server to provide the photographed image or the edited image to the user's portable terminal. And The present invention is not limited to this, and it is also possible to adopt a configuration in which the photographed image and the edited image are not printed on the sticker paper but are transmitted to the server and provided only to the user's portable terminal. Conversely, it is also possible to adopt a configuration in which a photographed image or an edited image is not transmitted to the server, but is only printed on a sticker sheet.

  The series of processes described above can be executed by hardware or can be executed by software. When the series of processes described above are executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 7, this recording medium is distributed separately from the apparatus main body to distribute the program to an administrator of the photo sticker creating apparatus 1. It comprises a removable medium 205 including a flexible disk, an optical disk (including a CD-ROM and a DVD), a magneto-optical disk, or a semiconductor memory. In addition to these, the recording medium includes a ROM 206 in which a program to be distributed to an administrator in a state of being incorporated in the apparatus main body in advance, a hard disk included in the storage unit 202, and the like.

  In the present specification, the steps of describing a program recorded on a recording medium may be performed in chronological order according to the described order, or may be performed in parallel or This also includes processes executed individually.

  In the above, the print medium is not limited to sticker paper or photographic paper. For example, the image may be printed on paper or film of a predetermined size, a card such as a prepaid card or an IC (Integrated Circuit) card, or a cloth such as a T-shirt. In this case, a seal layout image on which one or a plurality of photographed images are arranged may be printed on these print media.

  Embodiments of the present technology are not limited to the above-described embodiments, and various changes can be made without departing from the gist of the present technology.

DESCRIPTION OF SYMBOLS 1 Photo sticker creation apparatus 91 Camera 201 Control unit 301 Image processing unit 311 Display control unit 312 Image control unit 313 Image processing unit 314 Lighting control unit 501 Area determination unit

Claims (10)

A camera that shoots the subject,
An image processing unit that performs predetermined image processing without depending on a direct selection by a user for an upper body region of a person region in a moving image captured by the camera,
A display control unit that displays a live view display screen in which the moving image subjected to the image processing is displayed in real time.
The display control unit may include a display area where the entire moving image is displayed on the live view display screen when the image processing is performed on the moving image, compared to when the image processing is not performed on the moving image. Photo sticker making equipment. The photograph sticker creation device according to claim 1, wherein the image processing unit performs a plurality of types of the image processing on the upper body region in the moving image. The photo sticker creation device according to claim 1, wherein the image processing unit performs the image processing using the result of the face recognition on the upper body region specified by performing the face recognition. The photo sticker creation device according to claim 3, wherein the image processing unit performs the image processing using the result of the face recognition on the face area specified by performing the face recognition. The photo sticker according to claim 1, wherein the image processing unit performs the image processing using the mask image on the upper body region specified by generating a mask image for acquiring the person region. Creating device. The photograph sticker according to any one of claims 3 to 5, further comprising an area determination unit that determines the validity of the specified upper body area using at least one of a color, a shape, and a size of the person area. Creation device. The image processing unit performs image processing with different parameters for the upper body region in a case where a close-up image capturing the face and the upper body of the subject is performed and a case where a full body image capturing the whole body of the subject is performed. The photo sticker producing device according to any one of claims 1 to 6. The display control unit, before the live view display screen is displayed, displays a course selection screen for allowing the user to select a course related to shooting,
The photograph sticker creation device according to any one of claims 1 to 7, wherein the image processing unit performs the image processing according to a course selected on the course selection screen on the upper body region in the moving image. The photograph sticker creation device according to claim 1, wherein the image processing unit performs the image processing on a still image obtained as a result of shooting. A display method of a photo sticker creating device including a camera for photographing a subject,
For the upper body region of the person region in the moving image captured by the camera, perform predetermined image processing without direct selection by the user,
Display a live view display screen in which the moving image subjected to the image processing is displayed in real time,
Increasing the display area where the entire moving image is displayed on the live view display screen, when the image processing is performed on the moving image, compared to when the image processing is not performed on the moving image. Display method.

Images