JP7032632B2 - Photographing game consoles, display methods, and programs - Google Patents

Description

The present technology relates to a photo-creating game machine, a display method, and a program, and more particularly to a photo-creating game machine, a display method, and a program that enable a user to provide a desired image.

Conventionally, a photo sticker machine installed in an amusement facility or the like is known. The photo sticker machine photographs the user and edits the captured image according to the operation of the user. The photo sticker machine prints the edited photographed image on the sticker paper.

In the photo sticker machine, for example, a background image selected by the user and a stamp image corresponding to the background image, which is a stamp image for a face synthesized in the area of the user's face, are displayed as a live view image. There is something to synthesize in.

Further, in recent photo sticker machines, image processing is performed to make the user's own face reflected in the photographed image look more cute.

Patent Document 1 and the like disclose a photo-seal machine that allows a user to select "a feeling of swelling", which is a degree of emphasis that makes the face and eyes look good, such as eye size, face size, and eyelash thickness. ..

JP-A-2015-210397

However, there is no photo sticker machine that allows the user to select a type of facial stamp image according to the feeling of swelling selected by the user.

The present technology has been made in view of such a situation, and makes it possible to provide an image desired by a user.

The photo creation game machine of the present technology displays a selection reception unit that accepts selections by the user and a selection screen that displays a stamp image for the face that is synthesized on the user's face in the photographed image obtained by shooting. The selection reception unit includes a display control unit for controlling, the selection reception unit receives selection of the intensity of image processing applied to the user's face reflected in the photographed image by the user, and the display control unit receives the selection of the intensity of the image processing applied to the user's face in the photographed image. The type of the face stamp image displayed on the selection screen is changed according to the intensity selected by the user.

The display method of the present technology controls the display of a selection reception unit that accepts selections by the user and a selection screen that displays a face stamp image synthesized on the user's face in the photographed image obtained by photography. The photo-creating game machine provided with the display control unit accepts the selection of the intensity of the image processing applied to the user's face reflected in the captured image by the user, and the intensity is selected by the user. A step of changing the type of the face stamp image displayed on the selection screen is included accordingly.

The program of the present technology displays a selection reception unit that accepts selections by the user and a selection screen that displays a stamp image for the face that is synthesized on the user's face in the photographed image obtained by photographing the computer. It is a program for functioning as a display control unit to be controlled, and the selection reception unit accepts the selection of the intensity of image processing applied to the user's face reflected in the captured image by the user, and the selection reception unit receives the selection. The display control unit is a program that changes the type of the face stamp image displayed on the selection screen according to the intensity selected by the user.

In the present technology, the user is accepted to select the intensity of the image processing applied to the user's face reflected in the captured image, and the selection screen is selected according to the intensity selected by the user. The type of face stamp image displayed in is changed.

According to this technology, it is possible to provide an image desired by a user.

It is a perspective view which shows the structural example of the appearance of the photograph sticker making apparatus of this technique. It is a perspective view which looked at the appearance of the photograph sticker making apparatus from another angle. It is a figure explaining the movement of a user. It is a figure which shows the structural example of the preselection part. It is a figure which shows the structural example of the photographing part. It is a figure which shows the structural example of the background part. It is a perspective view which shows the floor material. It is a figure which shows the configuration example of the front of an editing unit. It is a figure which shows the structural example of the side surface of an editing unit. It is a figure which shows the example of the sticker paper. It is a figure which shows the example of the layer composition of an edited image. It is a block diagram which shows the configuration example of the photograph sticker making apparatus. It is a block diagram which shows the functional structure example of the photograph sticker making apparatus. It is a block diagram which shows the functional structure example of the preselection processing part. It is a block diagram which shows the functional structure example of the photographing processing part. It is a flowchart explaining the photo sticker making game process. It is a flowchart explaining the preselection process. It is a figure which shows the example of the imadoki prime shooting selection screen. It is a figure which shows the example of the imadoki prime shooting selection screen. It is a flowchart explaining the stamp image display process for a face. It is a figure which shows the example of the stamp for a face. It is a figure which shows the example of the stamp for a face. It is a flowchart explaining the shooting process. It is a flowchart explaining the face stamp image composition processing. It is a figure which shows the example of composition of the face stamp. It is a figure which shows the example of composition of the face stamp.

<Appearance of photo sticker making device>
1 and 2 are perspective views showing a configuration example of the appearance of the photo sticker creating device 1.

The photo sticker creating device 1 is a game machine that provides a photographed image and an edited image. The photo sticker creating device 1 provides an image to a user by printing the image on a sticker paper or making the image viewable on the user's mobile terminal. The photo sticker creating device 1 is installed in an amusement facility such as a game center or a store.

The users of the photo sticker making device 1 are mainly high school girls and young women. In the photo sticker creating device 1, a plurality of users, such as mainly two or three people, can enjoy the game per set. Of course, in the photo sticker creating device 1, one user can enjoy the game.

In the photo sticker creating device 1, the user takes a picture by himself / herself as a subject. By editing, the user synthesizes a composite image such as handwritten characters or a stamp image with an image selected from the captured images obtained by shooting. As a result, the captured image is edited into a colorful image. The user receives a sticker paper on which the edited image, which is an edited image, is printed, and ends the series of games.

The photo sticker creation device 1 can be said to be a photo creation game machine that provides a photo creation game.

As shown in FIG. 1, the photo sticker creating device 1 is basically configured by being installed in a state where the photographing unit 11 and the editing unit 12 are in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected.

The photographing unit 11 has a box-shaped housing having a size large enough for a person to enter, and is composed of a preselection unit 20, a photographing unit 21, and a background unit 22. The preselection unit 20 is installed on the side surface of the photographing unit 21. The space in front of the preselection unit 20 is the preselection space in which the preselection process is performed. Further, the photographing unit 21 and the background unit 22 are installed at a predetermined distance from each other. The space formed between the photographing unit 21 and the background unit 22 is the photographing space in which the photographing process is performed.

As the preselection process, the preselection unit 20 provides guidance for introducing the game provided by the photo sticker creating device 1, and makes various settings in the photography process performed in the photography space. The preselection unit 20 is provided with a coin slot for the user to insert the price, a touch panel monitor used for various operations, and the like. The preselection unit 20 appropriately guides the user in the preselection space to the shooting space according to the availability of the shooting space.

The photographing unit 21 is a device for photographing a user as a subject. The photographing unit 21 is located in front of the user who has entered the photographing space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the shooting unit 21 facing the shooting space.

Assuming that the left side surface is the left side surface and the right side surface is the right side surface when viewed from the user facing the front in the shooting space, the left side surface of the photographing unit 21 is composed of the side panel 41A and the right side surface is composed of the side panel 41B. Will be done. Further, the front surface of the photographing unit 21 is composed of the front panel 42. The preselection unit 20 described above is installed on the side panel 41A. The preselection unit 20 may be installed on the side panel 41B.

The background portion 22 is composed of a back panel 51, a side panel 52A, and a side panel 52B. The back panel 51 is a plate-shaped member located on the back side of the user facing the front. The side panel 52A is a plate-shaped member attached to the left end of the back panel 51 and having a narrower width than the side panel 41A. The side panel 52B is a plate-shaped member attached to the right end of the back panel 51 and having a width narrower than that of the side panel 41B.

The side panel 41A and the side panel 52A are provided on substantially the same plane. The upper portions of the side panel 41A and the side panel 52A are connected by a connecting portion 23A which is a plate-shaped member. The lower portions of the side panel 41A and the side panel 52A are connected by, for example, a connecting portion 23A'which is a metal member provided on the floor surface. Similarly, the side panel 41B and the side panel 52B are provided on substantially the same plane. The upper portions of the side panel 41B and the side panel 52B are connected by the connecting portion 23B. The lower portions of the side panel 41B and the side panel 52B are connected by a connecting portion 23B'.

A flooring material 27, which is a plate-shaped member, is laid on the floor of the photographing space.

For example, a green chroma key sheet is attached to the surface of the back panel 51 on the shooting space side. The photo sticker creating device 1 takes a picture with a sheet for chroma key as a background, and performs chroma key composition in a shooting process and an editing process. As a result, the desired background image is combined with the background portion of the user in which the sheet is shown.

An opening formed by being surrounded by the side panel 41A, the connecting portion 23A, and the side panel 52A serves as an entrance / exit of the photographing space. Further, an opening formed by being surrounded by the side panel 41B, the connecting portion 23B, and the side panel 52B also serves as an entrance / exit of the photographing space.

Above the photographing space, a ceiling surrounded by the front surface of the photographing unit 21, the connecting portion 23A, and the connecting portion 23B is formed. A ceiling strobe unit 24 is provided in a part of the ceiling. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B.

The ceiling strobe unit 24 has a built-in strobe that irradiates light into the shooting space in accordance with shooting. Inside the ceiling strobe unit 24, a fluorescent lamp is provided in addition to the strobe. As a result, the ceiling strobe unit 24 also functions as lighting for the shooting space.

The editing unit 12 is a device for editing a captured image. The editing unit 12 is connected to the photographing unit 11 so that one side surface is in contact with the front panel 42 of the photographing unit 21.

Assuming that the configuration of the editing unit 12 shown in FIG. 1 is the configuration on the front side, the configuration used for the editing work is provided on each of the front side and the back side of the editing unit 12. With this configuration, two sets of users can perform editing work at the same time.

The front side of the editing unit 12 is composed of a surface 61 and a slope 62 formed above the surface 61. The surface 61 is perpendicular to the floor surface and substantially parallel to the side panel 41A of the photographing unit 21. A monitor with a built-in tablet and a stylus are provided on the slope 62 as a configuration used for editing work. On the left side of the slope 62, a columnar support portion 63A that supports one end of the lighting device 64 is provided. On the right side of the slope 62, a columnar support portion 63B that supports the other end of the lighting device 64 is provided. A support portion 65 for supporting the curtain rod 26 is provided on the upper surface of the support portion 63A.

A curtain rod 26 is attached above the editing unit 12. The curtain rail 26 is composed of a combination of three rails 26A to 26C. The three rails 26A to 26C are combined so that the shape when viewed from above is U-shaped. One ends of the rail 26A and the rail 26B provided in parallel are fixed to the connecting portion 23A and the connecting portion 23B, respectively, and the other ends of the rail 26A and the rail 26B are joined to both ends of the rail 26C, respectively.

A curtain is attached to the curtain rail 26 so that the space in front of the front and the space in front of the back of the editing unit 12 cannot be seen from the outside. The space in front of the front and the space behind the back of the editing unit 12 surrounded by the curtain are the editing spaces in which the user performs editing work.

As will be described later, the left side surface of the editing unit 12 is provided with a discharge port from which the printed sticker paper is discharged. The space in front of the left side of the editing unit 12 is a printing waiting space for the user to wait for the printed sticker paper to be ejected.

<About the movement of users>
Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described.

FIG. 3 is a plan view of the photo sticker creating device 1 as viewed from above.

The user inserts the price into the coin slot in the preselection space A0, which is the space in front of the preselection unit 20. Next, the user makes various settings according to the screen displayed on the touch panel monitor. For example, the user performs preselection work such as selection of a course related to shooting performed in the shooting space.

As shown by the white arrow # 1, the user who has completed the preselection work has a shooting space A1 formed between the shooting unit 21 and the background unit 22 from the entrance / exit G1 between the side panel 41A and the side panel 52A. to go into. The user performs shooting work by using a camera or a touch panel monitor provided in the shooting unit 21.

The user who has completed the shooting work can either leave the shooting space A1 from the entrance / exit G1 and move to the editing space A2-1 as shown by the white arrow # 2, or move to the editing space A2-1 as indicated by the white arrow # 3. Exit the shooting space A1 and move to the editing space A2-2.

The editing space A2-1 is an editing space on the front side of the editing unit 12. On the other hand, the editing space A2-2 is an editing space on the back side of the editing unit 12. Whether the user moves to the editing space A2-1 or the editing space A2-2 is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the vacant one of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts the editing work. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing work at the same time.

After the editing work is completed, printing of the edited image is started. When printing is started, the user who has completed the editing work in the editing space A2-1 moves from the editing space A2-1 to the printing waiting space A3 as indicated by the white arrow # 4. Further, the user who has completed the editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as indicated by the white arrow # 5.

The user who has moved to the print waiting space A3 waits for printing to finish. When printing is completed, the user receives the sticker paper discharged from the discharge port provided on the right side surface of the editing unit 12, and ends a series of photo sticker creation games.

Next, the configuration of each device will be described.

<Structure of preselection unit>
FIG. 4 is a diagram showing a configuration example of the preselection unit 20.

A touch panel monitor 71 is provided on the upper side of the preselection unit 20. The touch panel monitor 71 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated on the monitor. The touch panel monitor 71 has a function of displaying various GUIs (Graphical User Interfaces) and accepting a user's selection operation. The touch panel monitor 71 displays a screen used for selecting the number of users.

A speaker 72 is provided below the touch panel monitor 71. The speaker 72 outputs a guidance voice for preselection processing, BGM (Back Ground Music), a sound effect, and the like. A coin insertion / return port 73 for inserting coins by the user is provided adjacent to the speaker 72.

<Structure of shooting unit>
FIG. 5 is a diagram showing a configuration example of the front surface of the photographing unit 21. The photographing unit 21 is configured to be surrounded by the side panel 41A, the side panel 41B, and the front panel 42.

A camera unit 81 is provided slightly above the center of the front panel 42. A camera 91, a touch panel monitor 92, and a front strobe 93 are provided on the front surface of the camera unit 81.

The camera 91 is, for example, a single-lens reflex camera, and is mounted inside the camera unit 81 so that the lens is exposed. The camera 91 has an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and photographs a user in the photographing space A1. The camera 91 functions as a shooting unit that shoots with the user as a subject.

The moving image captured by the camera 91 (hereinafter, also referred to as a live view image) is displayed on the touch panel monitor 92 in real time. A still image captured by the camera 91 at a predetermined timing such as when shooting is instructed is saved as a shooting image.

The touch panel monitor 92 is provided below the camera 91. The touch panel monitor 92 is composed of a monitor such as an LCD and a touch panel laminated on the monitor. The touch panel monitor 92 has a function as a live view monitor that displays a moving image captured by the camera 91, and a function that displays various GUIs and accepts a user's selection operation.

The front strobe 93 is provided above the camera 91. The front strobe 93 has a crescent-shaped light emitting surface made of a milky white acrylic plate. The front strobe 93 emits light in accordance with the shooting by the camera 91 to illuminate the vicinity of the user's face as a subject from the front.

Above the camera unit 81, an upper strobe unit 82 with a curved light emitting surface facing the user is installed. The upper strobe unit 82 irradiates the user's face and upper body with light from above the front of the user.

Below the camera unit 81, a foot strobe unit 83 that irradiates the lower body and feet of the user with light is provided.

The upper strobe unit 82 and the foot strobe unit 83 are composed of a fluorescent lamp and a lighting device capable of emitting strobe light. The upper strobe unit 82 and the foot strobe unit 83 brighten the shooting space, constantly illuminate the shooting space in order to ensure user operability and safety, and improve the image quality of the shot image. The strobe emits light at the shooting timing to illuminate the user who is the subject.

A box-shaped portion 84 is provided between the foot strobe unit 83 and the side panel 41A. Further, a box-shaped portion 85 is provided between the foot strobe unit 83 and the side panel 41B. The upper surfaces of the box-shaped portions 84 and 85 form a surface substantially horizontal to the installation surface of the photo sticker making device 1, and are used as a luggage storage place for a user who performs photography work to put baggage and the like.

Although not shown, a speaker is provided near the ceiling of the front panel 42, for example. The speaker outputs guidance voice, BGM, sound effect, etc. for shooting processing.

<Structure of background part>
FIG. 6 is a diagram showing a configuration example of the background portion 22 on the photographing space A1 side.

A strobe 101 on the back surface is installed above the back panel 51. The strobe 101 on the back surface irradiates the user with light from above the back surface.

In the figure, the rear left strobe 102 is installed on the left side of the rear panel 51. The rear left strobe 102 irradiates the user from the rear right side. In the figure, the rear right strobe 103 is installed on the right side of the rear panel 51. The rear right strobe 103 irradiates the user from the rear left side.

Further, the chroma key sheet 121 is attached to the surface of the back panel 51 on the shooting space A1 side (front side in the drawing). The color of the chroma key sheet 121 is, for example, green.

Although not shown, the chroma key sheet is also attached to the lower side (floor surface side) of the surface of the side panels 52A and 52B on the photographing space A1 side in the same manner as the chroma key sheet 121.

FIG. 7 is a perspective view showing the floor material 27. For convenience of explanation, illustrations of the photographing unit 21, the side panel 41A, and the like are omitted.

A horizontally long rectangular floor sheet 27A is attached to a position near the rear of the floor material 27 so that its long side is substantially parallel to the back panel 51. In FIG. 7, the direction in which the back panel 51 is located is behind the photographing space A1, and the direction in which the photographing unit 21 is indicated by the white arrow is in front of the photographing space A1.

Mark figures 28-1 to 28-4 are printed side by side on the front side of the floor sheet 27A, and mark figures 28-5 to 28-8 are printed side by side behind the mark figures 28-1 to 28-4. The marker figures 28-1 to 28-8 arranged in 2 rows × 4 columns are visually different figures, and the whole is filled with black, for example.

The mark figure 28-1 on the first line is a diamond-shaped mark, and the mark figure 28-2 is a heart-shaped mark. The mark figure 28-3 is a four-leaf clover-shaped mark, and the mark figure 28-4 is a square mark.

Further, the mark figure 28-5 on the second line is a flower-shaped mark composed of four petals, and the mark figure 28-6 is a star-shaped mark. The mark figure 28-7 is a circular mark, and the mark figure 28-8 is a tulip petal-shaped mark.

Each mark figure has a size that fits within a range of approximately 30 cm × 30 cm so that one user can put both feet on it. Each size may be different.

The mark figures 28-1 to 28-8 are used as marks for guiding each user to the standing position at the time of shooting.

For example, when the number of users is two and an image showing a large upper body is taken, the four-leaf cloverleaf marker figure 28-is set as the standing position of the user standing on the right side of the camera 91. 3 is designated, and the heart-shaped marker figure 28-2 is designated as the standing position of the user standing on the left side.

The marker figures 28-1 to 28-8 are printed at positions where the optimum standing position can be specified according to the number of users, the angle of view (range) of the image to be captured, and the like. .. The optimum standing position means a position where the light from the strobe is sufficiently applied to the subject, a position where the camera 91 does not deviate from the shooting range, a position where the balance between the background and the size of the face is improved, and the like.

As the mark figure, a figure with a color other than black, a figure with a predetermined pattern, or a figure with a color and a pattern may be used. It is also possible to change at least one of the shape, size, pattern, and color for each marker figure. The mark figures 28-1 to 28-8 shown in FIG. 7 have the same color as black, but have different shapes.

<Structure of editing unit>
FIG. 8 is a diagram showing a configuration example of the front side (editing space A2-1 side) of the editing unit 12.

A monitor with a built-in tablet 131 is provided at substantially the center of the slope 62. A touch pen 132A is provided on the left side of the tablet built-in monitor 131. A stylus 132B is provided on the right side of the tablet built-in monitor 131.

The tablet built-in monitor 131 is configured by stacking a tablet and a display. The tablet enables operation input using the touch pen 132A or the touch pen 132B. The tablet built-in monitor 131 displays, for example, an editing screen used for editing work. When two users edit at the same time, the touch pen 132A is used by the user on the left side of the tablet built-in monitor 131, and the touch pen 132B is used by the user on the right side of the tablet built-in monitor 131. ..

The operation using the touch pen 132A and the operation using the touch pen 132B are distinguished. As appropriate, only the operation using the touch pen 132A is possible for the display on the left side of the tablet built-in monitor 131, and only the operation using the touch pen 132B is possible for the display on the right side. Hereinafter, when it is not necessary to distinguish between the touch pen 132A and the touch pen 132B as appropriate, they are collectively referred to as the touch pen 132.

FIG. 9 is a diagram showing a configuration example of the left side surface of the editing unit 12.

A sticker paper discharge port 161 is provided on the lower side of the left side surface of the editing unit 12. A printer is provided inside the editing unit 12. The printer prints an image of the user of the editing space A2-1 or an image of the user of the editing space A2-2 on the sticker paper in a predetermined layout and discharges the image from the sticker paper ejection port 161.

<Example of sticker paper>
FIG. 10 is a diagram showing an example of a sticker paper created by the photo sticker creating device 1.

When there are two users, for example, two stickers with photographs (edited images) printed in the layout shown in FIG. 10 are created and provided to the users. The layout shown in FIG. 10 is one of a plurality of types of layouts, and the user can select a desired layout.

An edited image printing area 181A having a size of a business card and a horizontally long strip-shaped extra image printing area 181B are formed on one sticker paper. The edited image 191-1 is printed in a large size on the substantially left half of the edited image print area 181A, and four edited images 191-2 to 191-5 are printed on the right side of the edited image 191-1 in two lines with a size smaller than that of the edited image 191-1. × Printed side by side in 2 columns.

The edited images 191-1 to 191-5 are images generated by editing the close-up image, which is an image in which the face and upper body of the subject are largely captured. Actually, a background image which is an image of a predetermined color or pattern is combined with the background of the user as appropriate, and a foreground image such as a handwritten character or a stamp image is combined with the foreground of the user.

In the shooting process, in addition to the close-up image, an image showing a wide range from above the head to near the knee is also shot. This image is used, for example, to keep the clothes coordinated. Hereinafter, an image having a wider shooting range than the close-up image, which is used to keep the coordination of clothes as appropriate, is referred to as a coordinate image.

The aspect ratio of the close-up image and the coordinated image are different. For example, the ratio of the horizontal length to the vertical length of the close-up image is 1: 1.2, and the ratio of the horizontal length to the vertical length of the coordinated image is 1: 1.5. In this example, the coordinated image is not printed on the sticker paper.

In the bonus image printing area 181B, photographed images 192-1 to 192-5 trimmed into a simple shape similar to the marker figures 28-1 to 28-8 printed on the floor sheet 27A are printed side by side. To. The image printed in the bonus image print area 181B is used by cutting it with scissors, for example.

Instead of the image before editing, the edited image (the same image as the edited images 191-1 to 191-5) may be trimmed and printed as captured images 192-1 to 192-5.

Bonus A sticker ID or the like is printed in the margin of the image print area 181B. The sticker ID is used when viewing an image transmitted from the photo sticker creation device 1 to the server on a mobile terminal such as a smartphone.

The image is transmitted to the mobile terminal via a server that manages an image acquisition site, which is a website for importing (storing) the image transmitted from the photo sticker creation device 1 into the mobile terminal. Users can post images captured on mobile terminals to SNS (Social Networking Service) or set them as wallpaper for use. Hereinafter, the server that manages the image acquisition site is referred to as an image acquisition site management server as appropriate.

FIG. 11 is a diagram showing an example of the layer structure of the edited image.

The leftmost edited image P1 is an image generated by editing. The edited image P1 is composed of images of each layer of the background image P11, the person image P12, and the foreground image P13.

In the example of FIG. 11, the background image P11 is an image of the pattern of the wall surface on which bricks are stacked. The foreground image P13 is an image including an image of handwritten characters of "Love my friend" and a heart-shaped image. The handwritten image of "Love my friend" is a pen image input by the user using the pen tool. The heart-shaped image is a stamp image input by the user using the stamp tool.

As described above, the edited image P1 is generated by superimposing the person image P12, which is an image of the area of the person extracted from the captured image by chroma key processing, on the background image P11, and superimposing the foreground image P13 on the background image P11. It is also possible to input a pen image or a stamp image on the background image P11 and display it on the background of the subject. Foreground images and background images may be combined with the captured image, and even after editing, they may not be combined depending on the user's operation.

<Internal configuration of photo sticker making device>
FIG. 12 is a block diagram showing a configuration example of the photo sticker creating device 1. In FIG. 12, the same configurations as those described above are designated by the same reference numerals. Duplicate explanations will be omitted as appropriate.

As shown in FIG. 12, in the photo sticker creating device 1, the preselection unit 302, the photographing unit 304, the editing units 305A and 305B, and the printing unit 306 are external input / output interfaces 303 with respect to the PC (Personal Computer) unit 301. It is configured by being connected via. The PC unit 301, which is an information processing unit, is housed inside the housing of the editing unit 12, for example.

The CPU (Central Processing Unit) 311, ROM (Read Only Memory) 312, and RAM (Random Access Memory) 313 constituting the PC unit 301 are connected to each other by a bus 314.

The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating device 1. The ROM 312 stores programs and data executed by the CPU 311. The RAM 312 temporarily stores data and programs processed by the CPU 311.

An input / output interface 315 is further connected to the bus 314. A storage unit 316, a communication unit 317, and a drive 318 are connected to the input / output interface 315.

The storage unit 316 is a non-volatile storage medium such as a hard disk or a flash memory. The storage unit 316 stores various setting information and the like supplied from the CPU 311. The information stored in the storage unit 316 is appropriately read out by the CPU 311.

The communication unit 317 is an interface of a network such as the Internet. The communication unit 317 communicates with an external device according to the control by the CPU 311. The communication unit 317 transmits the image selected by the user to, for example, an image acquisition site management server managed by the manufacturer of the photo sticker creation device 1. The image transmitted from the communication unit 317 is allocated and stored in a predetermined storage area, and is displayed on a mobile terminal that has accessed the image acquisition site management server, or downloaded to the mobile terminal.

A removable media 319 made of an optical disk, a semiconductor memory, or the like is appropriately mounted on the drive 318. The programs and data read from the removable media 319 by the drive 318 are supplied to the CPU 311 and stored or installed in the storage unit 316.

An external input / output interface 303 is connected to the input / output interface 315. The control of each unit by the PC unit 301 is performed via the external input / output interface 303.

The preselection unit 302 realizes the preselection process for the user in the preselection space A0. The preselection unit 302 includes a touch panel monitor 71, a speaker 72, and a coin processing unit 321.

The touch panel monitor 71 displays various selection screens according to the control by the PC unit 301, and accepts the user's operation on the selection screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and various settings are made.

The coin processing unit 321 detects the insertion of coins into the coin insertion / return port 73. When the coin processing unit 321 detects that a predetermined amount of coins has been inserted, the coin processing unit 321 outputs an activation signal instructing the start of the game to the PC unit 301.

The shooting unit 304 realizes shooting processing for the user in the shooting space A1. The photographing unit 304 includes a lighting device 331, a camera 91, a touch panel monitor 92, and a speaker 332.

The lighting device 331 is each strobe unit in the shooting space A1 and emits light according to a lighting control signal supplied from the PC unit 301.

The camera 91 shoots according to the shutter control by the PC unit 301, and outputs the captured image (image data) obtained by the shooting to the PC unit 301.

The editorial unit 305A realizes an editing process for a user in the editing space A2-1. The editorial unit 305A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 341. The editorial unit 305B realizes an editing process for a user in the editing space A2-2, and has the same configuration as the editorial unit 305A. Hereinafter, when the editorial units 305A and 305B are not particularly distinguished, they are simply referred to as the editorial unit 305.

The tablet built-in monitor 131 displays the edit screen according to the control by the PC unit 301, and accepts the user's operation on the edit screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and the captured image to be edited is edited.

The printing unit 306 is configured to include a printer 351. A sticker paper unit 352 is attached to the printer 351.

The printer 351 drives the built-in head 361 and prints an image on the roll-shaped sticker paper 363 stored in the sticker paper unit 352 based on the print data supplied from the PC unit 301. Further, the printer 351 cuts the sticker paper 363 on which the image is printed at a predetermined cut position by the cutter 362, and discharges the sticker paper 361 to the sticker paper discharge port 161.

<Example of functional configuration of photo sticker creation device>
FIG. 13 is a block diagram showing a functional configuration example of the photo sticker creating device 1. At least a part of the functional units shown in FIG. 13 is realized by executing a predetermined program by the CPU 311.

In the photo sticker creating device 1, a preselection processing unit 401, a shooting processing unit 402, an editing processing unit 403, and a printing processing unit 404 are realized.

The preselection processing unit 401 executes the preselection processing by controlling each unit of the preselection unit 302. By the pre-selection process, the number of users is selected, the background image is selected, and the like. Information indicating the content selected by the user is supplied to the photographing processing unit 402.

The photographing processing unit 402 performs imaging processing by controlling each unit of the photographing unit 304. The shooting processing unit 402 outputs the data of the shooting image obtained by performing the shooting processing to the editing processing unit 403. Data of a plurality of captured images obtained by performing imaging a plurality of times is supplied from the photographing processing unit 402 to the editing processing unit 403.

The editing processing unit 403 performs editing processing by controlling each unit of the editing unit 305. The editing process includes a process of adjusting the size of the user's eyes and the brightness of the skin in the captured image, a process of editing the captured image, and the like.

The editing process in the game provided by the photo sticker creating device 1 also includes a process of generating a moving image using a photographed image. This moving image is composed of each frame image obtained by synthesizing a captured image which is a still image, and is a moving image having a short reproduction time such as 7 seconds.

After the game is over, the user can access the image acquisition site management server, import the moving image into his / her mobile terminal, post it on SNS, and use it. Hereinafter, the moving image generated by using the captured image as appropriate is referred to as a portable mini moving image.

After finishing editing of the captured image, the editing processing unit 403 generates print data by arranging the edited image in a predetermined layout and outputs the print data to the print processing unit 404.

The print processing unit 404 outputs print data to the printer 351 and prints the edited image.

<Configuration example of preselection processing unit>
FIG. 14 is a block diagram showing a functional configuration example of the preselection processing unit 401.

The preselection processing unit 401 includes a display control unit 411 and a selection reception unit 412.

The display control unit 411 controls the display of the touch panel monitor 71. The display control unit 411 causes the touch panel monitor 71 to display various selection screens for accepting the user's selection.

The selection reception unit 412 accepts the user's selection of options on the selection screen displayed on the touch panel monitor 71.

<Configuration example of shooting processing unit>
FIG. 15 is a block diagram showing a configuration example of the photographing processing unit 402.

The shooting processing unit 402 is composed of a display control unit 421, a shooting control unit 422, a composition unit 423, and an image processing unit 424.

The display control unit 421 controls the display of the touch panel monitor 92. For example, the display control unit 421 causes the touch panel monitor 92 to display a live view image captured by the camera 91 in addition to a selection screen for accepting a user's selection, or to display a shot image which is a shot result. do.

The shooting control unit 422 controls the camera 91 to acquire a live view image or a shot image taken with the user as a subject.

The compositing unit 423 synthesizes the face stamp image selected by the user with the user's face reflected in the live view image or the captured image. As will be described later, the face stamp image is composed of images that imitate animal face parts (nose, ears, whiskers, etc.), and is the result of face recognition processing for the live view image and the captured image. It is combined with the user's face in the image.

The image processing unit 424 performs image processing on a part or all of the user's face reflected in the captured image according to the feeling of swelling selected by the user. The details of the feeling of swelling will be described later.

<Operation of photo sticker making device>
Here, the operation of the photo sticker creation device 1 that provides the photo sticker creation game will be described with reference to the flowchart of FIG.

In step S1, the preselection processing unit 401 determines whether or not a predetermined amount of coins has been inserted based on the activation signal supplied from the coin processing unit 321 and waits until it is determined that coins have been inserted. do.

If it is determined in step S1 that a coin has been inserted, the process proceeds to step S2. In step S2, the preselection processing unit 401 performs the preselection processing by controlling the preselection unit 302. Specifically, the preselection processing unit 401 is obtained by a number of people course that determines the type of game to be played according to the number of users as a course related to shooting performed in the shooting space, or a shooting performed in the shooting space. Various settings are made by letting the user select a background image that is the background of the captured image.

In step S3, the photographing processing unit 402 performs the photographing process by controlling the photographing unit 304. Specifically, the shooting processing unit 402 displays a moving image of the subject captured by the camera 91 in a live view on the touch panel monitor 92, shoots the user in the shooting space A1 as the subject, and generates a shot image.

In step S4, the editing processing unit 403 controls the editing unit 305 corresponding to the editing space of the editing space A2-1 and the editing space A2-2, which is the destination of the user who has completed the shooting process. Then, edit it. Specifically, the editing processing unit 403 generates an edited image by causing the user to perform editing work on the captured image obtained by the photographing process.

In step S5, the print processing unit 404 performs (starts) printing processing by controlling the printer 351. Specifically, the print processing unit 404 outputs the edited image obtained by the editing process to the printer 351 and prints it on the sticker paper. The photographed image obtained by the photographing process may be printed on the sticker paper.

When printing is completed, in step S6, the printer 351 discharges the sticker paper on which the image is printed to the sticker paper discharge port 161 and ends the process.

<Details of preselection processing>
Next, with reference to the flowchart of FIG. 17, the details of the preselection process of step S2 in the series of processes of the above-mentioned photo sticker creation game will be described.

When the pre-selection process is started, in step S11, the display control unit 411 displays the pre-mode selection screen on the touch panel monitor 71.

The pre-mode selection screen is a screen used for pre-mode selection. The pre-mode includes a normal pre-mode, which is a game mode in which an edited image in which a photographed image is colorfully edited is provided, and a proof pre-mode, which is a game mode in which a photographed image is provided as an image for proof photograph.

By operating the pre-mode selection screen, the selection reception unit 412 accepts the selection of the pre-mode. When the selection of any of the pre-modes is accepted, the process proceeds to step S12.

In step S12, the display control unit 411 displays the number of people selection screen on the touch panel monitor 71.

The number of people course selection screen is a screen used for selecting a number of people course that determines the type of shooting performed according to the number of users. The number of people course includes a two-person course in which shooting is performed when there are two users, and a three-person or more course in which shooting is performed when there are three or more users.

By operating the number of people course selection screen, the selection reception unit 412 accepts the selection of the number of people course. When the selection of any number of people course is accepted, the process proceeds to step S13.

In step S13, the display control unit 411 displays the background selection screen on the touch panel monitor 71.

The background selection screen is a screen used for selecting a background image to be a background of a photographed image obtained by photography. A plurality of background images are displayed on the background selection screen. The user can select a set background in which five background images corresponding to the five shot images obtained by the first to fifth shots of the shots performed in the shooting process are set. In the background selection screen, the user may be able to select each of the five background images separately.

By operating the background selection screen, the selection reception unit 412 accepts the selection of the background image. When the selection of the background image is accepted, the process proceeds to step S14.

In step S14, the display control unit 411 displays the imadoki prime shooting selection screen on the touch panel monitor 71.

The Imadoki prime shooting selection screen is a stamp image for the face corresponding to the "filled feeling" of the shot image obtained by the imadoki prime shooting performed as the fifth shooting of the shooting performed in the shooting process and the "filled feeling". This is the screen used to select. The "feeling of swelling" is an index showing the degree of emphasis on the cuteness of the user's face in the photographed image.

By operating the imadoki prime shooting selection screen, the selection reception unit 412 accepts the feeling of swelling and the selection of the stamp image for the face corresponding to the feeling of swelling. When the selection of the face stamp image is accepted, the process proceeds to step S15.

In step S15, the preselection processing unit 401 guides the user in the preselection space A0 to move to the shooting space A1. Guidance for moving to the shooting space A1 is performed by displaying a guidance screen on the touch panel monitor 71 or by outputting voice from the speaker 72.

As described above, the preselection process is performed.

<Example of Imadoki prime shooting selection screen>
FIG. 18 is a diagram showing an example of the imadoki prime shooting selection screen displayed in step S14 of the preselection process described above.

The Imadoki prime shooting selection screen of FIG. 18 is provided with three buttons 511 to 513. The button 511 is a button for selecting "simple prime" as a feeling of swelling, and the button 512 is a button for selecting "cute swelling" as a feeling of swelling. Further, the button 513 is a button for making it possible to select a "seasonal" face stamp image as the face stamp image.

"Simple prime" weakly emphasizes the cuteness (good appearance) of the user's face in the captured image, and keeps the original facial expression and atmosphere of the user's face while making the user's face naturally cute. It is a feeling of excitement that can be shown. When "Simple prime" is selected as the feeling of swelling, as will be described later, a face stamp image having a simple design can be selected. In other words, the "simple prime" can be said to be a sense of excitement for selecting a face stamp image that has a design and a low decorativeness.

"Kawaimemori" strongly emphasizes the cuteness of the user's face in the captured image, and makes the user's face look even more cute beyond the original facial expression and atmosphere of the user's face. It's a feeling. When "Kaimemori" is selected as the feeling of swelling, as will be described later, a face stamp image colorfully composed with an elaborate design can be selected. That is, it can be said that "cuteness" is a feeling of swelling for selecting a stamp image for a face that has both design and decoration.

Below the buttons 511 to 513, a face stamp image display area 514 is provided. In the face stamp image display area 514, a plurality of model images in which face stamp images of the type corresponding to the selected button (feeling of swelling) among the buttons 511 to 513 are combined are displayed.

In the default state where the Imadoki prime shooting selection screen is initially displayed, the button 511 is selected as shown in FIG. 18, and the face stamp image display area 514 is a type corresponding to "simple prime". It is assumed that the model images 521a to 521e in which the stamp images for the face of the above are combined are displayed.

The default state of the imadoki prime shooting selection screen may be set by the number of people course selected on the number of people course selection screen. If there are a large number of users in the captured image, the face stamp image that has both design and decoration may be combined with each user's face, giving the entire captured image a cluttered impression. There is. So, for example, when a course with 3 or more people is selected on the number of people course selection screen, the default state of the imadoki prime shooting selection screen is the state where the button 511 that enables selection of a simple face stamp image is selected. It may be set.

When the button 512 is selected on the imadoki prime shooting selection screen, as shown in FIG. 19, the face stamp image display area 514 has a face stamp of a type corresponding to "kawaii prime". It is assumed that the model images 522a to 522e in which the images are combined are displayed.

The user selects one of the model images (face stamp image) displayed in the face stamp image display area 514, and presses the OK button 515. As a result, the live view image displayed at the time of the imadoki prime shooting and the face stamp image to be combined with the photographed image obtained by the imadoki heap shooting are determined.

In addition, in the imadoki prime shooting selection screen of FIG. 18, the buttons 511, 512 display a face image of a model in which a character string indicating each feeling of swelling and a stamp image for a face corresponding to the feeling of swelling are combined. However, only the character string indicating the feeling of swelling may be displayed.

<Face stamp image display processing>
Here, with reference to the flowchart of FIG. 20, the face stamp image display process executed by the selection operation for the imadoki prime shooting selection screen will be described. The process of FIG. 20 is executed when the imadoki prime shooting selection screen is displayed.

In step S21, the selection reception unit 412 determines whether or not the feeling of swelling is selected by selecting the button 511 or the button 512 on the imadoki swelling shooting selection screen. When the button 511 is selected, it means that "simple assortment" is selected as the swelling feeling, and when the button 512 is selected, it means that "cute swelling" is selected as the swelling feeling.

The process of step S21 is repeated until it is determined that the feeling of swelling is selected. Then, when it is determined that the feeling of swelling is selected, the process proceeds to step S22.

In step S22, the display control unit 411 changes the type of the face stamp image displayed in the face stamp image display area 514 of the imadoki prime shooting selection screen according to the selected feeling of swelling.

In this way, the face stamp image of the type corresponding to the feeling of swelling selected by the user is displayed on the imadoki prime shooting selection screen.

When the button 513 is selected on the Imadoki prime shooting selection screen, the face stamp image displayed in the face stamp image display area 514 is an event (summer vacation, Halloween, Christmas) corresponding to the season at that time. , Valentine's Day, etc.) will be changed to a face stamp image.

<Example of face stamp image>
Here, with reference to FIGS. 21 and 22, an example of a face stamp image corresponding to a feeling of swelling will be described.

The face stamp image is composed of an image imitating a part of an animal's face, and is configured to include an image synthesized on at least the nose part of the user's face shown in the captured image.

FIG. 21 shows face stamp images 531 to 533 that can be selected in the face stamp image display area 514 of the imadoki prime shooting selection screen when "simple fill" is selected as the fill feeling.

The face stamp images 531 to 533 are all stamp images composed of line drawings of a single color (black, white, etc.).

The face stamp image 531 is composed of an image 531a synthesized on the nose portion of the person and images 531b and 531c synthesized on the left and right cheek portions of the person. The images 531b and 531c are images imitating the whiskers of an animal.

The face stamp image 532 includes an image 532a synthesized on the nose of the person, images 532b and 532c synthesized on the left and right cheeks of the person, and images 532d and 532e combined on the head of the person. Consists of. The images 532d and 532e are images that imitate the ears of an animal (specifically, a rabbit).

The face stamp image 533 includes an image 533a synthesized on the nose of the person, images 533b and 533c synthesized on the left and right cheeks of the person, and images 533d and 533e combined on the head of the person. Consists of. The images 533d and 533e are images that imitate the ears of an animal (specifically, a cat).

In this way, the face stamp images 531 to 533 corresponding to the "simple prime" are simply configured in terms of design. With this kind of face stamp image, it is possible to make the user's face look naturally cute while maintaining the original facial expression and atmosphere of the user's face in the photographed image.

FIG. 22 shows face stamp images 551 to 553 that can be selected in the face stamp image display area 514 of the imadoki prime shooting selection screen when “cute prime” is selected as the fill feeling.

The face stamp images 551 to 553 are all stamp images drawn using a plurality of colors.

The face stamp image 551 is an image 551a synthesized on the nose portion of the person, images 551b and 551c synthesized on the left and right cheek portions of the person, and images 551d and 551e synthesized on the head portion of the person. Consists of. The images 551d and 551e are images that imitate the ears of an animal (specifically, a cat) and are drawn using a plurality of colors.

The face stamp image 552 is composed of an image 552a synthesized on the nose portion of the person and images 552b and 552c synthesized on the head portion of the person. Image 552a is an image imitating the nose and whiskers of an animal (specifically, a rabbit), and images 552b and 552c are images imitating the ears of an animal (specifically, a rabbit). The images 552a to 552c are all drawn using a plurality of colors.

The face stamp image 553 is composed of an image 553a synthesized on the nose portion of the person and images 553b and 553c synthesized on the head portion of the person. Image 553a is an image imitating the nose and whiskers of an animal (specifically, a dog), and images 553b and 553c are images imitating the ears of an animal (specifically, a dog). The images 553a to 553c are all drawn using a plurality of colors.

In this way, the face stamp images 551 to 553 corresponding to the "cute prime" are colorfully composed with an elaborate design. With this kind of face stamp image, it is possible to make the user's face look more cute beyond the original facial expression and atmosphere of the user's face in the photographed image.

The face stamp image corresponding to the "kawaii prime" has a larger area of the entire image than the face stamp image corresponding to the "simple prime" due to the difference in design. In other words, the face stamp image corresponding to "Kaimemori" has the area of the part to be combined in the user's face reflected in the photographed image as compared with the face stamp image corresponding to "Simple prime". growing.

Furthermore, in order to enhance the design of the face stamp image corresponding to "Simple prime", the face stamp image corresponding to "Simple prime" is compared with the face stamp image corresponding to "Kawaime prime". The transparency may be increased. Further, the saturation may be increased so that the face stamp image corresponding to the "simple prime" is closer to the face stamp image corresponding to the "kawaii prime".

The face stamp image displayed on the Imadoki prime shooting selection screen as described above and selected by the user is combined with the captured image obtained by the Imadoki prime shooting performed in the shooting process described later.

According to the above processing, the user can be made to select the type of face stamp image according to the feeling of swelling selected by the user, and as a result, the face of the cuteness desired by the user is captured. It becomes possible to provide an image.

<Details of shooting process>
Next, with reference to the flowchart of FIG. 23, the details of the shooting process of step S3 in the series of processes of the above-mentioned photo sticker creation game will be described.

In the shooting process, six shots are taken as will be described later. Of these, close-up photography is performed as the 1st to 5th photography, and full-body photography is performed as the 6th photography.

The close-up shooting is a shooting for obtaining a close-up image, which is an image in which the area above the chest (upper body) of the user is captured, centering on the face. Full-body photography is an image taken to obtain a full-body image, which is an image showing almost the entire body of the user. In full-body photography, it is possible to obtain an image showing the whole body of the user seen from diagonally above, or to obtain an image showing the whole body of the user seen from the front.

Now, when the shooting process is started, in step S31, the display control unit 421 displays the guidance guidance screen on the touch panel monitor 92.

The guidance guidance screen allows the user to stand in any of the marker figures 28-1 to 28-8 printed on the horizontally long rectangular floor sheet 27A (FIG. 7) in the shooting space A1. It is a screen for guiding.

By checking the guidance guidance screen before the first shooting is performed, the user can recognize the standing position in which he / she should stand in the shooting space A1.

After the guidance guidance screen is displayed for a predetermined time, the process proceeds to step S32.

In step S32, the imaging control unit 422 performs the first imaging. Specifically, after the pose sample image in which the model person is posing is displayed, the shooting control unit 422 starts shooting the moving image by the camera 91, and the moving image (live) obtained by the shooting is started. The live view display screen on which the view image) is displayed is displayed on the touch panel monitor 92.

After the live view image is displayed for a predetermined time, the countdown before shooting is started, and when the shooting timing comes, the shooting control unit 422 takes a picture to acquire a still image which is a shot image. The captured image obtained by photographing is displayed on the touch panel monitor 92 as a photographing result.

The captured image (up image) obtained by the first shooting is printed on a sticker paper, sent to a mobile terminal via a server, and the face selected in the editing process as a result of the face recognition process. It is used to select image processing for the eyes.

When the first shooting is completed, in step S33, the display control unit 421 displays the image course selection screen on the touch panel monitor 92.

The image course selection screen is a screen used for selecting the image course. There are "Light course" and "Clear course" in the image course that determines the image of the subject in the captured image. The Light course is a shooting course to make the texture of the skin of the subject in the captured image natural and moist by making the skin color slightly yellowish. The Clear course is a shooting course to make the texture of the skin of the subject in the captured image fair and transparent by making the skin color slightly bluish.

The image of the subject determined by the image course is determined by the image processing applied to the captured image. For example, the appearance of a subject is determined by adjusting at least one of saturation, brightness, sharpness, contrast, and the like of a person's area in a captured image.

The close-up image obtained by the first shooting is displayed on the image course selection screen in a state where image processing corresponding to each image process is performed. As a result, the user can confirm the actual image of the subject and can more reliably select the desired image course.

When any of the image courses is selected by operating the image course selection screen, the pose sample image is displayed, and then the live view display screen is displayed on the touch panel monitor 92.

When the shooting timing is reached in that state, in step S34, the shooting control unit 422 performs a second shooting (up shooting). The captured image obtained by imaging is displayed on the touch panel monitor 92 as the imaging result.

Similarly, in steps S35 and S36, the imaging control unit 422 performs the third and fourth imaging (up imaging), respectively.

Subsequently, in step S37, the photographing control unit 422 performs an impulsive shooting as the fifth photographing. In the imadoki prime shooting, the same shooting as the above-mentioned close-up shooting is performed, and the shot image obtained by the shooting is displayed on the touch panel monitor 92 as the shooting result. A face stamp image selected by the user in the preselection process is combined with the captured image displayed as the capture result.

After the imadoki prime shooting (fifth shooting) was performed, in step S38, the shooting control unit 422 aimed to record the coordination shooting (user's clothes (coordination)) as the sixth shooting. Whole body photography). Specifically, after the pose sample image in which the model showing the whole body is posed is displayed, the shooting control unit 422 starts shooting the moving image by the camera 91, and the live view image obtained by the shooting is started. The live view display screen on which is displayed is displayed on the touch panel monitor 92.

After the live view image is displayed for a predetermined time, the countdown before shooting is started, and when the shooting timing comes, the shooting control unit 422 takes a picture to acquire a still image which is a shot image. The captured image obtained by imaging is displayed on the touch panel monitor 92 as the imaging result.

In this way, after six times of shooting are performed in steps S32 to S38, in step S39, the shooting processing unit 402 tells the user in the shooting space A1 the editing space A2-1 or the editing space A2. Guide the move to -2. Guidance for moving to the editing space A2-1 or the editing space A2-2 is performed by displaying the guidance screen on the touch panel monitor 92 of the photographing unit 304 or by outputting the sound from the speaker 332.

The shooting process is performed as described above.

<Face stamp image composition processing>
Here, with reference to the flowchart of FIG. 24, a face stamp image synthesizing process for synthesizing a face stamp image with a photographed image obtained by imadoki prime shooting will be described.

In step S51, the compositing unit 423 performs face recognition processing on the photographed image obtained by the imadoki prime photography. In the face recognition process, face recognition is performed by extracting contour points of a portion to be recognized in a captured image and determining whether or not the area connecting them is a face.

In step S52, the compositing unit 423 synthesizes the face stamp image selected by the user in the preselection process into the face recognized by the face recognition process in the captured image obtained by the imadoki prime shooting.

Here, when a plurality of faces are captured in the captured image obtained by the imadoki prime shooting, the compositing unit 423 uses the face stamp image selected by the user in the preselection process for all the faces recognized by the face recognition process. Synthesize to.

25 and 26 are diagrams showing an example of synthesizing a face stamp image.

25 and 26 show a photographed image 571 obtained by imadoki prime photography. The captured image 571 is a close-up image in which the faces and upper body of the two users U1 and U2 are greatly captured.

When "Simple prime" is selected as the feeling of fullness and the face stamp image 531 (FIG. 21) is selected on the imadoki prime shooting selection screen, as shown in FIG. 25, the user U1 in the shot image 571 A face stamp image 531 is synthesized for each of the faces of U2. Specifically, the face stamp image 531 is synthesized so that the image 531a constituting the face stamp image 531 is arranged in each of the nose portions of the users U1 and U2.

Further, when "Kawaimemori" is selected as the feeling of swelling and the face stamp image 551 (FIG. 22) is selected on the imadoki swelling shooting selection screen, as shown in FIG. 26, the use of the image 571 as shown in FIG. A face stamp image 551 is synthesized for each of the faces of the persons U1 and U2. Specifically, the face stamp image 551 is synthesized so that the image 551a constituting the face stamp image 551 is arranged in each of the nose portions of the users U1 and U2.

When multiple faces appear in the captured image, the face stamp image is combined with all the faces recognized by the face recognition process, but the upper limit is the number of faces to which the face stamp image is combined. It may be provided.

In the above, the example in which the stamp image for the face is combined with the captured image obtained by the imadoki prime shooting has been described, but it may be combined with the live view image displayed before the imadoki prime shooting.

In this case, the shooting processing unit 422 extracts a person area from the moving image captured by the camera 91 by chroma key processing (makes the background area transparent), and synthesizes the background image with the background area to generate a live view image. do.

The compositing unit 423 performs face recognition processing on the live view image generated in this way, and the face stamp image selected by the user in the preselection processing is recognized by the face recognition processing in the live view image. Synthesize to the face. At this time, the stamp image for the face is synthesized by changing its position and shape so as to follow the movement of the face and the change of the facial expression in the live view image.

By synthesizing the face stamp image with the live view image in this way, the user can create his / her own facial expression while checking the live view image in which the face stamp image is synthesized, and as a result of shooting. The obtained photographed image can be a more desired image.

In the above, it is assumed that the face area is recognized by the face recognition process, but the user's face area is recognized by generating the person mask image from the distance image acquired by the distance image sensor. You may do so.

<Image processing corresponding to the feeling of swelling and stamp image for face>
In the above, it is assumed that the degree of emphasis on the cuteness of the user's face in the photographed image is adjusted by the type of face stamp image according to the feeling of swelling selected by the user. In addition to this, the image processing unit 424 may apply image processing having an intensity corresponding to the feeling of swelling selected by the user to the face of the user on which the captured image is captured.

In this case, the user selects the intensity of the image processing applied to the user's face in the captured image by selecting the feeling of swelling (button 511 or button 512) on the imadoki prime shooting selection screen. Become.

For example, when the button 511 is selected, the cuteness of the user's face reflected in the captured image is weakly emphasized, and the user's face is naturally cute while maintaining the original facial expression and atmosphere of the user's face. First-intensity image processing for showing is applied to the user's face in the captured image.

Specifically, as the first-intensity image processing, a process of slightly reducing the size of the user's face or slightly increasing the size of the eyes is performed.

In addition, by selecting the button 512, the cuteness of the user's face reflected in the captured image is strongly emphasized, and the user's face is made to look more cute beyond the original facial expression and atmosphere of the user's face. A second intensity image process for this is applied to the user's face in the captured image.

Specifically, as the second intensity image processing, a process of reducing the size of the user's face or increasing the size of the eyes is performed as compared with the case of the first intensity image processing. ..

For example, when the button 513 is selected, a third intensity image process for emphasizing the cuteness of the user's face in the captured image is applied to the user's face in the captured image. It may be done.

In this case, as the image processing of the third intensity, a process of reducing the size of the user's face or increasing the size of the eyes is performed to the extent that the image processing of the first intensity does not reach. Will be done.

In this example, the type of the stamp image for the face displayed on the imadoki prime shooting selection screen is changed according to the intensity of the image processing selected by the user.

As a result, the user can be made to select a type of face stamp image according to the intensity of the image processing selected by the user, so that an image showing the cute face desired by the user can be provided. Is possible.

<Modification example>
Hereinafter, a modified example of the above-described embodiment will be described.

(Modification 1)
In the above, it is assumed that only one feeling of swelling is selected on the screen for selecting the shooting of the swelling, but a plurality of feelings of swelling may be selected. For example, three swelling feelings, a first swelling feeling, a second swelling feeling, and a third swelling feeling, are prepared. Of these, when the second swelling feeling and the third swelling feeling are selected, the face stamp image corresponding to the second swelling feeling and the third swelling feeling correspond to the imadoki swelling shooting selection screen. The stamp image for the face is displayed.

As a result, the number of face stamp images displayed is larger than the case where all the face stamp images corresponding to the first swelling feeling, the second swelling feeling, and the third swelling feeling are displayed. Since it is limited, it is possible to reduce the time required for confirmation when the user selects the face stamp image.

(Modification 2)
When a plurality of swelling feelings are selected on the imadoki swelling shooting selection screen, the swelling feeling may be selected for each user. In this case, two users each select a feeling of swelling, and pen images and stamp images corresponding to each of the feelings of swelling selected by the two users are prepared on the left and right sides of the editing screen used for editing work. You may do so.

Further, the pen images and stamp images corresponding to the selected feeling of swelling displayed on the left and right sides of the editing screen may be interchanged according to the standing positions of the two users facing the editing screen.

(Modification 3)
In the configuration in which the intensity of the image processing applied to the user's face reflected in the captured image is selected by selecting the feeling of swelling, a plurality of image processes are applied to the user's face reflected in the captured image. Specifically, a process of making the face smaller and a process of enlarging the eyes are applied to the user's face shown in the captured image.

In this case, the parameters (intensities) of each process may be selected separately, and the types of face stamp images that can be selected may be changed according to the intensity of each selected process. For example, when the intensity of the process of making the face smaller and the intensity of the process of enlarging the eyes are each in three stages, nine types of face stamp images can be selected.

(Modification example 4)
In the above, it is assumed that a plurality of types of face stamp images corresponding to one swelling feeling are prepared, but only one face stamp image is prepared corresponding to one swelling feeling. May be good. For example, one face stamp image corresponding to "simple prime" and one face stamp image corresponding to "cute prime" may be prepared.

(Modification 5)
In the above, it is assumed that the type of face stamp image can be selected according to the selected feeling of swelling on the imadoki prime shooting selection screen, but the face stamp image can be reselected on the editing screen used for editing work. You may do so. When the face stamp image is reselected, the reselected face stamp image is combined with the face appearing in the captured image displayed as the editing target on the edit screen.

<About the stamp image for the face>
The face stamp image may be stored in advance in the storage unit 316 of the PC unit 301 or the like, or may be generated for each game.

When the face stamp image is generated for each game, it is assumed that the image of each part constituting the face stamp image is stored in advance in the storage unit 316 of the PC unit 301 or the like, and these images are combined. , Make sure that a stamp image for the face is generated. The timing at which the face stamp image is generated can be a predetermined timing such as when a feeling of swelling is selected, when face recognition processing is being performed, or when shooting processing is started.

As the face stamp image, a cosmetic image may be prepared instead of an image imitating an animal face part. For makeup images, use items such as lips, eyelines, eyelashes, color contacts, and cheeks that are used for makeup on the entire face of the person, organs such as lips and eyes, and parts such as cheeks that appear in the photographed image. It is an image for compositing to make it look like it has been applied with makeup.

Further, not only the stamp image for the face corresponding to the selected swelling feeling is provided, but also the skin brightness and hair color of the user appearing in the captured image are changed according to the selected swelling feeling. You may do so.

<Other embodiments>
In the above-described embodiment, the type of the stamp image for the face is changed according to the feeling of swelling (intensity of image processing) selected by the user.

On the contrary, by having the user select the face stamp image first, the feeling of swelling may be changed according to the face stamp image selected by the user. For example, the size of the user's face and the size of the eyes shown in the captured image are changed according to the face stamp image selected by the user.

In addition, the type of face stamp image is changed according to the feeling of swelling (intensity of image processing) selected by the user, and the feeling of swelling is changed according to the feeling of swelling selected by the user. The processing to be performed may be executed on the user's mobile terminal.

In this case, the image to be processed may be an image transmitted from the photo sticker creation device 1 to the mobile terminal, or an image taken by a camera built in the mobile terminal. ..

Furthermore, when an animation image is displayed together with the live view image as shooting guidance on the live view display screen, the displayed animation image may be changed according to the selected feeling of excitement. good. For example, when "Simple prime" is selected as the fill feeling, an animation image consisting of a single color line drawing is displayed, and when "Kaime prime" is selected as the fill feeling, it is drawn using multiple colors. The animation image is displayed.

In the above-described embodiment, the photo sticker creating device 1 is configured to print the obtained photographed image or edited image on the sticker paper and send it to the server to provide it to the user's mobile terminal. .. Not limited to this, it is also possible to adopt a configuration in which the photographed image or the edited image is not printed on the sticker paper but is transmitted to the server and provided only to the user's mobile terminal. On the contrary, it is also possible to adopt a configuration in which only the photographed image or the edited image is printed on the sticker paper without being transmitted to the server.

The series of processes described above can be executed by hardware or software. When the series of processes described above is executed by software, the programs constituting the software are installed from a network or a recording medium.

This recording medium is, for example, as shown in FIG. 12, a magnetic disk on which the program is recorded, which is distributed to distribute the program to the administrator of the photo sticker creation device 1 separately from the device main body. It is composed of a removable medium 319 including a flexible disk), an optical disk (including a CD-ROM and a DVD), a magneto-optical disk, or a semiconductor memory. In addition to these, the recording medium is composed of a ROM 312 in which a program to be distributed to the administrator is recorded in a state of being preliminarily incorporated in the main body of the apparatus, a hard disk included in the storage unit 316, and the like.

In this specification, the steps for describing a program to be recorded on a recording medium are not only processed in chronological order in the order described, but also in parallel or in parallel, even if they are not necessarily processed in chronological order. It also includes processes that are executed individually.

In the above, the print medium is not limited to the sticker paper and the photographic paper. For example, the image may be printed on a predetermined size of paper or film, a card such as a prepaid card or an IC (Integrated Circuit) card, or a cloth such as a T-shirt. In this case, a sticker layout image in which one or a plurality of captured images are arranged may be printed on these print media.

Further, the embodiment of the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the gist of the present technology.

1 Photo sticker creation device 401 Preselection processing unit 402 Imaging processing unit 403 Editing processing unit 404 Printing processing unit 411 Display control unit 412 Selection reception unit 421 Display control unit 422 Imaging control unit 423 Synthesis unit 424 Image processing unit

Claims (10)

A selection reception section that accepts choices by users,
It is equipped with a display control unit that controls the display of the selection screen on which the face stamp image synthesized on the user's face that appears in the captured image obtained by shooting is displayed.
The selection reception unit receives the selection of the intensity of the image processing applied to the user's face reflected in the photographed image by the user.
The display control unit is a photo-creating game machine that changes the type of the face stamp image displayed on the selection screen according to the intensity selected by the user. The photo creation game according to claim 1, further comprising a compositing unit for synthesizing the face stamp image selected by the user with the user's face reflected in the photographed image based on the result of face recognition processing. Machine. The photograph creation according to claim 2, wherein the compositing unit synthesizes the face stamp image selected by the user into all the faces recognized by the face recognition process when a plurality of faces appear in the photographed image. game machine. Further equipped with a live view display control unit that controls the display of the user's live view image captured by the camera before shooting.
The photo-creating game machine according to claim 2 or 3 , wherein the compositing unit synthesizes the face stamp image selected by the user with the face of the user reflected in the live view image. The photo-creating game machine according to any one of claims 1 to 4, wherein the face stamp image includes an image synthesized at least in the nose portion of the user's face reflected in the photographed image. The photo-creating game machine according to claim 5, wherein the face stamp image is composed of an image imitating an animal face part. The selection receiving unit receives the selection of the first intensity of the image processing or the second intensity of the image processing higher than the first intensity by the user.
The display control unit
When the first intensity is selected by the user, the face stamp image composed of a monochromatic line drawing is displayed.
The photo-creating game machine according to claim 5 or 6, wherein when the second intensity is selected by the user, the stamp image for the face drawn using a plurality of colors is displayed. 6. Photographing game console. A selection reception section that accepts choices by users,
A photo-creating game machine equipped with a display control unit that controls the display of a selection screen on which a face stamp image synthesized on the user's face in the photographed image obtained by photography is displayed.
Accepting the user's selection of the intensity of image processing applied to the user's face in the captured image,
A display method including a step of changing the type of a face stamp image displayed on the selection screen according to the intensity selected by the user. Computer,
A selection reception section that accepts choices by users,
It is a program to function as a display control unit that controls the display of the selection screen on which the face stamp image synthesized on the user's face in the captured image obtained by shooting is displayed.
The selection reception unit receives the selection of the intensity of the image processing applied to the user's face reflected in the photographed image by the user.
The display control unit is a program that changes the type of face stamp image displayed on the selection screen according to the intensity selected by the user.

Images