JP6985632B2 - Image processing device, display control method, and program - Google Patents

Description

The present technology relates to an image processing device, a display control method, and a program, and in particular, an image processing device and a display control that enable a selection of an optimum image as a background image to be combined with a user's background reflected in a captured image. Regarding methods and programs.

Conventionally, a photo sticker making device is known. The photo sticker creating device photographs a user, causes the user to edit the photographed image, and prints the edited image on a sticker paper to provide the photographed image. The photo sticker making device is installed in amusement facilities and the like.

The flow of one game provided by the photo sticker creation device is usually that after shooting with a user in the shooting space as a subject, the user is moved to the editing space and an image is displayed according to an operation performed in the editing space. It will be edited and the edited image will be printed on the sticker paper.

Generally, the image taken by the photo sticker making device is subjected to chroma key processing. The chroma key processing is performed, for example, by extracting an area other than the person area appearing in the captured image as a background area and synthesizing a background image having a high design property with the background area.

As the background image, the user can select his / her favorite background image from a plurality of types according to the image, the pose at the time of shooting, the facial expression, the shooting angle of view, the number of subjects, the height, and the like. ing. As a result, the user can obtain a sticker paper on which a highly satisfying image is printed.

As a usage form of the photo sticker making device, it is generally used by a group of a plurality of people. Since you can select your favorite background image while consulting with your friends, it can be said that the selection of the background image is an element that is extremely palatable while playing with the photo sticker creation device.

Patent Document 1 discloses a technique that enables a favorite background color to be selected in the process of creating a portable image, which is an image that can be viewed on a mobile phone. The portable image is generated by trimming a part of a predetermined angle of view of the captured image.

Japanese Unexamined Patent Publication No. 2011-19072

Since the conventional screen used for selecting the background image displays thumbnail images for the number of shots such as 5 images and about 20 types of background images for the user to select, the display space for each image is set. It cannot be secured large.

The background image is often selected, for example, by moving from the shooting space to the editing space using a monitor in the editing space and before actually editing (scribbling). At the time of editing, the photographed image in which the background image is combined is used as the editing target.

From the point of view of the display space, the captured image in which the background image is combined is not displayed large on the background image selection screen, and the user cannot confirm the details. That is, the captured image in which the background image is combined is displayed in a large size when the selection of the background image is completed, the screen display is switched to the edit screen, and the image is selected as the edit target. At that time, I noticed that it wasn't cute, and sometimes I was dissatisfied.

Usually, about 25 to 35 seconds are allocated for selecting the background image. If this selection time is shortened, the preference of "selecting the background" will be impaired. On the contrary, if the selection time is lengthened, the number of rotations of the game (the number per unit time of the group using the photo sticker making device) decreases.

In the selection of the background image using the selection screen, the user can select the background image for each captured image. Since the background image to be combined with each shot image is selected one by one, it is possible to select the background image while consulting with each other as described above, but if the consultation time is insufficient, the fourth image. For the background image near the end, such as the fifth image, the selection may be appropriate.

The present technology has been made in view of such a situation, and makes it possible to select an optimum image as a background image to be combined with the background of the user reflected in the captured image.

The image processing device on one aspect of the present technology is a plurality of captured images including a close-up image, which is an image in which the upper body of the user is greatly captured, and a full-body image, which is an image in which the entire body of the user is captured, with the user as a subject. Combining a shooting unit for shooting and a background selection area in which a plurality of buttons used for selecting a background image are arranged with an editing area in which the shot image to be edited is enlarged and a shot image to be edited. At the same time as the compositing image selection area where the images used for selecting the image for selection are lined up, the display control unit to be displayed on the editing screen used for editing the captured image and the predetermined button to be edited are said to be the same. When the captured image is the close-up image, the background image for the close-up image corresponding to the operated button is combined with the captured image to be edited, and the captured image to be edited is the whole body image. Occasionally, the display control unit includes an image processing unit that synthesizes the background image for the whole body image, which corresponds to the operated button, with the captured image to be edited, and the display control unit is the combined image of the background image. The captured image is displayed in the editing area.

In one aspect of the present technology, a plurality of captured images including a close-up image, which is an image of the upper body of the user in a large size, and a full-body image, which is an image of the whole body of the user, are taken with the user as a subject. The background selection area in which a plurality of buttons used for selecting the background image are lined up is used for selecting the editing area in which the captured image to be edited is enlarged and the composite image to be combined with the captured image to be edited. At the same time as the compositing image selection area where the images to be used are lined up, it is displayed on the editing screen used for editing the captured image. Further, when the predetermined button is operated, when the captured image to be edited is the close-up image, the background image for the close-up image corresponding to the operated button is the captured image to be edited. When the captured image to be edited is the whole body image, the background image for the whole body image corresponding to the operated button is combined with the captured image to be edited, and the background image is combined with the photographed image to be edited. The combined captured image is displayed in the editing area.

According to the present technology, the user can select the optimum image as the background image to be combined with the background of the user reflected in the captured image.

It is a perspective view which shows the structural example of the appearance of the photographic sticker making apparatus which concerns on one Embodiment of this technique. It is a figure explaining the movement of a user. It is a perspective view which shows the structural example of the photographing part. It is a front view which shows the structural example of the photographing part. It is a figure which shows the structural example of the background part. It is a figure which shows the configuration example of an editing unit. It is a figure which shows the configuration example of the right side surface of an editing unit. It is a figure which shows the example of the sticker paper. It is a figure which shows the example of the layer structure of an edited image. It is a block diagram which shows the structural example of the inside of a photographic sticker making apparatus. It is a block diagram which shows the functional structure example of the control part of FIG. It is a block diagram which shows the structural example of the editing processing part of FIG. It is a flowchart explaining the photo sticker making game process. It is a flowchart explaining the editing process. It is a figure which shows the example of an edit screen. It is a figure which enlarges and shows the background selection area of FIG. It is a figure which shows the display example of an edit screen. It is a figure which shows the other display example of an edit screen. It is a figure which shows the other display example of an edit screen. It is a figure which shows the example of the background image. It is a figure which shows the display example of an edit screen. It is a figure which shows the 1st modification of an edit screen. It is a figure which shows the 2nd modification of an edit screen. It is a figure which shows the 3rd modification of an edit screen.

<Appearance configuration of photo sticker making device>
FIG. 1 is a perspective view showing a configuration example of the appearance of the photo sticker creating device 1.

The photo sticker creation device 1 is a game machine that provides a photographed image and an edited image. The photo sticker creating device 1 provides an image to a user by printing the image on a sticker paper or transmitting the image to a server so that the image can be viewed on the user's mobile terminal. ..

The photo sticker creating device 1 is installed in an amusement facility or a store. The users of the photo sticker making device 1 are mainly young women such as female high school students and female university students. In the photo sticker creating device 1, a plurality of users, such as mainly two or three people, can enjoy the game per set. Of course, one user can also enjoy the game.

In the photo sticker creating device 1, the user takes a picture by himself / herself as a subject. By performing the editing work, the user synthesizes a composite image such as a handwritten character or a stamp image with the shot image obtained by the shooting. As a result, the captured image is edited into a colorful image. The user receives a sticker paper on which the edited image, which is an edited image, is printed, and ends the series of games.

The photo sticker creating device 1 is configured by being installed in a state where the photographing unit 11 and the editing unit 12 are in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected. The photographing unit 11 has a box-shaped housing having a size sufficient for a person to enter.

The shooting unit 11 is composed of a shooting unit 21 and a background unit 22. The photographing unit 21 and the background unit 22 are installed separately. The space provided between the shooting unit 21 and the background unit 22 is a shooting space for the user to perform shooting work.

The photographing unit 21 is a device for photographing a user as a subject. A camera or the like is provided in front of the shooting unit 21 facing the shooting space. A front panel 41 is provided on the surface of the photographing unit 21 in contact with the editing unit 12. Assuming that the right side surface is the right side surface and the left side surface is the left side surface when viewed from the user in the photographing space, the right side surface of the photographing unit 21 is composed of the side panel 42A, and the left side surface is formed by the side panel 42B (FIG. 2). It is composed.

The background portion 22 is composed of a back panel 51, a side panel 52A, and a side panel 52B (FIG. 2), which are plate-shaped members, respectively. The back panel 51 is located on the back side of the user facing the front. The side panel 52A is attached to the right end of the back panel 51, and the side panel 52B is attached to the left end of the back panel 51.

The side panel 42A and the side panel 52A are provided on substantially the same plane with a predetermined interval. The upper portions of the side panel 42A and the side panel 52A are connected by a connecting portion 31A which is a plate-shaped member. Further, the lower portions of the side panel 42A and the side panel 52A are connected by a connecting portion 34 which is, for example, a metal member provided on the floor surface.

Similarly, the side panel 42B and the side panel 52B are provided on substantially the same plane. The upper part of the side panel 42B and the side panel 52B is connected by the connecting portion 31B. The lower portions of the side panel 42A and the side panel 52A are connected by a metal member (not shown) provided on the floor surface.

The opening formed by being surrounded by the side panel 42A, the connecting portion 31A, and the side panel 52A serves as an entrance / exit of the photographing space. Further, the opening formed by being surrounded by the side panel 42B, the connecting portion 31B, and the side panel 52B also serves as an entrance / exit of the photographing space.

An opening surrounded by the front panel 41 of the photographing unit 21, the connecting portion 31A, the connecting portion 31B, and the back panel 51 of the background portion 22 is formed above the photographing space. A ceiling lighting unit 32 is provided so as to cover a part of the opening. One end of the ceiling lighting unit 32 is fixed to the connecting portion 31A, and the other end is fixed to the connecting portion 31B.

A fluorescent lamp is provided inside the ceiling lighting unit 32. The ceiling lighting unit 32 functions as lighting for the shooting space and irradiates the user who is shooting with strobe light.

The editing unit 12 is a device for editing a captured image. The editing unit 12 is connected to the photographing unit 11 so that one side surface is in contact with the front panel 41 of the photographing unit 21.

Assuming that the configuration of the editing unit 12 shown in FIG. 1 is the configuration on the front side, the configuration used for the editing work is provided on each of the front side and the back side of the editing unit 12. With this configuration, two sets of users can edit at the same time.

The front side of the editing unit 12 is composed of a surface 12A which is a surface perpendicular to the floor surface and a slope 12B formed above the surface 12A. A monitor with a built-in tablet and a touch pen are provided on the slope 12B as a configuration used for editing work.

On the upper right side of the slope 12B, a columnar support portion 71A (FIG. 6) for supporting one end of the lighting device 73 is provided. On the left side of the slope 12B, a columnar support portion 71B that supports the other end of the lighting device 73 is provided. A plate-shaped panel 72 is provided on the right side of the support portion 71A. A support portion 74 for supporting the curtain rail 75 is provided on the upper surface of the panel 72.

A curtain rail 75 is attached above the editing unit 12. The curtain rail 75 is configured by combining three rails 75A to 75C. The three rails 75A to 75C are combined so that the shape when viewed from above is U-shaped. One ends of the rail 75A and the rail 75B provided in parallel are fixed to the connecting portion 31A and the connecting portion 31B, respectively, and the other ends of the rail 75A and the rail 75B are joined to both ends of the rail 75C, respectively.

A curtain is attached to the curtain rail 75 so that the space in front of the front and the space in front of the back of the editing unit 12 cannot be seen from the outside. The space in front of the front and the space behind the back of the editing unit 12 surrounded by the curtain are the editing spaces in which the user performs editing work.

As will be described later, the right side surface of the editing unit 12 is provided with a discharge port from which the printed sticker paper is discharged. The space in front of the right side of the editing unit 12 is a printing waiting space in which the user waits for printing to finish.

<About the movement of users>
Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described.

FIG. 2 is a plan view of the photo sticker creating device 1 as viewed from above.

First, the user can use the shooting space formed between the shooting unit 21 and the background unit 22 from the doorway G1 as indicated by the white arrow # 1 or from the doorway G2 as indicated by the white arrow # 2. Enter A1. The doorway G1 is an opening between the side panel 42A and the side panel 52A, and the doorway G2 is an opening between the side panel 42B and the side panel 52B. The user performs shooting work in the shooting space A1 by using a camera, a touch panel monitor, or the like provided in the shooting unit 21.

The user who has completed the shooting work can either leave the shooting space A1 from the entrance / exit G1 and move to the editing space A2-1 as indicated by the white arrow # 3, or the entrance / exit G2 as indicated by the white arrow # 4. Exit the shooting space A1 and move to the editing space A2-2.

The editing space A2-1 is an editing space on the front side of the editing unit 12. On the other hand, the editing space A2-2 is an editing space on the back side of the editing unit 12. Whether the user moves to the editing space A2-1 or the editing space A2-2 is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the vacant one of the two editing spaces is guided as the destination.

The user who has moved to the editing space A2-1 or the editing space A2-2 starts the editing work. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing work at the same time.

After the editing work is completed, printing of the edited image is started. When printing is started, the user who has completed the editing work in the editing space A2-1 moves from the editing space A2-1 to the printing waiting space A3 as indicated by the white arrow # 5. Further, the user who has completed the editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as indicated by the white arrow # 6. The user who has moved to the print waiting space A3 waits for printing to finish.

When printing is completed, the user receives the sticker paper discharged from the discharge port provided on the right side surface of the editing unit 12, and ends a series of photo sticker creation games.

Next, the configuration of each part will be described.

<Structure of shooting unit>
FIG. 3 is a perspective view showing a configuration example of the photographing unit 21, and FIG. 4 is a front view showing a configuration example of the photographing unit 21.

The outer frame of the photographing unit 21 is configured such that the front panel 41, the side panel 42A, and the side panel 42B are erected on the base portion 43 to which a plurality of casters are attached.

A substantially box-shaped photographing / displaying unit 101 is provided at substantially the center of the front panel 41. On the front side of the photographing / displaying unit 101, a slope 101A that descends forward, a slope 101B that is slightly tilted forward with respect to the vertical, and a slope 101C that is steeper than the slope 101A are formed in this order from the top.

A circular opening is formed substantially in the center of the slope 101B, and the opening is provided with a lens of the camera 111 for shooting a user in the shooting space A1. Inside the shooting / display unit 101, for example, a camera 111, which is a single-lens reflex camera, is mounted so as to be tiltable.

A touch panel monitor 112 is provided on the slope 101C. The touch panel monitor 112 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated on the monitor.

The touch panel monitor 112 has a function as a live view monitor that displays a moving image (hereinafter, also referred to as a live view image) captured by the camera 111, and displays various GUIs (Graphical User Interfaces) for user operation. It has a function to accept. The touch panel monitor 112 displays a live view image or a captured image captured by the camera 111. The captured image is a still image captured by the camera 111 at a predetermined timing.

As will be described in detail later, the user may take a full-body image, which is an image showing the whole body of the user, and a close-up image, which is an image showing a large area above the chest of the user, centering on the face part. can.

The light emitting unit 102L and the light emitting unit 102R are symmetrically formed on the front panel 41 with the photographing / displaying unit 101 interposed therebetween. The light emitting unit 102L and the light emitting unit 102R are configured by, for example, fitting a translucent cover into a narrow groove formed in the front panel 41. A light emitting body such as an LED is provided in the narrow groove formed in the front panel 41.

As shown in FIG. 4, the light emitting unit 102L on the left side of the photographing / displaying unit 101 is composed of narrow linear portions 102L-1 to 102L-3. The linear portion 102L-2 is formed in the vertical direction so that its length is substantially the same as the vertical length of the photographing / displaying unit 101. The linear portion 102L-1 is formed diagonally upward to the right from the upper end of the linear portion 102L-2, and the linear portion 102L-3 is formed diagonally downward to the right from the lower end of the linear portion 102L-1. Will be done.

On the other hand, the light emitting unit 102R on the right side of the photographing / displaying unit 101 is composed of narrow linear portions 102R-1 to 102R-3. The linear portion 102R-2 is formed in the vertical direction so that its length is substantially the same as the vertical length of the photographing / displaying unit 101. The linear portion 102R-1 is formed diagonally upward to the left from the upper end of the linear portion 102R-2, and the linear portion 102R-3 is formed diagonally downward to the left from the lower end of the linear portion 102R-2. Will be done.

As shown in FIG. 4, the combined shape of the light emitting unit 102L and the light emitting unit 102R is substantially hexagonal. By emitting light from the light emitting unit 102L and the light emitting unit 102R, a sharp impression can be produced as an impression of the shooting space A1.

Above the photographing / displaying unit 101, an upper strobe unit 103 with a curved cover facing the user is installed. The upper strobe unit 103 is fixed to the front panel 41 or the like by using a predetermined mounting member. The upper strobe unit 103 irradiates the vicinity of the user's face with strobe light from above the front surface.

Below the shooting / display unit 101, a foot strobe unit 104 that irradiates the lower body of the user with strobe light in accordance with shooting by the camera 111 is provided. The front surface of the foot strobe unit 104 is composed of a plate-shaped member 121 forming a vertical surface, and the upper surface is composed of a plate-shaped member 122 forming a gentle slope. The plate-shaped member 121 and the plate-shaped member 122 are translucent plate-shaped members such as a milky white acrylic plate.

On the left and right sides of the plate-shaped member 121 of the foot strobe unit 104, a plate-shaped member 123L and a plate-shaped member 123R constituting a vertical surface are provided, respectively. The plate-shaped member 123R is provided with a coin slot for inserting coins by the user.

On the left and right sides of the plate-shaped member 122 of the foot strobe unit 104, a plate-shaped member 124L and a plate-shaped member 124R forming a gentle slope similar to the plate-shaped member 122 are provided, respectively. The slope formed by the plate-shaped member 124L and the plate-shaped member 124R is used for the user to put baggage and the like.

Although not shown, a speaker is provided near the ceiling of the front panel 41, for example. The speaker outputs guidance voice, BGM, sound effect, etc. related to shooting work.

<Structure of background part>
FIG. 5 is a diagram showing a configuration example of the background portion 22 on the photographing space A1 side.

A back upper strobe 131 is provided in the upper center of the back panel 51. Further, a rear right strobe 132 is provided on the upper right side (left side in the figure) of the back panel 51, and a rear left strobe 133 is provided on the upper left side (right side in the figure) of the back panel 51.

The strobe 131 on the back surface irradiates the user with strobe light from the rear upper side. The rear right strobe 132 irradiates the user with strobe light from the rear right side. The rear left strobe 133 irradiates the user with strobe light from the rear left side.

The surface of the back panel 51 on the shooting space A1 side (front side in the figure) is, for example, a green surface. Although not shown, the surface of each of the side panels 52A and 52B on the photographing space A1 side is, for example, a green surface.

The green color of these surfaces is a color for extracting the user's area by chroma key processing.
As a result, the photographed image can be subjected to chroma key processing, and the background image desired by the user can be combined with the background portion of the photographed image. The color of these surfaces may be any color that can be subjected to chroma key treatment, and may be another color such as blue.

<Structure of editing unit>
FIG. 6 is a diagram showing a configuration example of the front side (editing space A2-1 side) of the editing unit 12.

A tablet built-in monitor 141 is provided substantially in the center of the slope 12B. A touch pen 142A and a touch pen 142B are provided on the left and right sides of the tablet built-in monitor 141.

The tablet built-in monitor 141 accepts operation input using the touch pens 142A and 142B. An editing screen or the like used for editing work is displayed on the tablet built-in monitor 141. For example, the touch pen 142A is used by a user standing on the left side of the tablet built-in monitor 141, and the touch pen 142B is used by a user standing on the right side of the tablet built-in monitor 141. Hereinafter, when it is not necessary to distinguish between the touch pen 142A and the touch pen 142B as appropriate, it is referred to as a touch pen 142.

FIG. 7 is a diagram showing a configuration example of the right side surface of the editing unit 12.

A sticker paper discharge port 151 is provided at the lower part of the right side surface of the editing unit 12. A printer is provided inside the editing unit 12. The printer prints the image edited by the user of the editing space A2-1 or the image edited by the user of the editing space A2-2 on the sticker paper in a predetermined layout, and the sticker paper discharge port. It is discharged from 151.

<Example of sticker paper>
FIG. 8 is a diagram showing an example of a sticker paper produced by the photo sticker creating device 1 having the above-mentioned appearance configuration.

On the horizontally long sticker paper shown in FIG. 8, five edited images 161-1 to 161-5 are printed side by side.

Of the edited images 161-1 to 161-5, the edited images 161-1 to 161-3 are images generated by editing the close-up image, and the edited image 161-1-4 and the edited image 161-5 is an image generated by editing the whole body image.

The aspect ratio is different between the close-up image and the whole body image. For example, the ratio of the horizontal length to the vertical length of the close-up image is 1: 1.2, and the ratio of the horizontal length to the vertical length of the whole body image is 3: 4. In the example of FIG. 8, the close-up image and the whole body image are printed with the same length in the horizontal direction. In reality, a background image, which is an image of a predetermined color or pattern, is combined with the background of the user, and a composition image such as a handwritten character or a stamp image is combined with the foreground.

In addition to the model name (LOVERY) and shooting date, an e-mail address, ID, etc. are printed in the margin on the edge of the sticker paper. The e-mail address and ID printed in the margin area are used when viewing the image transmitted from the photo sticker creation device 1 to the server on a mobile terminal such as a mobile phone.

FIG. 9 is a diagram showing an example of the layer structure of the edited image.

The leftmost edited image P1 is an image generated by editing. The edited image P1 is composed of images of each layer of the background image P11, the captured image P12, and the foreground image P13.

In the example of FIG. 9, the background image P11 is an image of the pattern of the wall surface on which bricks are stacked. The foreground image P13 is an image including an image of handwritten characters of "Love my friend" and a heart-shaped image. The handwritten character image of "Love my friend" is a pen image input by the user using the pen tool at a position below the center of the photographed image P12. The heart-shaped image is a stamp image input by the user at the upper left position of the photographed image P12 using the stamp tool.

As described above, the edited image P1 is generated by superimposing the subject region of the photographed image P12 extracted by the chroma key processing on the background image P11 and superimposing the foreground image P13 on the background image P11. It is also possible to input a pen image or a stamp image on the background image P11 and display it on the background of the subject.

<Internal configuration of photo sticker making device>
FIG. 10 is a block diagram showing an example of the internal configuration of the photo sticker creating device 1. The same components as those described above are designated by the same reference numerals. Duplicate explanations will be omitted as appropriate.

The control unit 201 is configured by a CPU (Central Processing Unit) or the like. The control unit 201 executes a program stored in the ROM (Read Only Memory) 206 or the storage unit 202, and controls the overall operation of the photo sticker creation device 1. A storage unit 202, a communication unit 203, a drive 204, a ROM 206, and a RAM (Random Access Memory) 207 are connected to the control unit 201. Each configuration of the photographing unit 208, each configuration of the editing units 209A and 209B, and the printer 241 are also connected to the control unit 201.

The storage unit 202 is a non-volatile storage medium such as a hard disk or a flash memory. The storage unit 202 stores various setting information and the like supplied from the control unit 201. The information stored in the storage unit 202 is appropriately read out by the control unit 201.

The communication unit 203 is an interface of a network such as the Internet. The communication unit 203 communicates with an external device according to the control of the control unit 201. The communication unit 203 transmits, for example, a captured image selected by the user to the server. The image transmitted from the communication unit 203 is allocated and stored in a predetermined storage area in the server, and is displayed or downloaded to the mobile terminal that has accessed the server.

A removable media 205 made of an optical disk, a semiconductor memory, or the like is appropriately mounted on the drive 204. The programs and data read from the removable media 205 by the drive 204 are supplied to the control unit 201, stored in the storage unit 202, and installed in the storage unit 202.

The ROM 206 stores programs and data executed by the control unit 201. The RAM 207 temporarily stores data and programs processed by the control unit 201.

The shooting unit 208 realizes shooting processing for the user in the shooting space A1. The photographing unit 208 is composed of a coin processing unit 221, a lighting device 222, a camera 111, a touch panel monitor 112, and a speaker 223.

The coin processing unit 221 detects the insertion of coins into the coin insertion slot. When the coin processing unit 221 detects that a predetermined amount of coins such as 400 yen has been inserted, the coin processing unit 221 outputs an activation signal instructing the start of the game to the control unit 201.

The lighting device 222 is each lighting device provided in the photographing space A1 such as the upper strobe unit 103 and the foot strobe unit 104. Each of the lighting devices 222 emits light according to the lighting control signal supplied from the control unit 201.

The camera 111 shoots according to the shutter control by the control unit 201, and outputs the data of the captured image obtained by the shooting to the control unit 201.

The editorial unit 209A realizes an editing process for a user in the editing space A2-1. The editorial unit 209A includes a tablet built-in monitor 141, touch pens 142A and 142B, and a speaker 231. The editing unit 209B has the same configuration as the editing unit 209A, and realizes an editing process for a user in the editing space A2-2.

The tablet built-in monitor 141 displays various screens according to the control by the control unit 201, and accepts the user's operation on the displayed screens. An input signal representing the content of the user's operation is supplied to the control unit 201.

The printer 241 prints the edited image on the sticker paper stored in the sticker paper unit 242 based on the print data supplied from the control unit 201. The printer 241 discharges the sticker paper on which the edited image is printed in a predetermined layout to the sticker paper discharge port 151.

<Structure of control unit>
FIG. 11 is a block diagram showing a functional configuration example of the control unit 201. At least a part of the functional units shown in FIG. 11 is realized by executing a predetermined program by the CPU in the control unit 201.

The control unit 201 includes a shooting processing unit 301, an editing processing unit 302, and a printing processing unit 303.

The shooting processing unit 301 controls each unit of the shooting unit 208 to perform shooting processing. The editing processing unit 302 controls each unit of the editing units 209A and 209B to perform editing processing. The print processing unit 303 controls the printer 241 to print the edited image on the sticker paper.

FIG. 12 is a block diagram showing a configuration example of the editing processing unit 302.

The editing processing unit 302 includes an image processing unit 311 and a display control unit 312. The captured image obtained by the photographing process is supplied to the image processing unit 311 and the display control unit 312. A plurality of captured images such as five images are supplied from the photographing processing unit 301. For the image processing unit 311 and the display control unit 312, background image data, composite image data such as a pen image and a stamp image, information indicating the content of an operation input by a user using the touch pen 142, etc. Is also entered.

The image processing unit 311 edits the captured image according to the user's operation performed by using various editing tools such as a pen tool and a stamp tool. The data of the captured image after editing is supplied to the display control unit 312 every time the editing is performed. Further, the image processing unit 311 performs chroma key processing on the captured image, and synthesizes the background image selected by the user with the background of the user reflected in the captured image. The image processing unit 311 appropriately switches the captured image to be edited for editing, and after the editing process is completed, outputs the edited image, which is the edited captured image, to the print processing unit 303.

The display control unit 312 controls the display on the screen of the tablet built-in monitor 141. For example, the display control unit 312 displays the edit screen on the tablet built-in monitor 141, and switches the display of the edit screen according to the user's operation.

Further, the display control unit 312 displays the captured image after editing on the editing screen based on the information supplied from the image processing unit 311. After the editing process is completed, the display control unit 312 causes the tablet built-in monitor 141 to display various screens such as a layout selection screen and a screen for guiding the movement to the print waiting space A3.

<Operation of photo sticker making device>
Here, the operation of the photo sticker creation device 1 that provides the photo sticker creation game will be described with reference to the flowchart of FIG. The process of FIG. 13 is started when a predetermined amount of coins is inserted into the coin slot.

In step S1, the photographing processing unit 301 controls the photographing unit 208 to perform the photographing process.

In the shooting process, the shooting processing unit 301 displays the selection screen of the number of people and the shooting course on the touch panel monitor 112, and causes them to select them. For example, different shot images are generated depending on the shooting course.

The appearance of the subject varies depending on the type of image processing applied to the captured image and the like. For example, the appearance of a subject is determined by adjusting at least one of saturation, brightness, sharpness, contrast, and the like of a person's area in a captured image. Image processing is applied to the captured image to adjust various parameters such as saturation, brightness, sharpness, and contrast. The image of the subject may be changed by controlling the light emission amount, the light emission timing, and the like of each strobe in the shooting space A1.

When the number of people or the shooting course is selected, the shooting processing unit 301 controls the camera 111 to start capturing the moving image. The shooting processing unit 301 displays the captured moving image as a live view image on the touch panel monitor 112. Users can check how they are captured by looking at the live view image.

After the live view image is displayed for a predetermined time, the countdown before shooting is started. When it is time to shoot, the shooting processing unit 301 performs the first shooting. After that, the shooting processing unit 301 repeatedly shoots a predetermined number of times.

For example, when the first to third shots of the five shots are close-up image shots and the fourth and fifth shots are full-body image shots, the shooting processing unit 301 takes the shot images of each shot. Processing such as adjusting the angle of view of the camera 111 is performed according to the type.

As the whole body image, an image showing the whole body of the user seen from diagonally above and an image showing the whole body of the user seen from the front may be generated. The former full-body image is generated based on a still image obtained by shooting with the shooting / display unit 101 at a high position and looking down at the user from above. Further, the latter full-body image is generated based on a still image obtained by shooting the user from the front with the position of the shooting / display unit 101 lower than the position at the time of shooting the former full-body image. To.

In this case, for example, the height of the photographing / displaying unit 101 and the angle of the camera 111 can be adjusted. The user can take a full-body image with a different angle (shooting direction).

After shooting a predetermined number of times such as five times, the shooting processing unit 301 guides the user who has finished shooting to move to the editing space A2-1 or the editing space A2-2. Guidance for moving to the editing space is performed by displaying a guidance screen on the touch panel monitor 112 or by outputting voice from the speaker 223.

In step S2 of FIG. 13, the editing processing unit 302 performs editing processing and generates an edited image. In the editing process, the editing screen is displayed on the tablet built-in monitor 141, and the captured image is edited. The tablet built-in monitor 141 on which the editing screen is displayed is a monitor provided in the editing space of the user who has finished the shooting process and is the destination of the movement.

Editing of the captured image using the edit screen ends when the preset time limit elapses or the end button displayed on the edit screen is operated. When the editing of the captured image is completed, the layout is selected, the portable image is selected, and the like, and then the movement to the print waiting space A3 is guided. The details of the editing process will be described later with reference to the flowchart of FIG.

In step S3, the print processing unit 303 controls the printer 241 and prints the edited image obtained by the editing process on the sticker paper. If the photographed image obtained by the photographing process has not been edited, the photographed image is printed as it is on the sticker paper.

In step S4, the printer 241 discharges the sticker paper on which the edited image is printed to the sticker paper discharge port 151, and ends the process.

<Editing process>
Next, the editing process performed in step S2 of FIG. 13 will be described with reference to the flowchart of FIG.

In step S11, the display control unit 312 of the editing processing unit 302 causes the tablet built-in monitor 141 to display the selection screen related to the image. Here, for example, the size of the eyes and face, the brightness of the skin, and the like are selected.

The image processing unit 311 performs image processing on each of the five captured images acquired from the photographing processing unit 301 according to the user's selection content, and adjusts the size of the eyes and face and the brightness of the skin. .. The captured image to be edited is an image in which the size of the user's eyes and face and the brightness of the skin appearing in the captured image are adjusted.

In step S12, the display control unit 312 displays the name input screen on the tablet built-in monitor 141. The editing tools that can be used during editing change according to the user's name entered on the name input screen. For example, a stamp image that expresses the user's name in handwritten characters is prepared as an editing tool.

In step S13, the display control unit 312 displays the edit screen on the tablet built-in monitor 141. As will be described in detail later, the selection of the background image is performed using the editing screen within the time allotted for editing the captured image.

The image processing unit 311 extracts the user's area by performing chroma key processing on the captured image, and combines the background image selected by using the buttons on the edit screen with the captured image. Further, the image processing unit 311 synthesizes a composite image such as a stamp image and a pen image with the photographed image in which the background image is composited according to the user's operation, and generates an edited image.

When the editing of the captured image is completed, in step S15, the display control unit 312 displays the division number selection screen on the tablet built-in monitor 141. The division number selection screen is a screen used for selecting the layout of the edited image to be printed on the sticker paper.

When a predetermined layout is selected, in step S16, the display for selecting a portable image is displayed on the tablet built-in monitor 141. The mobile phone-only image is, for example, an image selected from captured images.

After selecting the captured image to be transmitted as the mobile-only image, the tablet built-in monitor 141 displays, for example, an input screen for the e-mail address of the user's mobile terminal. The user enters an email address and is ready to receive emails sent from the server.

In step S17, the control unit 201 controls the communication unit 203 and transmits the mobile-only image selected by the user to the server. The user can operate the mobile terminal to access the server and input the ID printed on the edge of the sticker paper to capture the mobile-only image into the mobile terminal.

In step S18, the editing processing unit 302 guides the user who has finished editing the captured image to move to the print waiting space A3. Guidance for moving to the print waiting space A3 is performed by displaying a guidance screen on the tablet built-in monitor 141 or by outputting voice from the speaker 231.

After that, the process returns to step S2 in FIG. 13 and the subsequent processing is performed. When the printing is completed, the user receives the sticker paper on which the edited image is printed and ends the use of the photo sticker creating device 1.

<< Example 1 >>
FIG. 15 is a diagram showing an example of an editing screen displayed on the tablet built-in monitor 141.

The edit screen is basically composed of the area 403L and the area 403R formed on the left and right sides of the background selection area 401, which is a vertically long quadrangular area. Below the background selection area 401, a BGM selection area 402, which is a small area having the same width as the background selection area 401, is formed. Above the background selection area 401, the remaining time of the time limit allocated to the editing work and the like are displayed.

The background selection area 401 is a display area such as a button used for selecting a background image. The background selection area 401 is always displayed while the edit screen is displayed. The user can select the background image at any time while editing using the edit screen.

The BGM selection area 402 is an area used for adjusting the volume of the BGM. The background selection area 401 and the BGM selection area 402 are areas shared by the user on the left side and the user on the right side when facing the tablet built-in monitor 141.

On the other hand, the area 403L is an area used by the user on the left side of the tablet built-in monitor 141, and the area 403R is an area used by the user on the right side of the tablet built-in monitor 141. ..

That is, an operation using either the touch pen 142A or the touch pen 142B is accepted for the display of the background selection area 401 and the BGM selection area 402, but the touch pen 142A is used for the display of the area 403L. Only the operation is accepted, and only the operation using the touch pen 142B is accepted for the display of the area 403R.

When the user on the left side of the tablet built-in monitor 141 presses the button of the background selection area 401 using the touch pen 142A and selects the background image, the operation is performed using the display of the area 403L. It is reflected in.

On the other hand, when the user on the right side presses the button of the background selection area 401 using the touch pen 142B and selects the background image, the operation is reflected in the editing performed using the display of the area 403R.

In this way, the control unit 201 identifies whether the operation for each area of the editing screen is an operation performed using the touch pen 142A or an operation performed using the touch pen 142B.

The main configurations of the area 403L and the area 403R are symmetrically provided. The broken line surrounding each area in FIG. 15 is not actually displayed on the screen.

The thumbnail display area 411L above the center of the area 403L is a display area for a thumbnail image representing a captured image. Thumbnail images are generated, for example, by reducing each of the captured images. The user (the user on the left side of the tablet built-in monitor 141) selects the captured image to be edited by selecting the thumbnail image displayed in the thumbnail display area 411L.

In the example of FIG. 15, thumbnail images P21 to P25 representing five captured images are displayed side by side in the thumbnail display area 411L. Further, by selecting the leftmost thumbnail image P21, the first captured image is targeted for editing. The cursor C1 is displayed on the thumbnail image P21.

The thumbnail images P21 to P23 are thumbnail images of up images, and the thumbnail images P24 and P25 are thumbnail images of whole body images.

The editing area 412L, which is largely formed in the substantially center of the area 403L, is a display area of the captured image selected as the editing target. The user can select an editing tool using the touch pen 142A and edit the captured image displayed in the editing area 412L.

On the left side of the editing area 412L, a button 413L operated when displaying an editing sample and a button 414L operated when creating a mobile-only image are displayed.

Below the editing area 412L, an editing palette 415L, which is a horizontally long rectangular area, is displayed. The editing palette 415L is an area in which buttons and the like used for selecting various editing tools (contents) such as a pen tool and a stamp tool are displayed.

Six types of tabs 431L are displayed on the edit palette 415L, and six types of tabs 432L are displayed on the right side of the edit palette 415L. The user can switch the type and category of the editing tool to be displayed on the editing palette 415L by using the tab 431L and the tab 432L.

The tab 431L is composed of "HIKARI", "simple", "hand-drawn", "tight", "collage", and "live-action" tabs. These tabs are used to select the category of editing tools.

The tab 432L is composed of "PEN", "STAMP1", "STAMP2", "MOJI", "transformation", and "texture" tabs. These tabs are used to select the type of editing tool.

For example, the tab named "PEN" is the tab that is operated when selecting the pen tool. The pen tool is an editing tool that can input a predetermined pen image along the trajectory by moving the touch pen 142A in a state of being pressed against the editing area 412L after selecting the pen tool.

The tabs named "STAMP1" and "STAMP2" are tabs that are operated when the stamp tool is selected. The stamp tool is an editing tool capable of inputting a predetermined stamp image at a position where the touch pen 142A is pressed by pressing the touch pen 142A against the editing area 412L after selecting the stamp tool.

For example, every time the tab 431L is switched with the pen tool selected, the buttons operated when selecting the pen tools belonging to different categories are displayed side by side on the edit palette 415L. A category is set for each editing tool.

A correction tool selection area 416L is formed on the right side of the editing area 412L. The correction tool selection area 416L cancels all the buttons used to select the eraser tool, the "forward" and "back" buttons operated when returning to the previous or next work, and all the edits that have already been entered. , This is the area where the "From the beginning" button, which is operated when returning to the state before editing, is displayed vertically. The eraser tool is a tool used to erase entered edits. A "1 set back" button is also displayed in the correction tool selection area 416L. By pressing the "1 set back" button, the edits entered during the predetermined time can be canceled at once.

Above the correction tool selection area 416L, an end button 417L that is operated when the editing process is ended is displayed.

In the area 403R used by the user on the right side of the tablet built-in monitor 141, the same configuration as that of the area 403L as described above is arranged symmetrically in position. In the example of FIG. 15, by selecting the thumbnail image P22 from the thumbnail display area 411R, the second shot image is set as the editing target. The cursor C2 is displayed on the thumbnail image P22. The cursor C1 and the cursor C2 are displayed in different colors, for example.

A photographed image selected by one user as an editing target cannot be selected by the other user as an editing target. At a certain timing, different captured images are set as editing targets in the area 403L and the area 403R.

When one user switches the captured image to be edited, the other user can newly select the captured image selected by the other user as the editing target. In this case, the content of the editing performed by one user is maintained as it is. The other user will further edit the captured image edited by one user.

In the editing process, such an editing screen is used by the left and right users, and the captured image is edited. On the edit screen, the thumbnail display area 411L, the edit area 412L, and the edit palette 415L are mainly arranged in the area 403L with the background selection area 401 in the center, and the thumbnail display area 411R, the edit area 412R, and the edit palette 415R are mainly arranged. The area 403R arranged in is displayed at the same time.

As described with reference to FIG. 14, the edit screen is displayed on the tablet built-in monitor 141 instead of the name input screen after the name is input. Further, when the editing is completed by the elapse of a preset time or by the operation of the end button, the tablet built-in monitor 141 is used to select the number of divisions used for layout selection instead of the editing screen. The screen is displayed.

A display such as the background selection area 401 is displayed only on the edit screen, and is not displayed on other screens including the screen displayed on the touch panel monitor 112 of the shooting space A1. In a series of games provided by the photo sticker creation device 1, the background image to be combined with the captured image can be selected only during editing while the editing screen is displayed on the tablet built-in monitor 141. .. In other words, the background image cannot be selected except when the edit screen is displayed on the tablet built-in monitor 141.

Hereinafter, the details of the display of the background selection area 401 will be described.

FIG. 16 is an enlarged view showing the background selection area 401 of FIG.

Above the background selection area 401, a message is displayed to guide the selection of the background image and the selection of the category, and below that, the names "Hikari", "Rough", "Fashionable", and "Normal" are given. The category tabs 451-1 to 451-4 that have been created are displayed side by side. The user can switch the category of the background image displayed below the category tabs 451-1 to 451-4 by operating the category tabs 451-1 to 451-4.

For example, when the user on the left operates the category tab 451-1, a button used for selecting a background image belonging to the category of "Hikari" is displayed in the background selection area 401. Further, for example, when the user on the right side operates the category tab 451-2, a button used for selecting a background image belonging to the "rough" category is displayed in the background selection area 401.

For example, a background image belonging to the "Hikari" category is a single-color image that does not interfere with the image of the user. The background image belonging to the "rough" category is an image in which a pattern is added to the background image belonging to the "fashionable" category. Background images that belong to the "fashionable" category are background images of various colors. The background image belonging to the "normal" category is an image with a slight pattern based on a white color.

If only a simple image such as a single-color image is used, the satisfaction of the user who wants to select a flashy background image cannot be obtained. Therefore, various images with patterns are also prepared in this way.

In this way, by dividing the background image into categories and enabling the display to be switched by tabs, it is possible to prevent background images having different colors from being mixed. Further, since only the buttons used for selecting the background image of the same color are displayed at a certain timing, the user can easily select the background images belonging to the same category in succession.

The "Hikari" category is the default category. Immediately after the start of display on the edit screen, a button used for selecting a background image belonging to the "Hikari" category is displayed in the background selection area 401. The tabs of the selected category are displayed in a different color from the other tabs. The state of the background selection area 401 in FIG. 16 is a state in which the "rough" category is selected.

Below the category tabs 451-1 to 451-4, a message prompting the selection of five background images is displayed, and below that, 24 buttons of the background selection buttons 471-1 to 471-24 are displayed in 6 lines 4 Displayed side by side in a column.

The background selection buttons 471-1 to 471-24 are square (rectangular) images of the same size. The pattern of each button represents the pattern of the background image. For example, the background selection button 471-1 is an image of a brick pattern. When the background selection button 471-1 is selected, the background image of the brick pattern is combined with the captured image to be edited.

FIG. 17 is a diagram showing a display example of the edit screen.

For example, when the user on the left side presses the background selection button 471-1 on the upper left of the background selection area 401 while the edit screen of FIG. 15 is displayed, the image processing unit 311 is edited by the user on the left side. The first photographed image and the background image of the brick pattern corresponding to the background selection button 471-1 are combined.

As shown in FIG. 17, the display control unit 312 displays the captured image in which the background image corresponding to the background selection button 471-1 is combined is displayed in the editing area 412L in real time. At this time, the background selection button 471-1 displays the cursor C11 indicating that the background image is being selected.

Similarly, when the user on the right side presses the background selection button 471-2 from the buttons displayed in the background selection area 401, the image processing unit 311 is subject to editing by the user on the right side2. The shot image of the first sheet and the background image corresponding to the background selection button 471-2 are combined.

As shown in FIG. 17, the display control unit 312 displays the captured image in which the background image corresponding to the background selection button 471-2 is combined is displayed in the editing area 412R in real time. At this time, the background selection button 471-2 displays the cursor C12 indicating that the background image is being selected. The cursor C11 and the cursor C12 are cursors of different colors. Various displays can be used as a display representing the selected background image, such as displaying an arrow image in the vicinity of the selected background image instead of displaying the cursor.

In this way, the user can select the background image to be combined with the captured image to be edited by operating the button that is always displayed, and can confirm the composition result in real time. Since the display area of the composite result is a large area, the user can select a background image suitable for the captured image while checking the details.

Further, since the background image selection area is provided in the center of the editing screen, the left and right users can select the background image while consulting with each other.

The user selects a thumbnail image, sequentially switches the captured images to be edited, and operates the button displayed in the background selection area 401 to select one background image to be combined with each captured image. Will be done.

The left and right users can also select the same image as the background image to be combined with the five captured images. By selecting the same background image, it is possible to create a sense of unity when printing five edited images.

When the other user selects a captured image for which one user has already selected a background image as the editing target and selects a different background image, the background image combined with the captured image to be edited is the other user. Switches to a new background image selected later by. The display of the editing area 412L and the editing area 412R is also switched to the captured image in which a new background image is combined each time.

As a result, the background image selected by one user can be replaced with another background image by the other user.

FIG. 18 is a diagram showing another display example of the edit screen.

In the example of FIG. 18, the photographed image in which the background image is selected by the user on the right side in the editing screen of FIG. 17 is displayed in the editing area 412L of the area 403L. Further, in the editing area 412R of the area 403R, a fourth photographed image, which is a whole body image, is displayed.

That is, in the state shown in FIG. 18, the photographed image selected as the editing target by the user on the right side is switched from the second photographed image to the fourth photographed image, and the user on the left side makes a new edit. As the target, the background image is selected by the user on the right side, and the second captured image is selected.

The user on the left side can edit the second shot image displayed in the editing area 412L, and the user on the right side edits the fourth shot image displayed in the editing area 412R. It can be performed.

In this state, for example, when the user on the left side presses the background selection button 471-5 from the buttons displayed in the background selection area 401, the image processing unit 311 displays the background image selected by the user on the right side. Instead of (background image corresponding to the background selection button 471-2), the background image corresponding to the background selection button 471-5 is combined with the second captured image to be edited.

As shown in FIG. 19, the display control unit 312 displays the captured image in which the background image corresponding to the background selection button 471-5 is combined is displayed in the editing area 412L in real time. At this time, the cursor C11 indicating that the background image is being selected is displayed on the background selection buttons 471-5 of the background selection area 401.

In this way, the user on the left side can replace the background image selected by the user on the right side with another background image. Similarly, the user on the right side can replace the background image selected by the user on the left side with another background image. Thereby, for example, the background image selected by the user who is not accustomed to selecting the background image can be replaced with another background image by the accustomed user.

The user can also select the background image to be combined with the whole body image by using the display of the background selection area 401.

FIG. 20 is a diagram showing an example of a background image associated with the background selection button 471-1.

Each background selection button in the background selection area 401 is associated with a background image for a close-up image and a background image for a full-body image. Since the aspect ratios of the close-up image and the whole body image are different, the same background image cannot be combined.

When a predetermined background selection button displayed in the background selection area 401 is pressed, among the background images associated with the pressed background selection button, the captured image selected as the editing target at that time is uploaded. When it is an image, a background image for a close-up image is used, and when it is a full-body image, a background image for a full-body image is used. A background image for such a close-up image and a background image for a whole body image are stored in a storage unit 202 or the like.

The background image of FIG. 20A is a background image for a close-up image associated with the background selection button 471-1. When the close-up image is selected as the captured image to be edited and the background selection button 471-1 is operated, the background image of FIG. 20A is used for compositing with the close-up image as shown in the edit area 412L of FIG.

On the other hand, the background image of FIG. 20B is a background image for a whole body image associated with the background selection button 471-1. When a whole body image is selected as the captured image to be edited and the background selection button 471-1 is operated, the background image of FIG. 20B is used for compositing with the whole body image.

The background image of FIG. 20B is an image of a brick pattern similar to the background image of FIG. 20A. In the background image of FIG. 20B, the brick pattern is drawn on the portion corresponding to the floor portion of the photographing space A1 reflected in the whole body image. In the composition of the background image of FIG. 20B, the user and the floor area appearing in the captured image to be edited are extracted by chroma key processing, and the background image is combined with the floor area, which is the background of the user area. It is done. The background image used for compositing with the whole body image can be composited with the floor area, the background area, the side area, or a combination of these areas.

FIG. 21 is a diagram showing a display example of the edit screen.

The captured image displayed in the editing area 412R of FIG. 21 has a background selection button in a state where the fourth captured image is selected as an editing target by the user on the right side as described with reference to FIG. It is an image obtained by synthesizing a background image (FIG. 20B) for a whole body image, which is associated with the background selection button 471-1 when 471-1 is pressed.

As described above, as one type of background image, a plurality of images having the same color and the same pattern that match the shooting angle of view are prepared. The user can also select the background image to be combined with the whole body image by using the display of the background selection area 401 in the same manner as the background image to be combined with the close-up image.

A background selection button operated when selecting a background image for a close-up image and a background selection button operated when selecting a background image for a full-body image may be prepared respectively. In this case, the former background selection button can be operated only when the close-up image is selected as the editing target. Further, the latter background selection button can be operated only when a full-body image is selected as an editing target.

As described above, the user can enjoy the selection of the background image while consulting with each other using the display of the background selection area 401 arranged in the center of the editing screen.

One user is in charge of editing using the editing tool, and the other user is in charge of selecting the background image. In addition, the user can select the background image while checking the content of the edit.

Since the background selection area 401 is always displayed, the user can select the background image over time. In addition, since the composite result of the background image is displayed in a large size in real time, the user can select the background image while viewing the details of the background image or the content of the input edit. That is, the user can select the optimum background image for the captured image.

When the background image is selected using the display of the background selection area 401, the foreground image may be combined with the captured image to be edited together with the background image.

As the background image of the five captured images, it may be possible to select only from the background images belonging to one category.

For example, as the background image to be combined with the 1st to 4th shot images, 4 images are selected from the background images belonging to the "Hikari" category, and as the 5th shot image, the background image belonging to the "rough" category is selected. When selected from, the selection of the background image belonging to the "Hikari" category is cancelled. As a result, it is possible to prevent background images belonging to different categories from being selected in a mixed manner, and it is possible to obtain five edited images with a sense of unity.

If the user selects the category tab 451-2, which is a tab of the "rough" category, while selecting from the background images belonging to the "Hikari" category, "other background images will disappear. A message calling attention such as "" may be displayed in a pop-up.

For example, a white background image belonging to the category of "Hikari" is combined with the captured image in which the background image is not selected. A white background image belonging to the "Hikari" category is a predetermined default background image. If no background image has been selected during editing, a white background image will be combined with all five captured images.

The white background is achromatic and has the effect of attracting other colors. Here, the other colors are the skin color of the user and the color of the hair such as black and brown. As a result, the user's face becomes more three-dimensional, and the balance between the background image and the person image is improved. An image of another color instead of white may be used as the default background image.

The content of the correction made by using the display of the correction tool selection areas 416L and 416R may not be reflected in the background image. As described above, in the correction tool selection areas 416L and 416R, a "forward" button, a "back" button, a "from the beginning" button, a "1set back" button, and the like are displayed.

If, for example, the "from the beginning" button is operated after selecting the background image, the composition of the compositing image input using the editing tool is canceled, but the selection of the background image is not canceled and is maintained. This is because, unlike editing using an editing tool, the selection of the background image can be corrected by a single operation such as pressing a button displayed in the background selection area 401. Of course, the correction using the correction tool may be reflected in the selection of the background image.

<< Example 2 >>
<1. About the display of the background selection area>
(1) Movement The background selection area may be moved to the edge of the editing screen instead of the center of the editing screen. The movement of the background selection area is performed by the user's operation or by the photo sticker creating device 1.

When the background selection area is moved by the user's operation, for example, the background selection area is designated by the user with the touch pen, and the background selection area moves according to the trajectory when the touch pen is moved. On the other hand, when the background selection area is moved by the photo sticker creation device 1, for example, when the image to be edited is a vertically long image, the background selection area is arranged in the center, and when the image is horizontally long, the background is arranged. It is also possible to change the arrangement of the background selection area according to a predetermined condition such as arranging the selection area at the edge.

FIG. 22 is a diagram showing an example of an edit screen.

Of the configurations shown in FIG. 22, the same configurations as those described above are designated by the same reference numerals. Duplicate explanations will be omitted as appropriate.

In the editing screen of FIG. 22, the background selection area 401L is formed closer to the left end of the area 403L, and the background selection area 401R is formed closer to the right end of the area 403R. The background selection area 401L and the background selection area 401R are display areas such as a background selection button, similar to the background selection area 401 described above.

In the case of FIG. 22, since all the background images are not displayed in the background selection area, the background image that is not displayed may be displayed by scrolling the background selection area in the vertical direction or the horizontal direction. Further, in the first embodiment, four background image categories (category tabs) are displayed, but only the background images belonging to one category are displayed, and it is described as a neighborhood area or category of the category tab. By pressing the area, you may switch to the background image that belongs to another category. Since the background images belonging to one category are selected, it is easy to check the images of the same color when displaying multiple background images.

If the background selection area is arranged in the center of the editing screen, it may be difficult to operate or the visibility may be deteriorated depending on the dominant hand of the user. By making it possible to change the arrangement position of the background selection area in this way, operability and visibility may be improved.

When the background selection area is moved, the arrangement of the background selection buttons and the layout of each area are changed as appropriate. For example, when background selection areas are provided at both ends of the edit screen, it is not possible to secure a display space, and it is necessary to make each background selection button smaller or reduce the number of buttons to be displayed. In this case, the editing area 412L and the editing area 412R may be moved to the center of the editing screen to secure a display space for the background selection area.

As shown in FIG. 23, the editing palette 415L and the editing palette 415R may be moved to the center of the editing screen to secure a display space for the background selection area. This makes it possible to increase the vertical length of the background selection area. The background image that is not displayed may be displayed by the scroll operation.

As shown in FIG. 24, the background selection buttons are displayed in a row in the background selection areas formed on the left and right sides of the editing screen, and next to them, the sample images when the respective background images are combined are displayed vertically side by side. It is also possible to let them do it. The sample image is an image in which each background image is combined with an image showing a model person. This allows the user to select the background image while checking the image. Instead of the model person, an image obtained by synthesizing the user himself and the background image may be displayed as a sample image. It is also possible to provide a means for switching the display of the background selection button, such as a button that slides up and down.

(2) Enlarged The background selection area 401 may be enlarged and displayed. In this case, the range in which the background selection area 401 can be enlarged and displayed is set as, for example, a range in which the editing area 412L and the editing area 412R are not hidden. As the background selection area 401 expands, each background selection button also expands and is displayed.

As described above, when the background selection button is operated, the composite result of the background image is displayed in real time in the editing areas 412L and 412R, but in order to confirm the details of the background image, the background image is actually displayed in this way. Must be selected. By enlarging the background selection area 401 and displaying each background selection button in a large size, the user can display the details of each background image such as the color of the background selection button without actually selecting the background image. It can be confirmed from the pattern.

Further, when all the background images to be combined with the five captured images have been selected, the background selection area 401 may be reduced from the viewpoint of visibility.

(3) Display / non-display switching 1
The display of the background selection area 401 may be switched on / off (display / non-display). When the display of the background selection area 401 is turned off, a button or the like operated when the background selection area 401 is redisplayed is displayed at a predetermined position on the edit screen.

When the display of the background selection area 401 is turned off, instead of the background selection area 401, an area for realizing another function (pen list, stamp list, etc.) such as an area used for selecting an editing tool. May be formed.

(4) Dynamic (animation) display
A background image may be displayed and selected by using a moving image in a predetermined format such as a gif moving image or a flash moving image. By using a moving image, it is expected that the selection rate will increase because it is more conspicuous than the case where the selection is made by the button of the still image.

(5) The function appears after a certain period of time. The background selection area 401 may be displayed after a predetermined time has elapsed from the start of editing, and the background image may be selected. In this case, immediately after the start of editing, editing can be performed using a pen tool or the like, and then a background image can be selected according to the edited image.

(6) Pop-up display In order to display the background selection button in a large size, the background selection area 401 may be displayed in a pop-up manner straddling the editing areas 412L and 412R. Since each background selection button is displayed in a large size, the user can confirm the details of each background image from the color, pattern, and the like of the background selection button.

(7) Button Shape The shape of the background selection button may be displayed as a quadrangle with the same aspect ratio as the aspect ratio of the captured image selected as the editing target. For example, if the aspect ratio of the up image is 1: 1.2 and the aspect ratio of the whole body image is 3: 4, when the captured image selected for editing is the up image, each background selection button is 1: 1. It is displayed with an aspect ratio of .2, and each background selection button is displayed with an aspect ratio of 3: 4 when it is a full-body image.

By adjusting the aspect ratio of each thumbnail image displayed in the thumbnail display areas 411L and 411R according to the type of image, the aspect ratio of each image of the shot image to be edited, the background selection button, and the thumbnail image is aligned. Therefore, the balance of arrangement is improved.

(8) Number of Displayed Background Selection Buttons Only one large background selection button may be displayed in the background selection area 401, and the display may be switched by button operation or the like. The ratio of the number of captured images to be edited and the number of background images is not one-to-many, but one-to-one.

(9) Display / non-display switching 2
The display of the background selection area 401 may be switched on / off depending on whether the captured image to be edited is a close-up image or a full-body image.

For example, when the captured image to be edited is a close-up image, the display of the background selection area 401 is turned on, and when it is a full-body image, the display of the background selection area 401 is turned off. Since the close-up image is an image with a large area showing the face, there is a desire to select a background image that does not interfere with the appearance of the face. By making it possible to select a background image when the captured image to be edited is a close-up image, the user can select a background image that does not interfere with the appearance of the face.

In addition, since the whole body image is an image in which the area where the face is reflected is small, it is often the case that the image is not as particular as the close-up image. The user may think that it is not necessary to be able to select the background image.

On the contrary, the display of the background selection area 401 may be turned off when the captured image to be edited is a close-up image, and the display of the background selection area 401 may be turned on when the captured image to be edited is a full-body image.

(10) Person on / off button The person on / off button is operated as a background selection button when selecting whether to display an image in which a person is composited or an image in which a person is not composited. It's a button. By operating the person on / off button, it is possible to display an image in which a person is combined with an image representing the background image as each background selection button. The person to be synthesized may be the user himself or the person of the model.

By displaying the image in which the person is combined, the user can imagine the image after the composition from the display of the background selection button.

(11) Omakase Function By pressing a predetermined button, the background image to be combined with each captured image may be randomly selected. For example, it is possible to select a background image having a high selection rate.

(12) Set background The set background is a set of five background images combined with each of the five captured images. For example, a plurality of types of set backgrounds are prepared and displayed in the background selection area 401. By selecting a favorite set background, the user can select a background image to be combined with each of the five captured images in a single operation.

For users who are not interested in selecting a background, using a set background can reduce the time and effort. In addition, in order to prevent the sense of unity when printed on the sticker paper from being impaired, a background other than the set background may not be selected.

(13) Switching the tabs of the background image category The background image category displayed in the background selection area may be switched according to the editing tool (content) used by the user for editing. For example, when editing is performed using a pen tool with a thin line width, a simple background image category is automatically selected, and a background selection button used to select a background image belonging to that category is displayed in the background selection area 401. Will be done.

(14) Content switching Contrary to the above (13), the content displayed on the editing palettes 415L and 415R may be switched according to the background image selected by the user.

(15) Recommended function The background selection button used for selecting the recommended background image may be displayed in the background selection area 401. This makes it possible to rescue users who do not know which background image to select. For example, a background image having a high selection rate in the photo sticker creating device 1 and a background image having a high selection rate in a region, a town, or a game center where the photo sticker creating device 1 is installed are recommended background images. A mark indicating the recommended background image may be displayed in the vicinity of the background selection button used for selecting the recommended background image.

<2. About image processing>
(1) Adding a shadow to a person area When a background image is selected, it is possible to add a shadow to the area around the person in the captured image according to the hue, lightness, and saturation of the background image.

For example, if the selected background image is a dark image, the area around the person is shaded with a dark color. Further, when the selected background image is an image with a gradation, a shadow with the gradation is added to the area around the person. As a result, it is possible to give a three-dimensional effect to the captured image in which the background image is combined.

(2) Movement / rotation / reduction of the person area When the background image is selected, it is also possible to move / rotate / reduce the area of the person in the captured image according to the pattern of the background image.

For example, when the selected background image is an image including characters and the like, the area of the person is moved and combined with the background image in order to prevent the characters and the like from being hidden. Instead of moving the area of the person, you may rotate or shrink it.

(3) Adding an aura image to a person area When a background image is selected, it is also possible to add an aura image to the area around the person in the captured image according to the hue, brightness, and saturation of the background image. be. An aura image is a decorative image of various colors synthesized along the contour of a person who is a subject. By adding an aura image, a more decorative image can be provided, and when the aura image is black like a shadow, the stereoscopic effect can be emphasized.

(4) Enlargement / reduction of organs When a background image is selected, it is also possible to enlarge / reduce predetermined organs such as the eyes, nose, and mouth of the face in the photographed image. For example, when the background image is a white image, the white color has a high reflectance, so that the captured image obtained by synthesizing such a background image has a three-dimensional effect as if the light is turning more. .. By displaying a predetermined organ in a large size and making the subject appear more clearly, it is possible to emphasize that the image has a three-dimensional effect.

<3. About special shooting mode>
(1) Collage image When the photo sticker creation device 1 has a collage image generation function and the user uses the function, a background image is used for each of a plurality of images constituting one collage image. May be able to be selected.

A collage image is an image composed of a plurality of captured images arranged on one image. Depending on the selection of the background image to be combined with one captured image constituting the collage image, the background image to be combined with the other captured image may be automatically selected.

(2) Pin-shooting image When a pin-shooting image is generated as a mobile-only image, a background image may be selected for each of the pin-shooting images. The pin-captured image is, for example, an image obtained by dividing one captured image in which two users are captured into two images including an area in which each user is captured.

(3) When a moving image is provided to a moving image user, a background image to be combined with the moving image may be selected.

<< Example 3 >>
In the above, it is assumed that the background image is selected using the center area of the edit screen, but other functions such as the following are formed at the same position as the background selection area 401, and the center of the edit screen is formed. It may be provided using the area of.

Since the central area of the tablet built-in monitor 141 is used, the user can easily check the displayed contents regardless of the standing position. Further, since a time of about 150 seconds is allocated for editing (displaying the editing screen), it is possible to secure time (selection time, input time) for work performed using the central area of the editing screen.

(1) Selection of number of divisions Layout may be selected using the central area of the editing screen. In the central area of the edit screen, for example, an image representing each layout is displayed. The user selects a desired layout by pressing the image.

When a predetermined layout is selected, an image representing the selected layout is enlarged and displayed in the editing areas 412L and 412R, and is enlarged and displayed between the editing area 412L and the editing area 412R.

When the above-mentioned division number selection screen displays various layouts for two people, three people, a large number of people, etc. separately for each tab, there is not enough time to check all the layouts. However, it is possible to prevent such a situation.

(2) Input of e-mail address As described above, the user inputs his / her own e-mail address when selecting a mobile-only image. The email address may be entered using the central area of the edit screen.

If the user does not remember the e-mail address of his / her mobile terminal, it takes time to confirm and the input time of the e-mail address may be insufficient, but such a case can be prevented.

(3) Selection of mobile-only image The captured image to be transmitted as the mobile-only image may be selected by using the central area of the editing screen. In the central area of the editing screen, about 10 thumbnail images of candidates for mobile-only images generated based on the captured image are displayed. The user selects a favorite image by selecting a thumbnail image.

When a predetermined thumbnail image is selected, the selected mobile-only image is enlarged and displayed in the editing areas 412L and 412R, or enlarged and displayed between the editing area 412L and the editing area 412R. The user can check the details of the selected mobile-only image.

(4) Eye size and skin brightness selection The eye size and skin brightness may be selected using the central area of the editing screen. In the above example, before the edit screen is displayed, the size of the eyes and the brightness of the skin are selected using the screen displayed on the tablet built-in monitor 141, but this selection is the edit screen. Will be done during the display of.

(5) Inversion function Using the central area of the editing screen, it may be possible to select whether or not to invert the left and right of the captured image. In this case, for example, the captured image and the inverted image are displayed side by side in the center of the editing screen.

In some cases, it may be better to flip the captured image left and right, such as when the user is wearing clothes with characters drawn on it. By displaying the inverted photographed image in the central area of the editing screen, the user can be made aware of this.

(6) Selection of processing type The content of the processing to be applied to the captured image may be selected by using the central area of the editing screen. The processing process is a process of changing parameters such as brightness and saturation of all pixels of a photographed image by applying various filters to the photographed image. In this case, for example, the thumbnail images of the respective images obtained by subjecting the captured image to various processing processes are displayed side by side in the center of the editing screen.

(7) Angle adjustment The angle of the person in the captured image may be adjusted by using the central area of the editing screen. For example, when a predetermined button is operated, an image in which a person appears straight and an image in which a person appears diagonally are switched and displayed. The user looks at the display and adjusts the angle of the person.

(8) The game or advertisement may be provided to the user by using the central area of the game / advertisement editing screen. A user who finishes editing early can play a game or watch an advertisement until he / she moves to the print waiting space A3.

The embodiment of the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the gist of the present technology. For example, the background image cannot be selected except when the edit screen is displayed on the tablet built-in monitor 141, but the background image may be selected at other timings.

1 Photo sticker creation device, 301 shooting processing unit, 302 editing processing unit, 303 printing processing unit, 311 image processing unit, 312 display control unit, 401 background selection area, 411L, 411R thumbnail display area, 412L, 412R editing area

Claims (7)

A shooting unit that shoots a plurality of shot images including a close-up image, which is an image of the upper body of the user in a large size, and a full-body image, which is an image of the whole body of the user, with the user as a subject.
The background selection area in which a plurality of buttons used for selecting a background image are lined up is used for selecting an editing area in which the captured image to be edited is enlarged and a composite image to be combined with the captured image to be edited. At the same time as the compositing image selection area where the images are lined up, a display control unit to be displayed on the editing screen used for editing the captured image, and a display control unit.
When the predetermined button is operated, when the captured image to be edited is the close-up image, the background image for the close-up image corresponding to the operated button is combined with the captured image to be edited. However, when the captured image to be edited is the whole body image, an image processing unit corresponding to the operated button and synthesizing the background image for the whole body image with the captured image to be edited is provided.
The display control unit is an image processing device that displays the captured image in which the background image is combined in the editing area. The image processing apparatus according to claim 1, further comprising a storage unit for storing the background image for a close-up image and the background image for a whole body image in correspondence with each of the buttons. The display control unit according to claim 1 or 2, wherein the editing area and the image selection area for compositing are arranged on the left and right respectively, and the editing screen in which one background selection area is arranged in the center is displayed. Image processing device. The image processing device according to claim 1 or 2, wherein the display control unit displays the editing screen in which the editing area, the image selection area for compositing, and the background selection area are arranged on the left and right respectively. The image processing device according to any one of claims 1 to 4, wherein the photographing unit captures a plurality of types of whole body images having different shooting angles. Taking the user as a subject, a plurality of captured images including a close-up image, which is an image showing the upper body of the user in a large size, and a full-body image, which is an image showing the whole body of the user, are taken.
The background selection area in which a plurality of buttons used for selecting a background image are lined up is used for selecting an editing area in which the captured image to be edited is enlarged and a composite image to be combined with the captured image to be edited. At the same time as the compositing image selection area where the images are lined up, it is displayed on the editing screen used for editing the captured image.
When the predetermined button is operated, when the captured image to be edited is the close-up image, the background image for the close-up image corresponding to the operated button is combined with the captured image to be edited. When the captured image to be edited is the whole body image, the background image for the whole body image corresponding to the operated button is combined with the captured image to be edited.
A display control method including a step of displaying the captured image in which the background image is combined in the editing area. On the computer
Taking the user as a subject, a plurality of captured images including a close-up image, which is an image showing the upper body of the user in a large size, and a full-body image, which is an image showing the whole body of the user, are taken.
The background selection area in which a plurality of buttons used for selecting a background image are lined up is used for selecting an editing area in which the captured image to be edited is enlarged and a composite image to be combined with the captured image to be edited. At the same time as the compositing image selection area where the images are lined up, it is displayed on the editing screen used for editing the captured image.
When the predetermined button is operated, when the captured image to be edited is the close-up image, the background image for the close-up image corresponding to the operated button is combined with the captured image to be edited. When the captured image to be edited is the whole body image, the background image for the whole body image corresponding to the operated button is combined with the captured image to be edited.
A program for executing a process of displaying the captured image in which the background image is combined in the editing area.

Images