JP2022076733A - Image processing device, image processing method, and program - Google Patents

Abstract

To provide an image processing device capable of easily performing edition of captured images and selection of layout designs.SOLUTION: An image processing device in one embodiment generates a layout image according to user's choices of a layout image design which is constituted of placing a pick-up image by synthesizing a pick-up image with a first content which is superimposed on a person in a pick-up image and a second content that represents a design of the area around the pick-up image. The art is applicable to a photo creation game machine that provides a series of a game to print a captured image on a seal sheet.SELECTED DRAWING: Figure 12

Description

The present art relates, in particular, to image processing devices, image processing methods, and programs that allow easy editing of captured images and selection of layout designs.

Conventionally, a photo sticker making device is known. The photo sticker creating device photographs a user, causes the user to edit the photographed image, and prints the edited image on a sticker paper to provide the photographed image. Photo sticker making devices are installed in play facilities and the like.

The flow of one game provided by the photo sticker creation device is usually that after shooting with a user in the shooting space as a subject, the user is moved to the editing space and the image is edited according to the operation performed in the editing space. Then, the edited image is printed on the sticker paper.

Editing of the image obtained by shooting is performed using the editing screen displayed on the display provided in the editing space after moving from the shooting space to the editing space. On the edit screen, along with the image to be edited, buttons used for selecting various tools for editing are displayed.

For example, Patent Document 1 discloses a photographic sticker creating device capable of selecting a sticker layout after editing a photographed image.

Japanese Unexamined Patent Publication No. 2019-121996

As a way to receive images obtained by games, many users place importance on receiving images that can be viewed on mobile terminals such as smartphones, rather than being printed on sticker paper. For such users, it is preferable that the editing of the image to be printed on the sticker paper can be easily performed by using a simple function.

This technique has been made in view of such a situation, and makes it possible to easily edit a photographed image and select a layout design.

The image processing device of one aspect of the present technology is superposed on a person appearing in the photographed image according to the user's selection of a layout image design composed by arranging the photographed image. It is provided with an image processing unit that synthesizes the content of 1 and the second content representing the design of the area around the captured image into the captured image to generate the layout image.

In one aspect of the present technique, the first content is superimposed on the person appearing in the photographed image according to the user's selection of the design of the layout image composed by arranging the photographed image. And the second content representing the design of the area around the captured image are combined with the captured image to generate the layout image.

According to this technique, it is possible to easily edit a photographed image and select a layout design.

It is a perspective view which shows the structural example of the appearance of the photograph sticker making apparatus. It is a perspective view which looked at the appearance of the photograph sticker making apparatus from another angle. It is a perspective view which shows the structural example of the front of a shooting space. It is a perspective view which shows the structural example of the ceiling surface of a shooting space. It is a figure which shows the example of the photographed image. It is a block diagram which shows the configuration example of the photograph sticker making apparatus. It is a block diagram which shows the functional composition example of the photograph sticker making apparatus. It is a block diagram which shows the structural example of an edit processing part. It is a flowchart explaining operation of a photograph sticker making apparatus. It is a flowchart explaining the editing process performed in step S4 of FIG. It is a flowchart explaining the seal design selection process performed in step S12 of FIG. It is a figure which shows the example of the seal design selection screen. It is a figure which shows the sample image enlarged. It is a figure which shows the example of the content which becomes a component of a seal design. It is a figure which shows the example of a template. It is a figure which shows the example of the generation of the image for a seal. It is a figure which shows the other sample image in an enlarged manner. It is a figure which shows the example of the content which becomes a component of a seal design. It is a figure which shows the example of the generation of the image for a seal. It is a figure which shows the example of the image selection screen. It is a figure which shows the example of the image for a seal. It is a figure which shows the example of the printed sticker paper. It is a figure which shows the display example of the scribble screen for exclusive use of a mobile phone. It is a figure which shows the state of editing using the impersonator stamp. It is a figure which enlarges and shows the graffiti input area of FIG. It is a figure which enlarges and shows the stamp image which constitutes the impersonator stamp. It is a figure which shows the example of the operation at the time of adjusting a stamp image. It is a figure which shows the example of the enlargement of a stamp image. It is another figure which shows the example of the enlargement of a stamp image. It is a figure which shows the type of adjustment. It is a figure which shows the example of the movement of a stamp image. It is a figure which shows the example of taking over the adjustment of a stamp image. It is a figure which shows the difference of the composite position.

<< Configuration of photo sticker making device >>
<External configuration>
1 and 2 are perspective views showing a configuration example of the appearance of the photo sticker making device 1.

The photo sticker creating device 1 is a game machine that provides a photographed image taken with a user as a subject. The photo sticker creating device 1 provides an image to a user by printing the photographed image on a sticker paper or making the photographed image viewable on the user's mobile terminal. The photo sticker creating device 1 is installed in an amusement facility such as a game center or a store.

The users of the photo sticker making device 1 are mainly high school girls and young women. In the photo sticker creating device 1, a plurality of users, such as mainly two or three people, can enjoy the game per set.

The user of the photo sticker creating device 1 takes a picture by himself / herself as a subject. The user edits an image selected from the captured images obtained by shooting to synthesize a composite image such as handwritten characters or a stamp image. As a result, the captured image is edited into a colorful image. The user finishes a series of games by receiving a sticker paper on which an image of himself / herself is printed.

The photo sticker creation device 1 can be said to be a photo creation game machine that provides a photo creation game.

As shown in FIG. 1, the photo sticker creating device 1 is basically configured by being installed in a state where the photographing unit 11 and the editing unit 12 are in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected.

The photographing unit 11 has a box-shaped housing having a space large enough for a person to enter, and is composed of a preselection unit 20, a photographing unit 21, and a background unit 22. The preselection unit 20 is installed on the side surface of the photographing unit 21. The space in front of the preselection unit 20 is the preselection space in which the preselection process is performed. Further, the photographing unit 21 and the background unit 22 are installed at a predetermined distance from each other. The space formed between the photographing unit 21 and the background unit 22 is the photographing space in which the photographing process is performed.

As the preselection process, the preselection unit 20 provides guidance for introducing the game provided by the photo sticker creation device 1, and makes various settings for shooting performed in the shooting space. The preselection unit 20 is provided with a coin slot for the user to insert the price, a touch panel monitor 71, and the like.

The touch panel monitor 71 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated on the monitor. The touch panel monitor 71 has a function of displaying various GUIs (Graphical User Interfaces) and accepting a user's selection operation. The touch panel monitor 71 displays a screen used for selecting the number of users.

The photographing unit 21 is a device for photographing a user as a subject. The photographing unit 21 is located in front of the user who has entered the photographing space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the shooting unit 21 facing the shooting space.

Assuming that the left side surface is the left side surface and the right side surface is the right side surface when viewed from the user facing the front in the shooting space, the left side surface of the photographing unit 21 is composed of the side panel 41A and the right side surface is composed of the side panel 41B. Will be done. Further, the front surface of the photographing unit 21 is composed of the front panel 42. The preselection unit 20 described above is installed on the side panel 41A.

The background portion 22 is composed of a back panel 51, a side panel 52A, and a side panel 52B. The back panel 51 is a plate-shaped member located on the back side of the user facing the front. The side panel 52A is attached to the left end of the back panel 51. The side panel 52B is attached to the right end of the back panel 51.

The opening between the side panel 41A and the side panel 52A serves as the entrance / exit of the photographing space. Further, the opening between the side panel 41B and the side panel 52B also serves as an entrance / exit of the photographing space.

At least a part of the ceiling surface formed above the photographing space is covered with the ceiling sheet 23. The ceiling sheet 23 may be in the shape of a sheet or in the shape of a plate.

The editing unit 12 is a device for editing a captured image. As shown in FIG. 2, the editing unit 12 is connected to the photographing unit 11 so that one side surface thereof is in contact with the front panel 42 of the photographing unit 21.

Assuming that the configuration of the editing unit 12 shown in FIG. 1 is the configuration on the front side, the configuration used for the editing work is provided on each of the front side and the back side of the editing unit 12. With this configuration, two sets of users can perform editing work at the same time.

The front side of the editing unit 12 is composed of a vertical surface 61 and a slope 62 formed above the vertical surface 61. The slope 62 is provided with a tablet built-in monitor 141 and touch pens 142A and 142B as configurations used for editing work. A lighting device 63 is provided above the slope 62.

The tablet built-in monitor 141 is configured by stacking a tablet and a display. The tablet built-in monitor 141 displays, for example, an editing screen used for editing. When two users edit at the same time, the touch pen 142A is used by the user standing on the left side of the tablet built-in monitor 141, and the touch pen 142B is used by the user standing on the right side of the tablet built-in monitor 141. Hereinafter, when it is not necessary to distinguish between the touch pen 142A and the touch pen 142B as appropriate, they are collectively referred to as the touch pen 142.

A curtain rod 24 is attached above the editing unit 12. The curtain rail 24 is configured by combining three rails 24A to 24C.

A curtain is attached to the curtain rail 24 so that the space in front of the front and the space in front of the back of the editing unit 12 cannot be seen from the outside. The space in front of the front and the space behind the back of the editing unit 12 surrounded by the curtain are the editing spaces in which the user performs editing work.

A sticker paper discharge port 161 is provided on the side surface of the editing unit 12. A printer is provided inside the editing unit 12. The sticker paper on which the image of the user is printed is discharged from the sticker paper discharge port 161. The space in front of the side surface (seal paper ejection port 161) of the editing unit 12 becomes a printing waiting space for the user to wait for the printed sticker paper to be ejected.

<Composition of the front of the shooting space>
FIG. 3 is a perspective view showing a configuration example of the front of the photographing space.

Each configuration of the photographing unit 21 is provided in front of the photographing space so as to be surrounded by the side panel 41A, the side panel 41B, and the front panel 42. In FIG. 3, the preselection unit 20 installed on the side panel 41A is not shown.

A front camera unit 81 is provided slightly above the center of the front panel 42. The front camera unit 81 is provided with a front camera 91 and a front monitor 92.

The front camera 91 is composed of, for example, a single-lens reflex camera, and is built in the front camera unit 81 so that the lens is exposed. The front camera 91 has an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and photographs a user in a photographing space. The front camera 91 functions as a shooting unit that shoots with the user as a subject.

The moving image captured by the front camera 91 (hereinafter, also referred to as a live view image) is displayed in real time on the front monitor 92. A still image captured by the front camera 91 at a predetermined timing such as when shooting is instructed is saved as a shot image.

The front monitor 92 is provided below the front camera 91. The front monitor 92 is composed of a monitor such as an LCD and a touch panel laminated on the monitor. The front monitor 92 has a function as a live view monitor that displays a moving image captured by the front camera 91, and a function that displays various GUIs and accepts a user's selection operation.

Above the front camera unit 81, a front strobe unit 82 that irradiates the user's face and upper body with light from above the front of the user is installed. The front strobe unit 82 has a built-in light bulb for lighting in addition to a strobe arc tube that emits light according to the shooting timing.

The front strobe unit 82 is provided with three panels 82a, 82b, 82c formed of a transparent or translucent acrylic plate or the like as a light emitting surface arranged side by side in a horizontal row. The light emitting surfaces (panels 82a, 82b, 82c) of the front strobe unit 82 are installed diagonally downward.

Below the front camera unit 81, a lower box strobe unit 83 that irradiates the lower body and feet of the user with light is provided. The lower box strobe unit 83 has a built-in light bulb for lighting in addition to the strobe arc tube that emits light according to the shooting timing.

The light emitting surface of the lower box strobe unit 83 is formed so as to cover the front surface between the side panel 41A and the side panel 41B without a gap. The light emitting surface of the lower box strobe unit 83 is also formed of a transparent or translucent acrylic plate or the like. The upper surface of the lower box strobe unit 83 is used as a luggage storage place for a user performing photography work to put baggage and the like.

<Composition of the ceiling surface of the shooting space>
FIG. 4 is a perspective view showing a configuration example of the ceiling surface of the photographing space.

A ceiling camera unit 101 and a ceiling strobe unit 102 are provided at substantially the center of the ceiling surface of the shooting space so as to project from the ceiling surface.

The ceiling camera unit 101 is provided with a ceiling camera 111 and a ceiling monitor 112.

Like the front camera 91, the ceiling camera 111 is composed of, for example, a single-lens reflex camera, and is built in the ceiling camera unit 101 so that the lens is exposed. The ceiling camera 111 photographs a user in the photographing space.

The live view image captured by the ceiling camera 111 is displayed in real time on the ceiling monitor 112. The still image captured by the ceiling camera 111 at a predetermined timing such as when shooting is instructed is saved as a shooting image.

The ceiling monitor 112 is provided below the ceiling camera 111. The ceiling monitor 112 is composed of a monitor such as an LCD. The ceiling monitor 112 has a function as a live view monitor that displays a moving image captured by the ceiling camera 111.

The surface of the ceiling camera unit 101 on which the ceiling camera 111 and the ceiling monitor 112 are provided is formed so as to be an obliquely downward surface.

On the ceiling surface of the shooting space, the ceiling strobe unit 102 is installed adjacent to the ceiling camera unit 101 at a position in front of the ceiling camera unit 101. The ceiling strobe unit 102 irradiates the user with strobe light from diagonally forward above the user's head. The ceiling strobe unit 102 includes a light bulb for lighting in addition to a strobe arc tube that emits light in accordance with the shooting timing.

The ceiling strobe unit 102 is provided with a single panel 102a formed of a transparent or translucent acrylic plate or the like as a light emitting surface. Further, on the left and right sides of the light emitting surface (panel 102a) of the ceiling strobe unit 102, speakers for outputting guidance voices, BGM, sound effects, etc. for shooting processing are provided.

The light emitting surface (panel 102a) of the ceiling strobe unit 102 is also formed so as to be an obliquely downward surface.

As described above, on the ceiling surface of the shooting space, the ceiling camera unit 101 and the ceiling strobe unit 102 are provided so as to have the same positional relationship as the front camera unit 81 and the front strobe unit 82 in front of the shooting space.

FIG. 5 is a diagram showing an example of a captured image.

Shooting in the shooting space is performed using both the front camera 91 and the ceiling camera 111. As shown on the left side of FIG. 5, the captured image obtained by photographing with the front camera 91 is an image in which the face and upper body of the user facing the front are greatly captured.

On the other hand, the captured image obtained by photographing with the ceiling camera 111 is an image showing the whole body of the user sitting on a bench provided in the photographing space, as shown on the right side of FIG. In the shooting space, a bench for the user to sit down and shoot with his / her face facing the ceiling camera 111 is provided close to the back panel 51.

Hereinafter, the captured image obtained by photographing with the front camera 91 as appropriate is referred to as a close-up image. Further, the captured image obtained by photographing with the ceiling camera 111 is referred to as a ceiling camera image. As described above, the provision of the ceiling camera 111 makes it possible to capture a plurality of types of captured images having different angles of view.

<Block configuration of photo sticker making device>
FIG. 6 is a block diagram showing a configuration example of the photo sticker creating device 1. In FIG. 6, the same components as those described above are designated by the same reference numerals. Duplicate explanations will be omitted as appropriate.

As shown in FIG. 6, in the photo sticker creating device 1, the preselection unit 302, the photographing unit 304, the editing units 305A and 305B, and the printing unit 306 are external input / output interfaces 303 with respect to the PC (Personal Computer) unit 301. It is configured by being connected via. The PC unit 301 that controls the overall operation of the photo sticker creating device 1 is housed inside, for example, the editing unit 12.

The CPU (Central Processing Unit) 311, ROM (Read Only Memory) 312, and RAM (Random Access Memory) 313 constituting the PC unit 301 are connected to each other by a bus 314.

The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating device 1. The ROM 312 stores programs and data executed by the CPU 311. The RAM 313 temporarily stores data and programs processed by the CPU 311.

An input / output interface 315 is further connected to the bus 314. A storage unit 316, a communication unit 317, and a drive 318 are connected to the input / output interface 315.

The storage unit 316 is a non-volatile storage medium such as a hard disk or a flash memory. The storage unit 316 stores various setting information and the like supplied from the CPU 311. The information stored in the storage unit 316 is appropriately read out by the CPU 311.

The communication unit 317 is an interface of a network such as the Internet. The communication unit 317 communicates with an external device according to the control by the CPU 311. The communication unit 317 transmits the image selected by the user to, for example, an image management server managed by the manufacturer of the photo sticker creating device 1. The image transmitted from the communication unit 317 is allocated and stored in a predetermined storage area in the image management server, and is displayed on the mobile terminal accessing the image management server or downloaded to the mobile terminal.

A removable media 319 made of an optical disk, a semiconductor memory, or the like is appropriately mounted on the drive 318. The programs and data read from the removable media 319 by the drive 318 are supplied to the CPU 311 and stored or installed in the storage unit 316.

An external input / output interface 303 is connected to the input / output interface 315. The control of each unit by the PC unit 301 is performed via the external input / output interface 303.

The preselection unit 302 performs preselection processing for users in the preselection space. The preselection unit 302 includes a touch panel monitor 71, a speaker 321 and a coin processing unit 322.

The touch panel monitor 71 displays various selection screens according to the control by the PC unit 301, and accepts the user's operation on the selection screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and various settings are made.

The coin processing unit 322 detects the insertion of coins into the coin insertion slot. When the coin processing unit 322 detects that a predetermined amount of coins has been inserted, the coin processing unit 322 outputs an activation signal instructing the start of the game to the PC unit 301.

The shooting unit 304 performs shooting processing for users in the shooting space. The photographing unit 304 includes a front camera 91, a front monitor 92, a ceiling camera 111, a ceiling monitor 112, a lighting device 331, and a speaker 332.

The front camera 91 and the ceiling camera 111 take pictures under the control of the PC unit 301, and output the still image or moving image data obtained by the shooting to the PC unit 301.

The front monitor 92 displays the live view image captured by the front camera 91 in real time under the control of the PC unit 301, accepts the user's operations on various screens, and outputs a signal indicating the contents of the accepted operations to the PC. It is output to the unit 301.

The ceiling monitor 112 displays a live view image captured by the ceiling camera 111 in real time under the control of the PC unit 301.

The lighting device 331 is each strobe unit in the photographing space, and emits light according to a control signal supplied from the PC unit 301. The lighting device 331 includes a front strobe unit 82, a lower box strobe unit 83, and a ceiling strobe unit 102.

The speaker 332 is a speaker provided in the ceiling strobe unit 102 in the photographing space.

The editorial unit 305A performs editing processing for users in one of the editing spaces. The editorial unit 305A includes a tablet built-in monitor 141, touch pens 142A and 142B, and a speaker 341. The editorial unit 305B performs editing processing for the user in the other editing space, and has the same configuration as the editorial unit 305A. Hereinafter, the editorial departments 305A and 305B are collectively referred to as the editorial department 305.

The tablet built-in monitor 141 displays the editing screen according to the control by the PC unit 301, and accepts the user's operation on the editing screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and the captured image to be edited is edited.

The printing unit 306 is configured to include a printer 351. A sticker paper unit 352 is attached to the printer 351.

The printer 351 drives the built-in head 361 and prints an image on the roll-shaped sticker paper 363 stored in the sticker paper unit 352 based on the print data supplied from the PC unit 301. Further, the printer 351 cuts the sticker paper 363 on which the image is printed at a predetermined cut position by the cutter 362, and discharges the sticker paper 361 to the sticker paper discharge port 161.

<Example of functional configuration of control unit>
FIG. 7 is a block diagram showing a functional configuration example of the photo sticker creating device 1. At least a part of the functional units shown in FIG. 7 is realized by executing a predetermined program by the CPU 311.

In the photo sticker making device 1, the control unit 401 is realized. The control unit 401 is composed of a preselection processing unit 411, a shooting processing unit 412, an editing processing unit 413, a print processing unit 414, and a transmission processing unit 415.

The preselection processing unit 411 executes the preselection processing by controlling each unit of the preselection unit 302. By the pre-selection process, the number of users is selected, the game theme is selected, and the like. A plurality of types of themes are prepared for the game of the photo sticker creating device 1.

During the game, for example, screen display and BGM are used to produce effects according to the game theme. Also, the editing tools that can be used during editing are switched according to the game theme. The game theme defines the progress of the game. Information indicating the content selected by the user is supplied to the photographing processing unit 412.

The photographing processing unit 412 performs imaging processing by controlling each unit of the photographing unit 304. In the shooting process, a plurality of shot images such as seven images are shot. The shooting processing unit 412 outputs the data of a plurality of shot images obtained by performing the shooting process to the editing processing unit 413.

The editing processing unit 413 performs editing processing by controlling each unit of the editing unit 305. The editing process includes editing the captured image, printing the image on the sticker paper, and transmitting the image to an image management server which is an external device.

As described above, the image transmitted to the image management server can be viewed on the mobile terminal by the user by operating the mobile terminal such as his / her smartphone after the game of the photo sticker creating device 1 is completed. , Used for downloading.

Editing the captured image includes a process of generating an image to be printed on the sticker paper based on the captured image and a process of generating an image to be transmitted to the image management server based on the captured image.

As will be described in detail later, the image to be printed on the sticker paper is generated by letting the user select the sticker design and performing image processing according to the sticker design selected by the user.

In addition, the mobile-only image, which is an image to be sent to the image management server, corresponds to the operation performed using the tool selected by the user from the editing tools prepared in advance, such as the pen tool and the stamp tool. It is generated by applying the image processing to the captured image to be edited. By using the pen tool and the stamp tool, the pen image and the stamp image as the compositing image are combined with the captured image to be edited. The user selects a favorite editing tool, selects a position to perform image processing on the captured image to be edited, and proceeds to edit the captured image.

In this way, the editing of the captured image for creating the mobile-only image can be proceeded as if the user uses the touch pen 142 to scribble on the captured image. Hereafter, editing is referred to as graffiti as appropriate.

The editing processing unit 413 outputs the print data generated based on the image for printing on the sticker paper to the printing processing unit 414, and outputs the data of the portable image to the transmission processing unit 415.

The print processing unit 414 outputs the print data to the printer 351 and causes the image to be printed on the sticker paper.

The transmission processing unit 415 communicates with the image management server by controlling the communication unit 317, and transmits (uploads) the mobile-only image to the image management server.

FIG. 8 is a block diagram showing a configuration example of the editing processing unit 413.

The editing processing unit 413 is composed of an image analysis unit 421, a seal image generation unit 422, a seal design data storage unit 423, a portable image generation unit 424, and a display control unit 425. The details of the functions of each processing unit will be described later with reference to the flowchart. The data of the captured image output from the imaging processing unit 412 is input to the image analysis unit 421 and the display control unit 425.

The image analysis unit 421 analyzes the characteristics of the user reflected in each captured image, and recognizes the position of a specific portion of the user captured in the captured image. For example, the positions of the head, eyes, nose, and mouth are recognized as the positions of specific parts. The information representing the position recognized by the image analysis unit 421 is supplied to the sticker image generation unit 422 and the portable image generation unit 424 together with the captured image data.

The seal image generation unit 422 reads information about the seal design selected by the user from the seal design data storage unit 423, and performs image processing based on the read information on the captured image.

Further, the seal image generation unit 422 synthesizes a seal image obtained by performing image processing based on information on the seal design on the captured image and a seal edge image according to the seal design, and prints an image of the seal paper. Generates a layout image that represents. The layout image is an image in which a sticker image in which the user appears as a subject and a sticker edge image having a predetermined design are combined. The sticker image generation unit 422 accepts operations performed by each user and generates a layout image for each user.

The layout image data generated by the sticker image generation unit 422 is supplied to the print processing unit 414 as print data. Information representing the content of image processing by the image generation unit 422 for sealing is appropriately supplied to the display control unit 425 and used for screen display.

The image processing by the sticker image generation unit 422 can be said to be a process for creating an image to be printed on the sticker paper. The layout image generated by the image processing by the sticker image generation unit 422 is an image for printing used for printing on the sticker paper.

The mobile-only image generation unit 424 performs image processing according to the mobile-only graffiti performed by the user on each captured image to generate a mobile-only image. Mobile phone graffiti is a graffiti for creating an image to be sent to an image management server. The scribbled image by the mobile phone scribble is an image for transmission used for transmitting to the image management server.

Note that the term "printing" indicates that the image is used for printing, out of the two uses of printing and transmission. Further, "for transmission" indicates that the use of the image is one of the two uses of printing and transmission. The image for printing is not used for transmitting to the image server, and the image for transmission is not used for printing on the sticker paper. In other words, the image for printing and the image for transmission may be used for applications other than the two applications of printing and transmitting, such as the screen display of the tablet built-in monitor 141.

The mobile-only image generated by the mobile-only image generation unit 424 is supplied to the transmission processing unit 415. Information representing the content of image processing by the portable image generation unit 424 is appropriately supplied to the display control unit 425 and used for screen display.

The display control unit 425 causes the tablet built-in monitor 141 to display various screens including a screen used for generating a sticker image and a scribble screen for mobile phones. The display control unit 425 controls the display of the screen according to the operation of the user.

<< Operation of photo sticker making device >>
<Photo sticker creation game>
Here, the operation of the photo sticker creation device 1 that provides the photo sticker creation game will be described with reference to the flowchart of FIG.

In step S1, the preselection processing unit 411 determines whether or not a predetermined amount of coins has been inserted, and waits until it is determined that coins have been inserted. The fee paid at the start of one game is, for example, 400 yen.

When it is determined in step S1 that coins for a predetermined charge have been inserted, the preselection processing unit 411 performs preselection processing in step S2. In the pre-selection process, the number of users is selected, the game theme is selected, and the like.

In step S3, the photographing processing unit 412 controls the photographing unit 304 to perform the photographing process. Specifically, the shooting processing unit 412 causes the front monitor 92 to display the moving image captured by the front camera 91 in a live view. When the shooting timing comes, the shooting processing unit 412 shoots a user in the shooting space as a subject and generates a shot image as a close-up image.

Further, the shooting processing unit 412 displays the moving image captured by the ceiling camera 111 on the ceiling monitor 112 in a live view. When the shooting timing comes, the shooting processing unit 412 shoots a user in the shooting space as a subject and generates a shot image to be a ceiling camera image.

The shooting process ends when a plurality of shot images are shot. For example, six close-up images and one ceiling camera image are taken.

In step S4, the editing processing unit 413 performs the editing process by controlling the editing unit 305 corresponding to the editing space of the user who has finished the shooting process and is the destination of the move.

<Details of editing process>
Next, the editing process performed in step S4 of FIG. 9 will be described with reference to the flowchart of FIG.

In step S11, the display control unit 425 of the editing processing unit 413 displays the address input screen on the tablet built-in monitor 141.

The address input screen is a screen used for inputting a user's e-mail address. A software keyboard or the like is displayed on the address input screen and is used for inputting an e-mail address.

The e-mail address entered using the address input screen is uploaded to the image management server together with the mobile-only image, and the image management server notifies the user of the URL where the mobile-only image is stored by e-mail. Used for. For example, the user can display the mobile-only image created by the game of the photo sticker creating device 1 on the screen of the mobile terminal by tapping the URL notified by e-mail.

The seal design selection process is performed in step S12. In the sticker design selection process, image processing according to the sticker design selected by the user is applied to the captured image, and a sticker image is generated. Further, the layout image which is an image for printing is generated by using the image for sticker. The details of the seal design selection process will be described later with reference to the flowchart of FIG.

In step S13, the print processing unit 414 starts printing the layout image based on the print data representing the layout image. The print start timing of the layout image can be any timing as long as it is after the seal design selection process is performed.

In step S14, the display control unit 425 causes the tablet built-in monitor 141 to display the scribble screen for mobile phones. The user scribbles the captured image using the scribble screen for mobile phones. In the mobile-only graffiti, all seven captured images obtained by the photographing process are targeted for graffiti. Details of graffiti using the mobile-only graffiti screen will be described later.

In step S15, the mobile-only image generation unit 424 performs image processing on the captured image to be scribbled in response to an operation by the user to generate a mobile-only image.

In step S16, the mobile phone image generation unit 424 determines whether or not the mobile phone graffiti is completed. If it is determined in step S16 that the mobile-only graffiti is not finished, the process returns to step S14 and the mobile-only graffiti is continued. For example, when the preset time limit has elapsed, the mobile phone graffiti ends.

When it is determined in step S16 that the mobile phone-only graffiti is completed, the display control unit 425 causes the tablet built-in monitor 141 to display the image selection screen in step S17. The image selection screen displayed here is a screen used to select one mobile phone image from the seven mobile phone images created by the mobile phone graffiti.

Of the seven mobile-only images uploaded to the image management server, one mobile-only image selected using the image selection screen is provided to the user who is a free member. The image providing service provided by the image management server is a membership-based service that enables viewing of images on a mobile terminal and downloading of images to a mobile terminal.

Free member users can view one mobile-only image. On the other hand, paid member users can view all mobile-only images.

When the selection of the mobile-only image is completed, in step S18, the transmission processing unit 415 transmits the mobile-only image to the image management server. When the transmission of the mobile-only image is completed, the process returns to FIG. 9, and the series of processes of the photo sticker creation game is completed.

<Selection of seal design>
The seal design selection process performed in step S12 of FIG. 10 will be described with reference to the flowchart of FIG.

In step S31, the image analysis unit 421 analyzes the characteristics of the user appearing in each captured image and recognizes the position of each part of the user.

In step S32, the sticker image generation unit 422 generates a sample image as a sample of the sticker design according to the game theme. In the pre-selection process, the game theme is selected.

In step S33, the display control unit 425 displays the seal design selection screen using the sample image generated by the seal image generation unit 422.

In step S34, the seal image generation unit 422 determines whether or not a predetermined seal design is selected from the plurality of seal designs. If it is determined in step S34 that the seal design is not selected, the process returns to step S33, and processing according to the user's operation on the seal design selection screen is continued.

FIG. 12 is a diagram showing an example of a seal design selection screen.

The area 501L is formed on the left side of the seal design selection screen, and the area 501R is formed on the right side. The area 501L is an area used for operation by a user standing on the left side of the tablet built-in monitor 141. The area 501R is an area used for operation by a user standing on the right side of the tablet built-in monitor 141.

In this way, the selection of the seal design is made by each user using the display of the area 501L and the area 501R. The operation by each user for the area 501L and the area 501R is accepted by, for example, the image generation unit 422 for sealing. The display of the area 501L will be mainly described, but the display of the area 501R is the same as the display of the area 501L.

A message prompting the selection of the number of divisions, which is the layout of the image, is displayed in the upper center of the sticker design selection screen. Below the message, a tab of "Pocket pre" and a tab of "Other layout" are displayed, and in the example of FIG. 12, it is said that the tab of "Pocket pre" is being selected. The seal design selection is made when the "Pocket Pre" tab is selected. When the "Other Layouts" tab is selected, samples of various pattern layouts are displayed.

A sample image 511L is displayed in the center of the area 501L. The sample image is a sample image of the seal design.

On the left side of the sample image 511L, a color selection button 512L used for color selection is displayed.

In the button area 513L formed below the sample image 511L, the seal design selection buttons 521-1 to 521-7 are displayed. The seal design selection buttons 521-1 to 521-7 are buttons used for selecting the seal design. The display of the sample image 511L is switched according to the pressing of the seal design selection button. In the example of FIG. 12, the seal design selection button 521-1 is in the selected state.

The user can select the seal design by pressing the enter button while the predetermined sample image is displayed.

FIG. 13 is an enlarged view showing a sample image.

The sample image 511-1 shown in FIG. 13 is, for example, an image displayed in the area 501L as the sample image 511L when the seal design selection button 521-3 of FIG. 12 is pressed.

The sample image 511-1 is configured by arranging the seal image P1 and the seal image P2 vertically and combining them with the seal edge image P11. Both the seal image P1 and the seal image P2 are close-up images. A seal design having different arrangement positions of the seal image may be prepared, such that the seal image P1 and the seal image P2 are arranged side by side.

As described above, the sticker image is an image generated based on a photographed image in which the user appears as a subject as an image to be printed on the sticker paper.

The sticker edge image is an image showing the design of the edge portion of the sticker paper (the area around the image in which the user appears as a subject). In the example of FIG. 13, an image of a predetermined color including a logo representing the model name of the photo sticker making device 1 is used as the sticker edge image. For example, each time the color is switched using the color selection button 512L, the color of the sticker edge image is switched.

In this way, as a sample image as a sample of the seal design, an image using an image actually obtained by shooting is displayed. The user can select the sticker design while imagining the layout image that is actually printed. A sample image using an image of a person other than the user, such as a model person, may be displayed.

The sample image 511-1 is generated by using, for example, a combination of a seal edge image P11, a pattern image P12, and a sticker stamp image P13 as shown in FIGS. 14A to 14C.

The pattern image is an image composited with the background of the user in the captured image. The pattern image P12 shown in FIG. 14B is an image of a floral pattern.

The sticking stamp image is a stamp image (composite image) synthesized at a composite position determined based on the position of a specific part of the user in the captured image. For example, the position on the user is determined as the composition position so that the composition is superimposed on the user. The sticker stamp image P13 shown in FIG. 14C is configured by arranging images of six flowers at different positions.

Multiple templates representing the components of each sticker design are prepared for each game theme.

FIG. 15 is a diagram showing an example of a template.

In the example of FIG. 15, six templates of templates 1 to 6 are associated with the game theme of "girly". Each template is configured by combining at least one of a sticker edge image, a pattern image (background image), a sticker stamp image, a frame image, and a filter image, as shown in the balloon. A sticker design that does not use the above-mentioned pattern image or sticker stamp image may be prepared.

The frame image is an image that is combined with the foreground of the captured image. The image of the predetermined design constituting the frame image is synthesized at a fixed position on the captured image, unlike the sticker stamp image.

The filter image is an image showing the content of the filter processing applied to the captured image. By applying the filter processing using the filter image to the captured image, the brightness, color, etc. of the captured image are partially or wholly changed.

Information on the template representing the seal design corresponding to each such game theme is stored in the seal design data storage unit 423 of FIG. For example, when selecting a sticker design, the content that is a component of the sticker design, such as a sticker edge image, a pattern image, and a sticker stamp image, is specified based on the information of the template associated with the game theme selected by the user. Then, a plurality of sample images are generated by the image generation unit 422 for sealing. Further, the image generated by the seal image generation unit 422 is used for displaying the seal design selection screen.

A sticker design using other types of content, such as a stamp image synthesized over a captured image and a portion other than the captured image, may be prepared. Also, as a sticking stamp image, for makeup such as eye shadow, eye line, eyelash image synthesized at the eye position of the face, cheek image synthesized at the cheek position, lip image synthesized at the lip position, etc. The image of may be used.

FIG. 16 is a diagram showing an example of generating a seal image.

As shown by the arrow # 1, by synthesizing the pattern image P12 with the background of the captured image P21, the sticker image P1 as shown at the tip of the arrow # 2 is generated.

The pattern image P12 is synthesized so as to synthesize the pattern image P12 with the background of the person area (the layer below the layer of the person area) extracted from the captured image P21 by the chroma key processing.

Further, as shown by arrow # 3, the pattern image P12 is combined with the background of the photographed image P22, and as shown at the tip of the arrow # 4, the positions of the heads of the two users reflected in the photographed image P22. By synthesizing the sticker stamp image P13, the seal image P2 as shown at the tip of the arrow # 5 is generated.

In the composition of the sticker stamp image P13, the sticker stamp image P13 is attached to the position p1 and the position p2, which are the composite positions determined based on the positions of the heads of the two users recognized by analyzing the captured image P22, respectively. It is done as if it were synthesized. The sticking stamp image P13 is combined with a layer above the layer of the person area. The sticking stamp image P13 is appropriately rotated according to the orientation of the user's head, enlarged / reduced according to the size of the user's head, and the like.

The seal image P1 and the seal image P2 thus generated are combined with the seal edge image P11 to generate a sample image 511-1.

In this way, as the sticker design, the content synthesized at the composite position determined based on the position of the specific part of the user reflected in the captured image and the content used for editing the part other than the sticker image are used. The design to be prepared is prepared. In the case of the above example, the content synthesized at the composite position determined based on the position of the specific part of the user in the captured image is the sticker stamp image P13, which is used for editing the part other than the sticker image. The content is the seal edge image P11.

The information of the template representing the seal design includes information indicating which of the seven captured images is used to generate the sample image. The captured images P21 and P22 used to generate the sample images 511-1 are, for example, the first captured image obtained by the first imaging and the second imaging obtained by the second imaging, respectively. It is an image. The default captured image of the seal design of the sample image 511-1 is two close-up images of the first captured image and the second captured image.

In the seal design, not only the close-up image but also a design that uses the ceiling camera image, which is the seventh captured image with a different angle of view, as the default captured image is prepared.

FIG. 17 is an enlarged view of another sample image.

The sample image 511-2 shown in FIG. 17 is an image displayed in the area 501L as a sample image 511L when a predetermined seal design selection button is pressed.

The sample image 511-2 is configured by arranging the seal image P51 and the seal image P52 vertically and combining them with the seal edge image P71. The seal image P51 is a close-up image, and the seal image P52 is a ceiling camera image.

In this way, a sticker design that uses the ceiling camera image in combination with the close-up image is also prepared.

The sample image 511-2 is generated by using, for example, a combination of a seal edge image P71, a filter image P72, and a sticker stamp image P73, 74 as shown in FIGS. 18A to 18C.

The filter image P72 shown in FIG. 18B is an image used to generate an image having an impression that a predetermined color is applied to the entire image. By the filter processing using the filter image P72, the pixel values of the pixels of the entire captured image are changed.

The sticker stamp image P73 shown in FIG. 18C is an image showing a ring of angels. Further, the sticker stamp image P74 is an image showing the wings of an angel. The sticker stamp image of the angel's ring and the sticker stamp image of the angel's wings are used as a set.

FIG. 19 is a diagram showing an example of generating a seal image.

As shown by the arrow # 11, by applying the filter processing using the filter image P72 to the captured image P81, the seal image P51 as shown at the tip of the arrow # 12 is generated.

Further, as shown by the arrow # 13, the photographed image P82 is subjected to the filter processing using the filter image P72, and as shown by the arrows # 14 and # 15, the two users appearing in the photographed image P82. By synthesizing the sticker stamp image P73 on each head and synthesizing the sticker stamp image P74 near the shoulders of each of the two users, the seal image P52 as shown at the tip of the arrow # 16 is obtained. Generated.

The composite of the sticker stamp image P73 synthesizes the sticker stamp image P73 at the positions p11 and p12, which are the composite positions determined based on the positions of the heads of the two users recognized by analyzing the captured image P82. It is done in this way. The sticking stamp image P73 is combined with a layer above the layer of the person area. The sticking stamp image P73 is appropriately rotated according to the orientation of the user's head, enlarged or reduced according to the size of the user's head, and the like.

In the composition of the sticker stamp image P74, the sticker stamp image P74 is synthesized at the positions p21 and p22 which are the composite positions determined based on the positions of the heads of the two users recognized by analyzing the captured image P82. It is done in this way. The sticking stamp image P74 is combined with the same layer as the sticking stamp image P73. The sticking stamp image P74 is appropriately rotated according to the orientation of the user's head, enlarged or reduced according to the size of the user's head, and the like.

The seal image P51 and the seal image P52 generated in this way are combined with the seal edge image P71 to generate a sample image 511-2.

The sticker design represented by the sample image 511-2 is also used for editing the content synthesized at the composite position determined based on the position of the user's specific part in the captured image and the part other than the sticker image. It is a design that uses the contents to be used.

Using the sticker design selection screen on which the sample image as described above is displayed, each of the plurality of users selects the sticker design.

For example, when the color selection button 512L is pressed, at least one of the color of the seal edge image, the color of the background image, and the color of the filter image is changed according to the selected color. Each user selects the sticker design while looking at the color of the content as well as the content that is a component of the sticker design.

It may be possible to turn on / off the filter processing using the filter image, adjust the color density, and the like when selecting the seal design.

If it is determined in step S34 of FIG. 11 that the predetermined seal design has been selected by the two users, the process proceeds to step S35.

In step S35, the display control unit 425 causes the tablet built-in monitor 141 to display the image selection screen instead of the sticker design selection screen. The image selection screen is a screen used for selecting a captured image to be used as a sticker image.

The sample image displayed on the sticker design selection screen is an image using the default captured image automatically selected by the photo sticker creation device 1. After selecting the sticker design, the user can change (replace) the default captured image with another captured image.

FIG. 20 is a diagram showing an example of an image selection screen.

In the area 501L and the area 501R, images 551L and 551R representing the seal edge image of the selected seal design are displayed, respectively. The selection of the captured image is performed by each user using the display of the area 501L and the area 501R.

In the example of FIG. 20, the seal design selected by the user on the left side is a seal design using two close-up images described with reference to FIG. 13 and the like. The sticker design selected by the user on the right side is a sticker design using a close-up image and a ceiling camera image described with reference to FIG. 17 and the like.

In the image 551L of the region 501L, the image arrangement regions 561L and 562L are vertically arranged and formed. The user on the left side uses the touch pen 142A to move the thumbnail image displayed in the display area 552L on the right side of the image 551L to the image arrangement areas 561L and 562L, and selects two captured images.

In the display area 552L, thumbnail images representing the six captured images P101 to P106 are displayed. The captured images P101 to P106 are the first to sixth captured images, respectively. The thumbnail image displayed in the display area 552L is a thumbnail image of the close-up image. Since the seal design selected by the user on the left side is a seal design using two close-up images, the thumbnail image of the ceiling camera image is not displayed, but only the thumbnail image of the close-up image is displayed.

The user on the left will select two close-up images to use for the sticker design of his choice.

On the other hand, in the image 551R of the region 501R, the image arrangement regions 561R and 562R are vertically arranged and formed. The ceiling camera image is already arranged in the image arrangement area 562R, and the entire image arrangement area 562R is displayed in a grayed out state. It is not possible to replace the captured image arranged in the image arrangement area 562R.

In this example, the sticker design selected by the user on the right side is a sticker design using the close-up image and the ceiling camera image, and since the ceiling camera image is taken only once, the image arrangement area 561R is used. Only the close-up image to be placed can be selected. Whether or not to accept the selection of the captured image is switched by the sticker image generation unit 422 or the like according to the angle of view of the default captured image of the sticker design.

The user on the right side uses the touch pen 142B to move the thumbnail image displayed in the display area 552R on the right side of the image 551R to the image arrangement area 561R, and selects one captured image. In the display area 552R, the same thumbnail image as the thumbnail image displayed in the display area 552L is displayed.

Using such a display, the two users each use their favorite shot image for the sticker design of their choice, regardless of the shot image placed in the sample image of the sticker design selection screen. be able to. Since the captured image to be used for the sticker design can be selected after the seal design is selected, the user can replace the default captured image with a captured image that matches the sticker design.

For example, when the user on the left side selects a photographed image to be arranged in the image arrangement areas 561L and 562L, the image processing using the template representing the seal design described with reference to FIG. 13 and the like is performed by the seal image generation unit 422. It will be done.

Image processing using the pattern image P12 is performed on the photographed image arranged in the upper part of the sticker design, and a sticker image is generated.

Further, the photographed image arranged in the lower part of the sticker design is subjected to image processing using the sticker stamp image P13 together with the pattern image P12. For example, when the user on the left side arranges the captured image P104 in the lower image arrangement area 562L, as shown in FIG. 21, image processing using the pattern image P12 and the sticking stamp image P13 is performed on the captured image P104. Be given. In the example of FIG. 21, the pattern image P12 is synthesized on the background of the two users, and the stamp image P13 is synthesized by sticking to the composite position determined based on the positions of the heads of the two users. Has been done.

Similarly, when the user on the right side selects the captured image to be arranged in the image arrangement area 561R, the image processing using the template representing the seal design described with reference to FIG. 17 and the like is performed by the seal image generation unit 422. Will be.

The process returns to step S35 and the selection of the captured image is continued until it is determined in step S36 of FIG. 11 that the selection of the captured image using the image selection screen as described above is completed. If it is determined in step S36 that the captured image is selected, the process proceeds to step S37.

In step S37, the sticker image generation unit 422 applies the sticker design selected by the user to the photographed image selected by the user, and generates the sticker image. Further, the seal image generation unit 422 generates a layout image by synthesizing the seal image with the seal edge image constituting the seal design selected by the user, and outputs the layout image data as print data. ..

After that, the process returns to step S12 in FIG. 10 and the subsequent processing is performed. When the printing of the layout image is completed, the printed sticker paper is taken out from the sticker paper ejection port 161.

FIG. 22 is a diagram showing an example of a printed sticker paper.

For example, when the sticker design described with reference to FIGS. 13 and 17 is selected, as shown in FIG. 22, the sticker papers s1 and s2 on which the layout image of each sticker design is printed are provided to the user. To.

As described above, in the game of the photo sticker creating device 1, graffiti is not performed on the image provided in the state of being printed on the sticker paper. The user can determine the print content of the sticker paper simply by selecting the sticker design and selecting the photographed image.

-Modification example Although it is assumed that the photographed image is selected after the sticker design is selected, the sticker design may be selected after the photographed image is selected. It may be possible to select a sticker design and a photographed image using one screen.

It may be possible to make one of the selection of the sticker design and the selection of the captured image first, the other after that, and then return to the selection made earlier.

The game theme may be selected again when the sticker design is selected.

It may be possible to select a game theme for each user. For example, by allowing two users to select different game themes, it is possible to improve user satisfaction.

<About mobile phone graffiti>
-Screen configuration of a mobile-only graffiti screen FIG. 23 is a diagram showing a display example of a mobile-only graffiti screen.

As shown in FIG. 23, the portable graffiti screen is basically configured by providing each display symmetrically with the central thumbnail display area 603 interposed therebetween. The area on the left is the area used by the user on the left. The area on the right is the area used by the user on the right.

The rectangular broken line surrounding each area on the mobile-only graffiti screen shown in FIG. 23 is not actually displayed on the screen.

The thumbnail display area 603 provided in the center of the mobile phone graffiti screen is a display area for a thumbnail image representing a captured image. The user selects a photographed image to be scribbled by using the thumbnail image displayed in the thumbnail display area 603.

In the thumbnail display area 603, six close-up images and one thumbnail image representing one ceiling camera image are displayed side by side. The mobile-only graffiti is performed for all captured images.

In the example of FIG. 23, the upper left thumbnail image is selected by the user on the left side, and the upper right thumbnail image is selected by the user on the right side. The thumbnail image on the upper left represents the first captured image P101, and the thumbnail image on the upper right represents the fourth captured image P104.

A graffiti input area 601L is provided in the substantially center of the area on the left side. The graffiti input area 601L is a display area of a photographed image to be scribbled, which is selected by using the thumbnail image. The user can select an editing tool using the touch pen 142A and edit the captured image P101 displayed in the graffiti input area 601L.

On the right side of the graffiti input area 601L, there are buttons that are pressed when selecting the eraser tool, buttons that are pressed when resetting the graffiti, and buttons that are pressed when returning to the previous operation. 602L is provided.

A pallet area 604L is provided below the graffiti input area 601L. The palette area 604L is an area in which buttons and the like used for selecting various editing tools to be combined with the captured image displayed in the graffiti input area 601L are displayed.

Above the palette area 604L, tabs used to select the category of editing tools are prepared. The user can switch the editing tool to be displayed in the palette area 604L by using the tab. In the example of FIG. 23, the tabs of the impersonator stamp, MAKE, STAMP, and PEN are prepared, and the tab of the impersonator stamp is selected. The MAKE, STAMP, and PEN tabs are the tabs of the make tool, which is an editing tool used for facial makeup, the stamp tool used for stamp image composition, and the pen tool tab used for pen image composition, respectively.

In the palette area 604L, selection buttons 611-1 to 611-5, which are buttons used for selecting the type of impersonator stamp, are displayed. The selection buttons 611-1 to 611-5 are used to select the impersonator stamps with the names "Rabbit", "Moon", "Cherry", "Cat", and "Wire Light", respectively.

In the area on the right side used by the user on the right side, the same configuration as the above-mentioned configuration of the region on the left side is arranged symmetrically in position.

-About Narikiri Stamp Narikiri Stamp is an editing tool used to combine stamp images according to the game theme with the captured images to be scribbled. The types of impersonator stamps that can be used for graffiti are switched according to the game theme.

By inputting once using the impersonator stamp, multiple stamp images designed according to the game theme are combined together. The impersonator stamp is composed of a plurality of stamp images.

Similar to the above-mentioned sticking stamp image, each stamp image, which is the content constituting the impersonator stamp, has a composite position determined based on the position of a specific part of the user recognized by analyzing the photographed image. It is synthesized.

For example, when the selection button 611-3 is pressed by the user on the left side, as shown in FIG. 24, the impersonator stamp of "cherry" is combined with the captured image P101 to be scribbled. In the example of FIG. 24, a plurality of stamp images are synthesized on the faces of the user U1 and the user U2 shown in the captured image P101.

FIG. 25 is an enlarged view showing the display of the graffiti input area 601L of FIG. 24.

A balloon-shaped stamp image P201 containing the characters "cherry" is synthesized at the head positions of the user U1 and the user U2 reflected in the captured image P101. The stamp image P201 is enlarged and shown in FIG. 26A. The stamp image P201 is, for example, a stamp image synthesized at a composite position determined based on the position of the user's head in the captured image.

Further, a stamp image P202, which is a set of two cherry images, is synthesized at the positions under the eyes of the user U1 and the user U2 reflected in the captured image P101. The stamp image P202 is enlarged and shown in FIG. 26B. The stamp image P202 is, for example, a stamp image synthesized at a composite position determined with reference to the center of the user's face in the captured image. For example, the position of the nose is used as the center of the face.

In this way, when one operation using the impersonator stamp is performed, the plurality of stamp images are collectively combined at the composite position determined based on the position of the specific portion of the user.

In addition, a plurality of stamp images are combined for each user reflected in the captured image. Considering a set of two cherry images as one stamp image P202, in the example of FIG. 25, four stamp images are combined with one captured image P101. The images of the two cherries constituting the stamp image P202 may be combined as separate stamp images.

-Adjustment of the composition mode of the Narikiri stamp The plurality of stamp images synthesized by the Narikiri stamp are images that can be adjusted in various ways as different contents.

FIG. 27 is a diagram showing an example of an operation at the time of adjusting the stamp image constituting the impersonator stamp.

As shown on the left side of FIG. 27, for example, when the user selects the stamp image P201 synthesized at the position of the head of the user U1 shown on the left side with the touch pen 142, the stamp image P201 is shown on the right side of FIG. 27. A rectangular frame surrounding is displayed. A circular enlargement / reduction button 621 and a deletion button 622 are displayed at the lower right and upper left of the rectangular frame, respectively.

The enlargement / reduction button 621 is a button used for enlarging or reducing the stamp image. As will be described later, the enlargement / reduction button 621 is also used for rotating the stamp image and the like. The delete button 622 is a button used for deleting the stamp image.

FIG. 28 is a diagram showing an enlarged example of the stamp image P201.

As shown in FIG. 28, the stamp image is enlarged by moving the touch pen 142 in the lower right direction while pressing the enlargement / reduction button 621. For example, the size of the stamp image P201 is determined by moving the touch pen 142 away from the enlargement / reduction button 621.

On the contrary, by moving the touch pen 142 in the upper left direction while pressing the enlargement / reduction button 621 with the touch pen 142, the stamp image P201 is reduced in accordance with the movement of the touch pen 142.

FIG. 29 is another diagram showing an example of enlargement of the stamp image P202.

As shown on the left side of FIG. 29, for example, when the user selects the stamp image P202 synthesized in the center of the face of the user U1 on the left side with the touch pen 142, a rectangular frame surrounding the stamp image P202 is displayed. .. The enlargement / reduction button 621 and the delete button 622 are displayed at the lower right and upper left of the rectangular frame, respectively.

By moving the touch pen 142 in the lower right direction while pressing the enlargement / reduction button 621, the stamp image P202 is enlarged following the movement of the touch pen 142 as shown on the right side of FIG. 29. For example, the size of the stamp image P202 is determined by moving the touch pen 142 away from the enlargement / reduction button 621.

On the contrary, by moving the touch pen 142 in the upper left direction while pressing the enlargement / reduction button 621, the stamp image P202 is reduced in accordance with the movement of the touch pen 142.

The stamp image P201 and the stamp image P202 synthesized for the user U2 can also be enlarged or reduced respectively.

FIG. 30 is a diagram showing the types of adjustment. FIG. 30 shows the type of adjustment using the stamp image P201.

As shown in FIG. 30A, the stamp image P201 can be enlarged or reduced by using the enlargement / reduction button 621.

As shown in FIG. 30B, the stamp image P201 can be rotated by using the enlargement / reduction button 621. For example, the rotation of the stamp image is performed by moving the touch pen 142 upward or downward while pressing the enlargement / reduction button 621. The stamp image P201 rotates following the movement of the touch pen 142, and the orientation of the stamp image is determined by releasing the touch pen 142 from the enlargement / reduction button 621.

The button used for rotating the stamp image may be prepared separately from the enlargement / reduction button 621. The button used to rotate the stamp image is displayed, for example, in any of the four corners of the frame surrounding the stamp image. This makes it possible to visually understand that the button is used for rotation.

As shown in FIG. 30C, the stamp image P201 can be deleted by using the delete button 622. For example, when two stamp images are combined, it is possible to delete only one stamp image or delete both stamp images to adjust the design to the liking.

In this way, the user can adjust the composition mode of the stamp image automatically synthesized by using the impersonator stamp for each stamp image, that is, partially.

As the adjustment of the composition mode of the stamp image, the position can be adjusted (moved). The adjustment of the synthesis mode includes not only the size adjustment, the orientation adjustment, and the deletion shown in FIG. 30, but also the position adjustment.

FIG. 31 is a diagram showing an example of movement of the stamp image.

The movement of the stamp image is performed, for example, by pressing the stamp image in a state where a rectangular frame or the like is displayed with the touch pen 142 and moving the touch pen 142 in that state. The stamp image moves following the movement of the touch pen 142, and the position of the stamp image is determined by releasing the touch pen 142. In the example of FIG. 31, the stamp image P201 synthesized at the position p31, which is the default position, has moved to the position p32, which is the position on the left side of the position p31.

The stamp images P202 synthesized for the user U1 and the stamp images P201 and P202 synthesized for the user U2 can also be moved. The user can adjust the position of each of the plurality of stamp images synthesized by the impersonator stamp from the default position to the desired position.

As described above, the plurality of stamp images synthesized by the impersonator stamps are contents that can be adjusted by moving and other adjustments by enlargement / reduction, rotation, and deletion as separate contents.

When the operation to select another impersonator stamp is performed using the selection buttons 611-1 to 611-5 while the stamp image is synthesized using the predetermined impersonator stamp, the stamp image is replaced with the synthesized stamp image. , The stamp image of the newly selected impersonator stamp is combined. As for the captured image to be scribbled, the combined stamp image disappears, and the stamp image of the newly selected impersonator stamp is combined. Narikiri Stamp is an editing tool that can be used only for one type selected from a plurality of types for each captured image.

For example, when the selection button 611-4 is pressed and the "cat" impersonator stamp is selected in the state of FIG. 24 in which the "cherry" impersonator stamp is synthesized, the composite stamp images P201 and P202 are replaced. The stamp image of the "cat" impersonator stamp is combined. The impersonator stamp of "cat" is also composed of a plurality of stamp images.

Here, if the above-mentioned adjustments have been made to the stamp images P201 and P202 that make up the "cherry" impersonator stamp that has already been synthesized, the composition of the "cat" impersonator stamp will be taken over during the adjustment. There is something that can be done.

For example, when the stamp image P201 constituting the "cherry" impersonator stamp is moved, the stamp image constituting the "cat" impersonator stamp whose composite position is determined based on the head position is the default. It is synthesized from the beginning at the same position as the position after the movement of the stamp image P201, not at the position of. In this case, the contents of the movement of the stamp image are inherited.

FIG. 32 is a diagram showing an example of taking over the adjustment of the stamp image.

The state shown on the left side of FIG. 32 is a state in which the stamp image P201 is moved from the default position p31 to the position p32 as described with reference to FIG. The stamp image P202 is synthesized at the position p41 for the user U1, and the stamp images P201 and P202 are synthesized at the positions p42 and p43 for the user U2, respectively. The position p41 is a default composite position determined with reference to the center of the face of the user U1. The positions p42 and p43 are default composite positions determined based on the head position and the center of the face of the user U2, respectively.

In this state, when the selection button 611-4 is pressed and the "cat" impersonator stamp is selected, the stamp image of the "cat" impersonator stamp is combined as shown on the right side of FIG. 32.

The "cat" impersonator stamp is composed of a stamp image P211 which is a set of images of left and right cat ears and a stamp image P212 which is a set of images of left and right beards and noses (dots). The stamp image P211 is a stamp image synthesized at a composite position determined based on the position of the user's head in the captured image. Further, the stamp image P212 is a stamp image synthesized at a composite position determined with reference to the center of the user's face reflected in the captured image.

Some of the impersonator stamps, such as the "cherry" impersonator stamp and the "cat" impersonator stamp, have their composite position determined based on the same position.

In the example on the right side of FIG. 32, the stamp image P211 for the user U1 is synthesized at the position p32, and the stamp image P212 is synthesized at the position p41. Further, the stamp image P211 for the user U2 is synthesized at the position p42, and the stamp image P212 is synthesized at the position p43.

That is, the stamp image P211 inherits the content of the movement of the "cat" before the selection of the impersonator stamp, and is synthesized from the beginning at the position p32 where the stamp image P201 was moved.

FIG. 33 is a diagram showing the difference in the composite position.

The state shown on the left side of FIG. 33 is a state in which each stamp image constituting the impersonator stamp of the "cat" is combined at the default position. If the stamp image has not been moved before the "cat" impersonator stamp is selected, the stamp images P211 and P212 show the position of the user's head in the captured image, respectively, as shown on the left side of FIG. 33. It is synthesized at the composite position determined as a reference and the composite position determined based on the center of the user's face.

The state shown on the right side of FIG. 33 is a state in which the contents of the movement are inherited as described with reference to FIG. 32.

In this way, when the type of the impersonator stamp is switched, the content of the adjustment of the composition mode is inherited, so that the user can efficiently perform graffiti using the impersonator stamp. For example, if the stamp image of the "cherry" impersonator stamp is moved, but the stamp image of the "cat" impersonator stamp is combined with the default position when switching to the "cat" impersonator stamp. If this happens, the user will have to move again, but such trouble can be saved.

Of the adjustments for the composition target of the impersonator stamp, the content of movement is inherited, but the content of enlargement / reduction may be inherited, or the content of rotation may be inherited. In addition, the content of the deletion may be inherited.

For example, when the deleted content is inherited and the stamp image P201 is deleted after selecting the "cherry" impersonator stamp, the stamp image P211 is combined in response to switching to the "cat" impersonator stamp. Instead, only the stamp image P212 is combined.

In this way, the content of the inherited adjustment can be changed arbitrarily. At least one of the adjustments of the plurality of types of synthesis modes is inherited.

As a result, the user can individually adjust the composition mode of each of the automatically synthesized stamp images, and create a mobile-only image with a good image quality in which the composition mode is complete.

In addition, the user can make the above adjustments for each photographed image, such as graffiti using the impersonator stamp and the stamp image synthesized by the impersonator stamp. The user can create a plurality of mobile-only images with good image quality based on each captured image.

If the back button is pressed after the stamp image has been moved, the position of the stamp image returns to the position before the movement. As described above, the tool area 602L is provided with a button that is pressed when returning to the previous operation. The behavior when the back button is pressed is that the position of the stamp image does not return to the position before the move, but the operation of the impersonator stamp itself is canceled and all the stamp images synthesized by the impersonator stamp are deleted. You may do it.

When the position is changed for the stamp image synthesized by the impersonator stamp and then deleted, for example, the position before deletion is stored. When the graffiti using the impersonator stamp is performed again, the stamp image is combined with the position before the deletion, so that the user can reduce the trouble of adjusting the position again.

-Modification example As a stamp image synthesized using Narikiri stamp, eye shadow, eyeline, eyelash image synthesized at the eye position of the face, cheek image synthesized at the cheek position, and lips composited at the position of the lips. An image for make-up, such as an image of the lips, may be used.

As a result, the user can input a plurality of images for makeup at once. In addition, the user can adjust the compositing mode of the images for a plurality of makeups.

In the above, it is assumed that the stamp image of the impersonator stamp is synthesized when a predetermined operation such as pressing the selection buttons 611-1 to 611-5 is performed, but the scribble is performed without performing such an operation. It may be automatically synthesized at the start. For example, a predetermined stamp image is randomly selected from a plurality of types of stamp images prepared according to the game theme, and is synthesized together.

As a result, the user can easily input a plurality of stamp images of impersonator stamps simply by selecting a game theme. It is also possible to adjust the composition mode of the stamp images automatically synthesized in this way as described above.

It may be possible to adjust the composition mode of the sticker stamp image synthesized by selecting the seal design in the same manner as the stamp image of the impersonator stamp. When a plurality of sticker stamp images are combined by selecting a sticker design, the user can adjust the combination mode of each sticker stamp image.

In the above, the operation such as graffiti is performed by using the touch pen 142, but it may be performed by a finger.

<Others>
The series of processes described above can be executed by hardware or software. When a series of processes are executed by software, the programs constituting the software are installed on a computer embedded in dedicated hardware, a general-purpose personal computer, or the like.

The installed program is provided by recording it on a removable medium consisting of an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or a semiconductor memory. It may also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be pre-installed in the ROM or storage.

The program executed by the computer may be a program in which processing is performed in chronological order according to the order described in the present specification, or processing is performed in parallel or at a necessary timing such as when a call is made. It may be a program to be performed.
It should be noted that the effects described in the present specification are merely examples and are not limited, and other effects may be obtained.

The embodiment of the present technique is not limited to the above-described embodiment, and various changes can be made without departing from the gist of the present technique.

1 Photo sticker creation device, 141 Tablet built-in monitor, 142 Touch pen, 301 PC unit, 302 Preselection unit, 304 Imaging unit, 305 Editing unit, 306 Printing unit, 401 Control unit, 411 Preselection processing unit, 412 Imaging processing unit, 413 Editing processing unit, 414 printing processing unit, 415 transmission processing unit, 421 image analysis unit, 422 seal image generation unit, 423 seal design data storage unit, 424 portable image generation unit, 425 display control unit

Claims (11)

Depending on the user's choice of the design of the layout image configured by arranging the captured image, the first content that is superimposed on the person in the captured image and the surroundings of the captured image. An image processing device including an image generation unit that synthesizes a second content representing the design of an area with the captured image and generates the layout image. The image processing apparatus according to claim 1, wherein the image generation unit synthesizes the first content into a composite position determined based on an analysis result of characteristics of a person appearing in the captured image, or a fixed composite position. The image processing device according to claim 1 or 2, wherein the image generation unit synthesizes the first content for each of a plurality of people appearing in the captured image. The image generation unit according to any one of claims 1 to 3, which accepts the selection of the layout image design performed by each of the plurality of users and generates the layout image for each user. Image processing device. The image processing apparatus according to any one of claims 1 to 4, wherein the image generation unit accepts selection of the captured image to be arranged in the layout image, which is performed by each of the plurality of users. The image processing device according to claim 5, wherein the image generation unit receives the selection of the photographed image after receiving the selection of the design of the layout image. When selecting a design for the layout image, a display control unit that displays a selection screen including a sample image in which the captured image with the default angle of view set for each design is arranged as a sample image of the layout image. The image processing apparatus according to claim 5 or 6. The image processing device according to claim 7, wherein the image generation unit switches whether or not to accept selection of the captured image according to the default angle of view. The layout image is an image for printing, and is an image for printing.
The image processing apparatus according to any one of claims 1 to 8, further comprising a printing processing unit for printing the layout image on a sticker paper. The image processing device
Depending on the user's choice of the design of the layout image composed by arranging the captured image, the first content to be superimposed on the person appearing in the captured image and the surroundings of the captured image. An image processing method for generating the layout image by synthesizing the second content representing the design of the area with the captured image. On the computer
Depending on the user's choice of the design of the layout image composed by arranging the captured image, the first content to be superimposed on the person appearing in the captured image and the surroundings of the captured image. A program for synthesizing a second content representing the design of an area with the captured image and executing a process of generating the layout image.

Images