JP7132492B2 - Image processing device, display control method, and program - Google Patents

Description

The present technology relates to an image processing device , a display control method, and a program, and in particular, enables a user to easily check a moving image reflecting the selected content while selecting the content of image processing to be performed on a captured image. image processing device , display control method, and program.

Conventionally, a photo sticker creating device is known. A photo sticker creating apparatus photographs a user, makes the user edit the photographed image, and prints the edited image on sticker paper to provide the edited image. A photo sticker creating device is installed in an amusement facility or the like.

The flow of one game provided by the photo sticker creating device is that after taking a picture of the user in the shooting space as the subject, the user is moved to the editing space, and the image is displayed according to the operation performed in the editing space. After editing, the edited image is printed on sticker paper.

By the way, at the time of photographing, a moving image photographed by the camera is displayed in real time on a monitor provided in the photographing space. The user can check his or her standing position, pose, etc. while watching such a moving image called a live view image.

Japanese Patent Application Laid-Open No. 2002-200001 discloses a technique for switching the angle of view of a live view image between when the live view image starts to be displayed and when the image is captured. In the technique described in Patent Document 1, the angle of view is adjusted so that the latter timing is narrower, and as a result, the area of the subject occupying the image is wider during shooting.

JP 2014-212489 A

By operating the buttons displayed on the live view image display screen, you can select the type of content to be combined with the captured image obtained by shooting, and select the content of retouching. There is a photo sticker making device. The user can make these selections while looking at the live view image in which his or her selections are reflected.

The user needs to approach the monitor in order to operate the buttons displayed on the display screen. Since moving closer to the monitor means moving closer to the camera, the face of the user performing the operation may be cut off from the angle of view of the live view image (beyond the angle of view). If it is cut off from the angle of view of the live view image, it will be impossible to confirm how the selection will be reflected.

The present technology has been developed in view of such circumstances, and is intended to enable a user to easily check moving images in which the selected content is reflected while selecting the content of image processing to be performed on the captured image. It is intended to be

The image processing device of the present technology includes a photographing unit that photographs a still image that is the basis of a photographed image of a user and a moving image that is the basis of the photographed image, and the selection of the content of image processing to be performed on the still image. a selection reception unit that receives a selection during display of a moving image; an image processing unit that performs processing representing the content of the image processing selected by the user on the moving image ; display the moving image photographed by using the same angle of view as the photographed image, and display the content of the image processing selected by the user while accepting the selection of the content of the image processing. and a display control unit for displaying the processed moving image with a wider angle of view than the captured image.

In the present technology, a still image that is the basis of a captured image of a user as a subject and a moving image are captured . The image is displayed at the same angle of view as that of the photographed image, and selection of the content of the image processing is accepted while the moving image is being displayed . Further, a process representing the content of the image processing selected by the user is applied to the moving image, and the content of the image processing selected by the user is accepted while the selection of the content of the image processing is being accepted. is displayed with an angle of view wider than that of the captured image.

According to the present technology, the user can easily confirm the moving image reflecting the selected content while selecting the content of the image processing to be performed on the captured image.

It is a perspective view showing an example of composition of appearance of a photograph sticker production device of this art. FIG. 10 is a perspective view of the appearance of the photo sticker creating apparatus as seen from another angle; It is a figure explaining a user's movement. It is a figure which shows the structural example of a prior selection part. It is a figure which shows the structural example of an imaging part. It is a figure which shows the structural example of a background part. It is a figure which shows the structural example of the front of an editing unit. FIG. 4 is a diagram showing a configuration example of a side surface of an editing unit; FIG. 4 is a diagram showing an example of a layer configuration of an edited image; It is a block diagram which shows the structural example of a photo sticker production apparatus. 2 is a block diagram showing a functional configuration example of a photo sticker creating device; FIG. It is a block diagram which shows the structural example of an imaging|photography process part. It is a figure which shows the example of generation|occurrence|production of a close-up image and a coordinated image. FIG. 10 is a diagram showing an example of a stamp image used when photographing in the prime of the present day; FIG. 10 is a diagram showing an example of a synthesized image; FIG. FIG. 4 is a diagram showing an example of a stamp image; 4 is a flowchart for explaining the operation of the photo sticker creating device; FIG. 18 is a flowchart for explaining a shooting process performed in step S3 of FIG. 17; FIG. FIG. 10 is a diagram showing a display example of a live view screen; FIG. 19 is a flowchart for explaining a modern-day photographing process performed in step S15 of FIG. 18; FIG. FIG. 10 is a diagram showing an example of changing the angle of view; FIG. 10 is a diagram showing a display example of a live view image when the angle of view is not changed; FIG. 11 is a diagram showing a display example of a live view image when the angle of view is widened; FIG. 11 is a diagram showing a display example of a stamp image selection screen; FIG. 11 is a diagram showing another display example of the stamp image selection screen; FIG. 10 is a diagram showing an example of changes in the angle of view of a live view image; It is a figure which shows the example of angle-of-view adjustment when there is one user. It is a figure which shows the example of angle-of-view adjustment when there are multiple users. FIG. 10 is a diagram showing an example of angle-of-view adjustment when all faces are included; FIG. 10 is a diagram showing an example of angle-of-view adjustment when content is accommodated; FIG. 10 is a diagram showing an example of an animation in which an image forming content is rotated; FIG. 10 is a diagram showing an example of animation in which the positions of images forming content change; FIG. 10 is a diagram showing an example of rotation; It is a figure showing an example of up-and-down movement. It is a figure which shows the example of expansion/contraction. It is a figure which shows the other example of expansion/contraction. It is a figure which shows the example of a left-right movement. It is a figure which shows the example of a transparency change. FIG. 10 is a diagram showing an example of color change; FIG. 10 is a diagram showing another example of color change; FIG. 11 is a diagram showing an example of a retouch selection screen;

<<Example>>
<Appearance of photo sticker making device>
1 and 2 are perspective views showing configuration examples of the appearance of the photo sticker creating apparatus 1. FIG.

The photo sticker creation device 1 is a game machine that provides photographed images and edited images. The photo sticker creating apparatus 1 provides images to users by printing the images on sticker paper or making the images viewable on the user's portable terminal. The photo sticker creating device 1 is installed in an amusement facility such as a game center or a store.

Users of the photo sticker creating apparatus 1 are mainly high school girls and young women. In the photo sticker creating device 1, a plurality of users, mainly two or three, can enjoy the game per group. Of course, one user can also enjoy the game in the photo sticker creating apparatus 1 .

In the photo sticker creating apparatus 1, the user himself/herself becomes a subject and performs photographing work. Through editing work, the user combines an image for composition such as handwritten characters or a stamp image with an image selected from the photographed images obtained by photographing. As a result, the photographed image is edited into a colorful image. The user receives the seal paper on which the edited image, which is the edited image, is printed, and ends the series of games.

The photo sticker creation device 1 can be called a photo creation game machine that provides a photo creation game.

As shown in FIG. 1, the photo sticker creating apparatus 1 is basically configured by installing a photographing unit 11 and an editing unit 12 in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected.

The photographing unit 11 has a box-shaped housing large enough for a person to enter, and is composed of a pre-selection section 20 , a photographing section 21 and a background section 22 . The pre-selection unit 20 is installed on the side of the imaging unit 21 . The space in front of the pre-selection unit 20 becomes the pre-selection space where the pre-selection process is performed. Also, the photographing unit 21 and the background unit 22 are placed apart from each other by a predetermined distance. A space formed between the photographing section 21 and the background section 22 is a photographing space in which photographing processing is performed.

As the pre-selection process, the pre-selection unit 20 performs guidance for introducing games provided by the photo sticker creating apparatus 1, and performs various settings in the photographing process performed in the photographing space. The pre-selection unit 20 is provided with a coin slot into which the user inserts money, a touch panel monitor used for various operations, and the like. The pre-selection unit 20 appropriately guides the user in the pre-selected space to the imaging space according to the availability of the imaging space.

The photographing unit 21 is a device for photographing a user as a subject. The photographing unit 21 is positioned in front of the user entering the photographing space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the photographing unit 21 facing the photographing space.

Assuming that the left side and the right side are the left side and the right side, respectively, as viewed from the user facing the front in the imaging space, the left side of the imaging unit 21 is composed of the side panel 41A, and the right side is composed of the side panel 41B. be done. Further, a front panel 42 constitutes the front of the photographing unit 21 . The preselection section 20 described above is installed on the side panel 41A. Note that the preselection unit 20 may be installed on the side panel 41B.

The background portion 22 is composed of a rear panel 51, side panels 52A, and side panels 52B. The back panel 51 is a plate-like member located on the back side of the user facing the front. The side panel 52A is a plate-like member attached to the left end of the rear panel 51 and having a width narrower than that of the side panel 41A. The side panel 52B is a plate-like member attached to the right end of the rear panel 51 and having a width narrower than that of the side panel 41B.

The side panel 41A and the side panel 52A are provided substantially on the same plane. Upper portions of the side panel 41A and the side panel 52A are connected by a connecting portion 23A, which is a plate-like member. The lower portions of the side panel 41A and the side panel 52A are connected by a connecting portion 23A' which is provided on the floor and is a member made of metal, for example. Similarly, the side panel 41B and the side panel 52B are provided substantially on the same plane. Upper portions of the side panel 41B and the side panel 52B are connected by a connecting portion 23B. The lower portions of the side panel 41B and the side panel 52B are connected by a connecting portion 23B'.

A floor material 27, which is a plate-like member, is laid on the floor of the imaging space. The flooring 27 is printed with a mark used for designating a standing position at the time of photographing.

For example, a green chromakey sheet is attached to the surface of the back panel 51 facing the imaging space. The photo sticker creating apparatus 1 performs chromakey synthesis in the shooting process and the editing process by shooting a chromakey sheet as a background. As a result, the desired background image is synthesized with the user's background in which the sheet is shown.

An opening formed by being surrounded by the side panel 41A, the connecting portion 23A, and the side panel 52A serves as an entrance to the imaging space. An opening formed by being surrounded by the side panel 41B, the connecting portion 23B, and the side panel 52B also serves as an entrance to the imaging space.

A ceiling surrounded by the front of the photographing unit 21, the connecting portion 23A, and the connecting portion 23B is formed above the photographing space. A ceiling strobe unit 24 is provided on a part of the ceiling. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B.

The ceiling strobe unit 24 incorporates a strobe that irradiates light toward the inside of the photographing space in accordance with photographing. Inside the ceiling strobe unit 24, a fluorescent lamp is provided in addition to the strobe. As a result, the ceiling strobe unit 24 also functions as lighting for the shooting space.

The editing unit 12 is a device for editing a captured image. The editing unit 12 is connected to the photographing unit 11 so that one side thereof contacts the front panel 42 of the photographing section 21 .

If the configuration of the editing unit 12 shown in FIG. 1 is taken as the configuration on the front side, the configuration used in the editing work is provided on each of the front side and the back side of the editing unit 12 . This configuration allows two sets of users to perform editing work at the same time.

The front side of the editing unit 12 is composed of a surface 61 and an inclined surface 62 formed above the surface 61 . The surface 61 is a surface that is perpendicular to the floor surface and substantially parallel to the side panel 41A of the imaging unit 21 . A built-in tablet monitor and a touch pen are provided on the slope 62 as components used for editing work. A columnar support portion 63A that supports one end of the lighting device 64 is provided on the left side of the slope 62 . A columnar support portion 63B that supports the other end of the lighting device 64 is provided on the right side of the slope 62 . A support portion 65 for supporting the curtain rail 26 is provided on the upper surface of the support portion 63A.

A curtain rail 26 is attached above the editing unit 12 . The curtain rail 26 is constructed by combining three rails 26A to 26C. The three rails 26A to 26C are combined to form a U-shape when viewed from above. One ends of rails 26A and 26B provided in parallel are fixed to connecting portions 23A and 23B, respectively, and the other ends of rails 26A and 26B are joined to both ends of rail 26C, respectively.

A curtain is attached to the curtain rail 26 so that the space in front of the front and the space in front of the back of the editing unit 12 are not visible from the outside. The space in front of the editing unit 12 surrounded by the curtain and the space behind the editing unit 12 become an editing space in which the user performs editing work.

As will be described later, the left side of the editing unit 12 is provided with a discharge port through which the printed sticker paper is discharged. A space in front of the left side of the editing unit 12 becomes a print waiting space where the user waits for the printed sticker paper to be discharged.

<Regarding the movement of users>
Here, the flow of the photo sticker creation game and the movement of the user associated therewith will be described.

FIG. 3 is a top plan view of the photo sticker creating apparatus 1. FIG.

The user inserts money into the coin slot in the pre-selection space A0, which is the space in front of the pre-selection section 20. FIG. Next, the user makes various settings according to the screen displayed on the touch panel monitor. The user performs, for example, selection of a course related to photographing to be performed in the photographing space as a pre-selection work.

After completing the pre-selection work, the user enters the imaging space A1 formed between the imaging unit 21 and the background unit 22 from the entrance G1 between the side panel 41A and the side panel 52A, as indicated by the white arrow #1. to go into. A user uses a camera, a touch panel monitor, or the like provided in the photographing unit 21 to perform photographing work.

The user who has completed the photographing work exits the photographing space A1 from the doorway G1 as indicated by the white arrow #2 and moves to the editing space A2-1, or enters the doorway G2 as indicated by the white arrow #3. , exits the photographing space A1 and moves to the editing space A2-2.

The editing space A2-1 is an editing space on the front side of the editing unit 12. FIG. On the other hand, the editing space A2-2 is the editing space behind the editing unit 12. FIG. To which of the editing space A2-1 and the editing space A2-2 the user should move is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the empty one of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing work. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing work at the same time.

After the editing work is completed, printing of the edited image is started. When printing starts, the user who has finished the editing work in the editing space A2-1 moves from the editing space A2-1 to the print waiting space A3 as indicated by the white arrow #4. Also, the user who has finished the editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as indicated by the white arrow #5.

The user who has moved to the print waiting space A3 waits for the end of printing. When the printing is finished, the user receives the sticker paper ejected from the ejection port provided on the right side of the editing unit 12, and finishes the series of photo sticker creating games.

<Configuration of pre-selection unit>
FIG. 4 is a diagram showing a configuration example of the pre-selection unit 20. As shown in FIG.

A touch panel monitor 71 is provided above the pre-selection section 20 . The touch panel monitor 71 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel stacked thereon. The touch panel monitor 71 has a function of displaying various GUIs (Graphical User Interfaces) and receiving user selections. The touch panel monitor 71 displays a screen used for selecting the number of users.

A speaker 72 is provided below the touch panel monitor 71 . The speaker 72 outputs a guide voice for pre-selection processing, BGM (Background Music), sound effects, and the like. Adjacent to the speaker 72, a coin insertion/return opening 73 for inserting coins by the user is provided.

<Structure of shooting unit>
FIG. 5 is a diagram showing a configuration example of the front of the photographing unit 21. As shown in FIG. The imaging unit 21 is configured to be surrounded by the side panel 41A, the side panel 41B, and the front panel 42. As shown in FIG.

A camera unit 81 is provided slightly above the center of the front panel 42 . A camera 91 , a touch panel monitor 92 , and a front strobe 93 are provided in front of the camera unit 81 .

The camera 91 is, for example, a single-lens reflex camera, and is attached inside the camera unit 81 so that the lens is exposed. The camera 91 has an imaging device such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and photographs a user in the imaging space A1. The camera 91 functions as a photographing unit that photographs a user as a subject.

A moving image captured by the camera 91 (hereinafter also referred to as a live view image) is displayed on the touch panel monitor 92 in real time. A still image captured by the camera 91 at a predetermined timing, such as when an instruction to shoot is given, is saved as a shot image.

A touch panel monitor 92 is provided below the camera 91 . The touch panel monitor 92 is composed of a monitor such as an LCD and a touch panel laminated thereon. The touch panel monitor 92 has a function as a live view monitor that displays moving images captured by the camera 91, and a function that displays various GUIs and receives user selections.

A front strobe 93 is provided above the camera 91 . The front strobe 93 has a crescent-shaped light-emitting surface made of a milky white acrylic plate. The front strobe 93 emits light in synchronization with photographing by the camera 91 to illuminate the vicinity of the user's face as a subject from the front.

Above the camera unit 81, an upper strobe unit 82 is installed with its curved light-emitting surface facing the user. The upper strobe unit 82 irradiates the user's face and upper body with light from above the front of the user.

Below the camera unit 81, a foot strobe unit 83 is provided to irradiate the user's lower body and feet with light.

The upper strobe unit 82 and the foot strobe unit 83 are composed of a fluorescent lamp and lighting equipment capable of strobe light emission. The upper strobe unit 82 and the foot strobe unit 83 constantly illuminate the shooting space to ensure user operability and safety. Light is emitted to the user who becomes

A box-shaped portion 84 is provided between the foot strobe unit 83 and the side panel 41A. A box-shaped portion 85 is provided between the foot strobe unit 83 and the side panel 41B. The upper surfaces of the box-shaped parts 84 and 85 form a surface substantially horizontal with the installation surface of the photo sticker creating apparatus 1, and are used as a luggage storage area for the user who performs the photographing work to place luggage and the like.

Although not shown, a speaker is provided on the front panel 42, for example, near the ceiling. The speaker outputs guide voices, BGM, sound effects, etc. for the shooting process.

<Composition of the background part>
FIG. 6 is a diagram showing a configuration example of the background portion 22 on the photographing space A1 side.

A rear upper strobe 101 is installed above the rear panel 51 . The upper back strobe 101 irradiates the user with light from above the back.

In the drawing, a rear left strobe 102 is installed on the left side of the rear panel 51 . The back left strobe 102 irradiates the user from the right side of the back. In the drawing, a rear right strobe 103 is installed on the right side of the rear panel 51 . The back-right strobe 103 irradiates the user from the back-left side.

A chromakey sheet 121 is attached to the surface of the back panel 51 facing the shooting space A1 (the front side in the figure). The color of the chromakey sheet 121 is, for example, green.

Although not shown, a chromakey sheet similar to the chromakey sheet 121 is attached to the lower side (floor surface side) of the side panels 52A and 52B facing the imaging space A1.

<Structure of editing unit>
FIG. 7 is a diagram showing a configuration example of the front side (editing space A2-1 side) of the editing unit 12. As shown in FIG.

A tablet built-in monitor 131 is provided approximately in the center of the slope 62 . A touch pen 132A is provided on the left side of the tablet built-in monitor 131 . A touch pen 132B is provided on the right side of the tablet built-in monitor 131 .

The tablet built-in monitor 131 is configured by laminating a tablet and a display. The tablet enables operation input using touch pen 132A or touch pen 132B. The tablet built-in monitor 131 displays, for example, an editing screen used for editing work. When two users simultaneously perform editing work, the touch pen 132A is used by the user on the left side of the tablet built-in monitor 131, and the touch pen 132B is used by the user on the right side of the tablet built-in monitor 131. .

An operation using the touch pen 132A and an operation using the touch pen 132B are distinguished. As appropriate, the display on the left side of the tablet built-in monitor 131 can only be operated using the touch pen 132A, and the display on the right side can only be operated using the touch pen 132B. Hereinafter, when there is no need to distinguish between the touch pen 132A and the touch pen 132B, the touch pen 132A and the touch pen 132B are collectively referred to as the touch pen 132.

FIG. 8 is a diagram showing a configuration example of the left side of the editing unit 12. As shown in FIG.

A seal paper discharge port 161 is provided on the lower side of the left side of the editing unit 12 . A printer is provided inside the editing unit 12 . The printer prints an image of the user of the editing space A2-1 or an image of the user of the editing space A2-2 in a predetermined layout on a sticker sheet, which is discharged from the sticker paper outlet 161. FIG.

<Layer structure of edited image>
FIG. 9 is a diagram showing an example of the layer structure of an edited image.

The edited image P1 at the left end is an image generated by editing. The edited image P1 is composed of images of layers of a background image P11, a person image P12, and a foreground image P13.

In the example of FIG. 9, the background image P11 is an image of a pattern of a wall made of stacked bricks. The foreground image P13 is an image including an image of handwritten characters "Love my friend" and a heart-shaped image. The handwritten character image of "Love my friend" is a pen image input by the user using the pen tool. The heart-shaped image is a stamp image input by the user using the stamp tool.

Thus, the edited image P1 is generated by superimposing the person image P12, which is the image of the person's area extracted from the photographed image by chromakey processing, on the background image P11, and superimposing the foreground image P13 thereon. It is also possible to input a pen image or stamp image onto the background image P11 and display it in the background of the subject.

In the example of FIG. 9, an image showing a large area above the user's chest is shown as the person image P12. In the photographing process, a close-up image, which is a photographed image in which the face is enlarged in this way, is photographed. Shooting of the close-up image is performed, for example, multiple times.

In the photographing process, in addition to the close-up image, an image showing a wide range from the top of the head to the vicinity of the knee is also photographed. This image is used, for example, to keep the coordination of clothes. Hereinafter, an image with a wider angle of view (capturing range) than the close-up image, which is used to record the coordination of clothes as appropriate, will be referred to as a coordinated image.

A whole-body image that captures the whole body of the user and has a wider angle of view than the coordinated image may be captured.

<Internal configuration of photo sticker creation device>
FIG. 10 is a block diagram showing a configuration example of the photo sticker creating apparatus 1. As shown in FIG. In FIG. 10, the same reference numerals are given to the same configurations as those described above. Duplicate explanations will be omitted as appropriate.

As shown in FIG. 10, the photo sticker creating apparatus 1 has an external input/output interface 303 for a PC (Personal Computer) section 301, a preselection section 302, a photographing section 304, editing sections 305A and 305B, and a printing section 306. It is configured by being connected via A PC section 301, which is an information processing section, is housed inside the housing of the editing unit 12, for example.

A CPU (Central Processing Unit) 311 , a ROM (Read Only Memory) 312 , and a RAM (Random Access Memory) 313 constituting the PC section 301 are interconnected by a bus 314 .

A CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating apparatus 1 . The ROM 312 stores programs and data executed by the CPU 311 . A RAM 312 temporarily stores data and programs processed by the CPU 311 .

An input/output interface 315 is further connected to the bus 314 . A storage unit 316 , a communication unit 317 and a drive 318 are connected to the input/output interface 315 .

The storage unit 316 is a nonvolatile storage medium such as a hard disk or flash memory. The storage unit 316 stores various setting information and the like supplied from the CPU 311 . Information stored in the storage unit 316 is appropriately read by the CPU 311 .

A communication unit 317 is an interface of a network such as the Internet. A communication unit 317 communicates with an external device under the control of the CPU 311 . The communication unit 317 transmits the image selected by the user to, for example, an image acquisition site management server managed by the manufacturer of the photo sticker creating apparatus 1 . The image transmitted from the communication unit 317 is stored in a predetermined storage area, displayed on the mobile terminal accessing the image acquisition site management server, or downloaded to the mobile terminal.

A removable medium 319 such as an optical disk or a semiconductor memory is mounted in the drive 318 as appropriate. Programs and data read from the removable medium 319 by the drive 318 are supplied to the CPU 311 and stored in the storage unit 316 or installed.

The external input/output interface 303 is connected to the input/output interface 315 . Each unit is controlled by the PC unit 301 via the external input/output interface 303 .

The pre-selection unit 302 realizes pre-selection processing for users in the pre-selection space A0. The preselection unit 302 is composed of a touch panel monitor 71 , a speaker 72 and a coin processing unit 321 .

The touch panel monitor 71 displays various selection screens under the control of the PC unit 301 and accepts user operations on the selection screens. An input signal representing the content of the user's operation is supplied to the PC unit 301, and various settings are performed.

The coin processing unit 321 detects insertion of coins into the coin insertion/return port 73 . When the coin processing unit 321 detects that a predetermined amount of coins has been inserted, the coin processing unit 321 outputs an activation signal instructing the start of the game to the PC unit 301 .

The photographing unit 304 realizes photographing processing for users in the photographing space A1. The photographing unit 304 is composed of an illumination device 331 , a camera 91 , a touch panel monitor 92 and a speaker 332 .

The lighting device 331 is each strobe unit in the shooting space A1 and emits light according to the lighting control signal supplied from the PC section 301 .

The camera 91 performs photographing according to shutter control by the PC section 301 and outputs image data obtained by photographing to the PC section 301 .

The editing unit 305A implements editing processing for users in the editing space A2-1. The editing unit 305A is composed of a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 341. FIG. The editing section 305B implements editing processing for users in the editing space A2-2, and has the same configuration as the editing section 305A. Hereinafter, the editing units 305A and 305B will simply be referred to as the editing unit 305 when they are not distinguished from each other.

The tablet built-in monitor 131 displays an edit screen under the control of the PC unit 301 and accepts a user's operation on the edit screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and the captured image is edited.

Printing unit 306 is configured to include printer 351 . A sticker paper unit 352 is attached to the printer 351 .

The printer 351 drives the head 361 and prints an image on the roll-shaped sticker paper 363 contained in the sticker paper unit 352 based on the print data supplied from the PC section 301 . The printer 351 also cuts the sticker paper 363 on which the image is printed by the cutter 362 and discharges it to the sticker paper discharge port 161 .

<Example of functional configuration of photo sticker creation device>
FIG. 11 is a block diagram showing a functional configuration example of the photo sticker creating apparatus 1. As shown in FIG. At least some of the functional units shown in FIG. 11 are implemented by the CPU 311 executing a predetermined program.

In the photo sticker creating apparatus 1, a pre-selection processing unit 401, a photographing processing unit 402, an editing processing unit 403, and a printing processing unit 404 are realized.

The pre-selection processing unit 401 executes pre-selection processing by controlling each unit of the pre-selection unit 302 . Selection of the number of users, selection of a background image, and the like are performed by the pre-selection process. Information representing the content selected by the user is supplied to the imaging processing unit 402 .

The imaging processing unit 402 performs imaging processing by controlling each unit of the imaging unit 304 . The shooting processing unit 402 outputs the data of the shot image obtained by performing the shooting processing to the editing processing unit 403 . The shooting processing unit 402 supplies the editing processing unit 403 with data of a plurality of captured images obtained by performing shooting a plurality of times.

The editing processing unit 403 performs editing processing by controlling each unit of the editing unit 305 . The editing process includes a process of adjusting the size of the user's eyes and the brightness of the skin appearing in the captured image, a process of editing the captured image, and the like. After editing the captured image, the edit processing unit 403 generates print data by arranging the edited image in a predetermined layout, and outputs the print data to the print processing unit 404 .

The print processing unit 404 outputs print data to the printer 351 to print the edited image.

<Detailed Configuration of Shooting Processing Unit>
FIG. 12 is a block diagram showing a configuration example of the imaging processing unit 402. As shown in FIG.

The photographing processing unit 402 includes a photographing control unit 411 , a trimming unit 412 , an image processing unit 413 , a selection reception unit 414 , a display control unit 415 and a photographed image storage unit 416 .

The photographing control unit 411 controls the camera 91 to photograph the user as a subject. The shooting control unit 411 shoots a moving image for a live view image before shooting a still image, and outputs the moving image captured by the camera 91 . Further, the shooting control unit 411 shoots a still image in accordance with the shooting timing of the shot image, and outputs the still image shot by the camera 91 . The moving image and still image output from the shooting control unit 411 are supplied to the trimming unit 412 .

The trimming unit 412 trims each frame of the moving image supplied from the shooting control unit 411, and outputs a moving image composed of images of a predetermined range. A moving image made up of images of the range cut out by trimming is supplied to the image processing unit 413 and the display control unit 415 .

Also, the trimming unit 412 trims the still image supplied from the shooting control unit 411 at the shooting timing of the shot image, and cuts out a predetermined range to generate a shot image. The trimming unit 412 outputs the generated captured image to the captured image storage unit 416 for storage. The captured image generated by the trimming unit 412 is appropriately output to the display control unit 415 to display the captured image.

The photographing of the photographed image is performed, for example, six times. The 1st to 4th shots are for close-up images, and the 6th shot is for example a coordinated image. The shooting of the close-up image and the shooting of the coordinated image are performed with the same focal length of the lens of the camera 91, for example, 24 mm. By changing the trimming range, a close-up image and a coordinated image with different aspect ratios are generated.

FIG. 13 is a diagram showing an example of generating a close-up image and a coordinated image.

The image shown in FIG. 13 is an original image taken with a focal length of 24 mm. A rectangular area indicated by a frame F1 is an area cut out by trimming when shooting a close-up image. The trimming unit 412 cuts out the rectangular area indicated by the frame F1 by trimming to generate a close-up image.

A rectangular area indicated by a frame F2 is an area cut out by trimming when photographing a coordinated image. The trimming unit 412 cuts out the rectangular area indicated by the frame F2 by trimming to generate a coordinated image.

The display of the live view image before photographing the close-up image and the coordination image is also performed using images obtained by cutting out the ranges indicated by frames F1 and F2 in FIG. done.

The fifth shot of the six shots is taken as a close-up image synthesized with the stamp image selected by the user.

Hereinafter, photographing of a close-up image synthesized with a stamp image will be referred to as "modern prime photographing" in the sense of photographing for obtaining an image with a so-called "lively feeling" by appropriately synthesizing trendy stamp images. The “feeling of liveliness” is an index representing the degree of emphasizing the cuteness of the user's face.

FIG. 14 is a diagram showing an example of a stamp image that is used when photographing the prime of life.

For example, a stamp image 431 representing the ears and nose of an animal as shown in FIG. The stamp image 431 consists of a nose image 431-1 representing the nose of a rabbit and ear images 431-2 and 431-3 representing the left and right ears of a rabbit.

FIG. 15 is a diagram showing an example of a synthesized image.

A composite image as shown in FIG. 15 is generated by combining the stamp image of FIG. 14 with the position of the nose and head of each user shown in the close-up image. The size of the stamp image is adjusted according to the size of the user appearing in the close-up image, and the size-adjusted stamp image is synthesized.

In the example of FIG. 15, a nose image 431-1L is synthesized at the position of the user's nose on the left side, and ear images 431-2L and 431-3L are synthesized at the position of the head of the user. A nose image 431-1R is synthesized at the position of the user's nose on the right side, and ear images 431-2R and 431-3R are synthesized at the position of the head of the user.

In this way, a synthesized image obtained by synthesizing the stamp image with the close-up image is generated as the photographed image of the modern prime photographing.

The type of stamp image to be used for synthesis is selected before the modern prime photography is performed. Data of a plurality of types of stamp images as shown in FIGS.

Selection of the stamp image is performed using a stamp image selection screen displayed on the touch panel monitor 92 . As will be described later, the stamp image selection screen displays a button operated when selecting each stamp image, as well as a live view image synthesized with content representing the currently selected stamp image.

The user can select a stamp image to be used for the modern prime photographing while viewing the live view image reflecting the content selected by the user.

Although the details will be described later, the trimming unit 412 in FIG. 12 adjusts the trimming range while allowing the user to select the stamp image, in other words, while accepting the selection of the stamp image by the user. By doing so, the angle of view of the live view image is adjusted.

The trimming unit 412 cuts out an image having the same angle of view as the close-up image by trimming the still image supplied from the photographing control unit 411 at the time of high-end photographing, and outputs the cut-out close-up image to the image processing unit 413 .

The image processing unit 413 synthesizes contents with respect to each frame of the moving image supplied from the shooting control unit 411 before the modern prime shooting. That is, the image processing unit 413 identifies the position of each part such as the eyes, nose, and head by performing face recognition on each frame, and synthesizes each image forming the content at the identified position. Information indicating the type of stamp image selected by the user is supplied from the selection reception unit 414 .

The content to be combined with the moving image is composed of an image representing the type of stamp image to be combined with the close-up image. The same image as the stamp image to be combined with the still image may be combined with each frame of the moving image, or a different image may be combined with each frame of the moving image. The content to be synthesized with the moving image is an image representing the content of the image processing performed on the close-up image, which is a still image. The image processing unit 413 outputs the moving image synthesized with the content to the display control unit 415 .

Further, the image processing unit 413 generates a synthesized image by synthesizing the stamp image selected by the user with the close-up image supplied from the shooting control unit 411 at the time of shooting in the prime of life. The image processing unit 413 outputs the synthesized image generated by synthesizing the stamp images to the photographed image storage unit 416, and stores it as the photographed image of the modern prime photographing. The composite image generated by the image processing unit 413 is appropriately output to the display control unit 415 to display the imaging result of the modern prime imaging.

The selection acceptance unit 414 accepts a user's operation on the stamp image selection screen displayed on the touch panel monitor 92 . The selection accepting unit 414 outputs information indicating the type of stamp image selected by the user to the image processing unit 413 .

The display control unit 415 controls display on the touch panel monitor 92 . For example, the display control unit 415 causes the touch panel monitor 92 to display a guidance screen regarding shooting.

The display control unit 415 also causes the touch panel monitor 92 to display the close-up image and the coordinated image of the live view image before shooting based on the moving image supplied from the trimming unit 412 . Based on the moving image supplied from the image processing unit 413 , the display control unit 415 causes the touch panel monitor 92 to display the live view image before the modern prime shooting.

When an image is captured, the display control unit 415 causes the touch panel monitor 92 to appropriately display the image capturing result.

The captured image storage unit 416 stores the close-up image and coordinated image supplied from the trimming unit 412 and the composite image supplied from the image processing unit 413 . The photographed image stored in the photographed image storage unit 416 is read by the editing processing unit 403 after the photographing process is completed.

<Operation of photo sticker creation device>
Here, the operation of the photo sticker creating apparatus 1 that provides the photo sticker creating game will be described with reference to the flowchart of FIG.

In step S1, the pre-selection processing unit 401 determines whether or not a predetermined amount of coins has been inserted based on the activation signal supplied from the coin processing unit 321, and waits until it is determined that coins have been inserted. do. If it is determined in step S1 that a coin has been inserted, the process proceeds to step S2.

In step S<b>2 , the pre-selection processing unit 401 performs pre-selection processing by controlling the pre-selection unit 302 . By the pre-selection process, for example, selection of the number of users, selection of a background image to be combined with the captured image, and the like are performed. Any selection is made using the screen displayed on the touch panel monitor 71 .

In step S<b>3 , the imaging processing unit 402 performs imaging processing by controlling the imaging unit 304 . For example, the photographing processing unit 402 displays a live view screen on the touch panel monitor 92 based on the moving image captured by the camera 91, and photographs the user in the photographing space A1 as a subject. Details of the shooting process will be described later with reference to the flowchart of FIG. 18 .

In step S4, the editing processing unit 403 controls the editing unit 305 corresponding to the editing space to which the user who has completed the photographing process is moved, out of the editing space A2-1 and the editing space A2-2. to perform the editing process.

For example, the editing processing unit 403 causes the tablet built-in monitor 131 to display an editing screen, and allows the user to edit the photographed image obtained by the photographing process. On the editing screen, a photographed image to be edited and buttons to be operated when selecting a composite image to be composited with the photographed image are displayed. The editing processing unit 403 edits the captured image by synthesizing images for synthesis according to the user's operation, and generates an edited image.

For example, it is possible to edit not only a close-up image and a coordinated image, but also a composite image obtained by modern-day photography.

After editing the captured image, the edit processing unit 403 displays various screens on the tablet built-in monitor 131, such as a screen used for selecting the number of divisions and a screen used for selecting an image to be transmitted to the image acquisition site management server. The edit processing unit 403 performs various processes according to the user's operation on each screen.

In step S<b>5 , the print processing unit 404 performs print processing by controlling the printer 351 . The print processing unit 404 outputs the print data generated by the editing processing unit 403 to the printer 351 to print it on the sticker paper 363 .

When printing is completed, the printer 351 ejects the sticker paper 363 cut by the cutter 362 to the sticker paper outlet 161 in step S6.

Each group of users of the photo sticker creating apparatus 1 is provided with a photo creating game consisting of a series of processes as described above. When a user of another group starts using the photo sticker creating device 1 following a user of a certain group, the photo sticker creating game of the user who started using the photo sticker creating device 1 first, and the user who started using the photo sticker creating device 1 later. The user's photo sticker creation game that has been started will be played in parallel as appropriate. As appropriate, the photo sticker creation game is also simply called a game.

<Shooting process>
Next, the photographing process performed in step S3 of FIG. 17 will be described with reference to the flowchart of FIG.

In step S11, the display control unit 415 (FIG. 12) of the imaging processing unit 402 displays a guidance screen on the touch panel monitor 92 to guide the standing position of each user. Guidance of the standing position is performed by designating marks on the floor material.

After guidance of the standing position is performed, the display control unit 415 starts displaying the live view screen in step S12. That is, the camera 91 is controlled by the imaging control unit 411, and capturing of the moving image is started. A moving image captured by the camera 91 is supplied to the trimming unit 412 and trimmed. A moving image composed of an image cut out by trimming is output to the display control unit 415 and used for displaying the live view screen.

FIG. 19 is a diagram showing a display example of the live view screen.

A display area 451 is provided substantially in the center of the live view screen. The moving image supplied from the trimming unit 412 is displayed as a live view image in the display area 451 .

In the example of FIG. 19, a live view image is displayed in which the faces and upper bodies of two users are enlarged. Such a live view image is displayed before shooting a close-up image. The user can check the pose by looking at the live view image.

On the live view screen, numbers representing the countdown to shooting are displayed at a predetermined timing.

When the timing for photographing comes, the photographing control unit 411 photographs a close-up image in step S13. The trimming unit 412 cuts out an image in the range described with reference to FIG. 13 from the still image obtained by shooting, and generates a close-up image.

The close-up image generated by the trimming unit 412 is stored in the captured image storage unit 416, is supplied to the display control unit 415, and is displayed on the touch panel monitor 92 as the captured result. The image processing unit 413 may synthesize a background image with the close-up image.

In step S14, the shooting control unit 411 determines whether or not the close-up image shooting has been performed four times. Until it is determined that four close-up images have been captured, the process returns to step S13, and display of the live view screen and close-up image capturing are repeated.

If it is determined in step S14 that four close-up images have been captured, the process proceeds to step S15.

In step S15, modern prime photographing processing is performed. A synthesized image as described above is generated as a photographed image by the modern prime photographing process. The details of the modern prime photographing process will be described later with reference to the flowchart of FIG. 20 .

In step S16, the display control unit 415 displays a guidance screen on the touch panel monitor 92 to guide the user to the standing position for the coordinated image.

After guidance of the standing position is performed, the display control unit 415 starts displaying the live view screen in step S17. The configuration of the live view screen is the same as the configuration described with reference to FIG. A display area 451 displays a live view image showing the area from the top of the user's head to the area below the knee.

When the timing for photographing comes, the photographing control unit 411 photographs a coordinated image in step S18. The trimming unit 412 cuts out an image within the range described with reference to FIG. 13 from the captured image to generate a coordinated image.

The coordinated image generated by the trimming unit 412 is stored in the photographed image storage unit 416, is supplied to the display control unit 415, and is displayed on the touch panel monitor 92 as the photographed result. The image processing unit 413 may combine the coordinate image with a background image or the like.

In step S<b>19 , the display control unit 415 displays a guide screen on the touch panel monitor 92 to guide the user who has finished shooting to move to the editing space. After that, the process returns to step S3 in FIG. 17 and the subsequent processes are performed.

<Modern prime shooting processing>
With reference to the flow chart of FIG. 20, the modern prime photographing process performed in step S15 of FIG. 18 will be described.

The processing shown in FIG. 20 is performed after shooting the close-up image. When capturing a close-up image, the touch panel monitor 92 displays a moving image within the range of the frame F1 described with reference to FIG. 13 as a live view image. Moving images continue to be supplied from the imaging control unit 411 .

In step S31, the trimming unit 412 changes the angle of view of the live view image by changing the cutout range by trimming. The live view image with the changed angle of view is an image used for display before the modern day shooting.

FIG. 21 is a diagram showing an example of changing the angle of view.

As shown in FIG. 21, for example, a range indicated by a dashed frame F11 is set as a trimming cutout range and cut out. The range indicated by the frame F11 is a range with an angle of view wider than the angle of view of the close-up image. A moving image with a wider angle of view than that of the close-up image is used for displaying the live view image before the modern prime shooting. The range indicated by the frame F11 is fixed and set in advance as the range of the angle of view for the live view image before the modern prime shooting.

As described above, the touch panel monitor 92 displays a live view image synthesized with content, and buttons used to select a stamp image before the modern prime shooting. The user operates the buttons while watching the display of the live view image to select a desired stamp image.

Here, in order to operate the buttons displayed on the touch panel monitor 92 , the user needs to approach the touch panel monitor 92 . When the user approaches the touch panel monitor 92, the user approaches the camera 91. Therefore, assuming that the angle of view of the live view image is the same as the angle of view of the close-up image, as shown in FIG. The face of the user performing the operation may not fit in the angle of view.

FIG. 22 is a diagram showing the angle of view of the live view image when the angle of view is not changed. Actually, a live view image is displayed in which the content representing the stamp image selected by the user is synthesized.

In the example of FIG. 22, the face of the left user who is performing the operation for selecting the stamp image does not fit. In this case, face recognition fails, content composition is not performed correctly, and it becomes impossible to select a stamp image while viewing a live view image.

By widening the angle of view while the stamp image selection is being accepted, it is possible to display a live view image in which the face of the user performing the operation is within the angle of view, as shown in FIG. Become. When the user on the right side approaches the touch panel monitor 92 in the same way as the user on the left side, the face of the user on the right side also fits within the angle of view of the live view image together with the face of the user on the left side.

Returning to the description of FIG. 20, in step S32, the trimming unit 412 trims each frame of the moving image supplied from the imaging control unit 411 to generate a moving image with a wider angle of view. The moving image generated by the trimming unit 412 is supplied to the image processing unit 413 .

In step S<b>33 , the image processing unit 413 synthesizes the content representing the default stamp image with the moving image supplied from the trimming unit 412 . The image processing unit 413 recognizes, for example, the user's face in the moving image, synthesizes the image of the nose that constitutes the content with the position of the user's nose, and aligns the image of the ear that constitutes the content with the user's head. position.

By displaying a moving image synthesized with the content representing the default stamp image, even users who have never taken a picture in prime time can easily understand what kind of picture is taken in prime time. I can understand.

In step S34, the display control unit 415 causes the touch panel monitor 92 to display a stamp image selection screen including a live view image synthesized with content representing a default stamp image.

FIG. 24 is a diagram showing a display example of the stamp image selection screen.

As shown in FIG. 24, a live view image combined with content is displayed in a display area 451 of the stamp image selection screen. The moving image used to display the live view image is a moving image with a wider angle of view than the close-up image. The user's face is displayed large because the user is approaching the touch panel monitor 92 (camera 91).

In the example of FIG. 24, a nose image 501-1L is synthesized at the position of the user's nose on the left side, and ear images 501-2L and 501-3L are synthesized at the position of the head of the user. A nose image 501-1R is synthesized at the position of the user's nose on the right side, and ear images 501-2R and 501-3R are synthesized at the position of the head of the user.

A nose image 501-1L, ear images 501-2L and 501-3L, a nose image 501-1R and ear images 501-2R and 501-3R are contents representing default stamp images. In the example of FIG. 24, the default stamp image is a stamp image of a cat's nose and ears.

In this way, on the stamp image selection screen, the contents of the user's selection are reflected in the display of the live view image in real time.

Below the display area 451, buttons 461-1 to 461-7 operated when selecting a stamp image are displayed side by side. More buttons are provided to the left of button 461-1 and to the right of button 461-7. Each circular button displays a sample stamp image that is selected when the button is pressed.

In the example of FIG. 24, the central button 461-4 is selected and displayed larger than the other buttons. A button 461-4 is the button operated when selecting the default stamp image.

By operating other buttons, the user can switch the content synthesized with the live view image, view the live view image synthesized with such content, and select a desired stamp image. The user may be allowed to change the color of the selected stamp image. In this case, buttons used for changing the color are also prepared on the stamp image selection screen.

On the right side of the display area 451, an OK button 462 is displayed which is operated when finishing the selection of the stamp image.

Returning to the description of FIG. 20, in step S35, the selection reception unit 414 determines whether or not the stamp image has been switched.

If it is determined in step S35 that the stamp image has been switched, then in step S36 the image processing unit 413 combines the content representing the stamp image selected by the user with the moving image.

Thereafter, the process returns to step S34, and a live view image synthesized with the content representing the stamp image newly selected by the user is displayed on the stamp image selection screen.

FIG. 25 is a diagram showing another display example of the stamp image selection screen.

For example, when the button 461-3 is operated, as shown in FIG. 25, instead of the content representing the default stamp image, a live view image synthesized with different content is displayed.

Nose image 502-1L, ear images 502-2L and 502-3L, nose image 502-1R and ear images 502-2R and 502-3R are contents representing stamp images selected when button 461-3 is operated. is. In the example of FIG. 25, the stamp image of the dog's nose and ears is the stamp image selected when the button 461-3 is operated.

On the other hand, if it is determined in step S35 of FIG. 20 that the stamp image has not been switched, the imaging control unit 411 determines in step S37 whether or not the stamp image has been determined.

If it is determined in step S37 that the stamp image has not been determined, the process returns to step S34 to continue displaying the stamp image selection screen. For example, when the OK button 462 is operated, or when the time limit elapses, it is determined that the stamp image synthesized at that time has been determined.

If it is determined in step S37 that the stamp image has been determined, in step S38 the trimming unit 412 adjusts the angle of view of the live view image to the same angle of view as that of the close-up image by changing the trimming range. return.

The touch panel monitor 92 displays a live view image with the same angle of view as the close-up image. Content representing the stamp image selected by the user is combined with the live view image.

In step S39, the shooting control unit 411 shoots a still image. The photographed still image is supplied to the trimming unit 412, and trimmed to cut out a range indicated by a frame F1 having the same angle of view as the close-up image. The image (close-up image) cut out by the trimming unit 412 is supplied to the image processing unit 413 .

In step S40, the image processing unit 413 synthesizes the stamp image selected by the user with the close-up image supplied from the trimming unit 412, and generates a synthesized image of modern prime photography.

In step S41, the image processing unit 413 outputs the synthesized image to the captured image storage unit 416 and stores it as a captured image. After the composite image is saved, the process returns to step S15 in FIG. 18 and the subsequent processes are performed.

FIG. 26 is a diagram showing an example of changes in the angle of view of the live view image.

The horizontal axis in FIG. 26 represents time. FIG. 26 shows the time from the start of display of the live view image before shooting of the close-up image to the shooting of the prime of life. After the modern-day photographing, the display of the live view image before photographing of the coordinated image, etc. are performed as described above.

Display of the live view image is started at time t1. Since this is the live view image before the close-up image is captured, the angle of view of the live view image displayed here is the same as the angle of view of the close-up image (the angle of view of the frame F1 in FIG. 21).

A close-up image is captured at each of times t2 to t5 after a predetermined time has elapsed since the display of the live view image started.

After the close-up image is captured, the stamp image selection screen starts to be displayed at time t6. The angle of view of the live view image displayed on the stamp image selection screen is wider than the angle of view of the close-up image (the angle of view of the frame F11 in FIG. 21).

At time t7 after the stamp image is determined, the angle of view of the live view image is returned to the same angle of view as that of the close-up image. At time t8 after a predetermined period of time has passed since the angle of view was returned, modern prime photography is performed.

As described above, at least while the selection using the display of the touch panel monitor 92 is being accepted, by widening the angle of view of the live view image, the face of the user who is performing the operation is within the angle of view. A view image can be displayed.

Since the face is within the angle of view, the user can select a stamp image while looking at the content synthesized with his or her face.

The angle of view of the live-view image during the period from time t2 to t5 is the same as the angle of view of the close-up image, and after time t7, the angle of view of the live-view image is set to be narrower than the angle of view of the close-up image. may be made. Since the user tends to lean backward when photographing, by narrowing the angle of view of the modern-day photographing than the angle of view of the close-up image, it is possible to photograph an image in which the users are closer to each other.

Conversely, the angle of view of the live-view image after time t7 is the same as the angle of view of the close-up image, and the angle of view of the live-view image during the period from time t2 to t5 is narrower than the angle of view of the close-up image. may be set.

Both the angle of view of the live view image during the period from time t2 to t5 and the angle of view of the live view image after time t7 may be set to a narrower angle of view than the angle of view of the close-up image. . This makes it possible to take an image in which the users are closer to each other.

A bust-up image having a wider angle of view than the close-up image is captured as live-view image capturing during the period from time t2 to t5, and the close-up image is captured as live-view image capturing during the period after time t7. It is also possible to shoot with the same angle of view.

Conversely, a bust-up image is captured as live-view image capturing in the period after time t7, and the same angle of view as the close-up image is captured as live-view image capturing in the period from time t2 to t5. may be performed.

<Example of angle of view adjustment>
Although the angle of view of the live view image is expanded to a preset fixed angle of view, the angle of view may be adjusted by adjusting the position of the cut-out range by trimming.

FIG. 27 is a diagram showing an example of angle-of-view adjustment when there is only one user.

The range indicated by a frame F21 in FIG. 27 is the range of the angle of view of the live view image. As shown on the left side of FIG. 27, when the user's face does not fit within the angle of view of the live view image, the image of the live view image is adjusted so that the user's face fits within the angle of view indicated by the white arrow. angle is adjusted.

In this case, the trimming unit 412 recognizes the user's face by analyzing each frame of the moving image supplied from the shooting control unit 411, and adjusts the position of the trimming range so that the user's face fits within the angle of view. will have to adjust. Not only the position of the trimming range but also the size of the range is adjusted accordingly.

By adjusting the field angle of the live view image in this manner while the selection using the display of the touch panel monitor 92 is being accepted, at least the face of the user who is performing the operation is within the field angle. A view image can be displayed.

FIG. 28 is a diagram showing an example of angle-of-view adjustment when there are multiple users.

As shown in FIG. 28, when there are multiple users, the angle of view of the live view image is adjusted so that the faces of the users near the camera 91 fit. The position of each user is specified, for example, based on a mask image representing a person's area, which is obtained by subjecting an image captured by the camera 91 to chromakey processing or the like.

As shown on the left side of FIG. 28, when the face of the user near the camera 91 does not fit within the angle of view of the live view image, the face of the user near the camera 91 fits as indicated by the white arrow. , the angle of view of the live view image is adjusted.

It is considered that the user in the large image is the user who is operating the touch panel monitor 92 . By adjusting the angle of view of the live view image in this manner while accepting a selection using the display of the touch panel monitor 92, the user performing the operation can at least fit his or her face within the angle of view. You can check the live view image that is displayed.

When there are multiple users, the persons to be included in the angle of view of the live view image may be set as follows.

- Adjust the angle of view of the live view image so that the face of the user far from the camera 91 (the user near the back) can be accommodated.
・Adjust the angle of view of the live view image so that everyone's face fits.

By adjusting the angle of view so that the face of the user who is far from the camera 91 fits, the user who is operating the touch panel monitor 92 can see how the content is combined with the user who is close to the back and stamp it. Images can be selected.

By adjusting the angle of view so that all the faces fit, the user who is operating the touch panel monitor 92 can see the images of all the people and select a stamp image.

FIG. 29 is a diagram showing an example of adjusting the angle of view when all the faces are included.

The range shown in the frame F31 in FIG. 29 is the range of the angle of view of the original image. The range indicated by the frame F21 is the range of the angle of view of the live view image. Face recognition is performed on the original image, and it is detected that the face appears in the range indicated by square frames f1 and f2. Frames f1 and f2 are squares with the position of the nose as the midpoint and the area from the eyebrows to the tip of the chin.

In the leftmost example of FIG. 29, the entire face of the user near the camera 91 is not within the angle of view of the live view image. In this case, as shown in the center of FIG. 29, a square frame f11 is set to include the peripheries of two square frames f1 and f2.

Also, as shown on the right side of FIG. 29, the angle of view of the live view image is adjusted so that the frame f11 fits. This makes it possible to display a live view image in which all the faces are within the angle of view.

Also, the range within the angle of view of the live view image may be set as follows.

・Adjust the angle of view of the live view image so that the face fits.
・Adjust the angle of view of the live view image so that the bust-up (approximately the area above the chest) fits.
・Adjust the angle of view of the live view image so that the whole body fits.

By adjusting the angle of view so that the face fits, the user operating the touch panel monitor 92 can see the image of his/her own face and select a stamp image.

In addition, by adjusting the angle of view so that the bust-up fits, the user who is operating the touch panel monitor 92 can select a stamp image by looking at the image of his/her face and the overall balance. .

By adjusting the angle of view so that the whole body fits, the user operating the touch panel monitor 92 can view the whole body and select a stamp image.

In this way, it is possible to appropriately combine and set the person and the range to be included in the angle of view of the live view image.

For example, the angle of view may be adjusted so that the entire content fits within the angle of view.

FIG. 30 is a diagram illustrating an example of adjusting the angle of view when content is contained.

The range indicated by the frame F21 in FIG. 30 is the range of the angle of view of the live view image combined with the content. In the example of FIG. 30, a nose image 431-1L is synthesized at the position of the user's nose on the left side, and ear images 431-2L and 431-3L are synthesized at the position of the head of the user. A nose image 431-1R is synthesized at the position of the user's nose on the right side, and ear images 431-2R and 431-3R are synthesized at the position of the head of the user.

The ear images 431-2L and 431-3L synthesized at the position of the user's head on the left side and the ear images 431-2R and 431-3R synthesized at the position of the user's head on the right side are live views. It is not within the angle of view of the image.

In this case, the angle of view of the live view image is adjusted so that the ear images 431-2L and 431-3L and the ear images 431-2R and 431-3R are entirely contained as indicated by the white arrows.

By adjusting the angle of view so that the entire content fits, the user operating the touch panel monitor 92 can view the entire content and select a stamp image even when the user is close to the touch panel monitor 92. . Note that the angle of view is adjusted while maintaining the aspect ratio.

<Angle of view of target captured image>
The angle of view should be adjusted when shooting an image with the same angle of view as the close-up image (during modern day shooting). good too.

Also, the angle of view may be adjusted when an image having the same angle of view as that of the coordinated image is captured.

<How to adjust the angle of view>
As a method for adjusting the angle of view, it is possible to adopt various adjustment methods as follows.
・Detects the position of the user and adjusts the size of the angle of view.
- By detecting the position of the user, if it is detected that the user is extremely close to either the left or the right, the range of the angle of view is moved to the left or right.
- While the stamp image selection screen is being displayed on the touch panel monitor 92, the angle of view is adjusted so that the user near the camera 91 can be accommodated.
- Adjust the angle of view so that the user near the camera 91 can be accommodated while the selection using the display of the touch panel monitor 92 is being accepted.
- Within a predetermined time after pressing the touch panel monitor 92, the angle of view is adjusted so that the user closer to the camera 91 is included.
・When the user moves and deviates from the angle of view, the angle of view is adjusted so as to follow the movement of the user.

<How to adjust the angle of view>
Although the angle of view is adjusted by changing the trimming range, the angle of view of the live view image may be adjusted by controlling the zoom of the lens of the camera 91 .

By adjusting the angle of view by trimming, the processing load for operating the zoom mechanism of the camera 91 can be reduced.

The angle of view of the live view image may be adjusted by controlling the direction of the optical axis of the lens of the camera 91 .

Instead of adjusting the angle of view by moving a trimming frame set on the original image, the angle of view of the live view image may be adjusted by fixing the trimming frame and moving the original image.

<Content display>
- Synthesize and display the content representing the stamp image selected by the user.
・Continue to display the content with animation.
- The content may be displayed as an animation, and after a predetermined period of time has elapsed, the content may be changed to content using a stamp image (content that is not animation).
- The content combined with the live view image and the content (stamp image) combined with the still image are not the same.

<Re-select stamp image>
Reselection of stamp images may be performed as follows.

- When a stamp image is selected in the pre-selection space A0, the selected stamp image may be changed in the photographing space A1.
- Even if a stamp image is determined by pressing the OK button 462 (FIG. 24) in the shooting space A1, the stamp image may be changed within a predetermined time.
If the predetermined time allocated for stamp image selection has passed and the OK button 462 has not been pressed, content representing the last selected stamp image may be synthesized.

<Content example>
Contents used for displaying live view images include various contents as follows.

(1) Content Representing Fixed Stamp Image A fixed stamp image is a stamp image that is displayed with a fixed position in the angle of view.
(2) Content representing a sticky stamp image A sticky stamp image is a stamp image displayed following the position of a predetermined part of the user. The content representing the sticky stamp image may be displayed as an animation with the following changes.
・Rotate ・Move up and down ・Scale ・Move left and right ・Transparency change ・Color change (3) Aura (4) Veil (5) Frame is.

<Example of animation>
Here, animation of content will be described.

FIG. 31 is a diagram showing an example of an animation in which an image forming content rotates.

The content shown in FIG. 31 is content synthesized when the stamp image representing the rabbit's nose and ears described with reference to FIG. 15 and the like is selected. The content consists of an image of a rabbit's nose and an image of its ears.

The image of the ear is tilted to the right on the live view image on the left side of FIG. 31, and the image of the ear is tilted to the left on the live view image on the right side. For example, the position of the base of the ear image is fixed on any live view image. By alternately displaying the images of the ears with different angles at one-second intervals, an animation in which the content rotates is realized.

After such a live view image is displayed, a close-up image is taken by modern prime shooting, and a stamp image including an ear image without inclination is combined with the close-up image obtained by shooting.

FIG. 32 is a diagram showing an example of animation in which the position of an image forming content changes.

The content shown in FIG. 32 is the same content as the content shown in FIG. In the live view image on the left side of FIG. 32, the ear image is arranged above the head, and in the live view image on the right side, the ear image is arranged below the head (approximately at the forehead position). ing. By alternately displaying the images of the ears at different positions at one-second intervals, an animation in which the content moves up and down is realized.

After such a live view image is displayed, a close-up image is taken by the modern prime shooting, and an ear image is synthesized at a position different from the position shown in FIG. 32 with the close-up image obtained by the shooting.

In the following, further description will be given of changes in the images that make up the content.

(1) Rotation FIG. 33 is a diagram showing an example of rotation.

Triangles shown as Display 1 and Display 2 in FIG. 33 represent images that constitute content. One triangle corresponds to, for example, one image representing the rabbit's ear described above. The same applies to FIGS. 34 to 40 as well.

As indicated by display 1 and display 2, images whose angles are changed around a position p1, which is a predetermined position, are combined with a moving image as images constituting content. In display 1, the image is tilted to the left about the position p1, and in display 2, the image is tilted to the right about the position p1.

For example, in the case of an image to be synthesized at the position of the user's head, the midpoint of the lower side of the image, which is in contact with the head, is set as the position p1. In the case of an image to be synthesized around the face, such as an image representing cheeks, an image representing an animal's nose, or an image representing sunglasses, the position of the nose, which is the center of the face, is set as the center of rotation.

As shown on the left side of FIG. 33, an image arranged with the vertex on the vertical axis L passing through the position p1 is combined with the close-up image obtained by the modern height photographing.

In this way, when a live view image is being displayed, an image whose angle is changed around the position p1 is combined with a moving image to realize an animation display.

(2) Vertical Movement FIG. 34 is a diagram showing an example of vertical movement.

As indicated by display 1 and display 2, images whose heights are changed are combined with moving images as images constituting content.

For example, in the case of an image to be synthesized at the position of the user's head, a horizontal axis L2 passing through a predetermined position of the head is set. Horizontal axes L1 and L3 are set vertically with a predetermined interval around the horizontal axis L2. The image is arranged so that the lower side is at the height of the horizontal axis L3. In the case of an image to be synthesized around the face, such as an image representing cheeks, an image representing an animal's nose, or an image representing sunglasses, the horizontal axis L2 is set so as to pass through the center of the face.

As shown on the left side of FIG. 34, an image whose lower side is arranged at the same height as the horizontal axis L2 is synthesized with the close-up image obtained by the modern height photographing.

In this way, when a live view image is being displayed, an image whose position is vertically changed by a predetermined equal width is combined with a moving image to realize an animation display. Such an animation can be said to be an animation using an image that has little difference in visual impression from the stamp image that is synthesized with the still image.

(3) Scaling FIG. 35 is a diagram showing an example of scaling.

As indicated by display 1 and display 2, an image whose size is changed with reference to a position p1, which is a predetermined position of the image, is synthesized with the moving image as an image constituting content. In the display 1, the image is reduced with the position p1 as a reference, and in the display 2, the image is enlarged with the position p1 as a reference.

For example, in the case of an image to be synthesized at the position of the user's head, the midpoint of the lower side of the image, which is in contact with the head, is set as the position p1.

As shown on the left side of FIG. 35, an image having a size different from the size shown in display 1 and display 2 is arranged and combined with the position p1 as a reference for the close-up image obtained by the modern height photographing. .

In this way, when a live view image is being displayed, an image whose size is changed with reference to the position p1 is synthesized with a moving image, thereby realizing an animation display.

FIG. 36 is a diagram showing another example of scaling.

The scaling of the image shown in FIG. 36 differs from the scaling shown in FIG. 35 in that the reference position for scaling is different. In the example of FIG. 36, the center of the image is set as the midpoint p2 that serves as a reference for scaling.

As indicated by display 1 and display 2, an image whose size is changed around a position p2, which is the center of the image, is combined with the moving image as an image forming the content. In display 1, the image is reduced around the position p2, and in display 2, the image is enlarged around the position p2.

In this way, it is possible to arbitrarily set a position that serves as a reference for scaling.

(4) Left/Right Movement FIG. 37 is a diagram showing an example of left/right movement.

As indicated by display 1 and display 2, images that change their positions to the left and right around a predetermined position p3 are synthesized with the moving image as images constituting content.

For example, in the case of an image to be combined with the position of the user's head, the position p3 is set to be in contact with the head. In display 1, the image is arranged so that the right end is at position p3, and in display 2, the image is arranged so that the left end is at position p3.

As shown on the left side of FIG. 37, an image arranged so that the center of the lower side is positioned at the position p3 is synthesized with the close-up image obtained by the modern height photographing.

In this way, when a live view image is being displayed, an image whose position is changed left and right by a predetermined equal width is combined with a moving image to realize an animation display.

(5) Transparency Change FIG. 38 is a diagram showing an example of transparency change.

As shown in FIG. 38, an image whose transparency is changed is synthesized with a moving image as an image forming content. In the example of FIG. 38, three levels of transmittance of 0%, 50%, and 80% are set. In FIG. 38, different shades of triangles represent different transmittances.

A content made up of an image with a higher transparency than the stamp image to be combined with the still image may be combined, or a content made up of an image with a lower transparency may be combined.

As shown on the left side of FIG. 38, an image with a transparency of 0% is combined with the still image obtained by the modern prime photography.

In this way, when a live view image is being displayed, an image whose transparency changes is combined with a moving image to achieve animation display.

(6) Color Change FIG. 39 is a diagram showing an example of color change.

As shown in FIG. 39, an image of which colors are sequentially changed is synthesized with a moving image as an image constituting content. In the example of FIG. 39, four colors are set as shown as colors 1 to 4. In FIG. Colors 1 to 4 are, for example, colors forming a similar color gradation. In FIG. 39, different shades of triangles represent different colors. For example, an image is displayed in which colors are sequentially changed from a color with high brightness to a color with low brightness.

As shown on the left side of FIG. 39, an image of a color similar to colors 1 to 4 and having a lower lightness than color 1 is synthesized with the close-up image obtained by the modern height photographing.

In this way, when the live view image is being displayed, an image in which the color changes is synthesized with the moving image to realize an animation display.

FIG. 40 is a diagram showing another example of color change.

The color change shown in FIG. 40 differs from the color change shown in FIG. 39 in that different types of colors are used. In the example of FIG. 40, two kinds of colors are set as shown as color 1 and color 2. In FIG. Images in which colors are alternately changed as color 1 and color 2 are combined with a moving image as images constituting content.

As shown on the left side of FIG. 40, an image of a color different from both color 1 and color 2 is combined with the close-up image obtained by the modern height photographing.

In this way, when a live view image is being displayed, an image blinking by alternately switching colors is combined with a moving image to realize an animation display. For example, color 1 is green and color 2 is blue. In this case, for example, a red stamp image is synthesized with the close-up image obtained by the modern prime photography.

As described above, animation display of content is realized by changing the angle, position, size, transparency, and color of images that constitute the content. Two or more types of changes among angle change, position change, size change, transmittance change, and color change may be used in combination.

<Shape of angle of view>
Although the shape of the synthesized image of the modern prime photographing is a vertically long rectangle, it may be another shape.

As the shape of the angle of view, the following various shapes can be adopted.
・Square ・Roughly square ・Vertical rectangle ・Horizontal rectangle ・Circle ・Triangle ・Shapes for images used in various SNS ・Rounded square ・Vertical rounded rectangle ・Horizontal rounded rectangle

<Selection of content for retouching>
Although the type of stamp image to be combined with the still image is selected by the user while viewing the display of the live view image, other content may be selected. For example, it is possible to select the content of retouch processing.

The retouching process is image processing for a specific part of the user appearing in the captured image, such as adjustment of eye size, eye shape, and skin brightness.

The still image is subjected to the same retouching process as the retouching process selected by the user while viewing the live view image. While the selection of the content of the retouching process is being accepted, the angle of view of the live view image is widened in the same way as while the selection of the stamp image type is being accepted.

FIG. 41 is a diagram showing an example of a retouch selection screen.

The retouching selection screen shown in FIG. 41 is a screen used for selecting an eye shape. A screen such as that shown in FIG. 41 is displayed, for example, before a still image to be subjected to image processing for changing the shape of the eyes is captured. Descriptions of the same displays as those described with reference to FIG. 24 will be omitted as appropriate.

In the example of FIG. 41 , a live view image whose angle of view is adjusted so that the user's bust-up is included is displayed in the display area 451 . When the image to be retouched is a full-body image, a live view image of the user's whole body is displayed.

Below the display area 451, buttons 551-1 to 551-4 that are operated when selecting the eye shape are displayed side by side. Each button displays a sample representing the retouching process that will be selected when the button is pressed.

The button 551-1 is a button that is operated when performing retouching processing to widen the eyes. The button 551-2 is a button that is operated when performing retouch processing to transform the eyes into cat's eyes. The button 551-3 is a button that is operated when performing retouching processing to transform the eyes into sunken eyes. A button 551-4 is a button that is operated when retouching is not performed (the eye shape is not changed).

In the example of FIG. 41, button 551-2 is selected and displayed larger than the other buttons. The user's eyes captured in each frame of the moving image captured by the camera 91 are subjected to retouching processing to transform the eyes into cat's eyes. It is displayed in the display area 451 as a view image.

The retouching process performed on the moving image represents the content of the retouching process performed on the close-up image captured after the live view image is displayed.

By operating other buttons, the user can display live view images that have been subjected to other retouching processes. The user can select desired retouching contents while viewing the live view image.

In this manner, the angle of view of the live view image may be changed while the selection of other image processing such as retouching is being accepted.

<Reselecting retouching content>
The retouch processing content may be reselected as follows.

- When the contents of the retouching process are selected in the pre-selection space A0, the selected contents may be changed in the shooting space A1.
- Even if the contents of the retouching process are determined by pressing the OK button 462 (FIG. 41) in the shooting space A1, the contents of the retouching process may be changed within a predetermined time.
If the predetermined time allocated for selecting the content of retouch processing has passed and the OK button 462 has not been pressed, the last selected retouch processing may be performed.

<Types of retouching>
On the retouching selection screen, the content of retouching may be selected as follows.

Retouching includes close-up image retouching and full-body image retouching.

Retouching for close-up images Contour processing Small face processing Eye size processing Eye shape processing Nostril processing Raising the corners of the mouth Mouth size processing Skin color processing Moving parts (eyes) move it toward the temple, etc.)
・Eyebrow (change the shape of the eyebrows)

The contour processing is processing for recognizing the user's face in the captured image and changing the contour. Face-slimming processing is processing for recognizing a user's face in a captured image and making the face smaller. The eye size processing is processing for recognizing the user's eyes in the captured image and enlarging the eyes.

The eye shape processing is processing for recognizing the user's eyes in the captured image and changing the eye shape. The nostril processing is processing for recognizing the user's nose in the captured image and making the nose smaller. The process of raising the corners of the mouth is a process of recognizing the user's mouth in the photographed image and raising the corners of the mouth.

Mouth size processing is processing for recognizing the user's mouth in the captured image and changing the size of the mouth. The skin color processing is processing for recognizing the skin color of the user appearing in the captured image and changing the skin color. The movement of parts is a process of recognizing the parts (parts) of the user's face shown in the captured image and moving the parts. For example, movements of parts include upward and downward movements of the eyes, inward movements, and movements of the mouth. Eyebrow is a process of recognizing the user's eyebrows in a captured image and changing the shape of the eyebrows.

Retouching for full-body images ・Leg length processing ・Leg thinness processing ・Height processing ・Upper arm processing ・Constriction processing ・Neck length processing ・Waist position raising processing・Nail length processing

The leg lengthening process is a process of recognizing the legs of the user appearing in the captured image and lengthening the legs. The thin leg processing is processing for recognizing the leg of the user in the photographed image and thinning the leg. The height processing is processing for recognizing the whole body of the user appearing in the photographed image and increasing the height of the user.

The upper arm processing is processing for recognizing the user's upper arms in the captured image and thinning the upper arms. Constriction processing is processing for recognizing the waist of the user in the photographed image and emphasizing the constriction. Neck length processing is processing for recognizing the user's neck in the captured image and lengthening the neck.

The process of raising the waist position is a process of recognizing the waist of the user in the captured image and raising the waist position. The finger thinning process is a process of recognizing the user's hand in the captured image and thinning the finger. The process of deforming the nail shape is a process of recognizing the user's hand in the photographed image and deforming the shape of the nail. The nail length processing is processing for recognizing the user's hand in the photographed image and changing the length of the nail.

Note that here, retouching for a close-up image and retouching for a full-body image are separately described, but each processing described as retouching for a close-up image may be used for retouching a full-body image, Conversely, each process described as retouching for the whole-body image may be used for retouching the close-up image.

Instead of selecting the type of stamp image or selecting the content of retouch processing, the user can select both the type of stamp image and the content of retouch processing while viewing the display of the live view image. good.

<<Modification 1>>
The angle of view may be adjusted according to the pose of the user.

- When a plurality of users are standing apart from each other, the angle of view may be adjusted so that the users are not cut off.
- When the user is standing alone at the edge of the housing, the angle of view may be adjusted so that the user is not cut off.
- When the user spreads his or her hands outward, the angle of view may be adjusted so that the user is not cut off.
- When the user spreads his or her legs outward, the angle of view may be adjusted so that the user is not cut off.
- When the user holds an object in his or her hand, the angle of view may be adjusted so that the user, including the object, fits within the angle of view.

<<Modification 2>>
The angle of view may be adjusted according to the height of the user.

The angle of view may be adjusted according to the height (position of the face) of the user when taking an image for an ID photo or taking an image to be retouched.

<<Modification 3>>
Although the case of adjusting the angle of view at the time of photographing performed in the photo sticker creating apparatus 1 has been described, the angle of view at the time of accepting an operation in a portable terminal such as a smartphone may be similarly adjusted. An application used for image processing of captured images is installed in the user's mobile terminal.

The adjustment of the angle of view in the mobile terminal may be performed as follows.

・Detects the position of the user and adjusts the size of the angle of view.
・While the retouching selection screen is displayed, the angle of view is adjusted so that the user closest to the camera can be accommodated.
・While touching the touch panel monitor, adjust the angle of view so that the user closest to the camera is included.
・The angle of view is adjusted so that the user who is close to the camera can be accommodated within a predetermined time after pressing the touch panel monitor.
・Set a wide angle of view while displaying a live view image, and narrow the angle of view when shooting (fix the angle of view).

<<Other examples>>
The series of processes described above can be executed by hardware or by software. When a series of processes is executed by software, a program that constitutes the software is installed in a computer built into dedicated hardware or a general-purpose personal computer. For example, a program is installed in the PC section 301 which is a computer installed in the photo sticker creating apparatus 1 .

The program to be installed is provided by being recorded on removable media 319 shown in FIG. Alternatively, it may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be pre-installed in the ROM 312 or storage unit 316 .

The program executed by the computer may be a program that is processed in chronological order according to the order described in this specification, or may be executed in parallel or at a necessary timing such as when a call is made. It may be a program in which processing is performed.

1 photo sticker creation device, 91 camera, 92 touch panel monitor, 402 photographing processing unit, 403 editing processing unit, 411 photographing control unit, 412 trimming unit, 413 image processing unit, 414 selection reception unit, 415 display control unit, 416 photographed image memory

Claims (18)

a photographing unit for photographing a still image that is the basis of a photographed image of a user, and for photographing a moving image;
a selection reception unit that receives selection of content of image processing to be performed on the still image while the moving image is being displayed ;
an image processing unit that performs processing representing the content of the image processing selected by the user on the moving image;
Before the selection of the content of the image processing, the moving image captured by the photographing unit is displayed at the same angle of view as the captured image, and while the selection of the content of the image processing is being accepted, the use is performed. and a display control unit configured to display the moving image, which has been subjected to processing representing the content of the image processing selected by a user, at an angle of view wider than that of the captured image. The image processing device according to claim 1, wherein the display control unit displays the moving image with a fixed angle of view. The image processing apparatus according to claim 1, wherein the display control unit detects the user appearing in the moving image, and displays the moving image with an angle of view adjusted to include the user's face. 4. The image processing according to claim 3, wherein, when there are a plurality of users appearing in the moving image, the display control unit displays the moving image with an angle of view adjusted so as to include the faces of all the users. device . When there are a plurality of users appearing in the moving image, the display control unit displays the moving image with an angle of view adjusted so as to include at least the face of the user appearing in a position close to the photographing unit. Item 4. The image processing apparatus according to item 3. The image processing device according to any one of claims 3 to 5, wherein the display control unit displays the moving image with an angle of view adjusted based on the height of the user. The image processing is a process of synthesizing an image for synthesis at a predetermined position of the user in the captured image,
2. The display control unit according to claim 1, wherein while the selection of the type of the image for synthesis is being accepted, the moving image synthesized with the content representing the image for synthesis selected by the user is displayed. Image processing device . The image processing apparatus according to claim 7, wherein the display control unit detects the user appearing in the moving image, and displays the moving image with an angle of view adjusted to include the content. The image processing apparatus according to Claim 7 or 8, wherein the display control unit displays an animation in which an image representing the composition image changes as the content. The image processing apparatus according to claim 9, wherein the display control unit displays the animation in which the angle of the image representing the composition image changes. The image processing device according to claim 9 or 10, wherein the display control unit displays the animation in which the position of the image representing the composition image changes. 12. The image processing device according to any one of claims 9 to 11, wherein the display control unit displays the animation in which at least one of color, size, and transparency of an image representing the composition image changes. . The image processing is a retouching process for adjusting the appearance of the user in the still image,
2. The display control unit according to claim 1, wherein, while receiving selection of the content of the retouching process, the display control unit displays the moving image subjected to processing representing the content of the retouching process selected by the user. Image processing device . 14. The display control unit according to any one of claims 1 to 13, wherein the information used for selecting the content of the image processing is displayed on the same screen together with the moving image processed to represent the content of the image processing. Image processing device . When the content of the image processing to be performed on the captured image is selected, the display control unit displays the moving image subjected to the processing representing the content of the image processing selected by the user. 15. The image processing apparatus according to any one of claims 1 to 14, wherein the image is displayed at a narrower angle of view than the angle of view during which the selection of . 16. The image processing apparatus according to any one of claims 1 to 15, wherein the image processing section applies the image processing selected by the user to the still image captured by the imaging section to generate the captured image. . The image processing device
Take a still image that is the basis of the shot image with the user as the subject and shoot a moving image,
displaying the captured moving image at the same angle of view as that of the captured image before selecting the content of the image processing to be performed on the still image;
Receiving selection of the content of the image processing during display of the moving image ;
subjecting the moving image to processing representing the content of the image processing selected by the user;
displaying the moving image processed to represent the content of the image processing selected by the user at an angle of view wider than that of the photographed image while the selection of the content of the image processing is being accepted; control method. The computer installed in the image processing device
Take a still image that is the basis of the shot image with the user as the subject and shoot a moving image,
displaying the captured moving image at the same angle of view as that of the captured image before selecting the content of the image processing to be performed on the still image;
Receiving selection of the content of the image processing during display of the moving image ;
subjecting the moving image to processing representing the content of the image processing selected by the user;
Displaying the moving image, which has undergone processing representing the content of the image processing selected by the user, at an angle of view wider than that of the photographed image while the selection of the content of the image processing is being accepted. program to run.

Images