JP6939927B2 - Amusement imaging equipment and programs - Google Patents

Description

The present invention relates to a technique for processing a game image.

The game image shooting device called Purikura (registered trademark) is very popular among high school girls. The user photographs himself and decorates the captured image with various decorations on the display for editing. The decorated image is printed on the sticker mount (see Patent Documents 1 and 2).

Japanese Unexamined Patent Publication No. 2004-32213 Japanese Unexamined Patent Publication No. 2016-184287 JP-A-2019-115029

Patent Document 3 discloses a game image capturing device capable of simultaneously capturing a still image and a moving image of a user and reproducing the moving image. In addition, it is possible to decorate the still images that are generally taken to increase the additional enjoyment.

It is thought that decorating the shot video will increase the enjoyment, but it is considered that the editing operation for decorating the video is avoided because it is difficult for the user of the photo booth.

The present invention is an invention completed based on the above-mentioned problem recognition, and a main object thereof is to make it possible to enjoy decoration of a photographed moving image with a simple operation.

The game image capturing device according to an aspect of the present invention captures a still image of a user, and also captures a moving image of at least one of the user before and after shooting the still image, and a shooting still image. For the reception unit that accepts the instruction to paste the additional image, the specific unit that specifies the pasting position of the additional image in the captured still image according to the instruction to paste the additional image, and the multiple frame images included in the captured video. It is characterized by having a moving image processing unit for pasting an additional image based on the pasting position.

According to the present invention, it is possible to enjoy the decoration of a photographed moving image with a simple operation.

It is an overall block diagram of an image editing system. It is an external perspective view which removed the cover of a game image taking apparatus. It is the external perspective view which removed the ceiling part of a shooting booth. It is a flowchart which shows the flow of play in a game image shooting apparatus. It is a top view of the game image taking apparatus. It is a time chart of shooting one still image and shooting a moving image before and after that. It is a screen view of an edit screen. FIG. 8A is a diagram showing a change stamp image of a cloud figure corresponding to the change stamp button 308. FIG. 8B is a diagram showing a change stamp image of a heart figure corresponding to the change stamp button 310. FIG. 8C is a diagram showing a change stamp image of an illustration of a cracker corresponding to the change stamp button 312. It is a figure which shows the example of pasting the face stamp on the target still image. It is a figure which shows the example of the head frame of a photographed moving image. Here is an example of the first frame It is a figure which shows the example of pasting the face stamp with respect to the head frame of a photographed moving image. It is a structural diagram of primary face information. It is a structural diagram of the primary face stamp information. It is a structural diagram of secondary face information. It is a structural diagram of the secondary face stamp information. It is a structural diagram of change stamp information. It is a functional block diagram of a game image taking apparatus. It is a flowchart which shows the editing process process. It is a flowchart which shows the editing process process. It is a flowchart which shows the generation process of primary face information. It is a flowchart which shows the specific processing process of the primary adjustment parameter. It is a flowchart which shows the generation process of primary face stamp information. It is a flowchart which shows the display processing process of a photographed moving image. It is a flowchart which shows the generation process of secondary face stamp information. It is a flowchart which shows the generation process of secondary face stamp information. It is a flowchart which shows the specific processing process of the change stamp image. It is a figure which shows the example of pasting the change stamp with respect to the target still image in modification 1. FIG. It is a figure which shows the example of pasting the change stamp with respect to the head frame of the photographed moving image in modification 1. FIG. It is a screen view of the edit screen in the modification 2. It is a figure which shows the example of pasting the particle with respect to the frame of the photographed moving image in the modification 2.

The game image shooting device in the present embodiment includes a shooting booth and an editing booth. The user shoots himself at the shooting booth. Hereinafter, the image of the subject (user) taken at the shooting booth is referred to as a "shooting image". The game image shooting device applies image correction such as skin whitening and hair gloss to the shot image at the shooting booth (hereinafter, such image correction is referred to as "pre-correction"). The game image capturing device according to the present embodiment captures not only still images but also moving images at the photographing booth. Among the photographed images, those acquired as moving images are called "photographed moving images", and those acquired as still images are called "photographed still images".

The pre-corrected captured image will be sent to the editing booth. At the editing booth, the user can make arbitrary decorations such as pasting stamp images and scribbling with a stylus pen, and image corrections such as eye size and whiteness of the skin (hereinafter, such image decorations). Is called "decorative processing" or "editing"). The captured image that is being edited at the editing booth is called the "target image". Further, among the target images, the one in which the shooting moving image is the editing target is called the "target moving image", and the one in which the shooting still image is the editing target is called the "target still image".

The game image capturing device prints the target still image on a sticker mount (external medium). In addition, the game image capturing device uploads the target moving image and the target still image to the server (external medium). The user can also download the target image (target moving image and target still image) after the decoration processing by accessing the server from a user terminal such as a smartphone. As described above, the game image capturing apparatus according to the present embodiment includes a photographing function, an editing function (decorative processing function), a printing function, and a communication function.
In the following, the setting changes at the time of shooting / editing based on various information of the subject will be mainly described.

FIG. 1 is an overall configuration diagram of the game image capturing system 200.
In the game image capturing system 200, the game image capturing device 100 is connected to the server 202 and the user terminal 206 via the Internet 204. In the game image capturing device 100, the user photographs himself / herself. The game image capturing device 100 acquires a captured image including a subject (user), applies pre-correction to the captured image as necessary, and accepts decoration processing by the user. The user is identified by a user ID given in advance. The user makes a play reservation for the game image capturing device 100 by using the user card in which the user ID is registered.

The target image after the decoration process is uploaded from the game image capturing device 100 to the server 202 together with the user ID. The server 202 stores the user ID, the shooting date and time, and the target image (target moving image and target still image) in association with each other. The user downloads the target image from the server 202 by accessing the server 202 via the authentication information such as the user ID and the password.

The server 202 manages various information related to the user (hereinafter, referred to as "user information"). The game image capturing device 100 in the present embodiment automatically gives instructions to the subject and changes the setting of the shooting conditions based on the live view image.

FIG. 2 is an external perspective view of the game image capturing device 100.
The game image capturing device 100 includes a reception device 102, a photographing booth 104, an editing booth 106, and a printing device 110. The user reserves the use of the game image capturing device 100 at the reception device 102. The user inputs the user ID in the reception device 102 and pays the play fee in cash or electronic money. The reception device 102 issues a reservation number to the user. The reception device 102 displays the number of people on standby and the reservation number to be called on the reception monitor 108. When the user's reservation number is displayed on the reception monitor 108, the user enters the shooting booth 104. Alternatively, when the shooting booth 104 is in use, the next user may be kept on standby, and the next user may be accepted after the shooting booth 104 is vacant.

At the shooting booth 104, the user takes a picture. After the shooting is completed, the user moves to the editing booth 106. An editing device 126 is installed in the editing booth 106. The editing device 126 includes an editing monitor 120. The target image (photographed image to be decorated) is displayed on the editing monitor 120. The editing monitor 120 in this embodiment is formed by a capacitive touch panel. Two stylus pens 122a and 122b are prepared for one editing monitor 120. The user uses the stylus pen 122 and a finger to decorate the target image. After the editing is completed, the printing device 110 prints the target still image on the sticker mount. Further, the editing device 126 uploads the target image to the server 202.

FIG. 3 is an external perspective view of the photographing booth 104.
The shooting booth 104 is shielded from the outside by the curtain 124. A photographing device 128 is installed in the photographing booth 104. The photographing device 128 includes three lights 116 that illuminate the user as a subject from three directions, a camera 118 for acquiring a photographed still image and a photographed moving image, a first photographing monitor 112, a second photographing monitor 114, a left strobe 119a, and the like. It is equipped with a right strobe 119b.

The first shooting monitor 112 displays a live view image and a shot image (shooting moving image and shooting still image) of the user. The second shooting monitor 114 displays a shot image (hereinafter, referred to as “sample image”) of a person other than the user who is the subject, for example, a model. The user takes an arbitrary shooting pose in front of the camera 118 while referring to the sample image displayed on the second shooting monitor 114. Various explanations regarding the shooting method are also displayed on the second shooting monitor 114. The left strobe 119a and the right strobe 119b emit light at the same time as the captured still image is captured. As described above, in the shooting booth 104, the shooting moving image and the shooting still image can be acquired.
In the present embodiment, the second shooting monitor 114 also instructs the shooting pose by the sample image.

FIG. 4 is a flowchart showing the flow of play in the game image capturing device 100. FIG. 5 is a plan view of the game image capturing device 100 as viewed from above.
When the user makes a reservation for use in the reception device 102, the reception device 102 executes the reception process (S10). After acceptance, the user enters the shooting booth 104. The photographing device 128 photographs the user and acquires the photographed image of the user (S12). The photographing device 128 takes a still image a predetermined number of times. In this example, a moving image is taken as well as a still image is taken. The shot video and the shot still image are treated as a set. This set is called a photographed image set. In this example, up to 6 captured image sets are generated. At the time of shooting, the user can select a pre-correction method from a plurality of pre-correction menus provided by the photographing device 128. The user can also select the background color of the captured image on the photographing device 128. The photographing device 128 executes pre-correction every time a photographed image is acquired. The pre-correction menu may be selected on the reception device 102 before play. Further, the editing booth 106 may accept selection of a background color or the like of the captured image. The photographing process will be described in detail in relation to FIG.

After shooting, the first shooting monitor 112 displays instruction information instructing one of the two editing booths 106. The user moves to the editing booth 106 designated by the first shooting monitor 112 among the two editing booths 106a and 106b. The captured image is transferred from the photographing device 128 to the editing device 126. The user performs decorative processing on the captured image (target image) transferred by the editing device 126 (S14).

After editing, the editing device 126 sends the target image to the printing device 110, and the printing device 110 prints the target image on the sticker mount (S16). Further, the editing device 126 uploads the target image to the server 202 via the Internet 204 (S18). The user can download the target image from the server 202 to the user terminal 206 by accessing the server 202 using the user ID as an access key.

Generally, it takes more time to edit than to shoot. In the game image photographing apparatus 100 of the present embodiment, the customer turnover rate is increased by providing two editing booths 106a and 106b (editing devices 126a and 126b) for one photographing booth 104.

Here, the photographing process (S12) will be described in detail. In the photographing process (S12), a moving image is photographed together with the still image.

FIG. 6 is a time chart of shooting one still image and shooting a moving image before and after the shooting.
In the shooting process (S12), this flow is repeated for the number of still images to be shot. The number written on the horizontal axis of the time chart indicates how much time has passed in seconds, assuming that the start of shooting is 0.

When the user presses the shooting start button of the shooting device 100, shooting is started. When the shooting is started, the pose explanation image and the sample still image for shooting the still image are displayed on the second shooting monitor 114. The pose explanation image is an image instructed by text information such as "Let's make a heart with two people".

Five seconds after the start of shooting, the countdown for still image shooting starts. This countdown is for notifying the user of the timing of taking a still image. The count starts 3 seconds before, and a still image is taken when the count reaches 0. Prior to that, the recording of the moving image is started 1.5 seconds before the still image is taken. By starting recording of a moving image during the still image shooting countdown, it is possible to casually shoot the movement and appearance until the user poses for the still image.

Recording of moving images is temporarily stopped before shooting of still images. After stopping the recording of the moving image, the still image is taken. After the still image is taken, the video recording is resumed. In this example, the still image shooting is resumed 0.5 seconds after the still image shooting, and the moving image shooting continues for 1 second.

The reason for stopping the recording of the moving image when the still image is taken is to prevent the moving image from being mixed with a pure white frame by the flash of the strobe 119. Further, the reason for waiting for 0.5 seconds until the video recording is restarted is to eliminate the influence of the remaining reflected light.

When the shooting of the moving image is completed, the shooting still image and the shooting moving image are corrected in advance. The pre-corrected shooting still image and shooting moving image are displayed on the first shooting monitor 112. In this example, the shooting still image is displayed 11 seconds after the start of shooting, and the shooting moving image is also displayed 14.5 seconds later. Then, 18.5 seconds after the start of shooting, the display of the captured image ends, and the process proceeds to the next capture of the still image. The live view image is displayed on the first shooting monitor 112 from the start of shooting until the shooting of all the still images is completed.

In the present embodiment, the editing process (S14) receives an editing instruction for the target still image. Further, the target moving image can be reproduced during the editing process (S14), and the instructed editing content is reflected in each frame of the reproduced target moving image. In the following, an example of accepting the stamp pasting operation on the target still image and pasting the stamp on each frame of the target moving image will be described.

FIG. 7 is a screen view of the edit screen.
FIG. 7 shows an edit screen for the left user to operate. On the right side, an edit screen for the right user to operate is displayed. The edit screen for the right user to operate is omitted, but the same layout as this figure accepts the user operation and displays the target still image. Hereinafter, user X is shown on the left side of the target still image, user Y is shown on the right side, user X is facing the left editing screen shown in FIG. 7, and user Y is facing the right editing screen (not shown). It is assumed that

In this example, it is assumed that five captured still images are acquired. The image tabs 300a to 300e (hereinafter, collectively referred to as "image tabs 300" when collectively referred to or not particularly distinguished) correspond to pre-corrected captured still images. When the user touches any of the image tabs 300, the captured still image corresponding to the touched image tab 300 is displayed as the target still image in the image display area 302.

The stamp palette 304 is used to select a stamp that the user wants to paste on the target still image. The face stamp button 306a and the face stamp button 306b correspond to a type of stamp to be attached to the face. Hereinafter, this type of stamp is referred to as a "face stamp". The face stamp button 306a represents a stamp of "raccoon dog nose and beard". The face stamp button 306b represents a stamp of "raccoon dog ears". When the stamp image of "Tsumugi nose and whiskers" is pasted on the face of the target still image with the face stamp button 306a, the same "Tsumugi nose and whiskers" stamp is displayed on the face when the target moving image is played back. NS. Similarly, when the stamp of "Tsumugi ears" is pasted on the face of the target still image with the face stamp button 306b, the same "Tsumugi ears" stamp image is displayed on the face when the target moving image is played back. .. Then, the face stamp follows the user's face included in the target moving image.

The change stamp button 308, the change stamp button 310, and the change stamp button 312 are arranged at an arbitrary place on the target still image, and correspond to a type of stamp whose display mode changes at that place in the reproduction of the target moving image. Hereinafter, this type of stamp is referred to as a "change stamp". The display mode of the stamp image corresponding to the change stamp button 308, the change stamp button 310, and the change stamp button 312 will be described later in relation to FIG.

When the user touches the moving image start button 320, the target moving image for about 3 seconds corresponding to the target still image is reproduced and displayed. The stamp placed on the target still image is also added to the target moving image. The seek bar 322 indicates a reproduced portion of the target moving image.

The user's face included in the target still image is extracted by the face recognition process. In the face recognition process, it is also possible to obtain facial feature data and identify an individual. A face ID for identifying an individual is assigned to the extracted face.

The face stamp in the target moving image follows the face. That is, the position, inclination and size of the face stamp are determined by the relative relationship with the face. For example, if the stamp of "raccoon nose and beard" is placed close to the center of the face in the target still image, the stamp of "raccoon nose and beard" is placed close to the center of the face in the target moving image. Attached. On the contrary, if the stamp image of "Tsumugi nose and whiskers" is placed closer to the mouth, the stamp image of "Tsumugi nose and whiskers" will be pasted closer to the mouth even in the target moving image. Be done.

In the process, in order to specify the relative relationship with the face in the target still image, information about the face included in the target still image (hereinafter, referred to as “primary face information”) is generated. In this example, the primary face information of the user X and the primary face information of the user Y are generated. The parameters specified in the target still image are expressed as "primary" in the sense of "basic". In this figure, the primary face tilt angle, the primary face size, and the primary face center position of the user X are shown.

The primary face tilt angle indicates the tilt of the user's face in the target still image. In this example, the angle formed by the center line connecting the midpoints of both eyes and the center point of the mouth with the vertical direction of the target still image is obtained and used as the primary face tilt angle. The positions of the user's eyes and mouth are specified by the face recognition process. The primary face size is the size of the user's face in the target still image. In this example, it is assumed that the primary face size is indicated by the distance between the eyes. In addition, the width of the head, the length of the head, or the area of the face area may be used as the primary face size. The primary face center position is the position of the center of the face in the target still image. In this example, the point where the line segment connecting the midpoint of both eyes and the center point of the mouth is divided by a predetermined ratio is set as the primary face center position. In this example, the ratio of the distance between the midpoint of both eyes and the center position of the primary face and the distance between the center point of the mouth and the center position of the primary face is 1: 3. The structure of the primary face information will be described later in relation to FIG.

8 (A) to 8 (C) are diagrams showing an example of a change stamp image. In each case, a part of the continuous stamp images is excerpted and shown.

FIG. 8A shows a change stamp image of a cloud figure corresponding to the change stamp button 308.
The cloud figure pasted on the target still image does not change, but the cloud figure automatically pasted on the target moving image repeatedly expands and contracts as shown in the figure. However, the position of the cloud figure does not move. As a process, the enlarged cloud figure is sequentially superimposed on the frame of the target moving image while increasing the magnification step by step. After reaching the maximum magnification, the magnification is gradually reduced, and the cloud figures are similarly superimposed on the frame in sequence. Even after the enlargement ratio becomes 1, the magnification is gradually reduced and the reduced cloud figures are sequentially superimposed on the frame. After reaching the minimum magnification, the cloud figures are similarly superimposed on the frame while increasing the magnification step by step. By repeating this process, expansion and contraction are repeated. The displayed stamp image is changed by repeatedly enlarging and reducing the original stamp image. A change stamp image that performs such processing is called a "scale type". The scaling type change stamp image is not limited to the cloud figure, and may be another figure. In the scaling type, a predetermined magnification column corresponds to a moving image pattern.

FIG. 8B shows a change stamp image of the heart shape corresponding to the change stamp button 310.
The heart figure pasted on the target still image does not change, but the heart figure automatically pasted on the target moving image repeatedly tilts to the right and to the left as shown in the figure. However, the position of the heart figure does not move. As a process, the heart figures tilted at a positive angle are sequentially superimposed on the frame of the target moving image while the tilt angle is gradually increased. In this example, clockwise is the positive orientation. After reaching the maximum tilt angle, the tilt angle is gradually reduced, and the heart figures are sequentially superimposed on the frame in the same manner. Even after the tilt angle becomes 0, the tilt angle is gradually reduced, and the heart figures tilted at a negative angle are sequentially superimposed on the frame. After reaching the minimum tilt angle, the heart figures are sequentially superimposed on the frame while gradually increasing the tilt angle. By repeating this process, the shaking from side to side is repeated. A change stamp image that performs such processing is called a "rotation type". The rotation type change stamp image is not limited to the heart figure, and may be another figure. In the rotation type, a predetermined sequence of tilt angles corresponds to a moving image pattern.

In the scaling type and the rotation type, one stamp image is changed and displayed by image processing. On the other hand, in the animation type described below, a plurality of stamp images are prepared in advance, and the stamp images are changed by sequentially displaying them as animation frame images.

FIG. 8C shows a change stamp image of the cracker corresponding to the change stamp button 312.
The illustration of the cracker pasted on the target still image does not change, but the cracker automatically pasted on the target moving image changes by animation as shown. In this example, a cracker with a string pops off, and paper tape and confetti are scattered. However, the position of the cracker illustration does not move. The animation can be processed by the existing method. That is, a plurality of frame images are sequentially superimposed on the frame of the target moving image. In the animation type, a plurality of stamp images provided in advance correspond to a moving image pattern. As the image to be displayed on the change stamp button 312, one of a plurality of stamp images may be used.

FIG. 9 is a diagram showing an example of attaching a face stamp to the target still image.
In this example, it is assumed that the user X selects the change stamp button 308, then touches the background area of the image display area 302, and pastes the change stamp of the cloud figure. Further, it is assumed that the user X selects the face stamp button 306a and then touches the face of the user X in the image display area 302 to attach the face stamp of "raccoon dog nose and beard".

In both the change stamp pasting and the face stamp pasting, the pasting position can be adjusted by the slide operation. Specifically, the last touch position among the continuous touch positions, that is, the release position is the stamp position. Then, the stamp image is pasted so as to overlap the stamp reference point at the stamp position.

In this example, the user X slides the stylus pen 122 to move the face stamp image, and separates the stylus pen 122 from the touch panel 222 at the nose tip of the face. Therefore, the tip of the nose is the stamp position. Hereinafter, the position of the face stamp in the target still image is referred to as "primary face stamp position".

The face stamp is placed at the position of the primary face stamp so that the reference point of the face stamp overlaps. Hereinafter, the reference point of the face stamp is referred to as a "face stamp reference point". In the face stamp of "raccoon dog nose and beard", the center point of the nose is the face stamp reference point. Further, in the face stamp image, the vertical line passing through the face stamp reference point is referred to as a "face stamp center line".

The angle of the face stamp image is corrected according to the inclination of the user's face in the image. Specifically, the face stamp image is rotated by the primary face tilt angle. The tilt angle of the face stamp placed on the target still image is called the "primary face stamp tilt angle". The tilt angle of the primary face stamp is an angle formed by the center line of the arranged face stamp in the vertical direction of the target still image. The tilt angle of the primary face stamp coincides with the tilt angle of the primary face. In this example, since the user X is tilting his face to the right, the stamp image of "raccoon dog nose and beard" is rotated clockwise accordingly.

The size of the face stamp image is also corrected according to the size of the user's face in the image. That is, when the user approaches the camera and the face appears large, the face stamp image is automatically enlarged. On the contrary, when the user is far from the camera and the face is small, the face stamp image is automatically reduced. The face stamp image is prepared in a size suitable for the standard face size, so if the user's face size included in the target still image is the same as the standard face size, the face stamp image is used as the original. Use the size as it is. On the other hand, when the user's face size is different from the standard face size, the face stamp image is enlarged or reduced according to the ratio. The magnification at this time is called "primary face stamp magnification". The primary face stamp magnification is a value obtained by dividing the user's face size by the reference face size. In this example, since the face size of the user X in the image is the same as the reference face size, the magnification of the face stamp image is 1, and neither enlargement nor reduction is performed.

In addition, when the face stamp is attached to the target still image, it is also determined where on the face the face stamp is attached. In this example, the relative positional relationship between the user face and the face stamp is specified by the vector in the face. Specifically, the first-order relative vector from the center position of the primary face to the stamp position of the primary face is obtained. In this example, the position of the nose tip of the user X is specified with reference to the center of the face of the user X. The direction of the first-order relative vector does not always coincide with the direction of the center line of the face. For example, when a national flag stamp is attached to the cheek, the linear relative vector faces the direction to which the national flag is attached. In this way, by specifying the relative position with the first-order relative vector, the face stamp can be attached to any place in the face. This first-order relative vector is used to calculate the position of the face stamp image superimposed on the target moving image.

The primary face stamp position, the primary face stamp tilt angle, the primary face stamp magnification and the primary relative vector are included in the primary face stamp information. The structure of the primary face stamp information will be described later in relation to FIG.

The position of the change stamp of the cloud figure is included in the change stamp information. Hereinafter, the position of the change stamp is referred to as "change stamp position". The structure of the change stamp information will be described later in relation to FIG. Next, a case where the captured moving image is reproduced will be described.

FIG. 10 is a diagram showing an example of a first frame of a captured moving image.
Here, an example of the first frame is shown, but the second and subsequent frames are processed in the same manner. The user's face included in the frame of the captured moving image is extracted by the face recognition process. In addition, the corresponding face ID is specified by the face feature data obtained by the face recognition process. Therefore, it is possible to associate the face included in the target still image with the face included in the frame of the captured moving image. The positions of the user's eyes and mouth are also specified by the face recognition process.

In order to specify the relative relationship with the face in the frame of the target moving image, information about the face included in the frame of the target moving image (hereinafter, referred to as “secondary face information”) is generated. In this example, the secondary face information of the user X and the secondary face information of the user Y are generated. The parameter specified in the frame of the target moving image is expressed as "secondary" in the sense of "reflected".

The secondary face tilt angle indicates the tilt of the user's face in the frame of the target moving image. The secondary face size is the size of the user's face in the frame of the target moving image. The secondary face center position is the position of the center of the face in the frame of the target moving image. The method of obtaining the secondary face tilt angle, the secondary face size, and the secondary face center position is the same as in the case of the primary face tilt angle, the primary face size, and the primary face center position.

The secondary face information and the primary face information are compared using the user X as an example. User X was approaching the camera at the start of shooting the target moving image. After that, it goes back to the standard position. Therefore, the secondary face size is larger than the primary face size. Specifically, the eye spacing in the frame of the target moving image is longer than the eye spacing in the target still image. Further, the secondary face center position is detected below the primary face center position in the image. The face of the user X at the start of shooting the target moving image is tilted opposite to the time when the target still image is shot. Therefore, the primary face tilt angle is a positive angle, while the secondary face tilt angle is a negative angle. The structure of the secondary face information will be described later in relation to FIG.

FIG. 11 is a diagram showing an example of attaching a face stamp to the first frame of a captured moving image.
A face stamp is automatically attached to the frame of the shooting moving image. In this example, the stamp image of "raccoon dog nose and whiskers" is arranged with reference to the nose tip of user X. The size and tilt of the stamp image are also matched to the face in the frame of the captured moving image. That is, the stamp image is automatically enlarged and drawn in a state of being tilted to the left. Since the second and subsequent frames are processed in the same manner, the positional relationship between the "raccoon dog nose and beard" stamp and the face is not broken, and the moving image is played as if the user X dressed as a raccoon dog.

Here, the process of automatically pasting the face stamp will be described in detail. The position of the face stamp in the frame of the captured moving image is called the "secondary face stamp position". The secondary face stamp position is obtained by adding a quadratic relative vector to the coordinates of the secondary face center position. The quadratic relative vector is obtained by modifying the same person's linear relative vector (see FIG. 9). Specifically, the direction and size of the vector are corrected.

Regarding the correction of the direction of the vector, the primary relative vector (see FIG. 9) is rotated by the angle of the difference obtained by subtracting the primary face tilt angle (see FIG. 7) from the secondary face tilt angle (see FIG. 10). In this example, the secondary face tilt angle (see FIG. 10) of the user X is a negative angle, and the primary face tilt angle (see FIG. 7) is also a positive angle, so that the difference angle is negative. As a result, the first-order relative vector (see FIG. 9) is rotated counterclockwise, and the direction of the second-order relative vector (see FIG. 11) is determined.

Regarding the correction of the size of the vector, the change in face size is used as a reference. Since the size of the vector is proportional to the face size, the size of the secondary relative vector is determined by multiplying the primary relative vector by the face size ratio (= secondary face size / primary face size). In this example, the secondary face size of user X (see FIG. 10) is approximately 1.5 times the primary face size (see FIG. 7), so the size of the secondary relative vector (see FIG. 11) is the primary relative vector. It is about 1.5 times that of (see FIG. 9). In this way, the frame portion of the captured moving image corresponding to an arbitrary portion in the face in the target still image can be specified by the secondary face center position (see FIG. 10) and the secondary relative vector (see FIG. 11). ..

The magnification of the face stamp image in the frame of the shooting moving image is called "secondary face stamp magnification". The secondary face stamp magnification is obtained as a value obtained by dividing the face size in the frame of the captured moving image by the reference face size. In this example, the secondary face stamp magnification of user X is about 1.5 times, and the original face stamp image is enlarged to about 1.5 times and used.

By rotating the enlarged face stamp image by the secondary face tilt angle and arranging the enlarged face stamp image so as to align the face stamp reference point with the secondary face stamp position, as shown in FIG. A stamp image of "nose and whiskers" is displayed.

The above-mentioned secondary face stamp position, secondary face stamp tilt angle, secondary face stamp magnification, and secondary relative vector are included in the secondary face stamp information. The structure of the secondary face stamp information will be described later in relation to FIG.

Further, the change stamp image of the cloud figure is enlarged or reduced at a predetermined magnification for each frame and displayed at a predetermined change stamp position. Although not shown in this example, in the case of the rotation type, for example, the change stamp image of the heart figure is rotated at a predetermined tilt angle for each frame and displayed at a predetermined change stamp position. In the case of the animation type, for example, a plurality of prepared cracker change stamp images are displayed in the order of frames.

FIG. 12 is a structural diagram of primary face information.
The primary face information regarding the face of the user X shown on the left side of the target still image of FIG. 7 and the face of the user Y shown on the right side is shown. The first record relates to the face of user X and the second record relates to the face of user Y. The face ID "F1" identifies the face of user X, and the face ID "F2" identifies the face of user Y. For each record, the primary face center position, the primary face tilt angle, and the primary face size of the user X and the user Y are set.

FIG. 13 is a structural diagram of the primary face stamp information.
The primary face stamp information about the face stamp of "raccoon dog nose and beard" of FIG. 9 is shown. The face ID "F1" identifies the face to which the face stamp is affixed. The face stamp ID "S101" identifies the pasted face stamp. The primary face stamp position, the primary face stamp tilt angle, the primary face stamp magnification, and the primary relative vector are as described above in relation to FIG. When a plurality of face stamps are pasted, a record corresponding to each face stamp is provided. For example, when a stamp image of "raccoon ears" is pasted on the face of user Y, a record whose face ID is "F2" and whose face stamp ID is "S102" that identifies "raccoon ears". Is added.

The primary face stamp tilt angle and primary face stamp magnification are also used to draw the face stamp on the slide. These primary face stamp tilt angles and primary face stamp magnifications are called "primary adjustment parameters".

FIG. 14 is a structural diagram of secondary face information.
Secondary face information regarding the face of user X shown in the lower left of the target moving image of FIG. 10 and the face of user Y shown in the right side is shown. The first record relates to the face of user X and the second record relates to the face of user Y. The face ID "F1" identifies the face of user X, and the face ID "F2" identifies the face of user Y. For each record, the secondary face center position, the secondary face tilt angle, and the secondary face size of the user X and the user Y are set. The secondary face information is generated for each frame.

FIG. 15 is a structural diagram of secondary face stamp information.
The secondary face stamp information regarding the face stamp of "raccoon dog nose and beard" of FIG. 11 is shown. The face ID "F1" specifies the face to which the face stamp is attached. The face stamp ID "S101" specifies the face stamp to be attached. The secondary face stamp position, the secondary face stamp tilt angle, the secondary face stamp magnification, and the secondary relative vector are as described above in relation to FIG. When a plurality of face stamps are pasted, a record corresponding to each face stamp is provided. For example, when a stamp image of "raccoon ears" is pasted on the face of user Y, a record whose face ID is "F2" and whose face stamp ID is "S102" that identifies "raccoon ears". Is added.

FIG. 16 is a structural diagram of change stamp information.
The change stamp information regarding the change stamp of the cloud figure of FIGS. 9 and 11 is shown. The change stamp ID "S201" specifies the change stamp of the pasted cloud figure. The change stamp position is as described above in connection with FIG.

FIG. 17 is a functional block diagram of the game image capturing device.
Each component of the game image capturing device 100 includes a CPU (Central Processing Unit), a computing unit such as various coprocessors, a storage device such as a memory and a storage device, hardware including a wired or wireless communication line connecting them, and storage. It is realized by software that is stored in the device and supplies processing instructions to the arithmetic unit. A computer program may be composed of a device driver, an operating system, various application programs located on the upper layers thereof, and a library that provides common functions to these programs.
As described above, the game image capturing device 100 is configured as an aggregate of the photographing device 128, the receiving device 102, the editing device 126, and the printing device 110. Each block described below shows a block for each function, not a configuration for each hardware.

The game image capturing device 100 includes a user interface processing unit 130, a data processing unit 132, a communication unit 134, and a data storage unit 136.
The user interface processing unit 130 is in charge of user interface processing via the reception monitor 108, the editing monitor 120, and the like. The communication unit 134 is in charge of communication processing with the server 202 via the Internet 204. The communication unit 134 may directly communicate with the user terminal 206 by short-range wireless communication. For example, the target image may be directly transmitted from the communication unit 134 to the user terminal 206. The data storage unit 136 stores various data. The data processing unit 132 executes various processes based on the data acquired by the communication unit 134 and the data stored in the data storage unit 136. The data processing unit 132 also functions as an interface for the user interface processing unit 130, the communication unit 134, and the data storage unit 136.

The user interface processing unit 130 includes an input unit 140 that accepts operation input by the user, an output unit 142 that presents information to the user, and a photographing unit 138 (camera 118) that acquires a captured image. The input unit 140 detects the user's operation input to the touch panel installed on the reception device 102, the photographing device 128, the editing device 126, and the like. The input unit 140 also detects the operation input by the stylus pen 122. The output unit 142 executes various output processes such as audio output and print output in addition to displaying images on the reception device 102, the photographing device 128, the editing device 126, and the like.

The input unit 140 includes a reception unit 158. The reception unit 158 accepts a user operation in the editing process.

The output unit 142 includes an image output unit 170. The image output unit 170 displays the captured still image as the target still image on the editing monitor 120, and further displays the captured moving image as the target moving image on the editing monitor 120.

The data processing unit 132 includes a shooting control unit 144, an editing processing unit 146, a reception management unit 148, and a printing processing unit 150.
The shooting control unit 144 controls the shooting process in the shooting booth 104. The shooting control unit 144 notifies the user of the shooting timing at the shooting booth 104. Assuming that the shooting timing is time t1, the shooting control unit 144 records a moving image (hereinafter referred to as "first half moving image") from 1.5 seconds to 0.1 seconds before time t1 and shoots at time t1. A still image is acquired, and a moving image (hereinafter referred to as "second half moving image") is recorded again from 0.1 second to 1.5 seconds after time t1. The shooting control unit 144 generates a shooting moving image by connecting the first half moving image and the second half moving image. The shooting control unit 144 controls the shooting unit 138 by transmitting a shooting start instruction and a shooting stop instruction to the shooting unit 138. Further, the photographing control unit 144 causes the strobes 119a and 119b to emit light when the photographed still image is acquired. Since the shooting moving image does not include the acquisition period of the shot still image, in other words, the moving image at the time of strobe light emission, the strobe light emission is not reflected.

The editing processing unit 146 decorates the target still image and the target moving image according to the operation input from the user. The editing processing unit 146 includes an arrangement specifying unit 152 and a moving image processing unit 154. The arrangement specifying unit 152 specifies the arrangement of the stamp image. The moving image processing unit 154 performs a process of pasting the stamp image on the target moving image.

The reception management unit 148 manages the payment of the play fee and the reservation order by the user in the reception device 102. The reception management unit 148 guides the reserved user to the shooting booth 104 every time the shooting work is completed at the shooting booth 104. The print processing unit 150 controls printing of the target still image in the printing device 110.

The data storage unit 136 includes a stamp data storage unit 174, a photographed image storage unit 180, a primary face information storage unit 182, a primary face stamp information storage unit 184, a secondary face information storage unit 186, and a secondary face stamp information storage unit 188. include.
The stamp data storage unit 174 stores stamp definition data (not shown), stamp image data, moving image pattern data, and the like that associate the stamp ID with the stamp name and the stamp type. The captured image storage unit 180 stores the captured still image and the captured moving image in association with each other. The primary face information storage unit 182 stores the primary face information (FIG. 12). The primary face stamp information storage unit 184 stores the primary face stamp information (FIG. 13). The secondary face information storage unit 186 stores the secondary face information (FIG. 14). The secondary face stamp information storage unit 188 stores the secondary face stamp information (FIG. 15).

18 and 19 are flowcharts showing the editing process.
When the reception unit 160 receives the touch of any of the image tabs 300 (Y in S10), the image output unit 170 displays the captured still image corresponding to the touched image tab 300 as the target still image. It is displayed in the area 302 (S12). Then, the arrangement specifying unit 152 generates the primary face information (FIG. 12) (S14). The process of generating the primary face information will be described later in relation to FIG. When the process of generating the primary face information is completed, the process returns to the process of S10. On the other hand, in the route N of S10, the process proceeds to the process of S16.

When the reception unit 160 accepts the touch of any of the stamp buttons (Y in S16), the reception unit 160 identifies the stamp ID corresponding to the touched stamp button (S18) and returns to the process of S10. .. On the other hand, in the route N of S16, the process proceeds to the process of S20.

When the reception unit 160 accepts the face stamp pasting operation (Y in S20), the arrangement specifying unit 152 specifies the primary adjustment parameter (S22). The process of specifying the primary adjustment parameter will be described later in relation to FIG.

The image output unit 170 displays the face stamp image during the slide (S24). Specifically, while the slide operation continues, the face stamp reference point is aligned with the new touch position, and the face stamp image is displayed again.

When the slide operation is completed, the arrangement specifying unit 152 generates the primary face stamp information (FIG. 13) (S26). The process of generating the primary face stamp information will be described later in relation to FIG. 22. When the process of generating the primary face stamp information is completed, the process returns to the process of S10. On the other hand, in the route N of S20, the process proceeds to the process of S28 shown in FIG.

The description of FIG. 19 will be resumed. When the reception unit 160 accepts the change stamp pasting operation (Y in S28), the image output unit 170 displays the change stamp image in the slide (S30). That is, the change stamp image is displayed again according to the sliding touch position. When the slide operation is completed, the arrangement specifying unit 152 generates change stamp information (FIG. 16) (S32). When the process of generating the change stamp information is completed, the process returns to the process of S10 shown in FIG. On the other hand, in the route N of S28, the process proceeds to the process of S34.

When the reception unit 160 receives the touch of the moving image start button 320 (Y in S34), the editing processing unit 146 displays the shooting moving image (S36). The display processing of the captured moving image will be described later in relation to FIG. 23. When the display processing of the captured moving image is completed, the process returns to the processing of S10 shown in FIG. On the other hand, in the route N of S34, the process proceeds to the process of S38.

When the editing time elapses and the timeout occurs, the editing process ends (Y of 38). On the other hand, if the editing time has not passed yet (N of 38), the process returns to the process of S10 shown in FIG.

FIG. 20 is a flowchart showing a process of generating primary face information.
The arrangement specifying unit 152 extracts the face image included in the target still image (FIG. 7) (S40). The face image in the target still image is called a "primary face image". Specifically, the face recognition process is performed as described above. In FIG. 7, the face images of the user X on the left side and the user Y on the right side are extracted.

The arrangement specifying unit 152 repeats the process for each primary face image (S42). In this example, the face image of the user X and the face image of the user Y are processed twice. The arrangement specifying unit 152 calculates the primary face center position, the primary face tilt angle, and the primary face size (S44 to S48). When all the primary face images are processed (Y in S50), the process returns to the processing in S10 shown in FIG. If there is a primary face image that has not been processed yet (N in S50), the process returns to S40.

FIG. 21 is a flowchart showing a process for specifying the primary adjustment parameter.
The arrangement specifying unit 152 determines the face ID of the face image including the touch position (S60). For example, if the face of the user X on the left is touched in the example of FIG. 9, the ID "F1" of the user X is specified. The arrangement specifying unit 152 sets the primary face tilt angle corresponding to the specified user ID as the primary face stamp tilt angle (S62). In other words, if the face stamp of "Tsumugi nose and whiskers" is selected and the face of user X is touched, the tilt angle of "Tsumugi nose and whiskers" matches the tilt angle of user X's face in the target still image. Let me. The arrangement specifying unit 152 calculates the primary face stamp magnification based on the primary face size (S64). Specifically, the primary face stamp magnification can be obtained by dividing the primary face size by the reference size. The process proceeds to S24.

FIG. 22 is a flowchart showing a process of generating primary face stamp information.
The arrangement specifying unit 152 sets the slide end position as the primary face stamp position (S70). The arrangement specifying unit 152 stores the tilt angle of the primary face stamp (S72). The arrangement specifying unit 152 stores the primary face stamp magnification (S74). The arrangement specifying unit 152 calculates a first-order relative vector (S76). The primary relative vector is obtained by subtracting the coordinates of the primary face center position from the coordinates of the primary face stamp position. Then, the process proceeds to S10.

FIG. 23 is a flowchart showing the display processing process of the photographed moving image.
The moving image processing unit 154 sequentially acquires frames of the captured moving image (S80). The moving image processing unit 154 generates secondary face stamp information (FIG. 15) (S82). The process of generating the secondary face stamp information will be described later in relation to FIGS. 24 and 25. When the process of generating the secondary face stamp information is completed, the process proceeds to the process of S84.

The moving image processing unit 154 identifies the change stamp image (S84). The process of specifying the change stamp image will be described later in relation to FIG. When the process of specifying the change stamp image is completed, the process returns to the process of S86.

The moving image processing unit 154 displays an image of the frame and each stamp (S86). Specifically, the frame of the shooting moving image is drawn on the lower layer, the face stamp image is drawn on the intermediate layer, the change stamp image is drawn on the upper layer, and the composite image obtained by layer composition is displayed. ..

The moving image processing unit 154 returns to S80 if there is a next frame (N in S88). On the other hand, when all the frames are processed (Y in S88), the process returns to the processing in S10 shown in FIG.

24 and 25 are flowcharts showing a process of generating secondary face stamp information. The moving image processing unit 154 extracts a face image included in the frame (FIG. 11) of the target moving image (S90). The face image in the frame of the target moving image is called a "secondary face image". Specifically, the face recognition process is performed as described above. For the second and subsequent frames of the moving image, the face image may be extracted by the process of tracking the face. In FIG. 11, the face images of the user X on the lower left and the user Y on the right are extracted.

The moving image processing unit 154 repeats the processing for each secondary face image (S92). In this example, the face image of the user X and the face image of the user Y are processed twice. The moving image processing unit 154 identifies the face ID of the secondary face image based on the feature data of the face (S94). The moving image processing unit 154 calculates the secondary face center position, the secondary face tilt angle, and the secondary face size (S96 to S100). When all the secondary face images are processed (Y in S102), the process proceeds to the process of S104 shown in FIG. If there is a secondary face image that has not been processed yet (N in S102), the process returns to S92.

The description of FIG. 25 will be resumed. The moving image processing unit 154 repeats the processing for each face stamp (S104). Specifically, the following processing is performed for each record of the primary face stamp information. If there is no record in the primary face stamp information, that is, if the face stamp is not pasted, the following processing is not performed. The moving image processing unit 154 determines the face ID corresponding to the face stamp (S106). Specifically, the face ID in the record of the primary face stamp information is read. The moving image processing unit 154 calculates the secondary relative vector, the secondary face stamp position, the secondary face stamp tilt angle, and the secondary face stamp magnification with reference to the primary face information and the secondary face information corresponding to the face ID. (S108 to S114). When all the face stamps are processed (Y in S116), the process returns to the processing of S84 shown in FIG. 23. If there is a face stamp that has not been processed yet (N in S116), the process returns to S104.

FIG. 26 is a flowchart showing a process of specifying the change stamp image. When the pasted change stamp is a scaling type (Y in S120), the moving image processing unit 154 specifies a magnification corresponding to the frame order (S122), and determines the size of the stamp image according to the magnification. Change (S124). When the pasted change stamp is a rotation type (Y in S126), the moving image processing unit 154 specifies an inclination angle corresponding to the order of the frames (S128). The stamp image is rotated according to the tilt angle (S130). When the pasted change stamp is an animation type (Y in S132), the moving image processing unit 154 specifies a frame image corresponding to the order of the frames (S134). If a plurality of change stamps are pasted, this process is performed for each change stamp. If the change stamp is not pasted, this process is not performed.

[Modification 1]
In the present embodiment, the position of the change stamp in the target moving image is fixed, but the position of the change stamp in the target moving image may be changed. Like the face stamp, it may follow the face.

Alternatively, the relative positional relationship with each face of a plurality of users may be maintained. For example, when a heart-shaped change stamp is pasted between user X and user Y, a heart-shaped change stamp is automatically pasted between user X and user Y in each frame of the target moving image. It may be attached.

FIG. 27 is a diagram showing an example of attaching a change stamp to the target still image in the modified example 1.
In the target still image, a triangle is assumed in which the line segment connecting the user X's primary face center position and the user Y's primary face center position is the base and the change stamp position is the apex. The triangle assumed in the target still image is called a "first-order triangle".

After the process of S32 shown in FIG. 19, the arrangement specifying unit 152 calculates the information for specifying the linear triangle. Specifically, the length of the base, the ratio at which the foot of the perpendicular (the intersection of the base and the perpendicular) divides the base, and the height from the base to the apex are calculated. Hereinafter, the length of the base in the target still image is referred to as "primary base length". The ratio of dividing the base of the target still image is called the "primary division ratio". The height from the bottom to the top of the target still image is called the "primary height". The primary face-to-face information storage unit (not shown) included in the data storage unit 136 stores the primary base length, the primary division ratio, and the primary height as the primary face-to-face information. The primary face-to-face information is associated with the stamp ID.

FIG. 28 is a diagram showing an example of attaching a change stamp to the first frame of the captured moving image in the modified example 1.
Here, an example of the first frame is shown, but the second and subsequent frames are processed in the same manner. A triangle similar to the linear triangle assumed in the target still image is assumed. The triangle assumed in the frame of the captured moving image is called a "quadratic triangle". The line segment connecting the center position of the secondary face of the user X and the center position of the secondary face of the user Y is the base of the quadratic triangle, and the apex of the quadratic triangle is the change stamp position in the frame of the captured moving image.

After the processing of S84 shown in FIG. 23, the moving image processing unit 154 calculates the change stamp position. Specifically, the position of the point at which the line segment connecting the secondary face center position of the user X and the secondary face center position of the user Y is divided according to the primary division ratio is calculated. This point is the foot of the perpendicular in the quadratic triangle. Hereinafter, the length of the line segment connecting the secondary face center position of the user X and the secondary face center position of the user Y is referred to as "secondary base length".

Next, the slope of the perpendicular is specified. The inclination of the perpendicular line is obtained by rotating the inclination of the line segment connecting the secondary face center position of the user X and the secondary face center position of the user Y by 90 degrees. Finally, the height from the base to the apex is calculated to specify the position of the apex on the vertical line. The height from the base to the apex is obtained by multiplying the primary height by the similarity ratio. The similarity ratio is a value obtained by dividing the secondary base length by the primary base length.

In the process of S86 shown in FIG. 23, a change stamp image is drawn at the position of the apex of the quadratic triangle.

In this way, for example, the relationship between the users that the user X and the user Y are on good terms can be expressed by the stamp of the photographed moving image.

Here, an example of a change stamp is shown, but in a normal stamp that does not change, the relative positional relationship with each face of a plurality of users may be maintained. That is, the stamp of the heart figure shown in this example is not limited to the one that changes the inclination as shown in FIG. 8C, and may be the one that does not change the inclination.

[Modification 2]
In the present embodiment, an example of pasting a stamp is shown, but decorative processing other than the stamp may be reflected in the target moving image. The decorative processing other than the stamp is, for example, line drawing or particle decoration. Particle decoration is a decoration in which small pieces of images are scattered on a target still image by a slide operation. For example, place a small star in the vicinity along the trajectory of the slide.

The decoration result of the target still image may be applied to each frame of the captured moving image as it is, or the process of decoration by the slide operation may be reproduced step by step. An example of displaying the particle decoration step by step will be described below.

FIG. 29 is a screen view of the editing screen in the second modification.
When the user touches the particle button 330a included in the particle palette 328 and then touches and slides the image display area 302, the reception unit 160 accepts the touch operation and the slide operation, and the touch position is used as the reference point for drawing. , A small image is drawn near the reference point by the drawing unit (not shown). Hereinafter, the reference point for drawing is referred to as a "reference point for drawing". The broken line shows the locus of the touch position by the slide operation. At this time, the arrangement specifying unit 152 stores the locus of the touch position by the slide operation in the locus information storage unit (not shown) included in the data storage unit 136. That is, time-series drawing reference points are accumulated.

FIG. 30 is a diagram showing an example of attaching particles to the frame of the shooting moving image in the modified example 2.
Some of the consecutive frames are excerpted and shown. The moving image processing unit 154 sequentially reads the drawing reference points stored in the locus information storage unit as the frame progresses. Then, a small piece image is drawn near the drawing reference point.

In this way, if small pieces of images are scattered as the moving image progresses, a fantastic effect can be enjoyed.

Similarly, regarding line drawing, the locus of the touch position by the slide operation may be accumulated as a time-series drawing reference point, and the line may be drawn so as to extend as the moving image progresses. Since the process of drawing handwritten figures and characters is reproduced, you can enjoy looking back on how the user wrote it.

[Modification 3]
As described above, not only the graffiti performed by the user on the target still image may be reflected on the target moving image, but also the decoration applied to the face of the target still image, that is, the processing of the filling and makeup may be reflected on the target moving image. .. Heaping and makeup processing is the process of enlarging the eyes, providing teardrops, thickening the eyelashes, adding lipstick to the lips, adding blush to the cheeks, and sharpening the face line. be.

The degree of filling and makeup may be instructed by the user or may be set in advance. The filling and makeup may be performed by an automatic pre-correction process, or may be performed by an editing process according to a user's instruction. The user may instruct the degree of pre-correction and the degree of makeup (correction amount). The reception unit 160 receives the degree of filling and makeup instructed by the user. The degree of heaping and makeup includes, for example, the enlargement ratio of the eyes, the size of the tear bag, the darkness of the eyelashes, the darkness of the lipstick, the darkness of the blusher, and the degree of sharpening of the face line.

The processing itself of the filling and makeup processing performed in each frame of the target moving image is the same as in the case of the target still image. However, in the case of the target moving image, the degree of filling and makeup is weaker than that in the case of the target still image. The video processing unit 154 may, for example, reduce the enlargement ratio of the eyes, reduce the size of the tear bag, reduce the thickness of the eyelashes, lighten the lipstick color, lighten the blusher color, and the face line. After making adjustments such as reducing the degree of sharpening, the treatment of filling and makeup is performed.

Alternatively, when the pre-correction unit (not shown) performs the filling and makeup processing on each frame of the shooting moving image, the degree of filling and makeup is compared with that of the target still image as in the moving image processing section 154. It may be weakened and pre-corrected. In this way, a moving image having a weak degree of filling or makeup can be reproduced and displayed without any special processing at the stage of displaying the pre-corrected target moving image.

By weakening the degree of filling and makeup as described above, the facial expression in the target moving image becomes natural. In general, it tends to be preferred to emphasize the filling and makeup processing in the target still image. The psychological effect is different for each person, so it cannot be said unconditionally, but it is presumed that if you have big eyes like a doll and a sharp face line, you will be more adorable. However, this psychological effect presupposes that the image does not move. Since there is no movement, it seems that the desire to emphasize facial expressions and convey individuality is working. This is similar to "doll play" where you can enjoy reading anthropomorphic minds from the facial expressions of immovable dolls. Simply put, you replace yourself with a doll and satisfy your self-love as an adorable being.

On the other hand, in the case of a moving image, the person moves, so the taste is different from the way of enjoying like "doll play". Rather, the movement of the doll is a production seen in horror movies, and it may give a strange impression that the soul resides in the inorganic one. This feeling cannot be unequivocally stated because it is different for each person, but it is thought that it is easier to enjoy the video itself if the reality remains. In other words, since the viewer can easily read the subject's mind because of the movement of the person and facial expression, it can be said that it is not necessary to emphasize the height and makeup.

However, it is troublesome for the user to indicate the degree of filling and makeup processing in the target moving image separately from the degree of filling and makeup processing in the target still image. In the third modification, in consideration of this point, the filling and makeup processing are automatically weakened so that the target moving image can be enjoyed naturally.

[Other variants]
The face stamp of the present embodiment does not change, but the face stamp may be changed. The method of changing may be a scaling type, a rotation type, or an animation type. If it is an animation type, various aspects can be expressed. You can also make the raccoon's nose twitch, make the raccoon's beard bend, make it stand up, or make the raccoon's ears hang down or make it bigger. In this way, you can enjoy the fairy tale world view by imagining that the raccoon dog is masquerading as a user and that the person who is here is actually a raccoon dog.

In this embodiment and each modification, an example of a shooting moving image in which two moving images taken before and after shooting a still image are connected is shown, but the shooting moving image was taken before shooting the still image. Only the moving image may be used. Alternatively, only the moving image taken after the still image is taken may be used.

In the present embodiment and each modification, an example in which all frames of the captured moving image are decorated is shown, but only a part of the frames of the captured moving image may be decorated. For example, the decoration process may be applied only to the frame of the moving image taken before the taking of the still image. Alternatively, the decoration process may be applied only to the frame of the moving image taken after the still image is taken.

The present invention is not limited to the above-described embodiment or modification, and the components can be modified and embodied within a range that does not deviate from the gist. Various inventions may be formed by appropriately combining a plurality of components disclosed in the above embodiments and modifications. In addition, some components may be deleted from all the components shown in the above embodiments and modifications.

100 play image shooting device, 102 reception device, 104 shooting booth, 106 editing booth, 108 reception monitor, 110 printing device, 112 first shooting monitor, 114 second shooting monitor, 116 lights, 118 camera, 119 strobe, 120 editing monitor , 122 stylus pen, 124 curtain, 126 editing device, 128 shooting device, 130 user interface processing unit, 132 data processing unit, 134 communication unit, 136 data storage unit, 138 shooting unit, 140 input unit, 142 output unit, 144 shooting Processing unit, 146 Editing processing unit, 148 Reception processing unit, 150 Printing processing unit, 152 Arrangement specifying unit, 154 Video processing unit, 160 Reception unit, 170 Image output unit, 174 Stamp data storage unit, 180 Captured image storage unit, 182 Primary face information storage unit, 184 Primary face stamp information storage unit, 186 Secondary face information storage unit, 188 Secondary face stamp information storage unit, 200 Play image shooting system, 202 server, 204 Internet, 206 user terminal, 222 touch panel, 220 Display, 300 Image Tab, 302 Image Display Area, 304 Stamp Palette, 306 Face Stamp Button, 308 Change Stamp Button, 310 Change Stamp Button, 312 Change Stamp Button, 320 Video Start Button, 322 Seek Bar, 328 Particle Palette, 330 Particles button

Claims (4)

A shooting unit that shoots a still image of the user and also shoots and records a moving image of the user at least one of before and after shooting the still image.
A reception section that accepts instructions to paste additional images on shot still images,
According to the instruction to paste the additional image, a specific unit for specifying the pasting position of the additional image in the captured still image, and a specific unit.
A moving image processing unit that attaches the additional image to a plurality of frame images included in the recorded recorded moving image based on the pasting position, and a moving image processing unit.
Have a communication unit for transmitting the captured videos pasted the additional image,
The specific unit specifies the relative position of the additional image with respect to the user's face in the captured still image as the pasting position.
The moving image processing unit determines the pasting position of the additional image with reference to the relative position of the user with respect to the face for each of the plurality of frame images of the captured moving image, and the additional image is used as the user in the captured moving image. A game image capturing device characterized by following the movement of the face. A shooting unit that shoots a still image of the user and also shoots and records a moving image of the user at least one of before and after shooting the still image.
A reception section that accepts instructions to paste additional images on shot still images,
According to the instruction to paste the additional image, a specific unit for specifying the pasting position of the additional image in the captured still image, and a specific unit.
A moving image processing unit that attaches the additional image to a plurality of frame images included in the recorded recorded moving image based on the pasting position, and a moving image processing unit.
Have a communication unit for transmitting the captured videos pasted the additional image,
The shooting unit shoots a still image of a plurality of users, and also shoots a moving image of the plurality of users at least one of before and after shooting the still image.
The specific unit identifies the relative relationship between each face of the plurality of users and the additional image in the captured still image.
The moving image processing unit is a game image capturing device, characterized in that the additional image is attached to each frame image of the captured moving image at a position that maintains the relative relationship with each face of the plurality of users. A function of shooting a still image of a user and shooting and recording a moving image of the user at least one of before and after shooting the still image.
A function that accepts instructions for pasting additional images on captured still images,
A specific function for specifying the pasting position of the additional image in the captured still image according to the instruction for pasting the additional image, and
A video processing function for pasting the additional image to a plurality of frame images included in the recorded video recording based on the pasting position, and
The information processing device is made to demonstrate the function of transmitting the captured video with the additional image pasted .
In the specific function, as the pasting position, the relative position of the additional image with respect to the user's face in the captured still image is specified.
In the moving image processing function, for each of the plurality of frame images of the captured moving image, the attachment position of the additional image is determined based on the relative position of the user with respect to the face, and the additional image is used as the user in the captured moving image. A program characterized by following the movement of the face. With taking a user of a still image, by capturing at least one of the user's video out after shooting and before photographing of the still image, a photographing function for recording,
A function that accepts instructions for pasting additional images on captured still images,
A specific function for specifying the pasting position of the additional image in the captured still image according to the instruction for pasting the additional image, and
A video processing function for pasting the additional image to a plurality of frame images included in the recorded video recording based on the pasting position, and
The information processing device is made to demonstrate the function of transmitting the captured video with the additional image pasted .
In the shooting function, a still image of a plurality of users is shot, and at least one of the moving images of the plurality of users before and after shooting the still image is shot.
In the specific function, the relative relationship between each face of the plurality of users and the additional image in the captured still image is specified.
A program characterized in that, in the moving image processing function, the additional image is attached to each frame image of the captured moving image at a position where the relative relationship with each face of the plurality of users is maintained.

Images