JP2022141418A - Animation data creation device and method - Google Patents

Abstract

To create picture-book-like animations in which images of people provided by users move.SOLUTION: An animation data creation device includes: a storage unit that stores format data including a background image and character motion information for each of a plurality of scenes of a work; an image processing unit that receives a user image from a user terminal, cuts out a person image from the user image, animates the person image based on the motion information, synthesizes the animated person image with the background image, and generates scene edit data corresponding to each of the plurality of scenes; and a combining unit that combines multiple pieces of the scene edit data to generate work data.SELECTED DRAWING: Figure 1

Description

The present invention relates to a moving image data creation device and method.

2. Description of the Related Art Images captured by a digital camera, a smartphone, or the like are uploaded and stored on a network. Further, there is known a service for printing uploaded images to produce prints such as photo books and posters. Also, in recent years, attention has been paid to a service for creating an original picture book using uploaded images. For example, Patent Literature 1 discloses a method of creating a photobook using a picture book template.

As described above, conventionally, a picture book is produced by inserting a photographed image of a person into a predetermined area of a template. However, in a picture book, the human image embedded is a still image and does not move. There is a demand for a service that creates a picture book-like movie in which a person's image moves and sounds are emitted, rather than a picture book as a book.

Japanese Patent No. 6402515

An object of the present invention is to provide a video data creation apparatus and method for creating a picture book-like video in which a person image provided by a user moves.

A moving image data creation apparatus of the present invention includes a storage unit for storing format data including a background image and character action information for each of a plurality of scenes of a work; An image processing unit that cuts out a person image, animates the person image based on the motion information, synthesizes the animated person image with the background image, and generates scene edit data corresponding to each of the plurality of scenes. and a combining unit that combines the plurality of scene editing data to generate work data.

A moving image data creation method of the present invention includes a step of receiving a user image from a user terminal, a step of cutting out a person image from the user image, and a background image and character action information for each of a plurality of scenes of a work. referencing the format data and converting the person image into a moving image based on the motion information; synthesizing the animated person image with the background image to generate scene edit data corresponding to each of the plurality of scenes; and combining the plurality of scene editing data to generate work data.

According to the present invention, it is possible to create a picture book-like moving image in which a person image provided by a user moves.

1 is a schematic configuration diagram of a moving image data creation system according to an embodiment of the present invention; FIG. It is a figure which shows the example of a work selection screen. FIG. 10 is a diagram showing an example of an edit scene selection screen; FIG. 10 is a diagram showing an example of an edit screen; It is a figure which shows the example of an image selection screen. FIG. 11 is a diagram showing an example of a clipping range specification screen; It is a figure which shows the example of a clipping result confirmation screen. It is a figure which shows the example of an operation confirmation screen. It is a figure which shows the example of a dialog setting screen. It is a figure which shows the example of an edit result confirmation screen. FIG. 10 is a diagram showing an example of an edit scene selection screen; It is a figure which shows the example of the created work list screen. FIG. 10 is a diagram showing an example of a playback screen; FIG. It is a figure which shows the structure and functional block of a moving image data production apparatus. It is a flowchart explaining a moving image data creation method.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings.

As shown in FIG. 1, the moving image data creation system according to the embodiment of the present invention includes a user terminal 2 for uploading a person image (still image), and a moving image data creation unit for creating picture book movie movie data using the person image. a device 1; Here, the picture book movie is one in which a person image is synthesized on the background of the picture book, and the person image performs a predetermined action. In addition, the voice (dialogue) uttered by the user may be output along with the movement of the person image.

The user terminal 2 is a smart phone, a tablet terminal, a PC, or the like. The user operates the user terminal 2 to access the website provided by the moving image data creation device 1, and selects a favorite work from a plurality of picture book movie works. For example, a work selection screen as shown in FIG. 2 is displayed on the user terminal 2 .

When the user presses a selection button B1 for a work that he/she likes on the work selection screen, the user terminal 2 displays an editing scene selection screen as shown in FIG. One work is divided into multiple scenes, and each scene is edited. For example, one work includes four scenes each corresponding to the beginning, ending, and ending of a story.

When the user presses the selection button B2 of the scene to be edited on the edit scene selection screen, the user terminal 2 displays an edit screen as shown in FIG. The editing screen displays a background image G1 of the scene and a sample image C of a person image to be combined with the background image G1. Scene editing involves uploading user images and recording lines.

When the user presses the photo selection button B3 on the editing screen, an image selection screen as shown in FIG. 5 is displayed, and images saved in the user terminal 2 are listed. From the sample image C, the user determines what kind of person image should be uploaded. For example, if the sample image C is the whole body from head to feet, the user uploads a user image showing the whole body. When the user selects a user image that matches the scene from the image list and presses the determination button B5, the selected image is uploaded to the moving image data creation device 1. FIG.

If there is no suitable image in the image list, a new photograph may be taken and the photographed image may be uploaded. In this case, the user presses the new shooting button B6 on the editing screen. As a result, the built-in camera of the user terminal 2 is activated, and photography can be performed. When photographing is performed, a photographed image (user image) is uploaded to the moving image data creation apparatus 1 .

After uploading the user image, the user terminal 2 displays a clipping range specification screen as shown in FIG. The user designates a clipping range 3 of a person to be clipped from the uploaded image G2. If you want to specify the clipping range 3 again, press the clear button B7 to reset the clipping range 3.

For example, if the uploaded image contains a plurality of persons, the user sets the clipping range 3 to the persons he/she wants to use in the picture book movie. After specifying the clipping range 3, the user presses the decision button B8.

When the decision button B8 is pressed, the moving image data creation device 1 cuts out the person image from the specified cutout range 3. For example, the face, torso, arm, and leg regions of a person are recognized and cropped. A portion corresponding to the sample image C (see FIG. 4) is clipped. Parts other than the person are deleted (transparent). Since the clipping range is specified by the user, the load of clipping/extracting the person image is reduced.

After the clipping process, a clipping result confirmation screen as shown in FIG. 7 is displayed on the user terminal 2 . If there is no problem with the clipped person image G3, the user presses the approval button B10. The cutout range may be specified again by pressing the return button B9.

When the approval button B10 is pressed, the user terminal 2 displays an operation confirmation screen for a person image as shown in FIG. The moving image data creation device 1 transcribes a predetermined motion to the clipped person image (still image) to create a moving image (animation). As a result, the limbs of the clipped image of the person move and walk, or the facial expression changes. The moving image data creation device 1 synthesizes the moving image of the person with the background. If there is no problem with the operation, the user presses the approval button B12.

When the approval button B12 is pressed, the screen returns to the editing screen shown in FIG. When the user presses the dialogue setting button B4, the user terminal 2 displays a dialogue setting screen as shown in FIG.

The dialog of this scene is displayed on the dialog setting screen. When the user presses the record button B13, the microphone function of the user terminal 2 is activated and recording is performed. The user reads out the displayed lines. The audio data is uploaded to the moving image data creation device 1 .

If the user's own voice is not used, a default voice pre-recorded by a voice actor or the like can be set by pressing the default voice setting button B14.

After clipping of the person's image and recording of lines are performed, an editing result confirmation screen as shown in FIG. 10 is displayed. When the user presses the play button 16, the person image is activated and the voice of the dialogue is output. When the user presses the save button B18, the result of scene editing (scene editing data) is saved in the moving image data creating apparatus 1. FIG.

Such editing is performed for multiple scenes of the work. If the same character appears in multiple scenes, the person image cut out in one scene may be used in another scene.

When editing of all scenes is completed, as shown in FIG. 11, the play button B19 on the editing scene selection screen is activated. When the play button B19 is pressed, all scenes are played back continuously. When the end button B20 is pressed, the editing ends, and the created picture book movie is saved in the moving image data creating apparatus 1.例文帳に追加

When the work is saved, the user terminal 2 displays a list screen of works created by the user, as shown in FIG. When the playback button B30 is pressed, the screen changes to a playback screen as shown in FIG. 13, and the picture book movie is streamed.

The picture book movie has a viewing time limit that allows streaming playback. For example, a viewing time limit of three days is set after a picture book movie is created. When the user presses the purchase button B32 and makes a payment by credit card or the like within the viewing period, the movie data of the created work can be downloaded.

As described above, according to the present embodiment, it is possible to create a picture book-like moving image in which the person image provided by the user moves.

Next, the configuration of the moving image data creation device 1 will be described. The video data creation device 1 generates a work selection screen and transmits it to the user terminal 2, receives an order for a picture book movie including the work selection from the user terminal 2, receives the image received from the user terminal 2, and the selected picture book. The video data of the picture book movie is generated by using the template data of the movie.

As shown in FIG. 14, the moving image data creation device 1 is a server device having a control unit 10, a storage unit 12, and a communication unit . The control unit 10 includes a central processing unit (CPU), ROM, RAM, etc., and controls the entire server apparatus. The control unit 10 implements various functions by reading and executing an operating system (OS) and application programs stored in the storage unit 12 .

The storage unit 12 is a storage area for storing programs, data, and the like necessary for the control unit 10 to execute various processes, and uses a hard disk, a semiconductor memory, or the like. The storage unit 12 stores template data of each picture book movie.

The template data includes a background image of each scene in the work, character movement information representing the movement of the person image to be synthesized, dialogue information of each scene, default voice data, and the like.

The control unit 10 functions as a user registration unit 101, a work selection unit 102, a scene selection unit 103, an image selection unit 104, an image processing unit 105, an audio setting unit 106, a combination unit 107, a reproduction processing unit 108, and a purchase reception unit 109. have

The user registration unit 101 accepts registration of a user who creates a picture book movie. By performing user registration, an area for storing picture book movie data created by each user is generated in the storage unit 12 .

The work selection unit 102 generates a work selection screen (see FIG. 2) and transmits it to the user terminal 2 . The work selection unit 102 receives a selection of a work for creating a picture book movie from the user via the work selection screen.

The scene selection unit 103 generates an edit scene selection screen (see FIG. 3) using the template data of the selected work, and transmits it to the user terminal 2 . The scene selection unit 103 receives selection of a scene to be edited from the user via the edit scene selection screen. Upon receiving the scene selection, the scene selection unit 103 generates an edit screen (see FIG. 4) using the template data, and transmits it to the user terminal 2 .

The image selection unit 104 accepts image selection from the user via the image selection screen (see FIG. 5), and receives the selected image data from the user terminal 2 .

The image processing unit 105 generates a clipping range specification screen (see FIG. 6) using the received image data, and transmits it to the user terminal 2 . The image processing unit 105 accepts the specification of the clipping range from the user via the clipping range specification screen. The image processing unit 105 cuts out the person image from the cutout range.

The image processing unit 105 transcribes the motion based on the character motion information to the clipped human image, and converts the human image into a moving image. A known method can be used for animation of a person image. The image processing unit 105 synthesizes the moving image of the person with the background image.

The voice setting unit 106 causes the user terminal 2 to display a dialog setting screen (see FIG. 9). The voice setting unit 106 receives voice data input via the microphone of the user terminal 2 and sets the voice data as lines of the scene. In addition, the audio backrest unit 106 can also set the default audio as the dialogue of the scene based on the instruction from the user terminal 2 .

Combining unit 107 generates work data for a picture book movie by combining the scene edit data of a plurality of scenes edited including synthesizing the background with the animated person image and setting dialogue. store in The linking unit 107 sets a viewing deadline for the work data.

The reproduction processing unit 108 transfers data to the user terminal 2 so as to perform streaming reproduction of the work data.

The purchase accepting unit 109 accepts purchase of work data from the user terminal 2 . After settlement processing, the purchase acceptance unit 109 makes the purchased work data downloadable. Also, the purchase reception unit 109 updates the purchase history in the storage unit 12 .

Next, the moving image data creation method according to this embodiment will be described using the flowchart shown in FIG.

The moving image data creation device 1 receives selection of a picture book movie from the user terminal 2 (step S1).

Based on the template data of the work selected in step S1, the moving image data creation device 1 displays a selection screen for scenes to be edited on the user terminal 2, and accepts the selection of scenes to be edited (step S2).

The edit screen of the scene selected in step S2 is displayed on the user terminal 2. FIG. The user refers to the sample displayed on the edit screen and selects an image to be combined with this scene (step S3). The image to be selected may be one saved in the user terminal 2 or one newly captured by the camera of the user terminal 2 .

The moving image data creation device 1 receives the selected image from the user terminal 2, and performs image processing such as clipping of a person image, animation, and composition with a background. Prior to clipping the portrait image, the user may specify a clipping range.

Next, the user records lines of the selected scene (step S4). The moving image data creation device 1 receives the voice data recorded from the user terminal 2 and sets it as the lines of this scene.

If there is a scene that has not been edited yet (step S5_No), the scene selection screen is returned to edit the unedited scene (steps S2 to S4).

When all the scenes have been edited (step S5_Yes), the moving image data creation device 1 combines all the scenes to create work data for a picture book movie, and performs streaming playback (step S6).

As described above, according to the present embodiment, it is possible to create a high-value-added moving image in which a person image (still image) provided by the user moves in the story of a picture book.

In the above embodiment, an example of creating a story-themed picture book movie has been described, but events such as birthdays, Shichigosan festivals, entrance ceremonies, graduation ceremonies, and wedding ceremonies may also be the themes.

Although the present invention has been described in detail using specific embodiments, it will be apparent to those skilled in the art that various modifications can be made without departing from the spirit and scope of the invention.

1 moving image data creation device 2 user terminal 101 user registration unit 102 work selection unit 103 scene selection unit 104 image selection unit 105 image processing unit 106 sound setting unit 107 combining unit 108 reproduction processing unit 109 purchase reception unit

Claims (4)

a storage unit for storing format data including a background image and character action information for each of a plurality of scenes of the work;
receiving a user image from a user terminal, cutting out a person image from the user image, animate the person image based on the motion information, combine the animate person image with the background image, and reproduce the plurality of scenes. an image processing unit that generates scene edit data corresponding to each;
a combining unit that combines a plurality of scene editing data to generate work data;
A video data creation device comprising: 2. The moving image data creating apparatus according to claim 1, further comprising an audio setting unit that receives audio data from said user terminal and sets said audio data in said scene editing data. 3. The moving image data creating apparatus according to claim 1, wherein said image processing unit receives designation of a clipping range in said user image from said user terminal, and clips said person image from said clipping range. receiving a user image from a user terminal;
clipping a person image from the user image;
a step of referring to format data including a background image and movement information of a character for each of a plurality of scenes of a work, and converting the person image into animation based on the movement information;
synthesizing the animated portrait image with the background image to generate scene edit data corresponding to each of the plurality of scenes;
a step of combining a plurality of said scene editing data to generate work data;
A video data creation method comprising:

Images