JP7505219B2 - Video creation system, video creation device, and program - Google Patents

Description

The present invention relates to a video creation system, a video creation device, a drone, and a program.

At tourist spots, there are services that take photos of users and provide those images to them. Users can enjoy looking back at those images and remembering events that happened at the tourist spot.

To make such services more appealing, it is possible to provide users with videos. However, it is difficult for a photographer to continue filming users while they are sightseeing.

One possible solution to this problem would be to use a drone to continuously capture images of the user. Patent Document 1 describes an example of a technology for capturing images using a drone, and discloses that the drone flies along a designated route to capture images.

Patent No. 6369538

Operating a drone requires specialized skills, and not just anyone can do it. The burden of operation can be reduced by using the drone's automatic tracking function to film, but the automatic tracking function controls the drone so that the subject continues to be filmed at the angle initially set, which can make the video tend to be monotonous.

In this regard, it is possible to create interesting videos by editing videos shot by drones, but video editing takes time and effort, and requires specialized skills.

The present invention was made in consideration of the above problems, and aims to provide a video creation system etc. that can easily provide interesting videos shot using a drone etc.

The first invention for solving the above-mentioned problems is a video creation system that uses video of a user as a subject captured by multiple imaging devices including a drone to create a new video in which footage of the subject is played at different angles for each time period, the video creation system comprising: a multiple imaging devices that capture video of the subject at different angles; a video creation device that creates the new video by cutting out parts of the video of the subject captured by each imaging device and connecting the parts based on an editing pattern that defines which time periods to cut out from the video of the subject captured at each angle and in what order to connect the cut-out parts; and a video transmission device that transmits the video created by the video creation device to a user terminal of the user, wherein the video creation device performs video analysis to change the time periods for cutting out the video from the original editing pattern depending on the content of the video .

In the present invention, a new video is created based on the above editing pattern from multiple videos taken from different angles of subjects such as users visiting tourist spots using multiple imaging devices, including drones. This makes it possible to obtain an interesting video in which footage of the subject is played back from different angles for each time period. In addition, because the videos are cut and pasted automatically based on the editing pattern, editing does not take much time or effort, and no specialized skills are required.

The drone may perform automatic tracking so that the subject is photographed at a constant angle, and it is also preferable that the multiple image capturing devices include multiple drones that capture the subject at different angles.
Using the drone's automatic tracking function reduces the burden of operating the drone, and by using multiple drones to shoot the subject from different angles, interesting videos can be created by cutting and pasting together the videos shot by each drone, even when using the drone's automatic tracking function.

Furthermore, in the present invention, the created video can be provided to users by a video transmission device, thereby realizing a video providing service at tourist spots and the like.

The second invention is a video creation device that uses videos of a subject shot by multiple shooting devices including a drone, each of which shoots videos of the subject at different angles, to create a new video in which footage of the subject is played at different angles for each time period, and creates the new video, which is sent to the user terminal of the user, by cutting out parts of the videos of the subject shot by each shooting device and connecting the parts based on an editing pattern that defines which parts of the videos shot of the subject at each angle will be cut out and the order in which the cut-out parts will be connected, and when creating the new video, the video creation device performs video analysis to change the time periods for cutting out the video from the original editing pattern depending on the content of the video .
A second invention is a moving image creating device in the moving image creating system of the first invention.

A third invention is a video creation device that uses videos of a subject shot by multiple shooting devices including a drone, each of which shoots videos of a user as a subject at different angles, to create a new video in which footage of the subject is played back at different angles for each time period, and creates the new video by cutting out parts of the videos of the subject shot by each shooting device and connecting the parts based on an editing pattern that defines which time periods to cut out from the videos of the subject shot at each angle and the order in which to connect the cut-out parts , to create the new video that is to be sent to the user terminal of the user, and when creating the new video, performs video analysis to change the time periods for cutting out the video from the original editing pattern depending on the content of the video .
A third invention is a program for the moving image creation device of the second invention.

The present invention provides a video creation system that can easily provide interesting videos shot using a drone or the like.

FIG. 1 shows a video creation system 1. FIG. 2 is a diagram showing the hardware configuration of drone 2. FIG. 2 is a diagram showing a hardware configuration of a moving image creation device 3. FIG. 2 is a diagram showing the hardware configuration of a video transmission device 4. FIG. 1 shows an editing pattern 100. A diagram explaining a new video 200 taken by a user using drone 2 and edited. 4 is a flowchart showing a process executed in the moving image creation system 1. FIG. 4 is a diagram illustrating setting of a tracking target. An example of photographing a user using a single drone 2.

The following describes in detail a preferred embodiment of the present invention with reference to the drawings.

(1. Video Creation System 1)
1 is a diagram showing a video creation system 1 according to an embodiment of the present invention. The video creation system 1 of the present embodiment includes a drone 2, a video creation device 3, a video transmission device 4, etc., and is used to provide a user who visits a tourist spot or the like with a video of the user.

The drone 2 is a photographing device that shoots video of the user (subject) while flying, and in this embodiment in particular, has an automatic tracking function that automatically tracks the user at a fixed angle using known technology that uses image recognition.

In this embodiment, multiple drones 2 are prepared, each capturing an image of the user at a different angle. In this embodiment, "angle" refers to the direction in which the user is captured by the image capture device (drone 2) and the size of the user (e.g., "close-up," "long-distance," etc.), and is determined by factors such as the positional relationship between the user and the image capture device.

Figure 2 is a diagram showing the hardware configuration of the drone 2. As shown in Figure 2, the drone 2 has a control unit 21, a memory unit 22, an imaging unit 23, an aircraft driving unit 24, a wireless communication unit 25, etc.

The control unit 21 is, for example, a processing device having a CPU, and performs various aircraft controls for flying and photographing the drone 2.

The storage unit 22 is, for example, a flash memory, and stores video data captured by the imaging unit 23.

The imaging unit 23 is a high-resolution area camera composed of an optical lens, an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor), an A/D (Analog/Digital) conversion unit, etc. The imaging unit 23 photoelectrically converts the subject image input through the optical lens using the imaging element to generate an analog image signal. The A/D conversion unit then converts the analog image signal into digital image data.

The aircraft drive unit 24 is a drive mechanism for operating the aircraft of the drone 2. The aircraft drive unit 24 can, for example, rotate the propellers for flying the drone 2 and change the position and orientation of the imaging unit 23.

The wireless communication unit 25 wirelessly transmits and receives signals and data between the drone 2's operation terminal (not shown) and the video creation device 3.

Returning to the explanation of Figure 1, the video creation device 3 creates a new video by editing the video captured by the drone 2.

Figure 3 is a diagram showing the hardware configuration of the video creation device 3. As shown in Figure 3, the video creation device 3 can be realized by a computer configured by connecting, for example, a control unit 31, a storage unit 32, an input unit 33, a display unit 34, a communication unit 35, etc. via a bus. However, the present invention is not limited to this, and various configurations can be used as appropriate.

The control unit 31 is composed of a CPU, ROM, RAM, etc. The CPU loads programs related to the processing of the video creation device 3 stored in storage media such as the memory unit 32 and ROM into a work area on the RAM and executes them. The ROM is a non-volatile memory, and permanently stores programs such as the boot program and BIOS, as well as data. The RAM is a volatile memory, and temporarily stores programs and data loaded from the memory unit 32, ROM, etc., and also has a work area that the control unit 31 uses to perform various processes.

The storage unit 32 is a hard disk drive, solid state drive, flash memory, etc., and stores the programs executed by the control unit 31, data necessary for program execution, the OS, etc. These programs and data are read and executed by the control unit 31 as necessary.

The input unit 33 is used to input various settings to the moving image creation device 3 .
The display unit 34 is, for example, a liquid crystal display.
The communication unit 35 is a communication interface that mediates communication via a network, etc., and communicates with the drone 2, video transmission device 4, etc.

Returning to the explanation of FIG. 1, the video transmission device 4 transmits new videos created by the video creation device 3 to a user terminal (not shown) at the user's request, allowing the user to download the videos.

Figure 4 is a diagram showing the hardware configuration of the video transmission device 4. As the video transmission device 4, a computer having a control unit 41, a storage unit 42, and a communication unit 43 similar to the control unit 31, storage unit 32, and communication unit 35 of the video creation device 3 can be used.

(2. Editing Pattern 100)
In this embodiment, the memory unit 32 of the video creation device 3 stores editing patterns for editing the videos shot by each drone 2 and creating new videos.

Figure 5 shows the contents of this editing pattern 100. Editing pattern 100 determines which time periods of the video footage of the user captured by each drone 2 are to be cut out, and in what order the cut-out parts are to be connected.

For example, in the example in Figure 5, three drones A, B, and C film the user from the front at a close angle, one from behind at a wide angle, and one from the front at a wide angle, respectively. A section a from 0 to 10 seconds into the video filmed by drone A, a section b from 10 to 20 seconds into the video filmed by drone B, a section c from 20 to 30 seconds into the video filmed by drone C, and a section d from 30 to 40 seconds into the video filmed by drone A are cut out and then joined in the order a to d to create a new video.

For example, as shown in FIG. 6(a), drones A to C continuously capture video of user S from start point 10 to goal point 20 during an activity such as zip lining, where user S slides down a wire suspended from a start point 10 to a goal point 20 in a mountainous area using a pulley.

By editing the videos taken by each drone A to C using the editing pattern 100 described in FIG. 5, a new video 200 can be created with a story, as shown in FIG. 6(b), including a close-up frontal shot of user S expressing his/her expectations at the starting point 10, a long-distance shot of user S sliding down a wire on a pulley, a long-distance shot of user S from the front, and a close-up frontal shot of user S expressing his/her impressions at the goal point 20.

(4. How to create a video)
Next, the process (movie creation method) executed in the movie creation system 1 of this embodiment will be described with reference to Fig. 7 etc. Fig. 7 is a flowchart showing this process, in which the control unit 21 of the drone 2 controls each unit of the drone 2 to execute the processes of S1 to S4, and the control unit 31 of the movie creation device 3 controls each unit of the movie creation device 3 to execute the processes of S5 to S8.

In this embodiment, first, an image 101 of a user S is captured by each drone 2 as shown in FIG. 8 (S1), and the user S in the image 101 is set as a tracking target to be tracked by each drone 2 (S2).

After that, user S enjoys riding the zip line, and each drone 2 automatically tracks user S and shoots video from the time user S reaches starting point 10 to goal point 20, as shown in FIG. 6(a) (S3). Each drone 2 controls the aircraft, including the imaging unit 23, to shoot user S at a certain angle so that the size and posture (shape) of user S in the video being shot remain the same as those of user S in the image 101 set in S2.

After completing the filming, each drone 2 transmits the video of the user to the video creation device 3 (S4), and the video creation device 3 receives these videos (S5).

Then, based on the editing pattern 100 described above, the video creation device 3 performs an editing process of cutting out parts of the videos shot by each drone 2 and splicing the parts together to create a new video 200 (S6).

The video creation device 3 transmits the created video 200 to the video transmission device 4 (S7), and issues a download ticket for downloading the video 200 to the user S, for example by printing it on a printer not shown (S8).

On the download ticket, for example, the URL of a website for downloading videos provided by the video transmission device 4 is printed as a two-dimensional code. The user can access the website by reading the two-dimensional code with a user terminal (not shown), and download the video 200 created in S6 from the video transmission device 4 to the user terminal.

As described above, according to this embodiment, a new video 200 is created based on the editing pattern 100 from multiple videos of the user S captured at different angles by multiple drones 2. This makes it possible to obtain an interesting video 200 in which footage of the subject is played at different angles for each time period. In addition, the videos are automatically cut and pasted based on the editing pattern 100, so editing does not take much time or effort, and no specialized skills are required.

In addition, in this embodiment, the automatic tracking function of the drone 2 is used to reduce the burden of operating the drone 2, and by using multiple drones 2 that shoot the user from different angles, an interesting video 200 can be created by cutting and pasting together videos shot by each drone 2, even when the automatic tracking function of the drone 2 is used.

In addition, the created video 200 can be provided to users via the video transmission device 4, making it possible to realize a video provision service at tourist spots, etc.

However, the present invention is not limited to the above embodiment. For example, the editing pattern 100 is not limited to the above, and several patterns are possible, and it is also possible to play back the following images in succession in the order: video of user S shot from a frontal wide angle - video of user S shot from a frontal close-up angle - video of user S shot from a frontal wide-up angle - video of user S shot from a rear wide-up angle - video of user S shot from a rearal close-up angle.

The range (time period) for cutting out the video can also be changed from the original editing pattern 100 depending on the content of the video. For example, if video analysis indicates that user S is speaking in a video shot from a wide angle, the range for cutting out the video can be extended from the original editing pattern 100 by the time while user S is speaking, in order to include the video during the time period when user S is speaking in the edited video 200. Also, if there is a time period in the video shot by any drone 2 where user S's voice is determined to be loud, it is possible to include the video during that time period in the new video 200.

In addition, at least one of the imaging devices that captures the user's image may be a drone 2, and the other imaging devices may be fixed cameras or cameras attached to a helmet worn by the user. In this case, if the editing patterns 100 are created in advance in correspondence with these imaging devices, an interesting video can be easily obtained by editing the video using the editing patterns 100 in the same manner as described above.

In addition, by setting the angle at which the drone 2 automatically tracks the user while shooting the video as a shooting pattern based on the same concept as the editing pattern 100 described above and storing it in the memory unit 22, it is possible to shoot a video equivalent to the edited video 200 described above using a single drone 2.

Figure 9(a) is an example of the above-mentioned shooting pattern 100a, which defines the time periods during which user S is shot at each angle. Each angle is different, and in the example of Figure 9(a), user S is shot at a frontal close-up angle from 0 to 10 seconds, a rearward wide-angle from 10 to 20 seconds, a frontal wide-angle from 20 to 30 seconds, and a frontal close-up angle from 30 to 40 seconds.

By combining such shooting pattern 100a with the drone flight route setting technology as shown in the above-mentioned Patent Document 1 as necessary, the drone 2 can fly while shooting the user S as shown by the arrow in Figure 9 (b), and a video equivalent to the above-mentioned edited video 200 can be obtained. Note that the tracking target when performing automatic tracking at each angle is set in advance in the same way as S1 to S2 described above, and the drone 2 switches the tracking target during flight for each time period specified in the shooting pattern 100a.

In this embodiment, the subject is a person (user S), but the subject is not limited to this. For example, the subject may be an animal or a vehicle such as a bicycle or a car.

The video creation system 1 of the present invention can be used in a variety of activities, such as rafting, skiing, and giant slides, and can also be used in other tourist destinations. The video creation system 1 of the present invention can also be used in other places than tourist destinations, such as sports days.

The above describes preferred embodiments of the present invention with reference to the attached drawings, but the present invention is not limited to these examples. It is clear that a person skilled in the art can come up with various modified or revised examples within the scope of the technical ideas disclosed in this application, and it is understood that these also naturally fall within the technical scope of the present invention.

1: Video creation system 2: Drone 3: Video creation device 4: Video transmission device 100: Editing pattern 100a: Shooting pattern 200: Video

Claims (5)

A video creation system that uses videos of a user, the subject of the video, captured by multiple imaging devices including a drone, to create a new video in which footage of the subject from different angles is played back for each time period,
The plurality of image capturing devices each capture a moving image of a subject from a different angle;
a video creation device that creates the new video by cutting out parts of the videos of the subject captured by each of the image capture devices and connecting the parts based on an editing pattern that defines which time periods to cut out from the videos of the subject captured at each angle and in what order to connect the cut out parts;
a video transmission device that transmits the video created by the video creation device to a user terminal of the user;
having
The video creation system is characterized in that the video creation device performs video analysis to change the time period for cutting out the video from the initial editing pattern depending on the content of the video . The video production system according to claim 1, characterized in that the drone automatically tracks the subject so that the subject is photographed at a fixed angle. The video production system according to claim 2, characterized in that the multiple image capture devices include multiple drones that capture images of a subject from different angles. A video creation device that uses videos of a subject taken by a plurality of imaging devices, including a drone, each of which takes a video of a user as a subject from a different angle, to create a new video in which the video of the subject is played back at different angles for each time period,
creating the new video to be transmitted to the user terminal of the user by cutting out portions of the videos of the subject shot by each shooting device and connecting the portions based on an editing pattern that defines which time periods to cut out from the videos of the subject shot at each angle and in what order to connect the cut out portions ;
The video creation device is characterized in that, when creating the new video, the device performs video analysis to change the time period for cutting out the video from the original editing pattern depending on the content of the video . Computer,
A video creation device that uses videos of a subject taken by a plurality of imaging devices, including a drone, each of which takes a video of a user as a subject from a different angle, to create a new video in which the video of the subject is played back at different angles for each time period,
creating the new video to be transmitted to the user terminal of the user by cutting out portions of the videos of the subject shot by each shooting device and connecting the portions based on an editing pattern that defines which time periods to cut out from the videos of the subject shot at each angle and in what order to connect the cut out portions ;
A program for functioning as a video creation device that, when creating the new video, performs video analysis to change the time period for cutting out the video from the original editing pattern depending on the content of the video .

Images