JP2021153218A - Video creation system, video creation device, drone and program - Google Patents

Abstract

To provide a video creation system that can easily provide interesting videos captured by using a drone or the like.SOLUTION: A video creation system 1 creates a new video in which an image of a subject in different angles for each time zone is reproduced, using the video of the subject taken by a plurality of drones 2. The video creation system 1 includes the drone 2, a video creation device 3, and a video transmission device 4, and the like. The drone 2 takes video of the subject from different angles. The video creation device 3 creates a new video by connecting the parts together by cutting out a part of the video of the subject that is taken with each drone 2 on the basis of an editing pattern that defines which time zone part of the video of the subject taken in each angle is cut out and in what order the cut-out parts are connected.SELECTED DRAWING: Figure 1

Description

The present invention relates to a moving image creation system, a moving image producing device, a drone and a program.

In tourist spots and the like, there is a service that takes a picture of a user and provides the image to the user. The user can look back at the image and enjoy remembering what happened at the tourist spot.

In order to make such a service more attractive, it is conceivable to provide a video to the user. However, it is difficult for the photographer to continue shooting the tourist user.

As one means for solving such a problem, it is conceivable to continue shooting the user using a drone. Patent Document 1 describes an example of a shooting technique using a drone, and discloses that the drone flies on a designated route and shoots.

Patent No. 6369538

Operating a drone requires specialized skills, and not everyone can do it. Although the burden of operation can be reduced by shooting using the drone's automatic tracking function, the automatic tracking function controls the drone's aircraft so that the subject continues to be shot at the initially set angle. Videos tend to be monotonous.

In this regard, it is conceivable to create an interesting video by editing a video shot with a drone, but video editing takes time and effort, and requires specialized skills.

The present invention has been made in view of the above problems, and an object of the present invention is to provide a moving image creation system or the like that can easily provide an interesting moving image taken by using a drone or the like.

The first invention for solving the above-mentioned problems is to create a new moving image in which an image of a subject at a different angle is reproduced for each time zone by using a moving image of a subject taken by a plurality of photographing devices including a drone. It is a video creation system, and the plurality of shooting devices that shoot a video of a subject from different angles, which time zone part of the video in which the subject is shot at each angle is cut out, and which part is cut out. Based on an editing pattern that determines whether to connect in order, it has a video creation device that creates the new video by cutting out a part of the video of the subject shot by each shooting device and joining the parts together. It is a video creation system characterized by this.

In the present invention, a new moving image is created based on the above editing pattern from a plurality of moving images in which a subject such as a user who has visited a tourist spot is photographed at different angles by a plurality of photographing devices including a drone. As a result, it is possible to obtain an interesting moving image in which the image of the subject at a different angle is reproduced for each time zone. In addition, since the video is cut and pasted automatically based on the editing pattern, editing does not take time and effort, and no specialized technique is required.

The drone automatically tracks, for example, so that the subject is photographed at a constant angle. It is also desirable that the plurality of photographing devices include a plurality of the drones that photograph a subject from different angles.
By using the automatic tracking function of the drone, the operation burden of the drone is reduced, and by using multiple drones that shoot the subject from different angles, even if the automatic tracking function of the drone is used, each drone You can create interesting videos by cutting and pasting the shot videos.

It is also desirable to have a moving image transmitting device that transmits the moving image created by the moving image creating device to the user terminal.
By providing the created video to the user by the video transmitting device, it is possible to realize a video providing service at a tourist spot or the like.

The second invention is a new moving image in which a moving image of a subject at a different angle is reproduced for each time zone by using a moving image of the subject taken by a plurality of shooting devices including a drone, which shoots a moving image of the subject at different angles. It is a video creation device that creates a video, and each shooting is based on an editing pattern that defines which time zone part of the video in which the subject was shot at each angle and in what order the cut out parts are connected. The moving image creating device is characterized in that a new moving image is created by cutting out a part of a moving image of a subject photographed by the device and joining the part.
The second invention is a moving image producing device in the moving image producing system of the first invention.

The third invention is a drone that shoots a moving image of a subject at different angles for each time zone, and automatically tracks the subject based on a shooting pattern that defines a time zone for shooting the subject at each angle. It is a drone characterized by shooting movies.
By defining the above shooting pattern in the same way as the above-mentioned editing pattern, it is possible to shoot a video equivalent to the above-mentioned new video (edited video) with one drone, and the video editing work. Is no longer needed.

The fourth invention uses a computer to shoot a moving image of a subject at different angles, and uses a moving image of the subject taken by a plurality of shooting devices including a drone, and reproduces a moving image of the subject at a different angle for each time zone. It is a video creation device that creates a new video, and is based on an editing pattern that defines which time zone part of the video in which the subject was shot at each angle and in what order the cut out parts are connected. , This is a program for functioning as a moving image creating device for creating the new moving image by cutting out a part of a moving image of a subject photographed by each photographing device and joining the part.
The fourth invention is a program of the moving image producing device of the second invention.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a moving image creation system or the like that can easily provide an interesting moving image taken by using a drone or the like.

The figure which shows the moving image creation system 1. The figure which shows the hardware configuration of the drone 2. The figure which shows the hardware configuration of the moving image creation apparatus 3. The figure which shows the hardware configuration of the moving image transmission apparatus 4. The figure which shows the edit pattern 100. The figure explaining the new moving image 200 after the user shooting and editing by the drone 2. The flowchart which shows the process executed in the moving image creation system 1. The figure explaining the setting of the tracking target. An example of shooting a user with one drone 2.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

(1. Video creation system 1)
FIG. 1 is a diagram showing a moving image creation system 1 according to an embodiment of the present invention. The moving image creation system 1 of the present embodiment has a drone 2, a moving image creating device 3, a moving image transmitting device 4, and the like, and is used to provide a moving image taken by the user to a user who visits a tourist spot or the like.

The drone 2 is a photographing device that captures a moving image of a user (subject) while flying, and in particular, in the present embodiment, it has an automatic tracking function that automatically tracks the user at a fixed angle by a known technique using image recognition. ing.

In this embodiment, a plurality of drones 2 are prepared, and the user is photographed from different angles. In the present embodiment, the “angle” refers to the shooting direction and the size of the user (“close”, “pull”, etc.) when the user is shot by the shooting device (drone 2), and the user and the shooting device. It is determined by the positional relationship.

FIG. 2 is a diagram showing a hardware configuration of the drone 2. As shown in FIG. 2, the drone 2 includes a control unit 21, a storage unit 22, an imaging unit 23, an airframe drive unit 24, a wireless communication unit 25, and the like.

The control unit 21 is an arithmetic processing unit having, for example, a CPU or the like, and controls various aircraft for flying and photographing the drone 2.

The storage unit 22 is, for example, a flash memory or the like, and stores moving image data captured by the imaging unit 23.

The image pickup unit 23 is a high-resolution area camera composed of an optical lens, an image pickup element such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide Semiconductor), and an A / D (Analog / Digital) conversion unit. .. The image pickup unit 23 photoelectrically converts the subject image input via the optical lens by the image pickup element to generate an analog image signal. Then, the analog image signal is converted into digital image data by the A / D conversion unit.

The machine body drive unit 24 is a drive mechanism for operating the body of the drone 2. The airframe drive unit 24 can, for example, rotate the flight propeller of the drone 2 and change the position and orientation of the image pickup unit 23.

The wireless communication unit 25 wirelessly transmits and receives signals and data to and from the operation terminal (not shown) of the drone 2 and the moving image creating device 3.

Returning to the description of FIG. The moving image creation device 3 creates a new moving image by editing the moving image taken by the drone 2.

FIG. 3 is a diagram showing a hardware configuration of the moving image creation device 3. As shown in FIG. 3, the moving image creation device 3 can be realized by, for example, a computer configured by connecting a control unit 31, a storage unit 32, an input unit 33, a display unit 34, a communication unit 35, and the like by a bus. However, the present invention is not limited to this, and various configurations can be taken as appropriate.

The control unit 31 is composed of a CPU, ROM, RAM, and the like. The CPU calls and executes a program related to the processing of the moving image creation device 3 stored in the storage medium such as the storage unit 32 and the ROM in the work area on the RAM. ROM is a non-volatile memory that permanently holds programs such as boot programs and BIOS, and data. The RAM is a volatile memory, and includes a work area used by the control unit 31 to perform various processes while temporarily holding programs and data loaded from the storage unit 32, ROM, and the like.

The storage unit 32 is a hard disk drive, a solid state drive, a flash memory, or the like, and stores a program executed by the control unit 31, data necessary for program execution, an OS, and the like. These programs and data are read out and executed by the control unit 31 as needed.

The input unit 33 inputs various settings to the moving image creation device 3.
The display unit 34 is, for example, a liquid crystal display or the like.
The communication unit 35 is a communication interface that mediates communication via a network or the like, and communicates with the drone 2 or the moving image transmitting device 4 or the like.

Returning to the description of FIG. The moving image transmitting device 4 transmits a new moving image created by the moving image creating device 3 to a user terminal (not shown) at the request of the user and causes the user terminal (not shown) to download the new moving image.

FIG. 4 is a diagram showing a hardware configuration of the moving image transmitting device 4. As the moving image transmitting device 4, a computer having a control unit 31, a storage unit 32, and a control unit 41, a storage unit 42, and a communication unit 43 similar to the communication unit 35 of the moving image creating device 3 can be used.

(2. Editing pattern 100)
In the present embodiment, the storage unit 32 of the moving image creation device 3 stores an editing pattern for editing the moving image taken by each drone 2 and creating a new moving image.

FIG. 5 is a diagram showing the contents of the editing pattern 100. In the editing pattern 100, it is determined which time zone portion of the moving image shot by the user with each drone 2 is cut out, and in what order the cut out portions are connected.

For example, in the example of FIG. 5, three drones A, B, and C each shoot the user at an angle closer to the front, the user at a pulling angle from the back, and the user at a pulling angle from the front. 0-10 seconds part a of the video shot with drone A, 10-20 seconds part b of the video shot with drone B, 20-30 seconds part of the video shot with drone C c, It is shown that a part d of 30 to 40 seconds of the moving image taken by the drone A is cut out and these are connected in the order of a to d to create a new moving image.

In the drones A to C, for example, as shown in FIG. 6A, in an activity such as a zip line in which a wire hung from a start point 10 to a goal point 20 is slid down by a pulley in a mountainous area, the user S starts from the start point 10. The video of the user S is continuously recorded until the goal point 20 is reached.

By editing the moving images shot by each of the drones A to C using the editing pattern 100 described in FIG. 5, as shown in FIG. Video taken in-Video of user S sliding down the wire with a pulley pulled from the back-Video shot of the same user S pulled from the front-Video taken of user S expressing his impressions at goal point 20 in front / closer A new video 200 having a story such as, can be created.

(4. Video creation method)
Next, the process (video creation method) executed in the moving image creation system 1 of the present embodiment will be described with reference to FIG. 7 and the like. FIG. 7 is a flowchart showing this process. The control unit 21 of the drone 2 controls each part of the drone 2 to execute the processes of S1 to S4, and the control unit 31 of the moving image creation device 3 executes the processes of S5 to S8. Each part of the moving image creation device 3 is controlled and executed.

In the present embodiment, each drone 2 first captures an image 101 of the user S as shown in FIG. 8 (S1), and the user S in the image 101 is set as a tracking target to be tracked by each drone 2 (S2). ..

After that, the user S enjoys the zip line, and each drone 2 automatically tracks the user S from the start point 10 to the goal point 20 as shown in FIG. 6A. Take a moving image (S3). Each drone 2 has an imaging unit to shoot the user S at a constant angle so that the size and posture (shape) of the user S in the moving image being shot are the same as those of the user S in the image 101 set in S2. Controls the aircraft including 23.

When the shooting is finished, each drone 2 transmits the moving images taken by the user to the moving image creating device 3 (S4), and the moving image creating device 3 receives these moving images (S5).

Then, the moving image creation device 3 cuts out a part of the moving image taken by each drone 2 based on the above-mentioned editing pattern 100, performs an editing process of joining the part, and creates a new moving image 200 (S6). ..

The moving image creation device 3 transmits the created moving image 200 to the moving image transmitting device 4 (S7), and prints a download ticket for downloading the moving image 200 with a printer (not shown) to issue the created moving image 200 to the user S (S8). ).

In the download ticket, for example, the URL of the video download website provided by the video transmission device 4 is printed as a two-dimensional code or the like. The user can access the website by reading the two-dimensional code with a user terminal (not shown) or the like, and download the moving image 200 created in S6 from the moving image transmitting device 4 to the user terminal.

As described above, according to the present embodiment, a new moving image 200 is created based on the editing pattern 100 from a plurality of moving images in which the user S is shot by a plurality of drones 2 at different angles. As a result, it is possible to obtain an interesting moving image 200 in which an image of a subject having a different angle is reproduced for each time zone. Further, since the cutting and pasting of the moving image is automatically performed based on the editing pattern 100, editing does not take time and effort, and no specialized technique is required.

Further, in the present embodiment, the operation load of the drone 2 is reduced by using the automatic tracking function of the drone 2, and the automatic tracking function of the drone 2 is provided by using a plurality of drones 2 that shoot the user from different angles. Even when it is used, it is possible to create an interesting moving image 200 by cutting and pasting the moving image taken by each drone 2.

Further, by providing the created moving image 200 to the user by the moving image transmitting device 4, it is possible to realize a moving image providing service at a sightseeing spot or the like.

However, the present invention is not limited to the above embodiments. For example, the editing pattern 100 is not limited to the above, and several patterns can be considered. An image of the user S taken at a front / pulling angle-an image of the user S taken at a front / near angle-a user S at a front / pulling angle It is also possible to use a pattern in which the captured image-the image of the user S taken at the back / pulling angle-the image of the user S taken at the back / close angle are continuously reproduced in this order.

It is also possible to change the range (time zone) for cutting out the moving image from the initial editing pattern 100 according to the content of the moving image. For example, if it is estimated by video analysis that user S is speaking in a video with a pulling angle, the video is cut out in order to include the video in the time zone in which user S is speaking in the edited video 200. The range may be extended from the original editing pattern 100 only while the user S is speaking. Further, if there is a time zone in which the voice of the user S is determined to be loud in the moving image shot by any of the drones 2, it is possible to include the moving image in that time zone in the new moving image 200.

Further, at least one of the photographing devices for photographing the user may be the drone 2, and the other photographing devices may be a fixed camera or a camera attached to a helmet worn by the user. In this case as well, if the above-mentioned editing pattern 100 is created in advance corresponding to these photographing devices, an interesting moving image can be easily obtained by editing the moving image using the editing pattern 100 in the same manner as described above. ..

Further, the angle at which a moving image is shot while automatically tracking the user by the drone 2 is set as a shooting pattern based on the same concept as the editing pattern 100, and is stored in the storage unit 22. It is also possible to shoot a moving image equivalent to the moving image 200 with one drone 2.

FIG. 9A is an example of the above-mentioned shooting pattern 100a, and defines the time zone for shooting the user S at each angle. Each angle is different from each other. In the example of FIG. 9A, the front / close angle is for 0 to 10 seconds, the back / pull angle is for 10 to 20 seconds, and the back / pull angle is for 20 to 30 seconds. It is shown that the user S is photographed at a front / pull angle and at a front / close angle for 30 to 40 seconds.

By combining such a shooting pattern 100a with a drone flight route setting technique as shown in Patent Document 1 as necessary, the drone 2 is flying as shown by the arrow in FIG. 9B. The user S can be photographed to obtain a moving image equivalent to the edited moving image 200 described above. The tracking target for automatic tracking at each angle is set in advance in the same manner as in S1 to S2 described above, and the drone 2 switches the tracking target every time zone specified by the shooting pattern 100a during flight.

Further, in the present embodiment, the subject is a person (user S), but the subject is not limited to this. For example, it may be an animal or a vehicle such as a bicycle or a car.

Further, the scene in which the moving image creation system 1 of the present invention is applied is not limited to the zip line as described above, but may be various activities such as rafting, skiing, and a huge slide, and may be applied to other tourist spots. It is possible. Further, the moving image creation system 1 of the present invention can be applied to a place other than a tourist spot, and can be applied to, for example, an athletic meet.

Although preferred embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modifications or modifications within the scope of the technical idea disclosed in the present application, and these also naturally belong to the technical scope of the present invention. Understood.

1: Video creation system 2: Drone 3: Video creation device 4: Video transmission device 100: Editing pattern 100a: Shooting pattern 200: Video

Claims (7)

It is a video creation system that creates a new video that reproduces the video of the subject from different angles for each time zone using the video of the subject shot by multiple shooting devices including drones.
The plurality of shooting devices that shoot moving images of the subject from different angles, and
A part of the video of the subject shot by each shooting device based on the editing pattern that defines which time zone part of the video of the subject shot at each angle and in what order the cut out parts are connected. A video creation device that creates the new video by cutting out and joining the parts together.
A video creation system characterized by having. The moving image creation system according to claim 1, wherein the drone automatically tracks so that a subject is photographed at a constant angle. The moving image creation system according to claim 2, wherein the plurality of photographing devices include a plurality of the drones that photograph a subject from different angles. The moving image creation system according to any one of claims 1 to 3, further comprising a moving image transmitting device for transmitting a moving image created by the moving image creating device to a user terminal. A video creation device that creates a new video that reproduces the video of the subject at different angles for each time zone, using the video of the subject shot with multiple shooting devices including drones, which shoots the video of the subject from different angles. And
A part of the video of the subject shot by each shooting device based on the editing pattern that defines which time zone part of the video of the subject shot at each angle and in what order the cut out parts are connected. A moving image creating device characterized in that a new moving image is created by cutting out and joining the parts thereof. It is a drone that shoots a movie of the subject from a different angle for each time zone.
A drone that automatically tracks the subject and shoots a movie of the subject based on a shooting pattern that defines the time zone for shooting the subject at each angle. Computer,
A video creation device that creates a new video that reproduces the video of the subject at different angles for each time zone, using the video of the subject shot with multiple shooting devices including drones, which shoots the video of the subject from different angles. And
A part of the video of the subject shot by each shooting device based on the editing pattern that defines which time zone part of the video of the subject shot at each angle and in what order the cut out parts are connected. A program for functioning as a moving image creation device for creating the new moving image by cutting out and joining the parts thereof.

Images