JP2009038451A - Moving video editing and reproducing system and apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving video editing and reproducing system which utilizes the positional information of an object image for editing or reproducing the recorded moving image data. <P>SOLUTION: The moving video editing and reproducing system comprises a section for acquiring the identification information of a moving object, a section for recording the photography information of the moving object in association with the photography moving image data of the moving object, and a section for operating the position of the object image for the reproduction screen of the photography moving image data from the identification information and the photography information. The moving video editing and reproducing system comprises a section for acquiring the identification information of a moving object from an external object portable device, a section for acquiring the photography information recorded in association with the photography moving image data of the moving object from an external moving video photography device, and a section for operating the position of the object image for the reproduction screen of the photography moving image data from the identification information and the photography information. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a moving image editing / reproducing system that uses position information of a subject image for editing and reproducing recorded moving image data.

  2. Description of the Related Art In recent years, it has been widely practiced to shoot and view a child's growth record and travel record with a video camera at home. In such shooting, for example, shooting for a children's athletic meet, a suitable place for shooting a start scene, a suitable place for shooting a chasing race, and a goal-in scene are suitable. There are several places suitable for holding a video camera such as a place. However, in a very crowded situation such as shooting at an athletic meet, it is actually difficult to shoot while moving between a plurality of preferred shooting locations. In addition, even when there are a plurality of suitable shooting locations at the same time, in a situation where one person shoots with one video camera, it can only shoot from one of the preferred shooting locations at a specific time. There are limitations.

  On the other hand, Patent Document 1 describes an apparatus for facilitating photographing of a moving subject by calculating the position of a subject image that moves during photographing and displaying the position on a finder screen.

However, there is no disclosure about the purpose or configuration of using the calculated position information of the subject image for editing or reproducing the recorded moving image data.
JP 2002-314851 A

  It is an object of the present invention to provide a moving image editing / reproducing system that uses position information of a subject image for editing and reproducing recorded moving image data.

  In order to solve the above problems, a video editing / playback system according to the present invention relates to a subject identification information acquisition unit that acquires identification information of a moving subject, and associates the shooting information of the moving subject with the shooting video data of the moving subject. A video information recording unit for recording, and a calculation unit for calculating a position of a subject image with respect to a reproduction screen of the captured moving image data from the identification information and the shooting information.

  According to the present invention, it is possible to obtain a moving image editing / reproducing system that uses position information of a subject image for editing and reproducing recorded moving image data.

  Examples of the present invention will be described below. The present invention can be applied to, for example, a digital video camera, an HDD / DVD recorder, and the like.

A first embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a block diagram of the entire system according to an embodiment of the present invention. The subject portable device 101 is a device that the subject wears and carries, and includes a subject position detection unit 102, a date / time measurement unit 103, a subject position / date / time information recording unit 105, and a subject position / date / time information transmission unit 106. It has a processing part.

The subject position detection unit 102 detects the position information of the subject by position detection means such as the global positioning system GPS, and the date / time measurement unit 103 measures the date / time and the date / time information and its The subject position / date / time information 104 in which the subject position information at the time is combined is output.

The subject position / date / time information 104 is information indicating the movement trajectory of the subject, and is sequentially recorded in the internal memory by the subject position / date / time information recording unit 105.
Subject position / date / time information 104 recorded in the subject position / date / time information recording unit 105, that is, identification information is subject position / date / time information realized by means of wired communication such as USB or wireless communication such as IrDA or Bluetooth. The data is sent to the moving image editing / playback apparatus 301 described later by the sending unit 106.

The moving image shooting device 201 is a device for shooting a moving image realized in the form of a digital video camera or the like. The shooting position detection unit 202, the shooting direction detection unit 203, the shooting magnification variable unit 204, the shooting magnification detection unit 205, and the year and month It has a processing unit of a date / time measuring unit 206, a moving image shooting unit 207, and shooting information / shot moving image data recording unit 210.

In the shooting position detection unit 202, the position of the moving image shooting apparatus 201 is detected by position detection means such as a global positioning system GPS.
The shooting direction detection unit 203 detects the direction in which the moving image shooting apparatus 201 is directed, for example, by a direction measurement unit such as a geomagnetic sensor or a triaxial acceleration sensor.
The photographing magnification detection unit 205 detects the photographing magnification set by the photographing magnification varying unit 204 realized by a zoom lens driving motor or the like.
The date / time measurement unit measures the date / time and detects / measures the date / time information, and the shooting position detection unit 202, shooting direction detection unit 203, and shooting magnification detection unit 205 described above. The shooting position information, shooting direction information, and shooting magnification information detected in this way are output as shooting information 208.

The moving image shooting unit 207 shoots a moving image, adds the date and time information sequentially measured by the date / time / time measuring unit to the captured moving image data, and outputs it as shooting moving image data 209.

With the above processing, the shooting information 208 and the shooting video data 209 output during shooting are recorded by the shooting information / shooting data recording unit 210 in a magnetic recording medium represented by DV tape or optical recording represented by DVD. Recording is performed on shooting information / shooting moving image data recording medium 211 realized by a recording medium such as a medium or a semiconductor recording medium represented by a memory card.

The moving image editing / reproducing apparatus 301 is an apparatus that edits and reproduces a moving image realized in the form of an HDD / DVD recorder or the like. This apparatus includes a subject position / date / time information reading unit 303, a subject position / date / time information recording unit 305, a shooting information / shooting movie data reading unit 306, a shooting information / shooting movie data recording unit 309, and a processing unit of a movie processing editing unit 310. And a system control CPU 302 for comprehensively controlling these processing units.

The subject position / date / time information reading unit 303 is a processing unit that reads the subject position / date / time information 104 sent from the subject position / date / time information sending unit 106 of the subject portable device 101, and is a shooting information acquisition unit in the video editing / playback device 301. Yes, it has information reading means corresponding to information sending means such as USB, IrDA and Bluetooth in the subject position / date and time information sending unit 106 of the subject portable device 101.

The shooting information / shooting movie data reading unit 309 is a processing unit that reads shooting information and shooting movie data recorded in the shooting information / shooting movie data recording medium 211 recorded by the moving image shooting device 201. Reference numeral 301 denotes a photographing information acquisition unit.

The subject position / date / time information 304 read by the subject position / date / time information reading unit 303 is recorded by the subject position / date / time information recording unit 305 in an internal memory such as an HDD or a flash memory in the video editing / playback device 301. The

The shooting information 307 and shooting movie data 308 read from the shooting information / shooting movie data reading unit 309 are stored in the HDD or flash memory in the movie editing / playback device 301 by the shooting information / shooting movie data recording unit 309. Recorded in memory.

Next, the moving image processing editing unit 310 performs moving image processing and editing. The moving image processing editing unit 310 includes a subject image position calculation unit 311 with respect to the playback screen, a determination unit 312 that determines whether the subject image falls within the playback screen, a determination result recording unit 313, a determination corresponding scene collection unit 314, and a video editing unit 315. Have.

The subject image position calculation unit 311 with respect to the playback screen calculates the position of the subject image with respect to the screen of each frame constituting the captured moving image. This calculation is performed using information on the shooting position, shooting direction, and shooting magnification in the subject position information 304 and shooting information 305.

Next, using this calculation result, the determination unit 312 determines whether or not the subject image is in the playback screen. Done.

The determination result made for each frame of the captured moving image is recorded in an internal memory such as an HDD or a flash memory in the moving image editing / playback apparatus 301 by the determination result recording unit 313.

Next, in the determination corresponding scene collection unit 314, using the information on the determination result for the configuration frame of the captured moving image recorded by the determination result recording unit 313, the captured moving image configuration determined that the subject image is included in the screen Image data corresponding to the frame is collected from the captured moving image data 308.

Next, the moving image editing unit 315 performs an editing process for connecting the image data corresponding to the frame determined to contain the subject image in the screen collected by the determination relevant scene collection unit 314 described above. Movie data 316 is generated.

A user of the system of the present embodiment can view a moving image in which a scene in which a subject of interest is included in the screen is collected by playing back the generated moving image data 316.

Next, a processing procedure for moving image editing / playback will be described with reference to FIG.
In step S401, the subject position / date / time information reading unit 303 of the moving image editing / playback apparatus 301 reads the subject position / date / time information 104 recorded in the subject portable device 101, and the subject position / date / time information recording unit 305 reads the subject position / date / time information. Record the information.

In step S402, the use of the moving picture photographing apparatus 201 for photographing a subject is not limited to one, and any number of moving picture photographing apparatuses 201 can be used. In the moving image editing / playback processing, moving image processing is sequentially performed for each of the used moving image photographing apparatuses 201 one by one. In this step, the first moving image shooting apparatus 201 is set as a processing target moving image shooting apparatus.

In step S403, the shooting information / shooting movie data reading unit 306 of the movie editing / playback apparatus 301 performs shooting information on the shooting information / shooting movie data recording medium 211 recorded by the movie shooting apparatus 201 set as the processing target. 307 and the captured moving image data 308 are read out, and the read information / data is recorded by the shooting information / captured moving image data recording unit 309.

In step S404, in the moving image editing / playback processing, the processing is sequentially performed one frame at a time for each frame constituting the captured moving image data 209 captured by each moving image capturing apparatus 201. In this step, the first frame of shooting is set as a processing target frame.

In step S405, processing is performed on the frame set as the processing target. The contents of this process will be described in steps S501 to S506.
In step S406, it is determined whether or not the processing target frame is the last frame in the captured moving image data 308.
In step S407, if it is determined in step S406 described above that the processing target frame is not the final frame in the captured moving image data 308, the next frame in the captured moving image data 308 is set as the processing target frame. Then, the process returns to the process S405 for the target frame.

In step S408, if it is determined in step S406 described above that the processing target frame is the last frame in the captured moving image data 308, it is determined whether there is another moving image capturing device 201 to be processed. .

In step S409, if it is determined in step S408 described above that there is another moving image shooting apparatus 201 to be processed, the next moving image shooting apparatus 201 is set as the moving image shooting apparatus to be processed.

In step S410, when it is determined in step S408 described above that there is no other video shooting device 201 to be processed, that is, when the processing for all the video shooting devices 201 to be processed is completed, A frame ID for identifying a frame recorded in step S506, which will be described later, a determination result for the frame, and information on the shooting date and time corresponding to the frame are read out.

In step S411, reproduced images corresponding to the frames determined to contain the subject image in the screen from the information read in step S410 described above are collected from the captured moving image data 308. In the captured video data 308, corresponding shooting date / time information is added to the constituting frame, and the shooting corresponding to the frame in which the subject image is determined to be included in the screen in step S410 described above. Since the date / time information is obtained, the determined frames can be collected from the captured moving image data 308.

In step S412, the image data of the frame determined to contain the subject image in the screen collected from the captured moving image data 308 in step S411 described above is connected to generate one moving image data 316. .

Next, the internal processing of step S405 for the target frame will be described.
In step S501, shooting date / time information is added to the captured moving image data 308 for each frame constituting the frame. In this step, shooting date / time information corresponding to the processing target frame in the shooting moving image data 308 is extracted. This processing is performed in the subject image position calculation unit 311 with respect to the playback screen.

In step S502, subject position information corresponding to the shooting date / time information extracted in step S501 is acquired from the subject position / date / time information 304. This processing is performed in the subject image position calculation unit 311 with respect to the playback screen.

In step S503, shooting information (shooting position, shooting orientation, and shooting magnification information) corresponding to the shooting date / time information extracted in step S501 is acquired from the shooting moving image data 308. This processing is performed in the subject image position calculation unit 311 with respect to the playback screen.

In step S504, the subject image with respect to the frame screen constituting the captured moving image data 306 is obtained from the subject position information acquired in step S502 and the shooting information (shooting position, shooting direction, and shooting magnification information) acquired in step S503. The position of is calculated. This processing is performed in the subject image position calculation unit 311 with respect to the playback screen.

In step S505, it is determined from the information on the position of the subject image with respect to the frame screen calculated in step S504 described above whether or not the subject image enters the frame screen. This process is performed by the determination unit 312 as to whether or not the subject image is within the reproduction screen.

In step S506, based on the determination made in step S505 described above, the frame ID information for identifying the frame, the determination result for the frame, and the shooting date and time information corresponding to the frame are stored together. This processing is performed in the determination result recording unit 313.

In the following, other examples and modifications of the above are listed.
1. The determination in step S505 is not limited to the determination contents described in the embodiment, and the following contents may be determined. Both relate to setting values for determining whether or not the subject image is to be obtained.

-Comparison of the distance between the subject and the camera and the preset distance
-Compare the estimated size of the subject image in the playback screen with the size of the preset size. For the size of the subject image in the playback screen, set the subject height in advance. It is possible to estimate using information on the distance between the photographing devices and photographing magnification.
-Whether or not the position of the subject image is within a preset area on the playback screen. This makes it possible to collect scenes as shown below.
-Scenes where the subject is shot from a distance closer than the set distance
-Scenes where the subject image is larger than the preset size in the playback screen
-Scene where the subject image is in the area near the preset center in the playback screen. It is also possible to add an automatic editing operation in step S412 of the moving image editing in which the moving image data 316 is generated by connecting by the editing operation by the manual adjustment of the determination corresponding scene automatically collected in step S411.

  The contents of this manual adjustment are based on the judgment scenes automatically collected in step S411, and some scenes are excluded from the judgment scenes automatically collected by the intention of the user of this system. Adjustments such as adding other scenes selected by the user.

3. Regarding the content of the recording means by the shooting information / shooting video data recording unit 210, the shooting information 208 and the shooting movie data 209 may be recorded on the same recording medium such as a DVD, or the shooting information 208 is recorded on a memory card and shot. The moving image data 209 may be recorded on a separate recording medium such as recording on a DVD.

4). A means for sending the subject position / date / time information 104 from the subject position portable device 101 by the subject position / date / time information sending unit 106 and a means for reading this by the subject position / date / time information reading unit 303 of the video editing / playback device 301 are implemented. In the example, wired communication such as USB and wireless communication such as IrDA and Bluetooth are described. As for the sending and reading means, the subject position / date / time information sending unit 106 writes information to a recording medium such as a memory card, and the subject position / date / time information reading unit 303 of the moving image editing / playback apparatus 301 uses the recording medium. It may be realized by reading out.

5). In the embodiment, it is described that the shooting information 208 and the shooting movie data 209 are recorded in the shooting information / shooting movie data recording medium 211 such as a DV tape, a DVD, or a memory card in the movie shooting apparatus 201. The recording information 208 and the captured moving image data 209 recorded in an internal recording device 201 such as an HDD and transferred to the moving image editing / playback device 301 may be performed using a communication means such as USB.

6). An image such as an arrow or a circle indicating the position of the subject image may be superimposed on the playback screen using the calculation result of the subject position with respect to the playback screen.
As described above, the moving image editing / playback system includes the subject position / date / time information reading unit 303, the shooting information / shooting moving image data reading unit 306, and the calculation unit 311 of the position of the subject image with respect to the playback screen, so that the subject image is displayed in the playback screen. A system capable of determining whether or not to enter is provided.

  In addition, for this system, scenes containing subject images in the playback screen are automatically collected from moving image data shot by a plurality of shooting devices based on the above determination result, and one moving image is manually created. The data 316 can be edited and played back.

  With parents working together, you can rent a video recording medium of a video taken by another person from a different location, and the scene in which your child appears in the video recording video of the borrowed video By manually searching and manually editing a video that is linked to the scene where the child appears in the captured video, the child captured from various shooting locations It was possible to create and watch a movie that collected scenes. However, it is very cumbersome and time-consuming to perform all such editing work manually.

  In the present embodiment, a scene in which a subject image of interest such as a child is in the screen is automatically determined from a plurality of captured moving images taken from different places with different photographing devices, and the subject image is determined. By automatically collecting the image data of the scene in the screen and providing the means to automatically generate the video data that connects the collected image data, it is very easy to do various operations without any trouble. It is possible to create a moving image in which scenes that include a subject of interest such as a child are captured from captured moving images shot from a suitable shooting location.

  In summary, in a video editing / playback system, a subject position / date / time information readout unit, shooting information / captured video data readout unit, and a computation unit for the position of the subject image with respect to the playback screen can be provided to determine whether or not the subject image enters the playback screen. Based on the result of the above determination, the system that can determine whether or not the scene containing the subject image in the playback screen is automatically collected from the moving image data shot by a plurality of shooting devices. It is possible to edit and reproduce one moving image data.

In the system of the present embodiment, for example, in a home video of a child's athletic meet, a scene in which a subject image such as a child to be noticed is included in the playback screen automatically from moving image data shot by a plurality of video cameras. By collecting and allowing the collected scenes to be manually edited into one moving image data, the efficiency of the user's moving image data creation can be greatly improved.

The present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention.
Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements according to different embodiments may be appropriately combined.

1 is an overall system configuration diagram showing an embodiment of the present invention. Processing flow of moving image editing / reproduction of the embodiment. The partial process flow of the animation edit reproduction | regeneration used for the Example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 ... Subject portable apparatus, 102 ... Subject position detection part, 103 ... Year / month / day / time measurement part, 105 ... Subject position / date / time information recording part, 106 ... Subject position / date / time information sending part, 201 ... Moving picture photographing apparatus, 202 DESCRIPTION OF SYMBOLS ... Shooting position detection part, 203 ... Shooting direction detection part, 204 ... Shooting magnification variable means, 205 ... Shooting magnification detection part, 206 ... Date / time measurement part, 207 ... Movie shooting part, 210 ... Shooting information / shooting movie Data recording unit 301 ... Movie editing / playback apparatus 302 ... System control CPU 303 ... Subject position / date / time information reading unit 305 ... Subject position / date / time information recording unit 306 ... Shooting information / shooting video data reading unit 309 ... shooting information / shooting movie data recording unit 310 ... moving image processing editing unit.

Claims (5)

A subject identification information acquisition unit for acquiring identification information of the moving subject;
A video information recording unit that records shooting information of the moving subject in association with shooting moving image data of the moving subject;
A moving image editing / reproducing system comprising: a calculation unit that calculates a position of a subject image with respect to a reproduction screen of the photographed moving image data from the identification information and the photographing information.   The moving image editing / reproducing system according to claim 1, wherein editing is performed so as to collect scenes containing subject images in a reproduction screen from the captured moving image data based on the calculation.   A subject portable device that has a subject identification information acquisition unit that acquires identification information of a moving subject and works to transmit this identification information to an external video editing / playback device.   A moving image shooting apparatus having a video information recording unit for acquiring shooting information of a moving subject and recording it in association with shooting moving image data, and transmitting the shooting information and the shooting moving image data to an external moving image editing / playback apparatus.   An identification information acquisition unit for acquiring identification information of a moving subject from an external subject portable device, a shooting information acquisition unit for acquiring shooting information recorded in association with shooting moving image data of the moving subject from an external moving image shooting device, A moving image editing / reproducing apparatus comprising: a calculation unit that calculates a position of a subject image with respect to a reproduction screen of the captured moving image data from the identification information and the shooting information.

Images