JP2011259265A - Video image recording/replaying device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video image recording/replaying device capable of extracting a video image scene of a specified area on the map and playing/editing it based on the position information of the subject and the photographing date and time thereof.SOLUTION: Two points that are a point A (Xa and Ya) and a point B (Xb and Yb) are specified by an area specification part 8 from a map on a display device 10, specifying a square area C with the two points as a diagonal line. The square area C is transmitted to a scene extraction part 9. The scene extraction part 9 arranges scenes of the square area C extracted from a position database 7 from entering the square area C to exit in chronological order as one scene, and displays the head of each scene by a thumbnail 101 under the map information of the display device 10.

Description

  The present invention relates to a video recording / reproducing apparatus for recording and reproducing a moving image, and more particularly to a video recording / reproducing apparatus capable of editing and reproducing a recorded video.

  In recent years, photographic devices such as photographic cameras and video cameras have been digitized, and together with captured images, meta information such as shooting date / time, shooting position using GPS (Global Positioning System), shooting conditions such as camera shake, etc. is recorded at the same time. It can be done.

  Along with that, the thumbnails of the recorded video clips are displayed on the calendar and organized in a visual and easy-to-understand order by date and time, and thumbnails are displayed on the map at the shooting location. A method of organizing videos at shooting locations has been proposed.

  For example, in Japanese Patent Laid-Open No. 2004-260688, the video clip, which is a unit from the start of shooting to the end of the shooting, and the map information recorded at the same time at the start of shooting, the thumbnail of the video clip is displayed on the map and the intuition of selecting a thumbnail on the map is selected. A method has been proposed in which a desired video can be reproduced by a typical operation and editing can be performed by an intuitive operation of selecting and arranging thumbnails.

Japanese Patent Laying-Open No. 2005-110111 (page 16, FIG. 5)

  However, with conventional video recording / playback devices, when shooting with a fixed camera position and shooting continuously for a long time, such as sports shooting, the shooting position information does not indicate the position of the subject. Cannot be played or edited.

  Also, the shooting time of the video clip is long, and the position of the subject continues to move during that time, so when editing the shot video, it is necessary to play the entire video and find the editing point, and the editing work becomes complicated There is.

  The present invention is to solve the above technical problems, and at the time of shooting, the head of the video clip and the position of the subject are recorded at regular intervals together with the video, and the position information of the subject and the shooting date and time are recorded. It is an object of the present invention to provide a video recording / playback apparatus capable of extracting and playing back / editing a video scene in an area on a specified map based on the above.

  In order to achieve the above object, a video recording / reproducing apparatus of the present invention includes a map database in which map information is stored, display means for displaying map information, and a position on a map on which an imaging position of the imaging means is displayed. The position information acquisition means associated with the information, the direction detection means for detecting the shooting direction of the imaging means, the distance detection means for calculating the distance from the imaging means to the subject, and the area on the map displayed on the display means are designated. A range specifying unit; and a scene extracting unit that extracts a video related to an area on the map specified by the range specifying unit at regular intervals. From the information of the position information acquiring unit, the direction detecting unit, and the distance detecting unit In addition, the position of the subject at regular intervals is acquired, and a part of the extracted scene is displayed as a thumbnail on the display means.

  As a result, it is possible to reproduce and edit the scene at the position of the subject at regular intervals.

  The video recording / playback apparatus of the present invention can automatically extract and play back a video of a subject in a specific range on a map selected in a visually easy-to-understand form called a map. In soccer, if an area near the goal position is designated, a shot scene can be quickly extracted and reproduced / edited.

  Also, it is possible to detect specific subjects such as balls and specific people and register the time and position in which these subjects are reflected in the database. You can easily collect, shoot, and play / edit scenes.

Configuration diagram of video recording / reproducing apparatus in Embodiment 1 of the present invention The figure which shows the display screen of the video recording / reproducing apparatus Explanatory drawing of position database The figure for demonstrating the calculation method of the to-be-photographed object position of the video recording / reproducing apparatus Flowchart showing scene extraction operation of the video recording / reproducing apparatus

  Hereinafter, embodiments of the present invention will be described with reference to FIGS.

(Embodiment 1)
FIG. 1 is a block diagram showing a video recording / reproducing apparatus according to Embodiment 1 of the present invention, in which 1 is an imaging unit that takes a video by focusing on a subject (not shown), and 2 is an ultrasonic wave. A distance detection unit that measures the distance between the imaging device 1 and the subject by measuring the time from transmission to reception of a sound wave using a displacement sensor, 3 utilizes the MI (Magneto-Impedance) effect of an amorphous material An azimuth detecting unit that detects an azimuth of a subject using an azimuth sensor such as an electronic compass IC, and 4 is a position for acquiring position information of the imaging unit 1 using a GPS that is a position measuring system using an artificial satellite. An information acquisition unit 5 identifies and detects a subject of a color and shape designated in advance from the subject from the video from the imaging unit 1, and 6 indicates a time at which time information is acquired. The acquisition unit 7 registers the information of the distance detection unit 2, the direction detection unit 3, the position information acquisition unit 4, and the time acquisition unit 6 in the database at the start of recording, when a specific subject is detected by the subject identification unit 5, or at regular intervals. This is a location database.

  Reference numeral 8 denotes a range designating unit for designating a specific range of map information from the map database 11 displayed on the display device 10, and 9 denotes a video within the range of the position information designated by the range designating unit 8. This is a scene extraction unit that extracts a scene from the video recording unit 12 having a recording medium such as an HDD based on information in the database 7.

  In the video recording / reproducing apparatus configured as described above, the video captured by the imaging unit 1 is recorded in the video recording unit 12 with the information of the time acquisition unit 6 added thereto.

  In addition, the position information of the subject photographed at regular intervals after the start of photographing is recorded in the position database 7 together with the time information.

  The position information of the subject is obtained by the distance and orientation detection unit 3 from the imaging device 1 acquired by the distance detection unit 2 to the position information indicated by the latitude and longitude of the imaging device 1 acquired by the position information acquisition unit 4. It is calculated by adding the difference between the latitude and longitude of the subject calculated from the azimuth.

  Further, when the subject identifying unit 5 detects a specific subject having characteristics such as color and shape, which has been designated in advance from the image of the imaging unit 1, detection information is also added together with the position information of the subject.

  In this way, position information that changes with the passage of time of the subject is recorded in the position database 7, and a specific scene is extracted based on this information as follows.

  First, as shown in the display screen of FIG. 2, map information near the shooting location is acquired from the map database 11 and displayed on the display device 10. The map database 11 includes detailed drawings of the ground such as a soccer field and a baseball field, and the display on the display device 10 can be enlarged to display details until the goal or home base can be identified.

  The range designation unit 8 designates two points, point A (Xa, Ya) and point B (Xb, Yb), from the map on the display device 10, and designates a rectangular region C having the two points as diagonal lines. Here, X and Y indicate latitude and longitude. This rectangular area C is sent to the scene extraction unit 9, and the scene extraction unit 9 from the position database 7 as shown by the trajectory T, chronologically assumes that the subject P enters and exits the rectangular area C as a scene. The head of each scene is displayed as a thumbnail 101 below the map information on the display device 10.

  The scene extraction unit 9 filters the scene in which the specific subject detected by the subject identification unit 5 is captured from the scenes in the rectangular area C, and displays the thumbnails in time series on the display device 10. Can be displayed side by side.

  In the present embodiment, the thumbnail 101 is displayed below the map information of the display device 10, but the display location may be anywhere on the display screen, for example, it may be superimposed on the map information. Absent.

  At the time of reproduction, a video corresponding to the recording time of the extracted scene is taken out from the video recording unit 12 and output to the display device 10.

  FIG. 3 is an explanatory diagram showing an example of the position database 7 of FIG. 1. The time when the position data of the subject is acquired is registered in the column 71, the latitude of the subject is stored in the column 72, and the longitude of the subject is stored in the column 73. Is registered in units of frequency.

  Also, the presence or absence of a specific subject at the time of position data acquisition is described in column 74 as 4-bit information. Here, four patterns of specific subjects are registered, one specific subject is indicated for each bit, and a column value of “0000” indicates that there is no specific subject in the video. “0101” means that there are two specific subjects.

  FIG. 4 is a diagram for explaining a method of calculating latitude (X) 72 and longitude (Y) 73 indicating the subject position in FIG.

The position of the imaging device 1 acquired from the position information acquisition unit 4 is G (X0, Y0), the distance between the imaging device 1 detected by the distance detection unit 2 and the subject is L, and the imaging device 1 detected by the direction detection unit 3 is If the shooting direction is θ, the position P (Xp, Yp) of the subject is
Xp = (L × cos (θ)) / 111,111 + X0,
Yp = (L × sin (θ)) / (111, 111 × COS (θo)) + Y0
Calculated by

  Here, the unit of latitude X and longitude Y is degrees, and the unit of distance L is meters (m). θo indicates the latitude of the measurement point. Here, the latitude is calculated as 111, 111 m.

  FIG. 5 is a flowchart showing an embodiment of the scene extraction procedure of the scene extraction unit 9 of FIG.

  First, in step 911, initialization is performed, and in step 912, 1 is added to the scene number i.

  In step 913, the time Tsi that enters the rectangular area C is searched. Since the first time Te1 is 0:00, the search starts from the recording start time.

  In step 914, a time Tei that leaves the rectangular area C after the time Tsi is searched. This is repeated until the end of the video, and a plurality of scenes (Si) from entering the rectangular area C to exiting are extracted and stored in the video recording unit 12 (step 915).

  Here, the scene from entering the rectangular area C to exiting is taken as one scene, but it is also possible to extract a video of an arbitrary time before and after the time of entering the rectangular area C as one scene.

  As described above, in the video recording / playback apparatus according to the present embodiment, the video of the subject in the specified range on the map selected in a visually easy-to-understand form called a map is automatically extracted from a large number of captured videos. Therefore, for example, in soccer, if an area near the goal position is designated, a shot scene can be quickly extracted and reproduced / edited.

  It is also possible to detect subjects such as balls and specific people in advance and register the time and position of those subjects in the database, so the ball is registered as a specific subject and the ball is at the goal position. If scenes are extracted for about 5 seconds before the video, it is easy to collect, play, and edit scenes with only the goal scene.

  The video recording / reproducing apparatus according to the present invention can be applied to a video camera that can shoot a moving image and a digital camera that takes a picture. Further, it can be applied to a BD / DVD recorder and PC application software that can be played back and edited.

DESCRIPTION OF SYMBOLS 1 Image pick-up part 2 Distance detection part 3 Direction detection part 4 Position information acquisition part 5 Subject identification part 6 Time acquisition part 7 Position database 8 Range designation part 9 Scene extraction part 10 Display apparatus 11 Map database 12 Image | video recording part 101 Thumbnail

Claims (8)

An imaging means for capturing an image of a subject;
A map database storing map information;
Display means for displaying the map information;
Position information acquisition means for associating an image pickup position of the image pickup means with position information on the displayed map;
Azimuth detecting means for detecting the photographing direction of the imaging means;
Distance detection means for calculating the distance from the imaging means to the subject;
Range designation means for designating an area on the map displayed on the display means;
Scene extracting means for extracting video related to the area on the map specified by the range specifying means at regular intervals;
From the information of the position information acquisition means, the azimuth detection means, and the distance detection means, the position of the subject in the region at a certain time interval is acquired,
A video recording / reproducing apparatus characterized in that a part of the extracted scene is displayed as a thumbnail on the display means. 2. The video recording / reproducing apparatus according to claim 1, wherein the scene extracting unit extracts a continuous video in an area on the map designated by the range designating unit as one scene. 2. The video recording / reproducing according to claim 1, wherein the scene extracting unit extracts a video of an arbitrary time before and after the video that has entered the area on the map designated by the range designating unit as one scene. apparatus. 2. The video recording / reproducing according to claim 1, wherein the scene extracting unit extracts a video of an arbitrary time before and after the video extracted from the area on the map designated by the range designating unit as one scene. apparatus. 5. The video recording / reproducing apparatus according to claim 1, wherein the thumbnail is displayed in the vicinity of the map information. 6. The video recording / reproducing apparatus according to claim 5, wherein the thumbnail is displayed below the map information. 6. The video recording / reproducing apparatus according to claim 5, wherein the thumbnail is displayed while being superimposed on the map information. 2. The video recording / reproducing apparatus according to claim 1, further comprising subject identification means for discriminating a video having a subject having the same color or shape as one or more subjects designated in advance.

Images