JP5746478B2 - Data processing apparatus, data processing method, and program - Google Patents

Description

  The present invention relates to an image display technique for displaying video data divided and recorded on a plurality of recording media.

  In recent years, a recording medium for recording video shot by a video camera or the like has changed from a magnetic tape to a file-based recording medium using a hard disk or a flash memory. Since video data recorded on such a file-based recording medium can be handled as a file, it can be retrieved and retrieved when necessary.

  On the other hand, as a video file format for broadcasting and business use, there is MXF (Material eXchange Format) standardized by Society of Motion Picture & Television Engineers (SMPTE). The MXF standard is composed of a plurality of standards such as a format for converting video data and audio data into a file, and a definition of metadata. Recently, broadcast and commercial video cameras capable of recording MXF files on a recording medium have become widespread.

  Some video cameras that support the MXF standard, such as a CF card (registered trademark), can be used by simultaneously mounting a plurality of removable memory cards. In such a video camera, if the remaining capacity of the memory card of the recording destination is insufficient while shooting a certain scene, the recording destination is automatically switched to another memory card and shooting is continued. There are models that can do this (hereinafter referred to as relay recording). Individual video data (hereinafter referred to as relay clips) recorded separately on a plurality of memory cards by this relay recording can be combined and converted into a single video data by a dedicated video editing application after shooting.

  In such video editing, the user confirms the video icon (thumbnail) for each relay clip displayed on the display, and the individual video (hereinafter, also referred to as a video clip) that is relay-recorded during one shooting. Select. Here, many techniques for making it easy to grasp the contents of a video clip recorded by relay from the thumbnails of individual relay clips have been proposed.

  For example, in Patent Document 1, for a plurality of frame groups extracted from video data, each frame is compared in pixel units, the number of matching pixels is counted, and the count value of the pixels is maximized. A method for selecting a thumbnail from a group of frames has been proposed. As a result, the user can select a video clip that has been relay-recorded while grasping the content by viewing the thumbnail.

JP 2007-201643 A

  In the case of broadcasting and commercial video shooting, a memory card is often used to record a large number of videos in one shooting. Therefore, at the time of editing, the user checks thumbnails of video clips relay-recorded on a plurality of memory cards in order to select relay clips related to each other. However, in such an operation, the order of the memory cards to be read does not always follow the order in which the relay clips are recorded, so it is very troublesome to collect related relay clips.

  The present invention has been made in view of the above problems, and an object of the present invention is to realize a technique for displaying a list of videos recorded in a plurality of recording media when shooting.

In order to solve the above problems and achieve the object, a data processing apparatus of the present invention is a data processing apparatus that reads video data recorded on a plurality of recording media at the time of shooting, and the video recorded on the recording medium Presentation means for presenting image information representing data, designation means for designating at least one of the image information presented by the presentation means, and video data corresponding to the image information designated by the designation means once Determination means for determining whether the divided video data is divided and recorded on a plurality of recording media in the shooting, and when the video data corresponding to the image information specified by the specifying means is the divided video data, the recording medium that records the divided video data to which the designated recorded by dividing into another recording medium, other minute continuing to divide the video data to which the designated List of the order in which the retrieval means for retrieving video data, image information representing the other of the divided video data continuously to the divided image data to which the designated where Ri retrieved by said retrieval means, which is divided and recorded at the time of shooting And a control means for controlling the presenting means so as to present it.

  According to the present invention, it is possible to reduce a load for searching a series of video data recorded in a divided manner on a plurality of recording media.

The block diagram which shows the structure of the data processor of embodiment which concerns on this invention. The directory structure figure of video data and metadata. The schematic block diagram of the relay clip and metadata which were recorded on the some memory card. The flowchart which shows operation | movement of the data processor of this embodiment. The block diagram of the media registration table produced | generated by the data processor of this embodiment. (A) is a figure which illustrates the screen which displayed the video clip in a memory card, (b) is a figure which illustrates the operation screen for displaying a relay clip. The flowchart which shows the relay clip search process of this embodiment. (A) is a figure which illustrates the screen which displayed the list of relay clips, (b) is a figure which illustrates the screen when arbitrary relay clips are selected from the relay clip displayed by the list. (A) is a figure which illustrates the operation screen for backing up the video clip in a memory card, (b) is a figure which illustrates the screen which displayed the backup result. The block diagram of the media registration table updated after virtual media creation. (A) illustrates a screen when a search for a relay clip fails when a memory card is not detected, and (b) illustrates a screen when a search for a relay clip fails while a memory card is detected. To do.

  EMBODIMENT OF THE INVENTION Below, the form for implementing this invention with reference to an accompanying drawing is demonstrated in detail. The embodiment described below is an example for realizing the present invention, and should be appropriately modified or changed according to the configuration and various conditions of the apparatus to which the present invention is applied. It is not limited to the embodiment.

  [Embodiment 1] Hereinafter, an embodiment in which the data processing apparatus of the present invention is realized by a personal computer (PC) will be described. Note that the data processing apparatus of the present embodiment is configured so that individual divided video data (relay clips) generated by dividing and recording video data continuously captured by an imaging device such as a digital video camera on a plurality of recording media. ) To search for relay clips that are related to each other, and display them in a list so that they can be edited and played back, such as combining and deleting.

  <Apparatus Configuration> First, the internal configuration of the PC of this embodiment will be described with reference to FIG. In FIG. 1, reference numeral 101 denotes a CPU that controls the entire PC 100. The CPU 101 controls each unit, which will be described later, according to a user operation, and reads, copies, deletes, or reproduces video data recorded in accordance with the MXF standard and metadata as additional information thereof. Reference numeral 102 denotes a memory (ROM) for storing a program for controlling the PC 100 and data used by the program. The ROM 102 includes a relay clip determination program (hereinafter referred to as a determination program) for determining whether or not the read video clip is a relay clip that is divided and recorded on a plurality of recording media. Further, the ROM 102 includes a relay clip search program (hereinafter referred to as a search program) that searches for a part of the relay clips on another recording medium regarding the relay clips selected by the user.

  Reference numeral 103 denotes a rewritable memory (RAM) that is used as a work area by a program that controls the PC 100. A hard disk drive (HDD) 104 stores various data used by the PC 100. Reference numeral 105 denotes an external interface (external IF) for reading or writing data recorded on the external recording medium 111 in accordance with an instruction from the CPU 101. The external IF 105 includes a memory card slot, a USB terminal, and the like, and controls reading and writing of data with respect to the connected recording medium 111. As the recording medium 111, a removable medium (hereinafter referred to as a memory card) such as a CF (registered trademark) card or an SDHC memory card is applied.

  Reference numeral 106 denotes a user interface (designating means) for transmitting user instructions to the PC 100. The user IF 106 is composed of, for example, a keyboard and a mouse. A VRAM 107 is used as a buffer until the screen rendered by the image processing unit 108 described below is scanned. An image processing unit (presentation unit) 108 receives the coordinates of image data drawn on the screen from the CPU 101, calculates the display position of each dot on the image, and temporarily stores the information in the VRAM 107. The image processing unit 108 reads information in the VRAM 107 at a predetermined timing and transfers the information to the display control unit 109 described below.

  Reference numeral 109 denotes a display control unit that converts the data stored in the VRAM 107 into a digital signal that can be displayed on the display and transfers it. Reference numeral 110 denotes a display that displays data output from the PC 100. Reference numeral 112 denotes a transmission path for control signals or data signals between the respective units.

  <Directory Configuration> Next, the directory configuration of video data read by the PC 100 from the memory card 111 and metadata as additional information thereof will be described with reference to FIG. Here, a file group recorded in the directory structure as shown in FIG. 2 is defined as “media”. For example, when the PC 100 detects the connection of the memory card, if it is confirmed that there is a file under the CONTENTS directory immediately under the root directory of the memory card, the memory card is recognized as one medium.

  Hereinafter, the directories and files shown in FIG. 2 will be described. MediaIndex. The IDX file is a file in which information in the medium is recorded. In this file, Media_ID as medium identification information that can uniquely specify a recording destination memory card and information of a video clip recorded on the medium are described.

  AA0001, AA0002, and AA0003 are directories, and their names are Clip_ID as data identification information for uniquely determining a video clip. In this directory, a file (AA0001 to AA0003.CMI) in which video clip metadata is recorded and an MXF file (AA0001 to AA0003.MXF) are further stored.

  In this embodiment, it is assumed that shooting is performed with a video camera using four memory cards in advance. Here, a file is recorded in any of the memory cards in the directory structure shown in FIG. 2, and among the video clips in three memory cards, one relay clip that is relay-recorded at one shooting is recorded. It shall be included one by one.

  FIG. 3 exemplifies relay clips and metadata recorded on three memory cards in which relay clips exist among four memory cards on which video data is relay-recorded. In FIG. 3, reference numerals 201, 202, and 203 denote three memory cards. Media_IDs of the memory cards 201 to 203 are AAAA, BBBB, and CCCC, respectively. The area of each rectangle indicated by 204, 205, and 206 represents the total capacity of each memory card. Of these, the capacity occupied by the relay clip that is divided and recorded on each memory card by one relay recording is shown. , R1, R2, and R3. Clip_IDs of these relay clips are AA0005, BB0001, and CC0001, respectively. For reference, the first frames 207, 208, and 209 of the relay clips are shown.

  Reference numerals 210, 211, and 212 are details of the metadata of each relay clip. Relay_Previous_Media_ID and Relay_Next_Media_ID are Media_IDs of the relay clips recorded immediately before and after each relay clip. Also, Relay_Previous_Clip_ID and Relay_Next_Clip_ID are Clip_IDs of relay clips recorded immediately before and after each relay clip. However, when there is no corresponding relay clip, the value of FFFF is described for these IDs. The metadata is described in a file (extension CMI) in which video clip metadata is recorded.

  <Operation of PC> Next, the operation of the PC 100 will be described with reference to FIG. In the following, description will be given assuming that the PC 100 has already been activated.

  In S101, when the user inserts four memory cards into a memory card slot (not shown), the external IF 105 detects the memory card and notifies the CPU 101 of it. Here, the CPU 101 detects a medium and starts a search program.

  In S102, the search program creates a media registration table shown in FIG. This table is referred to in the relay clip search process described later. In order to create this table, the search program acquires Media_ID from the memory card, and further acquires the location (drive name) where the detected medium exists via the CPU 101.

  In S103, the PC 100 displays the media information (media ID and drive name) acquired from each detected memory card and the video clip information recorded therein on the display 110 (presenting means). FIG. 6A illustrates a screen presented to the user. In FIG. 6A, reference numeral 301 denotes an area for displaying detected media information. An area 302 displays image information such as a thumbnail of the first frame of a video clip recorded in the medium selected by the user. Reference numeral 303 denotes an area for reproducing and displaying a video clip selected by the user. Reference numeral 304 denotes a control button for accepting various operations during reproduction by the user.

  The user can select any of the areas 301 to 304 and play an arbitrary video clip. In the screen example of FIG. 6A, a medium (Media_ID AAAA) existing in the F drive is selected, and a video clip (Clip_ID AA0001) recorded therein is reproduced. Here, in order to make the correspondence relationship with Clip_ID easy to understand, the clip name of the thumbnail displayed in the area 302 is made to match Clip_ID. However, since the clip name is managed independently of Clip_ID, the user can arbitrarily set the clip name. The name can be changed.

  In S <b> 104, it is confirmed whether a user operation has been performed on the screen presented in S <b> 103 (waiting for a user operation), and when there is a user operation, the CPU 101 receives a notification from the user IF 106.

  In S105 and S106, the PC 100 executes the process corresponding to the user operation until there is an instruction to end the process in S104, and repeats the processes from S103 to S106.

  Next, an operation for displaying a list of relay clips related to the video clip (Clip_ID AA0005) selected by the user on the screen of FIG. 6A will be described. FIG. 6B illustrates an operation screen for displaying a relay clip. The user selects a video clip with Clip_ID AA0005 on the screen of FIG. 6B and opens a context menu 401. Among the items in the context menu 401 is “display relay clip”. When the user selects “display relay clip”, the PC 100 searches for a relay clip including the selected AA0005 video clip from all detected media (relay clip search processing).

  <Relay Clip Search Processing> Here, the relay clip search processing by the PC 100 will be described with reference to FIG. In FIG. 7, in S201, the search program acquires Clip_ID of the selected video clip. In S202, the search program creates a display list of relay clips to be displayed after the search. Then, Clip_ID of the selected video clip and Media_ID of the media on which the video clip exists are registered in the display list.

  In S203, the search program acquires information on the video clip recorded immediately after the selected video clip from the file (extension CMI) in which the video clip metadata is recorded. Here, Relay_Next_Media_ID and Relay_Next_Clip_ID are acquired.

  In S204, the determination program determines the presence of the relay clip recorded immediately after from the Relay_Next_Media_ID and Relay_Next_Clip_ID acquired in S203. If it is determined that the immediately following relay clip exists, the determination program notifies the search program of the Relay_Next_Media_ID.

  In S205, the search program determines whether there is a media corresponding to Relay_Next_Media_ID from the media registration table shown in FIG. 5 created in advance. If the corresponding media exists, the process proceeds to S206.

  In S206, the search program searches for the relay clip corresponding to Relay_Next_Clip_ID from the specified medium, and in S207, the search result is determined. In S208, the search program registers the Clip_ID and Media_ID of the found relay clip in the display list.

  In S205 and S206, a search is performed by specifying a medium corresponding to Relay_Next_Media_ID. The above processing increases the possibility that the search target relay clip can be displayed at high speed.

  On the other hand, if there is no corresponding media in S205, or if there is no corresponding relay clip in S207, the process proceeds to S209. In S209, the search program searches for a media different from the Relay_Next_Media_ID acquired from the media registration table and searches for a relay clip corresponding to the Relay_Next_Clip_ID. This takes into account the case where the relay clip to be searched has been individually moved from the memory card that was first recorded by the user.

  In S210, the search result in S209 is determined, and Clip_ID and Media_ID of the found relay clip are registered in the display list (S208). On the other hand, if not found, in step S211, thumbnails of relay clips registered in the display list are displayed in a list on the screen according to the order of relay recording.

  After S208, the process returns to S203, and the determination program obtains the metadata of the relay clip recorded immediately after the relay clip from the file (extension CMI) in which the metadata of the recently found relay clip is recorded. To do. Here, Relay_Next_Media_ID and Relay_Next_Clip_ID are acquired.

  Thereafter, S203 to S208 are repeated until it is confirmed that there is no relay clip further behind.

  Although FIG. 7 illustrates an example in which the relay clip recorded immediately after the first selected video clip is searched, in practice, the relay recorded immediately before the selected video clip after the above processing. The same processing is executed for the clip. The description is omitted here.

  FIG. 8A illustrates a screen that displays a list of thumbnails of relay clips recorded before and after the video clip selected by the relay clip search process described above. In FIG. 8A, an “R” icon is added to the upper right of the thumbnail in order to make it easy to determine that the displayed video clip is a relay clip. In the screen of FIG. 8A, since the relay clips relay-recorded at the time of shooting are arranged in the order in which Clip_IDs are consecutive, that is, in the order in which they are actually recorded, the user can record the contents of a series of video data relay-recorded. It becomes easy to confirm.

  Further, when the user selects the relay clip with Clip_ID CC0001 on the screen of FIG. 8A, the screen is updated to the screen shown in FIG. In FIG. 8B, the Media_ID that records the selected relay clip is specified, and the selection state of the Media_ID is switched. As a result, the user can easily grasp the media on which the selected relay clip is recorded.

  According to the embodiment described above, it is possible to reduce the load for searching for relay clips recorded on a plurality of memory cards.

  Further, by enabling operations such as selection and reproduction of relay clips on the screen of FIG. 8, operations for sequentially reproducing relay clips can be easily performed. In addition, this is particularly convenient when performing an operation of deleting all relay clips at once or copying them all together to another directory.

  [Embodiment 2] Embodiment 2 will be described below. In the second embodiment, the media data on which the video clip is recorded is backed up, and the PC 100 searches the relay clip by including the backed up data as a search target. The PC 100 according to the second embodiment is substantially the same as the configuration described in the first embodiment, but the ROM 102 includes a data duplication program (duplicating means) for backing up detected media data. This data replication program newly creates a backup directory at an arbitrary location in the drive designated by a user operation or the like. Then, the file groups recognized as media by the method described in the first embodiment are collectively copied under the backup directory of the copy destination while sequentially exchanging the media.

  The backed up file group is recognized as virtual media by the PC 100. This virtual medium is defined as a backup of a group of files recognized as a medium, and is handled in the same manner as a medium by a user. For example, when the virtual media is created in a drive in the HDD 104 as another storage means, the virtual media remains even if the removable memory card as the backup source is removed from the PC 100. Therefore, the user can back up and manage data in a plurality of memory cards without being limited by the number of memory card slots of the PC 100.

  Here, with reference to FIG. 9, a case where data of a medium (memory card) recognized by the F drive is backed up to a virtual medium will be described.

  FIG. 9 illustrates an operation screen (a) for backing up a video clip in the memory card and a screen (b) displaying a backup result. In the screen of FIG. 9A, the medium of the F drive is selected and the context menu 501 is opened. Among the items in the context menu 501 is “Create Backup”. Here, when the user selects “create backup”, the PC 100 copies the data of the media of the selected F drive in association with the virtual media (backup processing). As shown in FIG. 9B, the PC 100 displays an icon 502 representing the initial letter B of backup before the Media_ID in order to clearly indicate that the created medium is a virtual medium.

  When backup creation is instructed in FIG. 9A, the search program creates a media registration table shown in FIG. The Media_ID of the virtual media created here is the same as the backup source media.

  Next, the relay clip search process according to the second embodiment will be described with reference to FIG. In the second embodiment, the same virtual media as the backup source Media_ID is created. In this state, in S205 and S206, when a plurality of media having the same Media_ID are detected, the backup source media is preferentially searched. This is because it is assumed that the user often does not edit the backup source media. Users often move or delete data from video clips in the backup destination virtual media and keep the source media unedited so that the data before editing can be reproduced at any time. Because it is. Therefore, by searching the backup source medium preferentially, there is a high possibility that the search target relay clip can be displayed at high speed.

  Further, even if the user removes the backup source memory card from the above state, the relay clip can be searched for the virtual media that backed up the media.

  According to the above embodiment, the user can back up each of the data recorded on the plurality of memory cards as virtual media in the backup destination storage means while sequentially exchanging the media. As a result, the search for relay clips can be executed without being limited by the number of memory card slots prepared in the PC 100.

  [Embodiment 3] Next, as Embodiment 3, an example in which guidance information is presented to the user when a relay clip to be searched is not detected as a result of the relay clip search processing will be described. The PC 100 in the third embodiment has the same configuration as that described in the first embodiment. In the first embodiment, as illustrated in FIG. 7, an example in which all relay clips recorded on a plurality of memory cards are searched has been described. This is equivalent to repeating the processing of S203 to S209 until the determination in S210 in FIG. 7 becomes “NO”.

On the other hand, the case where the determination in S210 is “NO” indicates that the relay clip to be searched was recorded at the time of shooting, but was not found in the media recognized by the PC 100. Such a case has the following two patterns.
(1) As a result of the determination in S205, it is determined that there is no media that matches the acquired Media_ID (NO in S205).
(2) As a result of the determination in S205, it is determined that there is a medium that matches the acquired Media_ID (YES in S205).
First, the pattern (1) will be described. The pattern (1) occurs when the medium on which the search target relay clip is recorded is not detected. In this case, as shown in FIG. 11A, the media information 602 recorded at the time of shooting the relay clip that failed to be displayed is displayed. This is because the user may be able to find the relay clip to be searched by reconnecting the specified medium to the PC 100 according to the guidance information displayed on the screen.

  Next, the pattern (2) will be described. The pattern (2) occurs when the medium on which the search target relay clip is recorded is detected, but the target relay clip is not found in the medium. In this case, as shown in FIG. 11B, information 603 indicating that the search target relay clip has been deleted from the media is displayed.

  In both cases of the patterns (1) and (2), a thumbnail 601 that informs the user that there is a relay clip that has not been found as a result of the search, and Clip_ID of the relay clip that has not been found are displayed. Here, it is assumed that the image data of the thumbnail 601 to be displayed on the screen is stored in the ROM 102 in advance.

  According to this embodiment, when a search target relay clip is not found, more detailed guidance information can be presented to the user.

  [Modification] In the above-described embodiments, relay recording to a different memory card is assumed. However, when relay clips are recorded in a partition in a memory card or in a different directory or folder, a certain partition ( Alternatively, the present invention can also be applied to a mode in which relay clips recorded in other partitions (or directories and folders) are extracted from a state in which a directory or folder is searched.

  [Other Embodiments] The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads and executes the program code. It is processing to do. In this case, the program and the storage medium storing the program constitute the present invention.

Claims (13)

A data processing device for reading video data recorded on a plurality of recording media at the time of shooting,
Presenting means for presenting image information representing video data recorded on the recording medium;
Designating means for designating at least one of the image information presented by the presenting means;
Determining means for determining whether the video data corresponding to the image information specified by the specifying means is divided video data divided and recorded on a plurality of recording media in one shooting ;
When the video data corresponding to the image information designated by the designation means is the divided video data, the video data is divided into a recording medium different from the recording medium on which the designated divided video data is recorded. recorded, a retrieving means for retrieving other divided image data continuous in the divided video data to which the designated,
Image information representing the other divided image data continuous in the divided video data to which the designated where Ri retrieved by said retrieval means, said presentation means to present a list in the order that has been divided and recorded at the time of shooting And a control means for controlling the data processing apparatus. Additional information is added to the divided video data,
The additional information includes at least one of image information representing the divided video data divided and recorded immediately before the divided video data designated by the designation means and image information representing the divided video data divided and recorded immediately after the divided information. And
The data processing apparatus according to claim 1, wherein the search unit performs a search using the additional information.   The data processing apparatus according to claim 2, wherein the additional information includes data identification information for specifying the divided video data.   4. The data processing apparatus according to claim 3, wherein the additional information includes medium identification information for specifying a recording medium that is a recording destination of the divided video data. A copy unit for copying a predetermined file group recorded on the predetermined recording medium to another storage unit;
5. The search unit according to claim 4, wherein when the plurality of recording media having the same medium identification information are detected, the search unit preferentially searches the divided video data recorded on the copy source recording medium. Data processing equipment.   The control means can detect the recording medium corresponding to the medium identification information included in the additional information of the divided video data designated by the designation means, but cannot detect the divided video data corresponding to the data identification information 6. The data according to claim 3, wherein the presenting means is controlled so as to present medium identification information of a recording medium in which the divided video data that could not be detected is recorded at the time of shooting. Processing equipment.   The control means is unable to detect when neither the recording medium corresponding to the medium identification information included in the additional information of the divided video data designated by the designation means nor the divided video data corresponding to the data identification information can be detected. 7. The data processing apparatus according to claim 3, wherein the presenting unit is controlled to present data identification information of the divided video data. Said retrieval means, said while specifying the divided video data in which the data identification information is continuous, any one of claims 3 to 7, characterized and Turkey to find the divided video data constituting a sequence of image data The data processing apparatus described in 1. The image information representing the video data is a thumbnail of the first frame of the video data,
9. The data processing apparatus according to claim 1, wherein the presenting unit adds a predetermined icon to the thumbnails of the divided video data displayed as a list.   The duplicating means associates the divided video data recorded on each of the plurality of recording media having the same medium identification information with information representing a virtual recording medium while sequentially exchanging the plurality of recording media. The data processing apparatus according to claim 5, wherein the data processing apparatus is duplicated in a storage unit.   11. The data processing apparatus according to claim 10, wherein the presenting means displays image information representing the video data duplicated by the duplicating means together with information representing the virtual recording medium as a duplication destination. A data processing method in a data processing apparatus for dividing and recording captured video data into a plurality of recording media,
A presentation step of presenting image information representing video data recorded on the recording medium;
A designation step for designating at least one of the presented image information;
A determination step of determining whether the video data corresponding to the designated image information is divided video data that is divided and recorded on a plurality of recording media in one shooting ;
When the video data corresponding to the designated image information is the divided video data, the video data is divided and recorded in a recording medium different from the recording medium on which the designated divided video data is recorded. a search step of other divided image data continuous in the divided video data to which the designated searches are either recorded,
And a control step of controlling so as to present the image information representing the other of the divided video data successive to the retrieved divided video data to which the designated were by the searching step, the list in the order that has been divided and recorded at the time of shooting, A data processing method characterized by comprising:   The program for functioning a computer as each means of the data processor of any one of Claims 1 thru | or 11.

Images