JP4548226B2 - Data processing method, apparatus and program thereof - Google Patents

Description

  The present invention relates to a data processing method, apparatus, and program for processing data in which content data and attribute data indicating attributes of the content data are mixed.

MXF (Material eXchange Format) is one of file exchange formats for video data and audio data.
MXF is composed of a plurality of pack data PACKs, and each pack data PACK includes index data INDEX indicating the attribute of the frame data and one or a plurality of frame data.
Each frame data includes system data, picture data, and sound data.
By the way, in a computer such as a personal computer, MXF file data is downloaded and then reproduced and edited.
In this case, the computer traces the MXF format file data, extracts the picture data, and stores it in the picture file.
The computer analyzes the picture file and generates and manages attribute data such as GOP related data of the picture data.
Thereafter, the computer performs processing such as reproduction and editing based on the picture file and the attribute data.

However, in the system described above, the entire MXF file data downloaded is traced to perform the picture data separation process, and then the separated picture data analysis process must be completed before playback and editing can be started.
Therefore, there is a problem that it takes a long time after the file data is downloaded until playback and editing can be started.

  The present invention has been made in view of the above-described problems of the prior art, and uses the data in which content data and attribute data indicating the attribute of the content data are mixed to process the content data based on the attribute data. It is an object of the present invention to provide a data processing method, an apparatus thereof, and a program that can be started at an earlier timing than conventional.

In order to solve the above-described problems of the prior art, the data processing method according to the first aspect of the invention includes a key K indicating the type of data, a data length L indicating the length of the data, and data indicating the data body. A data processing method of a data processing apparatus for processing file data including a plurality of KLV data in which a set of two values of V is a unit, wherein the analysis means of the data processing apparatus converts the file data into KLV data units And a second step in which the analyzing means determines whether or not the KLV data relates to encoded image data based on the key K of the read KLV data, and In the second step, when it is determined that the KLV data is related to the encoded image data, the first processing means of the data processing device stores the data of the KLV data. A third step of storing L in the first storage area; a fourth step in which the first processing means stores the data V of the KLV data in the third step in the second storage area; In the second step, when it is determined that the KLV data is not related to the encoded image data, the analyzing means converts the KLV data into the encoded data based on the key K of the read KLV data. A fifth step of determining whether or not the data relates to index data indicating an attribute of image data; and in the fifth step, if it is determined that the KLV data is related to index data, the data The second processing means of the processing device stores a sixth step of storing the index data in the first storage area, and all KLV data of the file data. On the condition that the first to sixth steps are executed, the processing circuit of the data processing device is stored in the second storage area based on the data stored in the first storage area. A seventh step of performing reproduction and / or editing processing of the data V which is the encoded image data.

The data processing apparatus according to the second aspect of the present invention uses a set of two values of a key K indicating the type of data, a data length L indicating the data length, and data V indicating the data body as one unit. A data processing apparatus for processing file data including a plurality of KLV data, wherein the file data is read and analyzed in units of KLV data, and the data V of the KLV data as encoded image data is stored in a second storage area. A first processing means for storing the data, a data length L of the KLV data which is the encoded image data, and a data V of the KLV data which is the index data indicating the attribute of the encoded image data in the first storage area. 2 processing means and reproduction and / or editing of data V which is encoded image data stored in the second storage area based on the data stored in the first storage area A processing circuit that performs processing, and the analysis means determines whether the KLV data relates to encoded image data based on the key K of the read KLV data, and the KLV data Is determined to be related to encoded image data, the first processing means stores the data length L of the KLV data in a first storage area, and the first processing means stores the KLV data. Data V is stored in the second storage area, and when it is determined that the KLV data is not related to the encoded image data, the analysis means performs the processing based on the key K of the read KLV data. It is determined whether or not the KLV data relates to index data indicating the attribute of the encoded image data, and the KLV data relates to index data. If it is a constant, and stores the index data in the first storage area.

The program according to the third aspect of the invention provides a KLV data in which a set of two values of a key K indicating a data type, a data length L indicating a data length, and data V indicating a data body is taken as one unit. Is a program executed by a computer included in a data processing apparatus that processes file data including a plurality of data, based on a first procedure for reading the file data in units of KLV data and a key K of the read KLV data. A second procedure for determining whether or not the KLV data is related to encoded image data; and in the second procedure, when it is determined that the KLV data is related to encoded image data, A third procedure for storing the data length L of the KLV data in the first storage area, and a second storage area for the data V of the KLV data in the third procedure. When the KLV data is determined not to be related to the encoded image data in the fourth procedure stored in the second procedure and the second procedure, the KLV data is based on the key K of the read KLV data. Is determined to be related to index data indicating the attribute of the encoded image data, and the KLV data is determined to be related to index data in the fifth procedure. In addition, on condition that the sixth procedure for storing the index data in the first storage area and the first to sixth procedures are executed for all the KLV data of the file data, A process of reproducing and / or editing data V, which is encoded image data stored in the second storage area, based on the data stored in the first storage area A seventh procedure for, the causes the computer to perform.

  According to the present invention, processing of the content data based on the attribute data is started at an earlier timing than before using data in which content data and attribute data indicating the attribute of the content data are mixed. Can provide a data processing method, an apparatus thereof, and a program.

Hereinafter, embodiments of the present invention will be described.
First, the correspondence between the configuration of the present invention and the configuration of the present embodiment will be described.
The picture data of this embodiment is an example of the content data of the present invention.
Further, the data L of the KLV data and the index data INDEX of the present embodiment are examples of attribute data of the present invention.
Step ST11 shown in FIG. 8 is an example of the first process of the present invention, step ST14 is an example of the second process of the present invention, and steps ST13 and ST16 are an example of the third process of the present invention. .
The MXF analysis unit 31 shown in FIG. 5 is an example of the detection unit of the present invention, the picture configuration unit 32 is an example of the content processing unit of the present invention, and the index configuration unit 33 is an example of the attribute processing unit of the present invention. It is.
A program PRG shown in FIG. 5 is an example of the program of the present invention.

An outline of the computer 4 shown in FIG. 1 will be described.
As shown in FIG. 5, the computer 4 stores the MXF file data FILE downloaded from the FTP server 3 in the input MXF memory 22.
Then, the MXF analysis unit 31 of the processing circuit 23 outputs the data L and V of the KLV data storing the picture data to the picture configuration unit 32 based on the key K of the KLV data constituting the file data FILE, and the index data The data V of the KLV data storing the INDEX is output to the index configuration unit 33.
The picture construction unit 32 adds data V, which is picture data, to the image file data IFD stored in the picture memory 24.
Also, the picture configuration unit 32 updates the attribute management data PMD stored in the index memory 25 based on the data L of the picture data.
Further, the index configuration unit 33 updates the attribute management data PMD based on the data V (index data INDEX) of the KLV data input from the MXF analysis unit 31.
That is, the computer 4 generates (updates) the attribute management data PMD in parallel with the generation of the image file data IFD.

Hereinafter, the communication system 1 will be described in detail with reference to the drawings.
FIG. 1 is an overall configuration diagram of a communication system 1 according to an embodiment of the present invention.
As shown in FIG. 1, the communication system 1 includes, for example, an FTP (File Transfer Protocol) server 3 and a computer 4, which communicate via a network 2.

[MXF file FILE]
First, the MXF file data FILE used in the communication system 1 will be described.
FIG. 2 is a diagram for explaining file data FILE in the MXF format used in the communication system 1 shown in FIG.
MXF is a standard defined in SMPTE-377M published by SMPTE (Society of Motion Picture & Television Engineers).
This standard, studied at the ProMPEG Forum, is a video content format mainly for the purpose of interoperability with business-use devices, and that video data, audio data, and metadata can be combined into a single file. It is characterized by not depending on the codec of data / audio data, and is used for applications such as digital archiving, content distribution, and nonlinear editing.

As shown in FIG. 2, the file data FILE includes header data HEADER, body data BODY, and footer data FOTER.
The header data HEADER includes a header partition pack HPP and metadata META.
The header partition pack HPP shows attribute data for the entire file data FILE.
For example, when the header partition pack HPP indicates a Closed partition, the number of frames, which is the number of frame data included in the file data FILE, can be indicated in the metadata META.

The metadata META is an encoding method of frame data (video data and audio data) stored in the body data BODY, keywords related to the contents of the frame data, title, identification data, editing data, creation data, editing data, etc. Indicates the attribute.
In addition, the metadata META includes, for example, a time code related to frame data, data for specifying missing frame data, the number of frames (Duration), and the like.

The body data BODY is composed of a plurality of pack data PACK.
The pack data PACK is classified by the body partition pack BPP.
Each pack data PACK includes index data INDEX and one or a plurality of editing unit data EU as shown in FIG.

The index data INDEX includes GOP (Group Of Pictures) related data of a frame in the editing unit data EU in the pack data PACK immediately before the pack data PACK in which the index data INDEX is stored.
The GOP related data indicates, for example, a frame number, a temporal offset, a key frame offset, and a flag.
The frame number indicates a number assigned to identify a target frame.
As shown in FIG. 3, the temporal offset indicates an offset in the editing unit data EU from the display order to the encoding order.
The key frame offset indicates an offset within the editing unit data EU up to the key frame.
The flag indicates whether the frame data is I Frame (Intra Frame: intra-frame coding) or the type using the correlation with the previous (past) I Frame, P Frame (Predicted Frame: forward predictive coding), before and after ( I / P / B frame information frame such as B Frame (Bi-directional predicted Frame) is a frame compressed using the correlation with I Frame of the past and future). Indicates whether or not

  In the above-described example, the case where the index data INDEX indicates the GOP related data of the frame data of the editing unit data EU in the pack data PACK in which the index data INDEX is stored is illustrated, but the index data INDEX is stored. The GOP related data of the frame data in the pack data PACK may be indicated.

As shown in FIG. 2, each of the editing unit data EU includes video data PIC and audio data SOU for one frame, and system data SYS indicating these attributes.
The system data SYS indicates, for example, the format and type of the video data PIC and the audio data SOU.
The system data SYS is, for example, the MXF_D format (for example, D10 standardized by SMPTE), and the type (for example, IMX50_625, IMX40_625, IMX30_625, IMX50_525, IMX40_525, IMX30_525, etc., standardized by SMPTE). Indicates.
In addition to the above, the system data SYS indicates, for example, an encoding method, a time code, UMID (Unique Material IDentifier) that is identification data of the data MXF_D, and the like.

The video data PIC is video data encoded by MPEG (Moving Picture Experts Group) or the like.
The audio data SOU is audio data encoded by AES (Audio Engineering Society) 3 or the like.
As described above, the file data FILE is stored in a state where the video data PIC and the audio data SOU are interleaved (mixed state).

  The footer data FOTER includes identification data indicating the end of the file data FILE.

For example, the video data PIC, the audio data SOU, and the system data SYS that constitute the editing unit data EU described above are composed of, for example, a single or a plurality of KLV data.
FIG. 4 is a diagram for explaining the KLV data.
As shown in FIG. 4, the KLV data includes a key K, a data length L, and data V.
The key K and the data length L are each fixed-length data, the key K is identification data of the content (type) of the data V, for example, and the data length L indicates the data length of the data V.
Data V indicates a data body.
The KLV data can be KLV data as data (V).
In order to perform analysis processing of KLV data, the fixed-length key K is read to determine the data type, the fixed-length data L is read to determine the length of the data V, and the data V corresponding to the length is read. Read and process.
The entire KLV data can be analyzed by repeating the above three processes in units of K, L, and V in order from the beginning of the file to the end.
Since the MXF file FILE is composed of the above KLV data, the basic analysis process can be performed in the same manner as the above KLV data analysis process.

[FTP server 3]
The FTP server 3 transmits the above-described MXF file data FILE to the computer 4 via the network 2.

[Computer 4]
The computer 4 downloads MXF data from the FTP server 3 and performs reproduction processing and editing processing.
FIG. 5 is a block diagram of the computer 4 shown in FIG.
As shown in FIG. 5, the computer 4 includes, for example, an interface 21, an input MXF memory 22, a processing circuit 23, a picture memory 24, an index memory 25, a display 26, a memory 27, and an operation unit 28.

The interface 21 receives MXF file data FILE from the FTP server 3 shown in FIG.
The input MXF memory 22 stores the MXF file data FILE received by the interface 21.

  For example, the processing circuit 23 executes the program PRG read from the memory 27 to realize the MXF analysis unit 31, the picture configuration unit 32, the index configuration unit 33, and the reproduction / editing unit 34 illustrated in FIG.

The MXF analysis unit 31 traces the MXF file data FILE read from the input MXF memory 22 and performs an analysis process thereof.
Specifically, the MXF analysis unit 31 reads the fixed-length key K of the KLV data constituting the file data FILE to determine the data type, reads the fixed-length data L, and determines the length of the data V. The data is calculated and read as data V for the length, and processed.
Then, when the key K of the read KVL data indicates picture data, the MXF analysis unit 31 outputs the data L of the KLV data and the data V (picture data) to the picture configuration unit 32.
At this time, based on the data L of the KLV data, the MXF analysis unit 31 outputs the subsequent picture data for the data length V to the picture configuration unit 32 as data V.

  Further, when the MXF analysis unit 31 indicates that the key K of the read KLV data is the index data INDEX, the data corresponding to the data length L following the data L of the KLV data is used as the data V (index data INDEX). , Output to the index configuration unit 33.

  Further, when the key K of the read KLV data is neither the picture data nor the index data INDEX, the MXF analysis unit 31 determines the key K of the next KLV data of the KLV data based on the data L. To do.

  The MXF analysis unit 31 analyzes the entire file data FILE by repeating the above KLV data processing from the beginning of the file data FILE to the end in order.

The picture configuration unit 32 inputs the data L and V of the picture data from the MXF analysis unit 31.
As shown in FIG. 6, the picture configuration unit 32 accumulates the data length indicated by the data L input from the MXF analysis unit 31 from the first picture data to the previous picture data of the target picture data for each target picture data. The picture offset is calculated and stored in the item associated with the target picture data in the attribute management data PMD shown in FIG.
Further, as shown in FIG. 6, the picture configuration unit 32 sets the data L of each target picture data as the picture size (Picture Size) and is associated with the target picture data in the attribute management data PMD shown in FIG. Stored in the selected item.

  Also, the picture configuration unit 32 adds the data V (picture data) input from the MXF analysis unit 31 to the image file data IFD stored in the picture memory 24 as shown in FIG.

The index construction unit 33 registers the GOP related data indicated by the index data INDEX input from the MXF analysis unit 31 in the attribute management data PMD shown in FIG.
That is, the index configuration unit 33 displays the frame number, temporal offset, key frame offset, and flags indicated by the GOP related data in the attribute management data PMD. Store in the corresponding item.

  The reproduction / editing unit 34 receives an operation signal corresponding to an operation by the user from the operation unit 28, and based on the operation signal and the attribute management data PMD shown in FIG. 6 stored in the index memory 25, the picture memory The reproduction processing (decoding processing) of the image file data IFD stored in 24 is performed, and the image obtained thereby is output to the display 26.

Hereinafter, an operation example of the computer 4 illustrated in FIG. 5 will be described.
FIG. 8 is a flowchart for explaining an operation example (Unwrap) of the computer 4 shown in FIG.
Step ST11:
The MXF analysis unit 31 of the processing circuit 23 reads, for example, the MXF file data FILE shown in FIGS. 2, 6, and 7 from the input MXF memory 22 in units of KLV data.

Step ST12:
When the MXF analysis unit 31 of the processing circuit 23 determines whether the KLV data relates to picture data based on the key K of the KLV data read in step ST11, and determines that the KLV data relates to picture data, It progresses to step ST13, and when that is not right, it progresses to step ST15.

Step ST13:
The MXF analysis unit 31 of the processing circuit 23 outputs the data L of the KLV data read in step ST11 to the picture configuration unit 32.
As shown in FIG. 6, the picture configuration unit 32 accumulates the data length indicated by the data L input from the MXF analysis unit 31 from the first picture data to the previous picture data of the target picture data for each target picture data. The picture offset is calculated and stored in the item associated with the target picture data in the attribute management data PMD shown in FIG.
Further, as shown in FIG. 6, the picture configuration unit 32 sets the data L of each target picture data as the picture size (Picture Size) and is associated with the target picture data in the attribute management data PMD shown in FIG. Stored in the selected item.

Step ST14:
The MXF analysis unit 31 of the processing circuit 23 outputs the data V of the KLV data read in step ST11 to the picture configuration unit 32.
The picture construction unit 32 adds the data V (picture data) input from the MXF analysis unit 31 to the image file data IFD stored in the picture memory 24 as shown in FIG.
Thereafter, the processing circuit 23 proceeds to step ST17.

Step ST15:
When the MXF analysis unit 31 of the processing circuit 23 determines whether the KLV data relates to the index data INDEX based on the key K of the KLV data read in step ST11, and determines that the KLV data relates to the index data INDEX The process proceeds to step ST16, and if not, the process proceeds to step ST17.

Step ST16:
The MXF analysis unit 31 of the processing circuit 23 outputs the data V (index data INDEX) of the KLV data read in step ST11 to the index configuration unit 33.
The index construction unit 33 registers the GOP related data indicated by the index data INDEX input from the MXF analysis unit 31 in the attribute management data PMD shown in FIG.
That is, the index configuration unit 33 displays the frame number, temporal offset, key frame offset, and flags indicated by the GOP related data in the attribute management data PMD. Store in the corresponding item.

Step ST17:
The MXF analysis unit 31 of the processing circuit 23 determines whether or not the analysis of all KLV data constituting the file data FILE has been completed. If it is determined that the analysis has not ended, the process returns to step ST11.
The processing circuit 23 completes the process of step ST17 described above, and then stores the image file stored in the picture memory 24 based on the attribute management data PMD stored in the index memory 25 in accordance with the operation signal from the operation unit 28. Data IFD reproduction processing or editing processing is performed.

As described above, according to the computer 4, as described with reference to FIG. 8, in the process of tracing the MXF file data FILE by the MXF analysis unit 31 in the processing circuit 23, the image file data shown in FIG. The IFD generation process and the attribute management data PMD generation process shown in FIG. 6 are performed in parallel.
That is, the computer 4 does not generate the attribute management data after generating the image file data IFD as in the prior art, but also generates the attribute management data PMD in the process of generating the image file data IFD. Generate.
Therefore, according to the computer 4, the image file data IFD can be stored in the picture memory 24 and the attribute management data PMD can be stored in the index memory 25 when the tracing of the entire file data FILE is completed.
As a result, the computer 4 can generate the image file data IFD and the attribute management data PMD in a shorter time than before, after starting the analysis processing of the file data FILE.

Moreover, according to the computer 4, the processing load of the processing circuit 23 can be reduced by increasing the efficiency of the processing as described above.
Further, according to the computer 4, after the image file data is generated, the analysis process thereof can be made unnecessary.

The present invention is not limited to the embodiment described above.
In the embodiment described above, MXF file data FILE is exemplified as “data in which content data and attribute data indicating the attribute of the content data are mixed” in the present invention, but the present invention is not limited to this. Absent.

FIG. 1 is a configuration diagram of a communication system 1M according to an embodiment of the present invention. FIG. 2 is a diagram for explaining MXF file data transmitted from the FTP server shown in FIG. 1 to the computer. FIG. 3 is a diagram for explaining GOP related data stored in the file data FILE. FIG. 4 is a diagram for explaining the KLV data. FIG. 5 is a block diagram of the computer shown in FIG. FIG. 6 is a diagram for explaining the attribute management data PMD stored in the index memory shown in FIG. FIG. 7 is a diagram for explaining the image file data IFD stored in the picture memory shown in FIG. FIG. 8 is a flowchart for explaining an operation example of the computer shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Communication system, 3 ... FTP server, 4 ... Computer, FILE ... File data of MXF, 21 ... Interface, 22 ... Memory for input MXF, 23 ... Processing circuit, 24 ... Picture memory, 25 ... Index memory, 26 ... Display , 27 ... Memory, 28 ... Operation part, 31 ... MXF analysis part, 32 ... Picture composition part, 33 ... Index composition part, 34 ... Playback / editing part, PMD ... Attribute management data, IFD ... Image file data

Claims (3)

Data processing for processing file data including a plurality of KLV data in which a set of two values of a key K indicating a data type, a data length L indicating a data length, and data V indicating a data body is used as one unit An apparatus data processing method comprising:
A first step in which the analysis means of the data processing device reads the file data in units of KLV data;
A second step in which the analyzing means determines whether or not the KLV data relates to encoded image data based on the key K of the read KLV data;
When it is determined in the second step that the KLV data is related to encoded image data, the first processing means of the data processing device sets the data length L of the KLV data to the first storage area. A third step of storing in
A fourth step in which the first processing means stores the data V of the KLV data in the third step in a second storage area;
In the second step, when it is determined that the KLV data is not related to the encoded image data, the analyzing means converts the KLV data into the encoded data based on the key K of the read KLV data. A fifth step of determining whether or not the index data indicates an attribute of image data;
In the fifth step, when it is determined that the KLV data relates to index data, the second processing means of the data processing device stores the index data in the first storage area. And the process of
On the condition that the first to sixth steps are executed for all the KLV data of the file data, the processing circuit of the data processing device uses the data stored in the first storage area as a basis. A seventh step of performing reproduction and / or editing processing of data V, which is encoded image data stored in the second storage area,
A data processing method. Data processing for processing file data including a plurality of KLV data in which a set of two values of a key K indicating a data type, a data length L indicating a data length, and data V indicating a data body is used as one unit A device,
Analyzing means for reading and analyzing the file data in units of KLV data;
First processing means for storing data V of KLV data, which is encoded image data, in a second storage area;
Second processing means for storing, in a first storage area, data length L of KLV data that is encoded image data and data V of KLV data that is index data indicating an attribute of the encoded image data;
A processing circuit for performing reproduction and / or editing processing of data V, which is encoded image data stored in the second storage area, based on the data stored in the first storage area;
Have
The analysis means determines whether the KLV data is related to encoded image data based on the key K of the read KLV data,
When it is determined that the KLV data is related to encoded image data, the first processing unit stores the data length L of the KLV data in a first storage area, and the first processing unit includes: Storing the data V of the KLV data in a second storage area;
When it is determined that the KLV data is not related to the encoded image data, the analysis means uses the key K of the read KLV data to indicate that the KLV data indicates an attribute of the encoded image data. It is determined whether or not the data relates to data. When it is determined that the KLV data relates to index data, the index data is stored in the first storage area.
Data processing device. Data processing for processing file data including a plurality of KLV data in which a set of two values of a key K indicating a data type, a data length L indicating a data length, and data V indicating a data body is used as one unit A program executed by a computer included in the apparatus,
A first procedure for reading the file data in units of KLV data;
A second procedure for determining whether the KLV data relates to encoded image data based on the key K of the read KLV data;
A third procedure for storing the data length L of the KLV data in the first storage area when it is determined in the second procedure that the KLV data relates to encoded image data;
A fourth procedure for storing the data V of the KLV data in the third procedure in a second storage area;
In the second procedure, when it is determined that the KLV data is not related to the encoded image data, the KLV data sets the attribute of the encoded image data based on the key K of the read KLV data. A fifth procedure for determining whether or not the index data is indicated;
A sixth procedure for storing the index data in the first storage area when it is determined in the fifth procedure that the KLV data is related to the index data;
Stored in the second storage area based on the data stored in the first storage area on condition that the first to sixth procedures have been executed for all the KLV data of the file data A seventh procedure for reproducing and / or editing the data V, which is the encoded image data,
A program for causing the computer to execute.

Images