JP3932130B2 - Structured data transmission apparatus and structured data transmission method - Google Patents

Description

The present invention relates to an apparatus and a method for transmitting structured data such as structured metadata describing the contents of multimedia contents.

  MPEG-7 (ISO / IEC 15938) is defined as a standard for a framework for describing the contents of multimedia contents. MPEG-7 is a standard for structured metadata in which multimedia contents are structured temporally and spatially and the contents of the multimedia contents are described using a tree structure.

  MPEG-7 metadata is characterized by being structured in a tree structure, and is described in a text format using XML (Extensible Markup Language). The format of XML elements and attributes in MPEG-7 metadata is defined using an XML schema.

  The MPEG-7 standard is composed of a plurality of parts. The MPEG-7 system (ISO / IEC 15938-1) of Part 1 defines a framework for transmitting and storing metadata, a metadata compression method, and the like.

  In the MPEG-7 system, MPEG-7 metadata is fragmented and transmitted. On the receiving side, MPEG-7 metadata is dynamically generated by sequentially integrating the received metadata fragments.

  FIG. 23 is a conceptual diagram showing the structure of an MPEG-7 description stream in the MPEG-7 system. The MPEG-7 description stream is composed of a decoder initial configuration (DecoderInit) and a plurality of subsequent access units (Access Units: AU). The decoder initial configuration includes various initial settings for the reception side decoder to operate. The access unit is a minimum processing unit to be processed in a single time, and includes a plurality of fragment update units (FUUs). The fragment update unit is a unit for transmitting metadata fragments, and includes a fragment update command (FU Command), a fragment update context (FU Context), and a fragment update payload (FU Payload). The fragment update command is a command indicating a fragment processing method, and there are four types of commands: “add”, “replace”, “delete”, and “reset”. The fragment update context is path information indicating a node to which a command is to be applied in a metadata tree generated on the receiving side. The fragment update payload stores metadata fragments.

  The dynamic generation of metadata by the fragment update unit will be described in more detail. FIG. 24 is a conceptual diagram showing the addition of a fragment to the metadata tree by the “add” command of the fragment update unit. The right side of the figure is a metadata tree generated on the receiving side, and in the initial stage, it is assumed that a portion drawn by a solid line is generated (assuming that a dotted line portion is not generated). Next, the fragment update unit on the left side of the figure is processed. The fragment update command in this fragment update unit is an “add” command. The fragment update context specifies a node on the metadata tree generated on the receiving side, and the fragment update payload stores metadata fragments. When this fragment update unit is processed, a fragment stored in the fragment update payload is added to the node specified by the fragment update context. That is, the dotted line part on the right side of the figure is generated.

  The transmission side can dynamically update the metadata tree generated on the reception side by using the “replace”, “delete”, and “reset” commands in addition to the “add” command.

In the above-described MPEG-7 metadata transmission framework by the MPEG-7 system, since the transmission target is XML data whose format is defined using the XML schema, not only the MPEG-7 metadata but also the XML schema is used. It can be used for transmission of any XML data whose format is defined using, that is, structured data.
Standard Number: ISO / IEC 15938-1: 2002 Title: Information technology-Multimedia content description interface-Part 1: Systems Source: ISO (http://www.iso.ch/) or Japan Standards Association ( (http://www.jsa.or.jp/)

  According to the above-described MPEG-7 metadata transmission method by the MPEG-7 system, the transmission side fragments the MPEG-7 metadata and transmits it, and the reception side MPEG-7 metadata is dynamically generated and updated. Can do. The transmission target is not only MPEG-7 metadata but also any XML data whose format is defined using the XML schema, that is, structured data. However, there is a problem that the receiving side cannot actively acquire / integrate part or all of the fragments of the structured data as necessary, and the receiving side cannot determine the timing for acquiring / integrating the fragments.

Therefore, the present invention is not limited to a system in which structured data is fragmented and transmitted / received, in which the transmitting side not only dynamically generates / updates the structured data on the receiving side, It is intended to provide a structured data transmission apparatus and transmission method for actively acquiring and integrating all as necessary, and further enabling a receiving side to determine the timing for acquiring and integrating fragments. Objective.

That is,
(1) A plurality of fragment data, and each piece of fragment configuration information corresponding to each piece of fragment data, which is information for integrating each piece of fragment data into structured data having a tree structure stored on the receiving side. An apparatus for transmitting structured data to be transmitted,
The fragment configuration information includes identification information for identifying the corresponding fragment data from each piece of fragment data, reference information having information on the name of the highest node of the corresponding fragment data, and the structuring of the corresponding fragment data Including location information about the connection location in the data,
The position information included in the fragment configuration information is position information including information specifying a node in the structured data and information specifying a connection position of the corresponding fragment data with respect to the specified node. ,
When the connection position of the corresponding fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, the information specifying the node in the position information is the one Information specifying a lower node, and information specifying a connection position of the corresponding fragment data for the specified node in the position information is specified for a node one level higher than the specified node. Information that designates the position immediately before the designated node as a connection position of the highest node of the corresponding fragment data ,
When the connection position of the corresponding fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of a single node having no subordinate node If there is, the information specifying the node in the position information is information specifying the one node, and the information specifying the connection position of the corresponding fragment data with respect to the specified node in the position information is the is one lower position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the fragment data which the corresponding,
An apparatus for transmitting structured data, characterized by comprising transmission means for transmitting a data stream generated by arranging the fragment data and the fragment configuration information.
(2) Sending a plurality of fragment data and each piece of fragment configuration information corresponding to each piece of fragment data, which is information for generating the structured data having a tree structure by integrating the pieces of fragment data on the receiving side A structured data transmission method for
The fragment configuration information includes identification information for identifying the corresponding fragment data from each piece of fragment data, reference information having information on the name of the highest node of the corresponding fragment data, and the structuring of the corresponding fragment data Including location information about the connection location in the data,
The position information included in the fragment configuration information is position information including information specifying a node in the structured data and information specifying a connection position of the corresponding fragment data with respect to the specified node. ,
When the connection position of the corresponding fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, the information specifying the node in the position information is the one Information specifying a lower node, and information specifying a connection position of the corresponding fragment data for the specified node in the position information is specified for a node one level higher than the specified node. Information that designates the position immediately before the designated node as a connection position of the highest node of the corresponding fragment data ,
When the connection position of the corresponding fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of a single node having no subordinate node If there is, the information specifying the node in the position information is information specifying the one node, and the information specifying the connection position of the corresponding fragment data with respect to the specified node in the position information is the is one lower position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the fragment data which the corresponding,
A structured data transmission method comprising transmitting a data stream generated by arranging the fragment data and the fragment configuration information.
(3) A plurality of first fragment data and each corresponding to each first fragment data which is information for integrating each first fragment data into structured data having a tree structure stored on the receiving side A structured data transmitting apparatus for transmitting the fragment configuration information and fragment update data obtained by adding integrated information, which is information for integrating the second fragment data into the structured data, into the second fragment data. And
The fragment configuration information corresponds to the reference information having identification information for identifying the corresponding first fragment data from each of the first fragment data and information about the name of the highest node of the corresponding first fragment data. First position information related to a connection position of the first fragment data in the structured data, and first integration processing information for specifying addition as an integration processing method on the reception side of the corresponding first fragment data to the structured data; Including
The integrated information included in the fragment update data includes second position information related to a connection position in the structured data of the second fragment data, and integration processing on the receiving side of the second fragment data into the structured data. And a second integrated processing information designating addition as a method,
The first location information included in the fragment configuration information includes information specifying a node in the structured data and information specifying a connection position of the corresponding first fragment data with respect to the specified node. Location information,
When the connection position of the corresponding first fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, information specifying the node in the first position information is The information specifying the one lower node, and the information specifying the connection position of the corresponding first fragment data for the specified node in the first position information is one level higher than the specified node. Information specifying the position immediately before the specified node as the connection position of the highest node of the corresponding first fragment data . ,
The connection position of the corresponding first fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate of one node that does not have a subordinate node If it is a position, the information specifying the node in the first position information is information specifying the one node, and the corresponding first fragment data for the specified node in the first position information the information specifying the connection position, is lower by one position of the specified node, the last a position of a node position of the lower as the connection position of the top node of the first fragment data the corresponding Information to specify,
The second position information included in the fragment update data includes position information including information specifying a node in the structured data and information specifying a connection position of the second fragment data with respect to the specified node. And
When the connection position of the second fragment data in the structured data is immediately before one subordinate node located one level below one node, the information specifying the node in the second position information is Information specifying one lower node, and information specifying the connection position of the second fragment data for the specified node in the second position information is for a node one level higher than the specified node. Information that designates a position that is the same position as the designated node and a position immediately before the designated node as a connection position of the highest node of the second fragment data ,
When the connection position of the second fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of one node that does not have a subordinate node In some cases, the information specifying the node in the second position information is information specifying the one node, and the connection position of the second fragment data with respect to the specified node in the second position information. information specifying is lower by one position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the second fragment data,
An apparatus for transmitting structured data, comprising: transmitting means for generating and transmitting a data stream including the first fragment data, the fragment configuration information, and the fragment update data.
(4) Each of the first fragment data corresponding to each of the first fragment data, which is information for generating a structured data having a tree structure by integrating the first fragment data and the first fragment data on the receiving side. A structured data transmission method for transmitting fragment configuration information and fragment update data in which integrated information that is information for integrating the second fragment data into the structured data is added to second fragment data. ,
The fragment configuration information corresponds to the reference information having identification information for identifying the corresponding first fragment data from each of the first fragment data and information about the name of the highest node of the corresponding first fragment data. First position information related to a connection position of the first fragment data in the structured data, and first integration processing information for specifying addition as an integration processing method on the reception side of the corresponding first fragment data to the structured data; Including
The integrated information included in the fragment update data includes second position information related to a connection position in the structured data of the second fragment data, and integration processing on the receiving side of the second fragment data into the structured data. And a second integrated processing information designating addition as a method,
The first location information included in the fragment configuration information includes information specifying a node in the structured data and information specifying a connection position of the corresponding first fragment data with respect to the specified node. Location information,
When the connection position of the corresponding first fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, information specifying the node in the first position information is The information specifying the one lower node, and the information specifying the connection position of the corresponding first fragment data for the specified node in the first position information is one level higher than the specified node. Information specifying the position immediately before the specified node as the connection position of the highest node of the corresponding first fragment data . ,
The connection position of the corresponding first fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate of one node that does not have a subordinate node If it is a position, the information specifying the node in the first position information is information specifying the one node, and the corresponding first fragment data for the specified node in the first position information the information specifying the connection position, is lower by one position of the specified node, the last a position of a node position of the lower as the connection position of the top node of the first fragment data the corresponding Information to specify,
The second position information included in the fragment update data includes position information including information specifying a node in the structured data and information specifying a connection position of the second fragment data with respect to the specified node. And
When the connection position of the second fragment data in the structured data is immediately before one subordinate node located one level below one node, the information specifying the node in the second position information is Information specifying one lower node, and information specifying the connection position of the second fragment data for the specified node in the second position information is for a node one level higher than the specified node. Information that designates a position that is the same position as the designated node and a position immediately before the designated node as a connection position of the highest node of the second fragment data ,
When the connection position of the second fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of one node that does not have a subordinate node In some cases, the information specifying the node in the second position information is information specifying the one node, and the connection position of the second fragment data with respect to the specified node in the second position information. information specifying is lower by one position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the second fragment data,
A structured data transmission method comprising: generating and transmitting a data stream including the first fragment data, the fragment configuration information, and the fragment update data.
(5) Structured data for transmitting each piece of fragment configuration information corresponding to each piece of fragment data, which is information for integrating a plurality of pieces of piece data into structured data having a tree structure stored on the receiving side A transmitting device,
The fragment configuration information includes location information regarding the location of the corresponding fragment data and reference information having information regarding the name of the highest node of the corresponding fragment data, and a connection position of the corresponding fragment data in the structured data And location information about
The position information included in the fragment configuration information is position information including information specifying a node in the structured data and information specifying a connection position of the corresponding fragment data with respect to the specified node. ,
When the connection position of the corresponding fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, the information specifying the node in the position information is the one Information specifying a lower node, and information specifying a connection position of the corresponding fragment data for the specified node in the position information is specified for a node one level higher than the specified node. Information that designates the position immediately before the designated node as a connection position of the highest node of the corresponding fragment data ,
When the connection position of the corresponding fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of a single node having no subordinate node If there is, the information specifying the node in the position information is information specifying the one node, and the information specifying the connection position of the corresponding fragment data with respect to the specified node in the position information is the is one lower position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the fragment data which the corresponding,
An apparatus for transmitting structured data, characterized by comprising transmission means for transmitting the fragment configuration information to the receiving side.
(6) Transmission of structured data for transmitting each piece of fragment configuration information corresponding to each piece of fragment data, which is information for generating a structured data having a tree structure by integrating a plurality of pieces of fragment data on the receiving side A method,
The fragment configuration information includes location information regarding the location of the corresponding fragment data and reference information having information regarding the name of the highest node of the corresponding fragment data, and a connection position of the corresponding fragment data in the structured data And location information about
The position information included in the fragment configuration information is position information including information specifying a node in the structured data and information specifying a connection position of the corresponding fragment data with respect to the specified node. ,
When the connection position of the corresponding fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, the information specifying the node in the position information is the one Information specifying a lower node, and information specifying a connection position of the corresponding fragment data for the specified node in the position information is specified for a node one level higher than the specified node. Information that designates the position immediately before the designated node as a connection position of the highest node of the corresponding fragment data ,
When the connection position of the corresponding fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of a single node having no subordinate node If there is, the information specifying the node in the position information is information specifying the one node, and the information specifying the connection position of the corresponding fragment data with respect to the specified node in the position information is the is one lower position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the fragment data which the corresponding,
A method of transmitting structured data, wherein the fragment configuration information is transmitted to the receiving side.
(7) Each piece of fragment configuration information corresponding to each piece of first piece of data, which is information for integrating a plurality of pieces of first piece of data into structured data having a tree structure stored on the receiving side, A structured data transmitting apparatus for transmitting fragment update data to which two pieces of fragment data are added with integrated information that is information for integrating the second piece of fragment data into the structured data,
The fragment configuration information includes reference information having location information regarding the location of the corresponding first fragment data and information regarding the name of the highest node of the corresponding first fragment data, and the corresponding first fragment data. Including first position information related to a connection position in structured data, and first integrated processing information that designates addition as an integrated processing method on the receiving side of the corresponding first fragment data to the structured data,
The integrated information included in the fragment update data includes second position information related to a connection position in the structured data of the second fragment data, and integration processing on the receiving side of the second fragment data into the structured data. And a second integrated processing information designating addition as a method,
The first location information included in the fragment configuration information includes information specifying a node in the structured data and information specifying a connection position of the corresponding first fragment data with respect to the specified node. Location information,
When the connection position of the corresponding first fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, information specifying the node in the first position information is The information specifying the one lower node, and the information specifying the connection position of the corresponding first fragment data for the specified node in the first position information is one level higher than the specified node. Information specifying the position immediately before the specified node as the connection position of the highest node of the corresponding first fragment data . ,
The connection position of the corresponding first fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate of one node that does not have a subordinate node If it is a position, the information specifying the node in the first position information is information specifying the one node, and the corresponding first fragment data for the specified node in the first position information the information specifying the connection position, is lower by one position of the specified node, the last a position of a node position of the lower as the connection position of the top node of the first fragment data the corresponding Information to specify,
The second position information included in the fragment update data includes position information including information specifying a node in the structured data and information specifying a connection position of the second fragment data with respect to the specified node. And
When the connection position of the second fragment data in the structured data is immediately before one subordinate node located one level below one node, the information specifying the node in the second position information is Information specifying one lower node, and information specifying the connection position of the second fragment data for the specified node in the second position information is for a node one level higher than the specified node. Information that designates a position that is the same position as the designated node and a position immediately before the designated node as a connection position of the highest node of the second fragment data ,
When the connection position of the second fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of one node that does not have a subordinate node In some cases, the information specifying the node in the second position information is information specifying the one node, and the connection position of the second fragment data with respect to the specified node in the second position information. information specifying is lower by one position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the second fragment data,
An apparatus for transmitting structured data, comprising: transmitting means for generating and transmitting a data stream including the fragment configuration information and the fragment update data.
(8) A piece of fragment configuration information corresponding to each piece of the first piece of data, which is information for generating a structured data having a tree structure by integrating a plurality of pieces of the first piece of data on the receiving side; A structured data transmission method for transmitting fragment update data to which fragment information is added with integrated information that is information for integrating the second fragment data into the structured data.
The fragment configuration information includes reference information having location information regarding the location of the corresponding first fragment data and information regarding the name of the highest node of the corresponding first fragment data, and the corresponding first fragment data. Including first position information related to a connection position in structured data, and first integrated processing information that designates addition as an integrated processing method on the receiving side of the corresponding first fragment data to the structured data,
The integrated information included in the fragment update data includes second position information related to a connection position in the structured data of the second fragment data, and integration processing on the receiving side of the second fragment data into the structured data. And a second integrated processing information designating addition as a method,
The first location information included in the fragment configuration information includes information specifying a node in the structured data and information specifying a connection position of the corresponding first fragment data with respect to the specified node. Location information,
When the connection position of the corresponding first fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, information specifying the node in the first position information is The information specifying the one lower node, and the information specifying the connection position of the corresponding first fragment data for the specified node in the first position information is one level higher than the specified node. Information specifying the position immediately before the specified node as the connection position of the highest node of the corresponding first fragment data . ,
The connection position of the corresponding first fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate of one node that does not have a subordinate node If it is a position, the information specifying the node in the first position information is information specifying the one node, and the corresponding first fragment data for the specified node in the first position information the information specifying the connection position, is lower by one position of the specified node, the last a position of a node position of the lower as the connection position of the top node of the first fragment data the corresponding Information to specify,
The second position information included in the fragment update data includes position information including information specifying a node in the structured data and information specifying a connection position of the second fragment data with respect to the specified node. And
When the connection position of the second fragment data in the structured data is immediately before one subordinate node located one level below one node, the information specifying the node in the second position information is Information specifying one lower node, and information specifying the connection position of the second fragment data for the specified node in the second position information is for a node one level higher than the specified node. Information that designates a position that is the same position as the designated node and a position immediately before the designated node as a connection position of the highest node of the second fragment data ,
When the connection position of the second fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of one node that does not have a subordinate node In some cases, the information specifying the node in the second position information is information specifying the one node, and the connection position of the second fragment data with respect to the specified node in the second position information. information specifying is lower by one position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the second fragment data,
A structured data transmission method, comprising: generating and transmitting a data stream including the fragment configuration information and the fragment update data.

As described above, the present invention has the following effects.
(A) On the transmission side, the structured data can be divided into a plurality of pieces of fragment data so as to be reintegrated. In addition, on the receiving side, it is possible to determine the timing at which fragment data is integrated, and to enable efficient reception processing of structured data.
(B) Position information regarding the connection position of fragment data included in fragment configuration information that is information for integrating fragment data, information specifying a node in generated structured data, and the specified node When it has information specifying the connection position of the corresponding fragment data, the position where the structured data is integrated can be specified accurately.
(C) When the reference information specifying the fragment data included in the fragment configuration information, which is information for integrating the fragment data, has information on the content of the fragment data to be referenced, It is possible to selectively receive and integrate, enabling efficient reception processing of structured data.
(D) When the reference information that specifies fragment data included in the fragment configuration information that is information for integrating fragment data has information on the name of the highest node of the fragment data to be referenced, Even if the referenced data is not integrated into the structured data and the position information included in the other fragment configuration information specifies the position corresponding to the node in the referenced fragment data, It is possible to appropriately process the fragment configuration information.

<Basic configuration>
In one embodiment of the content data and metadata transmission / reception system to which the present invention is applied, the original structured data (for example, MPEG-7 metadata or XML data whose format is defined using the XML schema) is used. Create multiple pieces of fragment data to be divided into multiple pieces or integrated as structured data, and for each piece of piece data, the original structured data (or the structure to be generated by integrating pieces) Fragment configuration information including position information for specifying the position of the fragment data in the data) and reference information for specifying the fragment data. The reference information included in the fragment configuration information is reference information related to fragment data having at least information related to the location of fragment data. Information related to the contents of fragment data may also be described in the reference information so that it can be used as a judgment material for the user or application to process the fragment data.

<Reception / Integration>
In the transmission / reception system, the position information that specifies the position of the fragment data in the original structured data (or the structured data to be generated by integrating the fragments) included in the fragment configuration information, and the fragment Based on the reference information designating data, the fragment data is arranged on the structured data, and the original structured data is reconstructed.
<< First Example (reference only, broadcast) >>
<System configuration>
FIG. 1 is a block diagram showing a first embodiment of a content data and metadata transmission / reception system to which the present invention is applied. In this embodiment, a sender (television station) transmits a metadata stream including content data (program) and structured metadata (structured data) related thereto, and a receiver (viewer) receives them. .

  The sender creates content data and related metadata. The content data is transmitted to the recipient via broadcasting. The metadata is divided into a plurality of fragment data, and fragment configuration information corresponding to each fragment data is created. A metadata stream is created by arranging fragment data and fragment configuration information, and transmitted to a receiver via broadcasting. The receiver receives the content data and the metadata stream from the broadcast, extracts the fragment data and the fragment configuration information from the metadata stream, and reconstructs the metadata from the fragment data and the fragment configuration information. The reconstructed metadata is used for searching or viewing content data.

<Description of metadata (XML)>
The metadata handled in this embodiment is structured metadata (structured data) such as MPEG-7 metadata, and is described in a text format using XML. The format of XML elements and attributes in the metadata is defined using an XML schema.

<Fragmentation process>
FIG. 2 is a diagram showing an outline of metadata fragmentation processing in the present embodiment. The metadata (structured data) is divided into a plurality of fragment data, and an ID for uniquely identifying the fragment data is added to each fragment data. Further, fragment configuration information corresponding to each fragment data is created. Instead of generating fragment data by dividing metadata, fragment data may be created assuming metadata generated by integration.

<Structure of fragment configuration information>
FIG. 3 is a diagram illustrating the structure of the fragment configuration information according to the present embodiment. The fragment configuration information is composed of position information and reference information. The position information is composed of XPath and position, and uses them to designate the position where the highest node of the fragment data in the structured data generated on the receiving side is to be arranged. The reference information includes an ID reference, an element name, and an element type. The ID reference designates fragment data using an ID added to the fragment data. The element name describes the element name in XML of the highest node of the fragment data. The element type describes the element type name in the XML schema of the highest node of the fragment data.

<Description of location information>
Next, a position designation method using XPath and position in the position information will be described. XPath specifies a specific node in the structured data generated on the receiving side using an XML path language (XPath). The position has a value of “prevSibling” or “lastChild” as its value. When the value of position is “prevSibling”, the node specified by the position information is a sibling node immediately before the node specified by XPath. When the value of position is “lastChild”, the node specified by the position information is the last child node of the node specified by XPath.

<Specific examples of location information>
Next, a method for specifying position information will be described in detail using a specific example.

  FIG. 4 is an example of a method for specifying position information when the first child node of a certain node is specified. When the top node “d” of the fragment data is arranged as the first child node of the node “a” in the structured data, the node “b” which is the current first child node of the node “a” is designated by XPath. The value of position is “prevSibling”. Then, the highest node ‘d’ of the fragment data is arranged as a sibling node immediately before the node ‘b’, that is, the first child node of the node ‘a’.

  FIG. 5 is an example of a method for specifying position information when a child node other than the first and last child nodes is specified. When the top node “d” of the fragment data is arranged as a child node other than the first and last of the node “a” in the structured data, the child node “c” of the node “a” is specified by the XPath, and the value of position Is “prevSibling”. Then, the highest node 'd' of the fragment data is arranged as a sibling node immediately before the node 'c', that is, a child node of the node 'a'.

  FIG. 6 is an example of a method for specifying position information when the last child node of a certain node is specified. When the top node ‘d’ of the fragment data is arranged as the last child node of the node ‘a’ in the structured data, the node ‘a’ is specified by the XPath, and the value of position is “lastChild”. Then, the highest node ‘d’ of the fragment data is arranged as the last child node of the node ‘a’.

  FIG. 7 is an example of a method for specifying position information when a child node of a node having no child node is specified. When the top node ‘d’ of the fragment data is arranged as a child node of the node ‘b’ in the structured data, the node ‘b’ is specified by the XPath, and the value of position is “lastChild”. Then, the highest node ‘d’ of the fragment data is arranged as a child node of the node ‘b’.

<Binary encoding of fragment configuration information>
The fragment configuration information of this embodiment may be expressed as binary data by converting the included information into binary data using an appropriate means.

<Send>
Next, a method for transmitting content data and metadata by the sender of this embodiment will be described.

  The sender arranges a plurality of pieces of fragment data and pieces of fragment configuration information corresponding to them in an appropriate order to create a metadata stream. The order in which the fragment data and the fragment configuration information are arranged may be a mixture of the fragment data and the fragment configuration information, or all the fragment configuration information may be arranged first, and then all the fragment data may be arranged next. However, the pieces of fragment data may be arranged in an arbitrary order, but pieces of piece structure information must be arranged in the order of depth priority or width priority with respect to the nodes in the structured data indicated by the position information included therein.

  FIG. 8 is a configuration diagram of the content data and metadata transmission apparatus in the sender.

  The content data storage unit stores content data, and the metadata stream storage unit stores the above-described metadata stream.

  The content data transmission control unit inputs content data from the content data storage unit according to a predetermined schedule and outputs the content data to the multiplexing unit.

  The metadata stream transmission control unit inputs the metadata stream from the metadata stream storage unit based on a predetermined frequency and cycle of carousel transmission and outputs the metadata stream to the multiplexing unit in order to perform the carousel transmission of the metadata stream. .

  The multiplexing unit multiplexes the content data input from the content data transmission control unit and the metadata stream input from the metadata stream transmission control unit, and outputs the multiplexed stream to the broadcast.

<Receive>
FIG. 9 is a configuration diagram of the content data and metadata receiving apparatus in the receiver.

  The separation unit separates the multiplexed stream input from the broadcast into content data and a metadata stream, outputs the content data to a user or an application, and outputs the metadata stream to the metadata stream separation unit.

  The metadata stream separation unit separates the metadata stream input from the separation unit into fragment data and fragment configuration information, outputs the fragment data to the fragment data temporary storage unit, and outputs the fragment configuration information to the metadata integration unit To do.

  The fragment data temporary storage unit is configured with, for example, a memory or the like, and temporarily stores the fragment data input from the metadata stream separation unit. When a list of fragment data IDs is requested by the metadata integration unit, the stored fragment data ID list is output to the metadata integration unit. When the fragment data specified by the ID is requested together with the fragment data ID from the metadata integration unit, the fragment data specified by the ID is output to the metadata integration unit and the fragment data is deleted from the memory. To do.

  The metadata integration unit processes the fragment configuration information input from the metadata stream separation unit in accordance with a fragment configuration information processing method described later, and the fragment storage information or reference information included in the fragment configuration information is stored in the metadata storage unit. To the metadata (structured data) stored in In addition, when the user or application is instructed to resolve the reference information in the metadata stored in the metadata storage unit, the fragment data is acquired from the fragment data temporary storage unit according to the reference information processing method described later. Are added to the metadata, and the related fragment configuration information is processed.

  The metadata storage unit is a storage medium for storing metadata, and the metadata integration unit writes and reads data. Data can also be read from a user or application.

  If any reference information in the metadata stored in the metadata storage unit is necessary for the fragment data of the reference destination, the user or application instructs the metadata integration unit to resolve the reference information. Furthermore, if the metadata obtained by resolving the reference information is read from the metadata storage unit and any reference information included in the metadata is required, the reference information to the metadata integration unit is required if the fragment data of the reference destination is necessary. Repeat the solution instructions. If there is no reference information that refers to the necessary fragment data, the finally obtained metadata is used for each application.

<Processing method of fragment configuration information>
Next, a method for processing fragment configuration information will be described. First, position information and reference information are extracted from the fragment configuration information. If the node specified by the XPath included in the position information exists on the structured data (metadata) stored in the metadata storage unit, the reference information is added to the position specified by the position information (XPath and position). Append. At this time, however, the reference information existing on the structured data is handled as an element having an element name included in the reference information. When the node specified by the XPath included in the position information does not exist on the structured data stored in the metadata storage unit, the last node when the structured data is traced from the root node as much as possible according to the XPath Fragment configuration information is added as the last child node of (this node should be reference information).

  A method of processing fragment configuration information will be specifically described with reference to the drawings.

  FIG. 10 shows an example of a fragment configuration information processing method when a node specified by XPath included in position information exists on structured data. XPath specifies the node 121, and the value of position is “lastChild”. This means that the highest node of the fragment data should be placed at the position of the node 122, and reference information is added to the position of the node 122.

  FIG. 11 shows an example of the fragment configuration information processing method when the XPath included in the position information specifies the reference information on the structured data. Since the reference information existing at the position of the node 131 includes the element name “b” of the highest node of the fragment data to be arranged at the position of the node 131, it can be seen that the XPath specifies the node 131. . Furthermore, since the value of position is “lastChild”, reference information is added to the position of the node 132.

  FIG. 12 shows an example of a fragment configuration information processing method in the case where a node specified by XPath included in position information does not exist in structured data. Since reference information exists at the position of the node 141, the element name of the highest node of the fragment data to be arranged at the position of the node 141 is known. However, since the XPath designates the position of the node 141, if the structured data is traced from the root node according to the XPath, it can be traced to the node 141, but cannot be traced thereafter. Therefore, the fragment configuration information is added as the last child node of the reference information existing at the position of the node 141.

<Solution of reference information>
Next, a method for solving reference information will be described. In the resolution of the reference information, the fragment data specified by the ID included in the reference information is acquired, the reference information is deleted, and the fragment data is added to the position where the reference information exists. However, when the reference information has fragment configuration information (one or more) as its child nodes, after the fragment data is added, the fragment configuration information is added according to the above-described fragment configuration information processing method (in the case of a plurality, from the front). Process in order).

<How to determine whether fragment data is necessary>
Whether the fragment data is necessary is determined based on the element type included in the reference information. The format of XML elements and attributes in structured data is defined using the XML schema, and the element type included in the reference information is the element type in the XML schema of the highest node of the fragment data to be referenced. By interpreting the format definition of structured data according to, it is possible to know the rough contents of fragment data from the element type. The user or application determines the necessity of the fragment data based on the rough contents.
<< Second Example (only for reference, broadcast and Internet) >>
<System configuration>
FIG. 13 is a configuration diagram of a second embodiment of the content data and metadata transmission / reception system to which the present invention is applied. In the present embodiment, as in the system configuration of the first embodiment of FIG. 1, the sender transmits the content data and the metadata stream via broadcasting, and the receiver receives them. Further, the sender stores a part of the fragment data in a database connected to the Internet, and the receiver acquires the fragment data from the database via the Internet.

  The sender creates content data and related metadata (structured data). The content data is transmitted to the recipient via broadcasting. The metadata is divided into a plurality of fragment data, and fragment configuration information corresponding to each fragment data is created. A metadata stream is created from a part of the fragment data and all the fragment configuration information, transmitted to the receiver via broadcasting, and the remaining fragment data is stored in the database. The receiver receives the content data and the metadata stream from the broadcast, extracts the fragment data and the fragment configuration information from the metadata stream, acquires the fragment data from the database via the Internet, and acquires the metadata from the fragment data and the fragment configuration information. Reconstruct the data. The reconstructed metadata is used for searching or viewing content data.

<Description of metadata (XML)>
The metadata in the present embodiment is the same as the metadata in the first embodiment.

<Fragmentation process>
The fragmentation processing method in this embodiment is the same as the fragmentation processing method in the first embodiment. However, an ID for uniquely identifying the fragment data is added to the fragment data transmitted via broadcasting, and the fragment data stored in the database is stored in the database in a file format with a unique file name added to each fragment data. . The database is constructed so that the fragment data stored in the database can be referred to from the Internet by a URI (Uniform Resource Identifier).

<Structure of fragment configuration information>
The structure of the fragment configuration information in the present embodiment is the same as the structure of the fragment configuration information in the first embodiment when the corresponding fragment data is transmitted via broadcast, and the outline thereof is shown in FIG. Street. On the other hand, when the corresponding fragment data is stored in a database connected to the Internet, as shown in FIG. 14, the structure of the fragment configuration information is included in the reference information instead of the ID reference in FIG. The fragment data is designated by URI.

<Transmission by broadcast>
The transmission method of the content data and metadata stream in the sender of this embodiment is the same as the transmission method of the content data and metadata stream in the first embodiment. However, the metadata stream includes only a part of fragment data.

<Transmission via the Internet>
Some fragment data not transmitted by broadcasting is stored in a database connected to the Internet as described above. When a database is requested to acquire a fragment data file together with a URI from a receiver connected to the Internet, the database transmits the fragment data file corresponding to the URI to the receiver.

<Receive>
FIG. 15 is a configuration diagram of the content data and metadata receiving apparatus in the receiver.

  The configuration and operation of the separation unit, the metadata stream separation unit, the fragment data temporary storage unit, the metadata storage unit, and the user or application in the configuration diagram of the content data and metadata reception device in FIG. It is the same as each structure and operation | movement in the block diagram of the content data and metadata receiver in an example.

  The configuration and operation of the metadata integration unit are the same as the operation and configuration of the metadata integration unit in the configuration diagram of the content data and metadata receiving apparatus in the first embodiment of FIG. However, when resolving the reference information, if the reference information specifies fragment data by ID reference, the fragment data is acquired from the fragment data temporary storage unit as in the first embodiment, and the reference information is a URI reference. When the fragment data is designated by the command, the fragment data receiving unit is instructed to receive the fragment data specified by the URI, and the fragment data is acquired from the fragment data receiving unit.

When there is an instruction to receive the fragment data specified by the URI from the metadata integration unit, the fragment data receiving unit requests the fragment data specified by the URI together with the URI from the database, and is transmitted from the database. The fragment data is received, and the received fragment data is output to the metadata integration unit.
<< Third Example (Reference only, Internet) >>
<System configuration>
FIG. 16 is a block diagram of a third embodiment of the content data and metadata transmission / reception system to which the present invention is applied. In this embodiment, the sender (content provider) stores the content data (video, audio, etc.) and the related metadata (structured data) in a database connected to the Internet, and the receiver (user) Get those data from the database via the Internet.

  The sender creates content data and related metadata. Content data is stored in a database. The metadata is divided into a plurality of fragment data, fragment configuration information corresponding to each fragment data is created, and the fragment data and the fragment configuration information are stored in the database. The receiver acquires content data, fragment data, and fragment configuration information from a database via the Internet, and reconstructs metadata from the fragment data and fragment configuration information. The reconstructed metadata is used for searching or viewing content data.

<Description of metadata (XML)>
The metadata in the present embodiment is the same as the metadata in the first embodiment.

<Fragmentation process>
The fragmentation processing method in this embodiment is the same as the fragmentation processing method in the first embodiment. However, no ID is added to the fragment data. In addition, a unique file name is added to the fragment data and stored in the database in a file format. Fragment data stored in the database can be referred to by URI from the Internet. In addition, the fragment configuration information forms a fragment configuration information stream by arranging all the fragment configuration information in the depth-first order or the width-first order with respect to the nodes in the structured data specified by the position information included therein, and the fragment configuration information stream. Is stored in the database.

<Structure of fragment configuration information>
The structure of the fragment configuration information in this embodiment is the same as the structure of the fragment configuration information when the corresponding fragment data in the second embodiment of FIG. 14 is stored in a database connected to the Internet.

<Transmission via the Internet>
The content data, fragment data, and fragment configuration information are stored in a database connected to the Internet as described above. When a database is requested to acquire content data, fragment data, or fragment configuration information files from a receiver connected to the Internet, the database transmits a file corresponding to the URI to the receiver.

<Receive>
FIG. 17 is a configuration diagram of the content data and metadata receiving apparatus in the receiver.

  When the data receiving unit is instructed by the user or application to acquire content data corresponding to the URI of the content data, the data receiving unit requests the content data corresponding to the URI from the database via the Internet, and the database transmits the content data. The content data corresponding to the URI is received, and the received content data is output to the user or application. Further, when the metadata integration unit is instructed to acquire the fragment configuration information stream or the fragment data corresponding to the URI together with the URI of the fragment data, the fragment configuration information stream or the fragment data corresponding to the URI is transmitted via the Internet. Requests the database, receives fragment configuration information stream transmitted from the database or fragment data corresponding to the URI, and outputs the received fragment configuration information stream or fragment data corresponding to the URI to the metadata integration unit.

  The metadata integration unit first instructs the data reception unit to acquire the fragment configuration information stream, and sequentially processes the fragment configuration information included in the fragment configuration information stream input from the data reception unit. The fragment configuration information processing method is the same as the fragment configuration information processing method of the first embodiment. In addition, when the user or application instructs to resolve the reference information in the metadata stored in the metadata storage unit, the fragment data corresponding to the URI included in the reference information is obtained according to the reference information processing method. To the data receiving unit, the fragment data input from the data receiving unit is added to the metadata, and the related fragment configuration information is processed. The reference information processing method is the same as the reference information processing method of the first embodiment.

  The configuration and operation of the metadata storage unit are the same as the configuration and operation of the metadata storage unit in the configuration diagram of the content data and metadata receiving apparatus of the first embodiment of FIG.

The configuration and operation of the user or application are the same as the configuration and operation of the user or application in the configuration diagram of the content data and metadata receiving apparatus of the first embodiment of FIG. However, when the content data is necessary, the data receiving unit is instructed to acquire the content data corresponding to the URI together with the URI of the content data, and the content data is input from the data receiving unit.
<< 4th Example (reference and command, broadcast) >>
<System configuration>
The fourth embodiment of the content data and metadata transmission / reception system to which the present invention is applied utilizes dynamic generation / update of metadata by the transmission side using the MPEG-7 system and the fragment configuration information of the present invention. The active acquisition and integration of fragment data by the receiving side is realized at the same time.

  The configuration of the content data and metadata transmission system of the present embodiment is the same as the configuration of the content data and metadata transmission system of the first embodiment of FIG. However, the structure of the metadata stream is different.

<Metadata stream>
The metadata stream in this embodiment is an extension of the MPEG-7 description stream in the MPEG-7 system of FIG. The metadata stream of this embodiment is composed of an initial decoder configuration and a plurality of subsequent access units. The access unit is composed of a plurality of fragment update units. However, in this embodiment, in addition to the fragment update unit (1) having the same structure as the fragment update unit in the MPEG-7 system, only the fragment update unit (2) for transmitting fragment configuration information and fragment data The fragment update unit (3) including FIG. 18 is a block diagram of the fragment update unit (2). The fragment update unit (2) includes a fragment update command, a fragment update context, and reference information. The fragment update context in the MPEG-7 system has the same structure as the position information included in the fragment configuration information of the present invention, and the fragment configuration information is configured by the fragment update context and the reference information.

<Fragmentation process>
FIG. 19 is a diagram showing an outline of fragmentation processing of metadata (structured data) and creation of a metadata stream in the present embodiment. The metadata is divided into a plurality of fragment data. For each piece of fragment data, a fragment update unit (1) is created by adding a fragment update command (in this case, an “add” command is used) and a fragment update context (position information) (fragment data becomes a fragment update payload) ), Or the fragment update unit (2) in which the fragment configuration information is created in the same manner as the fragmentation process in the first embodiment and the fragment update command (here, the “add” command is used) is added to the fragment update unit (2). And a fragment update unit (3) including For convenience, the fragment data included in the fragment update unit (3) is referred to as first fragment data, and the fragment data included in the fragment update unit (1) is referred to as second fragment data.

  Instead of creating fragment data by dividing metadata, fragment data is created assuming metadata generated by integration, and the fragment update unit (1) or fragment update unit (2) and fragment An update unit (3) may be created. Further, a “replace” command, a “delete” command, or a “reset” command may be employed as the fragment update command to dynamically update the structured metadata tree on the receiving side. An access unit is created by arranging an appropriate number of fragment update units (1), fragment update units (2), and fragment update units (3) created by the above processing, and access units are further arranged. Add metadata to create a metadata stream.

<Send>
The configuration of the content data and metadata transmission apparatus in the sender of this embodiment is the same as the configuration of the content data and metadata transmission apparatus in the sender of the first embodiment of FIG.

<Receive>
The configuration of the content data and metadata receiving apparatus in the receiver of this embodiment is the same as the configuration of the content data and metadata receiving apparatus in the receiver of the first embodiment of FIG. However, the operations of the metadata stream separation unit and the metadata integration unit are different.

  The metadata stream separation unit separates the metadata stream input from the separation unit into a fragment update unit (1), a fragment update unit (2), and a fragment update unit (3), and the fragment update unit (1) and the fragment The update unit (2) is output to the metadata integration unit, the fragment data is extracted from the fragment update unit (3), and the fragment data is output to the fragment data temporary storage unit.

  The metadata integration unit interprets the fragment update unit (1) input from the metadata stream separation unit, and when the fragment update command is an “add” command, the metadata integration unit stores the metadata in the metadata stored in the metadata storage unit. Fragment data included in the fragment update payload (included in the fragment update unit (1)) is added to the position specified by the fragment update context, and stored in the metadata storage unit when the fragment update command is a “replace” command. The partial data below the position specified by the fragment update context in the metadata that has been changed is replaced with the fragment data contained in the fragment update payload, and if the fragment update command is a “delete” command, it is stored in the metadata storage unit Metadata Remove the following parts data positions definitive fragment updating contexts specifies, if the fragment updating command is a "reset" command returns to a predetermined initial state metadata stored in the metadata storage unit. However, in the above processing, when there is no node at the position specified by the fragment update context in the metadata, the resolution of the corresponding higher-level reference information on the metadata is continued until the fragment data including the node is acquired. . The reference information solution is the same as the reference information solution in the first embodiment.

  The metadata integration unit extracts a fragment update command and fragment configuration information (fragment configuration context, that is, position information and reference information) from the fragment update unit (2) input from the metadata stream separation unit, and updates the fragment. The command is processed in the same manner as described above, and the fragment configuration information is processed in the same manner as the fragment configuration information processing method of the first embodiment.

When the metadata integration unit is instructed by the user or application to resolve the reference information on the structured metadata tree stored in the metadata storage unit, the method for resolving the reference information in the first embodiment The reference information is resolved in the same manner as.
<< Fifth Embodiment (Reference and Command, Broadcast and Internet) >>
<System configuration>
The fifth embodiment of the content data and metadata transmission / reception system to which the present invention is applied uses dynamic generation / update of metadata by the transmission side using the MPEG-7 system and the fragment configuration information of the present invention. The active acquisition and integration of fragment data by the receiving side is realized at the same time.

  The configuration of the content data and metadata transmission system of the present embodiment is the same as the configuration of the content data and metadata transmission system of the second embodiment of FIG. However, the structure of the metadata stream is different.

<Metadata stream>
The structure of the metadata stream in the present embodiment is the same as the structure of the metadata stream in the fourth embodiment. However, as in the second embodiment, some pieces of fragment data are not included in the metadata stream but are stored in a database connected to the Internet.

<Send>
The configuration of the content data and metadata transmission apparatus in the sender of this embodiment is the same as the configuration of the content data and metadata transmission apparatus in the sender of the second embodiment of FIG.

<Receive>
The configuration of the content data and metadata receiving apparatus in the receiver of this embodiment is the same as the configuration of the content data and metadata receiving apparatus in the receiver of the second embodiment of FIG. However, the operations of the metadata stream separation unit and the metadata integration unit are different.

  The operation of the metadata stream separation unit is the same as the operation of the content data and metadata stream separation unit of the metadata reception device in the receiver of the fourth embodiment.

The operation of the metadata integration unit is the same as the operation of the content integration unit and the metadata reception unit of the metadata reception apparatus in the fourth embodiment. However, when resolving the reference information, if the reference information specifies fragment data by ID reference, the fragment data is acquired from the fragment data temporary storage unit as in the fourth embodiment, and the reference information is a URI reference. When the fragment data is designated by the command, the fragment data receiving unit is instructed to receive the fragment data specified by the URI, and the fragment data is acquired from the fragment data receiving unit.
<< Realization of a receiving device by a receiving program >>
Here, a structured data receiving program for realizing the receiving apparatus in each embodiment described above on a computer will be specifically described by taking the second embodiment.

<Receiving system>
As shown in FIG. 20, in the second embodiment, the computer receives the content data and the metadata stream from the broadcast and also receives the fragment data from the database via the Internet. Furthermore, metadata is reconstructed from the metadata stream and fragment data, and stored in an internal storage device. The user operates the computer to search for content using the metadata or to display the metadata at the same time as viewing the content.

<Process flow>
FIG. 21 is a configuration diagram of a computer, and FIG. 22 is a flow of processing executed by the computer.

  First, the central processing unit receives a command from a control program (structured data receiving program) in the main memory, and separates fragment configuration information into content data and metadata streams from the multiplexed stream input from the broadcast receiving unit. Further, the metadata stream is separated into fragment data and fragment configuration information, and the separated fragment configuration information is processed in order. At that time, the content data and the fragment data separated in parallel are stored in the storage device.

  The fragment configuration information processing method is the same as the fragment configuration information processing method in the second embodiment. However, the metadata is created on the storage device.

  Next, if the central processing unit has not processed all the fragment configuration information, it continues to process the fragment configuration information, and if it has processed all the fragment configuration information, the user instruction input from the input device Wait for.

  When an instruction is input from the user, the central processing unit outputs metadata to the output device if the instruction is an output of metadata. If the instruction from the user is the resolution of the reference information, the reference information instructed by the user in the metadata stored in the storage device is resolved. The reference information solution is the same as the reference information solution in the second embodiment. However, if the fragment data referred to by the reference information is included in the metadata stream transmitted by broadcasting, the relevant data is obtained from the fragment data stored in the storage device, and the fragment data referenced by the reference information is obtained. Is stored in a database connected to the Internet, the corresponding fragment data is acquired from the database by the Internet communication device. If the instruction from the user ends, the process ends.

  Similarly, the receiving apparatus in the embodiments other than the second embodiment can be realized on the computer by the structured data receiving program.

<Others>
The structured data receiving program may be read from a computer-readable recording medium on which these are recorded and loaded into the computer, or may be transmitted via a communication network or the like and loaded into the computer.
<< Sixth embodiment (when reference target is stream) >>
<System configuration>
In the sixth embodiment of the content data and metadata transmission / reception system to which the present invention is applied, the reference object of the reference information in the fragment configuration information includes not only the fragment data but also other metadata streams. Data) using a plurality of streams, and recursive reception processing of the plurality of streams by the receiving side.

  The configuration of the content data and metadata transmission system of the present embodiment is the same as the configuration of the content data and metadata transmission system of the first embodiment of FIG. However, fragmentation processing, transmission method, and reception method are different.

<Fragmentation process>
FIG. 25 is a diagram showing an outline of metadata fragmentation processing in this embodiment. The metadata (structured data) is divided into a plurality of pieces of fragment data, and an ID for uniquely identifying the piece of fragment data is added to each piece of piece of fragment data, and piece structure information corresponding to each piece of piece of fragment data is created. Furthermore, the same fragmentation process may be performed on the generated fragmented data to divide it into smaller fragment data. The fragmentation process may be repeated recursively in any number of stages, for example, the fragmentation data generated by the second stage fragmentation process is further fragmented. At this time, the position information included in the fragment configuration information created in the second and subsequent fragmentation processes is not information indicating the position in the original metadata (structured data), but the structure of the object of the fragmentation process Information indicating the position in the digitized data. Instead of generating fragment data by dividing metadata, fragment data may be created assuming metadata generated by integration.

<Send>
The configuration of the content data and metadata transmission apparatus in the sender of the present embodiment is the same as the configuration of the content data and metadata transmission apparatus of the first embodiment of FIG. However, the configuration method of the metadata stream is different.

  The sender arranges a plurality of pieces of fragment data and pieces of fragment configuration information corresponding to them in an appropriate order to create a metadata stream. However, a plurality of independent metadata streams are created for each recursively repeated fragmentation process. The information included in the metadata stream corresponding to a certain fragmentation process includes all fragmented data generated by the fragmentation process that has not been recursively fragmented and all fragments. Configuration information. Furthermore, the ID added to the fragment data corresponding to the fragmentation process corresponding to the metadata stream is added. However, an ID indicating the highest metadata stream is added to the highest metadata stream.

<Receive>
FIG. 26 is a configuration diagram of the content data and metadata receiving apparatus in the receiver.

  The configuration and operation of the separation unit, metadata storage unit, and user or application in the configuration diagram of the content data and metadata reception device are the configurations of the configuration diagram of the content data and metadata reception device in the first embodiment of FIG. And the operation is the same.

  The metadata stream separation unit separates the highest-level metadata stream from the plurality of metadata streams input from the separation unit into fragment data and fragment configuration information, and the fragment data is temporarily stored in the fragment data and the metadata stream. The fragment configuration information is output to the metadata integration unit. Further, all the streams other than the highest-level metadata stream are output as they are to the fragment data and metadata stream temporary storage unit.

  The fragment data and metadata stream temporary storage unit includes, for example, a memory and the like. The fragment data and metadata stream input from the metadata stream separation unit, and the fragment data input from the fragment data and metadata stream separation unit Is temporarily stored. When the metadata integration unit requests a list of fragment data and metadata stream IDs, it outputs the stored fragment data and metadata stream ID list to the metadata integration unit. When the fragment data or metadata stream specified by the ID together with the fragment data or metadata stream ID is requested from the fragment data and metadata stream separator, the fragment data or metadata stream specified by the ID is The fragment data and metadata stream is output to the separation unit and the fragment data or metadata stream is erased from the memory.

  When the fragment data / metadata stream separating unit requests the fragment data or metadata stream identified by the ID together with the fragment data or metadata stream ID from the metadata integrating unit, the fragment identified by the ID The data or metadata stream is requested to the fragment data and metadata stream temporary storage unit, and the fragment data or metadata stream output from the fragment data and metadata stream temporary storage unit is input. Further, if the input data is fragment data, the fragment data is output to the metadata integration unit. When the input data is a metadata stream, the metadata stream is separated into (plural) fragment data and (plural) fragment configuration information, and the fragment data is fragment data and metadata stream temporary storage unit To output the fragment configuration information to the metadata integration unit.

  The metadata integration unit processes the fragment configuration information input from the metadata stream separation unit in the same manner as the fragment configuration information processing method in the first embodiment, and is included in the fragment configuration information or the fragment configuration information. The reference information is added to the metadata (structured data) stored in the metadata storage unit. In addition, when the user or application is instructed to resolve the reference information in the metadata stored in the metadata storage unit, the fragment data and the metadata are processed in the same manner as the reference information processing method in the first embodiment. Fragment data is acquired from the data stream separation unit and added to the metadata, and related fragment configuration information is processed. However, when the fragment data and the data acquired from the metadata stream separation unit are fragment configuration information, the fragment configuration information is processed in the same manner as the fragment configuration information processing method in the first embodiment. Meta data obtained by processing, storing fragment configuration information or reference information included in the fragment configuration information in the metadata storage unit (apart from the metadata already stored), and processing all of the fragment configuration information Data is added to a predetermined position of the original metadata. Furthermore, when the fragment configuration information acquired from the fragment data and metadata stream separation unit includes a reference to the metadata stream, the same processing is recursively repeated.

It is a block diagram of the content data and metadata transmission system in 1st Example. It is a figure which shows the outline of the fragmentation process of the structured data in 1st Example. It is a figure which shows the structure of the fragment structure information in 1st Example. It is an example of the designation | designated method of the positional information in the fragment | piece structure information of 1st Example. It is an example of the designation | designated method of the positional information in the fragment | piece structure information of 1st Example. It is an example of the designation | designated method of the positional information in the fragment | piece structure information of 1st Example. It is an example of the designation | designated method of the positional information in the fragment | piece structure information of 1st Example. It is a block diagram of the content data and metadata transmission apparatus in 1st Example. It is a block diagram of the content data and metadata receiving apparatus in 1st Example. It is an example of the processing method of the fragment | piece structure information in the content data and metadata receiver of 1st Example. It is an example of the processing method of the fragment | piece structure information in the content data and metadata receiver of 1st Example. It is an example of the processing method of the fragment | piece structure information in the content data and metadata receiver of 1st Example. It is a block diagram of the content data and metadata transmission system in 2nd Example. It is a figure which shows the structure of the fragment structure information in 2nd Example. It is a block diagram of the content data and metadata receiver in 2nd Example. It is a block diagram of the content data and metadata transmission system in 3rd Example. It is a block diagram of the content data and metadata receiver in 3rd Example. It is a block diagram of the fragment update unit (2) in the metadata stream of 4th Example. It is a figure which shows the outline of the fragmentation process of structured data and metadata stream preparation in 4th Example. It is explanatory drawing for implement | achieving the receiver in 2nd Example with a computer. And FIG. 11 is a configuration diagram of a computer that implements a receiving apparatus. It is a figure which shows the flow of a process of the structured data reception program performed with a computer. It is a conceptual diagram which shows the structure of the MPEG-7 description stream in an MPEG-7 system. FIG. 9 is a conceptual diagram showing addition of a fragment to a metadata tree by an “add” command of a fragment update unit in the MPEG-7 system. It is a figure which shows the outline of the fragmentation process of the structured data in 6th Example. It is a block diagram of the content data and metadata receiver in 6th Example.

Claims (8)

A structure for transmitting a plurality of pieces of fragment data and respective pieces of fragment configuration information corresponding to the pieces of fragment data, which is information for integrating the pieces of fragment data into structured data having a tree structure stored on the receiving side A data transmission device,
The fragment configuration information includes identification information for identifying the corresponding fragment data from each piece of fragment data, reference information having information on the name of the highest node of the corresponding fragment data, and the structuring of the corresponding fragment data Including location information about the connection location in the data,
The position information included in the fragment configuration information is position information including information specifying a node in the structured data and information specifying a connection position of the corresponding fragment data with respect to the specified node. ,
When the connection position of the corresponding fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, the information specifying the node in the position information is the one Information specifying a lower node, and information specifying a connection position of the corresponding fragment data for the specified node in the position information is specified for a node one level higher than the specified node. Information that designates the position immediately before the designated node as a connection position of the highest node of the corresponding fragment data ,
When the connection position of the corresponding fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of a single node having no subordinate node If there is, the information specifying the node in the position information is information specifying the one node, and the information specifying the connection position of the corresponding fragment data with respect to the specified node in the position information is the is one lower position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the fragment data which the corresponding,
An apparatus for transmitting structured data, characterized by comprising transmission means for transmitting a data stream generated by arranging the fragment data and the fragment configuration information. Structured to transmit a plurality of fragment data and each piece of fragment configuration information corresponding to each piece of fragment data, which is information for generating the structured data having a tree structure by integrating the pieces of fragment data on the receiving side A data transmission method,
The fragment configuration information includes identification information for identifying the corresponding fragment data from each piece of fragment data, reference information having information on the name of the highest node of the corresponding fragment data, and the structuring of the corresponding fragment data Including location information about the connection location in the data,
The position information included in the fragment configuration information is position information including information specifying a node in the structured data and information specifying a connection position of the corresponding fragment data with respect to the specified node. ,
When the connection position of the corresponding fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, the information specifying the node in the position information is the one Information specifying a lower node, and information specifying a connection position of the corresponding fragment data for the specified node in the position information is specified for a node one level higher than the specified node. Information that designates the position immediately before the designated node as a connection position of the highest node of the corresponding fragment data ,
When the connection position of the corresponding fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of a single node having no subordinate node If there is, the information specifying the node in the position information is information specifying the one node, and the information specifying the connection position of the corresponding fragment data with respect to the specified node in the position information is the is one lower position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the fragment data which the corresponding,
A structured data transmission method comprising transmitting a data stream generated by arranging the fragment data and the fragment configuration information. A plurality of first fragment data and each fragment configuration corresponding to each first fragment data which is information for integrating each first fragment data into structured data having a tree structure stored on the receiving side A structured data transmitting apparatus for transmitting information and fragment update data to which second fragment data is added with integrated information that is information for integrating the second fragment data into the structured data,
The fragment configuration information corresponds to the reference information having identification information for identifying the corresponding first fragment data from each of the first fragment data and information about the name of the highest node of the corresponding first fragment data. First position information related to a connection position of the first fragment data in the structured data, and first integration processing information for specifying addition as an integration processing method on the reception side of the corresponding first fragment data to the structured data; Including
The integrated information included in the fragment update data includes second position information related to a connection position in the structured data of the second fragment data, and integration processing on the receiving side of the second fragment data into the structured data. And a second integrated processing information designating addition as a method,
The first location information included in the fragment configuration information includes information specifying a node in the structured data and information specifying a connection position of the corresponding first fragment data with respect to the specified node. Location information,
When the connection position of the corresponding first fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, information specifying the node in the first position information is The information specifying the one lower node, and the information specifying the connection position of the corresponding first fragment data for the specified node in the first position information is one level higher than the specified node. Information specifying the position immediately before the specified node as the connection position of the highest node of the corresponding first fragment data . ,
The connection position of the corresponding first fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate of one node that does not have a subordinate node If it is a position, the information specifying the node in the first position information is information specifying the one node, and the corresponding first fragment data for the specified node in the first position information the information specifying the connection position, is lower by one position of the specified node, the last a position of a node position of the lower as the connection position of the top node of the first fragment data the corresponding Information to specify,
The second position information included in the fragment update data includes position information including information specifying a node in the structured data and information specifying a connection position of the second fragment data with respect to the specified node. And
When the connection position of the second fragment data in the structured data is immediately before one subordinate node located one level below one node, the information specifying the node in the second position information is Information specifying one lower node, and information specifying the connection position of the second fragment data for the specified node in the second position information is for a node one level higher than the specified node. Information that designates a position that is the same position as the designated node and a position immediately before the designated node as a connection position of the highest node of the second fragment data ,
When the connection position of the second fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of one node that does not have a subordinate node In some cases, the information specifying the node in the second position information is information specifying the one node, and the connection position of the second fragment data with respect to the specified node in the second position information. information specifying is lower by one position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the second fragment data,
An apparatus for transmitting structured data, comprising: transmitting means for generating and transmitting a data stream including the first fragment data, the fragment configuration information, and the fragment update data. A plurality of pieces of first fragment data and respective pieces of fragment configuration information corresponding to the first piece of fragment data, which is information for generating the structured data having a tree structure by integrating the first piece of fragment data on the receiving side. And a structured data transmission method for transmitting fragment update data to which second fragment data is added with integrated information that is information for integrating the second fragment data into the structured data,
The fragment configuration information corresponds to the reference information having identification information for identifying the corresponding first fragment data from each of the first fragment data and information about the name of the highest node of the corresponding first fragment data. First position information related to a connection position of the first fragment data in the structured data, and first integration processing information for specifying addition as an integration processing method on the reception side of the corresponding first fragment data to the structured data; Including
The integrated information included in the fragment update data includes second position information related to a connection position in the structured data of the second fragment data, and integration processing on the receiving side of the second fragment data into the structured data. And a second integrated processing information designating addition as a method,
The first location information included in the fragment configuration information includes information specifying a node in the structured data and information specifying a connection position of the corresponding first fragment data with respect to the specified node. Location information,
When the connection position of the corresponding first fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, information specifying the node in the first position information is The information specifying the one lower node, and the information specifying the connection position of the corresponding first fragment data for the specified node in the first position information is one level higher than the specified node. Information specifying the position immediately before the specified node as the connection position of the highest node of the corresponding first fragment data . ,
The connection position of the corresponding first fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate of one node that does not have a subordinate node If it is a position, the information specifying the node in the first position information is information specifying the one node, and the corresponding first fragment data for the specified node in the first position information the information specifying the connection position, is lower by one position of the specified node, the last a position of a node position of the lower as the connection position of the top node of the first fragment data the corresponding Information to specify,
The second position information included in the fragment update data includes position information including information specifying a node in the structured data and information specifying a connection position of the second fragment data with respect to the specified node. And
When the connection position of the second fragment data in the structured data is immediately before one subordinate node located one level below one node, the information specifying the node in the second position information is Information specifying one lower node, and information specifying the connection position of the second fragment data for the specified node in the second position information is for a node one level higher than the specified node. Information that designates a position that is the same position as the designated node and a position immediately before the designated node as a connection position of the highest node of the second fragment data ,
When the connection position of the second fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of one node that does not have a subordinate node In some cases, the information specifying the node in the second position information is information specifying the one node, and the connection position of the second fragment data with respect to the specified node in the second position information. information specifying is lower by one position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the second fragment data,
A structured data transmission method comprising: generating and transmitting a data stream including the first fragment data, the fragment configuration information, and the fragment update data. A structured data transmission device for transmitting each piece of fragment configuration information corresponding to each piece of fragment data, which is information for integrating a plurality of pieces of piece data into structured data having a tree structure stored on the receiving side. There,
The fragment configuration information includes location information regarding the location of the corresponding fragment data and reference information having information regarding the name of the highest node of the corresponding fragment data, and a connection position of the corresponding fragment data in the structured data And location information about
The position information included in the fragment configuration information is position information including information specifying a node in the structured data and information specifying a connection position of the corresponding fragment data with respect to the specified node. ,
When the connection position of the corresponding fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, the information specifying the node in the position information is the one Information specifying a lower node, and information specifying a connection position of the corresponding fragment data for the specified node in the position information is specified for a node one level higher than the specified node. Information that designates the position immediately before the designated node as a connection position of the highest node of the corresponding fragment data ,
When the connection position of the corresponding fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of a single node having no subordinate node If there is, the information specifying the node in the position information is information specifying the one node, and the information specifying the connection position of the corresponding fragment data with respect to the specified node in the position information is the is one lower position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the fragment data which the corresponding,
An apparatus for transmitting structured data, characterized by comprising transmission means for transmitting the fragment configuration information to the receiving side. A structured data transmission method for transmitting each piece of fragment configuration information corresponding to each piece of fragment data, which is information for generating a structured data having a tree structure by integrating a plurality of pieces of fragment data on the receiving side. And
The fragment configuration information includes location information regarding the location of the corresponding fragment data and reference information having information regarding the name of the highest node of the corresponding fragment data, and a connection position of the corresponding fragment data in the structured data And location information about
The position information included in the fragment configuration information is position information including information specifying a node in the structured data and information specifying a connection position of the corresponding fragment data with respect to the specified node. ,
When the connection position of the corresponding fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, the information specifying the node in the position information is the one Information specifying a lower node, and information specifying a connection position of the corresponding fragment data for the specified node in the position information is specified for a node one level higher than the specified node. Information that designates the position immediately before the designated node as a connection position of the highest node of the corresponding fragment data ,
When the connection position of the corresponding fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of a single node having no subordinate node If there is, the information specifying the node in the position information is information specifying the one node, and the information specifying the connection position of the corresponding fragment data with respect to the specified node in the position information is the is one lower position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the fragment data which the corresponding,
A method of transmitting structured data, wherein the fragment configuration information is transmitted to the receiving side. Each piece of fragment configuration information corresponding to each piece of first piece of data, which is information for integrating a plurality of pieces of first piece of data into structured data having a tree structure stored on the receiving side, and second piece of piece data A structured data transmitting device for transmitting fragment update data to which integrated information, which is information for integrating the second fragment data into the structured data, is added,
The fragment configuration information includes reference information having location information regarding the location of the corresponding first fragment data and information regarding the name of the highest node of the corresponding first fragment data, and the corresponding first fragment data. Including first position information related to a connection position in structured data, and first integrated processing information that designates addition as an integrated processing method on the receiving side of the corresponding first fragment data to the structured data,
The integrated information included in the fragment update data includes second position information related to a connection position in the structured data of the second fragment data, and integration processing on the receiving side of the second fragment data into the structured data. And a second integrated processing information designating addition as a method,
The first location information included in the fragment configuration information includes information specifying a node in the structured data and information specifying a connection position of the corresponding first fragment data with respect to the specified node. Location information,
When the connection position of the corresponding first fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, information specifying the node in the first position information is The information specifying the one lower node, and the information specifying the connection position of the corresponding first fragment data for the specified node in the first position information is one level higher than the specified node. Information specifying the position immediately before the specified node as the connection position of the highest node of the corresponding first fragment data . ,
The connection position of the corresponding first fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate of one node that does not have a subordinate node If it is a position, the information specifying the node in the first position information is information specifying the one node, and the corresponding first fragment data for the specified node in the first position information the information specifying the connection position, is lower by one position of the specified node, the last a position of a node position of the lower as the connection position of the top node of the first fragment data the corresponding Information to specify,
The second position information included in the fragment update data includes position information including information specifying a node in the structured data and information specifying a connection position of the second fragment data with respect to the specified node. And
When the connection position of the second fragment data in the structured data is immediately before one subordinate node located one level below one node, the information specifying the node in the second position information is Information specifying one lower node, and information specifying the connection position of the second fragment data for the specified node in the second position information is for a node one level higher than the specified node. Information that designates a position that is the same position as the designated node and a position immediately before the designated node as a connection position of the highest node of the second fragment data ,
When the connection position of the second fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of one node that does not have a subordinate node In some cases, the information specifying the node in the second position information is information specifying the one node, and the connection position of the second fragment data with respect to the specified node in the second position information. information specifying is lower by one position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the second fragment data,
An apparatus for transmitting structured data, comprising: transmitting means for generating and transmitting a data stream including the fragment configuration information and the fragment update data. A plurality of pieces of first fragment data are integrated on the receiving side to generate structured data having a tree structure. Each piece of piece structure information corresponding to each piece of first piece of data and second piece of fragment data A structured data transmission method for transmitting fragment update data added with integrated information, which is information for integrating the second fragment data into the structured data,
The fragment configuration information includes reference information having location information regarding the location of the corresponding first fragment data and information regarding the name of the highest node of the corresponding first fragment data, and the corresponding first fragment data. Including first position information related to a connection position in structured data, and first integrated processing information that designates addition as an integrated processing method on the receiving side of the corresponding first fragment data to the structured data,
The integrated information included in the fragment update data includes second position information related to a connection position in the structured data of the second fragment data, and integration processing on the receiving side of the second fragment data into the structured data. And a second integrated processing information designating addition as a method,
The first location information included in the fragment configuration information includes information specifying a node in the structured data and information specifying a connection position of the corresponding first fragment data with respect to the specified node. Location information,
When the connection position of the corresponding first fragment data in the structured data is immediately before one subordinate node located one subordinate to one node, information specifying the node in the first position information is The information specifying the one lower node, and the information specifying the connection position of the corresponding first fragment data for the specified node in the first position information is one level higher than the specified node. Information specifying the position immediately before the specified node as the connection position of the highest node of the corresponding first fragment data . ,
The connection position of the corresponding first fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate of one node that does not have a subordinate node If it is a position, the information specifying the node in the first position information is information specifying the one node, and the corresponding first fragment data for the specified node in the first position information the information specifying the connection position, is lower by one position of the specified node, the last a position of a node position of the lower as the connection position of the top node of the first fragment data the corresponding Information to specify,
The second position information included in the fragment update data includes position information including information specifying a node in the structured data and information specifying a connection position of the second fragment data with respect to the specified node. And
When the connection position of the second fragment data in the structured data is immediately before one subordinate node located one level below one node, the information specifying the node in the second position information is Information specifying one lower node, and information specifying the connection position of the second fragment data for the specified node in the second position information is for a node one level higher than the specified node. Information that designates a position that is the same position as the designated node and a position immediately before the designated node as a connection position of the highest node of the second fragment data ,
When the connection position of the second fragment data in the structured data is immediately after the last subordinate node located one subordinate to one node, or one subordinate position of one node that does not have a subordinate node In some cases, the information specifying the node in the second position information is information specifying the one node, and the connection position of the second fragment data with respect to the specified node in the second position information. information specifying is lower by one position of the specified node is information that specifies and final position of the node position of the lower as the connection position of the top node of the second fragment data,
A structured data transmission method, comprising: generating and transmitting a data stream including the fragment configuration information and the fragment update data.

Images