JP2001218204A - Data-processing method and device, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To efficiently control use of each object. SOLUTION: In the case that IPMP data exist in an IPMP stream (S1), a utilization state of object data of a higher layer denoted by IPMP information in the IPMP stream is checked (S2), and when the object data are available, whether the IPMP information includes control information with respect to utilization control of the object data is checked (S3). When the utilization is permitted (S3), the object data are used (S4). When the use of the object of the higher layer is not permitted (S2) and the use of the object is not permitted (S3), the use of a corresponding object is inhibited (S5). When the IPMP information includes no IPMP information of a lower layer (S6), the steps after the step S1 are repeated. When the IPMP information includes the IPMP information of the lower layer (S6), the IPMP information of the lower layer is loaded to a memory of an IPMP controller 24, and the steps after the step S2 are repeated.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data processing method and apparatus, and a storage medium, and more particularly, to reproducing information from a plurality of object data, in order to protect intellectual property in accordance with a scene configuration. The present invention relates to a data processing method and apparatus for controlling use of data and a storage medium.

[0002]

2. Description of the Related Art In recent years, as a method of encoding data such as moving images and audio, treating each encoded data as object data, and combining these so-called multimedia data and transmitting them as a single bit stream, an ISO has been proposed. MPEG-4 (Moving Pi
culture Experts Group pahse
4) is being standardized. An MPEG-4 receiving device (reproducing device) can reproduce, for example, audio and moving image scenes in association with each other. In the MPEG-4 system, due to the property that data is treated as object data,
Received bit stream is 1 for each object data
It is easy to separate and reorganize one by one. However, it is necessary to restrict the use of copyrighted object data in order to protect the copyright.

In the MPEG-4 data stream, unlike a general multimedia stream, a number of video scenes and video object data can be transmitted and received independently on a single stream. Similarly, for audio, several object data can be transmitted and received independently on a single stream.

As information for synthesizing these object data to generate a certain scene, a VRML-modified BIFS (Binary Format For S
cenes). BIFS describes a scene in binary, and the scene is synthesized according to this BIFS. Since the individual object data required for the synthesis of the scene are individually transmitted after being optimally encoded, they are also individually decoded on the decoding side, and the BI
According to the description of the FS, a scene is synthesized and output by synchronizing the time axis of each object data with the time axis inside the playback device.

[0005] Scenes can be arranged hierarchically. FIG. 22 shows a schematic diagram of one example. It is assumed that there are a plurality of object data such as music, people, captions, and backgrounds. The MPEG-4 encoder encodes each object data independently, multiplexes each encoded object data, and generates an MPEG-4 stream. The decoder separates the MPEG-4 stream into each object data, decodes them independently, combines the decoded results, and outputs the combined result. FIG. 23 shows the hierarchical structure of these object data.

As described above, since the MPGE-4 player synthesizes a plurality of object data, if any object data has a copyright, it is necessary to restrict its use. In accordance with this need, MPEG-4 uses IPMP (Intellectual Prope).
rty Management and Protect
) is adopted. I
In PMP, use of each object data can be controlled by IPMP information.

[0007]

In the conventional IPMP system, object data and IPMP information are paired so that use can be controlled independently for each object data in order to have a large degree of freedom. However, in practice, it is desired to increase the efficiency of use control of object data by controlling the use in a plurality of object data units instead of independent use control for each object data.

[0008] In MPEG-4, the use can be controlled in units of scenes. However, as the number of object data included in a scene increases, it becomes more complicated to independently control the use in units of object data, and the efficiency of object data increases. Use control is desired.

In MPEG-4, scenes can be described hierarchically as described above. Also in this case, as the number of scenes increases, it becomes very complicated to independently control the use of object data in units of object data. In this regard, efficient use control of object data is also desired.

[0010] The present invention has been made in view of such circumstances, and provides a data processing method and apparatus and a storage medium which efficiently control the use of object data according to the configuration of the object data. With the goal.

[0011]

A data processing method according to the present invention is a data processing method for reproducing a plurality of object streams each having predetermined information, and controls whether each object can be used from input data. A management information extraction step of extracting hierarchical management information;
A higher-order determining step of determining whether or not use of a higher-order object of the target object is prohibited according to the management information extracted in the management information extracting step;
A control step of prohibiting the use of the object of interest when the use of the object higher than the object of interest is prohibited according to the result of the determination of the higher order determination step.

A data processing apparatus according to the present invention is a data processing apparatus for reproducing a plurality of object streams each having predetermined information, and includes hierarchical management information for controlling whether or not each object can be used from input data. Management information extracting means for extracting the object, a high-order determining means for determining whether or not the use of an object higher than the object of interest is prohibited according to the management information extracted by the management information extracting means, According to the result, when use of an object higher than the object of interest is prohibited, control means for prohibiting use of the object of interest is provided.

[0013] The management information for controlling the use of each object in the object stream is hierarchized, and when the use of an object higher than the object of interest is prohibited, the use of the object of interest is prohibited. Can control the use of each object.

[0014] By encrypting the management information (or its hierarchical structure), the use control of each object is further ensured.

[0015]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a schematic block diagram of an embodiment of an MPEG-4 player to which the present invention is applied. Transmission line 1
Numeral 0 includes, for example, various networks and computer paths. An MPEG-4 stream is input to the demultiplexer 14 of the playback device 12 via the transmission path 10. The transmission path 10 also includes a CD-
It may be an interface with a playback mechanism or a playback device for a recording medium such as a ROM, a DVD-ROM, and a DVD-RAM.

The demultiplexer 14 separates the MPEG-4 stream input from the transmission line 10 into scene description data, moving image object data, audio object data, object description data, and control data (IPMP information to be described later). Synchronization layer 1 corresponding to the description data, moving image object data, audio object data, and object description data
6,18,20,22 and control data (IPMP
) To the IPMP control device 24.

The MPEG-4 stream includes information necessary for controlling reproduction of individual object data such as audio and moving images constituting a scene in order to protect copyrights, that is, IPMP information. The IPMP information is added to the IPMP stream, and the IPMP stream is added to the MPEG-4 stream and transmitted like other objects.

The audio object data is, for example, a known CELP (Code Excited Line Pr).
The coding is performed by a high-efficiency coding method such as an edition coding or a transform domain weighted interleaved vector quantization (TWINVQ) coding. The moving image object data is, for example, a well-known MPEG-2 format or H
High-efficiency coding is performed by the -263 system. Scene description data includes graphic data.

Each of the synchronization layers 16, 18, 20, 22
In accordance with time information called a time stamp added to the MPEG-4 stream, the scene description data, audio object data, moving image object data and object description data are time-synchronized to decode circuits 26 and 2.
8, 30, 32. The IPMP control device 24
According to the IPMP information from the demultiplexer 14, the data supply from the synchronization layers 16 to 22 to the decoding circuits 26 to 32 and the execution (start / stop) of the decoding operation of the decoding circuits 26 to 32 are controlled. Although details will be described later, for example, as shown in FIG. 2, the IPMP control device 24 stops the reproduction of the object data # 2, the reproduction of the object data # 3, the reproduction of the object data # 3, and the reproduction of the object data # 2. The use is independently controlled for each object data, such as starting reproduction.

In this embodiment, the audio object data, the moving image object data and the object description data can be decoded even if a plurality of different types of object data exist in the MPEG-4 stream. The synchronization layers 18, 20, 2
2 and a plurality of decoding circuits 28, 30, and 32, respectively.

The scene description data, audio object data, moving image object data and object description data decoded by the decoding circuits 26, 28, 30, and 32 are applied to a scene synthesis circuit 34. Based on the scene description data decoded by the scene description decoding circuit 26, the scene synthesis circuit 34
And synthesizes and graphically processes the decoded audio object data, moving image object data, and object description data. The final data sequence thus obtained is supplied to an output device 36 such as a display and a printer device, and is visualized.

As described above, the MPEG-4 stream is composed of scene description data, moving image object data, audio object data, object description data, IPMP stream, etc., and the demultiplexer 14 separates each object data. . The separated IPMP stream is stored in a memory in the IPMP control device 24, after which the IPMP information is read from the memory and the control information is extracted from the IPMP information.
In accordance with the control information, the operation (reproduction start and stop, etc.) of the reproduction system of each object data is controlled.

The IPMP information can be classified into IPMP information for scene description data (hereinafter referred to as IPMP information for scene) and IPMP information for object data excluding IPMP information for scene description (hereinafter referred to as IPMP information for object). . A scene is composed of one or more pieces of object data, and can be considered to have a hierarchical structure as shown in FIG. 3, as described above. Since the object data has a hierarchical structure, it is considered that the IPMP information paired with the object data also has a similar hierarchical structure as shown in FIG. In this embodiment, I
By providing the PMP information with the layering information, the IPMP information is layered according to the configuration of the object data. The use control according to the configuration of the object data is enabled by the hierarchical IPMP information.

Referring to FIG. 5, the IPM in the present embodiment
The operation of the P control device 24 will be described. FIG. 5 shows an operation flowchart of the IPMP control device 24 when an MPEG-4 stream including an IPMP stream is received.

The IPMP stream is transmitted to the IPMP controller 2
4 and stored in the IPMP stream
It is checked whether or not the MP information is included (S1). If not, the operation of the IPMP control device 24 ends. For example, MP without IPMP stream
In the case of the EG-4 stream, the IPMP controller 24
Ends the IPMP process. Thus, the object data can be freely used.

If there is IPMP data (S1), the IP
The usage status of the upper layer object data indicated by the IPMP information existing in the memory of the MP control device 24 is checked (S2), and if available, the IPMP information includes control information on the usage control of the object data. It is checked whether it is (S3). If the use is permitted (S3), the object data is used (S3).
4). When the use of the object in the upper hierarchy is not permitted (S2) and when the use of the target object is not permitted (S3), the use of the corresponding object is prohibited (S5).

If the IPMP information does not include the lower layer IPMP information (S6), S1 and subsequent steps are repeated. If the lower layer IPMP information is included (S6), the lower layer IPM
P information is loaded into the memory of the IPMP controller 24,
Repeat step 2 and subsequent steps. That is, for objects belonging to the next lower layer, the availability is determined based on the control information of the IPMP information, and the use is controlled based on the result.

By repeating the above procedure for each scene,
The use of the object can be controlled according to the configuration of the object data.

Next, a description will be given of object use control according to the scene configuration in this embodiment. MPEG-
4 streams are continuous scene # 1 and scene # 2
It is assumed that it is composed of two scenes. FIG. 6 is a schematic diagram of the configuration of scene # 1, and FIG. 7 is a schematic diagram of the configuration of scene # 2. Scene # 1 is object data #
1 and object data # 2, and scene # 2 is assumed to be composed of object data # 3 and object data # 4. FIG. 8 is a schematic diagram of the configuration of IPMP information for scene # 1, and FIG. 9 is a schematic diagram of the configuration of IPMP information for scene # 2. The scene # 1 IPMP information includes IPMP information for object # 1 and IPMP information for object # 2, and the IPMP information for scene # 2 includes IPMP information for object data # 3 and IPMP information for object data # 4.

FIG. 10 shows an example of an IPMP stream. The IPMP stream includes IPMP information for scene # 1, IPMP information for object # 1, and object # 1.
2, IPMP information for scene # 2, IPMP information for object # 3, and IP for object # 4
It consists of MP information. The scene # 1 IPMP information includes a pointer to the object # 1 IPMP information and a pointer to the object # 2 IPMP information.
The IPMP information for 2 includes a pointer to IPMP information for object # 3 and a pointer to IPMP information for object # 4. The IPMP information is hierarchized by these pointers.

FIG. 11 shows another example of the IPMP stream. In this example, the IPMP stream is scene # 1
IPMP information for scene # 2 and IPMP information for scene # 2,
IPMP information for scene # 1 is IPM for object # 1
P information and IPMP information for object # 2 are included, and IPMP information for scene # 2 includes IPMP information for object # 3 and IPMP information for object # 4. With such a configuration, the IPMP information may be hierarchized.

FIG. 12 is a block diagram showing the configuration of the IPMP controller in detail. 40 is a demultiplexer, 42a and 42b are synchronization layers, 44a and 44b are use control devices, 46a and 46b are object decoding devices, 48 is a scene synthesis device, and 50 is an IPMP control device. The IPMP control device 50 includes a memory 52 that stores an IPMP stream, an IPMP information extraction device 54 that extracts IPMP information from the memory 52, and a usage status inspection device 5.
6. Control information extraction device 58 and IPMP information inspection device 6
0 is provided. Although two systems are exemplified as the object decoding system, it is needless to say that three or more systems may be used.

The demultiplexer 40 receives the input MPE
The G-4 stream is separated into scene description data, moving image object data, audio object data, object description data, an IPMP stream, and the like, and the scene description data, moving image object data, audio object data, and object description data are converted into a synchronization layer 42.
a, 42b, and the IPMP stream to the IPMP control device 50. The synchronization layers 42a and 42b are:
Each object data is synchronized on the time axis based on the time stamp.

Each of the use control devices 42 and 42b
According to the control information from the control information extraction device 58 of the PMP control device 50, the outputs of the synchronization layers 42a and 42b are selectively supplied to the decoding devices 46a and 46b, whereby the use of each object is controlled. The object decoding devices 46a and 46 decode the input data, that is, the encoded object data, and
Is applied. The scene synthesizing device 48 synthesizes the outputs of the decoding devices 46a and 46b based on the decoded scene description data and performs graphic processing.

The IPMP control device 50 operates as follows. The memory 52 stores the IPM from the demultiplexer 40.
The P stream is temporarily stored. The IPMP information extraction device 54 extracts IPMP information from the IPMP stream stored in the memory 52. If the IPMP information cannot be extracted from the IPMP stream stored in the memory 52, the IPMP control device 50 stops the use control process.

The usage status checking device 56 checks the usage status of the upper layer object data from the IPMP information,
If available, the IPMP information is sent to the control information extraction device 5
8 and if it cannot be used, the process proceeds to the IPMP information extraction device 56. The control information extraction device 58
The control information is extracted from the MP information, and the extracted control information is applied to the use control devices 44a and 44b. The IPMP information checking device 60 checks whether the IPMP information includes the lower-layer IPMP information, and outputs the lower-layer IPMP information to the control information extracting device 58 if the IPMP information includes the lower-layer IPMP information. The processing moves to.

The operation of the IPMP control device 50 will be described in comparison with the flowchart shown in FIG. The IPMP information extraction device 54 extracts the IPMP information for scene # 1 from the IPMP stream in the memory 52, and
6 (S1). Since there is no upper layer object data of the scene # 1 IPMP information, the usage status inspection device 56 outputs the scene # 1 IPMP information to the control information extraction device 58 (S2). Control information extraction device 5
8 extracts control information from the IPMP information for scene # 1, and uses the usage control devices 44a and 44b based on the control information.
To control the use of the corresponding object data (S3, S4, S5). If available, the use control devices 44a and 44b supply the data from the synchronization layers 42a and 42b to the object decoding devices 46a and 46b,
When the use is impossible, the use control devices 44a and 44b do not supply the data from the synchronization layers 42a and 42b to the object decoding devices 46a and 46b.

The IPMP information checking device 60 detects the IPMP information for the object # 1 as the lower layer IPMP information and outputs it to the usage status checking device 56 (S6, S
7). Since the use of the object data corresponding to the scene # 1 which is the upper hierarchy of the object data # 1 is permitted, the usage status inspection device 56
Is output to the control information extracting device 58 (S
2). The control information extraction device 58 uses the object # 1 I
The control information is extracted from the PMP information, and the use control devices 44a and 44b are controlled based on the control information to control the use of the corresponding object data # 1 (S3, S4, S4).
S5).

The IPMP information inspection device 60 detects the IPMP information for the object # 2 as the lower layer IPMP information and outputs it to the usage status inspection device 56 (S6, S6).
7). Since the use of the object data corresponding to the scene # 1 which is the upper hierarchy of the object data # 2 is permitted, the usage status inspection device 56 sets the object # 2
Is output to the control information extracting device 58 (S
2). The control information extraction device 58 uses the object # 2 I
The control information is extracted from the PMP information, and the use control devices 44a and 44b are controlled based on the control information to control the use of the corresponding object data # 2 (S3, S4, S4).
S5).

Next, the IPMP information inspection device 60
Since no P information is detected, the processing is shifted to the IPMP information extraction device 54 (S6).

The IPMP information extraction device 54 includes a memory 52
, The next IPMP information, that is, the IPMP information for scene # 2 of the next scene is extracted and output to the usage status inspection device 56 (S1). Since there is no upper layer object data of the scene # 2 IPMP information, the usage status inspection device 56 outputs the scene # 2 IPMP information to the control information extraction device 58 (S5). Control information extraction device 58
Extracts control information from IPMP information for scene # 2,
The use control devices 44a and 44b are controlled based on the control information to control the use of the corresponding object data (S3, S4, S5).

The IPMP information checking device 60 detects the IPMP information for the object # 3 as the lower layer IPMP information and outputs it to the usage status checking device 56 (S6, S6).
7). Since the use of the object data corresponding to the scene # 2, which is the upper layer of the object data # 3, is permitted, the usage status inspection device 56 sets the object # 3
Is output to the control information extracting device 58 (S
2). The control information extraction device 58 uses the object # 3 I
The control information is extracted from the PMP information, and the use control devices 44a and 44b are controlled based on the control information to control the use of the corresponding object data # 3 (S3, S4, S4).
S5).

The IPMP information inspection device 60 detects the IPMP information for the object # 4 as the lower layer IPMP information, and outputs it to the usage status inspection device 56 (S6, S6).
7). Since the use of the object data corresponding to the scene # 1 which is the upper hierarchy of the object data # 4 is permitted, the usage status inspection device 56 sets the object # 4
Is output to the control information extracting device 58 (S
2). The control information extraction device 58 uses the object # 4 I
The control information is extracted from the PMP information, and the use control devices 44a and 44b are controlled based on the control information to control the use of the corresponding object data # 4 (S3, S4, S4).
S5).

The IPMP information inspection device 60 performs the following IPM
Since no P information is detected, the use control process ends (S6, S1).

FIG. 12 shows the IPMP control device 50 in a configuration that makes it easy to understand the configuration in comparison with the flowchart shown in FIG. As shown in FIG. 12, when data is fed back and data is processed in parallel for each block, data collision and synchronization problems occur.
It is necessary to perform sequential processing for each block. On the other hand, when the IPMP information is extracted, the usage status of the object data in the upper layer is checked, and when it is available, the layering information is checked in advance, so that data feedback can be eliminated. FIG. 13 shows an example of such a modified configuration. The same components as those shown in FIG. 12 are denoted by the same reference numerals. That is, the IPMP information inspection / extraction device 64 of the IPMP control device 50a checks the usage status of the object data in the upper layer, and if
The IPMP information is sequentially output to the control information extracting device 64 while checking the hierarchical structure of the P information. The control information extraction device 64 controls the use control devices 44a and 44b according to the input control, similarly to the control information extraction device 58.

As described above, by checking the use status of the object data of the upper layer and controlling the use of the object data of the lower layer, it is possible to control the use of the object data for each layer. That is, the use of the object data can be controlled not only by the control information included in the IPMP information but also by the use state of the object data in the upper layer. Even if the use of the object data of the upper layer is prohibited even for the object data of the lower layer which is not controlled for use, the use can be prohibited.

This is very effective in the case of "pasting object data on object data" which is a feature of MPEG-4. It is conceivable that the object data to be pasted can be used and the object data to be pasted is prohibited from being used. The use control based on the IPMP information alone causes a contradiction in the scene configuration in such a case. It is conceivable that four systems will go down. However, the present embodiment can appropriately cope with such a case by generating IPMP information in consideration of the usage form of the object data and controlling the use of the object data based on the IPMP information. Specifically, the object data to be pasted may be set to the upper hierarchy, and the object data to be pasted may be set to the lower hierarchy. At this time, the object data to be pasted becomes available only when the object data to be pasted is available.

Another hierarchical configuration example according to the present invention will be described.
As described above, MPEG-4 allows a hierarchical scene configuration. FIG. 14 shows a hierarchical scene configuration. In the example shown in FIG. 14, scene # 1 is composed of object data # 1 and scene # 2, and scene # 2 is composed of object data # 2. FIG. 15 shows a configuration example of IPMP information corresponding to the scene configuration shown in FIG. The scene # 1 IPMP information is composed of the object # 1 IPMP information and the scene # 2 IPMP information.
The PMP information is composed of the IPMP information for object # 2.

FIG. 16 shows a configuration example of the IPMP stream corresponding to the configuration example of the IPMP information shown in FIG. In this example, the IPMP stream is an IPMP for scene # 1.
Information, IPMP information for object # 1, IPMP information for scene # 2, and IPMP information for object # 2. The IPMP information for scene # 1 is a pointer to the IPMP information for object # 1 and the IPMP information for scene # 2. The IPMP information for scene # 2 includes a pointer to the IPMP information for object # 2. Thereby, the IPMP information can be hierarchized.

FIG. 17 shows another configuration example of the IPMP stream. In this example, no pointer is used. IPM
The P stream is composed of IPMP information for scene # 1,
The IPMP information for scene # 1 is I for object # 1.
PMP information and IPMP information for scene # 2 are included, and IPMP information for scene # 2 includes IPMP information for object # 2. Even with such a configuration, the IPMP information can be hierarchized. In this configuration, scene IPMP information and object IPMP information are handled in the same manner.

The structure shown in FIG. 12 can control the use of each object in the hierarchical structure shown in FIGS. 14 and 15 by the same processing procedure as the flowchart shown in FIG. FIG.
Referring to the components shown in FIG. 2 and the respective steps in FIG. 5, FIG.
4 and the usage control operation for the hierarchical structure shown in FIG. 15 will be described.

The demultiplexer 40 separates the IPMP stream included in the MPEG-4 stream,
Output to the MP controller 50. The memory 52 temporarily stores the IPMP stream from the demultiplexer 40.

The IPMP information extraction device 54 includes a memory 52
The IPMP information for scene # 1 is extracted from the IPMP stream of (1), and is output to the usage status inspection device 56 (S1). Since there is no upper layer object data of the IPMP information for scene # 1, the usage state inspection device 56
The IPMP information for 1 is output to the control information extraction device 58 (S2). The control information extraction device 58 uses the IP for scene # 1.
The control information is extracted from the MP information, and the use control devices 44a and 44b are controlled based on the control information to control the use of the corresponding object data (S3, S4, S4).
5).

The IPMP information checking device 60 detects the IPMP information for the object # 1 as the lower layer IPMP information and outputs it to the use status checking device 56 (S6, S6).
7). Since the use of the object data corresponding to the scene # 1 which is the upper hierarchy of the object data # 1 is permitted, the usage status inspection device 56
Is output to the control information extracting device 58 (S
2). The control information extraction device 58 uses the object # 1 I
The control information is extracted from the PMP information, and the use control devices 44a and 44b are controlled based on the control information to control the use of the corresponding object data # 1 (S3, S4, S4).
S5).

The IPMP information inspection device 60 detects the scene # 2 IPMP information as the lower layer IPMP information and outputs it to the usage status inspection device 56 (S6, S7).
Since the use of the object data corresponding to the scene # 1 which is the upper layer of the scene # 2 is permitted, the usage status inspection device 56 outputs the IPMP information for the scene # 2 to the control information extraction device 58 (S2). . Control information extraction device 5
8 extracts control information from the IPMP information for scene # 2 and uses the usage control devices 44a and 44b based on the control information.
To control the use of the corresponding object data (S3, S4, S5).

The IPMP information checking device 60 detects the IPMP information for the object # 2 as the lower layer IPMP information and outputs it to the usage status checking device 56 (S6, S6).
7). Since the use of the object data corresponding to the scene # 2, which is the upper layer of the object data # 2, is permitted, the usage status inspection device 56
Is output to the control information extracting device 58 (S
2). The control information extraction device 58 uses the object # 2 I
The control information is extracted from the PMP information, and the use control devices 44a and 44b are controlled based on the control information to control the use of the corresponding object data # 2 (S3, S4, S4).
S5).

Next, the IPMP information inspection device 60
Since no P information is detected, the processing is shifted to the IPMP information extraction device 54 (S6).

The above processing is processing for a certain scene. Each time a subscene configuration such as scene # 2 is updated, the usage control is updated in the same manner as described above.

As described above, in this embodiment, the use of object data can be controlled even for a hierarchical scene configuration.

The use control of object data in one scene is the same as in the case of the hierarchical structure shown in FIGS. 3 and 4, but by processing recursively for each scene, the same applies to the hierarchical scene structure. Use of object data for each scene can be controlled.

Next, an example of the configuration of an IPMP stream that can control access to IPMP information will be described. FIG.
Shows a first configuration example of an IPMP stream having an access control function. FIG. 18 corresponds to the scene configuration shown in FIG. 6 and the IPMP hierarchical configuration shown in FIG. In FIG. 18, the IPMP stream is composed of scene # 1 IPMP information, encrypted object # 1 IPMP information, and encrypted object # 2 IPMP information. The IPMP information for scene # 1 includes permission information for generating key information, a pointer to IPMP information for encrypted object # 1, and a pointer to IPMP information for encrypted object # 2. In combination with the encryption method, access control of the objects # 1 and # 2 to the IPMP information becomes possible.

FIG. 19 is a block diagram showing an I / O device having an access control function.
5 shows a second configuration example of a PMP stream. The IPMP stream is composed of IPMP information for scene # 1. scene#
The IPMP information for 1 is permission information, encrypted object #
1 and IPM for encrypted object # 2
P information. If the permission information includes a decryption key of the IPMP information for the encryption object # 1 and the decryption key of the IPMP information for the encryption object # 2, the encryption object # 1
IPMP information and IPMP for encrypted object # 2
The information can be decrypted.

FIG. 20 is a flowchart for processing the IPMP stream with the access control function shown in FIGS. 18 and 19.

The I separated from the MPEG-4 stream
The PMP stream is stored in the memory of the IPMP control device. If the stored IPMP stream does not include the IPMP information (S11), the processing of the IPMP control ends. That is, the MPE that does not include the IPMP stream
This is the case of the G-4 stream, and all object data can be used freely.

If there is IPMP information (S11), it is checked whether the IPMP information of the upper layer is encrypted, and if the IPMP information is encrypted, a decryption key is included (S13). If encrypted and key information is included (S13), it is checked whether the IPMP information permits use of the object data by the control information (S13). If the IPMP information is permitted (S13), the object data is Is used (S14). When the encryption cannot be decrypted (S12) and when the use is not permitted (S13), the use of the object is prohibited (S15).

It is checked whether or not the IPMP information includes permission information (S16). If it does (S16), the encrypted data is decrypted using key information obtained from the permission information (S1).
7).

If the IPMP information or the decryption result is
It is checked whether or not PMP information is included (S18). If PMP information is included (S18), the lower layer IPMP information is stored in the memory of the IPMP control device, and S12 and subsequent steps are repeated. Step S11 and subsequent steps are repeated.

FIG. 21 is a schematic block diagram of a reproducing apparatus for realizing the operation shown in FIG. In FIG.
The same components as those shown in FIG. 12 are denoted by the same reference numerals.

The operation of the IPMP control device 50b will be mainly described. The memory 70 stores the IP from the demultiplexer 40.
The MP stream is temporarily stored. The IPMP information extraction device 72 extracts IPMP information from the IPMP stream stored in the memory 70. If the IPMP information cannot be extracted from the IPMP stream stored in the memory 70, the IPMP control device 50b stops the use control process.

The decryption key inspection device 74 determines whether or not the upper layer IPMP information has been encrypted from the output of the IPMP information extraction device 72, and if so, includes key information for decryption. If it is not encrypted, and if the key information can be stored and decrypted even if it is encrypted, the IPMP information is output. Transfer.
The control information extraction device 76 extracts control information from the IPMP information and uses the extracted control information as the use control devices 44a and 44.
b.

The permission information extracting device 78 extracts permission information included in the IPMP information, and writes the extracted permission information into the storage device 80. The decryption device 82 uses the key information obtained from the permission information stored in the storage device 80 to
Decode the control information of the information.

The IPMP information checking device 84 checks whether the IPMP information includes the lower layer IPMP information, and outputs the lower layer IPMP information to the decryption key checking device 74 when the IPMP information includes the IPMP information. Information extraction device 7
The processing is shifted to 2.

The operation of the apparatus shown in FIG. 21 will be described by taking the hierarchical structure of the IPMP information shown in FIG. 18 as an example. The IPMP information extracting device 72 extracts the IPMP information for scene # 1 from the IPMP stream stored in the memory 70 and outputs it to the decryption key checking device 74 (S11). Scene # 1 IP
Since there is no upper layer object data of the MP information, the decryption key inspection device 74 outputs the scene # 1 IPMP information (S74). The control information extraction device 76 extracts control information from the scene # 1 IPMP information, and controls the use of the corresponding object data based on the control information (S13, S14, S15).

The permission information extracting device 78 outputs the scene # 1 I
The permission information is extracted from the PMP information, and the extracted permission information is output to the storage device 80 (S16). The decoding device 82
The IPMP information for the encrypted object # 1 and the IPMP information for the encrypted object # 2 are decrypted using the key information obtained from the permission information stored in the storage device 80 (S1).
7).

The IPMP information checking device 84 detects the IPMP information for the object # 1 and the IPMP information for the object # 2 as the lower layer IPMP information, and outputs them to the decryption key checking device 74 (S18, S19).

Since the IPMP information for scene # 1 in the upper layer is not encrypted, the decryption key inspection device 74 outputs the IPMP information for object # 1 (S12). The control information extracting device 76 extracts the control information from the IPMP information for the object # 1, and controls the use of the corresponding object data # 1 based on the control information (S13, S13).
14, S15).

The permission information extracting device 78 uses the object #
No permission information is extracted from the IPMP information for S1 (S1
6). The IPMP information inspection device 84 checks the object # 1
The lower level IPMP information is not detected from the IPMP information for use (S18).

Next, the IPMP information extracting device 72 extracts the IPMP information for the object # 2 and outputs it to the decryption key checking device 74 (S11). Upper hierarchy scene # 1 I
Since the PMP information is not encrypted, the decryption key inspection device 74 outputs the IPMP information for the object # 2 (S12). The control information extraction device 76 has the object #
The control information is extracted from the IPMP information for 2 and the use of the corresponding object data # 2 is controlled based on the control information (S13, S14, S15).

The permission information extracting device 78 uses the object #
The permission information is not extracted from the IPMP information for S2 (S1
6). The IPMP information inspection device 84 checks the object # 2
The lower level IPMP information is not detected from the IPMP information for use (S18). Here, the IPMP control processing ends (S
11).

FIG. 21 shows components arranged corresponding to the flowchart shown in FIG. When data is fed back as shown in FIG. 21, if data is processed in parallel for each block, data collision and synchronization problems occur, so that it is necessary to perform sequential processing for each block. On the other hand, similarly to the configuration of FIG.
At the time when the information is extracted, it is checked whether or not the upper layer IPMP information is decodable.
By sequentially outputting the IPMP information while checking the hierarchical structure of the P information, data feedback can be eliminated.

FIG. 20 shows a process for a certain scene, and it is necessary to execute the process shown in FIG. 20 every time the scene configuration is updated.

By controlling the access to the lower layer IPMP information by the encryption method, the use of each object data can be controlled more reliably. The encryption method is used for the description format of the hierarchical structure, and the IPMP stream is
It is composed of MP information and decodes IPMP information for lower layer object data for each scene use control. Thereby, unauthorized access to the IPMP information can be prevented.

This embodiment proposes encryption of IPMP information. The encryption of the object data itself is MPEG-
4 is realized by the IPMP system of the third embodiment. By using the IPMP information together with the encryption of the IPMP information according to the present embodiment, not only the unauthorized access to the IPMP information but also the unauthorized access to the object data itself can be prevented. It is possible to reliably control the use of the object data of the lower hierarchy according to the usage status of the hierarchy. That is, the permission of use of the object data of the upper layer by decrypting the encrypted IPMP information and the decryption of the encrypted object data allows the IP of the lower layer to be used.
The MP information can be decrypted. Further, the IPMP information makes it possible to use the lower layer encrypted object data.

It is apparent that similar effects can be obtained even when the encryption of the IPMP information is used in combination with the hierarchical structure shown in FIGS.

The present invention is applicable not only to two-dimensional image objects but also to three-dimensional image objects. Further, not only one object data corresponds to one logical object but also one logical object such as formation of a three-dimensional image object by texture image data, modeling data and animation data. The present invention also includes the case where a plurality of object data correspond to each other. The three-dimensional object formation is performed by, for example, a home game machine, a personal computer, a graphic computer, and the like.

In the above description, the management information IPMP
Although the information and the hierarchical information are input as an object stream, for example, a case where the information and the hierarchical information are input from an external input device such as a keyboard or an external storage device such as a magnetic storage device is also included in the technical scope of the present invention. . Although the management information is managed including the hierarchical information, they may be managed independently. That is, by treating each object data, management information, and hierarchical information in the same manner as the object data and the management information, such as the IPMP information and the hierarchical information, the use of other object data can be controlled according to the usage status of the object data. become.

The present invention is not limited to an apparatus and a method for realizing the above-described embodiments, and a method combining the above-described methods. The present invention is implemented by supplying a computer (CPU or MPU) with software program codes for realizing the functions of the above-described embodiments, operating the computer according to a stored program, and operating the various devices. Are also included in the scope of the present invention.

In this case, the software program code itself implements the functions of the above-described embodiment, and the program code itself and means for supplying the program code to the computer, for example,
A storage medium storing such a program code constitutes the present invention. As a storage medium for storing such a program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, magnetic tape, nonvolatile memory card, ROM and the like can be used.

Further, when the computer executes the supplied program code, not only the functions of the above-described embodiments are realized, but also the OS (operating system) or other operating system running on the computer. Such a program code is also included in the scope of the present invention when the functions of the above-described embodiments are realized in cooperation with application software or the like.

Further, the supplied program code is
After being stored in the memory provided in the function expansion board of the computer or the function expansion unit connected to the computer, the CPU or the like provided in the function expansion board or the function expansion unit performs one of the actual processing based on the instruction of the program code. The invention according to the present application also includes a case where the functions of the above-described embodiments are realized by performing the processes of all or a part.

[0092]

As can be easily understood from the above description, according to the present invention, the use of an object stream can be controlled according to the configuration of the object stream. Therefore, when handling a data stream including a plurality of object streams each having predetermined information, the use of each object stream can be efficiently controlled.

[Brief description of the drawings]

FIG. 1 is a schematic block diagram of an embodiment of the present invention.

FIG. 2 is an example of a procedure for decoding object data under control of an IPMP stream.

FIG. 3 is a configuration example of object data in an MPEG-4 system.

FIG. 4 is a configuration example of IPMP information.

FIG. 5 is a processing flowchart of the present embodiment.

FIG. 6 is a schematic diagram showing a configuration of object data of scene # 1.

FIG. 7 is a schematic diagram illustrating a configuration of object data of a scene # 2.

FIG. 8 is a schematic diagram showing a configuration of IPMP information of scene # 1.

FIG. 9 is a schematic diagram showing a configuration of IPMP information of scene # 2.

FIG. 10 is a schematic diagram illustrating a first configuration example of an IPMP stream in the present embodiment.

FIG. 11 is a schematic diagram illustrating a second configuration example of an IPMP stream in the present embodiment.

FIG. 12 is a schematic configuration block diagram of a first configuration example of an IPMP control device;

FIG. 13 is a schematic block diagram of a second configuration example of the IPMP control device.

FIG. 14 is a schematic diagram of a scene configuration example.

FIG. 15 is a schematic diagram illustrating a configuration example of IPMP information of a scene corresponding to FIG. 14;

FIG. 16 is a schematic diagram of a configuration example of an IPMP stream corresponding to FIGS. 14 and 15;

FIG. 17 is a schematic diagram of another configuration example of the IPMP stream corresponding to FIGS. 14 and 15;

FIG. 18 is a schematic diagram of a configuration example of an IPMP stream corresponding to encryption.

FIG. 19 is a schematic diagram of another configuration example of an IPMP stream corresponding to encryption.

FIG. 20 is a processing flowchart corresponding to FIGS. 18 and 19;

FIG. 21 is a schematic configuration block diagram of a configuration example of an IPMP control device corresponding to FIG. 20;

FIG. 22 is a block diagram schematically showing an MPEG system.

FIG. 23 is a schematic diagram showing a configuration of an object stream in MPEG-4.

[Explanation of symbols]

 10: Transmission path 12: Reproduction device 14: Demultiplexer 16, 18, 20, 22: Synchronization layer 24: IPMP controller 26, 28, 30, 32: Decoding circuit 34: Scene synthesis circuit 36: Output device 40: Demultiplexer 42a, 42b: Synchronization layer 44a, 44b: Usage control device 46a, 46b: Object decoding device 48: Scene synthesis device 50, 50a, 50b: IPMP control device 52: Memory 54: IPMP information extraction device 56: Usage status inspection device 58 : Control information extraction device 60: IPMP information inspection device 62: IPMP information inspection and extraction device 64: control information extraction device 70: memory 72: IPMP information extraction device 74: decryption key inspection device 76: control information extraction device 78: permission information extraction Device 80: Storage device 82: Decoding device 84: IPMP information Inspection device

Continued on the front page F-term (reference) 5B017 AA01 BA05 BA07 BB02 CA09 CA16 5C059 KK43 MA00 MB11 MB12 MB29 PP04 RB01 RB18 RC32 RC35 SS06 SS11 SS20 SS30 UA05 UA39

Claims (23)

[Claims] 1. A data processing method for reproducing a plurality of object streams each having predetermined information, comprising: a management information extracting step of extracting hierarchical management information for controlling availability of each object from input data; An upper determination step for determining whether or not the use of an object higher than the object of interest is prohibited in accordance with the management information extracted in the management information extraction step; A control step of prohibiting the use of the object of interest when the use of the object is prohibited. 2. The data processing method according to claim 1, wherein a hierarchical structure of the management information is encrypted. 3. The data processing method according to claim 1, wherein management information of a predetermined level of hierarchy is encrypted. 4. The data processing method according to claim 1, wherein the management information and the hierarchical information are managed in association with each object stream. 5. The data processing method according to claim 4, wherein the hierarchical information is ID information of an object stream. 6. The object stream usage control method is updated each time the hierarchical information is updated.
Or the data processing method according to 5. 7. The data processing method according to claim 1, wherein the management information is transmitted while being contained in a management stream. 8. The data processing method according to claim 7, wherein the hierarchical information is pointer information to other management information. 9. The data processing method according to claim 7, wherein the management information is hierarchized by including other management information in the management information. 10. The data processing method according to claim 8, wherein the management information is management information for a scene description information stream. 11. The data processing method according to claim 10, wherein an object stream use control method is updated each time a scene is updated by said scene description information stream. 12. A data processing apparatus for reproducing a plurality of object streams each having predetermined information, wherein management information extracting means for extracting hierarchical management information for controlling availability of each object from input data An upper-level determining unit that determines whether or not use of an object higher than the object of interest is prohibited according to the management information extracted by the management information extracting unit. If the use of the object is prohibited,
A data processing device comprising: a control unit for prohibiting use of the object of interest. 13. The data processing device according to claim 12, wherein a hierarchical structure of the management information is encrypted. 14. The data processing apparatus according to claim 12, wherein management information of a predetermined level of hierarchy is encrypted. 15. The data processing apparatus according to claim 12, wherein the management information and the hierarchical information are managed in association with each object stream. 16. The data processing device according to claim 15, wherein the hierarchical information is ID information of an object stream. 17. The data processing device according to claim 15, wherein the method of controlling the use of the object stream is updated every time the hierarchical information is updated. 18. The data processing device according to claim 12, wherein the management information is accommodated in a management stream and transmitted. 19. The data processing device according to claim 18, wherein the hierarchical information is pointer information to other management information. 20. The data processing apparatus according to claim 18, wherein the management information is hierarchized by including other management information in the management information. 21. The data processing apparatus according to claim 19, wherein the management information is management information for a scene description information stream. 22. The data processing apparatus according to claim 21, wherein a use control method of an object stream is updated each time a scene is updated by the scene description information stream. 23. A storage medium storing program software for executing the data processing method according to claim 1. Description: