JP2001125925A - Method for displaying structure and computer readable recording medium recording program for allowing computer to execute the method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a structure display method capable of easily grasping the internal logical structure of structured data by visualizing it, intuitively knowing the rate of ranges of respective segments, simply comparing and investigating the structure of plural packages and the constitution of plural segments, and intuitively and quantitatively understanding the ranges or arrangement of respective packages and segments in the structure of all structured data. SOLUTION: In the structure display method for displaying the structure of structured data on a display screen, the display screen is divided into two parts, a structure display part 103A is formed on one divided screen and a constitution display part 103B is formed on the other. Structure information 301 expressing the structured data by tree-like master-slave relation by using respective packages as nodes is displayed on the structure display part 103A and constitution information 302 indicating the ranges of respective packages and the ranges of respective segments to be constitutional elements of respective packages are displayed on the constitution display part 103B so as to be aligned to the display lines of nodes concerned.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to structured data and a recording medium for displaying the structure of structured data on a display screen, and more particularly, to arranging data in a time series such as a video stream and an audio stream. The present invention relates to a structure display method and a recording medium for visually representing an internal logical structure of structured data generated by structuring a data stream having a meaning.

[0002]

2. Description of the Related Art In recent years, with the development of computer-related technology and information processing technology, and the spread of electronic networks such as the Internet, intranets, and extranets, all kinds of personal information used in daily life, business, and services have been developed. Have been digitized and transmitted as electronic information, or accumulated in databases in the computer world and used and utilized.

Therefore, electronic information is used and utilized in various forms (for example, information processing, information retrieval, information transmission, etc.) irrespective of whether the information is analog data or digital data. Various techniques for handling the electronic information itself in a format and data structure that are easy to use and utilize have been provided.

[0004] For example, text information, which is one type of electronic information, is represented by SGML,
A structure tag that expresses a logical structure such as HTML or XML is defined, and when information is transmitted, it can be expressed by the content and its logical structure. Therefore, when using and utilizing the text information, for example, by using the internal logical structure, it is possible to efficiently search, generate an appropriate summary sentence, increase the processing speed, and the like.

[0005] Further, a data stream having a meaning in arranging data in time series such as a video stream (video information) and an audio stream (audio information) is analyzed and structured, and the data stream is structured. Various methods for managing structured data have been proposed.

However, in general, when displaying a structured result by analyzing a data stream, a thumbnail image representing a set of structured unit data is simply displayed side by side. In order to grasp the logical structure inside the information, it is necessary to imagine the logical structure from the displayed thumbnail image, and there is a disadvantage that the inside logical structure of the video information cannot be grasped intuitively.

[0007]

In order to solve this problem, at least an arbitrary range in a data stream having a meaning in arranging data in a time series is defined as a segment. When the same range as defined in the above can be represented by a set of other multiple segments, by defining a set of multiple segments as a package, it is possible to target structured data in which the entire data stream is structured , For example,
As shown in FIG. 12, a structure display method for displaying the structure of structured data on a display screen (Japanese Patent Application No. 10-249598).
According to this structure display method, the internal logical structure of the structured data can be expressed, and the internal logical structure can be visualized and easily grasped.

However, in the structure display method shown in FIG. 12, a set (package 502) of a segment 500 and a partial segment 501 obtained by dividing the segment 500 is hierarchically displayed as one tree, and a plurality of displays are possible. There is
There is a problem that the ratio of the range of each segment to the whole or the parent segment and the arrangement thereof cannot be intuitively known.

Also, since the segments 501 constituting the package 502 are displayed directly below the package 502, the display is faithful to the entire structure.
When the number of 01s is large, there is a problem that it is difficult to compare and examine the structure and configuration of a plurality of packages.

Specifically, for example, the segment 501
Although the percentage of the parent segment 500 or the percentage of the entire parent segment is displayed as text information 503, there is an inconvenience that it is difficult to intuitively understand. Also,
When the structured data has a plurality of packages (that is, a plurality of segments), if the first package has a large number of segments, when the next package is searched on the display screen, scrolling is performed sequentially. You need to find or collapse the top package (in simplified form) and select the next package, but if you want to compare the first package with the next package, you may encounter frequent scrolling operations, Has to be expanded, and the operation is troublesome.

SUMMARY OF THE INVENTION The present invention has been made in view of the above, and allows the internal logical structure of structured data to be visualized and easily grasped, and intuitively knows the ratio of the range of each segment. The structure and segment structure of multiple packages can be easily compared and examined, and the range and arrangement of each package or segment in the overall structure of the structured data can be intuitively and quantitatively understood. It is an object of the present invention to provide a structure display method for displaying a structure.

[0012]

In order to achieve the above object, the structure display method according to the first aspect of the present invention provides at least an arbitrary range in a data stream having a meaning in arranging data in a time series. Is defined as a segment, by defining the set of the plurality of segments as a package when the same range as the range defined by a certain segment can be expressed by a set of other segments,
A structure display method for displaying the structure of the structured data on a display screen for structured data obtained by structuring the entire data stream, wherein the display screen is divided into two parts, and A display unit is provided, and a configuration display unit is provided on the other side, and the structure display unit displays structure information representing the structured data in a tree-like parent-child relationship with each package as a node. Displays the configuration information indicating the range of each package and the range of each segment as a component thereof in accordance with the display row or display column of the corresponding node, and recognizes the range of each segment in association with a numerical scale. To display the scale for the display.

According to the present invention, when displaying the structure of the structured data on the display screen, the structure display unit displays the structure information represented by a tree-like parent-child relationship with each package as a node. Can easily visually recognize the entire structure of the structured data. In addition, the configuration display unit displays configuration information indicating the range of each package and the range of each segment in accordance with the display row or display column of the node of the structure information. Thus, the size and arrangement of the package and the segment can be easily recognized. Furthermore, by referring to the scale, the range of each segment can be recognized in correspondence with the numerical scale, and qualitative and quantitative recognition can be performed.

According to a second aspect of the present invention, in the structure display method according to the first aspect, it is possible to specify whether to display a lower node for each node of the structure information,
The display of the structure information is changed based on the designation, and the display of the configuration information of the configuration display unit is changed in conjunction with the change.

According to the present invention, when a node of the structure information is designated as necessary, the lower nodes are hidden and the corresponding parts of the configuration information are also hidden in conjunction with each other. The display can be easily viewed even when the size is large and the number of nodes is large.

A structure display method according to a third aspect is the structure display method according to the first or second aspect, wherein the data stream is a video stream and / or an audio stream. In particular, a video stream and / or an audio stream is a general type of data stream having a meaning in arranging data in a time series, and indicates the structure of these structured data.

According to a fourth aspect of the present invention, in the structure display method according to any one of the first to third aspects, the data stream is arranged in a tree-like parent-child arrangement of the structure information. Is defined as one segment, a package corresponding to the segment is defined as a top-level package, and a corresponding node is arranged at the upper left of the structure display unit. If a child package is defined in which the same range as the segment range, which is one of the package components, is represented by a set of other segments,
The node indicating the child package is arranged at the lower right of the node indicating the parent package, and these nodes are connected by a broken line and displayed.

According to a fifth aspect of the present invention, in the structure display method according to the fourth aspect, when an arbitrary package is set as a parent package in the arrangement of the tree-like parent-child relationship of the structure information, When a plurality of child packages are defined in which the same range as the segment range, which is one of the components of the parent package, is represented by a set of other segments, the plurality of child packages are regarded as sibling packages. A plurality of nodes indicating these sibling packages are arranged side by side in the vertical direction, and these nodes are connected by a line and displayed.

According to a sixth aspect of the present invention, in the structure display method according to the fifth aspect, when a child package having the sibling package as a parent package exists, a node indicating the child package corresponds to the child package. The sibling package is arranged at the lower right of the node indicating the sibling package, and the sibling package located below the corresponding sibling package is arranged below the position of the child package arranged at the lower right.

According to a seventh aspect of the present invention, in the structure display method according to any one of the fourth to sixth aspects, an arbitrary package is arranged in the arrangement of the tree-like parent-child relationship of the structure information. When a parent package is defined, a plurality of child packages are defined in which the same range as the range of any one of the plurality of segments constituting the parent package is represented by a set of other plurality of segments, and When the ranges of the plurality of child packages do not overlap, a plurality of nodes indicating the plurality of child packages are arranged side by side in the horizontal direction, and the nodes are displayed by connecting them with lines. .

According to an eighth aspect of the present invention, in the structure display method according to any one of the first to seventh aspects, the configuration display unit sets a horizontal direction of a screen as a time-series direction, The configuration information includes a combination of a package identification display indicating a range and a position of a package and a segment identification display indicating a range and a position of a segment, and a line corresponding to each node of the structure display unit includes a range of the corresponding package. In the length corresponding to the above, and display a thin band-shaped package identification information at a corresponding position in time series, for each segment constituting the package displayed in the package range display, corresponding to the segment range In this case, a block-shaped segment range display is displayed at the corresponding position in the time series with the length.

According to a ninth aspect of the present invention, in the structure display method according to any one of the fifth to eighth aspects, in the arrangement of the tree-like parent-child relationship of the structure information, If you specify the node corresponding to any one of the child packages in the relationship and specify "Hide sibling packages",
Only the nodes below the designated node are displayed, the nodes below each node corresponding to the other sibling packages are hidden, and the lines below them are moved up and displayed, and in conjunction with this, the configuration information is Only the package identification display and the segment identification display of the child package corresponding to the specified node are displayed, and the tab information corresponding to the hidden child package in the sibling package relationship is added to the segment identification display and displayed. Is what you do.

Further, the structure display method according to claim 10 is:
10. The structure display method according to claim 9, wherein the specified node is displayed with a predetermined icon indicating that a node of another sibling package has been hidden and folded, and the specified icon is further displayed. If "cancel non-display of sibling packages" is specified, nodes corresponding to all sibling packages are displayed.

Further, the structure display method according to claim 11 is characterized in that:
10. The structure display method according to claim 8, wherein when tab information corresponding to the non-displayed child package is selected, a segment identification display of the child package being displayed is replaced with a child package corresponding to the tab information. A segment identification display is displayed.

Further, the structure display method according to claim 12 is
The structure display method according to any one of claims 5 to 11, wherein in the arrangement of the tree-like parent-child relationship of the structure information, an arbitrary node is specified, and "hidden child package" is specified. The node below the node corresponding to the child package when the created node is set as the parent package is hidden, the line below it is moved up and displayed, and in conjunction with this, the configuration information is the specified node When the parent package is set, the package identification display and the segment identification display of the nodes below the node corresponding to the child package are hidden.

Further, the structure display method according to claim 13 is characterized in that:
11. The structure display method according to claim 10, wherein the specified node is displayed with a predetermined icon indicating that a node below a child package is hidden, and furthermore, the predetermined icon is displayed as "child package Unhide "
Is specified, the nodes corresponding to all child packages are displayed.

Further, the structure display method according to claim 14 is
14. The structure display method according to any one of claims 5 to 13, wherein in the arrangement of the tree-like parent-child relationship of the structure information, an arbitrary node is specified and "package folding" is specified. The node is folded and displayed at the same thickness as the thin band-shaped package identification information of the configuration display unit, and the line below it is moved up and displayed, and in conjunction with this, the configuration information is the specified The segment identification display of the package corresponding to the node is hidden, and only the package identification display is displayed.

Further, the structure display method according to claim 15 is
In the structure display method according to the fourteenth aspect, when "unfold" is specified for a node displayed in a folded state, the state returns to the original display state.

Further, the structure display method according to claim 16 is characterized in that:
The structure display method according to any one of claims 1 to 15, wherein the configuration display unit is capable of changing a display scale of the configuration information, and specifies a change in a display size such as enlargement / reduction. In addition, the horizontal scale of the configuration display unit is scaled and displayed as specified, and the unit of the numerical scale of the scale is changed and displayed.

Further, the structure display method according to claim 17 is characterized in that:
17. The structure display method according to any one of claims 8 to 16, further comprising a segment display unit for individually displaying the contents of each segment, wherein one of the segment identification displays of the configuration display unit is included. By specifying one segment, the contents of the specified segment are displayed on the segment display section.

A recording medium according to claim 18 records a program for causing a computer to execute the method according to any one of claims 1 to 17. As a result, the program can be machine-readable, and the operations of claims 1 to 17 can be realized by a computer.

[0032]

An embodiment of the present invention will be described below in detail with reference to the accompanying drawings. In the present embodiment, a video stream is used as a data stream having a meaning in arranging data in a time series. However, the present invention is not limited to this. For example, an audio stream or both a video and an audio can be used. May be. Examples of other data streams include, for example, a work process chart describing work steps in a time series, and information (data) arranged in a reading direction (time series) such as a novel or learning book. In particular, there can be cited one in which structured data is generated based on the index for those that have meaning. In addition, there is structured data in which map data is input in order from north to south (data is arranged in time series) and structured.

FIG. 1 is a schematic configuration diagram showing an example of a system for realizing the structure display method according to the present embodiment. The system shown in FIG. 1 includes a video information library 101 storing a plurality of video streams or structured data obtained by structuring the video streams as video information, and inputting video information from the video information library 101 to analyze the structure of the video stream. And a computer 102 for performing a process of visually displaying the structure of the video stream on the display screen 103 based on the analysis result.

The video information library 101 shown in FIG.
May be built in the computer 102, but here, for example, it is assumed that the computer 102 is connected to the computer 102 via a network. The video information is stored on a floppy disk, CD-ROM, MO, D
It may be input via a recording medium such as VD.

FIG. 2 shows the computer 102 shown in FIG.
FIG. 2 is a block diagram of the configuration. The computer 102 has a CPU 201 that executes processing based on software described later.
ROM 202 storing a boot program and the like;
RAM 20 used as work area of PU 201
3 and a keyboard 204 for performing various input operations
And a mouse 205 and a display device 206 such as a CRT or a liquid crystal display having a display screen 103 for displaying a video stream analysis process and a video stream structure.
FIG. 1 shows a hard disk 210 storing various application programs and data such as structure analysis software 207, index generation software 208, and structure display software 209 for realizing the video stream structure display method according to the present embodiment. The illustrated video information library 101
It comprises at least a network adapter 211 for connecting the computer and the computer 102, and a bus 212 for connecting the above components.

The system configuration shown in FIGS. 1 and 2 is merely an example, and if a method according to the present embodiment described later can be realized,
Any system configuration may be used. For example, as a basic technique of a structure display method of analyzing a video stream to generate structured data and displaying the structure on a display screen, a technique proposed by the present applicant in Japanese Patent Application No. 10-249598 is disclosed. Can be applied. Further, the method of structuring the video stream is not particularly limited, but at least an arbitrary range in the video stream having a meaning in arranging data in a time series is defined as a segment, and a certain segment is defined as a segment. If the same range as the defined range can be represented by a set of other segments, the entire video stream is structured by defining the set of segments as a package.

Next, an example of the structure of structured data displayed by the structure display method according to the present embodiment will be described with reference to FIG. In the present embodiment, the entrance of the entire structure of one video stream is defined as a route R, and this route R
, An arbitrary range in the video stream is defined as a segment S, and the same range as the range defined in a certain segment S is defined as a component of a plurality of segments S. If the set can be represented by a set, a set of the plurality of segments S is defined as a package P.

That is, in the example of the structure shown in FIG. 3, a package P (refer to a symbol A) representing the entire video and one segment S constituting the package P exist in the first hierarchy immediately below the root R. . Also, on the second level,
Package P (see reference symbol B) and six segments S forming the package P, and package P (see reference symbol C) and three segments S forming the package P
And a package P (see reference symbol D) and two segments S constituting the package P. Also, the third
In the hierarchy, a package P (see reference numeral E), three segments S constituting the package P, and a package P
(See symbol F) and two segments S constituting the package P, package P (see symbol G) and one segment S constituting the package P: package P (see symbol H) and the package P There are two segments S that make up, a package P (see symbol I), and five segments S that make up the package P. The package P (see reference numeral J) is located on the fourth level.
And two segments S constituting the package P.

In the example of the structure shown in FIG.
Although there are a hierarchy to a fourth hierarchy, the depth of this hierarchy and the number of packages P in each hierarchy are not particularly limited.
It is set as needed. Further, in the present embodiment, when the same range as the range defined by the parent segment can be represented by a set of other plural child segments, the set of these plural child segments is defined as a package. For example, in the above package definition, the child segments S1 and S
In the case of 2, if each is within the range of the parent segment S, a condition that the ranges indicated by S1 and S2 may be empty or the ranges may overlap may be added.

Next, the criteria for generating the package P will be described with reference to an example. For example, when the video stream having the structure shown in FIG. 3 is a video stream in which a movie is recorded, of the three packages P on the second layer, the first package P (see reference numeral B) is:
The video is divided according to the characteristics of the still image, the second package P (see reference numeral C) is divided according to the characters, and the third package P (see reference numeral D) is divided according to time. is there. In this example, the child segments are generated in such a manner that the parent segment is divided, so that the ranges of the segments constituting one package do not overlap each other, and when the ranges of the child segments are collected, they become the ranges of the parent segment. I have. Of course, this need not be the case if the range of the child segment does not exceed the range of the parent segment.

As described above, the structure of the video stream may be extracted or read from the previously generated structured data. The video stream is read and directly structured on the spot, and the structured data is stored in the memory. May be managed.

The structure of the video stream shown in FIG. 3 is displayed on the structure display screen shown in FIG. 12 by using the technology (Japanese Patent Application No. 10-249598) already filed by the present applicant. is there.

FIG. 4 is an explanatory diagram showing a screen configuration of the display screen 103 according to the present embodiment. As shown in the figure, the display screen 103 includes a structure display unit 103A that displays structure information 301 in which each package is a node 301a and that represents structured data in a tree-like parent-child relationship, a package identification display 302a that indicates the range of each package, and The configuration information 302 including the segment identification display 302b indicating the range of each segment which is a component of the package identification display 302a is displayed in accordance with the display line of the corresponding node, and the range of each segment is recognized in correspondence with the numerical scale. And a configuration display section 103B for displaying a scale 303 for performing the operation. Reference numeral 304 denotes a line display unit for making it easy to visually recognize the corresponding display lines of the structure display unit 103A and the configuration display unit 103B.

In the above configuration, referring to the display examples of the display screen 103 in the present embodiment shown in FIGS.
The operation will be described. First, when the structure of the video stream as shown in FIG. 3 is displayed on the display screen 103,
As shown in FIG. Here, the structure information 301 displayed on the structure display unit 103A and the configuration information 302 displayed on the structure display unit 103B are displayed based on the following rules (conditions). Here, in order to distinguish and easily understand each node 301a, reference numerals A to J shown in FIG. For the same reason, the package identification 302a and the segment identification 302b are described in PA, SA, and the like.

In the rule tree-like parent-child relationship, nodes belonging to the same hierarchy are displayed in the same display row or display column, and are connected by straight lines. This rule can be paraphrased as follows. That is, in the arrangement of the tree-like parent-child relationship in the structure information 301, when an arbitrary package is set as a parent package, the same range as the range of a segment, which is one of the components of the parent package, is assigned to other segments. When a plurality of child packages represented by a set are defined, the plurality of child packages are defined as sibling packages, a plurality of nodes indicating the sibling packages are arranged in a vertical direction, and these nodes are arranged. Is displayed by connecting with a line. Also, in a tree-like parent-child relationship, when an arbitrary package is set as a parent package, the same range as the range of any one of the plurality of segments which are constituent elements of the parent package is set to a set of other plurality of segments. When a plurality of child packages represented by are defined and the ranges of the plurality of child packages do not overlap, a plurality of nodes indicating the plurality of child packages are arranged side by side in a horizontal direction, and These nodes are displayed by connecting them with lines.

Therefore, in FIG. 5, since the nodes B, C and D are displayed in the same display column and are connected by straight lines, they have the same hierarchy, and these nodes B, C, D The package corresponding to is a sibling package. Further, since the nodes G, H and I are displayed on the same display line and are connected by a straight line, they have the same hierarchy, and the packages corresponding to these nodes G, H and I are sibling packages. It is.

In the rule tree-like parent-child relationship, a node of a package representing the entire video stream is defined as a top-level package, and the corresponding node is defined as structure information 301 (structure display unit 1).
03A). Therefore, the node A indicating the package P representing the entire video is arranged at the upper left of the structure information 301.

In a tree-like parent-child relationship, when an arbitrary package is set as a parent package, the same range as the range of a segment, which is one of the components of the parent package, is represented by a set of other plural segments. When a child package is defined, the node indicating the child package is arranged at the lower right of the node indicating the parent package, and these nodes are connected by a broken line and displayed. For example, if node E is a parent package, its child package, node J,
In the display of the structure display unit 103A, it is arranged at the lower right of the node E and is connected to the node E by a broken line.

In a rule tree-like parent-child relationship, if there is a child package having a sibling package as a parent package, the node indicating the child package is arranged at the lower right of the node indicating the corresponding sibling package, and The sibling package located below the sibling package is arranged below the position of the child package arranged at the lower right.

Therefore, in FIG. 5, focusing on the nodes E, F, and J, the packages of the nodes E and F are in a sibling package relationship, and the packages of the nodes E and J are Parent package and child package. Therefore, the node J is arranged at the lower right of the node E, and the node F is arranged on the line next to the line where the node J exists.

The rule configuration display section 103B sets the horizontal direction of the screen as a time-series direction, and the row corresponding to each node specified by the row display section 304 of the structure display section 103A corresponds to the range of the package. A thin band-shaped package identification display 302a is displayed at a corresponding position in the time series with the length. In addition, for each segment constituting the package displayed by the package identification display 302a, a block-shaped segment identification display 302b having a length corresponding to the range of the segment and at a corresponding position in a time series is displayed. .

Therefore, in FIG. 5, for example, the package identification (PA) corresponding to node A is:
It is displayed on the same line as the node A and in a thin strip shape showing the entire video stream. The segment identification display (reference code SA) corresponding to the node A is displayed in the same row as the node A and in a block shape having a length corresponding to the range of the segment (here, the entire video stream).

The package identification (PE) corresponding to the node E has the length of the package corresponding to the node E on the same line as the node E, and a thin band at a corresponding position in the time series. Is displayed. In addition, the segment identification display (symbols SE1 to SE3) corresponding to the node E is displayed in the same row as the node E, in the range of each segment, and at a corresponding position in time series in a block shape.

Rule In the arrangement of the tree-like parent-child relationship of the structure information 301 displayed on the structure display section 103A, a node corresponding to any one child package among a plurality of child packages having a sibling package relationship is designated. , When "Hide sibling packages" is specified, only the nodes below the specified node are displayed, the nodes below each node corresponding to the other sibling packages are hidden, and the lines below them are moved up and displayed . In conjunction with this, the configuration display unit 103
The configuration information 302 of B displays only the package identification display and the segment identification display of the child package corresponding to the designated node, and segments the tab information corresponding to the non-displayed child package in a sibling package relationship. Appended to the display and displayed.

For example, in FIG. 5, when the node E is designated, a predetermined key on the display screen 103 is selected, and "non-display of sibling packages" is designated, as shown in FIG.
Only nodes below the specified node E (here, node J) are displayed, and node F corresponding to the sibling package is displayed.
The following (here, only the node F) is not displayed, and the display rows of the nodes C, D, G, H, and I are moved up.

In conjunction with the above operation, the package identification display PF corresponding to the node F displayed in FIG.
6, the segment identification displays SF1 and SF2 are not displayed in FIG. 6, and only the package identification display PE and the segment identification displays SE1 to SE3 of the package corresponding to the designated node E are displayed. Tab information TF corresponding to the package (node F) is added to the segment identification displays SE1 to SE3 and displayed. By selecting the tab information TF, the package identification display PF and the segment identification displays SF1 and SF2 of the node F, which is a sibling package, are displayed, and the package identification display PE and the segment identification displays SE1 to SE3 of the node E are displayed. It can be hidden. Similarly, display and non-display are switched by selecting the tab information TE.

As shown in FIG. 6, the designated node E is a predetermined icon (here, a folded icon) indicating that the other sibling package nodes are hidden and folded.
"/"), And when the predetermined icon is selected again (for example, by clicking), "release of non-display of sibling packages" is designated, and as shown in FIG.
Nodes (here, node F) corresponding to all sibling packages are displayed.

In the arrangement of the tree-like parent-child relationship in the rule structure information 301,
If you specify an arbitrary node and specify "Hide child package", the nodes below the node corresponding to the child package when the specified node is the parent package will be hidden, and the line below it will be moved up indicate. In conjunction with this, in the configuration information 302, the package identification display and the segment identification display of the nodes below the node corresponding to the child package when the designated node is set as the parent package are hidden.

For example, in FIG. 5, when a node E is designated, a predetermined key on the display screen 103 is selected, and "non-display of child package" is designated, as shown in FIG. , The nodes below the node J corresponding to the child package are hidden, and the nodes F,
The display rows of the nodes C, G, H, I, and D are moved up.

The configuration information 3 is linked with the above operation.
In No. 02, the package identification display and the segment identification display of the nodes below the node J corresponding to the child package when the node E is the parent package (here, only the node J) are hidden. The designated node E is displayed with a predetermined icon (here, “reverse /”) indicating that the nodes below the child package J are hidden, and the predetermined icon is selected again (for example, When a click operation or the like is performed, “cancel non-display of child packages” is designated, and nodes corresponding to all child packages are displayed as shown in FIG.

Rule + Rule Furthermore, it is possible to specify the above-mentioned rule and the rule at the same time. For example, in FIG. 5, a node E is specified, a predetermined key on the display screen 103 is selected, and “Sibling” is selected. When "Hide package and child package" is specified, as shown in FIG. 8, the node F corresponding to the sibling package and the node J corresponding to the child package are hidden.

In the arrangement of the tree-like parent-child relationship in the rule structure information 301,
When an arbitrary node is designated and "package folding" is designated, the designated node is folded and displayed to the same thickness as the thin band-shaped package identification information of the configuration display unit 103B, and the line below it is moved up. Is displayed. Also,
In conjunction with this, in the configuration information 302, the segment identification display of the package corresponding to the designated node is hidden, and only the package identification display is displayed.

For example, in FIG. 5, a node A, a node J, a node D, and nodes GI are designated, and the display screen 10
3. Select a predetermined key on "3. Fold the package"
Is designated, as shown in FIG. 9, the designated nodes A, J, D, and GI are displayed in the configuration display unit 1.
It is folded and displayed to the same thickness as the thin band-shaped package identification information of 03B, and the line below it is raised and displayed.

In conjunction with this, the configuration information 302
Indicates that the segment identification display of the package corresponding to the specified node A, node J, node D, and node GI is hidden, and the package identification display (PA, PJ, PD,
PG, PH, PI) are displayed. Note that, when a predetermined operation is performed on the node displayed in a folded state and “unfolding” is designated, as shown in FIG.
Returns to the original display state.

FIG. 10 shows an example in which the structure of a video stream having another structure is displayed on the display screen 103. In this example, there are no fine segments, but for a long video stream, the size of the segment ranges from a few frames (units of scale 303) to over a few thousand frames. Therefore, when it is desired to more accurately recognize the range and the arrangement of each segment, for example, the enlargement / reduction of the configuration display unit 103B is designated,
If the display unit of the scale 303 can be changed, the convenience can be further improved. Therefore, the display scale of the configuration information of the configuration display unit 103B can be changed,
When a change in the display size such as enlargement / reduction is specified by a predetermined key operation, the horizontal scale of the configuration display unit 103B is scaled and displayed as specified, and the scale 303 is input by a predetermined key input. If you change the unit of the numerical scale of,
The display is changed accordingly.

As shown in FIG. 11, a segment display section 104 for individually displaying the contents of each segment is provided. For example, on the display screen 103 of FIG. 5, the segment identification display SE1 is selected (for example, double Click), the segment display unit 104 shown in FIG.
May be displayed. As the contents of the segment, a frame of interest in the segment, a range of interest, and the like are displayed.

As described above, according to the structure display method of the present embodiment, by executing the rules (1) to (4), the logical structure inside the structured data can be visualized and easily grasped, and each segment can be easily grasped. You can intuitively know the ratio of the range of each package, easily compare and examine the structure of multiple packages and the configuration of segments, and furthermore, the range and arrangement of each package or segment in the structure of the entire structured data Can be displayed in an intuitive and quantitative manner.

Further, by applying the structure display method of the present embodiment described above, it is possible to reflect and display the editing results such as addition, deletion, range change, merging and addition or deletion of segments at any time. Obviously, this is easy. Further, the structure edited using such a structure display method can be used as information for searching and browsing, and may be stored in a recording medium again for use at a later date.

The program of the structure display method according to the present embodiment includes a hard disk, a floppy disk, and a CD.
-The program is recorded on a computer-readable recording medium such as a ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. Further, this program can be distributed via a communication medium such as the Internet via the above-described recording medium.

[0070]

As described above, according to the structure display method of the present invention (claim 1), structure information is displayed on a structure display unit in a tree-like parent-child relationship with each package as a node, and the structure is displayed. The section displays the configuration information indicating the range of each package and the range of each segment in accordance with the display row or column of the node of the structure information, so that the logical structure inside the structured data can be easily visualized. In addition to being able to grasp, the ratio of the range of each segment can be intuitively known, the structure of multiple packages and the configuration of segments can be easily compared and examined, and the structure of the entire structured data Can be displayed so that the range and arrangement of each package or segment can be intuitively and quantitatively understood. Also, by referring to the scale, the range of each segment can be recognized in correspondence with the numerical scale, and qualitative recognition and quantitative recognition can be performed.

Further, the structure display method of the present invention (Claim 2)
When specifying the node of the structure information as needed, the lower node is hidden, and the corresponding part of the configuration information is also hidden in conjunction with it, so the entire structured data is large,
The display can be easily viewed even when the number of nodes is large.

Further, the structure display method of the present invention (claim 3)
Since the data stream is a video stream and / or an audio stream, it is possible to visualize the internal logical structure of the data stream so that it can be easily grasped, and to intuitively know the ratio of the range of each segment. To easily compare and examine the structure of multiple packages and segment configurations, and to intuitively and quantitatively understand the range and arrangement of each package or segment in the overall structure of structured data. Can be displayed.

Further, the structure display method of the present invention (Claim 4)
Indicates a node indicating the child package as the parent package when a child package is defined in which the same range as the segment range which is one of the components of the parent package is represented by a set of other segments. Arranged at the lower right of the nodes and connecting these nodes with broken lines, the structure can be visually and intuitively grasped by the positional relationship of the nodes. .

The structure display method of the present invention (claim 5)
If multiple child packages are defined that represent the same range as the range of a segment that is one of the components of the parent package as a set of other segments, the multiple child packages are linked to each other as sibling packages. Defined as
A plurality of nodes indicating these sibling packages are arranged vertically and connected by lines, so the structure of the sibling packages can be visually and intuitively grasped by the positional relationship of the nodes. can do.

The structure display method of the present invention (claim 6)
If there is a child package with a sibling package as the parent package, the node indicating the child package is arranged at the lower right of the node indicating the corresponding sibling package, and the sibling package located below the corresponding sibling package Are arranged below the position of the child package arranged at the lower right, the structure of the packages can be visually and intuitively grasped based on the positional relationship of the nodes.

The structure display method of the present invention (claim 7)
Is defined as a plurality of child packages in which the same range as the range of any one of the plurality of segments that is a component of the parent package is represented by a set of other plurality of segments, and the plurality of child packages are defined. When the ranges of the packages do not overlap, a plurality of nodes indicating the plurality of child packages are arranged side by side in a horizontal direction, and these nodes are connected by a line and displayed. The structure of the package can be visually and intuitively grasped.

Further, the structure display method of the present invention (claim 8)
In the configuration display section, the horizontal direction of the screen is set in the time-series direction, and the configuration information includes a combination of a package identification display indicating the range and position of the package and a segment identification display indicating the range and position of the segment, and the structure display In the line corresponding to each node of the section, a thin strip-shaped package identification information is displayed at the position corresponding to the range of the corresponding package in the time series, and the package displayed in the package range display In order to display a block-shaped segment range display at a corresponding position in the time series with a length corresponding to the segment range for each of the segments that compose the data, visualize the internal logical structure of the structured data To make it easier to grasp, and to intuitively know the ratio of the range of each segment. Can easily compare the configuration of the segment can be displayed so as to be intuitive and quantitative understanding of the scope and the arrangement of each package or segment in addition structured data overall structure.

The structure display method of the present invention (claim 9,
10) When "Hide sibling packages" is specified,
Only the nodes below the specified node are displayed, and the nodes below each node corresponding to the other sibling packages are not displayed. In conjunction with this, the configuration information is displayed for the child package corresponding to the specified node. In order to display only the package identification display and the segment identification display, and to add and display the segment identification display with tab information corresponding to the hidden child packages in the sibling package relationship,
Further, workability and convenience can be improved. If you specify "Unhide sibling packages",
Since the nodes corresponding to all sibling packages are displayed, workability and convenience can be further improved.

The structure display method of the present invention (claim 1)
1) When the tab information corresponding to the hidden child package is selected, the segment identification display of the child package corresponding to the tab information is displayed instead of the segment identification display of the child package being displayed. -Convenience can be improved.

The structure display method of the present invention (claim 1)
2, 13), when "Hide child package" is designated, nodes below the node corresponding to the child package when the designated node is set as a parent package are hidden, and in conjunction with this, the configuration information When the designated node is set as the parent package, the package identification display and the segment identification display of the nodes below the node corresponding to the child package are not displayed, so that the workability and convenience can be further improved. Further, when "cancel non-display of child package" is designated, nodes corresponding to all child packages are displayed, so that workability and convenience can be further improved.

The structure display method of the present invention (claim 1)
4, 15), when "package folding" is designated, the designated node is folded and displayed to the same fineness as the thin band-shaped package identification information of the configuration display unit,
In conjunction with this, in the configuration information, the segment identification display of the package corresponding to the designated node is hidden, and only the package identification display is displayed, so that the workability and convenience can be further improved. Further, when "unfolding" is designated for a node displayed in a folded state, the original display state is restored, so that the workability and convenience can be further improved.

The structure display method of the present invention (claim 1)
In 6), since the display scale of the configuration information can be changed, workability and convenience can be improved.

The structure display method of the present invention (claim 1)
In 7), since the contents of each segment can be individually displayed on the segment display section, workability and convenience can be improved.

The recording medium of the present invention (claim 18)
Has recorded a program for causing a computer to execute the method according to any one of claims 1 to 17,
The program becomes machine readable,
There is an effect that a recording medium capable of realizing the operation of No. 17 by a computer can be obtained.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram illustrating an example of a system for realizing a structure display method according to an embodiment.

FIG. 2 is a block diagram of the computer shown in FIG. 1;

FIG. 3 illustrates an example of a structure of structured data displayed by the structure display method according to the present embodiment.

FIG. 4 is an explanatory diagram illustrating a screen configuration of a display screen according to the present embodiment.

FIG. 5 is an explanatory diagram showing a display example of a display screen in the present embodiment.

FIG. 6 is an explanatory diagram showing a display example of a display screen in the present embodiment.

FIG. 7 is an explanatory diagram showing a display example of a display screen in the present embodiment.

FIG. 8 is an explanatory diagram showing a display example of a display screen in the present embodiment.

FIG. 9 is an explanatory diagram showing a display example of a display screen in the present embodiment.

FIG. 10 is an explanatory diagram showing a display example of a display screen in the present embodiment.

FIG. 11 is an explanatory diagram illustrating a display example of a display screen in the present embodiment.

FIG. 12 is an explanatory diagram showing an example of a structure display method for displaying the structure of structured data on a display screen.

[Explanation of symbols]

 101 video information library 102 computer 103 display screen 103A structure display unit 103B configuration display unit 104 segment display unit 301 structure information 301a node 302a package identification display 302b segment identification display 303 scale 304 line display unit

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] December 22, 2000 (200.12.
22)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Claim 4

[Correction method] Change

[Correction contents]

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0017

[Correction method] Change

[Correction contents]

According to a fourth aspect of the present invention, in the structure display method according to any one of the first to third aspects, the data stream is arranged in a tree-like parent-child arrangement of the structure information. Is defined as one segment, a package corresponding to the segment is defined as a top-level package, and a corresponding node is arranged at the upper left of the structure display unit. If child package expressing the same range as the range of a segment which is one of the package components in a set of other plurality of segments that have been defined, indicate the parent package node indicating the child package It is arranged at the lower right of the nodes, and these nodes are displayed by connecting them with broken lines.

[Procedure amendment 3]

[Document name to be amended] Statement

[Correction target item name] 0066

[Correction method] Change

[Correction contents]

As shown in FIG. 11, a segment display section 104 for individually displaying the contents of each segment is provided. For example, on the display screen 103 of FIG. 5, the segment identification display SE1 is selected (for example, double In the case of clicking, the segment display unit 104 of FIG. 11 may be displayed. As the contents of the segment, a frame of interest in the segment, a range of interest, and the like are displayed.

[Procedure amendment 4]

[Document name to be amended] Statement

[Correction target item name] Figure 3

[Correction method] Change

[Correction contents]

FIG. 3 is an explanatory diagram showing an example of the structure of structured data displayed by the structure display method according to the embodiment .

 ──────────────────────────────────────────────────の Continued on the front page (72) Inventor Takayuki Kunieda 1-3-6 Nakamagome, Ota-ku, Tokyo F-term in Ricoh Co., Ltd. (Reference) 5B075 ND35 PQ02 5C025 BA27 CA09 CB01 DA08 5C052 AA02 AB04 AC08 DD04 DD08 5E501 AA02 AA13 AC15 BA03 CA03 DA07 EA05 EB05 FA13 FA14 FA22 FA44 FA46 FB14 FB25 FB43

Claims (18)

[Claims] At least an arbitrary range in a data stream having a meaning in arranging data in a time series is defined as a segment, and a range identical to a range defined in a certain segment is defined as a plurality of other segments. By defining a set of the plurality of segments as a package when the set can be represented by a set of segments, a structure of the structured data is displayed on a display screen for structured data in which the entire data stream is structured. The structure display method when performing, the display screen is divided into two, a structure display unit is provided on one,
On the other hand, a configuration display unit is provided. The structure display unit displays structure information in which each package is a node and the structured data is represented by a tree-like parent-child relationship. Display the configuration information indicating the range and the range of each segment that is a component of the range according to the display row or column of the corresponding node, and display the scale for recognizing the range of each segment in association with the numerical scale A structure display method. 2. It is possible to specify whether or not to display a lower node for each node of the structure information. Based on the specification, the display of the structure information is changed, and the configuration display is interlocked with the change. The structure display method according to claim 1, wherein the display of the configuration information of the unit is changed. 3. The method according to claim 1, wherein the data stream is a video stream and / or an audio stream. 4. In the arrangement of the tree-like parent-child relationship of the structure information, the entire data stream is defined as one segment, a package corresponding to the segment is defined as a top-level package, and a corresponding node is defined as the node. A child that is located at the top left of the structure display section and represents the same range as the range of a segment that is one of the components of the parent package as a set of other segments when an arbitrary package is set as the parent package 4. When a package is defined, the node indicating the child package is arranged at the lower right of the node indicating the parent package, and these nodes are connected by a broken line and displayed.
The structure display method according to any one of the above. 5. In the arrangement of the tree-like parent-child relationship of the structure information, when an arbitrary package is set as a parent package, the same range as the segment range, which is one of the constituent elements of the parent package, is set to another plurality. When a plurality of child packages represented by a set of segments are defined, the plurality of child packages are defined as sibling packages, and a plurality of nodes indicating the sibling packages are arranged in a vertical direction, and The structure display method according to claim 4, wherein these nodes are displayed by connecting them with a line. 6. When there is a child package having the sibling package as a parent package, a node indicating the child package is arranged at the lower right of the node indicating the corresponding sibling package, and below the corresponding sibling package. 6. The structure display method according to claim 5, wherein the sibling package located is arranged so as to be lower than the position of the child package arranged at the lower right. 7. In the arrangement of the tree-like parent-child relationship of the structure information, when an arbitrary package is set as a parent package, the same as a range of any one of a plurality of segments which are constituent elements of the parent package. If a plurality of child packages whose range is represented by a set of a plurality of other segments are defined, and the ranges of the plurality of child packages do not overlap, a plurality of nodes indicating the plurality of child packages are connected to each other. The structure display method according to any one of claims 4 to 6, wherein the nodes are arranged side by side in a horizontal direction, and the nodes are displayed by connecting them with lines. 8. The configuration display unit sets a horizontal direction of a screen as a time-series direction, and the configuration information includes a package identification display indicating a range and a position of a package and a segment identification display indicating a range and a position of a segment. A row corresponding to each node of the structure display unit, a length corresponding to the range of the corresponding package, and displaying thin band-shaped package identification information at a corresponding position in time series, For each segment constituting the package displayed in the package range display, a block-shaped segment range display is displayed at a length corresponding to the segment range and at a corresponding position in time series. The structure display method according to claim 1. 9. In the arrangement of the tree-like parent-child relationship of the structure information, a node corresponding to any one child package among a plurality of child packages having the relationship of the sibling package is designated, and If you specify "Hide", only the nodes below the specified node will be displayed,
The nodes below each node corresponding to the other sibling packages are hidden, and the lines below them are moved up and displayed. In conjunction with this, the configuration information is the package of the child package corresponding to the specified node. 9. The segment identification display according to claim 5, wherein only the identification display and the segment identification display are displayed, and tab information corresponding to a non-displayed child package having a sibling package relationship is added to the segment identification display. The structure display method according to any one of the above. 10. The designated node is displayed with a predetermined icon indicating that a node of another sibling package has been hidden and folded, and the specified icon is displayed as “non-sibling of sibling package”. 10. The structure display method according to claim 9, wherein when "cancel display" is specified, nodes corresponding to all sibling packages are displayed. 11. When tab information corresponding to the hidden child package is selected, the segment identification display of the child package corresponding to the tab information is displayed instead of the segment identification display of the child package being displayed. The structure display method according to claim 8 or 9, wherein: 12. In the arrangement of the tree-like parent-child relationship of the structure information, when an arbitrary node is designated and “Hide child package” is designated, the designated node is designated as a parent package. Nodes below the corresponding node are hidden, the lines below it are moved up and displayed, and in conjunction with this, the configuration information is the node corresponding to the child package when the specified node is the parent package 6. The package identification display and the segment identification display of the following nodes are hidden.
12. The structure display method according to any one of items 11 to 11. 13. The designated node is displayed with a predetermined icon indicating that a node below the child package is hidden, and “release of non-display of child package” is displayed for the predetermined icon. 11. The structure display method according to claim 10, wherein when specified, nodes corresponding to all child packages are displayed. 14. In the arrangement of the tree-like parent-child relationship of the structure information, when an arbitrary node is designated and "folding of package" is designated, the designated node becomes the thin band-shaped package identification information of the configuration display unit. Is displayed in the same size as that of the specified node, and the line below it is moved up and displayed. In conjunction with this, the configuration information indicates that the segment identification display of the package corresponding to the specified node is hidden. 14. The structure display method according to claim 5, wherein only the package identification display is displayed. 15. The structure display method according to claim 14, wherein when "unfold" is specified for a node displayed in a folded state, the display state returns to the original display state. 16. The configuration display unit is capable of changing a display scale of the configuration information, and when a change in display size such as enlargement / reduction is designated, the horizontal scale of the configuration display unit is designated as specified. The structure display method according to any one of claims 1 to 15, wherein the image is displayed by changing the scale of the scale and the unit of the numerical scale of the scale is changed. 17. A segment display unit for individually displaying the content of each segment, and by specifying one segment in the segment identification display of the configuration display unit, the content of the specified segment is displayed. 17. The structure display method according to claim 8, wherein the structure is displayed on a segment display unit. 18. A computer-readable recording medium on which a program for causing a computer to execute the method according to claim 1 is recorded.