JP3505138B2 - Structure editing device, video structure editing device, and computer-readable recording medium storing a program for causing a computer to execute as each means of the device - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a structure editing device, a video structure editing device and a device for editing the structure (structure) of data (segments) having a range, the structure editing device having a modification function for correction after the structure is generated. The present invention relates to a computer-readable recording medium that records a program for executing a computer as means. In particular, the video structure editing device relates to a case where a video stream (including audio) is used as target data. The video structure generating and editing functions handled by the video structure editing apparatus are used for video management, browsing of search results, digest creation, and the like. Further, the editing of data having a range can be used, for example, for editing a work process table.

[0002]

2. Description of the Related Art In recent years, even in a video stream containing only video or a video stream including video and audio, structural information is created by structuring the video stream, and the management / editing / utilization of the video is performed using this structural information. Various methods have been developed for.

As an example of structuring a video stream, for example, a range of an arbitrary frame in the video stream is defined as a segment, and the same range defined by one segment is defined by a set of a plurality of other segments. A method of creating a hierarchical structure of a video stream by defining a set of a plurality of segments as a package when it can be expressed has been proposed.

Further, as a display example of a video in a conventional video editing apparatus, a method of arranging video clips in time series and showing the video with an image icon is often used, but such a video editing apparatus displays the video itself. It is for editing, and there has not been provided a device for editing a video stream by utilizing structural elements of a structured video stream or for reconstructing the structure itself.

In other words, in the video editing software and the non-linear video editing machine, in the process of arranging the video clips and superimposing and editing the video clips, continuous frames may be displayed in a line in a row. However, this is only for the purpose of stacking each video material, and an easy-to-use support tool for structuring the video stream or re-editing the structured video stream structure has not been provided.

Therefore, the present applicant defines a range of an arbitrary frame in a video stream as a segment, and when the same range defined by one segment can be expressed by a set of a plurality of other segments. We propose a video structure editing device that edits the structure of a video stream by using structure information that defines the hierarchical structure of the video stream by defining a set of multiple segments as a package.

[0007]

However, although the above-mentioned conventional technique and the video structure editing apparatus proposed by the applicant of the present invention provide a function for creating a structure of contents, the created structure On the other hand, no specialized function was provided to modify the structure.

Further, if the data structure is created by using not only the video but also the data (segment) having a range as a unit of the structure, it is necessary to correct the next fine portion (request).
However, a device having an easy-to-use function for re-editing has not been provided. Specifically, if you find that the boundary of the parent segment is not correct when you divide a certain segment further, delete the detailed structure that you created and change the range of the parent segment and create it again. Since it is necessary to re-do it, it becomes complicated to correct the created structure, and there is a problem that work efficiency is reduced.

The present invention has been made in view of the above, and for a structure created in advance by using data (segment) having a range as a unit of structure, the original structure information is used as much as possible to make modifications and corrections. It is an object of the present invention to provide a structure editing device and a video structure editing device having a function capable of adding a video.

[0010]

In order to achieve the above object, the structure editing apparatus according to claim 1 defines a range of arbitrary data in arranged data as a segment,
When the range defined by one segment is expressed by a set of other plural segments, by defining the set of the plurality of segments as a package, the structural information defining the hierarchical structure of the arranged data is used. In the structure editing device for editing the structure of the arranged data, first designating means for designating an arbitrary segment in the structure information as a target segment, and an arbitrary position included in the range of the target segment. And a second designating unit that designates the segment, and the position designated by the second designating unit as a dividing position, and the range of the target segment is divided into two segments, a first half segment and a second half segment, at the dividing position, a segment dividing means for replacing the target segment by the two segments, said cell
The target segment is a package
If you have
First half package consisting of segments corresponding to the range of
From the segment corresponding to the range of the latter half segment
The latter half package is divided into two packages .

According to the present invention, the segment dividing means divides the range of the target segment into two segments, the first half segment and the second half segment, based on the division position, and replaces the target segment with these two segments. So if you have a segment you want to split,
It can be easily corrected (divided) by specifying it as the target segment and specifying the division position.

[0012]

According to the present invention, in the hierarchical structure of the structure information, when the package exists in the layer below the target segment, the corresponding package is also divided into two corresponding to the division of the target segment.

The structure editing apparatus according to claim 2 is
Segment any range of data in the columnar data
And define the range defined by one segment to another
When expressed as a set of multiple segments,
By defining a set of
Structure information that defines the hierarchical structure of the arranged data.
Information to edit the structure of the arranged data.
In the editing / editing device, any segment in the structure information
First specifying means for specifying a segment as a target segment
And any position included in the range of the target segment
Second specifying means to specify and the second specifying means
The target segment is defined as the divided position.
The first half segment and the second half segment at the division position
The target segment
Segment dividing means for replacing with the two segments
And the first designating means displays the structural information.
To specify the display device to be displayed and the target segment.
The second designating means, which comprises an pointing device
Is a display device for displaying the structural information and the division position.
It consists of a pointing device for specifying the position,
The second designating means displays on the display of the target segment.
Display a line segment to indicate the dividing position, and
The position of the line segment can be freely translated with a vise . The structure editing apparatus according to claim 3 is the structure editing apparatus according to claim 1 , wherein the first designating means is
A display device for displaying the structural information and a pointing device for designating a target segment; and the second designating means comprises a display device for displaying the structural information and a pointing device for designating the division position. , The second designating means displays a line segment for indicating a division position on the display of the target segment,
The position of a line segment can be freely translated in parallel with a pointing device.

According to the present invention, when the target device is designated by the pointing device of the first designating means, the second designating means displays a line segment for indicating the division position on the display of the target segment, and the second segment is displayed. The position of the line segment is freely translated in parallel with the pointing device of the designation means to determine the division position.

Further, the structure editing apparatus according to claim 4, distribution
Segment any range of data in the columnar data
And define the range defined by one segment to another
When expressed as a set of multiple segments,
By defining a set of
Structure information that defines the hierarchical structure of the arranged data.
Information to edit the structure of the arranged data.
In the editing / editing device, any segment in the structure information
First specifying means for specifying a segment as a target segment
And any position included in the range of the target segment
Second specifying means to specify and the second specifying means
The target segment is defined as the divided position.
The first half segment and the second half segment at the division position
The target segment
Segment dividing means for replacing with the two segments
And the end position of the segment immediately before the target segment is equal to the start position of the target segment, and the end position of the target segment is equal to the start position of the next segment, the boundary on the start position side of the target segment Or, a third designating means for designating the movement of the boundary on the end position side, and when the movement of the boundary is designated by the third designating means, the position designated by the second designating means is moved to the moving position. And a segment boundary moving means for moving the specified boundary on the start position side or the specified boundary on the end position side. The structure editing apparatus according to claim 5
Is a structure editing apparatus according to claim 1.
At the end of the segment immediately preceding the target segment
End position and the start position of the target segment are the same, and
The end position of the elephant segment and the start position of the next segment
If they are equal, the boundary on the start position side of the target segment
Or a third designator that specifies the movement of the boundary on the end position side
When the step and the movement of the boundary is designated by the third designating means,
The position designated by the second designating means
As the position, the specified start position side boundary or end position
Segment boundary moving means to move the boundary on the storage side,
Be prepared.

According to this invention, when the movement of the boundary is designated, the segment boundary moving means secondly designates the boundary on the start position side or the boundary on the end position side designated by the third designating means. It is moved to the movement position designated by the means.

A structure editing apparatus according to a sixth aspect is the structure editing apparatus according to the fourth or fifth aspect , wherein the segment boundary moving means moves the boundary to a start position of the target segment or A first boundary movement that moves only the end position and does not change the start position or end position of the other segment, and the start position or end position of the target segment is moved to the start position or end position of the target segment. A second boundary movement that moves the end position or start position of another segment that has come into contact, and only the start position or end position of the target segment is moved without changing the start position or end position of the other segment, And a third boundary movement for inserting a new segment so as to fill the generated gap.

According to the present invention, when the boundary is moved by the segment boundary moving means, three boundary moving methods can be selected, and when the first boundary movement is selected, the start position of the target segment or Move only the end position without changing the start or end positions of other segments. When the second boundary movement is selected, the start position or end position of the target segment is moved, and the end position or start position of another segment that is in contact with the start position or end position of the target segment is moved. Further, when the third boundary movement is selected, only the start position or the end position of the target segment is moved and the start position or the end position of the other segment is not changed, and the generated gap is newly added. A different segment.

A structure editing apparatus according to a seventh aspect is the structure editing apparatus according to the sixth aspect , wherein the segment boundary moving means, when the target segment has a package, a boundary of a segment in the corresponding package. Also moves according to the range of the target segment.

According to the present invention, when the target segment has a package, the segment boundary moving means moves the boundary of the segment in the corresponding package according to the range of the target segment.

Further, the structure editing apparatus according to claim 8, in the structure editing apparatus according to any one of claims 4-7, wherein the second designating means, the movement position on the display of the target segment A line segment for indicating is displayed, and the position of the line segment is freely translated by the pointing device. According to the present invention, the line segment for indicating the moving position is freely translated in parallel with the pointing device of the second designating unit to determine the moving position.

A structure editing apparatus according to a ninth aspect is the structure editing apparatus according to any one of the first to eighth aspects, wherein the target segment has a structure element below a package in a lower hierarchy. As the processing for dividing the descendant segment by the segment dividing unit or the segment boundary moving unit, a first dividing for deleting structural elements below the divided segment, a second dividing for dividing the divided segment, and After dividing the segment to be divided, it is possible to select from three divisions to be merged into adjacent segments on both sides, and these processes are recursively performed up to the terminal descendants.

According to the present invention, when the descendant segment is divided by the segment dividing means or the segment boundary moving means, it is possible to select from three dividing processes.
When the first division is selected, the structural elements below the segment to be divided are deleted. If you select the second division,
If the segment to be divided is divided and there is a segment to be further divided under the divided segment, the same processing is recursively performed up to the terminal segment. Furthermore, the third
When the division is selected, the segment to be divided is divided and then merged into adjacent segments on both sides, and when there is a segment to be further divided under the divided segment, the same processing is recursively performed up to the terminal segment.

Further, the structure editing apparatus according to claim 10 is
The structure editing device according to any one of claims 1 to 9 , further comprising a fourth designating unit that designates merging of segments, and a segment merging unit that merges a plurality of segments and replaces them into one segment. The first designating means can designate a plurality of adjacent segments inside the same package as target segments, and the segment merging means designates a plurality of target segments by the first designating means. In addition, when merging is designated by the fourth designating means, a plurality of designated target segments are merged, and 1 from the start position of the first segment to the end position of the last segment in time series.
It is to be replaced as a segment.

Further, the structure editing apparatus according to claim 1 1,
In the structure editing apparatus according to any one of claims 1-10, further, a subject in the fifth designation unit, the fifth designation unit configured to designate as a target package any package in said structure information When a package is designated, all the segments that are the constituent elements of the target package are replaced with the upper segments of the target package to upgrade the target package by one layer, and a package hierarchy raising unit. It is a thing.

Further, the structure editing apparatus according to claim 1 2,
In the structure editing apparatus according to any one of claims 1 to 1 1, further creates a sixth specifying means for specifying the hierarchy down segment, the new and new packages from a plurality of segments segments, wherein Segment hierarchy down means for arranging the new segment in place of a plurality of segments and arranging the new package in a lower hierarchy of the new segment, wherein the first designating means is adjacent to each other inside the same package. A plurality of segments can be designated as target segments, and in the segment layer down means, a plurality of target segments are designated by the first designating means, and hierarchy down is designated by the sixth designating means. In this case, a segment of the range in which the plurality of target segments are combined is created as the new segment, and the plurality of target segment segments are created. A new package underneath, and the plurality of target segments are moved underneath.

Further, the structure editing apparatus according to claim 1 3,
The structure editing apparatus according to any one of claims 1 to 12 , further comprising: a seventh designating means for designating a layer up of a segment, and a segment layer up for moving a plurality of segments to a segment one layer up. Means, the first designating means is capable of designating a plurality of adjacent segments inside the same package as target segments, and the segment hierarchy raising means is the first segment
Multiple target segments are specified by the specifying method of
When the layer up is designated by the seventh designating means,
The upper segment of the package including the plurality of target segments is a parent segment, the parent segment is divided into a new segment and a segment other than the range in which the plurality of target segments are combined, and the plurality of target segments are It will replace the new segment.

Further, the structure editing apparatus according to claim 1 4,
In the structure editing apparatus according to any one of claims 1 to 1 3, further comprising eighth designating unit for designating the deletion of a segment, when the deletion is specified in the eighth designating unit, wherein Segment deletion means for deleting structural elements below the target segment.

Further, the structure editing apparatus according to claim 1 5,
In the structure editing apparatus according to claim 1 4, as the processing of the gap after removing the following structural elements designated segment in the segment deleting unit, no post-processing, first processing to extend the previous segment boundaries, just after It is possible to select either the second process of extending the segment boundary or the fourth process of designating one point within the range of the target segment and extending the segment boundaries immediately before and immediately after to the designated position.

The structure editing apparatus according to claim 16 is
In the structure editing apparatus according to claim 1 1, further comprising: a ninth designating means for designating deletion of the package, the fifth
And a package deleting unit that deletes structural elements below the target package when the target package is specified by the specifying unit and the deletion is specified by the ninth specifying unit.

The structure editing apparatus according to claim 17 is
The structure editing apparatus according to any one of claims 1 to 16 , wherein the arranged data is a video stream.

The video structure editing device according to claim 18 defines a range of arbitrary frames in the video stream as a segment, and expresses the range defined by one segment by a set of a plurality of other segments. In this case, by defining the set of the plurality of segments as a package, the structure information defining the hierarchical structure of the video stream is used to edit the structure of the video stream. A first designating unit that designates an arbitrary segment in the target segment, a second designating unit that designates an arbitrary position included in the range of the target segment, and the second designating unit designated by the second designating unit. With the position as the division position, the range of the target segment is divided into the two segments of the first half segment and the second half segment at the division position. And a segment dividing unit that replaces the target segment with the two segments, the segment dividing unit including the target segment.
If the package has a package, the corresponding package
From the segment corresponding to the range of the first half segment
Corresponding to the range of the first half package and the latter half segment
2 packages of the latter half package consisting of
It is divided into pages.

[0034]

Further, the image structure editing apparatus according to claim 19, in the video structure editing apparatus according to claim 1 8, wherein said first designating means, designating a display device and the segment displaying the structure information The second designating means comprises a display device for displaying the structural information and a pointing device for designating the division position, and the second designating means is for the target segment. A line segment for indicating the division position is displayed on the display, and the position of the line segment is freely translated by the pointing device to determine the division position.

According to a twentieth aspect of the present invention, there is provided a video structure editing apparatus which segments a range of arbitrary frames in a video stream.
Range defined as one segment
Is expressed by a set of other multiple segments,
Defining a set of number segments as a package
The structure that defines the hierarchical structure of the video stream
The information is used to edit the structure of the video stream.
In the image structure editing device, an arbitrary section in the structure information is
First designator that designates the segment as the target segment
Steps and arbitrary positions included in the range of the target segment
And a second designating means for designating
Using the determined position as the division position, the target segment
The first half segment and the second half segment at the division position.
The target segment is divided into two segments
Segmentation hand that replaces
And a step for displaying the structural information.
To specify the display device and target segment to show
The second designating means, which comprises a pointing device
Is a display device for displaying the structural information and the division position.
It consists of a pointing device for specifying the position,
The second designating means displays on the display of the target segment.
Display a line segment to indicate the dividing position, and
The position of the line segment can be freely translated with a vise.
It A video structure editing apparatus according to claim 21 is the video structure editing apparatus according to claim 19 or 20 ,
When the division position is a frame unit, the start frame A, the end frame B of the segment, the frame C that is a division candidate, and the frame D immediately before that are displayed on the operation dialog.
Are arranged in the order of ADCB and are displayed together with the number of frames.

Further, the image structure editing apparatus according to claim 2 2, in the video structure editing apparatus according to any one of claims 1 8-2 1, just before the end position and the target segment of the target segment The start positions of the segments are equal,
Further, when the end position of the target segment is equal to the start position of the next segment, a third position for designating movement of the boundary on the start position side or the boundary on the end position side of the target segment
When the movement of the border is designated by the designation means of No. 3 and the third designation means, the position designated by the second designation means is set as the movement position, and the boundary or end position on the designated start position side is set. Segment boundary moving means for moving the side boundary.

Further, the image structure editing apparatus according to claim 2 3, in the video structure editing apparatus according to claim 2 2, wherein the segment boundary moving unit, when moving the boundary, the start of the target segment A first boundary movement that moves only a position or an end position and does not change the start position or the end position of another segment, and the start position or the end position of the target segment, and the start position or the end position of the target segment Second boundary movement for moving the end position or start position of another segment in contact with the position, and moving only the start position or end position of the target segment without changing the start position or end position of the other segment , A third boundary movement that inserts a new segment to fill the generated gap, and A.

The video structure editing apparatus according to a twenty- fourth aspect is the video structure editing apparatus according to the twenty- third aspect , wherein when the target segment has a package, the segment boundary moving means stores the corresponding package in the corresponding package. The boundary of the segment is also moved according to the range of the target segment.

Further, the image structure editing apparatus according to claim 2 5, in the video structure editing apparatus according to any one of claims 1 to 8 21 to 24, wherein the second designation means, said target segment A line segment for indicating the movement position is displayed on the display, and the position of the line segment is freely translated by the pointing device to determine the movement position.

A video structure editing apparatus according to a twenty- sixth aspect is the video structure editing apparatus according to the twenty- fifth aspect , wherein when the moving position is a frame unit, the start frame of the immediately preceding segment is displayed on the operation dialog. A, the end frame B, the start frame C and the end frame D of the target segment, and the start frame E and the end frame F of the segment immediately after are displayed together with the number of frames.

A video structure editing apparatus according to a twenty- seventh aspect of the present invention is the video structure editing apparatus according to the twenty- first or twenty- sixth aspect , further comprising segment division or segment boundary movement means through the segment division means or segment boundary movement means. When the segment boundary is moved, it is possible to select whether to update each frame displayed in the operation dialog only when the update button is pressed, or at the set update timing. is there.

A video structure editing apparatus according to a twenty- eighth aspect is the video structure editing apparatus according to the twenty- seventh aspect , which has a play button and a frame candidate selection button, and when the play button is pressed, the time point is reached. When the target segment is reproduced and the frame candidate selection button is pressed, the periphery of the candidate frame specified at that time is displayed on the frame continuous display screen.

[0044] The recording medium according to claim 2 9, and characterized by recording a program for causing a computer to execute the respective means of structural editing apparatus according to any one of the claims 1 to 1 7 To do. As a result, the program can be read by a machine, and the operations according to claims 1 to 17 can be realized by a computer.

[0045] The recording medium according to claim 30, characterized by recording a program for causing a computer to execute the respective means of the image structure editing apparatus according to any one of the claims 1 8-2 8 And This makes the machine readable the program, according to claim 1 8 -
The operation of the 2 8 can be realized by a computer.

[0046]

BEST MODE FOR CARRYING OUT THE INVENTION A structure editing apparatus and a video structure editing apparatus according to the present invention will be described below in detail with reference to the accompanying drawings, taking as an example a case where the structure editing apparatus is applied to a video structure editing apparatus.
The structure editing device of the present invention relates to editing for correction performed after structure generation in structuring a segment having a range, and in particular, a video stream (including one including audio) as target data. What is handled corresponds to the video structure editing apparatus of the present invention. Therefore, the structure editing apparatus of the present invention is not limited to the type of the data as long as the target data has a range in terms of the structure editing of the segment having the range. For example, it is possible to edit data having a timetable (range) and a work process (work content) at that time, such as a work process table, as the target data.

Further, the video structure editing apparatus of the present invention for limiting the target data to the video describes the contents by structuring the video and uses the structural information for video search, video editing, search result browsing, and digest creation. It is used in the technology.

In the modification performed after the structure is generated, even when the range of the parent segment is changed, it is desired to change the boundary of the parent segment while keeping the information of the child segment existing in the hierarchy below it. Therefore, the present invention provides a function of modifying or modifying a previously created structure while using the original information as much as possible.

First, regarding the video structure editing apparatus of the present embodiment, [schematic structure of video structure editing apparatus] [structure of structure information] [display example of structure information by structure display software] [specific function of structure editing software] Explanation] [Representative range of segment and copy of representative frame /
Moving process] will be described in detail with reference to the accompanying drawings.

[Schematic Configuration of Video Structure Editing Device] FIG.
It is a schematic block diagram which shows an example of the video structure editing device 100 of this Embodiment. The video structure editing apparatus 100 inputs a video stream from a storage unit 103 that stores structure information that structures the video stream and / or the video stream, analyzes the structure of the video stream, and based on the analysis result, Display stream structure screen 10
2 is composed of a computer 101 that performs a process of visually displaying. In the figure, 204 is a keyboard,
Reference numeral 205 denotes a mouse which is a pointing device.

The storage unit 103 is the computer 10
Although a hard disk built in 1 may be used, here, a video information library connected to the computer 101 via a network, a recording of a floppy (registered trademark) disk, a CD-ROM, an MO, a DVD, or the like. The medium shall be used. Further, the storage unit 103 may be either one in which either the video stream or the structural information is stored, or one in which both the video stream and the structural information are stored.
It is sufficient that the target video stream and the structure information can be read and stored in the computer 101 before the structure editing is performed with 0.

FIG. 2 shows the computer 101 shown in FIG.
It is a block configuration diagram of. The computer 101 is a CPU 201 that executes processing based on software described below.
And a ROM 202 storing a boot program and the like, C
RAM 20 used as a work area for PU 201
3 and a keyboard 204 for performing various input operations
Also, a display device 206 such as a CRT or a liquid crystal display having a mouse 205 and a display screen 102 for displaying the analysis process of the video stream and the structure of the video stream.
And structure analysis software 207 and structure editing software 20 for realizing the functions of the video structure editing apparatus according to the present embodiment.
8. A hard disk 210 storing various application programs such as structure display software 209 and data,
An interface unit 211 such as various drivers and network adapters that connects the storage unit 103 and the computer 101 illustrated in FIG. 1 and a bus 212 that connects the above units.
And at least.

Note that the configuration of the video structure editing apparatus 100 shown in FIGS. 1 and 2 is merely an example, and if each function of the present embodiment described later can be realized, Any system configuration may be used.
Further, as a basic technique of a structure display method of analyzing a video stream to generate structure information and displaying the structure on a display screen, Japanese Patent Application No. 10-24959 filed by the present applicant.
The technology proposed in No. 8 can be applied. Further, the method of structuring the video stream is not particularly limited, but at least an arbitrary range in the video stream is defined as a segment, and a range included in the range defined by a certain segment or the same range is defined. When it can be expressed by a set of other multiple segments, the set of multiple segments is defined as a package, and these multiple segments are defined as sub-segments of the certain segment to structure the entire video stream. The target is the converted one.

Correspondences between the respective means of the present invention and the respective parts having the above construction will be described. 1st designation means of this invention, 2nd designation means, 3rd designation means, 4th designation means, 5th designation means, 6th designation means, 7th designation means, 8th designation means The ninth designating means is basically realized by the display device 206, the mouse 205, and the structure editing software 208. Further, the segment dividing means, the segment boundary moving means, the segment merging means, the package hierarchy increasing means, the segment hierarchy decreasing means, the segment hierarchy increasing means, the segment deleting means, the package deleting means, the copy / move processing means, and the attribute copy / invention of the present invention. The moving means is realized as an application program of the computer 101, and corresponds to the structure analysis software 207, the structure editing software 208, and the structure display software 209 in this embodiment.

[Structure of Structure Information] Next, with reference to FIG. 3, a structure example of the structure information used in the video structure editing apparatus of the present embodiment will be described. In this embodiment, the entrance of the structure of one entire video stream is defined as a route R, and an arbitrary range in the video stream is segment S as a structural element representing a structure hierarchically existing under this route R. And a range included in a range defined by a certain segment S (that is, a range corresponding to a part of the segment S) or the same range can be represented by a set of a plurality of other segments S, A set of a plurality of segments S is defined as a package P.

That is, in the structure example shown in FIG. 3, a package P (see reference numeral A) representing the entire image and one segment S constituting the package P are present in the first layer immediately below the root R. . In the second layer,
A package P (see reference numeral B) and six segments S constituting the package P, and a package P (see reference numeral C) and three segments S constituting the package P
, And a package P (see reference numeral D) and two segments S forming the package P. Also, the third
The layer P includes a package P (see reference numeral E), three segments S that form the package P, and a package P.
(See reference numeral F) and two segments S constituting the package P, package P (see reference numeral G) and one segment S constituting the package P, package P (see reference numeral H) and the package P There are two constituent segments S, a package P (see reference numeral I), and five segments S constituting the package P. Also, in the fourth layer, the package P (see reference numeral J)
And there are two segments S that make up the package P.

In the structure example of FIG. 3, the first layer is used.
Although there are layers to fourth layers, the depth of this layer and the number of packages P in each layer are not particularly limited,
It is set as needed. Further, in the present embodiment, when a part of the range or the same range defined by the segments of the upper layer can be expressed by a set of a plurality of lower segments, the plurality of segments of the upper layer are represented. It is defined as a partial segment for a segment.

Next, the criteria for generating the package P will be described with an example. For example, when the video stream having the structure shown in FIG. 3 is a video stream in which a movie is recorded, the first package P (see reference numeral B) of the three packages P of the second layer is
The video is divided according to the characteristics of the still image, the second package P (see reference numeral C) is divided according to the characters, and the third package P (see reference numeral D) is divided according to time. is there. In this example, since the partial segment (segment in the layer immediately below the parent segment) is generated in the format of dividing the parent segment (segment in the upper layer), the range of the partial segment that constitutes one package is When the ranges of the partial segments are collected without overlapping with each other, they become the range of the parent segment.

As described above, the structure of the video stream may be extracted or read from the structure information generated in advance, or the video stream may be read and directly structured on the spot to generate the structure information. .

[Display Example of Structure Information by Structure Display Software] FIG. 4 is an explanatory diagram showing a display example of the structure edit screen 401 by the structure display software 209 of the present embodiment. This structure display software 209 corresponds to the structure configuration display means of the present invention, and displays the hierarchical structure of the video stream based on the structure information as described below. However, here, for simplification of description, a video stream capable of displaying all structural information in one screen size of the display screen 102 is taken as an example, and a structure in which only basic functions of the structure display software 209 are displayed. An edit screen 401 is shown.

As shown in FIG. 4, the structure edit screen 401 displays the structure display section 401A for displaying the structure information 301 in which the structure information is represented by a tree-shaped parent-child relationship with each package as a node 301a, and the range of each package. Package identification display 302a and package identification display 302 shown
In order to display the configuration information 302 including the segment identification display 302b indicating the range of each segment that is a component of a according to the display line of the corresponding node, and to recognize the range of each segment in association with the numerical scale. The configuration display unit 401B that displays the scale 303 is included. Reference numeral 304 denotes a row display portion for facilitating visual recognition of corresponding display rows in the structure display portion 401A and the configuration display portion 401B, and 305 denotes a play button icon for designating reproduction of the selected segment. .

The operation of the above configuration will be described with reference to the display examples of the display screen 102 in the present embodiment shown in FIGS. 4 and 5. First, when the structure of the video stream as shown in FIG. 3 is displayed on the display screen 102, it becomes as shown in FIG. Here, the structure display unit 401
Structure information 301 and configuration display section 401 displayed in A
The configuration information 302 displayed in B is displayed based on the following rules (conditions). Note that, here, in order to distinguish each node 301a for easy understanding, the symbols A to J shown in FIG. 3 are described in the display of □ (dotted line □) indicating the nodes. For the same reason, the package identification display 302a and the segment identification display 302b are set to PA, S
Describe in A etc.

In the rule tree-like parent-child relationship, nodes belonging to the same hierarchy are displayed in the same display row or display column and are connected by straight lines. This rule can be restated as follows. That is, in the arrangement of the tree-shaped parent-child relationship of the structure information 301, when an arbitrary package is set as the parent package, the same range as the range of the segment which is one of the constituent elements of the parent package becomes When multiple child packages expressed as a set are defined, the multiple child packages are defined as sibling packages, and a plurality of nodes indicating these sibling packages are arranged in the vertical direction and these nodes are arranged. Display by connecting with a line. Further, in a tree-shaped parent-child relationship, when an arbitrary package is set as a parent package, the same range as any one of the plurality of segments which are the constituent elements of the parent package is set to a set of other plurality of segments. If a plurality of child packages represented by is defined, and the ranges of the plurality of child packages do not overlap, a plurality of nodes indicating the plurality of child packages are arranged side by side in the horizontal direction, and, Display these nodes by connecting them with lines.

Therefore, in FIG. 5, since the nodes B, C, and D are displayed in the same display column and connected by a straight line, they are in the same hierarchy, and the nodes B, C, and D are the same. The packages corresponding to are sibling packages. Further, since the nodes G, H, and I are displayed on the same display line and are connected by a straight line, they are on the same layer, but packages corresponding to these nodes G, H, and I are siblings. Not a package.

In the rule tree-like parent-child relationship, the node of the package that represents the entire video stream is defined as the highest package, and the corresponding node is defined by the structure information 301 (structure display unit 4).
It is placed in the upper left part of 01A). Therefore, the node A indicating the package P representing the entire image is arranged in the upper left portion of the structure information 301.

In a rule tree-like parent-child relationship, when an arbitrary package is set as a parent package, the same range as the range of a segment which is one of the constituent elements of the parent package is expressed by a set of a plurality of other segments. When the child package is defined, the node indicating the child package is arranged at the lower right of the node indicating the parent package, and these nodes are displayed by connecting them with a broken line. For example, if node E is the parent package, its child package, node J,
It is arranged at the lower right of the node E in the display of the structure display unit 401A and is connected to the node E by a polygonal line.

In a rule tree-like parent-child relationship, when a child package having a sibling package as a parent package exists, a node indicating the child package is placed at the lower right of the node indicating the corresponding sibling package, and Arrange the sibling packages located below the sibling packages below the position of the child package located at the lower right.

Therefore, focusing on the nodes E, F, and J in FIG. 5, the packages of the nodes E and F are in a sibling package relationship, and the packages of the nodes E and J are: There is a relationship between the parent package and the child package. Therefore, the node J is arranged in the lower right of the node E, and the node F is arranged in the line next to the line in which the node J exists.

The rule configuration display section 401B has the horizontal direction of the screen as a time series direction, and the row corresponding to each node specified in the row display section 304 of the structure display section 401A corresponds to the range of the corresponding package. A thin strip-shaped package identification display 302a is displayed at a corresponding position on the time series in length. In addition, for each segment constituting the package displayed by the package identification display 302a, a block-shaped segment identification display 302b having a length corresponding to the range of the segment and at a corresponding position in time series is displayed. .

Therefore, in FIG. 5, for example, the package identification indicator (reference numeral PA) corresponding to the node A is:
It is displayed in the same line as the node A and in the form of a thin strip having a length indicating the entire video stream. Further, the segment identification display (reference numeral SA) corresponding to the node A is displayed in the same row as the node A and in a block shape having a length corresponding to the range of the segment (here, the entire video stream).

The package identification indicator (code PE) corresponding to the node E is in the same row as the node E, the length of the package corresponding to the node E, and a thin strip at the corresponding position on the time series. Is displayed. Further, the segment identification indications (reference symbols SE1 to SE3) corresponding to the node E are displayed in the same row as the node E in the range of each segment and at the corresponding position on the time series in a block shape.

Video structure editing apparatus 100 of the present embodiment
By executing the rules ~ with the structure display software 209, the internal logical structure of the structure information can be visualized and easily grasped, and the ratio of the range of each segment can be intuitively known. , The structure of multiple packages and the configuration of segments can be easily compared and examined, and the range and arrangement of each package or segment in the structure of the entire structural information should be displayed in an intuitive and quantitative manner. You can

Further, the structure display software 20 of the present embodiment
It is obvious that by applying 9 to 9, for example, it is easy to reflect and display the editing result such as the addition, deletion, and range change of the segment by the structure editing software 208, which will be described later, at any time. Further, the structure edited using such a structure display method can be used as information for searching and browsing, and may be saved again in the storage unit 103 for later use.

[Specific Description of Functions of Structure Editing Software]
Next, the function of correcting the video stream structure of the structure editing software 208 will be described with reference to the display screen examples of FIGS. In the present embodiment, the structure editing software 208 operates in cooperation with the structure display software 209 and the structure analysis software 207 described above to realize the correction function.

FIG. 6 shows an example in which the hierarchical structure of the video stream is displayed on the structure editing screen 401 by the structure display software 209. Here, for simplification, a video stream having a four-layer structure is taken as an example, and the configuration display unit 401B is further used.
Each segment displayed in shall be identified by describing a number.

In the structure edit screen 401 of FIG. 6, the segment making up the package of the first layer is (number 2),
The segments that make up the package of the second layer are (numbers 4, 5, 6, 7), and the segments that make up the package corresponding to the segment (number 5) of the packages of the third layer are (numbers 10, 11, 12). , 13) and the third
Among the packages in the hierarchy, the segments that make up the package corresponding to the segment (number 6) (number 20, 2
1, 22), and the segments that make up the package of the fourth layer are (numbers 15, 16).

Here, the correction process for dividing the segment will be described. (Split correction processing 1) For example, when splitting the segment (number 4) of the second layer of FIG. 6 at the position of 400 frames from the beginning, the mouse 205 is used to display the structure display portion 401A Segment (number 4)
Click. This makes the segment (number 4)
Is designated as the target segment. Next, mouse 20
By using 5, an arbitrary position included in the range of the target segment (here, a position of 400 frames) is clicked.
Next, when a segment division icon (not shown) is designated, the structure editing software 208 sets the range of the target segment (number 4) to the first half segment and the second half segment at the division position with the position clicked immediately before as the division position. It is divided into two segments, and as shown in FIG. 7, the target segment (number 4) is divided into two segments (number 4, number 2).
Replace with 3).

In this example, the first half segment inherits the original target segment number (number 4) and the second half segment is given a new segment number (number 23). You may make it manage by assigning a new number to one segment. Further, since the segment (number 4) does not have a package in the layer below it, the lower segment is not affected by the division of the segment (number 4).

(Split correction processing 2) Next, split correction processing when the target segment has a package will be described. For example, when the segment (number 6) in FIG. 6 is designated as the target segment, the target segment (number 6) has the package T0, and the package T0 is formed in the layer below the target segment (number 6). There are three segments (numbers 20, 21, 22) to be used.

When the target segment has a package as described above, the corresponding package is divided into two packages, that is, a first half package including a segment corresponding to the range of the first half segment and a second half package including a segment corresponding to the range of the second half segment. To divide. Specifically, as shown in FIG. 8, when the division position M is specified on the segment (number 6), the range of the target segment (number 6) is divided into the first half segment (number 6) and the second half segment (number 6) at the division position M. 23), and the package T0 is divided into a package T1 corresponding to the first half segment (number 6) and a package T2 corresponding to the second half segment (number 23).

When the target segment has a structural element below the package in the lower layer, there are the following three dividing methods as the processing for dividing the segment in the lower layer. First division: Delete structural elements below the segment to be divided (see FIG. 9). Second division: divide the segment to be divided (Fig. 10
reference). Third division: after dividing the segment to be divided, it is merged into adjacent segments on both sides (see FIG. 8).

As shown in FIG. 8, the target segment is the first half segment (number 6) and the second half segment (number 23).
The case where the package T0 is divided into a package T0 corresponding to the first half segment (number 6) and a package T2 corresponding to the second half segment (number 23) corresponds to the third division.

Further, as shown in FIG. 9, the segment (number 21) divided at the division position M is deleted corresponds to the first division. In this case, the package after division is a package T3 that is a combination of the segments in the lower layer of the first half segment (number 6), and a package T4 that is a combination of the segments of the lower layer of the second half segment (number 23). Is generated.

Further, as shown in FIG. 10, the segment (number 21) to be divided is divided into segments (number 2).
1) and the one that produces the segment (number 24) is the second
Corresponds to the division of.

The above first to third division processing is recursively applied up to the descendant segment at the end when there is a segment divided at the division position M in the lower hierarchical layers of the target segment. It

Further, which of the first to third division processes is to be used can be easily realized by selecting a desired process with the mouse 205 from the pull-down menu 1001 of FIG. 10, for example.

(Boundary Moving Process 1) Next, the boundary moving process for moving the boundary of the segment will be described. In the boundary movement process 1, when the end position of the segment immediately before the target segment is equal to the start position of the target segment, and the end position of the target segment is equal to the start position of the next segment, the mouse 205 is used to move the target segment. It is possible to specify the movement of the boundary on the start position side or the boundary on the end position side. When the movement of the boundary is designated using the mouse 205, the boundary on the start position side or the end position side of the designated target segment is moved to the movement position.

Specifically, the boundary on the start position side of the segment (number 21) in the third layer of FIG. 6 (left boundary position in the figure)
Is designated to change (move) this boundary to the position of 1760 frames from the beginning. First, the segment (number 21) of the structure display unit 401A displayed on the structure edit screen 401 is clicked using the mouse 205. As a result, the segment (number 21) is designated as the target segment. Next, using the mouse 205, the left boundary position of the target segment (number 21) is clicked. Then, after designating a boundary movement icon (not shown), if an arbitrary position is clicked as the movement position M0,
The structure editing software 208 moves the left boundary position of the target segment (number 21) to the moving position M0, as shown in FIG. At this time, the segments (number 20 and number 22) on both sides of the target segment (number 21) follow the movement position of the boundary, and the range of the segment is changed.

In the process of moving the boundary, there are two boundary moving methods depending on how the boundary between the target segment and the adjacent segment is moved. First boundary movement: Only the start position or end position of the target segment is moved and the start position or end position of the other segment is not changed. In other words, the area vacated by the movement is left as it is (see FIG. 12). Second boundary movement: The start position or end position of the target segment is moved, and the end position or start position of another segment in contact with the start position or end position of the target segment is moved (see FIG. 11). Third boundary movement: A new segment is inserted so as to fill the generated gap without moving only the start position or end position of the target segment and changing the start position or end position of the other segment (Fig. 13).

In FIG. 6, the segment (number 20) is designated as the target segment, and the target segment (number 2) is specified.
When the right boundary position (end position) of 0) is specified and then this boundary is changed (moved) from the beginning to the position of 1760 frames, as shown in FIG. 12, segment (number 20) and segment (number 21) The empty area remains empty as a result of the movement between the two. This corresponds to the first boundary movement.

As shown in FIG. 11, the target segment (number 21) and the segments (number 20,
The second boundary movement corresponds to the boundary (22) that always moves together.

Further, in FIG. 6, after the segment (number 20) is designated as the target segment and the right boundary position (end position) of the target segment (number 20) is designated,
When this boundary is changed (moved) to the position of 1760 frames from the beginning, as shown in FIG. 13, a new segment (number) is added to the area vacated by the movement between the segment (number 20) and the segment (number 21). What is inserted 23) corresponds to the third boundary movement.

Further, which of the first to third boundary movement processes should be used can be easily realized by selecting a desired process with the mouse 205 from the pull-down menu 1301 of FIG. 13, for example.

(Boundary Movement Processing 2) In the boundary movement processing 2,
In segment boundary movement, when the target segment has a package, the boundary of the segment in the corresponding package is also moved according to the range of the target segment. For example, when the left boundary position of the segment (number 6) in FIG. 14 is moved to the moving position M7,
The target segment (number 6) has the package T8, and the adjacent segment (number 5) has the package T7. When the left boundary position of the target segment (number 6) is moved to the moving position M7 from this state, as shown in FIG. 15, the left boundary position of the target segment (number 6) is moved, whereby the segment (number 2) of the package T8 is moved.
The left boundary position of 0) also moves to the moving position M7. Similarly, the right boundary position of the segment (number 13) of the package T7 moves to the moving position M7.

(Boundary movement processing 3) When the target segment has a package in the boundary movement of the segment, the boundary of the corresponding package is also changed in conjunction with the boundary movement of the target segment. Therefore, the boundary movement of the target segment is moved. Sometimes it is necessary to expand the package once and reconfigure the segments that make up the package according to the boundaries (range) of the package after the movement.

Further, in the boundary moving process, when the target segment has a structural element below the package in the lower layer, segmentation of the lower layer occurs due to the boundary movement of the target segment. There are the following three dividing methods as the dividing processing in this case. First division: The structural elements below the segment divided by the boundary movement of the target segment are deleted (see FIG. 16). Second division: The segment divided by the boundary movement of the target segment is divided (see FIG. 17). Third division: the segment divided by the boundary movement of the target segment is divided and then merged into the adjacent segments (see FIG. 18).

As shown in FIG. 16, when the left boundary position of the segment (number 6) is moved to the movement position M8, the segment (number 21) is divided at the movement position M8. The one obtained by deleting the divided segment (number 21) corresponds to the first division. In this case, the package after division is segment (number 10, 11, 12, 13, 2
0) package T9 and segment (number 2)
A package T10 consisting of 2) is generated.

As shown in FIG. 17, the moving position M8
The second division is the division of the segment (number 21) divided by to generate the segment (number 21) and the segment (number 23).

Further, as shown in FIG. 18, the moving position M8
The segment (number 21) that is divided by 2 is divided into two segments, the divided first half segment is merged into the segment (number 20), and the divided second half segment is merged into the segment (number 22). It corresponds to division.

The above first to third division processing is recursively applied up to the descendant segment at the end when there is a segment divided at the moving position M in the lower hierarchy segment of the target segment. It

(Merge Process) Next, a segment merge process for merging a plurality of segments and replacing them into one segment will be described .
Merging of segments, first, merging specifies a plurality of target segments (merge), selecting the merging processing icon (not shown), merge several object segment specified time series at the beginning of The segment from the start position of the segment to the end position of the last segment is replaced as one segment.

For example, if the segment (number 5) and the segment (number 6) in FIG. 6 are designated as the target segment to be merged, and then a merge processing icon (not shown) is designated, as shown in FIG. The target segment (number 5) and the target segment (number 6) are merged and replaced as one segment (number 5). At this time, if the target segment has a structural element below the package in the lower layer, the packages are merged by merging the target segments. In the example of FIG. 19, the packages under one new segment (number 5) generated by the merge are merged, and the segments (number 10, 1) are merged.
One package consisting of 1, 12, 13, 20, 21, 22) is generated. That is, if the target segment has at least one child package, these are 1
All the child segments of each package are managed.

(Package Layer Up Process) Next, the package layer up process will be described. In the package layer upgrade process of the present embodiment, the target package is specified, and all the segments that are the constituent elements of the target package are replaced with the upper segments of the target package, and the target package is upgraded by one layer.

For example, if the package T20 shown in FIG. 6 is designated as the target package and then the package hierarchy up processing icon (not shown) is designated, as shown in FIG. 5) is replaced by the segments (numbers 10, 11, 12, 13) forming the package T20. As a result, the target package T20 is included in the package T21 that is one layer higher, and is one layer higher. Also,
Due to the hierarchical amplifier of this package, the segments (numbers 10, 11, 12,
13) moves to the second layer, and the segments (numbers 15 and 16) arranged in the fourth layer move to the third layer.

(Segment Hierarchy Down Processing) The segment hierarchy down processing will be described. In this process, multiple segments existing in a certain hierarchy are specified, one new package is created from these multiple segments, and one new segment is created by merging these multiple segments. The new segment is arranged in the hierarchy in which the segment existed, and the new package (that is, a plurality of segments) is arranged in the hierarchy below the new segment. In other words, a plurality of segments have moved to the next lower layer.

For example, a case where three segments (numbers 5, 6, 7) among the segments existing in the second layer in FIG. 6 are designated as the target segment will be described as an example.
Here, the plurality of segments that can be designated as the target segment must be a plurality of adjacent segments inside the same package. In other words, if another segment exists between the two segments to be designated as the target segment, the segment layer down processing according to the present embodiment cannot be applied. In this case, it is necessary to individually perform the segment layer down processing or to combine with other processing to realize the desired segment layer down processing.

Target segments (numbers 5, 6,
7) is designated, and then a segment hierarchy down processing icon (not shown) is designated, as shown in FIG.
A segment (number 23) is generated as a new segment, and the segment (number 23) is arranged as the target segment (number 5, 6, 7) of the second layer. At the same time, one package T22 from the target segment (number 5, 6, 7)
Are created, and the new package T22 is arranged below the third layer segment (number 23) (third layer). At this time, as is clear from FIG. 21, when the lower layer has components such as a package like the segment (numbers 5 and 6), the segment (numbers 5 and 6) must go down one layer. In response, each one is moved down one level.

(Segment Layer Up Process) Next, the segment layer up process will be described. In the segment layer up processing, by specifying multiple segments existing in a certain layer, the upper segment of the package that contains multiple target segments is made the parent segment, and the parent segment is a new segment in the range that combines the multiple target segments. And other segments and replace multiple target segments with new segments.

For example, three segments (numbers 11, 12, 1) among the segments existing in the third layer of FIG.
The case where 3) is designated as the target segment will be described as an example. Here, the plurality of segments that can be designated as the target segment must be a plurality of adjacent segments inside the same package.

At the third layer, the target segment (number 11, 1)
(2, 13) and then the segment hierarchy up processing icon (not shown), the designated third
The parent segment (number 5) of the target segment of the hierarchy is divided into a new segment in the range including the target segments (numbers 11, 12, 13) and other segments. At this time, when the parent segment is divided into two including the new segment, the parent segment number is inherited by the segments other than the new segment. In addition, when the parent segment is divided into three, including the new segment, the parent segment number is inherited by the segment on the start position side of the parent segment and the new segment is added to the segment on the end position side. The segment number is given.

After that, the new segment of the second layer is replaced by the target segment (numbers 11, 12, 13) of the third layer, and the segment is moved up by one layer as shown in FIG. At this time, when the target segment has a component such as a package in the lower layer, the lower component is also made to follow the target segment by one layer, and is set to 1 each.
Move up one level.

(Segment Deletion Processing) Next, segment deletion processing will be described. In the segment deletion process,
Delete the segment specified as the target segment. At this time, as processes of the gap after deleting the structural elements below the target segment, the processes of to exist.

No post-treatment. The immediately preceding segment boundary is extended (first process). The segment boundary immediately after is extended (second process). One point within the range of the target segment is designated, and the segment boundaries immediately before and immediately after are extended to the designated position (third processing).

The case where the deletion of the segment (number 6) is designated in FIG. 6 will be described as an example. In the case where there is no post-processing, as shown in FIG. 23, the deletion of the segment (number 6) results in a state in which all the subordinate constituent elements are deleted from the segment (number 6). In the case of the first processing, as shown in FIG. 24, the segment boundary of the immediately preceding segment (number 5) is extended to the segment (number 7) in the second layer where the target segment (number 6) existed. . At this time, in the third layer, the segment boundary of the segment (number 13) may be extended to the right boundary position of the segment (number 22) deleted in the third layer. Alternatively, as shown in FIG. 25, the third layer may remain deleted. In the case of the second processing, as shown in FIG. 26, in the second layer in which the target segment (number 6) existed, the segment boundary of the immediately following segment (number 7) is extended to the segment (number 5). . In the third layer, since there is no segment immediately after the segment (number 22), the segment (number 20, 21, 22) is deleted as it is. In the case of the third processing, as shown in FIG. 27, one point M30 within the range of the target segment is designated, and the boundary of the immediately preceding segment (number 5) and the segment immediately after (number 7) is extended to the designated position. .

Which of the processes (1) to (3) is used can be easily realized by selecting a desired process with the mouse 205 from a pull-down menu (not shown).

(Package Deletion Processing) Next, the package deletion will be described. In the package deletion process, the structural elements under the target package are deleted. In particular,
When the package T20 in FIG. 6 is designated as the target package, the structural elements below the package T20 are deleted as shown in FIG.

Although the above description does not refer to display of line segments when designating a division position or a movement position, as shown in FIGS. 29 and 31, in the hierarchical structure, from the first hierarchy. In order to see the moving position and the dividing position up to the lowest level, the line segment displays D10 to D12 are displayed, and the line segment displays D10 to D12 are freely translated in parallel with the mouse 205 to determine the position. The workability is improved and work efficiency is good.

Further, FIG. 30 shows an example of an operation dialog 500 for performing segment division processing. The operation dialog 500 is for supporting segment division, and is effective when strict segment correction is performed in frame units. The display timing of the operation dialog 500 is displayed on the screen when, for example, a target segment is designated and a segment division process is designated. In the figure, 5
Reference numeral 01 indicates the start position frame of the target segment, 502 indicates the end position frame of the target segment, and 504 indicates a frame that is a candidate for division (a frame at the division position designated by the line segment display D10 in FIG. 29). A frame 503 is a frame immediately before a frame that is a division candidate.

Numeral 505 indicates a numerical value input section for inputting the number of frames of the division position frame when designating the division position. When the number of frames is input to the numerical value input unit 505 as the division position frame or the line segment display D10 is moved, the display frames 503 and 504 are changed.

Reference numeral 506 denotes a playback button for designating playback of the target segment, and 507 denotes a frame candidate selection button for selecting a frame that is a candidate for division when performing segment division. This frame candidate selection button 50
When 7 is clicked, the frame continuous display screen 700 shown in FIG. 33 is displayed. On the frame continuous display screen 700, the periphery of the candidate frame (frame 504) designated at that time is displayed as a continuous frame.

FIG. 32 shows an example of the operation dialog 600 when the segment boundary moving process is performed. The operation dialog 600 is for supporting segment boundary movement when the movement position is in frame units, and is effective when rigorously correcting segments in frame units. The display timing of the operation dialog 600 is displayed on the screen when, for example, a target segment is designated and segment boundary movement processing is designated. In the figure, 601 and 6
Reference numeral 02 corresponds to the line segment displays D11 and D12 in FIG.

Further, 604 is a target segment, and 604a
Indicates the start position frame (start frame) of the target segment, 604b indicates the end position frame (end frame) of the target segment, 603 indicates the segment immediately before the target segment, 603a indicates the start position frame of the immediately preceding segment, and 603b indicates the target segment. indicates the end position frame immediately preceding, 605 immediately following the segment segments, 60 5 a start position frame of the segment immediately after, is 60 5 b shows the end position frame immediately following the segment.

Further, reference numerals 607a and 607b denote numerical value input sections for inputting the number of moving position frames when designating a moving position. When the number of frames that are candidates for the moving position is input in the numerical input unit 607a, the boundary
01 (line segment display D11) is moved to the position of the input frame number, and the display frames of 603b and 604a are changed. When the number of frames that are candidates for the moving position is input in the numerical value input unit 607b, the boundary 602 (line segment display D
12) is moved to the position of the input frame number, and 604
The display frames of b and 605a change.

Reference numerals 606a and 606b denote frame candidate selection buttons for selecting a frame that is a candidate for a moving position when the boundary of the segment is moved. When the frame candidate selection button 606a is clicked, the frame continuous display screen 700 shown in FIG. 33 is displayed. At this time, the periphery of the candidate frame designated at that time is displayed as a continuous frame on the continuous frame display screen 700.

When the division position or the movement position is a frame unit, it is necessary to confirm the peripheral frame in order to appropriately determine the division frame or the boundary frame. , The selection is valid. A specific number of frames, but it is possible to just input in tough Esu of only the number of frames, this must be confirmed before and after the frame to be a candidate in a different way in the case, efficiency is poor. In particular, in the case of processing for correcting the deviation of the cut point (division position) for the segment that is roughly manually specified, if the cut detection algorithm is used on the frame continuous display screen 700, the candidate point Is obtained, and work efficiency is improved. This operation is visually easy to understand. When it is necessary to refer to a video, there is an advantage that it is easy to select an appropriate frame by finding the target position of the frame continuous display screen by reproduction and performing the same work.

Further, in FIG. 32, reference numeral 608 designates each frame (603a, 603a) displayed in the operation dialog 600.
603b, 604a, 604b, 605a, 605b)
The update button for updating the display is displayed. When the update button 608 is clicked, the bitmap display of each frame is updated. When the segment boundary is moved in the segment boundary moving process, each frame (603a, 603) displayed in the operation dialog 600 is displayed.
b, 604a, 604b, 605a, 605b), the update display can be selected only when the update button 608 is pressed, or at the set update timing. Basically, by using the check box □ of “Always” in the figure in the selected state (a check mark), the display is updated every time the segment boundary is changed, but the check box of “Always” is displayed. If □ is not selected (no check mark), the update timing (change interval time) setting dialog (not shown) is displayed, and the change interval time can be specified in the setting dialog.
At this time, "no update" can be designated. Therefore, the processing speed can be improved by designating the update timing by the interval time.
Further, if "no update" is specified, the display is updated only when the update button is pressed, so the display can be further omitted and the processing speed can be improved.

Further, the programs for realizing the respective means of this embodiment and the video structure editing apparatus (structure editing apparatus) of this embodiment are a hard disk, a floppy disk,
It is recorded on a computer-readable recording medium such as a CD-ROM, MO, or DVD, and executed by being read from the recording medium by the computer. Further, this program can be distributed via the recording medium as described above, or can be distributed via a communication network such as the Internet.

[0128]

As described above, the structure editing apparatus (Claims 1 to 17 ) of the present invention can be used to examine the contents of a logical structure generated by structuring when the contents are reviewed and modified. Segments and packages in different layers can be easily modified, and processing can be performed while making the most of the structure of the child segments and below. This is efficient because the work of the structure generation up to that point is not wasted, and a natural human work flow of reworking fine parts after rough processing can be realized is efficient. In other words, a structure editing device having a function capable of modifying or modifying a structure created in advance using data (segment) having a range as a unit of structure while using the original structure information as much as possible. The effect of being able to provide.

A structure editing apparatus of the present invention (claim 1)
The segment dividing means divides the range of the target segment into the first half segment and the second half segment based on the division position.
Since it is divided into two segments and the target segment is replaced with these two segments, if there is a segment to be divided, it can be easily corrected (divided) by designating it as the target segment and designating the division position.

The structure editing apparatus of the present invention (claim 1 )
In the hierarchical structure of the structure information, when a package exists in a layer below the target segment, the corresponding package is also divided into two corresponding to the division of the target segment. Therefore, while using the original structure information, You can easily make modifications and corrections.

The structure editing apparatus of the present invention (claim 2 )
In 3), when the target device is designated by the pointing device of the first designating means, the second designating means displays a line segment for indicating the division position on the display of the target segment,
Since the position of the line segment is freely moved in parallel by the pointing device of the second designating unit to determine the division position, the division work can be performed in a short time and the work efficiency can be improved. In addition, the candidate position is displayed visually in an easy-to-understand manner, and the position can be freely moved to determine the position, so the operability is good.

[0132] The structure editing apparatus (claim 4 of the present invention,
5 ) In the case where the movement of the boundary is designated, the segment boundary moving means designates the boundary on the start position side or the boundary on the end position side designated by the third designating means by the second designating means. Since it is moved to the movement position, it is possible to easily modify and correct it while using the original structure information.

A structure editing apparatus of the present invention (claim 6 ).
Is capable of selecting three boundary moving methods when the boundary is moved by the segment boundary moving means, and when the first boundary moving is selected, only the start position or end position of the target segment is moved. If the start position or end position of another segment is not changed and the second boundary movement is selected, the start position or end position of the target segment is moved and the start position or end position of the target segment is touched. If the third boundary movement is selected by moving the end position or the start position of the other segment, the start position or the end position of the other segment is moved to move the start position or the end position of the other segment. Since a new segment is inserted so as to fill the generated gap without changing it, it is possible to move the boundary according to the content of the correction. It is possible to improve the workability and operability.

The structure editing apparatus of the present invention (claim 7 ).
When the target segment has a package, the segment boundary moving means moves the boundary of the segment in the corresponding package in accordance with the range of the target segment, so that workability and operability can be further improved.

The structure editing apparatus of the present invention (claim 8 ).
Since the line segment for indicating the moving position is freely translated in parallel with the pointing device of the second designating unit to determine the moving position, the moving work can be performed in a short time,
Work efficiency can be improved. In addition, the candidate position is displayed visually in an easy-to-understand manner, and the position can be freely moved to determine the position, so the operability is good.

The structure editing apparatus of the present invention (claim 9 )
Can be selected from three division processes when the descendant segment is divided by the segment dividing unit or the segment boundary moving unit. When the first dividing is selected, the structural elements below the divided segment are deleted, and , If the second segment is selected, the segment to be segmented is segmented, and if there is a segment segment further segmented below the segment thus segmented, the same process is recursively performed up to the terminal segment. If you select division, after dividing the divided segment, it is merged into both adjacent segments, and if there is a segment that is further divided under the divided segment, the same process is performed recursively up to the end segment, Since the boundary can be moved according to the content of the correction, workability and operability can be improved. Further, when operating a segment having a hierarchy that has been generated in advance, if the structure below the descendant is discarded, the work up to that point is wasted.
The information of the structural elements under the child can be utilized in a form that is suitable for the purpose, and the processing that suits the meaning of the operation can be performed, and the work is easy to perform.

[0137] Further, the structure editing apparatus of the present invention (claim 1
0 ), the segment merging means merges the plurality of designated target segments when the plurality of target segments are designated by the first designating means and the merge is designated by the fourth designating means, Since the segment from the start position of the first segment to the end position of the last segment is replaced in time series as one segment, the segments can be merged according to the content of the correction, so workability and operability can be improved. You can

A structure editing apparatus of the present invention (claim 1)
1 ) is a fifth designating unit that designates an arbitrary package in the structure information as a target package, and all segments that are constituent elements of the target package when the target package is designated by the fifth designating unit. Is provided in place of the upper segment of the target package, and a package layer raising means for raising the target package by one layer is provided, so that the package can be raised by one layer if necessary, and workability and operability are improved. It is possible to improve.

The structure editing apparatus of the present invention (claim 1)
In 2 ), when the segment hierarchy down means specifies a plurality of target segments by the first designating means and the hierarchy down is designated by the sixth designating means, a plurality of target segments are combined as a new segment. Create a range of segments, replace them in place of multiple target segments, create a new package underneath them, and move multiple target segments underneath it, so you can
The hierarchy can be lowered, and workability and operability can be improved.

The structure editing apparatus of the present invention (claim 1)
3 ) is a package including a plurality of target segments when the segment layer raising means specifies a plurality of target segments by the first designating means and a layer up is designated by the seventh specifying means. The upper segment is used as the parent segment, and the parent segment is divided into a new segment and a segment other than the range in which multiple target segments are combined, and multiple target segments are replaced with new segments. Therefore, the workability and operability can be improved.

The structure editing apparatus of the present invention (claim 1)
4 ) is provided with the eighth designating means for designating the deletion of the segment and the segment deleting means for deleting the structural element below the target segment when the deletion is designated by the eighth designating means. Accordingly, the segment can be deleted accordingly, and workability and operability can be improved.

The structure editing apparatus of the present invention (claim 1)
5 ) is the processing of the gap after the structural elements below the target segment are deleted by the segment deletion means, without post-processing,
Of the first process that extends the immediately preceding segment boundary, the second process that extends the immediately following segment boundary, and the fourth process that designates a point within the range of the target segment and extends the previous and next segment boundaries to the designated position. Since either one can be selected, the segment can be deleted according to the content of the correction, and the workability and operability can be improved.

The structure editing apparatus of the present invention (claim 1)
6 ) is the structure below the target package when the target package is designated by the ninth designating means for designating the deletion of the package and the fifth designating means and the deletion is designated by the ninth designating means. Since the package deleting means for deleting the element is provided, the package can be deleted according to the content of the correction, and the workability and the operability can be improved.

The structure editing apparatus of the present invention (claim 1)
In 7 ), since the arranged data is a video stream, the structure editing apparatus according to claims 1 to 16 can be provided as a video structure editing apparatus.

Further, the video structure editing device of the present invention (claim 18 ) includes a first designating means for designating an arbitrary segment in the structure information as a target segment and an arbitrary segment included in the range of the target segment. With the second designating means for designating the position and the position designated by the second designating means as the dividing position, the range of the target segment is divided into two segments of the first half segment and the second half segment at the dividing position, and the target segment is divided into two segments. Since the segment dividing means for replacing with two segments is provided, if there is a segment to be divided, it can be easily corrected (divided) by designating it as the target segment and designating the dividing position.

Further, in the video structure editing device of the present invention (claim 18), when the target segment has a package,
The corresponding package is the first half package consisting of the segment corresponding to the range of the first half segment and the second half package consisting of the segment corresponding to the range of the latter half segment.
Since it is divided into one package, it is possible to easily modify and modify it while using the original structure information.

Further, the video structure editing device of the present invention (claims 19 and 20 ) displays a line segment for indicating the division position on the display of the target segment, and the position of the line segment can be freely parallelized by the pointing device. Since the dividing position is determined by moving the dividing operation, the dividing operation can be performed in a short time, and the efficiency of the operation can be improved. In addition, the candidate position is displayed visually in an easy-to-understand manner, and the position can be freely moved to determine the position, so the operability is good.

[0148] The video structure editing apparatus of the present invention (claim 2 1), when the dividing position is a frame unit, on the operation dialog, the start of the segment frame A, the end frame B, frame C as a candidate dividing And the frame D immediately before that are displayed in order of ADCB together with the number of frames, the frames before and after the candidate boundary position are displayed in time series, and the display is updated every time the candidate frame is changed. It is possible to judge at a glance whether or not the frame is appropriate and the operability is good.

Further, in the image structure editing device of the present invention (claim 2 2 ), when the movement of the boundary is designated, the segment boundary moving means causes the boundary on the side of the start position designated by the third designating means. Alternatively, since the boundary on the end position side is moved to the movement position designated by the second designating means, it is possible to easily make modifications and corrections while utilizing the original structural information.

[0150] The video structure editing apparatus of the present invention (claim 2 3), when moving the boundary segment boundary moving unit, it is possible select three methods boundaries movement, first
When the boundary movement of is selected, only the start position or the end position of the target segment is moved without changing the start position or the end position of the other segment, and when the second boundary movement is selected, the target position is changed. When the start position or the end position of the segment is moved, the end position or the start position of another segment which is in contact with the start position or the end position of the target segment is moved, and when the third boundary movement is selected, the target position is changed. A new segment is inserted to fill the created gap without moving only the start or end position of the segment and changing the start or end position of other segments. Since it can be moved, workability and operability can be improved.

[0151] The video structure editing apparatus of the present invention (claims 2 to 4), when the target segment has a package,
Since the boundaries of the segments in the corresponding package are also moved according to the range of the target segment, workability and operability can be further improved.

Further, the image structure editing device of the present invention (claim 25 ) displays a line segment for indicating the movement position on the display of the target segment, and the position of the line segment is freely moved in parallel by the pointing device. Since the moving position is determined by doing so, the moving work can be performed in a short time, and the work efficiency can be improved. In addition, the candidate position is displayed visually in an easy-to-understand manner, and the position can be freely moved to determine the position, so the operability is good.

Also, the video structure editing apparatus of the present invention (claim 26 ), when the moving position is in frame units, the start frame A of the immediately preceding segment, the end frame B, and the start frame of the target segment are displayed on the operation dialog. Since C and the end frame D, and the start frame E and the end frame F of the segment immediately after are displayed together with the number of frames, the frames before and after the boundary position as a candidate are displayed in time series, and the display is updated every time the candidate frame is changed. Therefore, you can judge at a glance whether the frame to be operated is appropriate,
Operability is good.

[0154] The video structure editing apparatus of the present invention (Claim 2 7), when there is movement of the segmentation or segment boundaries through the segment dividing unit or the segment boundary moving unit, is displayed on the operation dialog Regarding the update display of each frame, it is possible to select whether to update only when the update button is clicked or to update at the set update timing, so by specifying the display update timing as necessary, Processing can be omitted and processing speed can be improved. It is also effective when the desired number of frames is known in advance and display is unnecessary.

[0155] The video structure editing apparatus of the present invention (claim 28) has a play button and a frame candidate select button and press the playback button, the segment at that point is reproduced, the frame candidate select button When is pressed, the periphery of the candidate frame specified at that time is displayed on the frame continuous display screen, so that the divided frame or the boundary frame can be appropriately determined. Further, when it is necessary to confirm the peripheral frames, the confirmation and selection on the frame continuous display screen can be easily performed, and the workability can be improved.

[0156] The recording medium of the present invention (Claim 2 9)
Records a program for causing a computer to execute each means described in any one of claims 1 to 17 , so that the program can be machine-readable and the operation of claims 1 to 17 is realized by the computer. There is an effect that a recording medium capable of being obtained can be obtained.

A recording medium of the present invention (claim 30 )
Since recording a program for executing the respective means described in claim 1 8-2 8 to a computer, the program becomes machine readable by the computer an operation of claim 1 8-2 8 The recording medium that can be realized can be obtained.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram showing an example of a video structure editing device of the present embodiment.

FIG. 2 is a block diagram of the computer shown in FIG.

FIG. 3 is an explanatory diagram showing a structure example of structure information used in the video structure editing device of the present embodiment .

FIG. 4 is an explanatory diagram showing a display example of a structure edit screen by the structure display software according to the present embodiment.

FIG. 5 is an explanatory diagram showing a display example of a structure edit screen by the structure display software according to the present embodiment.

FIG. 6 is an explanatory diagram showing an example in which the hierarchical structure of a video stream is displayed on a structure edit screen by structure display software.

FIG. 7 is an explanatory diagram showing a segment division process and a package division process according to the present embodiment.

FIG. 8 is an explanatory diagram showing segment division processing and package division processing according to the present embodiment.

FIG. 9 is an explanatory diagram showing segment division processing and package division processing according to the present embodiment.

FIG. 10 is an explanatory diagram showing a segment dividing process and a package dividing process according to the present embodiment.

FIG. 11 is an explanatory diagram showing segment boundary movement processing according to the present embodiment.

FIG. 12 is an explanatory diagram showing segment boundary movement processing according to the present embodiment.

FIG. 13 is an explanatory diagram showing segment boundary movement processing according to the present embodiment.

FIG. 14 is an explanatory diagram showing segment boundary movement processing according to the present embodiment.

FIG. 15 is an explanatory diagram showing segment boundary movement processing according to the present embodiment.

FIG. 16 is an explanatory diagram showing segment boundary movement processing according to the present embodiment.

FIG. 17 is an explanatory diagram showing segment boundary movement processing according to the present embodiment.

FIG. 18 is an explanatory diagram showing segment boundary movement processing according to the present embodiment.

FIG. 19 is an explanatory diagram showing segment merging processing according to the present embodiment.

FIG. 20 is an explanatory diagram showing a package hierarchy raising process according to the present embodiment.

FIG. 21 is an explanatory diagram showing segment hierarchy down processing according to the present embodiment.

FIG. 22 is an explanatory diagram showing a segment hierarchy raising process according to the present embodiment.

FIG. 23 is an explanatory diagram showing segment deletion processing according to the present embodiment.

FIG. 24 is an explanatory diagram showing a segment deletion process of the present embodiment.

FIG. 25 is an explanatory diagram showing a segment deletion process of the present embodiment.

FIG. 26 is an explanatory diagram showing a segment deletion process according to the present embodiment.

FIG. 27 is an explanatory diagram showing a segment deletion process according to the present embodiment.

FIG. 28 is an explanatory diagram showing package deletion processing according to the present embodiment.

FIG. 29 is an explanatory diagram of line segment display for determining a division position and a movement position.

FIG. 30 is an explanatory diagram showing an example of an operation dialog for performing segment division processing.

FIG. 31 is an explanatory diagram of line segment display for determining a division position and a movement position.

FIG. 32 is an explanatory diagram showing an example of an operation dialog for performing segment boundary movement processing.

FIG. 33 is an explanatory diagram showing a frame continuous display screen.

[Explanation of symbols]

100 Video structure editing device (structure editing device) 101 computer 102 display screen 103 storage 207 Structural analysis software 208 Structure editing software 209 Structure display software

─────────────────────────────────────────────────── ─── Continuation of the front page (56) References JP-A-5-227477 (JP, A) JP-A-7-303234 (JP, A) (58) Fields investigated (Int.Cl. ⁷ , DB name) H04N 5/76-5/956

Claims (30)

(57) [Claims] 1. A set of a plurality of segments is defined when a range of arbitrary data in arrayed data is defined as a segment and the range defined by one segment is expressed by a set of a plurality of other segments. In the structure editing device that edits the structure of the arranged data by using the structure information that defines the hierarchical structure of the arranged data by defining as a package, an arbitrary segment in the structure information is targeted. First designating means for designating as a segment, second designating means for designating an arbitrary position included in the range of the target segment, and the position designated by the second designating means as a division position, The range of the target segment is divided into two segments, the first half segment and the second half segment, at the division position, and the target segment is Segment segmentation means for replacing with two segments , said segment segmentation means comprising:
If you have a cage, place the appropriate package in the first half
Segment consisting of segments corresponding to
Cage and segment corresponding to the range of the latter half segment
It is divided into two packages of the latter half package
Structure editing apparatus, characterized in that that. 2. A range of arbitrary data in arranged data.
Define the enclosure as a segment and define it as one segment
If the range is expressed as a set of other multiple segments,
In this case, the set of multiple segments is defined as a package.
By defining the hierarchical structure of the arranged data
Using the defined structural information, the structure of the arrayed data is
In the structure editing device for editing a structure , an arbitrary segment in the structure information is a target segment.
The first designation means for designating as and the arbitrary position included in the range of the target segment
Second designating means, and the position designated by the second designating means as a dividing position.
Then, the first half of the range of the target segment is divided at the division position.
Divided into segments and the two segments of the second half segment
The target segment with the two segments
And a display device for displaying the structural information.
And a pointing to specify the target segment
And a second designating means,
Designate a display device for displaying information and the division position
The pointing device for displaying the target segment on the display of the target segment.
Display a line segment to indicate the dividing position, and
Structure editing apparatus you and moving freely in parallel the position of the line segment in vise. 3. The first designating means comprises a display device for displaying the structural information and a pointing device for designating a target segment, and the second designating means for displaying the structural information. And a pointing device for designating the division position, wherein the second designating means displays a line segment for indicating the division position on the display of the target segment, and the position of the line segment can be freely set by the pointing device. The structure editing device according to claim 1, wherein the structure editing device is moved in parallel with the structure editing device. 4. A range of arbitrary data in the arranged data.
Define the enclosure as a segment and define it as one segment
If the range is expressed as a set of other multiple segments,
In this case, the set of multiple segments is defined as a package.
By defining the hierarchical structure of the arranged data
Using the defined structural information, the structure of the arrayed data is
In the structure editing device for editing a structure , an arbitrary segment in the structure information is a target segment.
The first designation means for designating as and the arbitrary position included in the range of the target segment
Second designating means, and the position designated by the second designating means as a dividing position.
Then, the first half of the range of the target segment is divided at the division position.
Split into two segments, a segment and a second half segment
The target segment with the two segments
And a segment dividing means for changing, the start position of the segment immediately before the target segment is equal to the start position of the target segment, and the end position of the target segment is equal to the start position of the next segment, the start of the target segment Third designating means for designating the movement of the boundary on the position side or the boundary on the end position side, and when the movement of the boundary is designated by the third designating means,
As the movement position by said position designated by said second designation means, you and the segment boundary moving means for moving the boundary of the boundary or end side of the designated start position side, comprising the structure Manufacturing and editing equipment. 5. A segment immediately before the target segment
End position is the same as the target segment start position, and
The end position of the target segment and the start position of the next segment
If the positions are equal, the start position side of the target segment
A third finger that specifies the movement of the boundary or the boundary on the end position side
When the boundary movement is designated by the fixing means and the third designating means,
The position designated by the second designating means is referred to as a moving position.
Then, the specified start position side boundary or end position side
Structure editing apparatus according to any one <br/> of claims 1 to 3, characterized by comprising a segment boundary moving means for moving the border, the. 6. The segment boundary moving means is configured to move the boundary.
When moving the field, move only the start position or end position of the target segment.
Move it to change the start or end position of the other segment.
The first boundary movement that does not change and the start position or end position of the target segment are moved.
And the start position or end of the target segment
End or start position of another segment touching the position
The second boundary movement for moving the target segment and only the start position or the end position of the target segment.
Move it to change the start or end position of the other segment.
Don't change it, add a new segment to fill the created gap.
The structure editing apparatus according to claim 4 or 5 , characterized in that a third boundary movement for inserting a component can be selected . 7. The segment boundary moving means comprises:
If the elephant segment has a package, the corresponding package
The boundaries of the segments in the cage are also within the range of the target segment
The structure editing device according to claim 6 , wherein the structure editing device is moved according to the movement . 8. The second designating means includes the target segment.
A line segment to show the movement position is displayed on the
You can freely move the position of the line
Structure editing apparatus according to any one of claims 4-7, characterized in that to. 9. The target segment is a package in a lower layer.
If there is a structural element below,
Descendant segmentation by means of step or segment boundary movement
As a process to divide the segment, the segment that is divided
The first division that deletes the structural elements below
The second segment that splits the segment, and the segment that is segmented
Split the segment and then merge it into adjacent segments.
It is possible to select from three of the three divisions, and
9. The structure editing apparatus according to claim 1, wherein the processing is performed recursively up to the last descendant . 10. Further, a merge of the segments is designated.
4th specification means to merge and merge multiple segments to 1
Segment merging means to replace one segment with
Wherein the first designation means, adjacent within the same package
Multiple segments can be specified as target segments
Yes, the segment merging means is duplicated by the first designating means.
Number of target segments are designated, and the fourth designation is made.
If the method specifies merge, the specified pairs are
Merge the elephant segments and
1 segment from the start position to the end position of the last segment
It replaces as a mentment, It is characterized by the above-mentioned.
The structure editing device according to any one of 1. 11. Further, an arbitrary pattern in the structural information is added.
Fifth designator to specify package as target package
And the target package is specified by the fifth specifying means.
All of the components of the target package
The segment of the upper segment of the target package
Instead, replace the target package by one layer.
11. The structure editing apparatus according to claim 1, further comprising a package layer upgrade unit that performs a package upgrade . 12. Further, the segment down of the hierarchy is instructed.
6th specifying means to set, and new segment from multiple segments
Create a cage and a new segment to
Place the new segment instead of the
Segment in the lower layer of the new segment
Layer down means, the first designating means being adjacent to each other inside the same package.
Multiple segments can be specified as target segments
Yes, the segment layer down means is the first designating means
A plurality of target segments are designated by the
When the hierarchy down is specified by the specifying means, the new segment
As a ment
Create a segment to replace the multiple target segments
Replace it, create a new package under it,
The structure editing device according to any one of claims 1 to 11, wherein a number of target segments are moved below the target segment . 13. A method for further increasing the hierarchy of segments.
7th designation means to set and multiple segments one level higher
Segment hierarchy up means to move to another segment
And, the first designating means are adjacent to each other inside the same package.
Multiple segments can be specified as target segments
Yes, the segment hierarchy raising means is the first designating means.
A plurality of target segments are designated by the
If the hierarchy is specified by the specification means,
The upper segment of the package that contains the target segment
As the parent segment, and the parent segment as the plurality of
New segment in the range that includes the target segment and other
Into multiple segments and
Replacement with a new segment .
12. The structure editing device according to any one of 12. 14. Further, the deletion of the segment is designated.
Eighth designation means and deletion is designated by the eighth designation means
If it is found, the structural elements below the target segment are deleted
Structure editing apparatus according to any one of claims 1 to 13, characterized by comprising a segment deleting unit, the for. 15. The target segment by the segment deleting means.
As the processing of the gap after deleting the structural elements below
No post-processing, first process to extend previous segment boundary
The second process that extends the segment boundary immediately after
Specify a point within the range of the
The fourth process is to extend the segment boundary to the specified position.
Structure editing apparatus according to claim 1 4, characterized in that it can be selected Zureka. 16. Further, the deletion of the package is designated.
The target package is composed of the ninth designating means and the fifth designating means.
Is specified, and deletion is specified by the ninth specifying means.
If it is specified, the structural elements under the target package will be deleted.
12. The structure editing apparatus according to claim 11 , further comprising a package deleting unit . 17. The arrayed data is a video stream.
17. The method according to claim 1 , which is a dome.
Structure editing device described in one . 18. An arbitrary frame in a video stream
The range is defined as a segment and defined by one segment.
The defined range is represented by a set of other multiple segments
In case the package of the multiple segments is
By defining the hierarchical structure of the video stream
Structure of the video stream using the defined structure information
In the video structure editing apparatus for editing a target segment to any segment in said structure information
The first designation means for designating as and the arbitrary position included in the range of the target segment
Second designating means, and the position designated by the second designating means as a dividing position.
Then, the first half of the range of the target segment is divided at the division position.
Split into two segments, a segment and a second half segment
The target segment with the two segments
And a segment corresponding to the range of the latter half segment consisting of segments corresponding to the range of the first half segment, when the target segment has a package. It is divided into two packages in the second half package consisting of you, wherein Film image structure editing apparatus. 19. The first designating means comprises a display device for displaying the structural information and a pointing device for designating a target segment, and the second designating means for displaying the structural information. And a pointing device for designating the division position, wherein the second designating means displays a line segment for indicating the division position on the display of the target segment, and the position of the line segment can be freely set by the pointing device. 19. The video structure editing device according to claim 18 , wherein the video structure editing device is moved in parallel with. 20. Arbitrary frames in a video stream
The range is defined as a segment and defined by one segment.
The defined range is represented by a set of other multiple segments
In case the package of the multiple segments is
By defining the hierarchical structure of the video stream
Structure of the video stream using the defined structure information
In the video structure editing apparatus for editing a target segment to any segment in said structure information
The first designation means for designating as and the arbitrary position included in the range of the target segment
Second designating means, and the position designated by the second designating means as a dividing position.
Then, the first half of the range of the target segment is divided at the division position.
Split into two segments, a segment and a second half segment
The target segment with the two segments
And a display device for displaying the structural information.
And a pointing to specify the target segment
And a second designating means,
Designate a display device for displaying information and the division position
The pointing device for displaying the target segment on the display of the target segment.
Display a line segment to indicate the dividing position, and
Film image structure editing apparatus characterized thereby freely translating the position of the line segment in vise. 21. The division position is a frame unit
The start frame of the segment on the operation dialog.
A, end frame B, frame C that is a candidate for division, and its
The immediately preceding frame D is arranged in the order of ADCB to obtain the number of frames.
Claim 19 or 20 together and displaying
The video structure editing device described in. 22. The segment immediately before the target segment
The end position of the segment and the start position of the target segment are
The end position of the target segment and the start of the next segment
If the positions are the same, the start position side of the target segment
The third that specifies the movement of the boundary of the
When the movement of the boundary is designated by the designating means and the third designating means,
The position designated by the second designating means is referred to as a moving position.
Then, the specified start position side boundary or end position side
Claim 18-21, characterized by comprising a segment boundary moving means for moving the border, the
The video structure editing device described in one . 23. The segment boundary moving means comprises:
When moving the boundary, move only the start position or end position of the target segment.
Move it to change the start or end position of the other segment.
The first boundary movement that does not change and the start position or end position of the target segment are moved.
And the start position or end of the target segment
End or start position of another segment touching the position
The second boundary movement for moving the target segment and only the start position or the end position of the target segment.
Move it to change the start or end position of the other segment.
Don't change it, add a new segment to fill the created gap.
The video structure editing device according to claim 22, wherein a third boundary movement for inserting a component is selectable . 24. The segment boundary moving means comprises:
If the target segment has a package,
The boundaries of the segments in the package
24. The video structure editing device according to claim 23 , wherein the video structure editing device is moved according to 25. The second designating means is configured to provide the target segment.
Display a line segment to show the movement position on the display of
Freely move the position of a line segment in parallel with a pointing device
Any one of claims 18-24, characterized in that makes
Video structure editing apparatus according to One. 26. The movement position is in frame units
The start frame of the previous segment on the operation dialog.
Frame A, end frame B, start frame of target segment
C and end frame D, start frame of the segment immediately after
26. The video structure editing device according to claim 25 , wherein E and the end frame F are displayed together with the number of frames . 27. The segment dividing means or
Is divided into segments via the segment boundary moving means.
When the segment boundary is moved, the operation die
The update display of each frame displayed in the
Update only when you press the new button or set update
27. The video structure editing device according to claim 21 , wherein it is possible to select whether to update at a timing . 28. A play button and a frame candidate selection button
Button and press the play button, the target at that time
The segment is played, and the frame candidate selection button is clicked.
When pressed, around the candidate frame specified at that time
Is displayed on the continuous frame display screen.
The video structure editing device according to claim 27. 29. The computer-readable recording medium characterized by recording a program for causing a computer to execute the respective means of structure editing apparatus according to any one of claims 1 to 17. 30. Any one of claims 18 to 28
The computer as each means of the video structure editing device described in
It records the program to be executed by the computer.
Computer readable recording medium.