JP2001326901A - Information management device for moving picture scene - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information management device for moving picture scenes with which the scene configuration of the whole moving picture can be grasped easily and retrieval and editing based on the moving picture scenes can be performed efficiently. SOLUTION: The information management device for moving picture scenes to detect the scene change included in a moving picture and accumulate/manage the positional information of the scene change frame of each scene is provided with a scene group determining part 103 to determine one or more scene groups consisting of one or more scenes on the basis of the difference information of the positional information of the change frame of each scene and then to output the positional information of a head frame in the scene group, and a scene information layering part 104 to generate layering information for hierarchically managing the positional information of the change frame of each scene of the whole moving picture from the positional information of the change frame of the scene and the positional information of the head frame in the scene group.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention belongs to the field of digital image processing, and detects a scene break (hereinafter referred to as "scene change") in a moving image and manages the moving image scene efficiently. It is about.

[0002]

2. Description of the Related Art In recent years, a large amount of digital moving images have been handled by personal computers and the like, and it has become important how to efficiently perform operations such as searching and editing of moving images. When searching and editing a moving image, it is necessary to decompose the moving image into the scenes that compose the moving image and to grasp the arrangement and configuration of each scene in the moving image. The term “scene” used herein refers to a unit in which a camera is switched in a moving image, or
This means a unit at which a scene is switched.

As one method of grasping the arrangement and configuration of the scene, the position of a first frame (hereinafter, referred to as a scene change frame), which is a scene change in a moving image, is detected from the moving image data. It is known to store / manage position information of all scene change frames in a moving image as scene information.

As a conventional moving image scene information management apparatus of this type, there is an apparatus using a scene change detection apparatus disclosed in Japanese Patent Application Laid-Open No. 9-261648, for example. A conventional moving image scene information management device using this scene change detection device will be described below with reference to the block diagram of FIG.

[0005] A conventional moving image scene information management device includes a coding parameter extracting unit 801 for extracting coding parameters from moving image coded data, and a scene change frame in a moving image based on the extracted coding parameters. And a storage unit 803 for storing position information (scene information) of the scene change frame and storing the output scene information. The scene information stored in the storage unit 803 is used for moving image search, editing, display, and the like.

[0006] Japanese Patent Application Laid-Open No. 5-282379 discloses a moving image management method and a management apparatus for hierarchically managing moving image scenes. In this method, the entire moving image is first divided into scenes by detecting a break in the scene of the entire moving image, and a one-layer tree structure (a tree having the whole moving image as a parent and each divided scene as a child). Structure).

Next, a hierarchical tree is constructed (bottom-up) by editing (merging) the hierarchical tree based on a user's input instruction. Furthermore, a method has been proposed in which a multi-level tree is constructed top-down for the entire moving image by an input instruction from a user from an early stage.

[0008]

However, in the above-described conventional moving image scene information management apparatus, a video in which camera switching frequently occurs or a video in which scene switching such as a TV commercial is intense is performed. Many scene change frames are detected in a short time, and a moving image in a short time is divided into many scenes.

For this reason, when a list of scenes is displayed based on the detected scene change frames, a large number of scene change frames are displayed, making it difficult to grasp the scene configuration of the entire moving image, and at the same time, Since it is difficult to grasp the configuration, there is a problem that it is inconvenient to search and edit a moving image based on a scene.

It is conceivable to semantically organize a large number of detected scenes, but this requires advanced processing or human intervention, and is not easily realized.

Further, in the above-described bottom-up type management method, once the scene is divided into the entire moving image,
Thereafter, a multi-level tree is generated in accordance with a user's instruction, and the hierarchical management of the scene is performed.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and automatically generates multi-layer management information of a scene at the same time as dividing a moving image into scenes without previously dividing the entire moving image into scenes. By doing so, it is possible to provide a moving image scene information management device that makes it easy to grasp the scene configuration of the entire moving image and enables efficient search and editing based on the moving image scene.

[0013]

A moving image scene information management apparatus according to the present invention detects a break in a scene (scene change) included in a moving image, and based on the detected scene change, detects a scene change. A moving image scene information management device that accumulates / manages position information of a first frame (scene change frame), and generates a scene group including one or more scenes based on difference information of the position information of each scene change frame. Decide one or more,
A scene group determining unit that outputs position information of a head frame in the scene group; and a position information of the scene change frame and a position information of a head frame in the scene group. A scene information layering means for generating layered information for hierarchically managing the position information.

Here, the scene group determining means may select one of two temporally adjacent scene change frames.
A frame that is a first scene change frame and a second scene change frame while a temporally earlier one is a first scene change frame and a temporally later one is a second scene change frame. Calculating a distance between frames, and, if the distance between frames is greater than a predetermined threshold, different scenes between the first scene starting from the first scene change frame and the second scene starting from the second scene change frame And determining the second scene change frame as the first frame of the new scene group and outputting the position information thereof,
When the inter-frame distance is smaller than a predetermined threshold, the first scene and the second scene are determined to be included in the same scene group.

Further, a threshold value for determining whether the first scene and the second scene are included in different scene groups or the same scene group is a variable value. .

Further, the moving picture scene information management apparatus according to the present invention detects a break (scene change) of a scene included in the moving picture, and, based on the detected scene change, a head frame (scene) of each scene. A moving image scene information management device that accumulates / manages position information of at least one change frame based on a flag indicating whether or not each frame over the entire moving image is the scene change frame. A scene group determining unit that determines one or a plurality of scene groups including scenes and outputs position information of a first frame in the scene group; and position information of the scene change frame and position information of a first frame in the scene group. To hierarchically manage the position information of each scene change frame over the entire moving image Characterized by comprising a scene information layer means for generating a hierarchical information.

Here, the scene group determining means may select one of two temporally adjacent scene change frames.
Based on the flag, the first scene change frame and the second scene change frame are referred to as the first scene change frame, and the later scene is referred to as the second scene change frame. Counting the number of non-scene change frames between scene change frames, and if the counted number of non-scene change frames is greater than a predetermined threshold, the first scene starting from the first scene change frame and the The second scene change frame and the second scene starting from the second scene change frame are determined to be included in a different scene group, and the position information is output using the second scene change frame as a head frame of a new scene group, When the counted number of non-scene change frames is smaller than a predetermined threshold, the first scene and the And determining shall include second and scenes in the same scene group.

Further, a threshold value for determining whether the first scene and the second scene are included in different scene groups or the same scene group is a variable value. .

Further, the scene information layering means is characterized in that the position information of the first frame in each scene is represented in a tree structure and managed hierarchically.

[0020]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a first embodiment of the present invention will be described in detail with reference to FIGS. Here, FIG. 1 is a block diagram illustrating a configuration of a moving image scene information management device according to the present embodiment, FIG. 2 is a block diagram illustrating a configuration of a scene group determination unit in the moving image scene information management device according to the present embodiment, FIG. 3 is a diagram for explaining the operation of the scene group determination unit in the moving image scene information management device according to the present embodiment, and FIG. 4 is the operation of the scene information hierarchical unit in the moving image scene information management device according to the present embodiment. FIG.

As shown in FIG. 1, a moving image scene information management apparatus according to the present embodiment is configured to extract an encoding parameter from input moving image encoded data such as MPEG-1. And a scene change frame detection unit 102 that detects a scene change frame in a moving image based on the extracted encoding parameters and outputs position information of the scene change frame.

The scene change frame detecting section 10
A scene group that determines one or more scene groups consisting of one or more scenes based on the position information of the scene change frame output from 2, and outputs the position information (scene group information) of the first frame in the scene group A determination unit 103;
A scene information layering unit 104 that generates hierarchical information for hierarchically managing the position information of scene change frames over the entire moving image, and stores / manages the position information and hierarchical information of the scene change frames. And a storage unit 105 for performing the operation.

Here, the encoding parameter extraction unit 101,
Scene change frame detection unit 102 and storage unit 10
5 is the same as the encoding parameter extraction unit 801, scene change frame detection unit 802, and accumulation unit 803 in the above-described conventional example, and a description thereof will not be repeated.

First, the scene group determining unit 103 will be described. In FIG. 2, a scene change frame detecting unit 1
The position information (scene information) of the scene change frame output from 02 is input to the scene information comparison unit 201. The scene information comparison unit 201 calculates the inter-frame distance from the input scene change frame scene information and the temporally past scene change frame scene information already stored in the memory 202.

If the inter-frame distance is larger than a predetermined threshold, the input scene change frame is set as the head of a new scene group, and the position information (scene information) of the scene change frame is output as scene group information. Further, the scene information of the input scene change frame is stored in the memory 202 for comparison with the scene information of the next input scene change frame.

When scene information is not stored in the memory 202, for example, when scene information is input to the scene information comparing unit 201 for the first time, comparison of scene information is impossible. In such a case, for example, the memory 20
If the flag indicates that there is no scene information in the memory 202, for example, by providing a flag indicating whether or not there is past scene information in the memory 202, the scene information of the input scene change frame is directly used as scene group information. You may make it output.

Next, the processing of the scene group determining unit 103 will be described. FIG. 3 shows frames arranged in chronological order, and the frames (F1, F2, F3, F4, and F
5) indicates a scene change frame detected by the scene change frame detection unit 102.

Here, scene 1 from frame F1 to immediately before frame F2, scene 2 from frame F2 to immediately before frame F3, scene 3 from frame F3 to immediately before frame F4, and frame F4 to immediately before frame F5. From scene F5 to immediately before the next scene change frame (not shown) as scene 5.

Further, the frame number of the frame F1 is set to 1
The frame number is sequentially assigned to each frame, and the position information (scene information) of the scene change frame
Is indicated by the frame number of the scene change frame. That is, the scene information of the frame F1 = 1, the scene information of the frame F2 = 16, the scene information of the frame F3 = 19, the scene information of the frame F4 = 22, and the scene information of the frame F5 = 36. The threshold used in the scene information comparison unit 201 is 12.

Since the scene information (= 1) of the frame F1 is the scene information of the first scene change frame input to the scene information comparing unit 201, the scene information comparing unit 201 outputs the scene information as scene group information. The scene information of the frame F1 is stored in the memory 202 for comparison with the scene information of the next scene change frame to be input.

Next, the scene information (= 16) of the frame F2 input to the scene information comparing unit 201 is already stored in the memory 2
02, the scene information of the frame F1 (=
Compared with 1), the distance between frames is calculated. Here, the distance between frames is 16-1 = 15, and the threshold value (=
12) Because of the above, the frame F2 becomes the head of a new scene group, and the scene information of the frame F2 is output as scene group information. The scene information of the frame F2 is stored in the memory 202 for comparison with the scene information of the next scene change frame.

Next, the scene information (= 19) of the frame F3 input to the scene information comparing unit 201 is the scene information (= 16) of the frame F2 stored in the memory.
And the distance between frames is calculated. Since the interframe distance is 19-16 = 3, which is smaller than the threshold value (= 12), the scene information of the frame F3 is not output as scene group information. The scene information of the frame F3 is
It is stored in the memory 202 for comparison with the scene information of the next input scene change frame.

Next, the scene information (= 22) of the frame F4 input to the scene information comparing unit 201 is the scene information (= 1) of the frame F3 stored in the memory.
9) and the distance between frames is calculated. Since the interframe distance is 22-19 = 3, which is smaller than the threshold value (= 12), the scene information of the frame F4 is not output as scene group information. The scene information of the frame F4 is stored in the memory 202 for comparison with the scene information of the next scene change frame to be input.

Next, the scene information comparing section 201
The scene information (= 36) of the frame F5 input to the
Scene information of the frame F4 stored in the memory (=
22), and the inter-frame distance is calculated. The distance between frames is 36−22 = 14, and the threshold value (= 12)
As described above, the frame F5 becomes the head of a new scene group, and the scene information of the frame F5 is output as scene group information. The scene information of the frame F5 is
It is stored in the memory 202 for comparison with the scene information of the next input scene change frame.

As a result, scene 1 is scene group 1, scenes 2 to 4 are scene group 2, scene 5 is scene group 3, and the scene information of frames F1, F2, and F5 is determined by the scene group determining unit. 103 outputs the scene group information.

Here, the threshold value and the scene information are compared on a frame basis, but may be compared on a time basis, for example, by setting the threshold value to 2 seconds. Further, by appropriately changing the threshold value according to the type / genre of the video, a more appropriate scene group can be created.

Next, the scene information layering unit 104 will be described. Here, the scene change frame detection unit 1
02 and the scene group determining unit 10
Using the scene group information output in step 3 as input, the position information of the scene change frame over the entire moving image is represented by a tree structure, and hierarchical information for hierarchical management is generated.

Each node of the tree structure includes position information (time from the beginning of the entire moving image, frame number, etc.) of a scene group or a scene leading frame (scene change frame), and a link (branch) to a node of a lower hierarchy. Part). The root node of the tree structure includes position information of the first frame in the entire moving image and a link to a node in a lower hierarchy.

FIG. 4 is a diagram showing a hierarchical tree structure. In the upper hierarchy, the scene group information (frames F1, F2, F5 in FIG. 3) output by the scene group determination unit 103
In the lower hierarchy, scene information (scene change frames F1, F2, F3, F4, F5 in FIG. 3) of the scenes included in each scene group is shown.

However, FIG. 4A shows a tree structure when scene group information is included in a lower hierarchy, and FIG. 4B shows a tree structure when scene group information is not included in a lower hierarchy. For example, FIG.
Taking the case of (b) as an example, the root node of the tree structure includes the position information of the first frame in the whole moving image and the first frames (scene change frames) F1, F2, and F2 of the scene group.
Has a link to F5.

Further, the node F2 stores the position information of the frame (scene change frame) F2 and the frame F2.
And a link to the first frame (scene change frame) F3, F4 of the scene included in the scene group starting from.

Also, in FIG. 4A, scene group information determined using a certain threshold is shown in the upper layer, but scene group information obtained by different thresholds is stored in the upper layer and the lower layer. (When a threshold smaller than the above threshold is used), or in a layer further above the upper layer (when a threshold larger than the above threshold is used),
It may be a multi-layer structure. The layering information generated by the scene information layering unit 104 is sent to the storage unit 105 and stored / managed as moving image scene management information.

Next, a second embodiment of the present invention will be described with reference to FIGS. 5 to 8. The same reference numerals are given to the same parts as those in the first embodiment, and the description will be omitted. Here, FIG. 5 is a block diagram illustrating a configuration of a moving image scene information management device according to the present embodiment, FIG. 6 is a block diagram illustrating a configuration of a scene group determination unit in the moving image scene information management device according to the present embodiment, FIGS. 7 and 8 are diagrams for explaining the operation of the scene group determination unit in the moving image scene information management device according to the present embodiment.

As shown in FIG. 5, the moving image scene information management apparatus according to the present embodiment is configured to extract an encoding parameter from input moving image encoded data such as MPEG-1. Detecting a scene change frame in the moving image based on the extracted encoding parameters, and determining the position information (scene information) of the scene change frame, and whether each frame constituting the moving image is a scene change frame. And a scene change frame detection unit 502 that outputs a flag indicating

The scene change frame detecting section 50
2, the position information of the scene change frame output from
A scene group determining unit 503 that determines one or more scene groups including one or more scenes based on the flag and the flag, and outputs position information (scene group information) of a first frame in the scene group; Scene information layering unit 104 for generating layered information for hierarchically managing the position information of scene change frames over the entirety, and a storage unit for storing / managing the position information and layered information of scene change frames. 105.

First, the scene change detecting section 502 will be described. The basic operation is the same as that of the first embodiment, but here, in addition to the position information (scene information) of the scene change frame, a flag indicating whether or not each frame constituting the moving image is a scene change frame is set. The output is different from the scene change detection unit 102 in the first embodiment.

Next, the scene group determining unit 503 will be described. In FIG. 6, a scene change frame detection unit 5
The flag indicating whether the frame is a scene change frame or not is output to the frame count unit 603 by connecting the switch 601 to the lower side if the frame is not a scene change frame. By connecting 601 to the upper side, it is sent to the scene group determination unit 602.

The frame count unit 603 counts the number of non-scene change frames from the immediately preceding scene change frame, and notifies the count value to the scene group determination unit 602 when the next scene change frame comes.
The scene group determination unit 602 includes a frame count unit 603
If the count value (the number of non-scene-change frames) notified from is greater than or equal to a predetermined threshold, the input second scene-change frame is set as the first frame of a new scene group, and its position information (scene group information) Is output.
After that, the count value of the frame counting unit 603 is reset to zero.

Next, the processing of the scene group determining unit 503 will be described. FIG. 7 shows frames arranged in chronological order, and the frames (F1, F2, F3, F4 and F
5) indicates a scene change frame detected by the scene change frame detection unit 502.

Here, scene 1 from frame F1 to immediately before frame F2, scene 2 from frame F2 to immediately before frame F3, scene 3 from frame F3 to immediately before frame F4, and frame F4 to immediately before frame F5. From scene F5 to immediately before the next scene change frame (not shown) as scene 5. The threshold used by the scene group determination unit 602 is 12 frames.

FIG. 8 is a graph showing the operation of the scene group determining unit 602 and the frame counting unit 603, with the horizontal axis representing time and the vertical axis representing frame count values. The solid line in the graph represents the count of the number of non-scene change frames in each of the scenes 1 to 5 calculated by the frame counting unit 603, and the broken line in the graph represents the frame used in the scene group determination unit 602. This represents a numerical threshold (12 frames).

In the frames F1, F2, and F5, since the count value of the non-scene change frame exceeds a predetermined threshold value, the scene group determination unit 602 determines that the frame is the first frame of a new scene group.
In frames F3 and F4, the threshold is less than the threshold, so that it is not determined to be the first frame of a new scene group.

Here, the count of the number of non-scene change frames is continuously counted even after exceeding a predetermined threshold. For example, a flag indicating that the count value has exceeded the predetermined threshold is provided, and When the value exceeds a predetermined threshold, the operation of resetting the count and turning off the count at the same time may be performed so that the count of the non-scene change frames is not performed.

As a result, as shown in FIG. 7, scene 1 is scene group 1, scenes 2 to 4 are scene group 2, and scene 5 is scene group 3, and frame F
1, the frame F2, and the frame F5 are set as the first frames of each scene group, and the position information of these scene change frames is output as scene group information.

By appropriately changing the threshold value in accordance with the type / genre of the video image, a more appropriate scene group can be created. Based on the position information of the scene change frame output by the scene change frame detection unit 502 and the position information of the first frame in the scene group output by the scene group determination unit 503, the hierarchy information is generated by the scene information hierarchy unit 104. Is done. This hierarchical information is sent to the storage unit 105 and stored as moving image scene management information.

[0056]

The moving image scene information management apparatus according to the first aspect of the present invention has the above-described configuration, so that a plurality of scene change frames can be detected in a short time. Scenes can be grouped into scene groups, and the position information of scene change frames is hierarchically managed, making it easy to grasp the entire moving image, and searching, editing, and displaying moving images based on scenes. Can be performed efficiently.

The moving picture scene information management apparatus according to the second aspect of the present invention determines the inter-frame distance between two temporally adjacent first and second scene change frames. Calculating, and when the inter-frame distance is larger than a predetermined threshold, the first scene starting from the first scene change frame and the second scene starting from the second scene change frame are included in different scene groups. And outputting the position information of the first scene change frame and the second scene change frame that are later in time as the first frame of the new scene group, and that the inter-frame distance exceeds a predetermined threshold. When it is small, the first scene and the second scene are included in the same scene group, so that the camera can be switched. When a large number of scene change frames are searched in a short period of time in a video in which change frequently occurs or a video in which scenes change rapidly, scenes can be combined into a scene group with a simple configuration, and the entire moving image can be combined. It becomes easy to grasp.

The moving picture scene information management apparatus according to the third aspect of the present invention determines whether the first scene and the second scene are included in different scene groups or the same scene group. The threshold value for this is made a variable value, so that an appropriate scene group can be created according to the type / genre of the video.

Since the moving picture scene information management apparatus according to the fourth aspect of the present invention has the above-described configuration, even in a video in which a large number of scene change frames are detected in a short time, a plurality of scene change frames can be used. Can be grouped into scene groups, and the position information of scene change frames is hierarchically managed, so that the entire moving image can be easily grasped.
Display and the like can be performed efficiently.

According to a fifth aspect of the present invention, there is provided a moving image scene information management apparatus comprising: a first scene change frame and a second scene change frame that are temporally adjacent to each other based on a flag; The number of non-scene change frames during the period is counted, and if the counted number of non-scene change frames is larger than a predetermined threshold, the first
It is assumed that the first scene starting from the scene change frame and the second scene starting from the second scene change frame are included in different scene groups, and the first scene change frame and the second scene change frame The position information of the first scene and the second scene are output when the number of non-scene change frames counted is smaller than a predetermined threshold. By including scenes in the same scene group, in a video where camera switching frequently occurs or in a video where scene switching is severe, a large number of scene change frames are searched in a short time. In addition, scenes can be grouped into scene groups with a simple configuration, and the entire moving image can be easily grasped.

The moving picture scene information management device according to the present invention determines whether the first scene and the second scene are included in different scene groups or the same scene group. The threshold value for this is made a variable value, so that an appropriate scene group can be created according to the type / genre of the video.

A moving image scene information management apparatus according to a seventh aspect of the present invention provides a moving image scene information management apparatus for generating a moving image based on position information of a scene change frame over the entire moving image and position information of a first frame in a scene group. By representing and managing the included scenes in a tree structure, it is possible to efficiently search and edit moving images based on the scenes.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a moving image scene information management device according to a first embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of a scene group determination unit in the moving image scene information management device according to the first embodiment of the present invention.

FIG. 3 is a diagram for explaining an operation of a scene group determination unit in the moving image scene information management device according to the first embodiment of the present invention.

FIG. 4 is a diagram for explaining an operation of a scene information layering unit in the moving image scene information management device according to the first embodiment of the present invention.

FIG. 5 is a block diagram illustrating a configuration of a moving image scene information management device according to a second embodiment of the present invention.

FIG. 6 is a block diagram illustrating a configuration of a scene group determination unit in a moving image scene information management device according to a second embodiment of the present invention.

FIG. 7 is a diagram for explaining an operation of a scene group determination unit in the moving image scene information management device according to the second embodiment of the present invention.

FIG. 8 is a diagram for explaining an operation of a scene group determination unit in the moving image scene information management device according to the second embodiment of the present invention.

FIG. 9 is a block diagram showing a configuration of a conventional moving image scene information management device.

[Explanation of symbols]

 Reference Signs List 101 encoding parameter extraction unit 102 scene change frame detection unit 103 scene group determination unit 104 scene information layering unit 105 storage unit 201 scene information comparison unit 202 memory 502 scene change frame detection unit 503 scene group determination unit 601 switch 602 scene group determination Section 603 Frame count section

Claims (7)

[Claims] 1. A moving image scene information management device that detects a break in a scene included in a moving image and stores / manages position information of a first frame in each scene based on the detected break in the scene. Based on the difference information of the position information of the first frame in each scene, a scene group including one or more scenes
A scene group determining unit that determines one or more and outputs position information of a top frame in the scene group; and A moving image scene information management device comprising: a scene information layering means for generating layering information for hierarchically managing position information of a leading frame in each scene over the entire scene. 2. The moving image scene information management device according to claim 1, wherein the scene group determination unit determines a temporally earlier one of the first frames in two temporally adjacent scenes. Calculating the inter-frame distance between the first scene change frame and the second scene change frame, using the first scene change frame as the first scene change frame and the second later scene change frame as the second scene change frame; When the distance is greater than a predetermined threshold, a first scene starting from the first scene change frame and a second scene starting from the second scene change frame
Is determined to be included in a different scene group, and the position information is output with the second scene change frame as the first frame of a new scene group, and when the inter-frame distance is smaller than a predetermined threshold value Wherein the first scene and the second scene are determined to be included in the same scene group. 3. The moving picture scene information management device according to claim 2, wherein it is determined whether the first scene and the second scene are included in different scene groups or the same scene group. The moving image scene information management device is characterized in that the threshold value for performing the operation is a variable value. 4. A moving image scene information management device that detects a break in a scene included in a moving image and accumulates / manages position information of a first frame in each scene based on the detected break in the scene. Based on a flag indicating whether each frame over the entire moving image is the first frame in each scene,
A scene group determining unit that determines one or more scene groups including one or more scenes and outputs position information of a top frame in the scene group; position information of a top frame in each scene and a head in the scene group A moving image characterized by comprising scene information layering means for generating layered information for hierarchically managing the position information of the first frame in each scene over the entire moving image from frame position information. Image scene information management device. 5. The moving image scene information management device according to claim 4, wherein the scene group determining means determines a temporally earlier one of the first frames in two temporally adjacent scenes. A first scene change frame is set, and a later part in time is set as a second scene change frame, and a non-interaction between the first scene change frame and the second scene change frame is determined based on the flag. Counting the number of scene change frames, and starting from the first scene change frame and the second scene change frame when the counted number of non-scene change frames is greater than a predetermined threshold value The second scene change frame is determined to be included in a different scene group from the second scene, and the second scene change frame is determined. And it outputs the positional information as the first frame of Tana scene group, if the non-scene number change frames the count is less than a predetermined threshold value, and the first scene the second
A moving image scene information management apparatus that determines that a scene is included in the same scene group. 6. The moving image scene information management device according to claim 5, wherein it is determined whether the first scene and the second scene are included in different scene groups or the same scene group. The moving image scene information management device is characterized in that the threshold value for performing the operation is a variable value. 7. The moving image scene information management apparatus according to claim 1, wherein said scene information hierarchical means expresses a position information of a first frame in each scene in a tree structure and is hierarchical. A moving image scene information management device characterized in that the video scene information management device manages the scene information.