JP2000350165A - Moving picture recording and reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a moving picture recording and reproducing device that displays summarized information of contents of a recorded moving picture by using a representative picture of a scene preferred by a user. SOLUTION: The moving picture recording and reproducing device is provided with a video recording and reproducing section 110 that applies video recording and reproduction processing to a moving picture, a control section 120 that controls a video recording and reproducing section 110, a moving picture storage device 31 that stores the moving picture, and a control information storage section 130 that stores control information used by the control section 120. The moving picture recording and reproducing device divides a moving picture to be recorded for each change in scenes, selects a representative image from each of the divided scenes, and the importance of each scene is discriminated on the basis of a type of user entry operation, and the device displays a representative image of a scene with high importance as image summarized information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving picture recording and reproducing apparatus such as a video player and a digital video disc player, and more particularly to a moving picture recording and reproducing apparatus for displaying summary information of a recorded moving picture.

[0002]

2. Description of the Related Art With the increase in capacity of a medium for storing moving images and the like, a recording and reproducing apparatus for recording and reproducing moving images has been developed.
Now you can record a lot of long videos. For this reason, it is difficult for the user of the recording / reproducing apparatus to grasp the contents of all the images recorded on the recording / reproducing apparatus. Therefore, the user needs a great deal of effort to search for a desired moving image from a large number of images stored in the recording / reproducing apparatus. In order to reduce this effort, there is a recording / reproducing apparatus having a function of displaying stored summary information of a moving image. The user can easily search for a desired moving image by obtaining the summary information of the stored images, and can also save and manage the stored moving images, for example, when deleting unnecessary moving images. It can be easily performed.

As a method of displaying such summary information of a moving image, there is a method of selecting and displaying a specific representative screen (hereinafter, referred to as a "moving image representative screen") from stored moving images. In this method, at the time of recording, a moving image is divided into a plurality of scenes, a representative screen representing the contents of each scene (hereinafter, referred to as a “scene representative screen”) is selected, and the importance of each scene is indicated by attribute information of the scene. (Hereinafter, referred to as “scene attribute”), and a scene representative screen of a scene with high importance is displayed as summary information of a moving image. As a method of automatically dividing a moving image into scenes, a change in the code amount between frames of a continuous moving image is monitored, and a frame whose change is equal to or more than a predetermined threshold value is determined as a scene change frame, There is a method of dividing the moving image for each frame of a scene change (JP-A-6-133305).

As a method of selecting a scene representative screen, there is a method of selecting a screen representative of the scene based on image information and audio information in the scene (Japanese Patent Laid-Open No. 10-1998).
32773). For example, in the scene, a frame in which the change of the luminance signal included in the image information is the largest and the sound intensity is the largest is selected as the scene representative screen of the scene.

As a method of determining the importance of a scene, there is a method of determining the importance of a scene based on image characteristics such as an average value of a luminance signal, an average value of a sound intensity, and a duration in the scene ( JP-A-10-32773). In this method, the most impressive scene, that is, a scene having a high average value of the luminance signal and the average value of the sound intensity and a long duration, is determined to be the most impressive scene.

As a method of determining the importance of a scene, a scene representative screen is used as a thumbnail image, and the number of times that a scene corresponding to the thumbnail image is searched for is stored. There is also a method of judging the importance (Japanese Patent Laid-Open No. 8-44758).

[0007]

However, the summary information of a moving image determined by the above method does not always reflect the user's preference, and the importance of the scene is not always determined. Therefore, in many cases, the moving image representative screen displayed as the summary information is not the one remaining in the user's memory. For this reason, even if the user refers to the summary information, the content of the recorded moving image is not sufficiently displayed. Can not grasp.

[0008] Specifically, the above-described method of selecting a scene representative screen (Japanese Patent Laid-Open No. 10-32773) judges the importance of a scene based only on screen characteristics such as a change in a signal included in moving image information. Therefore, the preference of the user such as the viewing frequency is not reflected at all. In the method of determining the importance of a scene (Japanese Patent Application Laid-Open No. H8-44758), the importance of each scene is determined based on the frequency of cueing reproduction. In many cases, the scene is played back from a scene with some margin, that is, slightly before the favorite scene. In such a case, the scene determined to be important based on the cue playback frequency and the user's favorite scene Does not match.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and has been made in consideration of the above-described problems, and uses a representative image of a user's favorite scene to display moving image recording / reproducing which can display summary information of the contents of a recorded moving image. An apparatus is provided.

[0010]

According to a first aspect of the present invention, there is provided a moving image recording / reproducing apparatus, comprising:
A moving image recording / reproducing apparatus that records and reproduces a moving image, and that displays summary information of the recorded moving image using a screen included in the moving image. Recording / playback means for performing playback in a method having different playback speed, playback direction, and image precision; moving picture storage means for storing the moving picture; dividing the moving picture into a plurality of scenes; Scene detecting means for selecting a screen representative of each scene from among the screens to be reproduced, and corresponding to each of the above-described reproduction methods input by the user with respect to the moving image, and Control means for creating a playback history including the number of executions, and control information storage means for storing the playback history, the control means, based on the playback history, the user has high image accuracy, and frequently Based on the scene played There the priority of each scene determined, based on the priority ranking, in which shall select the screen representative of the scene to be displayed as the summary information.

According to a second aspect of the present invention, in the moving image recording / reproducing apparatus according to the first aspect, the control means executes each of the reproducing methods in which a user performs an input operation on a recorded moving image. The number of times is recorded, the number of times of execution is weighted according to the type of the reproducing method, the sum of each of the reproducing methods is calculated, and the priority of each scene is determined based on the total. Things.

According to a third aspect of the present invention, in the moving image recording / reproducing apparatus according to the second aspect, the control means assigns a weight in the calculation of the sum to a reproduction method having a low reproduction speed and a high reproduction speed. The reproduction is more important than the reproduction method, the reproduction in the forward direction is more important than the reproduction in the reverse direction, and the high-quality reproduction method is more important than the low-quality reproduction method.

[0013]

DESCRIPTION OF THE PREFERRED EMBODIMENTS (Embodiment 1)

Hereinafter, a moving image recording / reproducing apparatus according to an embodiment of the present invention will be described. FIG. 1 is a block diagram for explaining a moving image recording / reproducing apparatus according to the present embodiment, and shows a configuration of the apparatus. In the figure, 100
Is a moving image recording / reproducing apparatus. The moving image recording / reproducing apparatus 100 stores a recording / reproducing unit 110 for recording and reproducing a moving image, a control unit 120 for controlling each device, and a moving image. It comprises a moving image storage device 31 and a control information storage unit 130 for storing control information used by the control unit 120. The recording / playback unit 110 includes an image input device 13 for inputting a moving image, a recording device 14 for recording the input moving image in the moving image storage device 31, and a moving image storage device 31
And a display output device 11 for outputting a signal for displaying the reproduced moving image.

The control unit 120 divides a moving image into a plurality of scenes, selects a screen representing each scene from among the screens included in each of the divided scenes, and performs a user input operation. Control information input device 2 to accept
3 and a control device 21 for controlling each device via the control bus 140. The control information storage device 130 stores a scene attribute which is attribute information of each scene of a moving image to be recorded, and a moving image attribute storage device which stores a moving image attribute which is attribute information of each moving image to be recorded. 33
Consists of

The operation of the main moving picture recording / reproducing apparatus 100 will be described below. The moving image input signal 300 input to the moving image recording / reproducing apparatus 100 is a digital broadcast signal,
Although it is an analog broadcast signal or the like, a case where a digital broadcast signal is input will be described below. The digital broadcast signal converts moving picture, audio, and text information constituting a program into MPEG (Moving Picture Experts Group).
After being encoded by a compression technique such as the p) method, it is decomposed into fixed-length transport packets and modulated.

The digital broadcast signal is an input signal 300
The image input device 13 demodulates and corrects the input signal, restores the transport packet sequence (transport stream), and outputs it. The recording device 14 is controlled based on the control information output from the control device 21.
Only the transport packets to be recorded are extracted from the transport stream and recorded in the moving image storage device 31. At the same time, the recording device 14 also outputs a copy of the transport packet to the scene detection device 22.

The playback device 12 reads a transport stream of a moving image to be played back from the moving image storage device 31 based on the control information output from the control device 21 and decodes the read transport stream.
Generate a video signal and an audio signal. Display output device 1
1 performs signal conversion such as digital / analog conversion on the video signal and the audio signal, and outputs the signal as a television signal (output signal 301). The scene detection device 22 detects a scene to be divided by monitoring a scene change of a moving image to be recorded.

That is, the scene detecting device 22 decodes the transport stream output from the recording device 14,
The decoded frame is compared with the frame held before the current processing, that is, the frame at the time of the previous scene change. Specifically, the two frames are compared on a pixel-by-pixel basis to calculate the difference, and the sum of the differences is compared with a predetermined threshold value as a change amount. If the change is larger than the threshold, it is determined that the scene has changed. Such a method of detecting a scene change of a moving image is disclosed in
No. 4216.

Further, the scene detecting device 22 divides the moving image at every scene change, and selects a representative screen from each of the divided scenes. As a method of selecting a representative screen, there is a method of selecting the first frame of each scene, a method of selecting a frame having the highest audio intensity in each scene, and the like, and any method may be adopted. In this way, when the scene detection device 22 determines that a scene has changed, it notifies the control device 21 of the storage position of the scene in the moving image storage device 31 and the representative screen of the scene.

Next, the operation of the control device 21 will be described with reference to FIG. FIG. 3 is a flowchart for explaining the operation of the control device according to the first embodiment. Control device 2
1 monitors whether the control information input device 23 has received a new user input operation (step 201). If the control information input device 23 has received a new user input operation, the control information input device 23 responds to the operation type. The control procedure is executed (step 202). The type of user input operation includes recording start,
There are normal reproduction, slow reproduction, high-speed reproduction, reverse reproduction, stillness, reproduction end, and the like. Here, the case where the user input operation is recording start 41, various reproductions 43 to 47, menu display 49, and scene search 42 will be described. It will be described in order.

When the user input operation is the recording start 41, the control device 21 transmits the program to be recorded to the recording device 1
Notify 4. As a result, the recording device 14 starts up (step 204). Thereafter, the control device 21 records the storage location of each scene notified from the scene detection device 22 and the scene representative screen as scene attributes in the scene attribute storage device 32, and creates scene attributes (step 20).
5). Here, in the scene attribute, a reproduction history of each scene is recorded according to a user input operation, and the reproduction history is all in an initial state at the time of recording.

When the user input operation is any one of the normal reproduction 43, the slow reproduction 44, the high-speed reproduction 45, the reverse reproduction 46, and the stillness 47, the control device 21 refers to these various reproduction operations to perform reproduction. The playback device 12 is notified of the identification information of the target moving image and the playback method. As a result, the playback device 12 is activated (Step 206). Further, the control device 21 updates the reproduction history of the currently reproduced scene (step 207).

When the user input operation is the menu display 49, the control device 21 updates the moving image attribute (step 209). The moving image attribute represents an important scene or the like of the moving image, and the important scene has a higher importance among the divided scenes. The importance is determined based on the reproduction history. The scene attribute storage device 32 records the number of executions for each reproduction method as a reproduction history, and determines the importance of the scene by weighting according to each reproduction method. For example, since it is considered that the user sees the more detailed scenes of his / her favorite, the weight for each reproduction method is set to “reverse reproduction 59 <high-speed reproduction 58 <normal reproduction 5”.
7 <Slow playback 56 <Still playback 55>, calculate the sum of values obtained by multiplying the number of executions of each playback method by the weight for each scene, and determine the importance of the scene based on the result. I do. After updating the moving image attribute, the control device 2
1 creates a menu screen based on the moving image attributes (step 210). The menu screen displays a list of title information of recorded moving images. The title information includes, in addition to the last playback date and time, a moving image representative screen representing the moving image as summary information of the moving image content.
The summary information of the moving image may be a display of one moving image representative screen or a slide display of a scene representative screen of an important scene group.

If the user input operation is a scene search operation 42, the control device 21 executes a scene search process (step 203). That is, a thumbnail image is created from the scene representative screen of each scene of the recorded moving image, and a list of the thumbnail images is sent to the display output device 11. The user selects a desired scene from the displayed list of thumbnail images. Based on the selection, the control device 2
No. 2 performs normal reproduction from the storage position of the scene. The user can select a method for displaying the thumbnail images in a method corresponding to the order of appearance in the recorded moving image, or a method for displaying the thumbnail images based on the importance of the scene. As the number of scenes in a video increases,
It becomes difficult to select a desired image from the displayed thumbnail images. Therefore, in such a case,
Selecting a method for displaying thumbnail images based on the importance of the scene makes it easier to search for the scene.

FIG. 2 shows an example in which the scene detecting device divides a moving image stored in the moving image storage device into a plurality of scenes and selects a representative screen for each scene, as well as scene attributes and moving image attributes. It is a figure showing an example. In the figure,
The moving image storage device 31 stores a moving image 1a. The moving image 1a is divided into scenes 2a, 2b,... By the scene detecting device 22, and a representative screen 51a is set as a representative screen of the scene 2a. The representative screen 51b is selected as the representative screen. The scene attribute 50 records a scene name, a representative screen, a storage location, a reproduction history, and the like. Here, the storage location of the scene 2a in the moving image storage device 31 is address 7400, and the storage location of the scene 2b is address 0120. Further, the number of executions for each playback method, that is, for each still 55, slow 56, normal 57, high speed 58, and reverse playback 59 is recorded as a playback history 53 for each scene. At the time of video recording, playback history 5
3 are all in the initial state. In the figure, scene 2
The reproduction of a is normally performed once at 57 and once at high speed 58.
Scene 2b is played once with slow 56 and usually 3 with 57.
Times.

The moving image attribute 60 is updated based on the scene attribute 50. The reproduction history is evaluated by weighting according to each reproduction method. In the figure, the weight for each reproduction method is set to “reverse reproduction 59 <high speed 58 <normal 57 <slow 56
Since the setting is made in the order of <still 55>, the importance 54 of the scene 2b is higher than that of the scene 2a. This indicates that the scene 2b is reproduced in more detail and more frequently than the scene 2a. Therefore, in the moving image attribute 60, the scene 2b is selected as the important scene 62, and the moving image representative screen 6
In 3, the representative screen 51 b of the scene 2 b is selected.

When the user instructs the menu display 49, a moving image representative screen 51b is displayed on the menu screen as summary information of moving image contents in addition to the last reproduction date and time. On the other hand, when the user instructs the scene search operation 42, the scene representative screens 51a and 51b of the respective scenes 2a and 2b of the moving image 1a are displayed as thumbnail images. Select the desired scene.

As described above, according to the moving picture recording / reproducing apparatus according to the present embodiment, the recording / reproducing section 110 for recording and reproducing moving pictures, and the control section 120 for controlling the recording / reproducing section 110, , Moving image storage device 31 for storing moving images
And a control information storage unit 130 for storing control information used by the control unit 120. The control unit 120 divides a moving image to be recorded for each scene change, selects a representative screen from each of the divided scenes, Based on the operation type, the importance of each scene is determined, and a representative screen of a scene with high importance is displayed as image summary information. As a result, the contents of the recorded moving image can be easily understood, and the image search can be easily performed.

In the moving image recording / reproducing apparatus according to the present embodiment, the moving image to be recorded is divided based on scene changes, and the reproduction history is managed for each divided scene. Whether to divide the video with fineness can be freely set by a trade-off between the fineness of management of the playback history and the processing cost, and even if this is changed, the same effect as in the present embodiment can be obtained. Obtainable. For example, when managing the reproduction history in detail, the moving image may be divided in units of one frame. On the other hand, when it is desired to reduce the processing cost for managing the reproduction history, the moving image may be divided into several scenes as one unit.

Also, in the present embodiment, only the case where the input video signal is a digital broadcast signal has been described. However, the recording / reproducing apparatus according to the present embodiment employs an analog broadcast signal or RGB video signal. Even in the case of a signal or the like, a similar effect can be obtained.

[0032]

As described above, according to the moving picture recording / reproducing apparatus according to the first aspect of the present invention, the moving picture is recorded and reproduced based on the input operation of the user, and the recorded moving picture is recorded. A moving image recording / reproducing apparatus that expresses image summary information using a screen included in the moving image, and records a moving image, and
Recording / playback means for performing playback in various ways with different playback speeds, playback directions, and image precisions; moving picture storage means for storing the moving picture; dividing the moving picture into a plurality of scenes; And a scene detecting means for selecting a screen representative of each scene from among the screens included in each of the scenes. Control means for creating a reproduction history including the number of times of execution of the method, and control information storage means for storing the reproduction history, wherein the control means allows a user to obtain a high image accuracy and a high image accuracy based on the reproduction history. Since the priority of each scene is determined based on the scene reproduced at a frequency, and based on the priority, a screen representing the scene to be displayed as the summary information is selected.
The user can easily understand the contents of the recorded moving image based on the summary information reflecting his or her preference, and the search for the moving image becomes easy.

According to the present invention (claim 2), in the moving picture recording / reproducing apparatus according to claim 1, the control means controls the reproduction method in which a user performs an input operation on a recorded moving picture. The number of executions is recorded, the number of executions is weighted according to the type of reproduction method, the sum of each reproduction method is calculated, and the priority of each scene is determined based on the sum. Therefore, the user can easily understand the contents of the recorded moving image based on the summary information reflecting his or her preference, and the retrieval of the moving image becomes easy.

Further, according to the present invention (claim 3), in the moving picture recording / reproducing apparatus according to claim 2, the control means determines the weight in the calculation of the sum by using a reproduction method having a low reproduction speed. The playback method is more important than the fast playback method, the playback in the forward direction is more important than the playback in the reverse direction, and the high-quality playback method is more important than the low-quality playback method. The user can easily understand the contents of the recorded moving image on the basis of the summary information reflecting his / her preference, and can easily search for a moving image.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a moving image recording and reproducing apparatus according to Embodiment 1 of the present invention.

FIG. 2 illustrates an example of a case where a scene detection device divides a moving image stored in a moving image storage device 31 into a plurality of scenes and selects a representative screen for each scene, and an example of scene attributes and moving image attributes. FIG.

FIG. 3 is a flowchart for explaining an operation of the control device according to the first embodiment of the present invention.

[Description of Signs] 11 Display output device 12 Reproduction device 13 Image input device 14 Recording device 100 Moving image recording / reproduction device 110 Recording / reproduction unit 120 Control unit 130 Control information storage unit 31 Video storage device 32 Scene attribute storage device 33 Video attribute storage apparatus

Claims (3)

[Claims] 1. A moving image recording / reproducing apparatus that records and reproduces a moving image based on a user's input operation, and that displays summary information of the recorded moving image using a screen included in the moving image. Recording / reproducing means for recording a moving image and reproducing in various ways with different reproduction speeds, reproduction directions, and image precisions; moving image storage means for storing the moving image; Scene detection means for selecting a screen representative of each scene from among the screens included in each of the divided scenes; and Correspondingly, control means for creating a playback history including the number of executions of each playback method for each scene, and control information storage means for storing the playback history, wherein the control means is based on the playback history The user A priority of each scene is determined based on a scene reproduced with high accuracy and high frequency, and a screen representing the scene to be displayed as the summary information is selected based on the priority. A moving image recording / reproducing apparatus characterized by the above-mentioned. 2. The moving image recording / reproducing apparatus according to claim 1, wherein the control means records the number of executions of each of the reproduction methods input by a user on the recorded moving image, and Weighting according to the type of the reproduction method, calculating the sum for each of the reproduction methods, and determining the priority of each scene based on the sum. Playback device. 3. The moving image recording / reproducing apparatus according to claim 2, wherein the control means assigns a weight in the calculation of the total sum to:
The playback method with slow playback speed is more important than the playback method with fast playback speed, the playback in the forward direction is more important than the playback in the reverse direction, and the high-quality playback method is more important than the low-quality playback method. And a moving image recording / reproducing apparatus.