JPH10243351A - Video reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable video reproduction while detecting video features in a digital image containing a moving image and a sound, and automatically controlling reproducing speed corresponding to this video feature. SOLUTION: This reproducing device is provided with a signal separating means 1 for separating an inputted video signal into a moving image signal and an audio signal for displaying the desired image by performing the ordinary reproduction, fast forward reproduction and rewind reproduction of digital video signal containing the moving image signal and the audio signal, video feature extracting means 5 for extracting the feature of any one of moving image signal and audio signal separated by the signal separating means 1, and fast forward video reproducing means 10 for generating out the fast forward reproduced video signal while synchronizing the moving image signal and the audio signal while performing prescribed work processing to the video of scene, where the video feature exists, based on the video feature extracted by the video feature extracting means 5, at least.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a device for reproducing video such as a video tape recorder (VTR-Video Tape Recorder) or a DVD (Digital Versatile Disc) device, and more particularly to a device for reproducing moving images and sounds. The present invention relates to a video reproducing apparatus capable of extracting a recording characteristic of digitally recorded video information and controlling a reproduction speed of a moving image or an audio to match the characteristic.

[0002]

2. Description of the Related Art In general, video information including moving images and audio can be recorded on a recording medium such as a video tape or a DVD, and reproduced using a reproducing apparatus such as the VTR or the DVD apparatus. Is possible. In such a video playback apparatus, in addition to a playback mode at a normal playback speed, there are at least two modes: a fast-forward playback mode with a high-speed playback speed from at least double speed to several hundred times speed, and a fast-reverse playback mode with high-speed reverse rotation. Is usually provided.

In such a conventional video reproducing apparatus, it is general that in a fast-forward reproduction mode, no sound is produced and only a moving image is reproduced. Also, depending on the model, a fast forward playback mode of about double speed or about 3 times speed is set as a time saving mode. Only in this time saving mode, a moving image is played back at about twice or about 3 times speed, and audio is played for a predetermined time. For example, there has been proposed an apparatus that cuts a next predetermined time, for example, 3 seconds when reproduced for 3 seconds, and repeats this to reproduce only a sound in a jumping manner.

Further, in a conventional video reproducing apparatus, when reproducing a video in the fast-forward reproduction mode, a moving image is generally reproduced at a constant speed preset at the time of designing the apparatus. Depending on the model, it is proposed to make the playback speed variable, but as a method, the playback speed is set with a speed setting dial etc., and the searcher's preference to the extent that the video scene etc. to be searched can be searched. The playback speed was slowed down, and the playback speed was adjusted manually only.

[0005]

However, in the conventional video reproducing apparatus described above, since the fast-forward reproduction is performed with no sound, it is difficult to grasp the contents of the video. When playing audio in synchronization with the video, it was not possible to know what the person in the video was saying because the playback audio was too fast. Also, in a reproducing apparatus that cuts out audio at a reproduction speed of about double speed or triple speed and partially reproduces the audio, if only a significant audio portion is discretely reproduced, a significant audio portion is not reproduced yet. When an insignificant audio part is reproduced irregularly, the contents may not be completely understood.

In addition, if the fast-forward function is used to reproduce a video at a constant speed and at a certain high speed, there is a problem that visibility is poor in a fast-moving portion and it is difficult to effectively grasp the contents. In a video playback device that changes the playback speed as needed by manual operation, the searcher must constantly look at the screen and search for the search scene, and although the responsiveness improves, the playback speed is set variably. However, there was a trouble that the search had to be continued.

SUMMARY OF THE INVENTION In view of the above problems, the present invention detects video features such as a sound portion of a sound and a portion where a moving image greatly changes in a digital video scene including a moving image and a sound, and responds to the video feature. It is an object of the present invention to provide a video reproducing apparatus capable of reproducing a video while automatically adjusting a reproducing speed.

[0008]

According to a first aspect of the present invention, there is provided a video reproducing apparatus for performing a normal reproduction, a fast forward reproduction, and a reverse reproduction of a digital video signal including a moving image signal and an audio signal. In a video reproducing apparatus for displaying a desired video according to the following, a signal separating means for separating the input digital video signal into a moving image signal and an audio signal, and a moving image signal and an audio signal separated by the signal separating means. A video feature extraction unit for extracting at least one of the features, and the video signal while performing a predetermined process on a video of a scene where the video feature exists based on the video feature extracted by the video feature extraction unit. Fast-forward video playback means for generating and outputting a fast-forward playback video signal while synchronizing with one of the audio signals. It is set to.

[0009] According to a second aspect of the present invention, there is provided a video reproducing apparatus.
In the video reproduction device described in the above, the video feature extraction means, by the audio feature extraction means to extract a predetermined range from the start time to the end time of the silent part in the audio signal separated by the signal separation means as audio features The fast-forward video playback means, wherein the fast-forward video playback means plays back the video signal separated by the signal separation means at a predetermined speed and outputs a fast-forward video signal, and the audio feature extraction means Audio playback means for processing the audio playback signal including at least the voiced portion by removing the extracted silent portion and synchronizing the audio playback signal with the playback speed of the fast-forward moving image signal to output a synchronized audio signal; Synthesizing means for synthesizing the synchronous audio signal and the fast-forward moving image signal and outputting a fast-forward playback video signal, That.

According to a third aspect of the present invention, in the video reproducing apparatus according to the second aspect, the audio reproducing unit removes a silent portion extracted by the audio feature extracting unit to generate a sound portion. Signal processing means for making
And a synchronizing means for synchronizing the processed audio reproduction signal with the reproduction speed of the fast-forward moving image signal reproduced by the moving image reproducing means.

According to a fourth aspect of the present invention, in the video reproducing apparatus according to the third aspect, the audio reproducing means reproduces the audio reproducing signal which is currently reproduced by the processing means. It is characterized in that it is configured to stop and reproduce the next processed audio reproduction signal in synchronization with the reproduction speed of the fast-forward moving image signal.

According to a fifth aspect of the present invention, in the video reproducing apparatus according to the third aspect, the audio reproducing means reproduces a reproduced sound by the audio reproducing signal which is currently reproduced by the processing means. And gradually reduce the volume of the reproduced sound by the next extracted audio reproduction signal while superimposing it on the next processed audio reproduction signal. I have.

According to a sixth aspect of the present invention, in the video reproducing apparatus according to the third aspect, the audio reproducing means is arranged so as to be temporally opposite to a direction in which the fast-forward reproduced video signal is photographed. When reproduced, the audio reproduction signal processed in synchronization with the reproduced video is reproduced in the forward direction from the beginning.

According to a seventh aspect of the present invention, in the video reproducing apparatus according to the third aspect, the synchronization means synchronizes with a reproduction speed of the audio reproduction signal reproduced by the audio reproduction means. It is characterized in that a reproduction speed of a fast-forward reproduced moving image signal reproduced by the moving image reproducing means is determined and output to the synthesizing means.

Further, the video reproducing apparatus according to claim 8 is
2. The video reproducing apparatus according to claim 1, wherein the video feature extracting unit divides the moving image signal separated by the signal separating unit into a plurality of still image frames, and the frame dividing unit. And an inter-frame change amount detecting means for detecting an inter-frame change amount between the frames divided by the moving image feature extracting means, and the fast-forward video reproducing means is detected by the inter-frame change amount detecting means. It is characterized by comprising moving picture reproducing means for changing the exposure feed rate of the frame in accordance with the amount of change between the frames, thereby changing the reproduction speed of the moving picture signal and reproducing the fast-forward reproduction video signal. .

According to a ninth aspect of the present invention, in the video reproducing apparatus of the eighth aspect, the inter-frame change amount detecting means determines a change amount of motion from the compression-encoded video data. It is characterized by being constituted.

Further, according to a tenth aspect of the present invention, in the video reproducing apparatus according to the eighth aspect, the moving image reproducing means is configured such that the moving image reproducing means is designated as a frame in the moving image divided by the frame dividing means. A similarity detecting means for obtaining a similarity between the image and a similarity between the detected frame and the reference image, wherein the higher the similarity, the lower the reproduction speed and the lower the similarity, the higher the reproduction speed. Speed adjusting means for adjusting a reproducing speed so as to reproduce, and a moving image reproducing speed for changing a fast-forward reproducing speed of the moving image signal sent from the frame dividing means based on the reproducing speed adjusted by the speed adjusting means. And changing means.

Further, the video reproducing apparatus according to claim 11 is
9. The video reproducing apparatus according to claim 8, wherein said inter-frame change amount detecting means includes an acceleration detecting means for obtaining an acceleration which is an amount by which a change amount in a moving image signal changes.

Further, the video reproducing apparatus according to claim 12 is
9. The video reproducing apparatus according to claim 8, wherein the inter-frame change amount detecting unit separates a background and a moving object from the moving image, and a background / motion separating unit. Background / motion relative speed detecting means for obtaining a change amount of a relative speed with respect to a certain object.

[0020]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of a video reproducing apparatus according to the present invention will be described below in detail with reference to the accompanying drawings. First, a video reproducing apparatus according to a first embodiment showing the most basic concept of the present invention will be described with reference to FIG. In FIG. 1, a video reproducing apparatus includes a signal separating unit 1 for inputting a digital video signal including a moving image signal and an audio signal and separating the digital video signal into a moving image signal and an audio signal. Video feature extraction means 5 for extracting at least one video feature of a moving image signal and an audio signal separated by the above, and the video feature exists based on the video feature extracted by the video feature extraction means 5 A fast-forward video playback unit 10 for generating and outputting a fast-forward playback video signal while synchronizing the moving image signal and the audio signal while performing predetermined processing on a video of a scene.

In this specification, a video is defined and used as a composite of a moving image and a sound.
A video feature is a video feature that is a part that is significantly different from other parts due to a sudden change in the moving image, for example, and a part where the sound is in a silent state or a sound state or a mountain in the video, for example. It is defined as including both a voice feature, which is a part where cheers and the like have rapidly increased.
Therefore, the video feature extraction unit 5 includes an audio feature extraction unit 6 that extracts a predetermined range from a start time to an end time of a silent part in the audio signal separated by the signal separation unit 1 as an audio feature, Separation means 1
And a moving image feature extraction unit 6 for dividing the moving image signal separated into a plurality of still images into frames and detecting a change amount between the divided frames.

When the moving image feature extracting means 6 supplies moving image characteristics, the fast-forward image reproducing means 10 changes the reproduction speed and the like based on the moving image characteristics to perform fast-forward reproduction of moving images. When the audio feature extracting means 7 supplies the audio feature, the audio signal is subjected to predetermined processing based on the audio feature, and the audio signal is processed by a fast-forward reproduction signal of the moving image output by the moving image reproducing means 11. An audio playback unit 12 that outputs an audio playback signal in synchronization with the audio playback unit 12;
Synthesizing means 18 for synthesizing the fast-forward reproduced moving image and the reproduced sound.

As described above, the basic concept of the present invention is to extract features of a video and use this feature at the time of fast-forward playback of the video. Therefore, the second embodiment for extracting audio features as video features The video playback device according to the above will be described. In FIG. 2, the video feature extraction means 5 comprises an audio feature extraction means 7 for extracting audio features in the audio signal separated by the signal separation means 1, and the audio reproduction constituting the fast-forward video reproduction means 10. Means 12 for removing an extracted silent part as an audio feature to process an audio reproduction signal including at least a sound part, and a fast-forward moving image signal output from the moving image reproducing means 11 And a synchronizing means 14 for synchronizing the audio reproduction signal with the reproduction speed and outputting a synchronous audio signal.

A video reproducing apparatus according to a third embodiment for extracting a moving image feature as a video feature will be described with reference to FIG. The video feature extracting unit 5 includes: a frame dividing unit 20 that divides the moving image signal separated by the signal separating unit 1 into a plurality of still image frames; The moving image feature extracting means 6 includes an inter-frame change amount detecting means 21 for detecting a change amount. The inter-frame change amount detecting means 21 may be configured to calculate the change amount of the motion from the compression-encoded video data, or may detect the acceleration which is the amount by which the change amount in the moving image signal changes. Means 22 may be provided. The inter-frame change amount detecting means 21
Is a background / motion separating means (not shown) for separating a background and a moving object from the moving image, and a background / motion for calculating a relative speed change amount between the separated background and the moving object. And an inter-movement relative speed detecting means 23.

The fast-forward video reproducing means 10 changes the exposure speed of the frame in accordance with the amount of change between the frames detected by the inter-frame change amount detecting means 21 to thereby reproduce the moving image signal. And a moving image reproducing means 11 for reproducing a fast-forward reproduction video signal by changing the frame rate. The moving image reproducing means 11 is provided with a frame in the moving image divided by the frame dividing means 20 and a designated reference image. A similarity detecting means 25 for calculating the similarity between the frames, and based on the similarity between the detected frame and the reference image, the higher the similarity, the slower the reproduction speed and the lower the similarity, the higher the reproduction speed. Adjusting means 26 for adjusting the playback speed as described above and the frame dividing means 20 based on the playback speed adjusted by the speed adjusting means 26. Is a moving image reproduction speed changing unit 27 for changing the fast-forward playback speed of the moving image signal has been provided with a.

The video reproducing apparatus according to the fourth embodiment, in which the video reproducing apparatus according to the first to third embodiments is further embodied in audio feature extraction, will be described in detail with reference to FIGS. FIG. 4 is a block diagram showing a system configuration of the video reproducing apparatus according to the fourth embodiment.
In FIG. 4, the basic system of the video reproducing apparatus analyzes a moving image database 31 for storing moving image data and an audio portion of the moving image data stored in the moving image database 31 to divide a predetermined range of sound. Voice analysis unit 32
And a moving image analyzing unit 33 for generating a correspondence between a sound and a moving image from the result of the sound analyzing unit 32 as table information.
A sound reproducing unit 34 and a moving image reproducing unit 35 for synchronizing and reproducing the divided sound and the moving image, an input unit 36 for receiving a user operation, and a control unit 37 for controlling all devices. And a display unit 38 for displaying video data and sounding.

The segmentation of speech as speech feature extraction is shown in FIG.
As shown in the figure, the start points t2 and t4 and the end point t3 of the silent part are obtained by looking at the power of the voice (the volume of the voice).
And t5 are detected. The sound portion 30 determined to have sound is divided and the information is stored in the moving image database 3.
1 is stored. At the same time as the sound is divided, the moving image analyzing unit 33 calculates the correspondence between the sound and the video frame in which the sound exists, and stores the information as a correspondence table in the moving image database
1 is stored. When the user is watching the video using the display unit 38, the input unit 36 (keyboard, shuttle,
The video can be fast-forwarded by an instruction from a button, a remote controller, or the like.

Next, an example of a method of reproducing a sound while fast-forwarding an image will be described. As shown in FIG. 6, when a video in a certain section is reproduced at 2 × speed, it is usually necessary to reproduce audio at 2 × speed. However, if there are, for example, three voiced portions 30 and the same number of silent portions 39 in which a voice is emitted in a frame in which fast-forwarding is performed, the voiceless portions 39 are omitted and the voice is output as shown in FIG. Can shrink. However, if there are not enough silences 39, the voices will overlap as shown in FIG. Therefore, the timing for starting the reproduction of the divided audio in the fast-forward reproduction is calculated using the correspondence table of the video frames corresponding to the start points of the divided predetermined range of the audio created in the moving image analysis unit 33.

Next, reproduction of video and audio is started simultaneously using the control unit 37. At this time, the video is played back at double speed, and the audio starts removing the silence at the same speed and starts playing back the first divided audio. At this time, when it is time to reproduce the second divided sound while holding the correspondence table, the control unit 37 terminates reproduction of the first divided sound and starts reproduction of the second sound. Thereafter, similarly, when the timing to reproduce the third divided sound comes, the second divided sound is terminated and the third divided sound is reproduced. By repeating the reproduction of the fifth divided sound and the discontinuation of the fourth divided sound halfway one after another, it becomes possible to reproduce the audible sound.
If there is a lot of silence 39 and it is not necessary to terminate it,
The audio reproduction unit 34 does not reproduce the audio until the timing of the next divided audio without aborting the divided audio.

Further, since the sound may be interrupted and difficult to hear, by selecting and setting another mode using the input unit 36 (for example, a mouse), the next divided sound is started without completely stopping the sound. Sometimes, the previous sound can be gradually reduced and the sound can be superimposed and reproduced. By letting the user hear two sounds at the same time, the spoken word or other sound can be heard continuously. The human auditory sense can recognize two voices at the same time because the smaller voice is the previous split voice and the voice that is heard normally is the newly started voice. . The tendency to reduce the sound can be controlled by a parameter set in advance from the input unit 36, so that a sound that suddenly decreases or a sound that hardly decreases can be selected.

As shown in FIG. 7, in the case of sound reproduction in the forward direction 44, the heads of the sound portions 41, 42 and 43 of the divided sound are reproduced in synchronization with the reproduction speed 45 of the fast-forward video frame. Also, as shown in FIG.
In the case of No. 4, the video frame is reproduced in the reverse direction. However, using the correspondence table of the divided audio and video, the audio end point and the audio start point of the divided sound parts 51, 52 and 53 are used. The sound is reproduced in the forward direction 54 by exchanging the correspondence relationship with the video frame corresponding to. As a result, the video and the audio are substantially synchronized, and the reproduction can be performed to the extent that the audio can be sufficiently clearly understood. The playback method is similar to that when playing back in the forward direction, and when it comes to the time to play back the next divided sound, depending on the mode, select whether to cut off the previous sound or reduce it, and play the next sound .

As shown in FIG. 9, when a mode is selected in the input unit 36 and the video is reproduced with priority given to the audio, the video frames corresponding to the head and the end of the audio of the divided sound parts 61, 62 and 63 are added. Silence 64, 6 before or after
The video frames corresponding to 5, 66 and 67 are selected from the correspondence table, and the video is fast-forward reproduced in synchronization with the divided audio. For example, although the video frames F1 to F20 correspond to the audio 61, the video frames of frames F21 to F30 corresponding to the silence section 65 immediately thereafter are also fast forwarded within the audio reproduction time to reproduce the video. As a result, the voice can be heard clearly, and the video can be confirmed by fast-forwarding at about twice the speed.

Next, a description will be given of a video reproducing apparatus according to a fifth embodiment in which video characteristics are extracted from moving image characteristics and the speed of fast-forwarding is controlled by the degree of screen change, as in the third embodiment. FIG. 7 is a block diagram illustrating a system configuration of a video playback device according to the fifth embodiment. The system includes a moving image database 71 for storing moving images, a moving image analyzing unit 72 for analyzing a moving image by comparing a change between frames of the moving image with a reference image, and a moving image database based on a moving image analysis result. A control unit 75 for selecting a moving image frame from 71 and synchronously reproducing the same, a video reproducing unit 76 for reproducing the selected moving image, and an input unit 77 for selecting a moving image reproducing mode or designating a reference image And a display unit 78 for displaying a moving image. The moving image analyzing unit 72 includes a reference image storage unit 73 for storing a change between frames of the moving image and a given reference image, and a moving image A video comparing unit 74 for comparing and calculating the frame and the reference image;
It has.

When the mode is designated from the input unit 77, a fast-forward instruction for video reproduction is input, and the moving image database 7
The moving image frame is transferred to the moving image analysis unit 72 from one desired storage location, and the amount of change in the movement of the video frame before and after is calculated. For example, as shown in FIG. 11, a video frame 81 in which sumo wrestlers are present and a video frame at the next moment are compared. When the next frame is the attended moving image frame 82, the change amount of the video is small, and the moving image frame 83 changes slightly when the approach is started. Further, if the scene is switched to the moving image frame 84 in the action table of the electric bulletin board, the change amount between the two video frames becomes large. As the amount of change, the sum of the amount of change in luminance or the amount of change in hue of each pixel of the moving image frame is calculated, and the moving image is represented by the Moving Picture Experts Group (MPEG).
-If the image is compressed by the encoding method standardized by an organization that performs the standardization work of the color moving image storage encoding method-), the sum of the lengths of the motion compensation vectors can be used as the amount of change. Information on whether the amount of change is large or small is sent to the control unit 75. If the amount of change is large, the reproduction is slowed down, and if the amount of change is small, the reproduction speed is increased. The command is sent to the moving image reproducing unit 76, the corresponding data is obtained from the moving image database 71, and the display unit 78
Is displayed on the screen.

FIG. 12 shows an example in which the reproduction speed is controlled in accordance with the amount of change. In the example shown in FIG. 12, the reproduction speed is inverted with respect to the amount of change in the moving image shown in the uppermost part, as shown in the middle part. The lower stage shows an example in which the speed is changed with a stepwise threshold. Various methods of setting the reproduction speed to be changed according to the change amount can be considered. For example, there is a method of controlling the reproducing speed in inverse proportion to the amount of change or controlling the speed so that only the stationary portion is reproduced with a fixed length. Also,
Playback speed may be extremely slow in extremely rapidly changing parts, or extremely fast in parts with extremely little change. It is also conceivable to perform the method.

In response to an instruction from the input unit 77, a still frame of a moving image is called from the moving image database 71 and displayed on the display unit 78. When a reference image is designated using, for example, a mouse of the input unit 77, the reference image is
2 and stored in the reference image storage unit 73. The reproduction of the moving image is started according to the mode selected by the input unit 77. The video frame read from the moving image database 71 is sent to the moving image analysis unit 72 and compared with the reference image in the reference image storage unit 73. The degree of similarity is calculated by the frame comparison unit 74 of the moving image analysis unit 72. For example, the similarity is represented by the reciprocal of the change amount of the moving image described above. FIG. 13 is a diagram showing the change in the similarity. The information is sent to the control unit 75, and the reproduction speed is controlled based on the information. If the similarity is high, the reproduction is slow, and if the similarity is low, the reproduction is slow. Control playback early. The control of the reproduction speed is shown in FIG. If the similarity is lower than a certain threshold, the video may not be reproduced. If the non-playback portion of the video is interpreted as having an infinitely high playback speed, the playback will skip over time.

When the amount of change of the moving image shown in FIG. 14 is obtained, the acceleration can be obtained. This includes a portion where a moving image changes from a fast motion to a slow motion or from a slow motion to a fast motion, and includes a portion where an image suddenly changes like a cut. By controlling the reproduction speed in accordance with such acceleration, it is possible to pick up a portion where the contents of the video are switched. In FIG. 14, the reproduction speed is controlled by the absolute value of the acceleration. When the acceleration is 0, the reproduction speed becomes infinite and the video frame is skipped.

In the above description, a method of controlling the reproduction speed of a moving image according to the amount of change in the entire moving image has been described. However, since the moving image includes the subject and the background, the background and the subject are controlled. If they are moving differently,
It is possible to separate them. As one of the methods, a background and a subject can be separated by obtaining an amount representing a change in movement of a small area called an optical flow and clustering the movement (for example, COMPUTER GRA).
PHICS AND IMAGE PROCESSING, pp.301-315, VOL.9,1979
Such). By determining the amount of change in each of the separated areas, the playback speed is slower as the difference between the changes is larger, and the playback speed is larger as the difference is smaller, so that it is possible to view the image in detail only when the subject is moving violently Become.

[0039]

According to the present invention, the voice can be heard even when fast-forwarding, the contents can be understood more clearly, and the contents of the video can be grasped in a short time. In addition, since the reproduction speed is controlled in accordance with a change in the video, the reproduction is performed quickly in a scene where there is no movement in sports or the like, and a temporally redundant scene can be quickly viewed. In addition, in a scene where the movement is intense, the reproduction speed becomes slow, so that it is possible to carefully watch the video.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a video playback device according to a first embodiment, which is a basic concept of the present invention.

FIG. 2 is a block diagram showing a video playback device according to a second embodiment, which is a basic concept of audio feature extraction.

FIG. 3 is a block diagram showing a video playback device according to a third embodiment, which is a basic concept of moving image feature extraction.

FIG. 4 is a block diagram illustrating a system configuration of a video playback device according to a fourth embodiment of the present invention.

FIG. 5 is a characteristic diagram illustrating audio division as a video feature extraction in a fourth embodiment.

FIG. 6 is a characteristic diagram illustrating an example in which a silent portion is removed from a divided voice according to a fourth embodiment and voices are combined in synchronization with double fast-forward.

FIG. 7 is a characteristic diagram showing an example of sound reproduction at the time of fast forward in the fourth embodiment.

FIG. 8 is a characteristic diagram showing an example of audio reproduction at the time of fast-forwarding in the reverse direction in the fourth embodiment.

FIG. 9A is a characteristic diagram and FIG. 9B is a chart showing an example of reproducing a moving image in synchronization with audio in the fourth embodiment.

FIG. 10 is a block diagram illustrating a system configuration of a video playback device according to a fifth embodiment of the present invention.

FIG. 11 is an explanatory diagram showing an example of a change in front and rear frames in the fifth embodiment.

FIG. 12 is a characteristic diagram showing a relationship between a change amount of a moving image and a reproduction speed in a fifth embodiment.

FIG. 13 is a characteristic diagram illustrating a relationship between a similarity to a reference image and a reproduction speed according to the fifth embodiment.

FIG. 14 is a characteristic diagram showing a relationship between acceleration and reproduction speed in a fifth embodiment.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 signal separation means 5 video feature extraction means 6 video feature extraction means 7 audio feature extraction means 10 fast-forward video playback means 11 moving image playback means 12 audio playback means 13 audio signal processing means 14 synchronization means 18 synthesis means 20 frame division means 21 frames Inter-variation detecting means 25 similarity detecting means 26 speed adjusting means 27 moving image reproducing speed changing means

 ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Susumu Kubota 1 Toshiba R & D Center, Komukai Toshiba-cho, Saiwai-ku, Kawasaki-shi, Kanagawa

Claims (12)

[Claims] 1. A video reproducing apparatus for displaying a desired video by reproducing a digital video signal including a moving image signal and an audio signal in a normal reproduction, a fast forward reproduction, and a reverse reproduction. A signal separating unit that separates into an image signal and an audio signal, a video feature extracting unit that extracts at least one of a moving image signal and an audio signal separated by the signal separating unit, and the video feature extracting unit. Based on the extracted video features, a fast-forward playback video signal is generated while synchronizing with one of the moving image signal and the audio signal while performing predetermined processing on a video of a scene where the video feature exists. And a fast-forward video reproducing means for outputting the video. 2. The image feature extracting means comprises an audio feature extracting means for extracting a predetermined range from a start point to an end point of a silent part in the audio signal separated by the signal separating means as an audio feature. The fast-forward video playback unit is configured to play back the video signal separated by the signal separation unit at a predetermined speed and output a fast-forward video signal, and the audio feature extraction unit extracts the video signal. A sound reproducing means for processing a sound reproduction signal including at least a sound part by removing a silent part and synchronizing the sound reproduction signal with a reproduction speed of the fast-forward moving image signal to output a synchronous sound signal; 2. A video signal as claimed in claim 1, further comprising: a synthesizing means for synthesizing a signal and said fast-forward moving image signal to output a fast-forward playback video signal. Image reproduction device. 3. An audio signal processing means for removing a silent part extracted by the audio feature extraction means to make a sound part continuous and an audio signal processing means for converting the processed audio reproduction signal into a moving image reproducing means. 3. A video reproducing apparatus according to claim 2, further comprising: a synchronizing means for synchronizing with a reproduction speed of the fast-forward moving image signal reproduced by the control unit. 4. The audio reproduction means, wherein the reproduction of the audio reproduction signal which is processed by the processing means and which is currently being reproduced is terminated, and the next processed audio reproduction signal is reproduced at a reproduction speed of the fast-forward moving image signal. The video reproducing apparatus according to claim 3, wherein the video reproducing apparatus is configured to reproduce in synchronization with the video data. 5. The sound reproducing means, wherein the sound reproduced by the sound reproduction signal which is processed by the processing means and which is being reproduced at present is gradually reduced in volume and superimposed on the next processed sound reproduction signal. 4. The video reproducing apparatus according to claim 3, wherein a volume of a reproduced sound by the next processed audio reproduction signal is gradually increased while reproducing. 6. The audio playback means processed in synchronization with a video being played when the fast-forward playback video signal is played back in a direction temporally opposite to a direction in which the video was shot. 4. The video reproducing apparatus according to claim 3, wherein the video reproducing apparatus is configured to reproduce the signal in a forward direction from the head of the signal. 7. The synchronizing means determines a reproduction speed of a fast-forward reproduction moving image signal reproduced by the moving image reproduction means while synchronizing with a reproduction speed of the audio reproduction signal reproduced by the audio reproduction means. 4. The video reproducing apparatus according to claim 3, wherein the image is output to the synthesizing unit. 8. The image feature extracting means includes: a frame dividing means for dividing the moving image signal separated by the signal separating means into a plurality of still images, and a frame dividing means for dividing the moving image signal into a plurality of still images. And an inter-frame change amount detecting means for detecting a change amount in the moving image feature extracting means, and the fast-forward video reproducing means, the inter-frame change amount detected by the inter-frame change amount detecting means. 2. A moving image reproducing means for changing a reproduction speed of a moving image signal by changing an exposure feed speed of the frame in accordance with the moving image reproducing means to reproduce a fast-forward reproduced video signal. Video playback device. 9. The video reproducing apparatus according to claim 8, wherein said inter-frame change amount detecting means is configured to obtain a motion change amount from the compression-encoded video data. 10. A moving image reproducing means, comprising: a similarity detecting means for calculating a similarity between a frame in a moving image divided by the frame dividing means and a designated reference image; Speed adjusting means for adjusting the reproducing speed such that the higher the similarity, the lower the reproducing speed and the lower the similarity, the higher the reproducing speed, based on the similarity between the images; 9. The video playback device according to claim 8, further comprising: a video playback speed changing unit that changes a fast-forward playback speed of the video signal sent from the frame dividing unit based on the playback speed. 11. The video reproducing apparatus according to claim 8, wherein said inter-frame change amount detecting means includes an acceleration detecting means for obtaining an acceleration which is an amount by which a change amount in a moving image signal changes. 12. An inter-frame change amount detecting means for separating a background and a moving object from the moving image, a relative speed between the separated background and the moving object. 9. The video reproducing apparatus according to claim 8, further comprising: a background / motion relative speed detecting means for obtaining a change amount of the moving image.