JP4551734B2 - Variable speed reproduction apparatus and variable speed reproduction method - Google Patents

Description

  The present invention relates to a variable speed playback apparatus and a variable speed playback method, and in particular, records content including received video data and audio data on a recording means, and then reads the content from the recording means and plays it at a playback speed different from that at the time of recording. The present invention relates to a variable speed reproduction device and a variable speed reproduction method.

  2. Description of the Related Art Conventionally, in a video playback apparatus with audio playback such as a video tape recorder, a double speed playback function, a high speed fast forward function, etc. are provided so that the user can view the entire video in a short time during playback. Yes.

  In addition, as a video playback device that accurately detects a voice section generated by a person and maintains the synchronization relationship between video and audio faithfully according to the detected voice section, the user's viewing time is significantly reduced. A moving image reproducing apparatus capable of reproducing moving image information including an audio signal and sub information at high speed, the first audio section representing a person's utterance period based on the sub information included in the moving image information, and the others On the basis of the moving picture information, the first voice section performs high-speed moving image reproduction with reproduced sound at a predetermined speed at which the user can grasp the content. Thus, the second audio section is known to include a moving picture playback device that includes at least a fast-playing playback means for performing high-speed moving picture playback at a speed higher than the predetermined speed (see, for example, Patent Document 1).

  Further, in the above publication (Patent Document 1), when playing back a moving image, if the playback is performed at a high magnification double speed that allows the user to grasp the content by watching the playback video, the change is so severe that it is difficult for a general user to hear. As a countermeasure against becoming a thing, in the speech segment correction process, considering the interval of the speech segment of the person, if the interval satisfies a predetermined condition, by integrating the speech segment group of a plurality of people, It is described that the above-mentioned difficulty in hearing is eliminated.

Next, FIG. 1 shows an example in which the playback speed is changed depending on whether or not it is a voice (conversation) part during conventional playback.
In FIG. 1, after content including video data and audio data is recorded on a recording unit, when the content is read from the recording unit and played back at a playback speed different from that at the time of recording, As shown in FIG. 1, “double speed / speech speed conversion” is executed in the sections “b”, “d” and “f” of the “conversation part” as shown in FIG. In “e”, “8 × speed / silent reproduction” is executed, and “8 × speed / silent reproduction” is executed in sections “a” and “c” of “silent portion”.
In FIG. 1, the motion of the video data is written in parentheses as (small motion) (moving) (large motion), but this portion is described for comparison with the present invention. In the example, the process of dividing the movement of the video data is not executed.
JP 2003-309786 A (Claims 1, (0031) (0032))

  In the above-mentioned publication, which is a prior art, the playback speed is determined by focusing on the viewpoint of eliminating the user's difficulty in listening to high-speed video playback. However, since the playback speed is changed only by the classification of the audio data, there is a problem that it is difficult for the user to see because the playback speed frequently changes.

  An example of a problem to be solved by the present invention is to provide a variable speed reproduction device and a variable speed reproduction method that make it easier for the user to see during reproduction and also eliminates difficulty in listening.

The variable speed playback apparatus according to claim 1, wherein a content including video data and audio data is recorded on a recording means and then played back at a playback speed different from that at the time of recording from the recording means. At the time of recording to the recording means, for each scene change of the content, the content of the section content between scene changes as elements relating to audio data, (a) conversation part, (b) music / sound effect part, (C) Classify into silent parts, and map the map data as elements related to video data by classifying them into (a) parts with intense movement, (b) moderately moving parts, and (c) parts close to still images. a map creating unit that records into the recording means to create, when the reproduction content from the recording means, elements relating to the audio data corresponding to the section content reproduced (b) (B), (c), and, elements relating to the image data (a), (b), (c) a reading from the map, elements relating to the audio data (a), (b), (c), And according to the combination of the elements (a), (b), and (c) relating to the video data, the section playback speed acquisition means for acquiring the playback speed of the section content, and the acquired section playback speed, Variable playback means for executing playback of the section content.

5. The variable speed playback method according to claim 4, wherein content including video data and audio data is recorded on a recording means and then played back at a playback speed different from that at the time of recording from the recording means. At the time of recording to the recording means, for each scene change of the content, the content of the section content between scene changes as elements relating to audio data, (a) conversation part, (b) music / sound effect part, (C) Classify into silent parts, and map the map data as elements related to video data by classifying them into (a) parts with intense movement, (b) moderately moving parts, and (c) parts close to still images. and recording into said recording means to create, during playback of the content from the recording means, to the audio data corresponding to the section content recorded on the map Containing (a), (b), (c), and, elements relating to the image data (a), (b), (c) a read from the map, the audio data about an element (a), (b) , (C), and a step of determining a segment playback speed according to the combination of the elements (a), (b), and (c) relating to the video data, and playback of the corresponding segment of the content according to the segment playback speed. And executing.

Embodiments of a variable speed reproduction apparatus and variable speed reproduction method according to the present invention will be described below with reference to the drawings.
FIG. 2 is a block diagram showing a schematic configuration of the variable speed playback apparatus and variable speed playback method according to the embodiment of the present invention, and FIG. 3 shows the playback speed according to the classification of audio data and video data according to the embodiment of the present invention. FIG. 4 is a diagram showing a second example in which the playback speed is changed in accordance with the classification of audio data and video data in the embodiment of the present invention.

First, the structure of the variable speed reproduction apparatus 10 according to the embodiment of the present invention will be described with reference to FIG.
In FIG. 2, 1 is an antenna, 2 is a receiving circuit, 3 is a scene change detection unit, 4 is an audio / video detection unit, 5 is an encoder, and 6 is an HDD (first recording means).
In this variable speed recording apparatus 10, an audio / video signal input to a receiving circuit 2 via an antenna 1 that receives broadcast content (program) is encoded into data such as MPEG2 by an encoder 5 at a predetermined bit rate. The map data detected by the scene change detection unit 3 and the audio / video detection unit 4 is also stored in the HDD (first storage means) 6. As the storage means, instead of the HDD (hard disk), other storage devices such as a memory made of a semiconductor element, an optical disk, a magneto-optical disk may be used.

In the configuration of FIG. 2, the variable speed playback device 10 receives the broadcast content (program) by the receiving circuit 2 via the antenna 1, and for each scene change, video and audio from the previous scene change. The scene change detection unit 3 and the audio / video detection unit 4 detect the situation of the (section content), create a map by dividing as follows, and make the section content encoded by the encoder 5 Correspondingly, it is recorded in the HDD 6.
If there is no scene change for a certain time or longer, the scene may be classified based on the change point of the audio or video situation.
In addition, for content with frequent scene changes, several points may be grouped together as a change point.
・ Voice: B: Conversation part B: Music / Sound effect part C: Silent part Video: a: High movement part b: Medium movement part c: Part close to still image In this example, the audio and video are divided into three elements, but may be divided into three or more.
Further, the magnitude of the motion of the video can be determined by, for example, the magnitude of an MPEG vector or the brightness difference data of the screen.
Although not shown in FIG. 2, when reproducing content from the HDD 6, elements related to audio data and video data corresponding to the segment content to be reproduced are read from the map and the reproduction speed of the segment content is acquired. Section playback speed acquisition means and variable playback means for executing playback of the section content at the acquired section playback speed are provided.

When playing back the content recorded on the HDD 6, the elements are read from the map recorded together with the content on the HDD 6, and the playback speed determined by the combination of a to c and a to c, the speech speed is converted or silenced Is determined.
An example of the playback speed determination rule is shown below.
-A: 1.5 times speed speech speed conversion -b or c: double speed speech speed conversion -a: double speed speech speed conversion -b or c: quadruple speed speech speed conversion -ha : Quadruple-speed silence / Ha-b: 8-times silence / Ha-c: 16-times silence

Next, FIG. 3 shows a first example in which the playback speed is changed in accordance with the above-described classification of audio data and video data.
In FIG. 3, as in FIG. 1, when content including received video data and audio data is recorded on the HDD 6, the contents of the content are used as audio data, and “conversation part (b)” “performance part (b)”. In addition to dividing into “silent part (c)”, the movement of the video screen as video data is further divided into “small movement (c)”, “moving (b)” and “large movement (a)” The above combination example is applied.

In FIG. 3, “double speed / speech speed conversion” is executed in the “conversation part” categories b, d, and f, and “double speed / speech speed conversion” is executed in the “performance part” category e. In the “part” section a, “8 × speed / silent reproduction” is executed, and in the “silent part” section “4 × speed / silent reproduction”.
Comparing the example of FIG. 3 of the present embodiment with the conventional FIG. 1, since the playback speed is set more finely in this embodiment, the change in the playback speed during the playback of content It can be understood that the shift reproduction screen is gentler and easier to see for the user.

Next, FIG. 4 shows a second example in which the playback speed is changed in accordance with the classification of the audio data and the video data.
In FIG. 4, when content including received video data and audio data is recorded on the HDD 6, the content of the content is set as audio data to “conversation part (b)”, “performance part (b)”, “silent part (c)”. And the above-mentioned combination example is applied by classifying the motion of the video screen as video data into “small motion (c)”, “moving (b)”, and “large motion (a)”. The point is the same as in the case of FIG.

  In the example of FIG. 4, the playback speed is determined in consideration of the playback time for variable speed playback, thereby preventing the playback speed from changing more frequently and making the variable speed playback screen easier for the user to see. It is.

In FIG. 4, the time (seconds) described in the upper part is a normal playback time between content scene changes, and the time (seconds) described in the lower part is shifted between content scene changes. Playback time.
In the example of FIG. 4, when the playback time determined by the rules for determining the playback time in the figure is less than the predetermined time (8 seconds in the figure), the playback speed is adjusted so that the playback time becomes the predetermined time. is doing.

That is, in the section a of “silent part / small motion”, in the example of FIG. 3, “8 × speed silent playback” is performed, and since the normal playback time of this section a is 40 seconds, the playback time after shifting at 8 × speed. Therefore, in the example of FIG. 4, the section a is set to “5 times speed” so that a reproduction time of 8 seconds can be secured.
Further, in the section b of “conversation part / moving”, in the example of FIG. 3, “double speed / speech speed conversion” is performed, and since the normal playback time of this section b is 20 seconds, even after double speed, Since the reproduction time is 10 seconds, the example of FIG. 4 is also reproduced by “double speed / speech speed conversion” similar to the example of FIG.

Further, in section c of “silent part / large motion”, in the example of FIG. 3, “4 × speed / silent playback”, and the normal playback time of this section c is 40 seconds. Since the time is 10 seconds, the example of FIG. 4 is also reproduced by “four times speed / silent reproduction” similar to the example of FIG.
Also, in the category d of “conversation part / moving”, in the example of FIG. 3, “double speed / speech speed conversion” is performed, and since the normal playback time of this category d is 8 seconds, at double speed, after the gear change. Since the reproduction time is 4 seconds, in the example of FIG. 4, the division d is set to “1 × speed” so that a reproduction time of 8 seconds can be secured.

Further, in the section e of “performance portion / small motion”, in the example of FIG. 3, “4 × speed / speech speed conversion”, and since the normal playback time of this section e is 30 seconds, at 4 × speed, after the shift. Since the reproduction time is 7 seconds, in the example of FIG. 4, the division e is set to “3.7 times speed” so that a reproduction time of 8 seconds can be secured.
Further, in the section f of “conversation part / moving”, in the example of FIG. 3, “double speed / speech speed conversion” is performed. Since the normal playback time of this section f is 30 seconds, even after double speed, The reproduction time is 15 seconds, and the example of FIG. 4 is also reproduced by “double speed / speech speed conversion” similar to the example of FIG.

In the example of FIG. 4, when the playback time is less than a predetermined time (8 seconds in the figure), the playback speed changes more frequently by determining the playback speed so that the playback time becomes the predetermined time. Thus, a variable speed playback screen that is easier for the user to see is provided.
In the example of FIG. 4, the predetermined reproduction time after the shift is set to 8 seconds, but it is not necessarily 8 seconds, and it may be set to another time such as 2 to 3 seconds, It is also possible to change according to the preference of the user.

Next, a procedure for recording content including video data and audio data according to the present embodiment on the HDD 6 and then reproducing the content from the HDD 6 at a reproduction speed different from that at the time of recording will be described.
First, when content is recorded on the HDD 6, for each scene change of the content, the content of the section content between scene changes is classified into a plurality of elements for each audio data and video data, and a map is created and recorded on the HDD 6. To do. (Step S1)
When reproducing content from the HDD 6, the segment reproduction speed is determined from the elements related to audio data and video data corresponding to the segment content recorded in the map. (Step S2)
-The playback of the section of the content is executed at the section playback speed. (Step S3)

As described above in detail, the variable speed playback apparatus 10 according to the embodiment of the present invention records content including video data and audio data in the HDD 6 (recording means), and then plays back from the HDD 6 differently from the time of recording. A device that reproduces at a speed, and maps the content of the section content between scene changes into a plurality of elements for each audio data and video data for each content scene change when recording the content (program) to the HDD 6. Creating and recording to the HDD 6, and at the time of content playback from the HDD 6, elements related to audio data and video data corresponding to the section content to be played back are read from the map and the playback speed of the section content is acquired The section playback speed acquisition means to perform playback of the section content at the acquired section playback speed. Comprising a variable reproducing means.
The variable speed playback method according to the embodiment of the present invention is a method for recording content including video data and audio data on the HDD 6 (recording means) and then playing the content from the HDD 6 at a playback speed different from that at the time of recording. When a content (program) is recorded on the HDD 6, for each scene change of the content, the content of the section content between scene changes is classified into a plurality of elements for each audio data and video data, and a map is created and recorded on the HDD 6. Step S1 for determining the section playback speed from the elements related to the audio data and the video data corresponding to the section content recorded in the map at the time of playback of the content from the HDD 6, and the section of the content based on the section playback speed. And step S3 of executing the reproduction.
As a result, the content of the content to be reproduced is divided into “conversation part”, “performance part”, “silent part”, etc. as audio data, and the movement of the video screen as the video data is changed to “small motion”, “moving”, “ By classifying them into “large motion” and the like and determining the playback speed by combining them, it becomes easier for the user to see at the time of playback, and the difficulty of listening can be eliminated.

It is a figure which shows the example which changes reproduction speed by whether it is an audio | voice part in a prior art. 1 is a block diagram showing a schematic configuration of a variable speed playback device according to an embodiment of the present invention. It is a figure which shows the 1st example which changes reproduction speed according to the division of the audio data and video data in embodiment of this invention. It is a figure which shows the 2nd example which changes reproduction speed according to the division of the audio | voice data and video data in embodiment of this invention.

Explanation of symbols

1 Antenna 2 Reception Circuit 3 Scene Change Detection Unit 4 Audio / Video Element Detection Unit 5 Encoder 6 HDD (Storage Unit)
10 Variable speed playback device

Claims (5)

A variable speed playback apparatus that records content including video data and audio data on a recording means and then plays back from the recording means at a playback speed different from that at the time of recording,
When recording the content in the recording means,
For each scene change of the content, the content of the section content between scene changes is classified into (b) a conversation part, (b) music / sound effect part, and (c) a silent part as elements relating to audio data. As the elements related to the video data, (a) a part with a strong movement, (b) a medium movement part, and (c) a part close to a still image are created and recorded in the recording means. Map creation means;
Elements (a), (b), (c) relating to the audio data corresponding to the section content to be reproduced , and elements (a), (b), relating to the video data, when reproducing the content from the recording means (C) is read from the map , and depending on the combination of the elements (a), (b), (c) related to the audio data and the elements (a), (b), (c) related to the video data , and segment playback speed obtaining means for obtaining a reproduction speed of the section contents,
Variable playback means for playing back the section content at the acquired section playback speed;
A variable speed reproduction apparatus comprising: When the playback time of the section content is less than a predetermined time determined by the section playback speed acquired from the combination of the elements corresponding to the content section, the playback time of the section content is the predetermined time. The variable speed playback apparatus according to claim 1, wherein the section playback speed is corrected so that   When there is no scene change for a certain period of time or more, the section content is classified based on a change point of an audio or video situation, and when scene changes are frequent, a plurality of scenes are grouped together. The variable speed playback apparatus according to claim 1, wherein the content is one section content. A variable speed playback method in which content including video data and audio data is recorded on a recording means and then played back from the recording means at a playback speed different from that at the time of recording,
At the time of recording the content on the recording means, for each scene change of the content, the content of the section content between scene changes is used as an element relating to audio data, and (b) a conversation part and (b) a music / sound effect part And (c) the silent part, and the elements relating to the video data are classified into (a) a part with a strong movement, (b) a moderately moving part, and (c) a part close to a still image. Creating a map and recording it in the recording means;
Elements (a), (b), (c) related to the audio data corresponding to the section content recorded in the map , and an element (a) related to the video data when reproducing the content from the recording unit , (B), (c) are read from the map , and the elements (a), (b), (c) related to the audio data and the elements (a), (b), (c) related to the video data Determining a segment playback speed according to the combination ;
Executing the playback of the section of the content at the section playback speed;
A variable speed reproduction method comprising:   When the playback time of the section content is less than a predetermined time determined by the section playback speed determined from the element corresponding to the content section, the playback time of the section content becomes the predetermined time. 5. The variable speed reproduction method according to claim 4, further comprising a step of correcting the section reproduction speed.

Images