JP2012034235A - Video reproduction apparatus and video reproduction method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video reproduction apparatus and a video reproduction method capable of making easy content acquisition of content data of a reproduction object.SOLUTION: The video reproduction apparatus comprises: separation means; keyword extraction means; reproduction means; display control means; and reproduction position changing means. The separation means separates video information and caption information from content data. The keyword extraction means extracts a keyword from caption information, and records it on a storage medium one by one with a display time of a caption including this keyword. The reproduction means decodes a video from the video information, and makes it to be displayed on a display screen. The display control means displays said one or more keywords recorded in the storage medium on the display screen side by side in the order of display time. The display position changing means changes a reproduction position by means of the reproduction means at a display time of a selected keyword among one or more keywords displayed on the display screen.

Description

  Embodiments described herein relate generally to a video playback apparatus and a video playback method.

  Broadcast program data includes various genres such as news, drama, movie, sports broadcast, education, variety, and the user can obtain various information from the broadcast program data being viewed.

  Here, it is considered that a keyword is extracted from the recorded broadcast program data, and a position corresponding to the extracted keyword is set as a reproduction position.

JP 2009-118158 A

However, there is a need not only to determine the reproduction position according to the keyword but also to grasp the rough contents by displaying the keyword.
Accordingly, an object of the embodiment of the present invention is to provide a video playback apparatus and a video playback method capable of facilitating the understanding of the content data to be played back.

  According to the embodiment, the video reproduction apparatus includes a separation unit, a keyword extraction unit, a reproduction unit, a display control unit, and a reproduction position change unit. The separating means separates the video information and the caption information from the content data. The keyword extraction means extracts keywords from the caption information, and sequentially records them on a storage medium together with the display time of captions including the keywords. The reproduction means decodes the video from the video information and displays it on the display screen. The display control means displays the one or more keywords recorded on the storage medium in order of display time on the display screen. The display position changing means changes the reproduction position by the reproduction means at the display time of the selected keyword among one or more keywords displayed on the display screen.

  According to the embodiment, the video reproduction method separates the video information and the subtitle information from content data, extracts a keyword from the subtitle information, and sequentially stores the subtitles including the keyword together with a display time. The video information is decoded and displayed on the display screen, and the one or more keywords recorded in the storage medium are displayed on the display screen in order of the display time, and displayed on the display screen. Among the one or more displayed keywords, the playback position is changed at the display time of the selected keyword.

The figure which shows an example of a structure of the video reproduction apparatus of embodiment. The figure which shows an example of the keyword time corresponding | compatible table which the video reproduction apparatus of embodiment memorize | stores. The figure which shows an example of the display screen which the video reproduction apparatus of embodiment produces | generates. The figure which shows an example of the class dictionary which the video reproduction apparatus of embodiment memorize | stores. The figure which shows an example of the genre corresponding table which the video reproducing apparatus of embodiment memorize | stores. The figure which shows an example of the flow of the keyword extraction process of the video reproduction apparatus of embodiment. The figure which shows an example of the flow of the reproduction | regeneration processing of the video reproduction apparatus of embodiment.

Hereinafter, embodiments will be described with reference to the drawings.
First, the configuration of the video playback apparatus in the present embodiment will be described with reference to FIG. FIG. 1 is a functional block diagram showing the configuration of the video playback apparatus 1 in the present embodiment.

  The video playback apparatus 1 includes a tuner / demodulator 3, a TS (Transport Stream) separator 4, a recording controller 5, a storage medium 6, a video buffer 7, a caption buffer 8, and a data broadcast buffer 9. , An audio buffer 10, an SI (Service Information: Program Sequence Information) processing unit 11, a PSI (Program Specific Information) processing unit 12, a video decoding unit 13, a subtitle decoding unit 14, and a data broadcasting process Unit 15, audio decoding unit 16, display memory 17, video output unit 18, audio output unit 19, control unit 20, STC (System Time Clock) counter 21, reception unit 22, keyword extraction unit 23 And a keyword UI generation unit 24, a memory unit 25, and a dictionary unit 29. To.

  The tuner / demodulator 3 selects an arbitrary channel from among the terrestrial digital broadcast received by the antenna 2, the broadcast sold separately by the BS, the CS digital broadcast, etc., and demodulates the selected broadcast signal. A TS format digital signal including a desired program is obtained and output to the TS separator 4.

  When displaying (reproducing) a digital broadcast, the TS separation unit 4 separates a plurality of TSs received from the tuner / demodulation unit 3 into a video signal, a caption signal, a data broadcast signal, and an audio signal. Output to each buffer.

  In addition, when recording digital broadcasting, the TS separation unit 4 outputs the remultiplexed TS to the recording control unit 5, and the recording control unit 5 uses the received TS as one content data as a storage medium. 6 is stored.

  Further, when playing back the recorded content data, the TS separation unit 4 reads the content data from the storage medium 6 via the recording control unit 5 and converts the TS received as the content data into a video signal, a caption signal, and the like. , Separated into audio signals and the like and output to each buffer.

  The video buffer 7, subtitle buffer 8, data broadcast buffer 9, and audio buffer 10 temporarily store the video signal, subtitle signal, data broadcast signal, and audio signal separated by the TS separator 4, respectively.

  The SI processing unit 11 and the PSI processing unit 12 perform appropriate digital signal processing on each of the SI information and the PSI information separated by the TS separation unit 4. The SI information and the PSI information subjected to the digital signal processing are transmitted to the control unit 20, and the control unit 20 constitutes an electronic program guide and the like and can be output from the video output unit 18.

The video decoding unit 13 reads a video signal from the video buffer 7 according to DTS (Decoding Time Stamp), and decodes the video signal into the video.
The caption decoding unit 14 reads a caption signal from the caption buffer 8 according to the DTS and generates a caption image (hereinafter also simply referred to as caption).
The data broadcast processing unit 15 reads a data broadcast signal such as BML (Broadcast Markup Language) from the data broadcast buffer 9 and appropriately generates a data broadcast screen (image).

  The audio decoding unit 16 reads an audio signal from the audio buffer 10 and decodes an audio output signal from the audio signal in accordance with PTS (Presentation Time Stamp). Note that the decoding time and output time of audio decoding are the same, and the DTS is not included in the audio signal.

  The display memory 17 includes a video and subtitle (caption image) decoded by the video decoding unit 13 and the subtitle decoding unit 14, a data broadcast screen generated by the data broadcast processing unit 15, and a keyword UI (User Interface) generation unit described later. The UI image output from 24 is temporarily stored (stored).

  The video output unit 18 synthesizes the video, caption, data broadcast screen, and UI image stored in the display memory 17 to form one display screen, and is an output terminal or built-in as a video output signal corresponding to the connected display. Output to the display device.

The audio output unit 19 outputs the audio output signal output from the audio decoding unit 16 to an output terminal or a built-in speaker according to the PTS.
The control unit 20 controls the operation of each unit of the video reproduction device 1 in accordance with the operation command received by the reception unit 22 from the remote controller, the operation button, or the like. Further, the control unit 20 includes an STC counter 21 as a counter for posting the system time. The audio output unit 19 and the audio output unit 19 output a video output signal and an audio output signal according to the STC counter 21.

The receiving unit 22 outputs to the control unit 20 an operation command corresponding to an operation input from a remote controller 38 (remote controller) corresponding to the video reproduction device 1 or an operation button.
The keyword extraction unit 23 extracts keywords from the caption signal stored in the caption buffer 8. More specifically, the caption information includes a text-formatted caption character string and a PTS (display time stamp) indicating the display timing. The keyword extraction unit 23 performs morphological analysis on the subtitle character string and breaks it down into words. Then, it is determined whether or not the keyword is to be extracted based on the user dictionary 26, the class dictionary 27, and the genre correspondence table 28 specified by the user stored in the dictionary unit 29, and should be extracted. If it is a keyword, the keyword is output to the keyword UI generation unit 24. Further, the keyword to be extracted is output to the control unit 20 together with time information (corresponding to a time stamp and a reproduction time described later), and stored as a keyword time correspondence table 30 on the memory unit 25.

An example of the keyword time correspondence table 30 is shown in FIG. FIG. 2 is a diagram illustrating an example of the keyword time correspondence table 30 stored on the memory unit 25.
As shown in FIG. 2, the keyword time correspondence table 30 associates the extracted keyword with its reproduction time. For example, in the example of FIG. 2, the reproduction time “00:10:23” is associated with the keyword “Ome”, and the reproduction time “00:11:45” is associated with the keyword “Izakaya”. When the keyword “Ome” is selected by the user on the display screen (see FIG. 3) generated by the keyword UI generation unit 24 described later, the control unit 20 reads the playback position (the recording control unit 5 reads and the TS separation unit). Control is performed to change the position (time) (also referred to as playback time) to be reproduced (decoded) after 4 to “00:10:23”. Note that “00:10:23” indicates that 10 minutes and 23 seconds have elapsed since the reproduction of the content data.

  The keyword UI generation unit 24 generates a UI screen in which a plurality of keywords are arranged in chronological order based on the keywords stored in the keyword time correspondence table 30 stored in the memory unit 25 in accordance with an instruction from the keyword extraction unit 23. The image is drawn on the display memory 17 via the video output unit 18.

  FIG. 3 is a diagram illustrating an example of a display screen generated by the keyword UI generation unit 24. The display screen 31 can be roughly divided into a video display area 32 and a keyword display area 33. In the video display area 32, the video being played back (video obtained by superimposing the video decoded by the video decoding unit 13 and the subtitle image decoded by the subtitle decoding unit 14) is displayed.

The keyword display area 33 is an image that is superimposed on the video display area 32, and displays a UI image generated by the keyword UI generation unit 24.
On the keyword display area 33, keyword buttons 34A to 34N are arranged to be selectable. The keyword buttons 34A to 34N can be selected by moving an operable cursor 35 in accordance with an operation command input from the remote controller 38 or the like.

  When the keywords extracted by the keyword extraction unit 23 cannot be displayed on the keyword display area 33, an icon 36 indicating that there is a continuation is displayed (arranged) at the right end or / and the left end of the keyword button 34 row. To do. When the cursor 35 is moved on the icon 36, the keyword buttons 34 that have not been displayed appear as the keyword button 34 row moves to the right or left.

  As a modification of the present embodiment, a thumbnail 37 that displays a video playback screen at the playback time of the keyword button 34 where the cursor 35 is located may be displayed together. By displaying the keyword and the thumbnail 37 at the same time, the scene where the keyword appears can be recognized at a glance.

  The dictionary unit 29 stores a user dictionary 26, a class dictionary 27, and a genre correspondence table 28. As described above, the keyword extraction unit 23 performs keyword extraction processing with reference to the class dictionary 27 and the genre correspondence table 28 stored in the dictionary unit 29.

An example of the class dictionary 27 is shown in FIG. FIG. 4 is a diagram illustrating an example of the class dictionary 27 stored on the dictionary unit 29.
In the class dictionary 27, as shown in FIG. 4, words are associated with classes. Here, a class is a semantic label of a word. In the example of FIG. 4, a class (meaning the word “Ome”) “place name” is associated with the word “Ome”, and a class “store type” is associated with the word “izakaya”. The keyword extraction unit 23 can obtain a registered word class (meaning) by referring to the class dictionary 27.

An example of the genre correspondence table is shown in FIG. FIG. 5 is a diagram showing an example of the genre correspondence table 28 stored on the memory unit 25.
The genre correspondence table 28 associates the genre of the content data with the class of words to be extracted there. In the example of FIG. 5, for example, when the genre of the content data is “news”, the class of words to be extracted may be “place name”, “person name”, “country name”, “case name”, and “company name”. When the genre is “cooking”, it is understood that the class of words to be extracted is “cooking name”, “cooking method”, and “country name”. The keyword extraction unit 23 checks the extracted word class with reference to the class dictionary 27 and checks whether the word class is a class to be extracted in the genre of the content data. When the extracted word class is a class to be extracted in the genre of the content data, the word is extracted using the word as a keyword, and is output to the memory unit 25 via the control unit 20 together with time information. Then, a drawing instruction is given to the keyword UI generation unit 24.

  In addition, when the content data is a broadcast program, the genre of each content data can be acquired from the PSI superimposed on the broadcast signal, or may be acquired via the Internet (not shown).

  Next, the flow of processing related to keyword extraction will be described with reference to FIG. FIG. 6 is a diagram showing the flow of keyword extraction processing by the keyword extraction unit 23. The process of FIG. 6 is performed for each caption information developed on the caption buffer 8. The keyword extraction process may be executed when the content data is recorded on the storage medium 6 or may be executed when the content data is viewed. Further, after the content data recording, only the keyword extraction process is executed independently, and the execution result is stored in the memory unit 25 as the keyword time correspondence table 30, so that the keyword time correspondence table 30 is reproduced during reproduction. The corresponding UI may be generated by the keyword UI generation unit 24.

  First, the keyword extraction unit 23 performs morphological analysis on the character string included in the caption information read from the caption buffer 8 and breaks it down into words (S11). Next, one word is extracted from the extracted words (S12), and the processes of S13 to S17 are performed.

  First, it is checked whether or not the extracted word is surrounded by symbols (such as parentheses and quotations) (S13). This is because, for example, in the case of subtitles such as “Oya Station” in front of Ome Station, “Oya” surrounded by quotations is likely to be an important word, and the important word is used as a keyword. This is because it should be extracted. If the extracted word is surrounded by symbols (Yes in S13), the word is registered (extracted) as a keyword (S17).

  If the extracted word is not surrounded by symbols (No in S13), it is confirmed whether or not the word is registered in the user dictionary 26 (S14). The user dictionary 26 is a dictionary for the user to arbitrarily register keywords, and is stored on the dictionary unit 29, for example. The keyword extraction unit 23 unconditionally extracts words registered in the user dictionary 26 as keywords. Therefore, when the word extracted in S12 is registered in the user dictionary 26 (Yes in S14), the word is registered (extracted) as a keyword (S17).

  If the extracted word is not registered in the class dictionary (No in S14), it is checked whether or not the word is registered in the class dictionary 27 (S15). If the extracted word is registered in the class dictionary 27 (Yes in S15), the genre of the content data being reproduced is checked, and the genre correspondence table 28 is referred to, so that the class of the extracted word is the content data. It is checked whether or not the class should be extracted in the genre (S16). If the extracted word class is a class to be extracted in the genre of the content data (Yes in S16), the word is registered (extracted) as a keyword (S17). Here, the process of registering as a keyword in S17 can register a word extracted as a keyword in the keyword time correspondence table 30 together with the reproduction time as a keyword, and can include a drawing instruction process in the keyword UI generating unit 24.

  If the extracted word is not registered in the class dictionary 27 (No in S15), or if the extracted word class is not a class to be extracted in the genre of content data (No in S16), or a keyword should be registered When the word is registered, it is determined whether or not the currently extracted word is the last word of the character string included in the caption information subjected to morphological analysis (S18).

  When the extracted word is the last word in the caption (Yes in S18), the keyword extraction processing procedure is terminated. On the other hand, if the extracted word is not the last word in the caption (No in S18), the process returns to step S12 and the above keyword extraction process is repeated.

  Next, the flow of reproduction processing when a keyword is selected will be described with reference to FIG. FIG. 7 is a diagram showing a flow of reproduction processing related to keyword selection by the control unit 20.

  First, the control unit 20 receives an operation command input by a user operation, and determines whether any of the keyword buttons 34 has been selected (S21). If the keyword button 34 has not been selected (No in S21), the control unit 20 continues to play back the video (step S22), and ends the playback process related to this keyword selection.

  On the other hand, when the keyword button 34 is selected (Yes in S21), the control unit 20 controls the TS separation unit 4 and the recording control unit 5 to pause the reproduction (S23). Next, the control unit 20 searches the keyword time correspondence table 30 for the selected keyword indicated by the cursor 34, and obtains reproduction time information stored in association with the keyword (S24). Next, the control unit 20 starts reproduction of the video data from the reproduction time indicated by the acquired reproduction time information (S25). Thus, the reproduction process related to this keyword selection is completed.

  In the above embodiment, the video playback is paused when a keyword is selected (S23). However, the present invention is not limited to this. For example, fast forward / rewind may be executed in accordance with the movement of the cursor, or playback may be continued.

  As described above, according to the present embodiment, it is possible to easily understand the content data to be reproduced. Based on the extraction condition of the keyword focused by the user, the keyword is extracted from the caption information of the content being played back, and a UI in which the extracted keywords are arranged in time series is displayed together with the content playback screen. Therefore, for example, when a certain time of content being reproduced is missed, it is possible to predict the contents of the missed scene by confirming the keyword string displayed in chronological order. If there is a keyword string indicating the content to be confirmed again, the rewinding operation can be quickly performed by selecting the keyword. In addition, since the content of the content can be grasped by listing the keyword strings, it is possible to reproduce from the position where the user desires to view without reproducing all the recorded content, thereby improving the operability. be able to.

  It should be noted that the embodiment is not limited as it is, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage. Further, various inventions can be configured by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from the previous components shown in the embodiment. Furthermore, you may combine the component covering different embodiment suitably.

  DESCRIPTION OF SYMBOLS 1 ... Video reproduction apparatus, 2 ... Antenna, 3 ... Tuner / demodulation part, 4 ... TS separation part, 5 ... Recording control part, 6 ... Storage medium, 7 ... Video buffer, 8 ... Subtitle buffer, 9 ... Buffer for data broadcasting DESCRIPTION OF SYMBOLS 10 ... Audio buffer, 11 ... SI processing part, 12 ... PSI processing part, 13 ... Video decoding part, 14 ... Subtitle decoding part, 15 ... Data broadcast processing part, 16 ... Audio decoding part, 17 ... Display memory, 18 ... Video output unit, 19 ... audio output unit, 20 ... control unit, 21 ... STC counter, 22 ... receiving unit, 23 ... keyword extraction unit, 24 ... keyword UI generation unit, 25 ... memory unit, 26 ... user dictionary, 27 ... Class dictionary, 28 ... Genre correspondence table, 29 ... Dictionary section, 30 ... Keyword time correspondence table, 31 ... Display screen, 32 ... Video display area, 33 ... Keyword display area, 34A-34N ... Keyword button, 5 ... cursor, 36 ... icon, 37 ... thumbnail, 38 ... remote control.

Claims (12)

Separating means for separating video information and subtitle information from content data;
Keyword extracting means for extracting a keyword from the subtitle information and sequentially recording it on a storage medium together with a display time of a subtitle including the keyword;
Playback means for decoding video from the video information and displaying it on a display screen;
Display control means for displaying the one or more keywords recorded in the storage medium in order of the display time and displaying them on the display screen;
A video playback device comprising playback position changing means for changing a playback position by the playback means at a display time of a selected keyword among the one or more keywords displayed on the display screen.   The video playback apparatus according to claim 1, wherein the display control unit simultaneously displays the video obtained by the playback unit and the one or more keywords.   The video reproducing apparatus according to claim 1, wherein the recording unit records the keyword and the display time on the storage medium for the recorded content data.   The video reproducing apparatus according to claim 1, further comprising changing means for changing a keyword extracted by the keyword extracting means.   5. The video reproducing apparatus according to claim 4, wherein the changing unit changes a keyword to be extracted according to a genre of the content data.   The video playback apparatus according to claim 1, wherein the display control unit displays the one or more keywords together with thumbnails corresponding to display times of the keywords. Separating the video information and the caption information from content data;
Extract keywords from the caption information, and sequentially record them on a storage medium together with the display time of captions containing the keywords,
Decoding video from the video information and displaying it on the display screen,
Displaying one or more of the keywords recorded in the storage medium on the display screen in order of the display time;
A video playback method, wherein a playback position is changed at a display time of a selected keyword among the one or more keywords displayed on the display screen.   The video playback method according to claim 7, wherein the video and the one or more keywords are displayed simultaneously.   The video reproduction method according to claim 7, wherein the keyword and the display time are recorded on the storage medium for the recorded content data.   The video reproduction method according to claim 7, wherein a keyword to be extracted can be changed.   5. The video reproducing apparatus according to claim 4, wherein the changing unit changes a keyword to be extracted according to a genre of the content data.   The video playback apparatus according to claim 1, wherein the display control unit displays the one or more keywords together with thumbnails corresponding to display times of the keywords.

Images