JP3998187B2 - Content commentary data generation device, method and program thereof, and content commentary data presentation device, method and program thereof - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a content commentary data generating device that generates content commentary data in which content commentary data is associated with the reproduction time of the content, a method and program thereof, and content commentary data that presents the content commentary data during content reproduction. The present invention relates to a presentation apparatus, a method thereof, and a program thereof.
[0002]
[Prior art]
Conventionally, in data broadcasting in BS digital broadcasting, information related to the contents of the content, for example, the profile of the characters of the currently broadcast drama, detailed competition records in the sports program, etc. are added to the content and transmitted. Therefore, there is a technology to present to the viewer. In data broadcasting in this BS digital broadcasting, data is described in BML (Broadcast Markup Language) and transmitted by a data carousel (for example, see Non-Patent Document 1).
[0003]
In addition, as a method of presenting explanations of terms to viewers during the playback of content provided as broadcast programs, program producers can generate explanations of terms in text data in advance and use the text data as “captions”. A method of superimposing and presenting on the content video is used. As a technique for presenting explanations by subtitles, for example, in BS digital broadcasting, a closed caption method is used in which video and subtitles are transmitted separately and the video and subtitles are combined (superimposed) on the receiver side. . At this time, the caption data (caption text data) is added with a display start time synchronized with the reproduction time of the video, and is synthesized with the video in synchronization with the reproduction time of the video on the receiver side. (For example, refer to Non-Patent Document 1 as above).
[0004]
In addition, the contents provided as DVD Video are accompanied by a glossary created by arranging the terms used in the contents in advance by the DVD producer and explanations of the terms in the order of the Japanese alphabet. . In this case, the viewer can obtain an explanation of a desired term by searching the glossary.
[0005]
[Non-Patent Document 1]
"Data broadcasting encoding and transmission system for digital broadcasting (ARIB
STD-B24) ", Radio Industry Association, October 26, 1999
[0006]
[Problems to be solved by the invention]
In the method of presenting information related to the content content in the data broadcasting in the prior art, it is possible to present information related to the entire content content, but synchronized with the playback time of the content Therefore, it is not intended to explain and present the term that the viewer wondered in the content when the content is played back.
[0007]
In addition, the method of providing explanations of terms in broadcast programs with captions has the problem that in terms of programs such as news programs where new words or technical terms frequently appear, the explanation terms are so large that the explanations cannot be presented on the screen. is there. Moreover, since the program producer decides the term to explain, the caption on the screen becomes troublesome for the viewer who does not need to explain the term.
[0008]
Furthermore, if the viewer needs explanations of terms that are not presented in subtitles, etc., the viewers must obtain explanations of terms by other media such as a dictionary or the Internet. However, it is difficult for viewers to hear unknown terms as speech, and there is a possibility that a dictionary will be looked up with the wrong word or an Internet search will be performed. In addition, in content such as a broadcast program whose contents change with time, if unknown terms are left as they are, there is a problem that the degree of understanding of the contents is reduced.
[0009]
Moreover, since the glossary implemented on DVDs and the like displays a list of all terms used in the content, the viewer has to find a desired term from the list. Furthermore, since it is difficult for the viewer to hear unknown terms as speech, there is a problem that the list is searched with wrong words as described above.
[0010]
The present invention has been made in view of the above problems, and in the content that changes with time, such as a broadcast program, the explanation of the term that the viewer has wondered is considered as the question. It is an object of the present invention to provide a content commentary data generation device, a method and a program thereof, and a content comment data presentation device, a method and a program thereof that can be presented at different timings.
[0011]
[Means for Solving the Problems]
  The present invention was created to achieve the above object, and first, the content commentary data generating device according to claim 1 is a character related to the content generated in synchronization with the playback time of the content. A content commentary data generating device that generates content commentary data associated with a reproduction time of the content by referring to a term database that accumulates terms and commentary that explain the term from information, the character information being Of the character informationBy the identification code attached in advanceCharacter information dividing means that is divided or divided at specific time intervals into character information dividing blocks, and character information divided blocks divided by this character information dividing means, character strings that become nouns or noun phrases by morphological analysis Search the term database for term extracting means for extracting the term in the block, which is the term in the character information division block, and the term explanatory text in the block, which is the explanation corresponding to the term in the block extracted by the term extracting means. Explanatory text search means,For each of the character information division blocks, a list of terms in the character information division block including at least one of the in-block terms and the in-block term explanation corresponding to the in-block terms is shown.Block information generating means for generating block information, and a plurality of the block information generated by the block information generating means,Character information division blockAnd a time-series block connecting means that is connected in time series based on the time information and used as the content commentary data.
[0012]
  According to such a configuration, the content commentary data generating device converts the character information generated by the character information dividing unit in synchronization with the reproduction time of the content.By the identification code attached in advanceA character information division block is formed by dividing or dividing at a specific time interval. For example, the character information is divided at a punctuation point, or the character information is divided at a specific time interval, for example, one minute interval. Alternatively, if the content can be divided by items such as news programs, the character information may be divided for each item.
[0013]
In addition, the content commentary data generation device performs a morphological analysis on the character information division block divided by the character information division unit by the term extraction unit, thereby converting a character string that becomes a noun or noun phrase into the character information division block. It is extracted as a term in a block that is a term. Then, the in-block term explanation sentence, which is the explanation sentence corresponding to the in-block term, is searched from the term database by the explanation sentence searching means. The term database is a database in which terms and explanations explaining the terms are stored in association with each other.
[0014]
  Furthermore, the content commentary data generating device uses block information generating means toFor each character information divided block, block information indicating a list of terms in the character information divided block including one or more in-block terms and one or more in-block term explanation sentences corresponding to the in-block terms is generated.
[0015]
  Then, the content commentary data generating device converts a plurality of block information by the time series block connecting means.Character information division blockContent commentary data arranged in time series based on time information (for example, time code) is generated.
  As a result, the content commentary data generation device can generate content commentary data that is synchronized with the reproduction time of the content and includes terms related to the contents of the content and their commentary.
[0016]
Furthermore, the content comment data generation device according to claim 2 is the content comment data generation device according to claim 1, wherein the block information generation means is the character information before or after the reproduction time of the content. The block information is generated by including an intra-block term and an intra-block term explanation sentence included in the divided block.
[0017]
According to such a configuration, the content commentary data generating device, when generating each block information by the block information generating means, includes the in-block terms included in the character information divided block before or after the reproduction time of the content and Include duplicate terminology in the block. As a result, when presenting content commentary data, the block information can be switched smoothly by giving some overlapping terms between the block information, and the viewer can inquire about the contents of the content after a certain delay. Will also be able to present previous terms.
[0018]
  Further, the content commentary data generation method according to claim 3 is based on the character information related to the content generated in synchronization with the playback time of the content, the term and the commentary explaining the term, A content commentary data generation method for generating content commentary data associated with a reproduction time of a content, wherein the character information isBy the identification code attached in advanceA character information dividing step for dividing or dividing at a specific time interval into a character information dividing block;For each of the character information division blocks, a list of terms in the character information division block including at least one of the in-block terms and the in-block term explanation corresponding to the in-block terms is shown.A block information generation step for generating block information, and a plurality of the block information generated in the block information generation step,Character information division blockAnd a time-series block concatenation step which is concatenated in time series based on time information and used as the content commentary data.
[0019]
  According to this method, in the content commentary data generation method, the character information generated in synchronization with the playback time of the content in the character information dividing step is converted into the character information.By the identification code attached in advanceA character information division block is formed by dividing or dividing at a specific time interval. And in the block information generation step,For each character information division block, block information indicating a list of terms in the character information division block including at least one term in the block and one or more term explanation sentences in the block corresponding to the term in the block is generated..
  Then, in the time series block connection step, a plurality of block information isCharacter information division blockContent commentary data arranged in time series based on time information (for example, time code) is generated.
[0020]
Furthermore, the content commentary data generation method according to claim 4 is the content commentary data generation method according to claim 3, wherein the block information generation step includes the character information division block divided in the character information division step. A term extraction step for extracting a character string that becomes a noun or noun phrase by morphological analysis as an in-block term in the character information division block, and the in-block term explanation sentence corresponding to the in-block term extracted in the term extraction step And an explanatory text search step for searching from a term database in which terms and explanatory text explaining the terms are stored.
[0021]
According to this method, in the content commentary data generation method, a character string that becomes a noun or noun phrase is a term in the character information division block by performing morphological analysis on the character information division block in the term extraction step. Extract as in-block terms. Then, in the comment sentence search step, the term comment sentence in the block, which is the comment sentence corresponding to the term in the block, is searched from the term database.
This makes it possible to extract terms from the character information generated in synchronization with the content playback time.
[0022]
The content commentary data generation program according to claim 5 is a term database that accumulates terms and commentary explaining the terms from character information related to the content generated in synchronization with the reproduction time of the content. In order to generate content description data associated with the playback time of the content, the computer is configured to function by the following means.
[0023]
  That is, the character information is replaced with the character information.By the identification code attached in advanceCharacter information dividing means that is divided or divided at specific time intervals into character information dividing blocks, and character strings that become nouns or noun phrases by morphological analysis from the character information dividing blocks divided by the character information dividing means Term extraction means for extracting as terms in a block that are terms in an information division block, and explanation sentences for searching a term explanation sentence in a block corresponding to a term in the block extracted by the term extraction means from the term database Search means,For each of the character information division blocks, a list of terms in the character information division block including at least one of the in-block terms and the in-block term explanation corresponding to the in-block terms is shown.Block information generating means for generating block information, a plurality of the block information generated by the block information generating means,Character information division blockTime-series block connection means is used to link the contents in time series based on the time information to obtain the content commentary data.
[0024]
  According to such a configuration, the content commentary data generation program converts the character information generated by the character information dividing means in synchronization with the reproduction time of the content.By the identification code attached in advanceA character information division block is formed by dividing or dividing at a specific time interval.
  Then, by performing morphological analysis on the character information division block divided by the character information division means by the term extraction means, a character string that becomes a noun or noun phrase is a term in the block that is a term in the character information division block Extract as In addition, the in-block term explanation sentence, which is the explanation sentence corresponding to the in-block term, is searched from the term database by the explanation sentence searching means.
[0025]
  In addition, the content commentary data generation program uses the block information generation means toFor each character information division block, a list of terms in the character information division block including at least one term in the block and one or more term explanation sentences in the block corresponding to the term in the block is shown.Generate block information. Then, a plurality of block information is converted by the time series block connecting means.Character information division blockContent commentary data arranged in time series based on time information (for example, time code) is generated.
  Thus, the content commentary data generation program can generate content commentary data that is synchronized with the reproduction time of the content and includes terms related to the content and the commentary.
[0026]
  The content commentary data presentation device according to claim 6 provides a plurality of content reproduction times.For each time interval divided intoTime intervalInsideTerminology related to the contents ofBlock information containing one or more of them is linked in time seriesA content comment data presentation device for presenting content comment data in synchronization with the reproduction of the content, a query detection unit for detecting a query request regarding the content at the time of the content reproduction, and the query request by the query detection unit Based on the playback time of the content at the time of detecting the inquiry requestBlock informationInsideOne or moreTerms are presented by the term search means for searching from the explanation data storage means storing the content explanation data, the term list presentation means for presenting a list of terms searched by the term search means, and the term list presentation means. Term selection means for selecting a desired term from a list of terms, commentary text search means for searching for commentary text corresponding to the term selected by the term selection means from the comment data storage means, and comment text search means And a comment sentence presenting means for presenting the comment sentence retrieved in (1).
[0027]
According to this configuration, the content commentary data presentation device detects an inquiry request related to content by the inquiry detection unit. For example, a specific word uttered by the viewer is recognized by voice recognition, or a specific button such as a remote controller or a keyboard is pressed to detect that the viewer has inquired about the content.
[0028]
  Then, the content commentary data presentation device uses the term search means to determine which of the content commentary data the time when the inquiry request is detected.Block informationIs included in theBlock informationTerms included inOne or moreSearch and extract. One or more terms extracted here are presented as a term list by the term list presenting means. Thereby, the candidate of the term which a viewer doubts at the time interval can be presented to the viewer in a list format.
[0029]
Furthermore, the content commentary data presentation device detects that the viewer has selected a desired term by means of term selection means. For example, it is recognized that a term has been selected by detecting that an up / down / left / right direction key or a determination key of the remote controller has been pressed, or by detecting that a mouse button has been pressed (clicked).
[0030]
In the content commentary data presentation device, the commentary text search means searches for commentary text corresponding to the term selected by the term selection means from the commentary data storage means that stores the content commentary data. Then, the retrieved comment sentence is presented on the screen by the comment sentence presenting means.
[0031]
  Furthermore, the content commentary data presentation method according to claim 7 provides a plurality of content reproduction times.For each time interval divided intoTime intervalInsideTerminology related to the contents ofBlock information containing one or more of them is linked in time seriesA content commentary data presentation method for presenting content commentary data in synchronization with the reproduction of the content, the inquiry detection step for detecting a query request related to the content at the time of the content reproduction, and the inquiry detection stepPlayback time of the content when the inquiry request is detectedDetected that query request based onWhenSaidBlock informationInsideOne or moreTerminology, Comment data storage means for storing the content comment dataFrom the list of terms presented in the term list presenting step, a term selecting step for selecting a desired term, and the term selected in the term selecting step. The explanation corresponding to the term isExplanation data storage meansAnd a comment sentence presenting step for retrieving and presenting from the above.
[0032]
  According to this method, the content commentary data presentation method detects a query request regarding content in the query detection step. For example, a specific word uttered by the viewer is recognized by voice recognition, or a specific button such as a remote controller or a keyboard is pressed to detect that the viewer has inquired about the content. And in the term list presentation step, it corresponds to the time when the inquiry request is detectedBlock informationInsideOne or morePresent a list of terms.
  In the term selection step, it is detected that the viewer has selected a desired term using a remote controller, keyboard, mouse, or the like. Then, in the comment sentence presentation step, a comment sentence corresponding to the selected term is presented on the screen.
[0033]
  The content commentary data presentation program according to claim 8 sets a plurality of content reproduction times.For each time interval divided intoTime intervalInsideTerminology related to the content ofBlock information containing one or more of them is linked in time seriesIn order to present the content description data in synchronization with the reproduction of the content, the computer is configured to function by the following means.
[0034]
  That is, when the content is played back, a query detection unit that detects a query request related to the content, and the query detection unit detects the query request based on the playback time of the content when the query detection unit detects the query request.Block informationInsideOne or moreTerm search means for searching the term from the comment data storage means for storing the content comment data, term list presentation means for presenting a list of terms searched by the term search means, and the term presented by the term list presentation means The term selection means for selecting a desired term from the list, the explanation text search means for retrieving the explanation text corresponding to the term selected by the term selection means from the explanation data storage means, and the explanation text search means An explanation sentence presentation means for presenting an explanation sentence.
[0035]
According to this configuration, the content commentary data presentation program detects the inquiry request regarding the content by the inquiry detection unit. For example, a specific word uttered by the viewer is recognized by voice recognition, or a specific button such as a remote control or a keyboard is pressed to detect that the viewer has inquired about the content.
[0036]
  Then, the content commentary data presentation program determines which of the content commentary data the time when the query request is detected by the term search means.Block informationIs included in theBlock informationTerms included inOne or moreSearch and extract. One or more terms extracted here are presented as a term list by the term list presenting means. Thereby, the candidate of the term which a viewer doubts at the time interval can be presented to the viewer in a list format.
[0037]
Further, the content commentary data presentation program detects that the viewer has selected a desired term by the term selection means. For example, it is recognized that a term has been selected by detecting that an up / down / left / right direction key or a determination key of the remote controller has been pressed, or by detecting that a mouse button has been pressed (clicked).
[0038]
Also, the content commentary data presentation program searches the commentary data storage unit that has stored the content commentary data for commentary corresponding to the term selected by the term selection means by means of commentary sentence search means. Then, the retrieved comment sentence is presented on the screen by the comment sentence presenting means.
[0039]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[First Embodiment: Content Explanation Data Generation / Transmission System]
FIG. 1 is a block diagram showing a configuration of a content comment data generation / transmission system 1 including a content comment data generator 30 according to the present invention. The content commentary data generation / transmission system 1 shown in FIG. 1 generates content commentary data associated with the playback time of the content 21 from the narration document 22 stored in the content storage device 20, and multiplexes it with the content 21. Is transmitted as a broadcast wave.
[0040]
The content commentary data generation / transmission system 1 includes a term database 10, a content storage device 20, a content commentary data generation device 30, and a multiplexing transmission device 40.
[0041]
The term database 10 is a database that stores a term and an explanation of the term in association with each other. In this term database 10, a term 11 (for example, a new word, a technical term, a proper noun, a place name, a word that requires explanation of an esoteric foreign word, etc.) related to the contents 21 and a commentary that explains the term 11 in advance. The sentence 12 is associated and registered.
[0042]
The content storage device 20 is configured with a hard disk, a semiconductor memory, or the like, which is a general recording medium, and converts content (video / audio) 21 such as a broadcast program and audio of the content 21 into character information (text information). Information (hereinafter referred to as narration document 22) is accumulated. In general, many news narrations, narrations such as dramas and documentaries or dialogues are handled as electronic data corresponding to video segments called video scenes or cuts. Therefore, the narration document 22 is generated by, for example, converting this electronic data into character information. The narration document 22 is provided with a time code indicating the scene or cut time.
[0043]
Based on the narration document 22 and the term database 10, the content commentary data generation device 30 generates a term related to the content of the content 21 and its commentary as content commentary data associated with the playback time of the content 21. Is.
[0044]
The multiplexing transmission device 40 multiplexes the content 21 stored in the content storage device 20 and the content description data generated by the content description data generation device 30 and transmits them as broadcast waves. For example, when content and content description data are broadcast by digital broadcasting, the content is converted into a PES (Packetized Elementary Stream) format, the content description data is converted into a section format, and each of the converted data is multiplexed. And transmitted as a broadcast wave by performing transmission path encoding.
[0045]
(Configuration of content commentary data generator)
Hereinafter, an internal configuration of the content comment data generation device 30 will be described.
Here, the content commentary data generating device 30 is composed of character information dividing means 31, term extracting means 32, comment sentence searching means 33, block information generating means 34, and time-series block connecting means 35.
[0046]
The character information dividing unit 31 divides the narration document 22 stored in the content storage device 20 at a specific time interval based on the time code to form a character information dividing block. For example, the narration document 22 is divided at 1-minute intervals based on the time code. The character information division block divided by the character information division unit 31 is notified to the term extraction unit 32. Further, the character information dividing unit 31 notifies the block information generating unit 34 of time information indicating a time code and a division unit (for example, 1 minute interval) in the divided character information divided block.
[0047]
Although the narration document 22 is divided at specific time intervals here, for example, in a news program, news items may be divided as character information delimiters. In this case, an identification code for identifying an item other than the time code is assigned to the narration document 22 in advance.
[0048]
The term extraction means 32 extracts terms (in-block terms) from the character information division blocks divided by the character information division means 31. The term extraction unit 32 extracts words that are nouns and noun phrases as in-block terms by performing morphological analysis on the character information division block. As a result, new words, technical terms, proper nouns, place names, foreign words, etc. existing in the character information division block are extracted as in-block terms. The in-block terms extracted by the term extracting means 32 are notified to the comment sentence searching means 33 and the block information generating means 34.
[0049]
The in-block terms extracted by the term extracting unit 32 are displayed on a display unit (not shown), and the content creator can delete unnecessary in-block terms by using an input unit such as a keyboard (not shown). It is also possible to add words that are not included in the character information division block as related terms.
[0050]
The comment search means 33 searches the term database 10 for the same term 11 as the term in the block extracted by the term extraction means 32, and reads the comment sentence 12 corresponding to the term 11 as a term comment sentence in the block. is there. Here, the read in-block term explanation sentence is notified to the block information generating means 34.
[0051]
If the in-block term is not registered in the term database 10, the content creator inputs the explanation as an in-block term explanation using an input means such as a keyboard (not shown). Further, the term in block and the term explanation text in block at this time are registered in the term database 10 as a new term and its explanation text.
[0052]
The block information generation means 34 includes the time information (including the division time and time code) of the character information division block divided by the character information division means 31, the in-block terms extracted by the term extraction means 32, and the explanation text search. Block information that associates the term explanation text in the block searched by the means 33 is generated. The block information generated here is notified to the time-series block connecting means 35.
[0053]
Here, an example of generating block information will be described with reference to FIG. FIG. 2 shows an example of block information generation when the division interval of the character information division block is 1 minute. Here, the time code is expressed in the format of [hour: minute: second: frame].
[0054]
In the example of FIG. 2A, the time code is generated at time T1 [00: 00: 05: 14], time T2 [00: 00: 32: 05], and time T3 [00: 00: 51: 05]. Terms (in-block terms) W1 to W3 and their explanations (in-block term explanations) E1 to E3 are displayed for the first minute ([00: 00: 00: 00] to [00: 00: 59: 29]) Block information B1.
[0055]
Also, terms (in-block terms) W4 and W5 generated in the time code at time T4 [00: 01: 02: 05] and time T5 [00: 01: 15: 10] and their explanations (in-block term explanations) ) E4 and E5 are blocked as block information B2 for the next one minute ([00: 01: 00: 0] to [00: 01: 59: 29]).
[0056]
FIG. 2B shows an example in which another block information is generated from the terms W1 to W5 and the explanatory texts E1 to E5 generated at the same times T1 to T5 as in FIG. The block information B1 in FIG. 2B is the same as that in FIG. The block information B2 in FIG. 2B shows block information for the next one minute ([00: 01: 00: 0] to [00: 01: 59: 29]) following the block information B1. Is the same as FIG. 2A, except that the term W3 and the commentary E3 at time T3 are included.
[0057]
In FIG. 2B, the block information B2 includes the start time ([00:01] of the block information B2 in addition to the terms W4 and W5 that occur at a time interval of 1 minute and the explanatory sentences E4 and E5 that are the explanatory sentences. : 00: 00])) and terms and explanations occurring at a specific time (here, 10 seconds). That is, the term W3 and the comment sentence E3 at time T3 are included in both the block information B1 and the block information B2.
[0058]
As a result, when the term of the block information including the reproduction time and the explanation thereof are presented at the time of content reproduction, even if the block information is switched to the next block information, immediately before the end of the previous block information (for example, 10 seconds) ) And their explanations can be presented. That is, the switching of block information can be made smooth.
[0059]
Note that the block information B2 in FIG. 2B can include the term W3 at the time T3 and the substance (character information) of the commentary E3, but a pointer that points to the information at the time T3 in the block information B1. It is good also as including only.
Returning to FIG. 1, the description will be continued.
[0060]
The time-series block connecting unit 35 generates one piece of content comment data in which the block information generated by the block information generating unit 34 is connected in time series in the order of the start times of the block information. This content comment data becomes the output of the content comment data generation device 30.
[0061]
The configuration of the content commentary data generation / transmission system 1 including the content commentary data generation device 30 has been described above. The content commentary data generated by the content commentary data generation device 30 is not limited to broadcasting data, but a DVD or the like. It can also be used as data that is packaged together with content on other recording media.
[0062]
The content commentary data generating apparatus 30 can also realize each means as a function program in a computer, and can also combine the function programs to operate as a content commentary data generation program.
[0063]
(Operation of content commentary data generator)
Next, with reference to FIG. 1 and FIG. 3, the operation of the content comment data generation device 30 which is the main configuration of the content comment data generation / transmission system 1 will be described. FIG. 3 is a flowchart showing the operation of the content comment data generation device 30.
[0064]
First, the content commentary data generating device 30 uses a character information dividing unit 31 to generate a content (video / audio) 21 such as a broadcast program and a narration original 22 obtained by converting the audio of the content 21 as character information (text information). Based on the time code, it is divided at specific time intervals (for example, 1 minute intervals) to form character information division blocks (character information division step: S1).
[0065]
Then, the term extraction means 32 performs morphological analysis on the character information division block divided in the character information division step (S1), thereby converting a word that becomes a noun or noun phrase from the character information division block into a term (inside block). Term) (term extraction step: S2).
[0066]
Further, the comment sentence search means 33 searches the term database 10 for the comment sentence corresponding to the term (term in the block) extracted in the term extraction step (S2) and sets it as the term comment sentence in the block (description sentence search). Step: S3).
[0067]
Further, the content commentary data generating device 30 uses the block information generating means 34 to generate time information including the division time and time code of the character information division block divided in the character information division step (S1), and the term extraction step (S2). ) And the in-block term comment sentence searched in the comment sentence search step (S3) are generated as block information as one text data (block information generation step: S4).
[0068]
Then, the content comment data generation device 30 links the block information generated in the block information generation step (S4) by the time series block connecting means 35 in time series in the order of the start time of the block information. Output as data (time-series block connection step: S5).
[0069]
The content description data generated in the block information generation step (S5) is multiplexed with the content by the multiplexing transmitter 40 and broadcast as broadcast waves (broadcast data). Further, the content comment data may be packaged together with the content on a recording medium such as a DVD.
[0070]
Through the above steps, the content commentary data generation device 30 associates the terms related to the contents of the content 21 and the explanations thereof with the playback time of the content 21 based on the narration document 22 and the term database 10. Generate as content commentary data.
[0071]
[Second Embodiment: Content Receiving Device]
Next, a description will be given of the configuration of a content receiving apparatus that receives broadcast data including content broadcast as broadcast waves and content comment data from the content comment data generation / transmission system 1 and reproduces the content and content comment data. .
[0072]
FIG. 4 is a block diagram showing a configuration of the content receiving device 2 including the content commentary data presentation device 80 according to the present invention. The content receiving apparatus 2 shown in FIG. 4 receives broadcast data composed of content and content commentary data, and presents terms and commentary related to the content when reproducing the content.
The content receiving device 2 includes a reception separating device 50, a reception storage device 60, an input device 70, a content comment data presentation device 80, and an output device 90.
[0073]
The reception separation device 50 receives broadcast data (content and content description data) transmitted as a broadcast wave, separates it into content 61 and content description data 62, and stores them in the reception storage device 60. is there.
[0074]
The reception storage device 60 is configured by a general recording medium such as a hard disk and a semiconductor memory, and stores the content 61 and content description data 62 received and separated by the reception separation device 50. For example, a home server (Home Server), a hard disk recorder, or the like that can view content when the viewer likes it. The content 61 and content description data 62 stored in the reception storage device 60 are read and reproduced by the content description data presentation device 80. The content commentary data 62 is generated by the content commentary data generation device 30 (see FIG. 1), and includes time information for synchronizing with the reproduction time of the content 61 and terms related to the reproduction time. , Is a concatenation of block information consisting of commentary that explains the term.
[0075]
The input device 70 is used by the viewer to instruct the content commentary data presentation device 80 to operate. For example, the input device 70 is a keyboard, a mouse, a remote controller, or the like. Moreover, the microphone etc. which perform voice input are also included. The key control signal input by the keyboard, mouse, remote controller or the like, or the audio signal input by the microphone or the like is notified to the operation control means 82 of the content commentary data presentation device 80.
[0076]
The content commentary data presentation device 80 reproduces the content 61 and content commentary data 62 stored in the reception storage device 60 based on the key signal and audio signal input from the input device 70 and outputs them to the output device 90. To do. More specifically, the content commentary data presentation device 80 normally reproduces and presents the content 61, but receives an inquiry request (a key signal or a voice signal from the input device 70) from the viewer. The content commentary data 62 synchronized with the reproduction time of the content 61 is reproduced and presented at the same timing.
[0077]
The output device 90 displays the content 61 and the content description data 62 reproduced by the content description data presentation device 80. For example, the output device 90 outputs a CRT, a liquid crystal display, a plasma display, or the like for displaying video. Speaker or the like.
[0078]
(Configuration of content commentary data presentation device)
Hereinafter, an internal configuration of the content comment data presentation device 80 will be described.
Here, the content commentary data presentation device 80 is composed of content reproduction means 81, operation control means 82, information control means 83, and display control means 84.
[0079]
The content reproduction means 81 reads out and reproduces the content 61 stored in the reception storage device 60. For example, when the content is a moving image encoded by MPEG2, decoding is performed based on the MPEG2 encoding method. Here, the reproduced data reproduced is notified to the display control means 84 and displayed on the screen of the output device 90. Note that the term search unit 83a of the information control unit 83 refers to the current playback time of the content in the content playback unit 81.
[0080]
The operation control unit 82 controls an operation instruction of the viewer input from the input device 70, and accepts an interruption by a voice signal from a microphone or the like or a key signal from a keyboard or the like, and based on the interruption. Control is performed. Here, the operation control means 82 is composed of an inquiry detection unit 82a and a term selection unit 82b.
[0081]
The inquiry detection unit (inquiry detection means) 82a receives an inquiry about the contents of the content from the viewer through an input device 70 in the state where the content is being reproduced, by an interruption by an audio signal or a key signal. This is notified to the term search unit 83a of the information control means 83 as a detection notification.
[0082]
For example, the inquiry detection unit 82a has a voice recognition function, and detects that the viewer has uttered a question word such as “What?” At the time of content reproduction. In this case, it is only necessary to recognize a predefined question word (such as “what”, “question”, etc.), so that an advanced speech recognition technique is not required. The inquiry detection unit 82a may detect an inquiry by detecting that the “glossary” button on the remote controller is pressed.
[0083]
In this way, the inquiry detection unit 82a detects an interruption of a question from a viewer by a simple operation such as a voice or a key that is determined in advance during content reproduction.
The term selection unit (term selection means) 82b receives a signal for selecting a term that the viewer wants to explain from the input device 70 in a state where the list of terms is presented on the output device 90, and determines the selected term. The position (selected position) is notified to the comment text search unit 83b of the information control means 83. For example, the position of the term selected by the up / down / left / right direction keys of the remote controller is detected and notified.
[0084]
Based on the viewer's request (inquiry detection notification, selected position) detected by the operation control means 82, the information control means 83 sends the terms and explanations related to the contents from the contents explanation data 62 of the reception storage device 60. Search. Here, the information control means 83 is composed of a term search unit 83a and a comment text search unit 83b.
[0085]
The term search unit (term search unit) 83 a makes an inquiry to the viewer based on the time when the query detection notification is received from the query detection unit 82 a of the operation control unit 82 and the content playback time in the content playback unit 81. It is determined which time of content playback corresponds to which time of content reproduction, that is, which block information of the content description data corresponds to, and a term corresponding to the block information is searched from the content description data 62. The one or more terms searched here are notified to the term list presentation unit 84a of the display control means 84.
[0086]
The term search unit 83a sets a term close to the time when the inquiry detection notification is notified in the block information in the content comment data 62 as a term having a high priority, and the term list presenting unit displays the priority together with the term. It is good also as notifying to 84a.
[0087]
Here, referring to FIG. 5 (refer to FIG. 4 as appropriate), the term search unit 83a identifies block information in the content commentary data 62 based on the time when the inquiry detection notification is notified and the playback time of the content. How to do will be described. FIG. 5 is a diagram conceptually showing an operation of identifying block information corresponding to the time tq when the inquiry is detected from the continuous block information B.
Since the block information B is linked with the reproduction time of the content, as shown in FIG. 5, the block information B related to the content content changes with time t.
[0088]
Therefore, the term search unit 83a stores the start time st at which the content was reproduced, and the content search at the time when the query is detected based on the difference (tq-st) from the time (detection time) tq when the query is detected. A viewing time p is calculated. Therefore, the block information (here, block information B4) corresponding to the viewing time p is specified as the block information corresponding to the time tq when the inquiry is detected.
Returning to FIG. 4, the description will be continued.
[0089]
The comment text search unit (comment text search means) 83b searches the content comment data 62 for comment text corresponding to the term based on the selected position of the term notified from the term selection section 82b of the operation control means 82. It is. The comment sentence retrieved here is notified to the comment sentence presentation section 84b of the display control means 84.
[0090]
The display control unit 84 outputs the reproduction data reproduced by the content reproduction unit 81 and the terms and explanations notified from the information control unit 83 to the output device 90 as display data. Here, the display control means 84 is composed of a term list presentation unit 84a and an explanation sentence presentation unit 84b. It is assumed that the reproduction data reproduced by the content reproduction unit 81 is converted into a video / audio signal by a content presentation unit (not shown) and output to the output device 90.
[0091]
The term list presenting unit (term list presenting unit) 84a outputs one or more terms notified from the term searching unit 83a of the information control unit 83 to the output device 90 in a list format. When the list of terms is presented on the screen of the output device 90, the display area of the content reproduction data is reduced, and the term list is displayed with the empty area as the term display area. The list of terms may be displayed (overlaid) on the content video, or may be a screen displaying only a list of terms without video.
The term list presentation unit 84a is notified of the priority of terms from the term search unit 83a, and the higher priority terms are displayed at the top of the list or displayed with a larger area to be arranged on the screen. It is good as well.
[0092]
The comment text presenting section (comment text presenting means) 84 b is for presenting the comment text notified from the comment text searching section 83 b of the information control means 83 in the comment text display area on the screen and outputting it to the output device 90. .
[0093]
Here, an example of a screen output from the content commentary data presentation device 80 and displayed on the output device 90 will be described with reference to FIG. 6 (refer to FIG. 4 as appropriate). FIG. 6 shows an example of a screen in which a viewer makes an inquiry to the content commentary data presentation device 80 when news related to a “flexible display” is broadcast as a news program, and the terms and commentary at the time of the inquiry are displayed. Show.
[0094]
As shown in FIG. 6, when displaying terms and explanation sentences on the screen, the screen is divided into a video display area A, a term display area B, and an explanation sentence display area C. Then, the reproduction data reproduced by the content reproduction unit 81 is displayed in the video display area A. Further, the term (B₁~ B_Three) Is displayed in the term display area B, and the explanatory text output from the explanatory text presentation unit 84b is displayed in the explanatory text display area C. Note that the “return” button D on the screen in FIG. 6 is used to end the display of terms and explanations and to display a video-only screen.
[0095]
The configuration of the content receiving device 2 including the content comment data presentation device 80 has been described above, but the present invention is not limited to this. For example, it is also possible to add a communication control device that can be connected to the Internet to the content commentary data presentation device 80 so that it functions as a remote lesson or a WebBased Training that provides a lesson while distributing content over the Internet. In this case, it is possible to sequentially ask questions about the contents and words of the class that the student wondered about, and to present the contents and explanations of the words to the students.
[0096]
The reception storage device 60 may be a drive device that reads a recording medium such as a DVD player. In this case, the content and content description data are not received as broadcast waves, but are distributed in a state of being written on a packaged recording medium such as a DVD.
[0097]
Note that the content commentary data presentation device 80 can also realize each means as a function program in a computer, and can also combine the function programs to operate as a content commentary data presentation program. In this case, the content commentary data presentation program is stored in the reception storage device 60 via a broadcast wave as a program described in a language such as BML, for example, and the program is operated in the content commentary data presentation device 80. It is good.
[0098]
(Operation of content commentary data presentation device)
Next, with reference to FIG. 4 and FIG. 7, the operation of the content commentary data presentation device 80, which is the main configuration of the content reception device 2, will be described. FIG. 7 is a flowchart showing the operation of the content commentary data presentation device 80.
[0099]
It is assumed that the content 61 and the content explanation data 62 have already been received by the receiving / separating device 50 and broadcast data broadcast on a broadcast wave, and are stored in the receiving and storing device 60 in a separated state. Here, it is assumed that the content 61 is reproduced as reproduction data by the content reproduction unit 81 and displayed on the output device 90 such as a CRT via the display control unit 84.
[0100]
First, the content commentary data presentation device 80 uses the inquiry detection unit 82a of the operation control means 82 to detect an inquiry to the content content from the viewer input from the input device 70 (inquiry detection step: R1). For example, the inquiry is detected by an interruption by a voice signal from a microphone or the like, or a key signal from a keyboard or the like.
[0101]
Then, the content commentary data presentation device 80 detects the inquiry (request) from the viewer in the inquiry detection step (R1) by the term search unit 83a of the information control means 83, and the content reproduction data from the content reproduction means 81. Based on the reproduction time, the time at which the viewer makes an inquiry corresponds to the content reproduction time, and the term included in the block information corresponding to the time is searched from the content explanation data 62 ( Term search step: R2).
[0102]
Then, the content commentary data presentation device 80 outputs (displays) one or more terms searched in the term search step (R2) to the output device 90 in a list format by the term list presentation unit 84a of the display control means 84. (Term list presentation step: R3).
Through the steps up to step R3, when the viewer wonders, a list of terms associated with the reproduction time of the content, which is the time at which the question was wondered, is displayed on the screen.
[0103]
Then, the term selected by the viewer using the input device 70 such as a remote controller or a keyboard is selected by the term selection unit 82b of the operation control unit 82 (term selection step: R4), and the explanation sentence search unit 83b of the information control unit 83 is used. The commentary text corresponding to the term selected in the term selection step (R4) is searched from the content commentary data 62 (explanatory text search step: R5).
[0104]
The comment sentence searched in the comment sentence search step (R5) is output (displayed) to the output device 90 by the comment sentence presentation part 84b of the display control means 84 (the comment sentence presentation step: R6), and the viewer is questioned. It is presented as a commentary on the term you thought of.
[0105]
Through the above steps, the content comment data presentation device 80 can present a list of terms related to the reproduction time of the content at the timing when the viewer wonders when reproducing the content. Then, the viewer can display the explanation text of the term by a simple operation of selecting the term in question from the list of terms.
[0106]
(Screen example of content commentary data presentation device)
Next, referring to FIG. 8, the viewer makes an inquiry to content commentary data presentation device 80 (FIG. 4) at the time of content reproduction, and terms and commentary relating to the reproduction time of the content are displayed on the screen. An example of a screen to be presented will be described. 8A shows a screen when content is played back, FIG. 8B shows a screen when a list of terms is displayed, and FIG. 8C shows a screen when an explanatory text is displayed. Yes.
[0107]
As shown in FIG. 8A, normally, in a state where the content is being reproduced, the video of the content is reproduced on the entire screen. At this stage, if the viewer has a question about the content, the voice is spoken through the microphone, for example, “So what”. Thereby, a list of terms related to the reproduction time of the content is displayed as shown in FIG.
[0108]
Then, when the viewer selects one term from the list of terms with a remote controller, keyboard, mouse or the like, an explanatory text corresponding to the term is displayed as shown in FIG.
In this way, the content commentary data presentation device 80 can quickly present the commentary of the term at the time when the viewer wondered when reproducing the content with a simple operation of the viewer.
[0109]
【The invention's effect】
As described above, the content comment data generation device, method and program thereof, and content comment data presentation device, method and program thereof according to the present invention have the following excellent effects.
[0110]
According to the invention of claim 1, claim 3, claim 4 or claim 5, in content such as a broadcast program whose contents change with time, character information synchronized with the playback time of the content (narration) From the manuscript, content explanation data associated with the playback time of the content can be generated based on the term related to the content content and the commentary explaining the term. As a result, by using the content commentary data on the content reproduction side, it becomes possible to refer to the term that the viewer has wondered from the content commentary data at the time when reproducing the content.
[0111]
According to the second aspect of the present invention, when generating block information, the in-block term and the in-block term explanation sentence included in the character information division block before or after the content reproduction time are duplicated. Can be included. This makes it possible to present the previous term even if the viewer makes an inquiry about the contents of the content with a certain time delay on the side of reproducing the content.
[0112]
According to the invention described in claim 6, claim 7 or claim 8, in content such as a broadcast program that changes in content over time, the explanation of the term that the viewer has wondered is questioned. Can be presented at different times. In addition, since the viewer simply interrupts with a specific designation method such as “So What” when reproducing the content, it is not necessary to input the questioned term accurately using a keyboard or the like.
In this way, the viewer does not need to listen to exactly the term in question, and can simply ask a question from a list displayed on the screen with a simple inquiry, so that he / she can easily ask a question. As a result, the viewer can easily acquire new knowledge when viewing a broadcast program or the like.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of a content commentary data generation / transmission system including a content commentary data generation device according to a first embodiment of the present invention.
FIG. 2 is an explanatory diagram for explaining an example of generating block information generated by block information generating means of the content commentary data generating apparatus according to the first embodiment of the present invention.
FIG. 3 is a flowchart showing an operation of the content commentary data generating apparatus according to the first embodiment of the present invention.
FIG. 4 is a block diagram showing a configuration of a content receiving device including a content comment data presentation device according to a second embodiment of the present invention.
FIG. 5 is an explanatory diagram for explaining a method for specifying block information in content commentary data by a term search unit of the content commentary data presentation device according to the second embodiment of the present invention;
FIG. 6 is an example of a screen presented by the content commentary data presentation device according to the second embodiment of the present invention.
FIG. 7 is a flowchart showing the operation of the content commentary data presentation device according to the second embodiment of the present invention.
FIG. 8 is an example of a screen for explaining a presentation operation of the content commentary data presentation device according to the second embodiment of the present invention.
[Explanation of symbols]
1 ... Content commentary data generation / transmission system
2 ...... Content receiver
10 …… Term database
20 …… Content storage device
30 …… Content comment data generator
31 …… Character information dividing means
32 …… Term extraction means
33 …… Explanation text search means
34 …… Block information generation means
35 …… Time series block connection means
40 ... Multiplexing transmitter
50 …… Reception separation device
60 …… Reception storage device
70 …… Input device
80 …… Contents comment data presentation device
81. Content reproduction means
82 …… Operation control means
82a ... Inquiry detection unit (inquiry detection means)
82b ... Term selection section (term selection means)
83 …… Information control means
83a ... Term search part (term search means)
83b ... Explanation sentence search part (explanation sentence search means)
84 …… Display control means
84a ... Term list presenting section (term list presenting means)
84b ... commentary presentation section (commentary presentation means)
90 …… Output device

Claims (8)

A content explanation associated with the playback time of the content by referring to a term database in which terms and explanations explaining the terms are accumulated from character information related to the content generated in synchronization with the playback time of the content. A content commentary data generation device for generating data,
Character information dividing means for dividing the character information into character information division blocks by dividing the character information by a predetermined identification code or by dividing at a specific time interval;
From the character information division block divided by the character information division means, a term extraction means for extracting a character string that becomes a noun or noun phrase by morphological analysis as a term in the block that is a term in the character information division block;
Commentary searching means for searching the term commentary in the block, which is a commentary corresponding to the term in the block extracted by the term extraction means, from the term database;
For each character information divided block, block information indicating a list of terms in the character information divided block, including one or more terms in the block and one or more in-block terms corresponding to the term in the block, is generated. Block information generating means for performing,
A plurality of the block information generated by the block information generating means, time-series block connecting means for connecting to the time-series based on the time information of the character information division block and making the content commentary data;
A content commentary data generating device characterized by comprising:   The block information generating means generates the block information including an intra-block term and an intra-block term commentary sentence included in the character information division block before or after the reproduction time of the content. The content commentary data generation device according to claim 1. A content description that generates content description data associated with the playback time of the content based on character information related to the content generated in synchronization with the playback time of the content, and a term and a description that explains the term A data generation method,
A character information dividing step in which the character information is divided by a predetermined identification code of the character information or divided at a specific time interval into a character information dividing block;
For each character information divided block, block information indicating a list of terms in the character information divided block, including one or more terms in the block and one or more in-block terms corresponding to the term in the block, is generated. Block information generation step to perform,
A plurality of the block information generated in the block information generation step are connected in time series based on the time information of the character information division block to be the content comment data, and a time series block connection step;
Content commentary data generation method characterized by including The block information generation step includes:
A term extraction step for extracting a character string that becomes a noun or a noun phrase by morphological analysis as a term in the block in the character information division block from the character information division block divided in the character information division step;
An explanatory sentence search step for searching the term explanatory sentence in the block corresponding to the term in the block extracted in the term extracting step from a term database in which the term and the explanatory sentence explaining the term are accumulated;
The content commentary data generation method according to claim 3, further comprising: A content explanation associated with the playback time of the content by referring to a term database in which terms and explanations explaining the terms are accumulated from character information related to the content generated in synchronization with the playback time of the content. Computer to generate data,
Character information dividing means for dividing the character information into a character information division block by dividing the character information by a predetermined identification code or dividing it at a specific time interval;
Term extraction means for extracting a character string that becomes a noun or noun phrase by morphological analysis as a term in the block that is a term in the character information division block from the character information division block divided by the character information division means,
Explanatory text search means for retrieving the term explanatory text in the block, which is the explanatory text corresponding to the term in the block extracted by the term extracting means, from the term database,
For each character information divided block, block information indicating a list of terms in the character information divided block, including one or more terms in the block and one or more in-block terms corresponding to the term in the block, is generated. Block information generating means for
A plurality of the block information generated by the block information generating means, connected in time series based on the time information of the character information division block, and used as the content comment data;
Content commentary data generation program characterized by functioning as Block information including one or more terms related to the contents of the content within the time interval and one or more explanations explaining the terms is linked in time series for each time interval obtained by dividing the content playback time into multiple times. has been the content description data, a content description data presentation device that presents in synchronism with playback of the content,
Inquiry detecting means for detecting an inquiry request regarding the content during the content reproduction;
Based on the playback time of the content when the inquiry request is detected by the inquiry detection means, one or more terms in the block information at the time when the inquiry request is detected are commentary in which the content commentary data is accumulated. A term search means for searching from the data storage means;
A term list presentation means for presenting a list of terms searched by the term search means;
Term selection means for selecting a desired term from the list of terms presented by the term list presentation means;
Commentary text search means for searching the commentary data storage means for commentary text corresponding to the term selected by the term selection means;
Commentary presentation means for presenting the commentary retrieved by this commentary retrieval means;
A content commentary data presentation device characterized by comprising: Block information including one or more terms related to the contents of the content within the time interval and one or more explanations explaining the terms is linked in time series for each time interval obtained by dividing the content playback time into multiple times. has been the content description data, a content description data presentation method of presenting in synchronism with playback of the content,
A query detection step of detecting a query request related to the content during the content playback;
Based on the reproduction time of the content when the inquiry request is detected in the inquiry detection step, one or more terms in the block information at the time of detecting the inquiry request are stored in the description in which the content description data is accumulated. A term list presenting step for searching from the data storage means and presenting a list of the terms;
A term selection step for selecting a desired term from the list of terms presented in the term list presentation step;
A comment sentence presenting step for retrieving the comment sentence corresponding to the term selected in the term selecting step from the comment data storage means and presenting it;
The content commentary data presentation method characterized by including. Block information including one or more terms related to the contents of the content within the time interval and one or more explanations explaining the terms is linked in time series for each time interval obtained by dividing the content playback time into multiple times. In order to present the content description data in synchronization with the playback of the content,
Inquiry detecting means for detecting an inquiry request regarding the content during the content reproduction;
Based on the playback time of the content when the inquiry request is detected by the inquiry detection means, one or more terms in the block information at the time when the inquiry request is detected are commentary in which the content commentary data is accumulated. Term search means for searching from data storage means,
Term list presenting means for presenting a list of terms searched by the term searching means;
Term selection means for selecting a desired term from the list of terms presented by the term list presentation means;
Explanatory text search means for retrieving an explanatory text corresponding to the term selected by the term selection means from the explanatory data storage means,
Commentary presentation means for presenting the commentary searched by this commentary search means,
Content commentary data presentation program characterized by functioning as

Images