JP2008134825A - Information processor, information processing method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To associate an index appropriate to a program content with a program partitioned to image sections. <P>SOLUTION: An index relevant keyword group extraction part 22 extracts, from a text associated with an index contained in information relevant to a program, a word contained in the text as an index keyword. An image section capturing part 16 cuts the program to a plurality of image sections, and a caption keyword group extraction part 18 extracts, for each image section captured by the part 16, a word contained in a caption synchronized with an image of the program as a caption keyword. An association information retention part 26 associates an index associated with the text from which an index keyword evaluated to have the highest similarity with a caption keyword by a similarity evaluation part 24 for evaluating the similarity between the caption keyword and the index keyword with an image section. This invention is applicable to, for example, a video reproducing device. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program, and in particular, information that enables an appropriate heading to be associated with the content of a program in a video section in a video section cut out from the program. The present invention relates to a processing device, an information processing method, and a program.

  2. Description of the Related Art Conventionally, in a recording / playback apparatus such as a hard disk recorder, when a television broadcast program is recorded, a position where a scene switches is determined based on a feature extracted by analyzing a program video. Some of them have a function of detecting and cutting out a plurality of video sections from a program according to the position.

  In such a recording / playback apparatus, when a recorded program is played back, a still image corresponding to the first frame of the video section is displayed side by side on the display unit, and the user can select a desired video section based on the still image. When is selected, program playback is started from the start position of the video section selected by the user.

  Here, for example, Patent Document 1 discloses a display device that extracts a title name that is displayed when a corner starts in a television broadcast program and displays the title name while the corner is broadcast. Is disclosed.

JP 2004-72504 A

  By the way, as described above, even if the recording / playback apparatus displays a still image corresponding to the video section, it is difficult for the user to grasp the content of the program in the video section only by the still image, and the desired video is displayed. It was difficult to find a section. For example, if the recording / playback apparatus can display a headline that appropriately represents the contents of a program in the video section together with a still image corresponding to the video section, the user can display the program in the video section by using the still image and the heading. It is thought that the content can be grasped and a desired video section can be easily found.

  However, in the conventional recording / playback apparatus, it is difficult to process the information included in the program in the video section and recognize the contents of the program, so a headline that appropriately represents the contents of the program in the video section is displayed. It was not done to display. Therefore, in order to perform such display, there has been a demand for an information processing apparatus that processes information included in a program in a video section and associates a headline that appropriately represents the contents of the video section with the video section. .

  The present invention has been made in view of such a situation, and enables an appropriate heading to be associated with the content of a program in a video section in a video section cut out from the program. is there.

  An information processing apparatus according to an aspect of the present invention is an information processing apparatus that processes a program and information related to the program, and is based on the text associated with a heading included in the information related to the program, Synchronizing with the video of the program for each of the video sections cut out by the cut-out means, the cut-out means for cutting out a plurality of video sections from the program, and the headline keyword-extracting means for extracting words included in the text as headline keywords Subtitle keyword extracting means for extracting words included in the subtitles as subtitle keywords from the subtitles being performed, evaluation means for evaluating the similarity between the subtitle keywords and the headline keywords, and similarity between the subtitle keywords The headline associated with the body from which the headline keyword evaluated as being the highest is extracted, And a strap with means to attach the string to the serial video section.

  An information processing method or program according to one aspect of the present invention is an information processing method for processing a program and information related to the program, or a program executed by a computer that processes the program and information related to the program. Then, from the text linked to the headline included in the information related to the program, the word included in the text is extracted as a headline keyword, and a plurality of video sections are cut out from the program, and for each video section, Extract words contained in the subtitle as subtitle keywords from subtitles synchronized with the video of the program, evaluate the similarity between the subtitle keyword and the headline keyword, and have the highest similarity with the subtitle keyword The headline associated with the body text from which the headline keyword evaluated as Comprising the step of attaching.

  In one aspect of the present invention, a word included in the text is extracted as a headline keyword from the text associated with the headline included in the information related to the program. Also, a plurality of video sections are cut out from the program, and words included in the subtitles are extracted as subtitle keywords from the subtitles synchronized with the video of the program for each video section. Then, the similarity between the subtitle keyword and the headline keyword is evaluated, and the headline associated with the body from which the headline keyword evaluated as having the highest similarity with the subtitle keyword is associated with the video section. .

  According to one aspect of the present invention, an appropriate heading can be associated with the content of a program in a video section in a video section cut out from the program.

  Embodiments of the present invention will be described below. Correspondences between the constituent elements of the present invention and the embodiments described in the specification or the drawings are exemplified as follows. This description is intended to confirm that the embodiments supporting the present invention are described in the specification or the drawings. Therefore, even if there is an embodiment which is described in the specification or the drawings but is not described here as an embodiment corresponding to the constituent elements of the present invention, that is not the case. It does not mean that the form does not correspond to the constituent requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

An information processing apparatus according to one aspect of the present invention is an information processing apparatus that processes a program and information related to the program,
Headline keyword extraction means (for example, a headline-related keyword group extraction unit 22 in FIG. 1) that extracts words included in the main text from the main text associated with the headlines included in the information related to the program. When,
Cutout means for cutting out a plurality of video sections from the program (for example, the video section cutout section 16 in FIG. 1),
For each of the video sections cut out by the cutout means, subtitle keyword extraction means for extracting words included in the subtitles as subtitle keywords from subtitles synchronized with the video of the program (for example, subtitle keywords in FIG. 1). Group extraction unit 18);
Evaluation means for evaluating the similarity between the caption keyword and the headline keyword (for example, the similarity evaluation unit 24 in FIG. 1);
A linking means for linking the headline linked to the body from which the headline keyword evaluated as having the highest similarity to the caption keyword is linked to the video section (for example, linking in FIG. 1) And a processing unit 25).

An information processing apparatus according to one aspect of the present invention includes:
Program receiving means for receiving the program (for example, the program receiving unit 13 in FIG. 1);
Information receiving means for receiving information related to the program (for example, the data broadcast receiving unit 19 in FIG. 1) can be further provided.

An information processing apparatus according to one aspect of the present invention includes:
Receiving means for receiving the program and information related to the program by time division (for example, the program receiving unit 13 and the data broadcast receiving unit 19 in FIG. 1).
Can further be provided.

An information processing apparatus according to one aspect of the present invention includes:
Video segment determining means (for example, video segment determining unit 15 in FIG. 1) for determining the video segment cut out from the program by the clipping unit based on a change in the feature amount of the video of the program.
Can further be provided.

An information processing method or program according to one aspect of the present invention is an information processing method for processing a program and information related to the program, or a program executed by a computer that processes the program and information related to the program. And
From the text associated with the headline included in the information related to the program, a word included in the text is extracted as a headline keyword (for example, step S14 in FIG. 7).
A plurality of video sections are cut out from the program (for example, step S23 in FIG. 8),
For each video section, words included in the subtitles are extracted as subtitle keywords from subtitles synchronized with the video of the program (for example, step S25 in FIG. 8).
Evaluating the similarity between the caption keyword and the headline keyword (for example, step S26 in FIG. 8),
The headline associated with the body from which the headline keyword evaluated to have the highest similarity with the caption keyword is associated with the video section (for example, step S28 in FIG. 8).
Includes steps.

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration example of an embodiment of an information processing apparatus to which the present invention is applied.

  In FIG. 1, an information processing apparatus 11 includes an antenna 12, a program receiving unit 13, a feature extracting unit 14, a video segment determining unit 15, a video segment segmenting unit 16, a caption segmenting unit 17, a caption keyword group extracting unit 18, and data broadcasting reception. A section 19, a headline acquisition section 20, a body text acquisition section 21, a headline related keyword group extraction section 22, a headline holding section 23, a similarity evaluation section 24, a linking processing section 25, and a linking information holding section 26.

  The antenna 12 receives an RF (radio frequency) signal broadcast on television and supplies the RF signal to the program receiving unit 13 and the data broadcasting receiving unit 19.

  The program receiving unit 13 receives and demodulates the RF signal from the antenna 12, and acquires MPEG-TS (Moving Picture Experts Group-Transport Stream). The program receiving unit 13 extracts program data (video data and caption data synchronized with the video) from the MPEG-TS, and the program data is extracted from the feature extraction unit 14 and the video. This is supplied to the section cutout unit 16.

  The feature extraction unit 14 analyzes the program data supplied from the program reception unit 13 as pre-processing for extracting a plurality of video sections from the program, and extracts the feature amount as the analysis result from the program data. For example, the feature extraction unit 14 analyzes program data based on changes in pixel values of consecutive frames, presence / absence of telop display, change in volume, and the like. Then, the feature extraction unit 14 supplies the feature amount extracted from the program to the video section determination unit 15.

  The video section determination unit 15 determines a video section cut out from the program based on the feature amount supplied from the feature extraction unit 14. For example, at the transition of a scene in a drama or a movie, the change in the pixel value of consecutive frames is large, and the feature amount supplied from the feature extraction unit 14 is also a large value. Therefore, the video section determination unit 15 determines the time when the feature amount is equal to or greater than a predetermined threshold as the start time or end time of the video section. Then, the video segment determination unit 15 generates chapter information that is information including the start time or end time of the video segment, and supplies the chapter information to the video segment cutout unit 16.

  The video section cutout section 16 is supplied with program data from the program receiving section 13 and chapter information from the video section determination section 15. The video segment cutout unit 16 cuts out the video segment from the program data supplied from the program receiving unit 13 based on the chapter information supplied from the video segment determination unit 15, and subtitles the program data for each video segment. To the unit 17 and the linking processing unit 25.

  The caption segmentation unit 17 extracts caption data synchronized with the video from the program data for each video segment supplied from the video segment segmentation unit 16, and supplies it to the caption keyword group extraction unit 18.

  The caption keyword group extraction unit 18 performs morphological analysis on the caption data for each video section supplied from the caption cutout unit 17, and extracts words included in the caption as caption keywords. For example, the caption keyword group extraction unit 18 divides words in the caption into words (morphemes), assigns parts of speech to the divided words, and extracts words assigned “noun” as parts of speech as caption keywords. To do. The subtitle keyword group extraction unit 18 extracts a plurality of subtitle keywords for each video section, and supplies data of the subtitle keywords (subtitle keyword group) to the similarity evaluation unit 24.

  The data broadcast receiving unit 19 receives and demodulates the RF signal from the antenna 12, and acquires text data, a still image, and the like broadcast as data broadcast. The data broadcast receiving unit 19 supplies the text data of the data broadcast to the headline acquisition unit 20 and the body text acquisition unit 21.

  The headline acquisition unit 20 acquires headline data from text data of the data broadcast supplied from the data broadcast reception unit 19 based on BML (Broadcast Markup Language) defined as a data broadcast description language. The header acquisition unit 20 supplies the header data acquired from the text data of the data broadcast to the header holding unit 23.

  The text acquisition unit 21 acquires text data from the text data of the data broadcast supplied from the data broadcast receiving unit 19 based on BML. The body acquisition unit 21 supplies body data acquired from the text data of the data broadcast to the headline-related keyword group extraction unit 22.

  The headline-related keyword group extraction unit 22 performs morphological analysis on the text data supplied from the text acquisition unit 21 and extracts words included in the text as headline-related keywords. The headline-related keyword group extraction unit 22 extracts a plurality of headline-related keywords from the text of the data broadcast, and supplies data of the headline-related keywords (headline-related keyword group) to the headline holding unit 23.

  The headline holding unit 23 holds (stores) the headline data supplied from the headline acquisition unit 20 and the headline related keyword group data supplied from the headline related keyword group extraction unit 22 in association with each other. In addition, since the data broadcast is periodically transmitted from the broadcasting station, the headline holding unit 23 sequentially stores the headline data and the data of the headline related keyword group.

  The similarity evaluation unit 24 is supplied with a caption keyword group from the caption keyword group extraction unit 18, and the similarity evaluation unit 24 is held in the caption keyword group from the caption keyword group extraction unit 18 and the headline holding unit 23. Evaluate the similarity with multiple headline related keywords.

  For example, the similarity evaluation unit 24 selects the caption keyword according to the ratio of the number of matched words between the caption keyword group and the headline-related keyword group with respect to the number of all words in the caption keyword group and the headline-related keyword group. Evaluate the similarity between groups and headline related keywords. That is, the similarity evaluation unit 24 evaluates that the similarity between the subtitle keyword group and the headline related keyword group is high if the ratio is high, and the similarity between the subtitle keyword group and the headline related keyword group if the ratio is low. Evaluated to be low.

  Then, the similarity evaluation unit 24 assigns specific information for identifying the headline-related keyword group having the highest similarity evaluation among the headline-related keyword groups whose similarity evaluation is equal to or higher than a predetermined criterion. 25. Note that if the headline related keyword group whose similarity evaluation is equal to or higher than a predetermined standard is not held in the headline holding unit 23, the similarity evaluation unit 24 does not supply the linking processing unit 25 with specific information.

  The association processing unit 25 is supplied with program data for each video segment from the video segment cutout unit 16. When the specific information specifying the headline related keyword group having the highest similarity evaluation with the caption keyword group is supplied from the similarity evaluation unit 24, the linking processing unit 25 is supplied with the specification supplied from the similarity evaluation unit 24. The headline data associated with the headline related keyword group specified by the information is read from the headline holding unit 23. Then, the linking processing unit 25 generates linking information for linking the heading data read from the heading holding unit 23 and the program data for each video section supplied from the video section cutout unit 16. The information is supplied to the attachment information holding unit 26.

  The linking information holding unit 26 holds (stores) linking information for linking program data and headings for each video section supplied from the linking processing unit 25.

  Next, FIG. 2 is a diagram illustrating a display example of a data broadcast screen.

  FIG. 2 shows a screen 30 for introducing the contents of a television broadcast program. The screen 30 shows a program name 31 of the program, program information 32 introducing the contents of the program, and a program information. A still image 33 of a performer or the like is displayed. The program information 32 displays a heading 34 that is the title name of a corner in the program, and a text 35 that is a sentence summarizing the contents of the corner.

  In the display example of FIG. 2, the heading 34 displays “prefectural flower information flower forest”, and the body 35 reads “Krinsou is beginning to bloom. According to the Wildflower Garden, this year it is flowering a little later than usual, and the best time to see it is this month. ”

  1 receives the data broadcast that displays the screen 30 shown in FIG. 2 and supplies the text data of the data broadcast to the header acquisition unit 20 and the body acquisition unit 21. In this case, the headline acquisition unit 20 acquires “prefectural flower information flower forest” as the headline, and the headline related keyword group extraction unit 22 supplied with the text data from the text acquisition unit 21 sets the headline related keyword group as Extract "Klinsaw, Primrose, White, Pink, Flower, Flowering, Best time".

  Next, FIG. 3 is a diagram illustrating a video section determined by the video section determination unit 15 of FIG. 1 based on the feature amount supplied from the feature extraction unit 14. In FIG. 3, the horizontal axis represents the passage of time of the program to be recorded. Note that the horizontal axis in FIGS. 4 to 6 also represents the passage of time of the recorded program, as in FIG.

For example, if the time when the program to be recorded starts is time t ₁ , the video section determination unit 15 sets the start time of the video section A, which is the first video section, as time t ₁ . Then, from time t ₁ to time t _2, and the feature quantity which is sequentially supplied from the feature extractor 14 is less than the predetermined threshold value, feature quantity at the time t ₂ is assumed to equal to or greater than a predetermined threshold value. In this case, the video section determination unit 15 detects the time t ₂ as a time (cut point) that divides the video section A from the video section B that is the second video section, and the end time of the video section A and the video and the start time of the section B, the time t ₂ to. In addition, the video section determination unit 15 sets the end time of the video section B as time t ₃ as in the process at time t ₂ .

  Next, FIG. 4 is a diagram for explaining the caption data extracted from the program data for each video section supplied from the video section cutout unit 16 by the caption cutout unit 17 in FIG. 1.

When the data of the program in the video section A is supplied from the video section cutout section 16, the caption cutout section 17, for example, starts from the time t ₁ ′ delayed by a predetermined time from the start time t ₁ of the video section A. Subtitle data up to the end time t ₂ of the section A is extracted from the program data as a subtitle group A synchronized with the video section A. Note that the work of creating subtitle data synchronized with the video is performed, for example, by the person who has watched the video of the program in the video section on the broadcast station side. It will be slightly delayed from the section. Accordingly, the caption cutout unit 17 extracts caption data from a time delayed by a predetermined time from the start time of the video section.

Similarly to the processing in the video section A, the caption cutout unit 17 extends from the time t ₂ ′ delayed by a predetermined time from the start time t _{2 of} the video section B to the end time t ₃ of the video section B. The caption data is extracted from the program data as a caption group B synchronized with the video section B.

  Next, FIG. 5 is a diagram illustrating the caption keyword group extracted from the caption group supplied from the caption cutout unit 17 by the caption keyword group extraction unit 18 of FIG.

  For example, the subtitle group A supplied from the subtitle cutout section 17 to the subtitle keyword group extraction section 18, as shown in FIG. 5, “Klinsaw belongs to the primrose family”, “Flower color is pink or white” , And "This year's flowering is late, the best time is next month." In this case, the caption keyword group extraction unit 18 extracts the words “clinics, primroses, white, pink, flowers, flowering, best time” included in the caption group A as caption keyword groups.

  Next, FIG. 6 is a diagram for explaining video sections and headings linked by the linking processing unit 25 in FIG.

  For example, it is assumed that a data broadcast for displaying the screen 30 shown in FIG. 2 is broadcast and the data broadcast receiving unit 19 receives the data broadcast. In this case, the headline acquisition unit 20 of FIG. 1 acquires “prefectural flower information flower forest” as the headline, and the headline related keyword group extraction unit 22 sets “Klinsaw, primrose, white, pink, The headline holding unit 23 extracts the heading “prefectural flower information flower forest” and the headline-related keyword group “Klinsou, primrose, white, pink, flowers, blooming, best season”. And are held in association with each other.

  Further, as described with reference to FIG. 5, the caption keyword group extraction unit 18 extracts the caption keyword group “Klinsaw, primrose, white, pink, flower, flowering, best time” and supplies it to the similarity evaluation unit 24. Suppose that In this case, the similarity evaluation unit 24 uses the headline-related keywords in which the subtitle keyword group “clinics, primroses, white, pink, flowers, flowering, best time” from the subtitle keyword group extraction unit 18 is held in the headline holding unit 23. Since it matches the group “Klinsou, Primrose, White, Pink, Flower, Flowering, Best time”, the headline related keyword group “Klinsou, Primrose, Specific information specifying “white, pink, flower, flowering, best time” is supplied to the linking processing unit 25.

  Then, based on the specific information, the linking processing unit 25 uses the heading “prefectural flower information flower forest” associated with the headline-related keyword group “Klinsou, primrose, white, pink, flower, flowering, best time”. "Is read from the headline holding unit 23, and link information that links the video section A and the headline" Prefectural Flower Information Flower Forest "is generated.

  Next, FIG. 7 is a flowchart for explaining processing in which the information processing apparatus 11 in FIG. 1 associates a headline with a headline-related keyword group.

  When the antenna 12 receives an RF signal being broadcast on television and supplies it to the data broadcast receiving unit 19, in step S11, the data broadcast receiving unit 19 receives and demodulates the RF signal from the antenna 12, and data Acquire text data and still images that are being broadcast. The data broadcast receiving unit 19 supplies the text data of the data broadcast to the header acquiring unit 20 and the body acquiring unit 21, and the process proceeds to step S12.

  In step S12, the headline acquisition unit 20 acquires headline data from the text data of the data broadcast supplied from the data broadcast reception unit 19 based on BML, and supplies the headline data to the headline holding unit 23. The processing is step S13. Proceed to

  In step S <b> 13, the text acquisition unit 21 acquires text data based on BML from the text data of the data broadcast supplied from the data broadcast receiving unit 19, and supplies it to the headline-related keyword group extraction unit 22.

  After the process of step S13, the process proceeds to step S14, and the headline related keyword group extraction unit 22 extracts the headline related keyword group from the text data supplied from the text acquisition unit 21, and supplies the headline related keyword group to the headline holding unit 23. The process proceeds to step S15.

  In step S15, the headline holding unit 23 associates and holds the headline supplied from the headline acquisition unit 20 in step S12 and the headline related keyword group supplied from the headline related keyword group extraction unit 22 in step S14. The process ends.

  Next, FIG. 8 is a flowchart for explaining processing in which the information processing apparatus 11 in FIG. 1 associates video segments with headings.

  When broadcasting of the program to be recorded is started and the RF signal of the program is supplied from the antenna 12 to the program receiving unit 13, the program receiving unit 13 receives the RF supplied from the antenna 12 in step S21. From the signal, the program data to be recorded is acquired. The program receiving unit 13 supplies the program data to the feature extracting unit 14 and the video segment extracting unit 16, and the process proceeds to step S22.

  In step S <b> 22, the feature extraction unit 14 analyzes the data of the program supplied from the program reception unit 13, and supplies the feature amount that is the analysis result to the video section determination unit 15.

  After the process of step S22, the process proceeds to step S23, and the video segment determination unit 15 determines a video segment cut out from the program based on the feature amount supplied from the feature extraction unit 14. Then, the video segment determination unit 15 generates chapter information that is information including the start time or end time of the video segment, and supplies the chapter information to the video segment cutout unit 16. The video segment cutout unit 16 cuts out a video segment from the program supplied from the program receiving unit 13 based on the chapter information supplied from the video segment determination unit 15 and subtitles the program data for each video segment. And supplied to the linking processing unit 25.

  After the process of step S23, the process proceeds to step S24, and the caption cutout unit 17 obtains subtitle data synchronized with the video from the program data for each video section supplied from the video section cutout unit 16 in step S23. Then, the subtitle keyword group extraction unit 18 is supplied, and the process proceeds to step S25.

  In step S25, the subtitle keyword group extraction unit 18 extracts a subtitle keyword group from the subtitle data for each video section supplied from the subtitle cutout unit 17, and supplies the subtitle keyword group to the similarity evaluation unit 24, and the process proceeds to step S26. move on.

  In step S <b> 26, the similarity evaluation unit 24 evaluates the similarity between the caption keyword group supplied from the caption keyword group extraction unit 18 in step S <b> 25 and the plurality of headline related keyword groups held in the headline holding unit 23. To do.

  After the process of step S26, the process proceeds to step S27, and the similarity evaluation unit 24 holds the headline related keyword group whose similarity evaluation with the subtitle keyword group is equal to or higher than a predetermined standard in the headline holding unit 23. It is determined whether or not.

  In step S27, when the similarity evaluation unit 24 determines that the headline related keyword group whose similarity evaluation with the caption keyword group is equal to or higher than a predetermined criterion is held in the headline holding unit 23, the process is step. Proceed to S28.

  In step S <b> 28, the similarity evaluation unit 24 supplies the linking processing unit 25 with specific information that identifies the headline-related keyword group having the highest similarity evaluation with the caption keyword group. The association processing unit 25 reads out the headline data associated with the headline-related keyword group specified by the specific information supplied from the similarity evaluation unit 24 from the headline holding unit 23, the headline data, In step S 23, link information that links the program data for each video segment supplied from the video segment cutout unit 16 is generated and supplied to the link information holding unit 26. The attachment information holding unit 26 holds the association information supplied from the association processing unit 25, and the process ends.

  On the other hand, if the similarity evaluation unit 24 determines in step S27 that the headline related keyword group whose similarity evaluation with the caption keyword group is equal to or higher than a predetermined criterion is not held in the headline holding unit 23, S28 is skipped and the process is terminated.

  As described above, the information processing apparatus 11 includes the headline-related keyword group having the highest similarity to the subtitle keyword group extracted from the subtitles in the video section in the program for each video section cut out by the video section cutout unit 16. The headline corresponding to can be linked. That is, the information processing apparatus 11 can associate an appropriate heading with the content of the program in the video section in the video section.

  Thereby, for example, when the recording / reproducing apparatus uses the association information held in the association information holding unit 26 of the information processing apparatus 11, the recorded frame is used as the first frame of the video section when reproducing the recorded program. A headline associated with the video section can be displayed together with the corresponding still image. Therefore, the user can grasp the contents of the video section from the still image and the headline, and can easily find the desired video section as compared with the conventional art.

  Further, for example, if the recording / reproducing apparatus can perform a search based on a keyword, the recording / reproducing apparatus searches the association information held in the association information holding unit 26 based on the keyword input by the user. The video section obtained as a result of the search can be presented to the user.

  Note that the information processing apparatus 11 is not limited to television programs and data broadcast data, but also, for example, video sections and data broadcast data distributed via a network such as the Internet. A process of associating a headline can be performed.

  In addition to cutting out the video section from the program being broadcasted on the television and performing processing for associating the video section and the headline, for example, the program cut out for each video section is recorded in the recording and playback device, In parallel with the process of reproducing the program, a process of associating the video section and the headline may be performed.

  That is, FIG. 9 is a block diagram showing a configuration example of another embodiment of the information processing apparatus to which the present invention is applied.

  In FIG. 9, the information processing apparatus 41 is connected to a recording / playback apparatus 42 via a network 43.

  The information processing apparatus 41 includes an antenna 44, a display unit 45, a caption processing unit 46, a heading processing unit 47, and a holding unit 48.

  The antenna 44 receives an RF signal being broadcasted on television and supplies it to the header processing unit 47.

  The display unit 45 displays programs that are broadcast on television and programs that are played back by the recording and playback device 42.

  The subtitle processing unit 46 includes the subtitle cutout unit 17 and the subtitle keyword group extraction unit 18 of FIG. 1, and program data reproduced by the recording / reproducing apparatus 42 is supplied for each video section. The caption processing unit 46 extracts caption data from the program data for each video section supplied from the recording / playback device 42, extracts caption keyword group data included in the caption, and uses the caption keyword group data as the caption keyword group data. This is supplied to the header processing unit 47.

  The headline processing unit 47 includes the data broadcast reception unit 19, the headline acquisition unit 20, the body text acquisition unit 21, the headline related keyword group extraction unit 22, the similarity evaluation unit 24, and the association processing unit 25 of FIG. The headline processing unit 47 is supplied with an RF signal from the antenna 44. The heading processing unit 47 extracts text data broadcast as a data broadcast from the RF signal from the antenna 44, and acquires heading data and body data from the text data based on BML. Then, the headline processing unit 47 extracts a headline-related keyword group from the text data of the text data, supplies the headline data and the headline-related keyword group data to the holding unit 48, and holds them in association with each other. .

  Further, when the caption keyword group data is supplied from the caption processing unit 46, the caption processing unit 47 evaluates the similarity between the caption keyword group and a plurality of header-related keyword groups held in the holding unit 48. To do. Then, the headline processing unit 47 extracts a headline associated with the headline-related keyword group having the highest similarity evaluation from the headline-related keyword group whose similarity evaluation is equal to or higher than a predetermined criterion from the holding unit 48. The link information that reads and links the video section corresponding to the caption keyword group supplied from the caption processing unit 46 and the headline read from the holding unit 48 is generated. Further, the header processing unit 47 supplies the association information to the recording / playback apparatus 42 via the network 43.

  The retaining unit 48 retains the heading data supplied from the heading processing unit 47 and the heading-related keyword group data in association with each other.

  The recording / playback device 42 includes, for example, a recording unit (not shown) such as a hard disk, and records or plays back a program. The program recorded in the recording / playback device 42 includes subtitles synchronized with the video, and is divided into video sections based on changes in the video feature.

  In addition, in order for the recording / playback device 42 to play back the recorded video and display it on the display unit 45 of the information processing device 41, the data of the program divided by the video section is transmitted via the network 43 to the information processing device 41. Is supplied to the recording / playback apparatus 42 from the headline processing unit 47 of the information processing apparatus 41. The recording / playback apparatus 42 records the association information supplied from the headline processing unit 47 in the recording unit.

  The network 43 is a digital interface that conforms to standards such as HDMI (High-Definition Multimedia Interface), DLNA (Digital Living Network Alliance), or IEEE (Institute of Electrical and Electronics Engineers) 1394.

  As described above, the information processing apparatus 41 can perform processing for associating the video section and the headline in parallel with the program reproduction by the recording / playback apparatus 42. The linking information for linking is recorded. Then, the user can easily find a desired video section of the program recorded in the recording / reproducing apparatus 42 based on the association information recorded in the recording / reproducing apparatus 42.

  Further, in general recording / playback apparatuses, data broadcasting is not provided with a function for recording data broadcasting because information without the advantage of time shifting such as weather forecast is broadcast. Also in the recording / playback apparatus, by connecting to the recording / playback apparatus 42 via the network 43 and using the functions provided in the recording / playback apparatus 42, association information that links the headline suitable for the content of the video section and the video section Can be recorded.

  The information processing apparatus 41 can display a message confirming that the headline is associated with the video section on the display unit 45, and can supply the association information to the recording / playback apparatus 42 after obtaining confirmation from the user. .

  By the way, the heading associated with the video section by the information processing apparatus 11 or 41 is used when the user searches for a desired video section. For example, a program is recorded by a DVD (Digital Versatile Disc) recorder (not shown). This can be used when printing program information on the disc label of the disc.

  For example, for a printer (not shown) that prints program information on a disc label, the title image, classification, title, number of stories, image, date and time, and index of the program are used as templates for information printed on the disc label. The position to print is set. The printer obtains data broadcast data corresponding to the program recorded on the disc from a data broadcast recording unit (not shown) in accordance with a user operation, and serves as information on the program to be printed on the disc label, That is, information such as the title image, classification, title, number of stories, image, date and time of the program is acquired.

  On the other hand, if the linking information corresponding to the program recorded on the disc is held in the linking information holding unit 26 according to the user's operation, the information processing apparatus 11 finds the heading linked to the program section. To the printer. Similarly, the information processing apparatus 41 supplies headings to the printer. Thereby, the printer acquires the headline supplied from the information processing apparatus 11 or 41 as information to be printed on the index of the disc label, and prints information of these programs on the disc label.

  The user can grasp in detail the content of the program recorded on the disc by the disc label on which the index is printed in this way. Further, the linking information corresponding to the index printed on the disc label may be recorded on the disc together with the program. Thereby, when the program recorded on the disc is reproduced, the heading corresponding to the program section is displayed, and the user can easily find and reproduce the desired program section.

  If there are many headings corresponding to the program recorded on the disc, the headings are displayed on a display unit (not shown), the user selects a heading to be printed on the disc label, and the user selects the heading selected. You may make it print. The background color of the disc label can be determined from the color of the title image acquired from the data broadcast.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software executes various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a program recording medium in a general-purpose personal computer or the like.

  FIG. 10 is a block diagram showing an example of the configuration of a personal computer that executes the above-described series of processing by a program. A CPU (Central Processing Unit) 101 executes various processes according to a program stored in a ROM (Read Only Memory) 102 or a storage unit 108. A RAM (Random Access Memory) 103 appropriately stores programs executed by the CPU 101 and data. These CPU 101, ROM 102, and RAM 103 are connected to each other by a bus 104.

  An input / output interface 105 is also connected to the CPU 101 via the bus 104. Connected to the input / output interface 105 are an input unit 106 made up of a keyboard, mouse, microphone, and the like, and an output unit 107 made up of a display, a speaker, and the like. The CPU 101 executes various processes in response to commands input from the input unit 106. Then, the CPU 101 outputs the processing result to the output unit 107.

  The storage unit 108 connected to the input / output interface 105 includes, for example, a hard disk, and stores programs executed by the CPU 101 and various data. The communication unit 109 communicates with an external device via a network such as the Internet or a local area network.

  A program may be acquired via the communication unit 109 and stored in the storage unit 108.

  The drive 110 connected to the input / output interface 105 drives a removable medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and drives programs and data recorded there. Get etc. The acquired program and data are transferred to and stored in the storage unit 108 as necessary.

  As shown in FIG. 10, a program recording medium for storing a program that is installed in a computer and is ready to be executed by the computer includes a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc-Read Only). Memory), DVD (Digital Versatile Disc), a magneto-optical disk, a removable medium 111 which is a package medium made of a semiconductor memory or the like, a ROM 102 in which a program is temporarily or permanently stored, or a storage unit 108 It is comprised by the hard disk etc. which comprise. The program is stored in the program recording medium using a wired or wireless communication medium such as a local area network, the Internet, or digital satellite broadcasting via a communication unit 109 that is an interface such as a router or a modem as necessary. Done.

  Note that the processes described with reference to the flowcharts described above do not necessarily have to be processed in time series in the order described in the flowcharts, but are performed in parallel or individually (for example, parallel processes or objects). Processing).

  The embodiments of the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

It is a block diagram which shows the structural example of one Embodiment of the information processing apparatus to which this invention is applied. It is a figure which shows the example of a display of the screen of data broadcasting. 4 is a diagram illustrating a video section that is determined by a video section determination unit 15 based on a feature amount supplied from a feature extraction unit 14. FIG. FIG. 10 is a diagram for explaining caption data extracted from the program data for each video section supplied from the video section cutting unit by the caption cutout unit. FIG. 5 is a diagram for explaining a caption keyword group extracted from a caption group supplied from a caption cutout unit 17 by a caption keyword group extraction unit 18. It is a figure explaining the video section and heading which were tied by the tied processing part. It is a flowchart explaining the process in which the information processing apparatus 11 matches a headline and a headline related keyword group. It is a flowchart explaining the process in which the information processing apparatus 11 matches a video area and a headline. It is a block diagram which shows the structural example of other embodiment of the information processing apparatus to which this invention is applied. And FIG. 11 is a block diagram illustrating an example of a configuration of a personal computer.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 11 Information processing apparatus, 12 Antenna, 13 Program receiving part, 14 Feature extraction part, 15 Video area determination part, 16 Video area cutout part, 17 Subtitle cutout part, 18 Subtitle keyword group extraction part, 19 Data broadcast receiving part, 20 Heading Acquiring unit, 21 Text acquiring unit, 22 Headline related keyword group extracting unit, 23 Headline holding unit, 24 Similarity evaluation unit, 25 Linking processing unit, 26 Linking information holding unit, 41 Information processing device, 42 Recording / playback device, 43 network, 44 antenna, 45 display unit, 46 caption processing unit, 47 headline processing unit, 48 holding unit

Claims (6)

In an information processing apparatus for processing a program and information related to the program,
Heading keyword extraction means for extracting a word included in the text as a heading keyword from the text linked to the heading included in the information related to the program;
Cutting means for cutting out a plurality of video sections from the program;
Subtitle keyword extraction means for extracting words included in the subtitles as subtitle keywords from subtitles synchronized with the video of the program for each video section cut out by the cutout means;
An evaluation means for evaluating the similarity between the caption keyword and the headline keyword;
An information processing apparatus comprising: a linking unit that links the headline associated with the text from which the headline keyword evaluated to have the highest similarity to the caption keyword is associated with the video section. Program receiving means for receiving the program;
The information processing apparatus according to claim 1, further comprising: an information receiving unit that receives information related to the program. The information processing apparatus according to claim 1, further comprising: a receiving unit that performs time division reception of the program and information related to the program. The information processing apparatus according to claim 1, further comprising: a video section determination unit that determines the video section cut out from the program by the cutout unit based on a change in a feature amount of a video of the program. In an information processing method for processing a program and information related to the program,
From the text associated with the headline included in the information related to the program, the word included in the text is extracted as a headline keyword,
Cut out multiple video segments from the program,
For each video section, from the subtitles synchronized with the video of the program, extract words included in the subtitles as subtitle keywords,
Evaluate the similarity between the caption keyword and the headline keyword,
An information processing method including the step of associating the headline associated with the text from which the headline keyword evaluated as having the highest similarity with the caption keyword is associated with the video section. In a program to be executed by a computer that processes a program and information related to the program,
From the text associated with the headline included in the information related to the program, the word included in the text is extracted as a headline keyword,
Cut out multiple video segments from the program,
For each video section, from the subtitles synchronized with the video of the program, extract words included in the subtitles as subtitle keywords,
Evaluate the similarity between the caption keyword and the headline keyword,
A program comprising the step of associating the headline associated with the text from which the headline keyword evaluated as having the highest similarity with the subtitle keyword is associated with the video section.

Images