JP2014207619A - Video recording and reproducing device and control method of video recording and reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique for detecting a reproduction scene of a video-recorded program using character information.SOLUTION: A video recording and reproducing device comprises: video recording means for receiving and video-recording a content; meta data storage means for extracting meta data from the content and storing the meta data; keyword acquisition means for acquiring the received keyword; selection display means for performing display for selecting a scene of the content from the metadata and the keyword; and reproduction means for reproducing the content on the basis of the result of the scene selection from the outside.

Description

  Embodiments described herein relate generally to a recording / playback apparatus and a control method for the recording / playback apparatus.

  There are various contrivances for content playback by the recording / playback apparatus. For example, according to the interval at which keywords appear as subtitles, the upper limit of chapters is determined by a technique for identifying an appropriate location as a playback start location, and when the upper limit is exceeded, chapters with short keyword occurrence intervals are combined It is.

  Also, links that link video content associated with a specific scene, subtitle lists and video display modes, one-segment switching between video display modes, and subtitles in programs that match the search keyword There are things that list and reproduce sentences, and those that quickly find a desired scene using subtitles.

  However, there is a demand for a technique for detecting a playback scene of a recorded program using character information, but means for realizing such demand is not known.

JP 2006-279290 A JP 2008-227909 A JP 2009-38775 A JP 2009-130469 A JP 2004-80476 A

  An object of the embodiment of the present invention is to provide a technique for detecting a playback scene of a recorded program using character information.

  In order to solve the above-described problem, according to the embodiment, a recording / playback apparatus acquires a keyword that is input and recorded, a metadata storage unit that extracts and stores metadata from the content, and an input keyword Keyword acquisition means for performing selection display means for performing display for selecting a scene of the content from the metadata and the keyword, and reproduction means for reproducing the content based on a result of the scene selection from the outside. Is provided.

The figure for demonstrating the recording / reproducing apparatus concerning one Embodiment. The figure for demonstrating the control part of the video recording / reproducing apparatus concerning one Embodiment. 1 is an overall functional configuration diagram of a recording / playback apparatus system. The figure which shows an example of the EPG information of embodiment. The figure which shows the timeline of the caption display used for the embodiment. The figure which shows an example of the caption information of the embodiment. The figure which shows an example of a search keyword acquisition part. The figure which shows the example of a list display / selection part. The flowchart of the control method of a video recording / reproducing apparatus.

Hereinafter, a recording / playback apparatus and a control method for the recording / playback apparatus according to an embodiment will be described in detail with reference to the drawings.
FIG. 1 shows an example of a broadcast receiving apparatus 100 as a recording / reproducing apparatus according to an embodiment.

The broadcast receiving apparatus 100 includes a main body provided with a display (display unit 400) for displaying video, and legs that support the main body in a state where it can stand on its own.
The broadcast receiving apparatus 100 includes a broadcast input terminal 110, a reception unit 111, a restoration unit 112, a communication interface 114, an audio processing unit 121, a video processing unit 131, a display processing unit 133, a control unit 150, an operation input unit 161, a card. A connector 164, a USB connector 166, a disk drive 170, a LAN connector 171, a power supply control unit 180, and a storage 190 are provided. The broadcast receiving apparatus 100 further includes a speaker 300 and a display 400.

  The broadcast input terminal 110 is an input terminal to which a digital broadcast signal received by the antenna 200 is input, for example. The antenna 200 receives, for example, a terrestrial digital broadcast signal, a BS (broadcasting satellite) digital broadcast signal, and / or a 110-degree CS (communication satellite) digital broadcast signal. That is, content such as a program supplied by a broadcast signal is input to the broadcast input terminal 110.

  The broadcast input terminal 110 supplies the received digital broadcast signal to the receiving unit 111. The receiving unit 111 is a receiving unit for digital broadcast signals. The receiving unit 111 tunes (tunes) the digital broadcast signal supplied from the antenna 200. The receiving unit 111 transmits the tuned digital broadcast signal to the restoration unit 112. When the signal supplied from the transmission input terminal 110 or the communication interface 114 is an analog signal, the reception unit 111 converts the signal into a digital signal.

  The restoration unit 112 demodulates the received digital broadcast signal. Further, the restoration unit 112 performs signal processing on the demodulated digital broadcast signal (content). Accordingly, the restoration unit 112 restores the video signal, the audio signal, and other data signals from the digital broadcast signal. For example, the restoration unit 112 restores a transport stream (TS) on which a video signal, an audio signal, and other data signals are superimposed from a digital broadcast signal.

  The restoration unit 112 supplies an audio signal to the audio processing unit 121. Further, the restoration unit 112 supplies a video signal to the video processing unit 131. Further, the restoration unit signal processing unit 113 supplies a data signal to the control unit 150. That is, the antenna 200, the reception unit 111, and the restoration unit 112 function as a reception unit that receives content.

  The communication interface 114 receives contents such as an HDMI (High Definition Multimedia Interface) terminal, an audio input terminal, an S video terminal, a component video terminal, a D video terminal, a D-Sub terminal, and a DVI-I terminal. Provide any or more of the possible interfaces. The communication interface 114 receives content in which a digital video signal, a digital audio signal, and the like are multiplexed from another device. The communication interface 114 supplies a digital signal (content) received from another device to the receiving unit 111. The communication interface 114 supplies content received from another device to the restoration unit 112. That is, the communication interface 114 functions as a receiving unit that receives content.

  The restoration unit 112 performs signal processing on the content supplied from the communication interface 114 via the reception unit 111. For example, the restoration unit 112 separates the digital signal into a digital video signal, a digital audio signal, and a data signal. The restoration unit 112 supplies a digital audio signal to the audio processing unit 121. The restoration unit 112 also supplies a digital video signal to the video processing unit 131. Further, the restoration unit 112 supplies the control unit 150 with other information regarding the content.

  Furthermore, the restoration unit 112 supplies the content to the storage 190 described later based on the control of the control unit 150. The storage 190 stores the supplied content. Thereby, the broadcast receiving apparatus 100 can record content.

  The audio processing unit 121 converts the digital audio signal received from the restoration unit 112 into a signal (audio signal) in a format that can be reproduced by the speaker 300. The audio processing unit 121 supplies an audio signal to the speaker 300. The speaker 300 reproduces sound based on the supplied audio signal.

  The video processing unit 131 converts the digital video signal received from the restoration unit 112 into a video signal having a format that can be reproduced on the display 400. That is, the video processing unit 131 decodes (reproduces) the video signal received from the restoration unit 112 into a video signal having a format that can be reproduced by the display 400. In addition, the video processing unit 131 superimposes an OSD signal supplied from an OSD processing unit (not shown) on the video signal. The video processing unit 131 outputs the video signal to the display processing unit 133.

  The OSD processing unit displays a GUI (graphic user interface) screen, subtitles, time, or other information based on the data signal supplied from the restoration unit 112 and / or the control signal supplied from the control unit 150. An OSD signal to be displayed in a superimposed manner is generated. The OSD processing unit may be provided individually as a module in the broadcast receiving apparatus 100 or may be provided as a function of the control unit 150.

  For example, the display processing unit 133 performs color tone, brightness, sharpness, contrast, or other image quality adjustment processing on the received video signal based on the control from the control unit 150. The display processing unit 133 supplies the video signal subjected to the image quality adjustment to the display 400. The display 400 displays a video based on the supplied video signal.

  The display 400 includes, for example, a liquid crystal display device including a liquid crystal display panel including a plurality of pixels arranged in a matrix and a backlight that illuminates the liquid crystal panel. The display 400 displays a video based on the video signal supplied from the broadcast receiving device 100.

  The broadcast receiving apparatus 100 may be configured to include a video output terminal instead of the display 400. Moreover, the broadcast receiving apparatus 100 may be configured to include an audio output terminal instead of the speaker 300. In this case, the broadcast receiving apparatus 100 outputs a video signal to a display device connected to the video output terminal, and outputs an audio signal to a speaker connected to the audio output terminal. Thereby, the broadcast receiving apparatus 100 can display an image | video on a display apparatus, and can output an audio | voice from a speaker.

  The control unit 150 functions as a control unit that controls the operation of each unit of the broadcast receiving apparatus 100. The control unit 150 includes a CPU 151, a ROM 152, a RAM 153, an EEPROM 154, and the like. The control unit 150 performs various processes based on the operation signal supplied from the operation input unit 161.

  The CPU 151 includes arithmetic elements that execute various arithmetic processes. The CPU 151 implements various functions by executing programs stored in the ROM 152, the EEPROM 154, or the like.

  The ROM 152 stores a program for controlling the broadcast receiving apparatus 100, a program for realizing various functions, and the like. The CPU 151 activates the program stored in the ROM 152 based on the operation signal supplied from the operation input unit 161. Thereby, the control part 150 controls operation | movement of each part.

  The RAM 153 functions as a work memory for the CPU 151. That is, the RAM 153 stores the calculation result of the CPU 151, the data read by the CPU 151, and the like.

The EEPROM 154 is a non-volatile memory that stores various setting information, programs, and the like.
The operation input unit 161 includes, for example, an operation key, a keyboard, a mouse, a voice input device, a touch pad, or another input device that can generate an operation signal according to the operation input. Further, the operation input unit 161 may be configured to include, for example, a sensor that receives an operation signal from a remote controller. Further, the operation input unit 162 may be configured to include the above input device and sensor. That is, the operation input unit 161 functions as an operation signal receiving unit that receives an operation signal.

  The operation input unit 161 supplies the input operation signal to the control unit 150. The control unit 150 causes the broadcast receiving device 100 to perform various processes based on the operation signal supplied from the operation input unit 161.

  The touch pad includes an electrostatic sensor, a thermo sensor, or a device that generates position information based on other methods. When the broadcast receiving device 100 includes the display 400, the operation input unit 161 may include a touch panel formed integrally with the display 400.

  The remote controller generates an operation signal based on a user operation input. The remote controller transmits the generated operation signal to the sensor of the operation input unit 161 by infrared communication. The sensor and the remote controller may be configured to transmit and receive operation signals by other wireless communication such as radio waves.

  The card connector 164 is an interface for communicating with, for example, a memory card 165 that stores moving image content. The card connector 164 reads moving image content data from the connected memory card 165 and supplies it to the control unit 150.

  The USB connector 166 is an interface for communicating with the USB device 167. The USB connector 166 supplies a signal supplied from the connected USB device 167 to the control unit 150.

  For example, when the USB device 167 is an operation input device such as a keyboard, the USB connector 166 receives an operation signal from the USB device 167. The USB connector 166 supplies the received operation signal to the control unit 150. In this case, the control unit 150 executes various processes based on the operation signal supplied from the USB connector 166.

  For example, when the USB device 167 is a storage device that stores content data of a moving image, the USB connector 166 can acquire content from the USB device 167. The USB connector 166 supplies the acquired content to the control unit 150.

  The disc drive 170 can be mounted with, for example, a compact disc (CD), a digital versatile disc (DVD), a Blu-ray disc (Blu-ray (registered trademark) Disk), or another optical disc M capable of recording moving image content data. Have a drive. The disk drive 170 reads content from the optical disk M to be loaded and supplies the read content to the control unit 150.

  The LAN connector 171 is an interface for connecting the broadcast receiving apparatus 100 to a network. When the LAN connector 171 is connected to a public line by a LAN cable or a wireless LAN, the controller 150 can download and upload various data via the network.

  The power control unit 180 controls power supply to each unit of the broadcast receiving apparatus 100. The power supply control unit 180 receives power from the commercial power supply 500 via an AC adapter, for example. The commercial power supply 500 supplies AC power to the power supply control unit 180. The power supply control unit 180 converts the received AC power into DC and supplies it to each unit.

  Moreover, the broadcast receiving apparatus 100 may further include another interface. The interface is, for example, Serial-ATA. The broadcast receiving apparatus 100 can acquire and play back content recorded in a device connected by an interface. Also, the broadcast receiving apparatus 100 can output the reproduced audio signal and video signal to a device connected by an interface.

  When the broadcast receiving apparatus 100 is connected to a network via an interface, the broadcast receiving apparatus 100 can acquire and reproduce content data of moving images on the network.

  The storage 190 is a storage device that stores content and the like. The storage 190 includes a mass storage device such as a hard disk (HDD), a solid state drive (SSD), or a semiconductor memory. The storage 190 may be configured by a storage device connected to the USB connector 166, the LAN connector 171, the communication interface 114, or another interface.

  As described above, when the content is recorded, the control unit 150 causes the content data demodulated by the restoration unit 112 to be input to the storage 190. Furthermore, the control unit 150 instructs the storage 190 to specify an address in the storage 190 that stores the content. The storage 190 stores the content supplied from the restoration unit 112 at the address designated by the control unit 150.

  The storage 190 may be configured to store a TS restored from a digital broadcast signal, or may be configured to store compressed content in which the TS is compressed by AVI, MPEG, or other compression methods. .

  In addition, the control unit 150 can read and play the content stored in the storage 190. For example, the control unit 150 instructs the storage 190 to specify an address in the storage 190. The storage 190 reads content from the address designated by the control unit 150. The storage 190 supplies the read content to the audio processing unit 121, the video processing unit 131, the control unit 150, and the like. Thereby, the broadcast receiving apparatus 100 can reproduce the recorded content.

  The broadcast receiving apparatus 100 includes a plurality of receiving units 111 and restoring units 112. Thereby, the broadcast receiving apparatus 100 can simultaneously receive a plurality of contents and restore the received plurality of contents at the same time. Thereby, the broadcast receiving apparatus 100 can simultaneously acquire a plurality of reproducible content data. That is, the broadcast receiving apparatus 100 can record a plurality of contents at the same time.

FIG. 2 shows an example of functions that the control unit 150 has. This relates to the telop described later.
As shown in FIG. 2, the control unit 150 can realize various functions by executing a program by the CPU 151. For example, the control unit 150 includes a character region extraction unit 1511, a character data recognition unit 1512, an error correction unit 1513, a keyword analysis unit 1514, and a storage unit 1515. Further, the control unit 150 includes a search unit 1521, a list display unit 1522, a list selection unit 1523, and a playback unit 1524.

  FIG. 3 shows the functional configuration of the recording / playback apparatus system. The system 30 includes a reception unit 31, a program recording unit 32, a metadata storage unit 33, a search keyword acquisition unit 34, a subtitle score calculation unit 35, a list display / selection unit 36, a reproduction unit 37, and the like.

  The receiving unit 31 mainly corresponds to the receiving unit 111. The program recording unit 32 is based on the restoration unit 122. The metadata storage unit 33 mainly corresponds to the control unit 150. The search keyword acquisition unit 34, subtitle score calculation unit 35, and list display / selection unit 36 also function based on the remaining part of the control unit 150. The playback unit 37 mainly corresponds to the audio processing unit 121, the video processing unit 131, and the display processing unit 133.

  The receiving unit 31, the program recording unit 32, and the storage 190 constitute recording means for inputting and recording content. The metadata storage unit 33 and the storage 190 constitute metadata storage means for extracting and storing metadata from content. The search keyword acquisition unit 34 constitutes a keyword acquisition unit that acquires an input keyword. The caption score calculation unit 35 and the list display / selection unit 36 constitute selection display means for performing display for selecting a scene of the content from the metadata and the keyword. The playback unit 37 constitutes playback means for playing back the content based on the result of this scene selection from the outside.

  The receiving unit 31 may use any broadcast signal format such as terrestrial digital broadcast or BS digital broadcast. It can be applied not only to broadcast waves but also to videos on the Internet. Further, even in a broadcast signal that cannot acquire caption information such as an analog signal, the present technology can be used as long as caption information can be acquired using a network and the caption information is associated with a broadcast program.

The program recording unit 32 stores the recorded program in a storage such as an HDD. The data format may be changed by converting to H.264.
The metadata storage unit 33 associates the program stored in the program recording unit 32 with EPG (Electronic Program Guide) information of the program, and stores the EPG information as metadata on a database configured on a storage such as an HDD. An example of a database storing EPG information is shown in FIG. A unique ID for identifying a program is created as a program ID. Based on the program ID, the program recorded by the program recording unit 32 can be found. All of the EPG data may be stored as metadata, or only necessary data may be extracted or converted as necessary. Here, the following description will be given by way of example based on the EPG information of FIG.

  The metadata storage unit 33 decodes the caption information in the recorded program. For example, FIG. 5 shows an example of the timing at which caption information should be displayed in a timeline. An example of a database storing caption information on this timeline is shown in FIG. The program ID, caption information, and the time when the caption is displayed on the screen are stored as metadata.

  FIG. 7 shows an input example of the search keyword acquisition unit 34. Such a UI is configured, and a user searches using a remote control or a keyboard. The keyword input method may use other means such as voice input and is not limited. As a search keyword, in addition to the input keyword, an object that is inferred, such as a higher-order concept or a symbol (for example, a landmark there if the place name), or a genre (or a semantic class or a group thereof) may be used. .

  The caption score calculation unit 35 calculates a score from a database storing the search keyword acquired from the search keyword acquisition unit 34 and the caption information. The score is preferably based on the search keyword input by the user and the degree the user desires. For example, elements such as channel, time, and genre (or semantic class and group) are arranged in order of appearance and time so that they can be displayed without bias. This is particularly useful when there are contents for multiple channels per week, for example. A method for calculating this score will be described below.

  The first score calculation method is a method of calculating a score based on the time when a search keyword appears. For example, in FIG. 6, the caption information at 12:01:05 has a high score, and the caption information at 12:00:35 has the next highest score. This is because the user wants the latest time. As a means for realizing this method, there is a method of multiplying the score by the difference between the current time and the time when the caption appears. As an example, a “coefficient that decreases by 1 (1/3600 per second) per hour” where the current time is 100 and the coefficient after 100 hours is 0 is used. By applying such a coefficient, it is possible to calculate a score giving priority to recent scenes.

  The second score calculation method is a method of counting the number of appearances of keywords that are continuous in a short time and using it as a score. For example, if one minute after the keyword appears is designated as a short time, “Tokyo” appears four times from 11:58:40 to 11:59:15 in the example of FIG. Since the time difference between 11:59:15 and 12:00:35 exceeds 1 minute, it is considered different. “Tokyo” appears three times from 12:00:35 to 12:01:05. A scene that appears four times has a high score.

  This short time may be a fixed time such as 1 minute or 3 minutes, or 3 minutes when appearing once, but may be changed to 1 minute when appearing for the second time or later. By the way, since it can be determined from the program ID that the programs are different, it is desirable not to count when the program ends.

  The third score calculation method is a method of not only counting the number of appearances but also taking the interval into account. In the example of FIG. 6, “Tokyo” appears after 11:58:40 at 11:58:55 for 15 seconds, then 10 seconds, and then 10 seconds. It is. The interval after 12:00:35 is an interval after 30 seconds. Since it seems that it is desirable that the intervals appear continuously at an appropriate interval rather than too short, the score is calculated by the following method, for example.

(A) Interval 0 seconds: even if multiple occurrences are counted as 1.0 (b) Interval 10 seconds or less: appearance number 0.8 and count (c) Intervals 25 seconds or less: appearance number 1.2 and count ( d) Interval ~ 45 seconds or less: Appearance number 1.0 and count (e) Interval ~ 60 seconds or less: Appearance number 0.9 and count According to this score calculation, from 11:58:40 to 11:59:15 The score is 1.0 + 1.2 + 0.8 + 0.8 = 3.8. The score from 12:00:35 to 12:01:05 is 1.0 + 1.0 = 2.0.

  The fourth score calculation method is a method that uses the classification of search keywords. In a processing system that recognizes keywords based on a word dictionary, it is possible to register word classifications in the dictionary. For example, for “Tokyo”, “Japan”, and “Nagoya”, dictionary data having a classification of “place” is created in advance. Even if “Nagoya” is used as a search keyword, there is no scene that matches “Nagoya” in the example of FIG. Therefore, another keyword whose classification is “location” is searched. A score is calculated from subtitle information including “Tokyo” and “Japan” having the same “location” classification. “Tokyo” and “Nagoya” can be subdivided into “location” and “city”, and “Japan” can be subdivided into “location” and “country”. In this case, the score of “city” that matches the subdivision classification is increased, and the score of “country” that does not match is calculated lower. In this way, even when there is no scene that matches the search keyword, it is possible to realize an ambiguous search using a keyword whose classification matches.

  The fifth score calculation method uses EPG meta-information. The EPG information in FIG. 4 includes “Tokyo” in the program details. Therefore, a method is adopted in which a score is given a priority so that a program including a keyword in the EPG information is given priority, or a score value is raised.

  FIG. 8 shows a display example of the list display / selection unit 36. Based on the score calculated by the caption score calculation unit 35, a list is displayed on the screen in the order of the score. The list may display not only the time of the acquired scene but also the title, channel, program start / end time, calculated score, and the like of the program including the scene. A scene capture screen may be displayed as an index. The user selects a list using a remote controller or the like.

  The playback unit 37 identifies and plays back the recorded program from the list selected by the list display / selection unit 36. At this time, playback is started not from the beginning of the program but from the point detected as a scene.

  The playback unit 37 may start playback from several seconds before, not just from the time detected in the scene. For example, by playing from 5 seconds before the start of the scene, a desired scene starts 5 seconds after selecting the list and starting playback. If EPG meta-information is used and the program genre is a program that can be determined that there is no delay in subtitles and audio, such as drama or animation, the program will be played 1 second before the start of the scene, and other programs will be played 5 seconds before It is also possible to play.

  Even when the subtitle display function is OFF, the playback unit 37 may display the subtitle only at the timing of displaying the subtitle in which the search keyword is displayed. The search keyword may be displayed on the screen at a timing when the search keyword is displayed separately from the caption.

  The reproduction unit 37 may display a countdown on the screen until a time when a subtitle that matches the search keyword is displayed. You may display with pictures, such as a time bar, instead of a numerical value.

  If the environment is connected to a network, the playback unit 37 may specify a playback position in combination with scene information acquired from the network. For example, in the top list of FIG. 8, the scene starts at 12:01:05, but in the scene cut information on the network (for example, TimeOn ((R), hereinafter omitted)), the scene start is 12:00. If it is: 00, playback starts from 12:00:00. When subtitle scene information, which is one of character information, and scene information on the network are too far apart in time, it is desirable to give priority to subtitle scene information. Therefore, for example, if the scene information on the network starts within 2 minutes from the start time of the caption scene information, the start point can be adopted, and if not, the caption scene information can be adopted. Further, the user may select whether to use subtitle scene information or network scene information. When there is scene information on the network in the list display / selection unit 36, the information may be displayed together and selected by the user.

  The reproduction unit 37 may determine the reproduction position in combination with a telop detection technique for detecting a character (telop) appearing in an image which is one of character information on the screen. The telop detection is a technique for recognizing a character string in a video and detecting a scene break by the change. This technique is based on, for example, an invention by the same inventors as the present application (Japanese Patent Application No. 2011-248858).

The same process as the scene cut information on the network can be performed using the scene cut information (for example, telop bot) by the telop detection.
The playback unit 37 may determine the playback position in combination with the silence detection process. Silence detection is performed by analyzing the waveform of a voice and using a point where there is no particular change in the waveform as a silent part, and various methods have been proposed. A silence point is detected from the past audio data of the time detected as a scene, and playback is started from the silence point.

  The reproduction unit 37 may determine the reproduction position by using voice recognition or voice synthesis as character information that can be extracted. There are two types of subtitles in appearance timing. One is anime, drama, etc., and subtitles are created in advance, so the subtitles and the sound pronunciation time almost coincide. The other is a news program, etc., which is broadcast in real time and has a time lag of several seconds to several tens of seconds after the sound is pronounced until the subtitles are displayed. Therefore, a point that matches the search keyword is detected by using past audio information from the time when the caption is displayed. This is the scene playback start point. Also, there is a method of detecting a position having a high correlation by using speech synthesis, comparing the speech waveform of the search keyword synthesized by speech with the speech waveform past the time when the caption is displayed. This method can be realized even in an environment with low processing performance.

  With the above-described caption score calculation processing, scenes matching the search keyword can be acquired in the order that the user desires. Improved the accuracy of the scene start point by devising it during playback.

The control method of the recording / reproducing apparatus described in the broadcast receiving apparatus 100 is as shown in FIG.
Step S91: This is a recording step for recording by inputting contents. For example, the receiving unit 31 receives one or more digital broadcast signals from the antenna. The program recording unit 32 records a recorded program received from a broadcast signal in a storage 190 such as an HDD.

Step S92: This is a metadata storage step for extracting and storing metadata from the content. The metadata storage unit 33 stores, for example, EPG information of the program recorded by the program recording unit 32 as metadata in a database on the storage 190 in units of programs.

Step S93: This is a keyword acquisition step for acquiring an input (search) keyword. The search keyword acquisition unit 34 receives a search keyword from the user.
Step S94: This is a selection display step for performing display for selecting a scene of the content from the metadata and the keyword. The caption score calculation unit 35 calculates a score using the database 190 storing the search keyword and, for example, caption information. The list display / selection unit 36 displays the list in the order of the scores obtained by the subtitle score calculation unit 35. The list displays a program title based on EPG information, a start time of a scene to be displayed in subtitles, or an elapsed time from the start of the program.

Step S95: This is a reproduction step of reproducing the content based on the result of this scene selection from the outside. The playback unit 37 reads the program selected by the list display / selection unit 36 from the storage 190 and plays back the scene at the caption display time.

  The recording / playback apparatus according to the embodiment as the entire system configuration includes a receiving unit, a program recording unit, a metadata storage unit, a storage, a search keyword acquisition unit, a caption score calculation unit, a list display / selection unit, and a playback unit. Device.

  The metadata storage unit stores the caption information as metadata in a database on the storage as storage related to the metadata and time. At this time, the time when the subtitles are displayed on the screen is stored together in the database.

  As a score calculation configuration, the subtitle score calculation unit may perform a score calculation process that takes into account the appearance time of the search keyword (score calculation method 1). The subtitle score calculation unit may perform score calculation processing that takes into account the number of search keywords that appear continuously in a short time (score calculation method 2). The subtitle score calculation unit may perform score calculation processing that takes into account the appearance intervals of search keywords that appear continuously in a short time (score calculation method 3). Further, the caption score calculation unit may identify a classification of the search keyword, and may perform a score calculation process in consideration of the degree of association of the scene that matches the classification (score calculation method 4). The subtitle score calculation unit may perform score calculation processing that considers whether or not the EPG title, program information, and program details match. Moreover, it is good also as a score calculation process which considered the relevance degree of the keyword based on the genre of the keyword etc. (score calculation method 5 (combination of EPG)).

  As the playback method 1, the playback unit starts playback several seconds before the playback point of the subtitle scene. As the reproduction method 2, the reproduction unit displays and reproduces the subtitles including the search keyword even if the subtitle display is OFF. Alternatively, the keyword is drawn on the screen at the subtitle display timing. As the reproduction method 3, the reproduction unit displays a countdown until the time when the subtitle of the search keyword is displayed.

  Also, as a playback method (using network information together), the playback unit uses scene cut information (TimeOn) obtained through the network together and starts playback from the start point of the scene.

As a playback method (combined use with telop detection), the playback unit also uses the result of telop detection and starts playback from the start point of the scene.
As a playback method (combined with silence detection), the playback unit analyzes the sound before and after the caption is displayed, detects a silence point, and starts playback from the previous silence point.
As a playback method (a combination of voice recognition and voice synthesis), the playback unit performs voice recognition of the search keyword and detects a scene start point by voice. Playback starts a few seconds before the scene start point. The processing load may be reduced by performing speech synthesis and detecting a speech scene that matches the speech synthesis result as a kind of character information.

  As a gist of the embodiment, when a broadcast program is stored in a storage such as an HDD, subtitle information in the program is acquired and stored in a database. Based on the search keyword input by the user and the caption information on the database, scenes that the user would like to see are found from all recorded programs and displayed in a list to the user. The user selects a desired scene from the displayed scene list screen and reproduces it. It is played from the beginning of the scene, not from the beginning of the program.

(Effect of embodiment)
Conventionally, there has been a method of recommending a program that matches a search keyword using program information such as EPG. However, this method has a problem that even if a program is found, it is difficult to find a scene in the program. That is, the user has to watch the program from the beginning and search for a desired scene in the program. This method detects a playback scene of a recorded program using caption information. The subtitle indicates the point at which the search keyword is pronounced, and it is possible to save the user from searching for the scene by reproducing the detected point.

In addition, this invention is not limited to the said embodiment, In the range which does not deviate from the summary, it can implement in various modifications.
Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements according to different embodiments may be appropriately combined.

  DESCRIPTION OF SYMBOLS 100 ... Broadcast receiving apparatus, 110 ... Broadcast input terminal, 111 ... Reception part, 112 ... Restoration part, 114 ... Communication interface, 121 ... Audio processing part, 131 ... Video processing part, 133 ... Display processing part, 150 ... Control part, 151 ... CPU, 152 ... ROM, 153 ... RAM, 154 ... EEPROM, 161 ... operation input unit, 164 ... card connector, 165 ... memory card, 166 ... USB connector, 167 ... USB device, 170 ... disk drive, 171 ... LAN Connector, 180 ... Power supply control unit, 190 ... Storage, 200 ... Antenna, 300 ... Speaker, 400 ... Display, 500 ... Commercial power supply, 1511 ... Character area extraction unit, 1512 ... Character data recognition unit, 1513 ... Error correction unit, 1514 ... Keyword analysis unit, 1514a ... Keyword dictionary, 151 ... storage unit, 1521 ... search unit, 1522 ... list display portion, 1523 ... list selecting unit, 1524 ... reproduction unit.

Claims (12)

Recording means for inputting and recording content,
Metadata storage means for extracting and storing metadata from the content;
A keyword acquisition means for acquiring an input keyword;
Selection display means for performing a display for selecting a scene of the content from the metadata and the keyword;
A recording / playback apparatus comprising playback means for playing back the content based on a result of the scene selection from the outside.   The recording / playback apparatus according to claim 1, wherein the metadata includes an appearance time of character information related to the scene selection.   The recording / reproducing apparatus according to claim 1, wherein the selection display unit calculates a score of character information related to the scene selection and performs display based on the score.   The recording / playback apparatus according to claim 3, wherein the score is calculated in consideration of a time at which the keyword appears.   The recording / playback apparatus according to claim 3, wherein the score is calculated in consideration of the number of appearances of the keyword that appears continuously in a relatively short time.   The recording / playback apparatus according to claim 3, wherein the score is calculated in consideration of an appearance interval of the keyword that appears continuously in a relatively short time.   The recording / playback apparatus according to claim 3, wherein the score is calculated in consideration of a scene relevance level based on the keyword classification.   The recording / playback apparatus according to claim 3, wherein the score is calculated by using EPG together.   The recording / playback apparatus according to claim 3, wherein the selection display unit displays a list in the order of the scores.   The recording / reproducing apparatus according to claim 2, wherein the reproduction unit reproduces the content at the presentation time.   The recording / reproducing apparatus according to claim 10, wherein the reproduction unit reproduces the content from several seconds before the display time. A control method for a recording / playback apparatus,
A recording process in which content is input and recorded;
A metadata storage step of extracting and storing metadata from the content;
A keyword acquisition process for acquiring input keywords;
A selection display step for performing display for selecting a scene of the content from the metadata and the keyword;
And a reproduction step of reproducing the content based on a result of the scene selection from the outside.

Images