JP2007060222A - Apparatus, method and program for processing video - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently recognize the outline of video contents and to efficiently extract a required scene by using an accurate representative image. <P>SOLUTION: An analysis processing part 211 detects whether or not a separated display selection caption is changed. When the display selection caption is changed, the representative image is registered on the basis of the display selection caption. In the meantime, when there is no display selection caption, a silent state is determined, and the analysis processing part 211 confirms whether or not the holding time of the silent state is prescribed reference time or longer. When the holding time of the silent state is the reference time or longer, shifting to a silent mode is performed, and the analysis processing part 211 calculates a difference between respective video data. Then, when the difference becomes a reference value or more, the analysis processing part 211 registers the representative image for the latter image data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a video processing apparatus, a video processing method, and a video processing program therefor for viewing video in a short time.

  Today, various contents are provided through broadcasting and networks. This content includes a video showing a moving image. There is a case where such video content is desired to be confirmed in a short time. In such a case, there is a case where recording is performed and fast-forwarding is confirmed, or a digest function of the recording device is used. However, in the case of fast-forwarding a recording tape, the search is performed by looking at the video projected at a high speed, so the important screen may be overlooked. The digest function of the recording apparatus uses a digest that is mechanically generated based on the color, shape, or movement on the screen, but it may be difficult to grasp the entire flow depending on the video.

  In some cases, closed captions (subtitle broadcasting) transmitted in synchronism with audio of a television broadcast are used. In this closed caption, a voice-coded audio code or the like is inserted into the 21st horizontal scanning line of the television signal. Closed caption data can be separated from the television signal by a dedicated decoder.

A technique related to a video search apparatus that searches for video based on such closed caption data is disclosed (see, for example, Patent Document 1). In the video search device described in Patent Document 1, upon receiving an instruction for “preparation for search” from the input unit, the video playback unit starts playback of the medium, and the decoder decodes the television signal to obtain closed caption data. And store it in memory. When “search request setting” is received from the input unit, the sentence search unit searches closed caption data in the memory, and the search result is stored in the memory. Further, the search result recorded in the memory is read out and sent to the decoder, which converts it into a television signal and displays it on the video display unit. Thereby, the content of the video can be easily searched using the text information of the closed caption corresponding to the video.
Japanese Patent Laid-Open No. 7-212708 (first page)

  However, closed caption data is not always recorded in an important scene in the video. In other words, important information may be provided through video even in a silent state without sound. In such a case, if the digest is created based only on the closed caption data, an appropriate digest may not be generated, and the content may not be grasped.

  The present invention has been made to solve the above-mentioned problems, and its purpose is to make it possible to efficiently view a video in a short time by using a more accurate representative image, and to grasp an outline of the content. It is an object to provide a video processing apparatus, a video processing method, and a video processing program.

In order to solve the above problem, the invention according to claim 1 is characterized in that a signal acquisition unit that acquires a broadcast signal including caption data, a separation unit that separates at least caption data and video information from the broadcast signal, A video processing apparatus comprising analysis means for analyzing subtitle data and pointer information storage means for recording pointer information for extracting representative images from the recorded video information and displaying the video information of the representative images. The analysis means detects a subtitle display timing, executes a first registration process for recording pointer information of video information in conjunction with the display timing, and when subtitle data is not detected, a predetermined registration is performed. The gist is to execute the second registration process for recording the pointer information of the video information according to the rule.

  According to a second aspect of the present invention, in the video processing device according to the first aspect, the video processing device transmits pointer information recorded in the pointer information storage means to a user terminal via a network. The gist of the present invention is to further include a transmitting means.

  According to a third aspect of the present invention, in the video processing device according to the first or second aspect, the video processing device further includes video information storage means for recording video information separated from a broadcast signal, and the pointer information And an extractor for extracting a representative image from the video information recorded in the video information storage means.

  According to a fourth aspect of the present invention, in the video processing device according to any one of the first to third aspects, the registration rule calculates a difference between continuous video information, and the difference is equal to or greater than a reference value. In this case, the gist is to record the pointer information related to the video information.

  According to a fifth aspect of the present invention, in the video processing device according to any one of the first to fourth aspects, the analysis unit records the subtitle data separated by the separation unit in association with the pointer information. This is the gist.

  According to a sixth aspect of the present invention, in the video processing device according to any one of the first to fifth aspects, the analyzing unit associates representative image data specified by the pointer information with the pointer information. The gist is to record.

A seventh aspect of the present invention is the video processing apparatus according to any one of the first to sixth aspects, wherein the video processing apparatus further includes a correction unit for the pointer information.
The invention according to claim 8 is a signal acquisition means for acquiring a broadcast signal including caption data, a separation means for separating at least caption data and video information from the broadcast signal, an analysis means for analyzing the caption data, This is a method of registering video information using a video processing apparatus that includes a pointer information storage unit that extracts a representative image from recorded video information and records pointer information for displaying the video information of the representative image. The analysis means detects a subtitle display timing, executes a first registration process for recording pointer information of video information in conjunction with the display timing, and when subtitle data is not detected, a predetermined registration is performed. The gist is to execute the second registration process for recording the pointer information of the video information according to the rule.

  The invention described in claim 9 is a signal acquisition means for acquiring a broadcast signal including caption data, a separation means for separating at least caption data and video information from the broadcast signal, an analysis means for analyzing the caption data, A program for registering video information using a video processing device that includes a pointer information storage unit that extracts a representative image from recorded video information and records pointer information for displaying the video information of the representative image. The analysis means detects a subtitle display timing, performs a first registration process for recording pointer information of video information in conjunction with the display timing, and when subtitle data is not detected, a predetermined registration is performed. The gist is to function as a means for executing a second registration process for recording pointer information of video information according to a rule.

(Function)
According to the first, eighth, and ninth aspects of the invention, the analysis unit detects the display timing of the caption, and executes the first registration process for recording the pointer information of the video information in conjunction with the display timing, Furthermore, when subtitle data is not detected, the 2nd registration process which records the pointer information of video information according to a predetermined registration rule is performed. Thereby, pointer information can be recorded even in a silent state in which no caption data is detected. Here, as the pointer information, it is possible to use time data by a clock means provided in the video processing device or frame count data by a frame counter provided in the video processing device. Since the representative image can be extracted by using the pointer information, the user can grasp the video content in a short time.

  According to the second aspect of the present invention, the pointer information recorded in the pointer information storage means is transmitted to the user terminal via the network. Thereby, the load which produces | generates pointer information in a user terminal can be reduced.

According to the invention described in claim 3, since the representative image is extracted using the pointer information, the content can be grasped by confirming the representative image.
According to the fourth aspect of the present invention, the difference between successive video information is calculated, and the pointer information related to the video information is recorded when the difference exceeds a reference value. Thereby, the representative image can be specified based on the change of the video.

According to the invention described in claim 5, since the caption data is recorded in association with the pointer information, it is possible to grasp the content while browsing the caption.
According to the sixth aspect of the present invention, since the representative image is recorded in association with the pointer information, the representative image can be efficiently displayed.

  According to the seventh aspect of the present invention, since the video processing apparatus includes the pointer information correcting means, the pointer information can be corrected to an appropriate position.

  According to the present invention, by using a more accurate representative image, it is possible to efficiently view a video in a short time and grasp the outline of the content. And a necessary scene can be extracted efficiently.

(First embodiment)
Hereinafter, a first embodiment embodying the present invention will be described with reference to FIGS. FIG. 1 is an explanatory diagram for explaining a configuration of a video processing apparatus to which the present invention is applied. In this embodiment, as shown in FIG. 1, a broadcast signal from a broadcast station is received using a television receiver 30. A recording device 20 is connected to the television receiver 30. For example, the recording device 20 functions as a video processing device, and a hard disk recorder device can be used.

  The broadcasting station 10 is a facility that broadcasts programs using terrestrial waves or satellite waves. The broadcast signal of the broadcast program includes video data and audio data. The video data is moving image data, and the audio data is data relating to audio that is reproduced in synchronization with the video data.

Also, the broadcast signal includes subtitles that are always displayed as video and subtitles that are displayed by selection. The former includes introductions of program titles and casts, Japanese subtitles in overseas works, etc. On the other hand, subtitle data (so-called closed caption) that can be displayed and selected as in the latter case may include text data corresponding to a performer's conversation, and explanations about broadcast content such as BGM and sound effects. is there. In this way, caption data that can be selected to be displayed or not is referred to as “display selected caption data”.

  Next, the display selection subtitle data will be described. For example, in NTSC analog terrestrial broadcasting, 525 scanning lines are used for video signals. Of these 525 lines, the first 21 lines of each field (one field is composed of 2 fields) is called VBI (Vertical Blanking Interval), and is used as an interval for starting scanning. Assigned. The closed caption is configured to be transmitted by multiplexing a 7-bit character code in the 21st VBI of the VBI of each field. Each field can be used to transmit two types of character sets at about 60 characters / second. This display selection subtitle data is decoded from the video data at the time of reproduction, and can be displayed simultaneously with the video.

  The user uses the television receiver 30 to receive a broadcast signal composed of video data and audio data including display selection subtitle data. The television receiver 30 includes a tuner 31, a signal processing unit 32, and an output unit 33 including a display and a speaker. When the display selection subtitle data is not displayed, the broadcast signal selected by the tuner 31 is demodulated by the signal processing unit 32, the video signal is output to the display, and the audio signal is output to the speaker by the output unit 33. You can watch the program.

  The recording device 20 acquires a broadcast signal selected by the tuner 31 of the television receiver 30 and decodes a video signal and an audio signal. Then, based on the user's operation input, the display selection subtitle data is extracted and decoded.

  Further, the recording device 20 generates metadata and uses this to create a digest of the recording data. This digest is data for displaying a list of representative images that are characteristic of the video. As shown in FIG. 2, this metadata includes a time code as pointer information for specifying a representative image in the video for each program ID. Further, when there is a selected display subtitle associated with this image, text data corresponding to this selected display subtitle is recorded in association with the time code.

  The recording device 20 includes a control unit including a CPU (Central Processing Unit), and a data storage unit such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an HDD (Hard Disk Drive). FIG. 3 shows a block configuration of the recording device 20. It is a functional block diagram for demonstrating the function (The function performed by the video processing program which CPU performs) which the video recording apparatus 20 performs.

A block diagram of the recording apparatus 20 is shown in FIG.
Of the broadcast signals selected by the tuner 31 of the television receiver 30, the video signal and the audio signal including the display selection subtitle data are respectively input to the video signal decoder 201 and the audio signal decoder 202 from predetermined input terminals. The

  The video signal decoder 201 functions as a signal acquisition unit, decodes the supplied video signal, and supplies the decoded video data to the memory 203. The memory 203 is a frame memory that temporarily holds the supplied video signal. The audio signal decoder 202 decodes the supplied audio signal and outputs the decoded audio data.

When the received broadcast signal is output in real time, the display selection subtitle data decoder 205 acquires video data from the memory 203. When the display selection subtitle data is instructed to be displayed, the display selection subtitle data decoder 205 functions as a separation unit that separates the video information for decoding the display selection subtitle data included in the acquired video data. And
Corresponding text data is supplied to an OSD (On Screen Display) 206 and video data is supplied to a composition processing unit 207.

  The OSD 206 converts the supplied text data into OSD data, which is image data to be displayed superimposed on the display screen, and supplies the OSD data to the composition processing unit 207. The composition processing unit 207 superimposes the supplied OSD data on the supplied video data, and outputs it from the output terminal to the display of the output unit 33 of the television receiver 30. Also, the audio processing unit 208 acquires the audio data decoded by the audio signal decoder 202 and outputs it to the speaker of the output unit 33 of the television receiver 30.

The program ID extraction unit 210 extracts the program ID included in the program management data from the video data held in the memory 203.
The recording management unit 209 functions as an extraction unit that extracts a representative image from video information. The recording management unit 209 refers to the built-in timer to acquire the time (absolute time) at which recording was started, and from among the video data supplied from the memory 203 or the audio data supplied from the audio signal decoder 202 The acquired time information is added to at least one of the above. Further, the program ID supplied from the program ID extraction unit 210 is added to the video data and audio data, and the video data and audio data are supplied to the recording data storage unit 22 as video information storage means. The time information added here is used as a time stamp in processing to be described later. The recorded data storage unit 22 stores video data and audio data to which a program ID and a time stamp are added. The recorded data storage unit 22 is constituted by a large-capacity recording medium such as a hard disk, for example, but a removable recording medium such as a DVD (Digital Versatile Disk) or a video tape can also be used.

The display selection subtitle data decoder 205 decodes the display selection subtitle data included in the acquired video data and supplies the corresponding text data to the analysis processing unit 211.
The analysis processing unit 211 functions as an analysis unit, and executes subtitle mode processing (first registration processing) and silent mode processing (second registration processing). These two processes will be described with reference to FIGS. Here, as a registration rule, a rule is used in which a difference between successive video data is calculated, and pointer information relating to video information is recorded when the difference exceeds a reference value.

  First, subtitle mode processing will be described with reference to FIG. In this caption mode processing, it is detected whether or not display selection caption data is included in the video data (step S1-1). When the display selection subtitle data can be separated (in the case of “YES” in step S1-1), the analysis processing unit 211 detects the display timing of the display selection subtitle and registers the representative image in conjunction with the display timing. Perform (step S1-2). Specifically, the text data corresponding to the display selection subtitle data supplied from the display selection subtitle data decoder 205 is divided into text groups of appropriate lengths, and the divided text groups are sent to the time code addition processing unit 213. Supply.

  On the other hand, when the display selection subtitle data is not included and separation is not possible (in the case of “NO” in step S1-1), it is determined that the state is silent. In this case, the analysis processing unit 211 starts a timer and measures the duration of the silent state. Then, the analysis processing unit 211 acquires a reference time recorded in a predetermined memory, and compares whether or not the unvoiced state holding time continues longer than the reference time (step S1-3). If the unvoiced state retention time exceeds the reference time (in the case of “YES” in step S1-3), the process of the silent mode (FIG. 5) is executed. If the unvoiced state holding time has not reached the reference time (in the case of “NO” in step S1-3), the process returns to step S1-1.

Next, the silent mode processing will be described with reference to FIG. In the silent mode process, the analysis processing unit 211 calculates a difference between the video data (step S2-1). Specifically, the analysis processing unit 211 calculates a difference between the current image and the next image (an image after a predetermined time has elapsed) as a numerical value. For this difference, it is also possible to use the total value of changes in the color signal and intensity signal of each pixel constituting the image and the magnitude of the motion vector.

  Then, the analysis processing unit 211 compares this difference with a predetermined reference value (step S2-2). If the difference is equal to or greater than the reference value (“YES” in step S2-2), it is determined whether or not the display selection subtitle data is separated from the image for which the difference is calculated (step S2-3). When the display selection subtitle data is separated (in the case of “YES” in step S2-3), the processing returns to the subtitle mode processing (step S2-4).

  On the other hand, if the difference is equal to or greater than the reference value and the display selection subtitle data is not separated at this stage (in the case of “NO” in step S2-3), the analysis processing unit 211 stores the subsequent image data. The representative image is registered (step S2-5). In this case, since there is no text corresponding to the display selection subtitle, the analysis processing unit 211 supplies text data including “unvoiced” characters to the time code addition processing unit 213 as a representative image registration instruction.

  As shown in FIG. 6, "Subtitle 1" at times 1 and 2 and "Subtitle 2" at times 3 to 4 are used as triggers for registering pointer information of the representative image. Also, the silent mode is entered from time 6 when a predetermined time has elapsed from time 5, and the change value of the image is calculated at time 6 or higher. The time 7 that exceeds the reference value is used as a trigger for registering the representative image. Further, at time 8, the subtitle mode is restored.

  The function of the time code addition processing unit 213 that receives a representative image registration instruction from the analysis processing unit 211 will be described with reference to FIG. The time code addition processing unit 213 uses the timer 212 to add the time at which the representative image registration instruction is received as a time code. For example, in the case of text corresponding to a display selection subtitle, a time code corresponding to the start time of the display selection subtitle is added. When the broadcast signal is acquired in real time for the broadcast, the time code addition processing unit 213 adds the time code to the text data based on the current time indicated by the timer 212. If the time code addition time is delayed with respect to the program broadcast time, the time code addition processing unit 213 corresponds to the broadcast time of the program based on the delay time and the current time indicated by the timer 212. The time code is calculated and added to the text data. The time code addition processing unit 213 supplies the text data with the time code added to the metadata generation unit 214.

  The metadata generation unit 214 generates the metadata by adding the program ID information supplied from the program ID extraction unit 210 to the text data to which the time code is added. Then, the metadata is recorded in the digest data storage unit 23 as pointer information storage means.

  Next, processing when viewing a program in a short time using this metadata will be described. In this case, the operation input unit 200 of the recording apparatus is used. The operation input unit 200 and the display unit are configured by input devices such as buttons, keys, a touch panel, a touch pad, and a lever, and receive user operation inputs. The display unit is composed of, for example, an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and displays various types of information. When the viewing target program ID is input to the operation input unit 200, the recording management unit 209 extracts the metadata to which the program ID is added from the digest data storage unit 23. Then, the recording management unit 209 searches the recording data storage unit 22 based on the time code and the program ID included in the metadata, and reads the recording data of this program.

  Then, the recording management unit 209 identifies a screen corresponding to the time code, and generates list screen data in which images are listed in order from an earlier time of the time code. In each image, text data included in the metadata is displayed. Furthermore, the recording management unit 209 adds a time code to each image. The list screen data is output to the display unit. Thereby, the user can grasp | ascertain the outline | summary of an image | video. Further, by selecting a predetermined representative screen in the list screen, the reproduction of the recording is started from the position desired by the user. Also in this case, the recording management unit 209 reproduces the video from the recording data storage unit 22 based on the time code associated with the representative image.

As described above, according to the present embodiment, the following effects can be obtained.
In the above embodiment, when the display selection subtitle can be separated, the analysis processing unit 211 registers the representative image based on the display selection subtitle (step S1-2). On the other hand, if the display selection subtitle cannot be separated, it is determined that the state is unvoiced, and the analysis processing unit 211 shifts to the unvoiced mode when the unvoiced state holding time is equal to or longer than a predetermined reference time. In the silent mode, the analysis processing unit 211 calculates a difference between the pieces of video data (step S2-1). If the difference is greater than or equal to the reference value, the representative image is registered. Thereby, when there is a caption, the representative image is registered with the caption. On the other hand, when there is no subtitle, the representative image is registered by the change of the image during this period. Therefore, it is possible to generate a digest that appropriately displays a list of representative images even in a silent state. By using this digest, the user can efficiently grasp the outline of the video content.

  In the above embodiment, the analysis processing unit 211 compares whether or not the unvoiced state retention time is equal to or longer than a predetermined reference time (step S1-3). When the silent state holding time is equal to or longer than the reference time, the silent mode is entered. That is, the difference between the video data is calculated, and the representative image is registered based on the difference. The calculation of the difference between images places a load on the CPU, but this load can be reduced by providing a time lag until the transition to the silent mode.

  In the above embodiment, the recording management unit 209 identifies a screen corresponding to a time code, and generates list screen data that lists images in order from the earliest time of the time code. In each image, text data included in the metadata is displayed. Furthermore, the recording management unit 209 adds a time code to each image. With this text data, the contents of the representative screen can be grasped more accurately. Furthermore, by using time code. Video can also be played from this part.

  In the above embodiment, an image related to this time code is retrieved from the recorded data storage unit 22 and read out, and the image is displayed on the display unit together with the metadata in order from the earliest time in the time code. Thereby, since an image and metadata (here, subtitles) are used, the user can efficiently grasp the outline.

(Second Embodiment)
Next, a second embodiment of the present invention will be described with reference to FIGS. In the second embodiment, the metadata generation of the first embodiment is executed by an external server, and detailed description of the same parts is omitted. FIG. 7 is a system diagram for explaining a configuration of an information processing system to which the present invention is applied. In the present embodiment, as shown in FIG. 7, a broadcast from a broadcasting station is received using a television receiver 30. A display selection subtitle decoder 40 and a home server 50 are connected to the television receiver 30. The home server 50 is connected to the metadata creation server 70 via the Internet I as a network.

  The broadcasting station 10 is a facility that broadcasts programs using terrestrial waves, satellite waves, and the like, as in the first embodiment. This broadcast signal includes subtitles that are always displayed as video and subtitles that are displayed by selection. The user uses the television receiver 30 to receive a broadcast signal composed of video data including display selection subtitle data and audio data.

  Further, in the present embodiment, the display selection subtitle decoder 40 acquires the broadcast signal selected by the tuner 31 of the television receiver 30 and decodes the video signal and the audio signal. Then, the display selection subtitle data is extracted and decoded based on the user's operation input, and output to the output unit 33. Further, the display selection subtitle decoder 40 generates time-coded recording data that allows the home server 50 to execute search and summary processing using the metadata acquired from the metadata creation server 70 via the Internet I. .

  The home server 50 receives the recording data with time stamp generated by the display selection subtitle decoder 40 based on the user's operation input, and records it in the internal data storage means. Further, the home server 50 receives supply of encrypted metadata including text data corresponding to display selection subtitle data and a time code corresponding to the text data from the metadata creation server 70 via the Internet I. .

  Furthermore, it is possible to decrypt the encrypted metadata using the key data, and execute matching processing between the text input by the user and the metadata using the metadata. If the time code corresponding to the text input by the user is detected as a result of the matching process, the recorded data is searched based on the time code and supplied to the display selection subtitle decoder 40.

  The metadata creation server 70 acquires a broadcast signal with display-selected caption data created by the broadcast station 10 by receiving it via various networks and radio waves. Then, metadata is created using the broadcast signal, and the created metadata is encrypted. Further, the metadata creation server 70 distributes the encrypted metadata to users via the Internet I. The metadata creation server 70 includes control means including a CPU (Central Processing Unit), and data storage means such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an HDD (Hard Disk Drive). FIG. 8 shows a block configuration of the metadata creation server 70. It is a functional block diagram for demonstrating the function (including the function performed by the software which CPU performs) which the metadata production server 70 performs.

  A broadcast signal acquisition unit 701 as a signal acquisition unit acquires a broadcast signal via a network or a broadcast radio wave and supplies the broadcast signal to the decoder 702. The decoder 702 decodes the broadcast signal supplied from the broadcast signal acquisition unit 701. Here, the decoder 702 decodes only the video signal including the program management information including the program ID information and the display selection subtitle data necessary for creating the metadata among the broadcast signals.

  The program ID information extraction unit 703 extracts program ID information that can specify a broadcast program from the program management data included in the video data decoded by the decoder 702 and supplies the extracted program ID information to the metadata generation unit 708. Further, the program ID information extraction unit 703 supplies the video data to the display selection subtitle data decoder 704 as a separating unit.

  The display selection subtitle data decoder 704 decodes the display selection subtitle data included in the acquired video data, and supplies the corresponding text data to the analysis processing unit 705 as analysis means.

The analysis processing unit 705 performs subtitle mode processing and silent mode processing instead of the analysis processing unit 211 of the first embodiment. These two processes are the same as those in FIGS.

  The function of the time code addition processing unit 707 that receives a representative image registration instruction from the analysis processing unit 705 will be described with reference to FIG. The time code addition processing unit 707 uses the timer 706 to add the time when the representative image registration instruction is received as a time code. For example, in the case of text corresponding to a display selection subtitle, a time code corresponding to the start time of the display selection subtitle is added. When the broadcast signal acquisition unit 701 acquires a broadcast signal in real time for the broadcast, the time code addition processing unit 707 adds the time code to the text data based on the current time indicated by the timer 706. If the time code addition time is delayed with respect to the program broadcast time, the time code addition processing unit 707 corresponds to the broadcast time of the program based on the delay time and the current time indicated by the timer 706. The time code is calculated and added to the text data.

  The metadata generation unit 708 generates metadata by adding the program ID information supplied from the program ID information extraction unit 703 to the text data to which the time code supplied from the time code addition processing unit 707 is added. As shown in FIG. 9, the metadata includes a time code in which the start time and end time of the text group are written to the text data. Then, the program ID information supplied from the program ID information extraction unit 703 is added. This metadata is supplied to the encryption processing unit 709.

  The encryption processing unit 709 encrypts the metadata supplied from the metadata generation unit 708 with an encryption key stored in advance in the key data storage unit 72. As shown in FIG. 10, the key data storage unit 72 stores an encryption key for each program ID. Then, the encryption processing unit 709 extracts the encryption key from the key data storage unit 72 based on the program ID included in the metadata, encrypts the metadata using this encryption key, and performs encryption. Records in the metadata storage unit 73. The encrypted metadata storage unit 73 functions as pointer information storage means for recording pointer information for displaying video information of the representative image. The encrypted metadata is provided to the home server 50 via the Internet I from the communication unit 710 as a transmission unit for each program in response to a request from the user.

Next, the configuration of the display selection subtitle decoder 40 and the home server 50 will be described. First, a block diagram of the display selection subtitle decoder 40 is shown in FIG.
Of the broadcast signals selected by the tuner 31 of the television receiver 30, the video signal and audio signal including display selection subtitle data are respectively input to the video signal decoder 401 and the audio signal decoder 402 from predetermined input terminals. The

  The video signal decoder 401 decodes the supplied video signal and supplies the decoded video data to the memory 403. The memory 403 is a frame memory that temporarily holds the supplied video signal. The audio signal decoder 402 decodes the supplied audio signal and outputs the decoded audio data.

  When the received broadcast signal is output in real time, the display selection subtitle data decoder 405 acquires video data from the memory 403. When the display selection subtitle data is instructed to be displayed, the display selection subtitle data decoder 405 decodes the display selection subtitle data included in the acquired video data and converts the corresponding text data into an OSD (On Screen Display) 406. And the video data to the composition processing unit 407.

The OSD 406 converts the supplied text data into OSD data that is image data to be displayed superimposed on the display screen, and supplies the OSD data to the composition processing unit 407. Composition processing unit 4
07 superimposes the supplied OSD data on the supplied video data and outputs it from the output terminal to the display of the output unit 33 of the television receiver 30. Also, the audio processing unit 408 acquires the audio data decoded by the audio signal decoder 402 and outputs it to the speaker of the output unit 33 of the television receiver 30.

  Next, when the video signal and the audio signal are output to the home server 50 for recording, the output signal generation unit 409 is included in the program management data from the video data held in the memory 403 in the program ID extraction unit 410. The program ID is extracted.

  The output signal generation unit 409 refers to the timer 411, acquires the time (absolute time) at which recording was started, and out of the video data supplied from the memory 403 or the audio data supplied from the audio signal decoder 402 The acquired time information is added to at least one of the above. Further, the program ID supplied from the program ID extraction unit 410 is added to the video data and audio data, and an output signal for recording is generated and supplied to the home server 50. The time information added here is used as a time stamp in search and extraction processing described later.

  Through such processing, the display selection subtitle decoder 40 decodes the display selection subtitle based on the user's operation input and displays it on the video, generates recording data, and supplies it to the home server 50. It is possible to record.

Next, a block configuration diagram of the home server 50 illustrated in FIG. 12 will be described.
The operation input unit 501 includes, for example, input devices such as buttons, keys, a touch panel, a touch pad, and a lever, and receives user operation inputs. The recorded data storage unit 52 stores video data and audio data to which a program ID and a time stamp supplied from the display selection subtitle decoder 40 are added. For example, the recorded data storage unit 52 may be configured by a large-capacity recording medium such as a hard disk or a removable recording medium such as a DVD (Digital Versatile Disk) or a video tape.

  When a broadcast program recording instruction is input from the operation input unit 501, the recording control unit 502 instructs the output signal generation unit 409 of the display selection subtitle decoder 40 to output a video signal or an audio signal.

The network IF unit 503 is an interface that performs communication via the Internet I. Here, data is transmitted to and received from the metadata creation server 70.
The display unit 504 is composed of, for example, an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and displays various types of information.

The encrypted metadata storage unit 53 stores the encrypted metadata acquired from the metadata creation server 70.
The key data storage unit 54 stores a decryption key in advance in order to decrypt the encrypted metadata. This decryption key is provided and recorded for each program ID.

  The decryption processing unit 505 decrypts the encrypted metadata recorded in the encrypted metadata storage unit 53 using the decryption key stored in the key data storage unit 54, and performs meta data as a video information storage unit. It is recorded in the data storage unit 55.

When a search target program ID and a search key text are input to the operation input unit 501, the matching processing unit 506 refers to the metadata recorded in the metadata storage unit 55 and performs matching processing. Execute. And if you specify text that contains a search key,
The time code associated with this text is supplied to the recorded data search processing unit 507.

  Here, when only the program ID is specified in the operation input unit 501, the matching processing unit 506 extracts the metadata recorded in association with the program ID from the metadata storage unit 55. Then, the recorded data storage unit 22 is searched based on the time code and the program ID included in the metadata. Then, the extracted term code is supplied to the recorded data search processing unit 507.

  The recorded data search processing unit 507 searches the recorded data storage unit 52 based on the matching result (program ID and time code) supplied from the matching processing unit 506. Here, the matching processing unit 506 and the recorded data search processing unit 507 function as extraction means for extracting a representative image from the video information. Then, in recording with the program ID, the image specified by the time code is supplied to the display selection subtitle decoder 40.

  Then, the screen corresponding to the time code is specified, and list screen data (digest) in which images are listed in order from the time with the earliest time code is generated. In each image included in the digest, text data included in the metadata is displayed at the same time. Furthermore, a time code for specifying this screen as a reproduction start position is added to each image. By using this digest, the user can grasp the outline of the video content. When an arbitrary image in the digest is selected, the reproduction start position is specified by the time code associated with the image, and the recorded data is reproduced based on the time code.

As described above, according to the present embodiment, the following effects can be obtained in addition to the effects of the first embodiment.
In the above embodiment, the metadata creation server 70 creates metadata and provides it to the home server 50 of each user. For this reason, it is not necessary to create metadata in the recording device of each user, and the load on the home server 50 can be reduced.

In addition, you may change the said embodiment into the following aspects.
In the above embodiment, the time code is used as the pointer information for specifying the representative image based on the metadata. However, the time code is not limited to this, and it is also possible to use the frame data allocated for each screen. . In this case, the video processing apparatus includes a frame counter, and uses frame data as pointer information when recording metadata. Then, when creating a digest or playing back a recording, this frame data can be used to specify an image and a playback start position. In this case, the influence of the time shift in the time code can be eliminated.

  In the above embodiment, the analysis processing units (211 and 705) compare whether or not the unvoiced state retention time exceeds a predetermined reference time. When the silent state retention time is equal to or longer than the reference time, the silent mode is entered. Instead of this, when a silent state is entered, the silent mode may be set promptly. Thereby, the change of an image can be extracted reliably.

  In the above embodiment, the analysis processing units (211 and 705) compare whether the unvoiced state retention time is equal to or longer than a predetermined reference time, and if the unvoiced state retention time is equal to or longer than the reference time, Transition to silent mode. Alternatively, the reference time may be changed according to the type of video. For example, a predetermined statistical value (for example, an average value) is calculated for the display time of each caption. Then, the reference time is changed based on this statistical value. Although there are cases where subtitles are put out differently depending on the broadcast content, it is possible to appropriately grasp the silent state according to the situation.

  In the above embodiment, the display selection subtitle data is recorded in the metadata in addition to the pointer information (time code) of the representative image, but only the pointer information may be recorded. If the representative image can be specified, the content can be viewed in a short time by displaying a list of the representative images.

  In the above embodiment, the display selection caption data is recorded in the metadata in addition to the pointer information (time code) of the representative image. However, the representative image itself may be recorded in association with the pointer information (time code). In this case, the analysis processing units (211 and 705) record the representative image data together in the caption mode or the silent mode. In this case, when creating the list screen, it is not necessary to access the recorded data storage unit (22, 52), and the outline of the content can be grasped without imposing a load on the apparatus.

  In the above embodiment, the analysis processing units (211 and 705) record the pointer information. However, the operation input unit may function as a correction unit so that the pointer information can be changed. In this case, the time code and the frame data can be changed while viewing the image.

The system schematic of one Embodiment of this invention. Explanatory drawing of the metadata of one Embodiment of this invention. Explanatory drawing of the block configuration of the video recording apparatus of one Embodiment of this invention. Explanatory drawing of the process sequence of one Embodiment of this invention. Explanatory drawing of the process sequence of one Embodiment of this invention. Explanatory drawing of the process sequence of one Embodiment of this invention. Schematic of the system of other embodiment of this invention. Explanatory drawing of the block structure of the metadata production server of one Embodiment of this invention. Explanatory drawing of the metadata of one Embodiment of this invention. Explanatory drawing of the data recorded on the key data storage part of one Embodiment of this invention. Explanatory drawing of the display selection subtitle decoder of one Embodiment of this invention. Explanatory drawing of the home server of one Embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Broadcasting station, 20 ... Recording apparatus as video processing apparatus, 205 ... Display selection caption data decoder as separation means, 209 ... Recording management section as extraction means, 211 ... Analysis processing section as analysis means, 30 ... Television John receiver, 22 ... recorded data storage unit as video information storage means, 23 ... digest data storage unit as pointer information storage means, 40 ... display subtitle decoder, 50 ... home server, 70 ... metadata as video processing apparatus Creation server, 701 ... broadcast signal acquisition unit as signal acquisition means, 704 ... display selection subtitle data decoder as separation means, 55 ... metadata storage section, 705 ... analysis processing section as analysis means, I ... Internet as network .

Claims (9)

Signal acquisition means for acquiring a broadcast signal including subtitle data;
Separating means for separating at least caption data and video information from the broadcast signal;
Analyzing means for analyzing the caption data;
A video processing apparatus comprising pointer information storage means for extracting pointer information from the recorded video information and recording pointer information for displaying the video information of the representative image,
The analysis means detects a subtitle display timing, and executes a first registration process for recording pointer information of video information in conjunction with the display timing;
A video processing apparatus that executes a second registration process for recording pointer information of video information according to a predetermined registration rule when caption data is not detected.   The video processing apparatus according to claim 1, further comprising a transmission unit configured to transmit the pointer information recorded in the pointer information storage unit to a user terminal via a network. apparatus. The video processing apparatus further includes video information storage means for recording video information separated from the broadcast signal,
The video processing apparatus according to claim 1, further comprising an extraction unit that refers to the pointer information and extracts a representative image from the video information recorded in the video information storage unit.   The registration rule calculates a difference between successive video information, and records pointer information regarding the video information when the difference is greater than or equal to a reference value. The video processing device described in 1.   The video processing apparatus according to claim 1, wherein the analysis unit records the subtitle data separated by the separation unit in association with the pointer information.   The video processing apparatus according to claim 1, wherein the analysis unit records representative image data specified by the pointer information in association with the pointer information.   The video processing apparatus according to claim 1, further comprising a correction unit for the pointer information. Signal acquisition means for acquiring a broadcast signal including subtitle data;
Separating means for separating at least caption data and video information from the broadcast signal;
Analyzing means for analyzing the caption data;
This is a method of registering video information using a video processing apparatus that includes a pointer information storage unit that extracts a representative image from recorded video information and records pointer information for displaying the video information of the representative image. And
The analysis means detects a subtitle display timing, and executes a first registration process for recording pointer information of video information in conjunction with the display timing;
A video processing method comprising: executing second registration processing for recording pointer information of video information according to a predetermined registration rule when caption data is not detected. Signal acquisition means for acquiring a broadcast signal including subtitle data;
Separating means for separating at least caption data and video information from the broadcast signal;
Analyzing means for analyzing the caption data;
A program for registering video information using a video processing device that includes a pointer information storage unit that extracts a representative image from recorded video information and records pointer information for displaying the video information of the representative image. And
The analyzing means;
Detecting a display timing of subtitles, and performing a first registration process for recording pointer information of video information in conjunction with the display timing;
A video processing program that functions as means for executing a second registration process for recording pointer information of video information according to a predetermined registration rule when no caption data is detected.

Images