JP3884017B2 - Information processing apparatus, information processing method, program, and information processing system - Google Patents

Description

  The present invention relates to an information processing device, an information processing method, a program, and an information processing system, and is particularly suitable for searching for a recorded broadcast program using caption information included in a broadcast signal. The present invention relates to an information processing device, an information processing method, a program, and an information processing system.

  Broadcast program data includes video data and audio data. In addition to the so-called captions (introduction of program titles and casts, or Japanese captions in overseas works) that are always displayed as video data, the program data can be selected to be displayed or not. Contains data. Such selectable subtitle data is generally referred to as closed captioning, and is mainly developed for hearing-impaired people. Like Japanese subtitles in overseas works, not only the conversation of performers, for example, Explanation of BGM and sound effects is also included.

  For example, in NTSC analog terrestrial broadcasting, 525 scanning lines are used for video signals. Of these 525 lines, the first 21 lines in each field (one field consists of two fields) And VBI (Vertical Blanking Interval), which is called an interval for starting scanning. Closed captions are transmitted by multiplexing a 7-bit character code in the 21st VBI of the VBIs in each field, and each field is used to transmit two types of character sets to approximately 60 characters per second. It can be transmitted.

  As for the transmission of caption information for digital television broadcasting, as defined in the BS digital broadcasting operation regulations and technical materials (ARIB TR-B15), which are domestic regulations, video using a transport stream for caption information is used. Caption information can be transmitted simultaneously with information transmission. Then, in the digital television broadcast receiver, the code corresponding to the caption information is decoded, characters and figures constituting the caption are generated, and displayed superimposed on the video.

  In digital television broadcasting, text information transmitted simultaneously with video information transmission using a transport stream for subtitle information can be stored internally, and the text information stored internally can be displayed and viewed on a TV monitor at any time. By making it possible, there is a technique that allows a user to utilize subtitle information without taking a note of the displayed subtitle (for example, Patent Document 1).

JP 2003-78889 A

  Also, the CM program, text information, or communication data is automatically saved by the viewer's operation or received subtitle broadcast, and the broadcast station or CM provider uses the saved information by the viewer. There is a technique that enables the purchase of CM merchandise by communicating with (for example, Patent Document 2).

JP 2002-77772 A

  In addition, the video data and the audio data in the broadcast signal are, for example, not to be watched in real time at the time of broadcasting, for example, so that the time axis is not shifted when recorded and reproduced, for example, Have corresponding link information or have a time stamp of relative time. On the other hand, caption data does not have link data for video data or audio data, a time stamp of relative time, or the like.

  As described above, the caption data to be broadcast has begun to be used for various services.

  However, when subtitle data that is broadcast such as closed captions is used to search for recorded programs, subtitle data and video data or audio data are either analog broadcast or digital broadcast. Since a time stamp that matches the two is not added, after separating the text data corresponding to the closed caption from the video data, it is impossible to take a correspondence between the separated text and the video data. Therefore, the text obtained from the closed caption cannot be used for searching the recorded data.

  In addition, even if the text acquired from the closed caption can be used for the search of the recording data, when searching for the recording data corresponding to the text desired by the user, the user can obtain the text from all the text acquired from the closed caption. However, since it is necessary to search for a desired text, for example, the processing becomes complicated as compared with the search of numerical data, and the search processing also takes time.

  Then, it is required to attach caption data for the hearing impaired, such as closed captions, to all broadcast signals. However, such subtitle data is usually not necessary for healthy people, so there is almost no possibility that a sponsor will be charged to generate the necessary cost for subtitle data creation, and the broadcasting station bears the cost of creation. This is the current situation. Therefore, although it is disadvantageous for the hearing impaired, the ratio that closed captions and other caption data for the hearing impaired are attached to the broadcast signal remains stagnant. Here, by using these subtitle data secondarily, the construction of a system capable of collecting the compensation to the broadcasting station for subtitle data creation can only contribute to the development of the industry. In addition, since it leads to an improvement in the rate at which caption data is attached to a broadcast signal, it is also beneficial for the hearing impaired.

  The present invention has been made in view of such a situation, and makes it possible to search for recorded data using caption data such as so-called closed captions.

An information processing apparatus according to the present invention, in an information processing apparatus for searching recorded data including audio data using text information as a search key, a recorded data storage control means for controlling storage of the recorded data, and a program of the recorded data. Metadata storage means for storing distinction information for distinguishing, subtitle data corresponding to each audio data and subtitle data that is text data relating to the recorded data, and metadata including start time information relating to a time at which each subtitle data starts An operation input means for receiving an operation input by a user, information for designating a program to be searched and text information to be a search key, which are input from the user by the operation input means, and stored by the metadata storage means The text information to be a search key by executing a matching process with the metadata Start time information and matching processing means for detecting the caption data of the corresponding subtitle data, detects the position of the text matches the text information in the subtitle data detected by the matching processing unit, the detected position And the start time of the text information input from the user based on the start time information of the subtitle data, the display time of the subtitle data, and the number of characters of the subtitle data, and the recording based on the start time A metadata acquisition means for acquiring encrypted metadata , comprising: a search means for searching for and reading a portion corresponding to the text information from the recorded data whose storage is controlled by a data storage control means ; Information acquisition means for acquiring key information used to decrypt the converted metadata; The metadata stored by the metadata storage means is further provided with decryption processing means for decrypting the encrypted metadata acquired by the metadata acquisition means using the key information acquired by the key information acquisition means. The metadata decrypted by the decryption processing means.

  The search means can search a time before a predetermined time from the position of the text that matches the text information serving as the search key as a start position for reading the recorded data.

The information processing method according to the present invention includes identification information for distinguishing programs of recorded data , text data corresponding to subtitle data included in the recorded data, and metadata including second time information corresponding to the text data. A metadata storage control step for controlling storage; a metadata acquisition step for acquiring encrypted metadata; a key information acquisition step for acquiring key information used for decrypting the encrypted metadata; A decryption processing step for decrypting the encrypted metadata acquired by the metadata acquisition step using the key information acquired by the key information acquisition step, and the metadata stored by the metadata storage step is a meta data decoded by the decoding step, information designating a program to perform a search and detection An input control step for controlling the input of text information as a key, information specifying the program whose input is controlled by the processing of the input control step, text information, and metadata are matched, and the text information is converted into text information. Corresponding second time information, a detection step for detecting text data including text information, a calculation step for calculating the position of text information among the text data detected by the processing of the detection step, and processing of the detection step The recording position of the text data corresponding to the second time information detected by is searched, and based on the searched recording position and the position of the text information in the text data calculated by the processing of the calculation step, And a reading step of retrieving and reading the recorded data.

The program of the present invention stores distinction information for distinguishing programs of recorded data , text data corresponding to subtitle data included in the recorded data, and metadata including second time information corresponding to the text data. A metadata storage control step for controlling, a metadata acquisition step for acquiring encrypted metadata, a key information acquisition step for acquiring key information used to decrypt the encrypted metadata, and metadata A decryption processing step for decrypting the encrypted metadata acquired in the acquisition step using the key information acquired in the key information acquisition step, and the metadata whose storage is controlled by the metadata storage control step is a meta data decoded by the decoding processing steps, Oyo information designating a program to perform a search An input control step for controlling the input of text information to be a search key, and information for specifying a program whose input is controlled by the processing of the input control step and text information are matched with the metadata to execute the text information. A second time information corresponding to, a detection step for detecting text data including the text information, a calculation step for calculating the position of the text information among the text data detected by the processing of the detection step, and a detection step The recording position of the text data corresponding to the second time information detected by the process is searched, and based on the searched recording position and the position of the text information in the text data calculated by the calculation step process And a reading step for searching and reading recorded data. To be executed by the Yuta.

  The information processing apparatus, the information processing method, and the program according to the present invention correspond to the discrimination information for distinguishing the program of the recording data to which the first time information is added, the text data related to the recording data, and the text data. The metadata including the second time information is stored, the information specifying the program to be searched and the text information as the search key are input, and the processing for matching the information specifying the program and the text information with the metadata Is executed, the second time information corresponding to the text information and the text data including the text information are detected, the position of the text information in the detected text data is calculated, and the second time information is supported. The recording position to be searched is searched, the searched recording position, and the text information of the calculated text data. Position based on the, recording data is read out is searched.

In the information processing system shown below as a reference example , the first information processing apparatus acquires a broadcast signal, and from the acquired broadcast signal, identification information that can uniquely distinguish a program of the broadcast signal is acquired and acquired. Recording data is generated by adding the first time information and the discrimination information to the broadcast signal, and the second information processing device stores the recording data to which the first time information and the discrimination information are added. The encrypted metadata is obtained, the decryption key used to decrypt the encrypted metadata is obtained, the encrypted metadata is decrypted using the decryption key, and the recorded data program is Decoded metadata including distinction information for distinguishing, text data related to recorded data, and second time information corresponding to the text data is stored, and receives user's operation input from the user. The second time information and text data corresponding to the text information serving as the search key after the matching processing between the specified information specifying the program to be searched and the text information serving as the search key and the metadata is executed. Is detected and the recorded position corresponding to the detected second time information is searched from the recorded video data, and the position of the text that matches the text information serving as the search key in the searched text data Is detected, the recorded data is searched and read based on the detection result, the broadcast signal is acquired by the third information processing apparatus, and the program of the broadcast signal can be uniquely distinguished from the acquired broadcast signal. Subtitle data that can be selected by the user to be displayed or not is extracted and decoded from the acquired broadcast signal. A time code is added to the text data corresponding to the subtitle data that has been loaded, the discrimination information is added to the text data to which the time code has been added, metadata is generated, the metadata is encrypted, and the fourth In this information processing apparatus, information related to user authentication is acquired from the second information processing apparatus, user registration information is stored, and authentication processing is executed based on the information related to user authentication and the user registration information. When the user is correctly authenticated, a decryption key for decrypting the metadata is supplied to the second information processing apparatus.

  According to the first aspect of the present invention, recorded data can be searched based on text information serving as a search key, and in particular, the position of information corresponding to the text information serving as a search key can be accurately detected, and Recorded data can be read from the position.

  According to the second aspect of the present invention, metadata and recorded data are generated, and recorded data can be searched using metadata based on text information serving as a search key. Thus, it is possible to accurately detect the position of the information corresponding to the text information serving as the search key, and to read the recorded data from the position.

  Embodiments of the present invention will be described below. The correspondence relationship between the invention described in this specification and the embodiments of the invention is exemplified as follows. This description is intended to confirm that the embodiments supporting the invention described in this specification are described in this specification. Therefore, even if there is an embodiment that is described in the embodiment of the invention but is not described here as corresponding to the invention, the fact that the embodiment is not It does not mean that it does not correspond to the invention. Conversely, even if an embodiment is described herein as corresponding to an invention, that means that the embodiment does not correspond to an invention other than the invention. Absent.

  Further, this description does not mean all the inventions described in this specification. In other words, this description is for the invention described in the present specification, which is not claimed in this application, that is, for the invention that will be applied for in the future or that will appear and be added by amendment. It does not deny existence.

The information processing apparatus according to claim 1 (for example, home server 4 in FIG. 3) includes recording data storage control means (for example, recording data storage unit 72 in FIG. 3) for controlling storage of recording data including audio data. Discriminating information for discriminating recorded data programs (for example, program ID 167 in FIG. 7), subtitle data corresponding to each audio data and text data relating to the recorded data (for example, text data 165 in FIG. 7), And metadata storage means (for example, FIG. 3 of FIG. 3) that stores metadata (for example, metadata 161 of FIG. 7) including start time information (for example, time code 166 of FIG. 7) regarding the time at which each caption data starts. Metadata storage section 78), operation input means for receiving user operation input (for example, operation input section 71 in FIG. 3), and user by the operation input means. The text information that is used as the search key and the text information that serves as the search key and the metadata that is stored in the metadata storage means are matched to the text information that serves as the search key. matching processing means for detecting the start time information and the caption data of the caption data to be (for example, matching processing section 79 of FIG. 3) and, detecting the position of the text that matches the text information in the caption data detected by the matching processing unit The start time of the text information input from the user is calculated based on the detected position, the start time information of the subtitle data, the display time of the subtitle data, and the number of characters of the subtitle data, and based on the start time Corresponds to text information from recording data whose storage is controlled by recording data storage control means Read by searching the partial search means (e.g., recorded data retrieval output unit 80 of FIG. 3) and a, a metadata acquisition means for acquiring the encrypted metadata (e.g., a network interface 73 in FIG. 3), Key information acquisition means (for example, the network interface 73 in FIG. 3) for acquiring key information used for decrypting encrypted metadata, and encrypted metadata acquired by the metadata acquisition means, Decryption processing means (for example, the decryption processing unit 77 in FIG. 3) for decrypting using the key information acquired by the key information acquisition means can be further provided, and the metadata stored by the metadata storage means is decrypted. The metadata is decrypted by the processing means.

  The search means can search a time before a predetermined time (for example, Δt shown in FIG. 8) from the position of the text that matches the text information serving as the search key, as a recording data reading start position.

An information processing method according to claim 3 is an information processing method of an information processing apparatus (for example, home server 4 in FIG. 3) that searches for recorded data to which first time information is added using metadata. The discriminating information (eg, program ID 167 in FIG. 7) for discriminating the program of the recorded data , the text data corresponding to the caption data included in the recorded data (eg, the text data 165 in FIG. 7), and the text data A metadata storage control step (for example, step S150 in FIG. 17) that controls storage of metadata (for example, metadata 161 in FIG. 7) including the corresponding second time information (for example, time code 166 in FIG. 7). and processing), the metadata acquiring the encrypted metadata (for example, step S141 in FIG. 17), the encrypted meta The key information acquisition step (for example, the process of step S147 in FIG. 17) for acquiring the key information used for decrypting the data, and the encrypted metadata acquired by the metadata acquisition step The decryption processing step (for example, the processing in step S149 in FIG. 17) for decrypting using the key information acquired in the step, and the metadata whose storage is controlled by the metadata storage control step is decrypted by the decryption processing step. a metadata, the input control step for controlling input of text information that is information and search key designating a program to perform a search (for example, step S181 and step S182 in FIG. 19), the input control step Information that specifies the program whose input is controlled by this process, text information, and meta data And a detection step for detecting second time information corresponding to the text information and text data including the text information (for example, processing in step S183 in FIG. 19), and processing in the detection step Of the text data detected by the above, the calculation step for calculating the position of the text information (for example, the process of step S184 in FIG. 19) and the text data corresponding to the second time information detected by the process of the detection step The recording position is retrieved, and the recording data is retrieved and read out based on the retrieved recording position and the position of the text information of the text data calculated by the processing of the calculation step (for example, in FIG. 19). And the process of step S185).

In the program according to claim 4 , the embodiment (however, an example) to which each step corresponds is the same as the information processing method according to claim 3 .

The information processing system shown below as a reference example searches for recorded data using a first information processing apparatus (for example, the display selection subtitle decoder 3 in FIG. 3) that acquires and processes a broadcast signal, and text information as a search key. A second information processing apparatus (for example, home server 4 in FIG. 3) and a third information processing apparatus (for example, FIG. 3) that generates metadata used for search processing executed by the second information processing apparatus. 5 and the metadata creation server 6 in FIG. 6) and a fourth information processing apparatus (for example, FIG. 9) that supplies a decryption key for decrypting the metadata used for the search processing executed in the second information processing apparatus. And the accounting server 7 in FIG. 10, in which the first information processing apparatus is a first broadcast signal acquisition unit (for example, input terminal 21-in FIG. 3) that acquires a broadcast signal. 1 and 21-2) and first distinction information acquisition means (for example, a program ID) for acquiring distinction information (for example, program ID) that can uniquely distinguish a broadcast signal program from the broadcast signal acquired by the first broadcast signal acquisition means. For example, the program ID information extraction unit 39) in FIG. 3 and the broadcast signal acquired by the first broadcast signal acquisition means include first time information (for example, recording start time information 95 in FIG. 4), first information And information addition means (for example, the output signal generation unit 33 in FIG. 3) for adding the distinction information acquired by the distinction information acquisition means to generate recorded data. The second information processing apparatus includes: Recording data storage control means (for example, the recording data storage section 72 in FIG. 3) for controlling the recording of the recording data to which the time information and the distinction information are added, and the metadata acquisition means for acquiring the encrypted metadata (For example, in FIG. Network interface 73), a decryption key obtaining means (for example, network interface 73 in FIG. 3) for obtaining a decryption key used for decrypting the encrypted metadata, and an encryption obtained by the metadata obtaining means. The decrypted metadata is decrypted using the decryption key obtained by the decryption key obtaining means (for example, the decryption processing unit 77 in FIG. 3), and the program of the recorded data decrypted by the decryption processing means is displayed. Discrimination information (eg, program ID 167 in FIG. 7) for discrimination, text data related to recorded data (eg, text data 165 in FIG. 7), and second time information corresponding to the text data (eg, FIG. 7) Metadata storage means for storing metadata (for example, metadata 161 in FIG. 7) including time code 166) For example, the metadata storage unit 78 in FIG. 3, an operation input unit (for example, the operation input unit 71 in FIG. 3) that receives a user's operation input, and a program that executes a search that is input from the user by the operation input unit The second time information and text data corresponding to the text information serving as the search key are obtained by executing a matching process between the information specifying the text and the text information serving as the search key and the metadata stored by the metadata storage means. Recording corresponding to the second time information detected by the matching processing means from the matching processing means to be detected (for example, the matching processing unit 79 in FIG. 3) and the recorded data whose storage is controlled by the recording data storage control means. Search the position, detect the position of the text that matches the text information that is the search key in the searched text data, Searching means (for example, the recording data search output unit 80 in FIG. 3) for searching and reading the recording data based on the output result, and the third information processing apparatus acquires the second broadcast signal for acquiring the broadcast signal. From the broadcast signal acquired by the means (for example, the broadcast data acquisition unit 141 in FIG. 6) and the second broadcast signal acquisition means, identification information (for example, program ID) that can uniquely distinguish the program of the broadcast signal is acquired. The user can select whether or not to display from the second distinction information acquisition means (for example, the program ID information extraction unit 143 in FIG. 6) and the broadcast signal acquired by the second broadcast signal acquisition means. Subtitle data decoding means (for example, display selected subtitle data decoder 145 in FIG. 6) for extracting and decoding possible subtitle data (for example, display selected subtitle data 17 in FIG. 2), subtitle data decoding Time code adding means (for example, time code addition processing unit 147 in FIG. 6) for adding time code to text data corresponding to the caption data decoded by the means, and text data to which the time code is added by the time code adding means The metadata generation unit (for example, the metadata generation unit 144 in FIG. 6) that generates the metadata by adding the identification information acquired by the identification information acquisition unit, and the metadata generated by the metadata generation unit And an encryption unit (for example, the encryption processing unit 149 in FIG. 6), and the fourth information processing apparatus acquires authentication information for acquiring information related to user authentication from the second information processing apparatus. Means (for example, the operation input information acquisition unit 204 in FIG. 10), and registration information storage control means for controlling storage of user registration information ( For example, the authentication processing is performed based on the user information database 206 in FIG. 10, the user authentication information acquired by the authentication information acquisition unit, and the registration information of the user whose storage is controlled by the registration information storage control unit. Controls the supply of a decryption key for decrypting metadata to the second information processing apparatus when the user is correctly authenticated by the authentication processing means to be executed (for example, the authentication processing unit 207 in FIG. 10) and the authentication processing means. And a decryption key supply control means (for example, the key supply processing unit 208 in FIG. 10).

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a system diagram for explaining the configuration of an information processing system to which the present invention is applied.

  The broadcasting station 1 broadcasts a program using terrestrial waves or satellite waves. Broadcast program data includes video data and audio data. In addition to the so-called captions (introduction of program titles and casts, or Japanese captions in overseas works) that are always displayed as video data, the program data can be selected to be displayed or not. Contains data. Such selectable subtitle data (so-called closed captions) includes not only text data corresponding to performers' conversations such as Japanese subtitles in overseas works, but also explanations such as BGM and sound effects. It may be included.

  For example, in NTSC analog terrestrial broadcasting, 525 scanning lines are used for video signals. Of these 525 lines, the first 21 lines in each field (one field consists of two fields) And VBI (Vertical Blanking Interval), which is called an interval for starting scanning. Closed captions are transmitted by multiplexing a 7-bit character code in the 21st VBI of the VBIs in each field, and each field is used to transmit two types of character sets to approximately 60 characters per second. It can be transmitted. Hereinafter, subtitle data typified by closed captions and capable of selecting display and non-display will be referred to as display selection subtitle data.

  Specific examples of video data, audio data, and display selection subtitle data will be described with reference to FIG.

  The video data 15 is moving image data, and in FIG. 2, frame image data at several timings is extracted from the moving image data. The audio data 16 is audio data to be reproduced simultaneously with the video data 15. The display selection subtitle data 17 may be, for example, text data corresponding to the voice data 17, and when the voice data other than the text data corresponding to the voice data is conversation, for explaining the speaker. Text data or the like may be included. The video data 15 and the audio data 16 are recorded and reproduced, for example, in addition to being viewed in real time at the time of broadcasting, for example, by having corresponding link information or having a relative time stamp. Even in such a case, the time axis is not shifted. On the other hand, since the display selection subtitle data 17 is assumed to be treated in the same way as the video data until it is decoded at the time of reproduction, the link data for the video data 15 or the audio data 16 or the time of the relative time is assumed. Does not have stamps.

  Returning again to the description of FIG.

  Using the television receiver 2, the user receives a broadcast signal composed of the video data 15 including the display selection subtitle data 17 described with reference to FIG. 2 and the audio data 16. The user who does not need to display the display selection subtitle data and does not perform the search processing described later using the display selection subtitle data can use the broadcast selected by the tuner 11 without using the display selection subtitle decoder 3. The video and audio signal processing unit 12 demodulates the signal, and the video signal is displayed on the display of the output unit 13, and the audio signal is output to the speaker of the output unit 13 to view the program.

  The display selection subtitle decoder 3 receives the broadcast signal selected by the tuner 11 of the television receiver 2, decodes the video signal and the audio signal, and displays the display selection subtitle data based on the user's operation input. It can be extracted and decoded, and output to the output unit 13 for display and audio output. Further, the display selection subtitle decoder 3 receives the input of the broadcast signal selected by the tuner 11 of the television receiver 2 and processes the broadcast signal, so that the home server 4 transmits the metadata creation server via the Internet 5. Recording data with a time stamp capable of executing a search process using the metadata acquired from 6 can be generated and supplied to the home server 4. Further, the display selection subtitle decoder 3 receives the supply of the recording data recorded by the home server and designated by the search position by the search process, decodes the display selection subtitle as necessary, and outputs the decoded subtitle to the output unit 13. Display and audio output can be performed.

  The home server 4 receives the recording data with a time stamp generated by the display selection subtitle decoder 3 based on the operation input of the user, and records (that is, records) on the internal recording medium. In addition, the home server 4 receives supply of metadata including text data corresponding to display selection subtitle data and a time code corresponding to the text data from the metadata creation server 6 via the Internet 5. The supply of key data for decrypting the metadata is received from the accounting server 7, the metadata is decrypted, and the matching process between the text input by the user and the metadata is executed using the decrypted metadata. As a result of the matching process, the text data including the text input by the user and the time code corresponding to the text data are detected, and the playback position of the recorded data corresponding to the text input by the user based on the time code and the text data. Is detected, and the recorded data is read from the detected reproduction position and supplied to the display selection subtitle decoder 3. Details of the search process will be described later. Here, the searched “program” is, for example, a whole program such as a two-hour drama, or a plurality of units even when each program is divided by a commercial or the like. Even a program may be included, or a commercial may be included or only a commercial may be indicated.

  The metadata creation server 6 obtains a broadcast signal with display selection subtitle data created by the broadcast station 1 by receiving it via the Internet 5, via a predetermined medium, or from an antenna (not shown), Based on that, metadata is created and the created metadata is encrypted. Further, the metadata creation server 6 publishes a web page for distributing encrypted metadata to users via the Internet 5 on the Internet 5, for example, the home server 4 or a personal computer (not shown). In response to access from the used user, the encrypted metadata used for searching for the program desired by the user is downloaded via the Internet 5.

  The accounting server 7 publishes on the Internet 5 a web page for distributing the decryption key for decrypting the metadata created by the metadata creation server 6 and encrypted and distributed to the user to the user via the Internet 5. For example, after receiving access from the user using the home server 4 or a personal computer (not shown), the user pays for the decryption key of the metadata desired by the user, and then distributes the key to the user. In addition, the accounting server 7 executes an accounting process for paying the broadcasting station 1 a fee for the broadcasting station 1 that has created the display selection subtitle data.

  FIG. 3 is a block diagram showing a configuration of the display selection subtitle decoder 3 and the home server 4 of FIG.

  Of the broadcast signals selected by the tuner 11 of the television receiver 2, a video signal including display selection caption data is supplied to the video signal decoder 31 from the input terminal 21-1, and an audio signal is input to the input terminal 21-. 2 is input to the audio signal decoder 34.

  The video signal decoder 31 decodes the supplied video signal and supplies the decoded video data to the memory 32. The memory 32 is a frame memory that temporarily holds the supplied video signal. The audio signal decoder 34 decodes the supplied audio signal and outputs the decoded audio data.

  When an instruction to output the received broadcast signal in real time by the user's operation input by the operation input unit 41, that is, to view a program currently being broadcast, the display selection subtitle data decoder 35 stores the memory Video data is acquired from 32. When the display selection subtitle data is instructed by the user's operation input from the operation input unit 41, the display selection subtitle data decoder 35 decodes the display selection subtitle data included in the acquired video data. The corresponding text data is supplied to the OSD (On Screen Display) 36 and the video data is supplied to the composition processing unit 37.

  The OSD 36 converts the supplied text data into OSD data, which is image data to be displayed superimposed on the display screen, and supplies the OSD data to the composition processing unit 37. The composition processing unit 37 superimposes the supplied OSD data on the supplied video data, and outputs it from the output terminal 22-1 to the display of the output unit 13 of the television receiver 2. At this time, the audio output processing unit 38 acquires the audio data decoded by the audio signal decoder 34 and outputs the audio data to the speaker of the output unit 13 of the television receiver 2 from the output terminal 22-2.

  Based on a user operation input from the operation input unit 41 or based on a control signal supplied from the home server 4 via the data terminal 61-3, the supplied video signal and audio signal are converted into the home server. 4, the output signal generation unit 33 causes the program ID information extraction unit 39 to extract the program ID included in the program management data from the video data held in the memory 32. To control. The program ID information extraction unit 39 indicates a unit to be searched from the program management data included in the video data decoded by the video signal decoder 31 (here, “program” is a unit to be searched, for example, a 2-hour drama) Even if it is the whole program, even if one program is divided by commercials, etc., each unit divided, or those that contain multiple programs, and those that contain commercials or only commercials The program ID information that can be uniquely distinguished is extracted and supplied to the output signal generation unit 33.

  The output signal generation unit 33 refers to the timer 40 to acquire the time (absolute time) when the recording was started, and the video data supplied from the memory 32 or the audio data supplied from the audio signal decoder 34 The acquired time information is added to at least one of them, and the program ID supplied from the program ID information extraction unit 39 is added to the video data and audio data to generate an output signal to be recorded. And supplied to the home server 4 from the output terminals 23-1 and 23-2. The added time information is used as a time stamp in a search process to be described later.

  The output signal to be recorded will be described with reference to FIG.

  In the output signal generation unit 33, the recording start time information 95 is added to at least one of the video data 15 and the audio data 16 among the recorded output signals. The video data 15 includes display selection subtitle data 17. Then, program ID information is associated with these data, and an output signal for recording is generated.

  Returning to FIG. 3, the configuration of the home server 4 will be described.

  The operation input unit 71 includes, for example, input devices such as buttons, keys, a touch panel, a touch pad, and a lever, and receives user operation inputs. The recorded data storage unit 72 stores video data and audio data to which a program ID and a time stamp are added supplied from the input terminal 61-1 and the input terminal 61-2. For example, the recorded data storage unit 72 may be configured by a large-capacity recording medium such as a hard disk, or may be configured by a removable recording medium such as a DVD (Digital Versatile Disk) or a video tape.

  When the user instructs the operation input unit 71 to record a broadcast program, the recording control unit 81 can record the video signal and the audio signal supplied to the display selection subtitle decoder 3 as searchable information. In order to be able to do so, a program ID and a time stamp are added to generate a control signal for output to the home server 4 and output from the display selection subtitle decoder 3 via the data terminal 61-3 and the data terminal 23-2. The signal is supplied to the signal generator 33.

  The network interface 73 acquires information on a web page published on the Internet 5 and displays the information on the display unit 74, or based on an operation input to the operation input unit 71 by a user who refers to the display unit 74. The predetermined information is transmitted to the metadata creation server 6 or the billing server 7, or the metadata is downloaded from the metadata creation server 6 and output to the encrypted metadata storage unit 75 for storage. The decryption key acquired from the accounting server 7 is output to the key information storage unit 76 and stored. In addition, the network interface 73 receives encrypted metadata, a decryption key, and the like acquired by using a personal computer (not shown) owned by the user from a personal computer (not shown) by wired or wireless communication. It is also possible to do.

  The display unit 74 is configured by, for example, an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and information on a web page published on the Internet 5 acquired via the network interface 73 and an operation input unit. 71 displays information input by the user.

  The encrypted metadata storage unit 75 stores the acquired encrypted metadata. The key information storage unit 76 stores the acquired decryption key. The decryption processing unit 77 decrypts the encrypted metadata stored in the encrypted metadata 75 using the decryption key stored in the key information storage unit 76 and outputs the decrypted metadata to the metadata storage unit 78. To remember. The metadata storage unit 78 receives the supplied metadata and stores it.

  The matching processing unit 79 receives from the operation input unit 71 information specifying the program ID of the recorded data to be searched and text serving as a search key, and refers to the metadata stored in the metadata storage unit 78. Then, the matching process is executed, and the program ID which is the matching result, the text data including the search key, and the time code are supplied to the recorded data search output unit 80. The recorded data search output unit 80 searches the recorded data storage unit 72 based on the program ID and time code that are the matching results supplied from the matching processing unit 79, and designates them by the program ID and time code that are the matching results. Search data in the detected text data based on the text data including the text to be used as a search key and the text as the search key supplied from the operation input unit 71. Time information corresponding to the position of the text is calculated. Then, the recorded data search output unit 80 searches the recorded data storage unit 72 based on the calculated time information, and reads the recorded data starting from the position corresponding to the starting point of the text that is the search key. The display selection subtitle decoder 3 is supplied via the output terminal 62-2 and the output terminal 62-2.

  The recorded data search output unit 80 assumes that the sound constituting the audio data corresponding to the text is uttered at a constant speed with respect to the display time of the corresponding text, and the position corresponding to the start point of the text. Is detected. A method for the recorded data search output unit 80 to detect the start point of the text as a search key will be described later with reference to FIG.

  Next, FIG. 5 is a block diagram showing the configuration of the metadata creation server 6.

  A CPU (Central Processing Unit) 101 executes various processes according to a program stored in a ROM (Read Only Memory) 102 or a program loaded from a storage unit 108 to a RAM (Random Access Memory) 103. The RAM 103 also appropriately stores data necessary for the CPU 101 to execute various processes.

  The CPU 101, ROM 102, and RAM 103 are connected to each other via a bus 104. An input / output interface 105 is also connected to the bus 104.

  The input / output interface 105 includes an input unit 106 including a keyboard and a mouse, an output unit 107 including a display and a speaker, a storage unit 108 including a hard disk, and a communication unit 109 including a modem and a terminal adapter. It is connected. The communication unit 109 performs communication processing via a network including the Internet 5.

  A drive 110 is connected to the input / output interface 105 as necessary, and a magnetic disk 121, an optical disk 122, a magneto-optical disk 123, a semiconductor memory 124, or the like is appropriately mounted, and a computer program read from them is loaded. These are installed in the storage unit 108 as necessary.

  FIG. 6 is a functional block diagram for explaining functions executed by the metadata creation server 6 described with reference to FIG. 5 (including functions executed by software executed by the CPU 101).

  The broadcast data acquisition unit 141 corresponds to the communication unit 109 in FIG. 5, acquires broadcast data via the Internet 5 or via an antenna (not shown), and supplies the broadcast data to the decoder 142.

  The decoder 142 decodes the supplied broadcast data. Here, the decoder 142 may decode only the video signal including the program management information including the program ID information necessary for creating the metadata and the display selection subtitle data in the broadcast data.

  The program ID information extraction unit 143 indicates a unit to be searched for from the program management data included in the video data decoded by the decoder 142 (here, “program” is a unit to be searched for, such as a two-hour drama). Even if it is the whole program, even if one program is divided by commercials, etc., each unit divided, including multiple programs, only those containing commercials or only commercials The program ID information that can be uniquely distinguished is extracted and supplied to the metadata generation unit 144, and the supplied video data is supplied to the display selection subtitle data decoder 145.

  The display selection subtitle data decoder 145 decodes the display selection subtitle data included in the acquired video data and supplies the corresponding text data to the display selection subtitle data analysis unit 146. The display selection subtitle data analysis unit 146 divides the text data corresponding to the display selection subtitle data supplied from the display selection subtitle data decoder 145 into a text group of an appropriate length (for example, the text displayed at one time). Are divided as one text group), and the divided text group is supplied to the time code addition processing unit 147.

  The time code addition processing unit 147 refers to the timer 148 and adds a time code corresponding to the start position and end position of the text to each of the supplied text group. When the broadcast data acquisition unit 141 acquires a broadcast signal in real time (ie, at the broadcast time of the program), the time code addition processing unit 147 indicates that the current time indicated by the timer 148 is the same as when the user acquires broadcast data. It is assumed that a time code is added to the text data based on the time.

  Further, the time code addition processing unit 147, when the broadcast data acquisition unit 141 acquires a broadcast signal with a delay from the broadcast time of the program, or the time taken by the decoder 142 to the display selection subtitle data analysis unit 146, When it becomes longer than the output processing of a broadcast signal using a general television receiver, the current time indicated by the timer 148 and the delay time for acquiring the broadcast signal, or the delay time due to the time required for the processing Based on this, a time code corresponding to the broadcast time of the program is calculated and added to the text data. Furthermore, it is needless to say that the time code addition processing unit 147 may be able to appropriately correct the timing shift when the timing at which the display selection subtitle data is given is different from the actual broadcast content.

  The metadata generation unit 144 adds the program ID information supplied from the program ID information extraction unit 143 to the text data to which the time code supplied from the time code addition processing unit 147 is added, and generates metadata. The data is supplied to the encryption processing unit 249.

  The metadata will be described with reference to FIG.

  For the text data 165 divided into text 1, text 2,..., Which is a text group of an appropriate length by the display selection subtitle data analysis unit 146, each time text group is processed by the time code addition processing unit 147. A time code 166 in which the start time and the end time are described is added. For example, if the text 1 is divided into ““ It's 7 o'clock news ”” and the text 2 is divided into the parts ““ Today's first topic is ... ”” The start time and the end time corresponding to the time at which the display selection subtitle of the part is displayed are described in the time code 166. Further, the program ID information 167 supplied from the program ID information extracting unit 143 is added. Thus, the metadata 161 is generated.

  Returning to the description of FIG.

  The encryption processing unit 149 encrypts the metadata supplied from the metadata creation unit 144 with the encryption key corresponding to the program ID stored in advance in the key information storage unit 150 and supplies the encrypted metadata to the metadata storage unit 151. To do. The metadata supply control unit 152 searches the metadata storage unit 151 for encrypted metadata corresponding to a program desired by the user based on a signal for requesting metadata supplied from the communication unit 153, and The data is supplied to the home server 4 held by the user or a personal computer (not shown) via the Internet 5.

  The page information storage unit 155 stores information necessary for downloading and using metadata such as a list of metadata that can be downloaded and a method of obtaining a decryption key necessary for using the metadata. Information corresponding to the web page to be provided is stored. The web page publication processing unit 154 publishes the web page stored in the page information storage unit to the Internet 5.

  The communication unit 153 corresponds to the communication unit 109 of FIG. 5, and exchanges information with the home server 4 held by the user or a personal computer (not shown) via the Internet 5.

  Next, based on the time code 166 of the metadata 161 described with reference to FIG. 7 created in the metadata creation server 6, the recorded data search output unit 80 of the home server 4 described above serves as a search key. A method for detecting the start point of the text will be described with reference to FIG.

  The recorded data search output unit 80 of the home server 4 assumes that the sound constituting the audio data corresponding to the text is uttered at a constant speed with respect to the display time of the corresponding text. The position corresponding to is detected. For example, in the recorded data corresponding to the metadata including the text 1 and the text 2 described with reference to FIG. 7, when “wheelchair” is the search key, the time code 166 corresponding to the text 2 is obtained by the matching process. Therefore, the recorded data search output unit 80 describes the start time “19: 00: 46: 01” and the end time “19:00:56: of the text 2 described in the time code 166 of the metadata 161. 51 ", the display time of text 2 is calculated as 10.5 seconds. Then, the recorded data search output unit 80 divides the display time of the text 2 by 10.5 seconds by dividing the display time of the text 2 by the number 25 of the sound of the text 2 “Today's first topic is about wheelchairs”. With respect to time, an estimated value 0.42 seconds of the average speech time of one sound of the corresponding voice data is calculated. Then, since the start position of the “wheelchair” included in the text 2 is the 12th sound, the recorded data search output unit 80 determines the time when the “wheelchair” included in the text 2 is spoken as the start time of the text 2. It is estimated that “19: 00: 50: 63” is delayed by (0.42 × 12) seconds from “19: 00: 46: 01”.

  Here, the recorded data search output unit 80 assumes that the sound constituting the audio data corresponding to the text is uttered at a constant speed with respect to the display time of the corresponding text. If not established, there is a possibility that the timing when the text “wheelchair” desired by the user is uttered cannot be searched. Therefore, the recorded data search output unit 80 detects a time earlier than the estimated utterance time “19: 00: 50: 63” by a predetermined time Δt as a reproduction start position, and starts from the detected reproduction start position. Recorded data is read from the recorded data storage unit 72 and supplied to the display selection subtitle decoder 3 via the output terminals 61-1 and 61-2.

  Here, the predetermined time Δt may be a value set in advance or a value that can be set and changed by the user.

  Next, FIG. 9 is a block diagram showing the configuration of the accounting server 7.

  A CPU (Central Processing Unit) 171 executes various processes according to a program stored in a ROM (Read Only Memory) 172 or a program loaded from a storage unit 178 to a RAM (Random Access Memory) 173. The RAM 173 also appropriately stores data necessary for the CPU 171 to execute various processes.

  The CPU 171, ROM 172, and RAM 173 are connected to each other via a bus 174. An input / output interface 175 is also connected to the bus 174.

  The input / output interface 175 includes an input unit 176 including a keyboard and a mouse, an output unit 177 including a display and a speaker, a storage unit 178 including a hard disk, and a communication unit 179 including a modem and a terminal adapter. It is connected. The communication unit 179 performs communication processing via a network including the Internet 5.

  A drive 180 is connected to the input / output interface 175 as necessary, and a magnetic disk 121, an optical disk 122, a magneto-optical disk 123, a semiconductor memory 124, or the like is appropriately mounted, and a computer program read from them is loaded. The storage unit 178 is installed as necessary.

  Next, FIG. 10 is a functional block diagram for explaining functions executed by the accounting server 7 of FIG. 9 (including functions executed by software executed by the CPU 171).

  The page information storage unit 202 includes, for example, input of user information and billing information for user registration, a method of obtaining a decryption key necessary for using the metadata, and transmission of a decryption key purchase request. A decryption key necessary for decrypting data is provided, and information corresponding to a web page for charging the data is stored. The web page publication processing unit 201 publishes the web page stored in the page information storage unit to the Internet 5.

  The communication unit 203 corresponds to the communication unit 179 in FIG. 9, and exchanges information with the home server 4 held by the user or a personal computer (not shown) via the Internet 5.

  The operation input information acquisition unit 204 acquires the operation input information transmitted by the user via the communication unit 203. When the operation input information relates to the operation of the web page, the operation input information acquisition unit 204 In the case of personal information for user registration, in the user information registration processing unit 205, in the case of information necessary for authentication processing, in the case of information that requests authentication processing unit 207 to purchase a key, When the information is related to the charging process to the supply processing unit 208, the information is supplied to the charging processing unit 210.

  The user information registration processing unit 205 receives supply of personal information for user registration from the operation input information acquisition unit 204 and supplies it to the user information database 206. The authentication processing unit 207 issues a user ID that can uniquely identify a user to a newly registered user, registers the user ID in the user information database 206, and sends the issued user ID via the communication unit 203. The data is sent to the home server 4 owned by the user or a personal computer (not shown). The authentication processing unit 207 receives supply of information necessary for the authentication process from the operation input information acquisition unit 204, executes the authentication process with reference to the user information registered in the user information database 206, and performs the authentication process. The result is output to the key supply processing unit 208.

  The key supply processing unit 208 receives supply of information requesting key purchase from the operation input information acquisition unit 204, and receives an input of an authentication result indicating that the user authentication processing has been correctly completed from the authentication processing unit 207. In this case, the corresponding decryption key is read from the key information database 209 and supplied to the home server 4 held by the user or a personal computer (not shown) via the communication unit 203, and the charge processing unit 210 receives the key. Output information about supply.

  The key information database 209 stores a decryption key for decrypting encrypted metadata for each program ID. That is, the key information database 209 is stored in advance in the key information storage unit 150 described with reference to FIG. 6, and the key information for each program ID used when the encryption processing unit 149 encrypts the metadata. The decryption key corresponding to is stored.

  The billing processing unit 210 performs billing processing based on the information related to billing supplied from the operation input information acquisition unit 204 and the key information processing unit 208, registers information necessary for billing in the billing information database 211, Based on the contents registered in the information database 206 and the billing information database 211, a process for paying the price of the supplied decryption key to the user, a process for paying the price for providing the display selection subtitle to the broadcast station 1, etc. are executed. . Information necessary for the accounting process is registered in the accounting information database 211.

  Next, with reference to the flowchart of FIG. 11, the process 1 of the display selection subtitle decoder which is the process which the display selection subtitle decoder 3 performed using FIG. 3 is demonstrated.

  In step S1, the video signal decoder 31 and the audio signal decoder 34 receive the program broadcast signal (video signal and audio signal) and decode it. The video signal decoder 31 supplies the decoded video data to the memory 32.

  In step S <b> 2, the display selection subtitle data decoder 35 and the audio output processing unit 38 determine whether viewing of the program is instructed based on the user's operation input supplied from the operation input unit 41.

  If it is determined in step S2 that viewing of the program is instructed, in step S3, the display selection subtitle data decoder 35 determines the display selection subtitle based on the user's operation input supplied from the operation input unit 41. Determine whether display is commanded.

  If it is determined in step S3 that display of the display selection subtitle is instructed, in step S4, the display selection subtitle data decoder 35 decodes the display selection subtitle data and supplies it to the OSD 36, and also the video data. This is supplied to the synthesis processing unit 37. The OSD 36 converts the supplied text data into video data and outputs it to the composition processing unit 37. The composition processing unit 37 synthesizes the supplied OSD data with video data, and outputs it to the television receiver 2 via the output terminal 22-1. The audio output processing unit 38 also acquires the audio data decoded by the audio signal decoder 34 and outputs it to the television receiver 2 via the output terminal 22-2.

  If it is determined in step S3 that the display selection subtitle display is not instructed, in step S5, the display selection subtitle data decoder 35 does not decode the display selection subtitle data, and the video data is combined with the synthesis processing unit 37 and The data is output to the television receiver 2 via the output terminal 22-1. The audio output processing unit 38 also acquires the audio data decoded by the audio signal decoder 34 and outputs it to the television receiver 2 via the output terminal 22-2.

  In step S2, if it is determined that viewing of the program is not instructed, or after the processing of step S4 or step S5 is completed, the output signal generation unit 33 is supplied from the operation input unit 41 in step S6. Based on a user operation input or a control signal supplied from the recording control unit 81 of the home server 4 supplied via the data terminal 23-3, it is determined whether or not a program recording is instructed. If it is determined in step S6 that recording of a program has not been instructed, the process ends.

  If it is determined in step S6 that recording of a program has been instructed, in step S7, recorded data creation processing 1 described later with reference to FIG. 12 is executed.

  In step S8, the output signal generation unit 33 supplies the recording data created by the process of step S6 to the home server 4 via the output terminal 23-1 and the output terminal 23-2, and the process ends. .

  By such processing, the display selection subtitle decoder 3 decodes the display selection subtitle and superimposes it on the video when viewing the received broadcast signal based on the user's operation input, or displays the display selection. Recording data that can use text data corresponding to subtitles for search processing can be generated and supplied to the home server 4 for recording.

  Next, the recorded data creation process 1 executed in step S7 of FIG. 11 will be described with reference to the flowchart of FIG.

  In step S21, the program ID information extraction unit 39 extracts program ID information that can individually identify the recorded program from the program management data included in the decoded video data held in the memory 32. To the output signal generator 33.

  In step S22, the output signal generation unit 33 refers to the timer 40 to at least one of the video data supplied from the memory 32 or the audio data supplied from the audio signal decoder 34, for example, A time stamp based on absolute time such as information indicating the recording start time is added.

  In step S23, the output signal generation unit 33 further adds a program ID to the video data or audio data to which the time stamp is added, and generates the recording output signal described with reference to FIG. Advances to step S8 in FIG.

  By such processing, recorded data to which a program ID and a time stamp are added, which can use text data corresponding to the display selection subtitles for search processing, is generated.

  Next, the metadata creation process 1 executed by the metadata creation server 6 described with reference to FIGS. 5 and 6 will be described with reference to the flowchart of FIG.

  In step S <b> 61, the broadcast data acquisition unit 141 receives a program broadcast signal (at least a video signal) and supplies it to the decoder 142. The decoder 142 decodes the supplied video signal and supplies it to the program ID information extraction unit 143.

  In step S62, the program ID information extraction unit 143 extracts a program ID, which is program-specific information for recognizing the program, from the program management data included in the supplied video data, and generates the program ID as metadata. And the decoded video data is supplied to the display selection subtitle data decoder 145.

  In step S <b> 63, the display selection subtitle data decoder 145 extracts and decodes the display selection subtitle data from the supplied video data, and supplies the extracted data to the display selection subtitle data analysis unit 146.

  In step S64, the display selection subtitle data analysis unit 146 analyzes the text data corresponding to the display selection subtitle data, and determines a predetermined length (for example, a predetermined number of characters displayed at a time when display is selected, It is divided into a text group of such a length that can be read by the user for a predetermined time and supplied to the time code addition processing unit 147.

  In step S <b> 65, the time code addition processing unit 147 adds time codes of the start time and the end time to the supplied text group, and supplies them to the metadata generation unit 144.

  In step S66, the metadata generation unit 144 adds the program ID supplied from the program ID information extraction unit 143 to the text data group with the time code supplied from the time code addition processing unit 147, and the process shown in FIG. The metadata 161 described above is created and supplied to the encryption processing unit 149.

  In step S <b> 67, the encryption processing unit 149 encrypts the supplied metadata 161 using a key corresponding to the program ID stored in the key information storage unit 150 and supplies the encrypted metadata 161 to the metadata storage unit 151. .

  In step S68, the metadata storage unit 151 stores the encrypted metadata, and the process ends.

  By such processing, text data corresponding to the display selection subtitle data, time code corresponding to the text data, and metadata including the program ID are generated, encrypted, and stored. The encrypted and stored metadata is downloaded to the home server 4 owned by the user by a process described later.

  Next, user registration processing executed by the accounting server 7 described with reference to FIGS. 9 and 10 will be described with reference to the flowchart of FIG.

  In step S <b> 81, the web page publication processing unit 201 publishes the web page for user registration stored in the page information storage unit 202 to the Internet 5.

  In step S82, the operation input information acquisition unit 204 determines whether a user registration request is received from the home server 4 owned by the user or a personal computer (not shown) via the communication unit 203. If it is determined in step S82 that a user registration request has not been received, the process returns to step S81, and the subsequent processes are repeated.

  If it is determined in step S82 that a user registration request has been received, the operation input information acquisition unit 204 notifies the web page publication processing unit 201 that the user registration request has been received. The unit 201 sends data corresponding to the user registration screen to the home server 4 owned by the user or a personal computer (not shown) via the communication unit 203 and the Internet 5.

  In step S84, the operation input information acquisition unit 204 is supplied with user registration data including, for example, information related to a charging method such as a payment method and personal information such as a user's name and email address, and receives a user information registration processing unit. 205.

  In step S85, the user information registration processing unit 205 supplies the user registration data to the user information database 206 to be stored. The user information database 206 stores the supplied user registration data.

  In step S86, the authentication processing unit 207 issues a user ID that can uniquely identify the user to the newly registered user, registers the user ID in the user information database 206, and sends the issued user ID to the communication unit. The data is sent to the home server 4 owned by the user or a personal computer (not shown) via the Internet 203 and the Internet 5, and the process is terminated.

  By such processing, user information is registered in the accounting server 7. The registered user information is used at the time of supplying key information, which will be described later, and at the time of billing processing.

  Next, the metadata supply process executed by the metadata creation server 6 described with reference to FIGS. 5 and 6 will be described with reference to the flowchart of FIG.

  In step S <b> 101, the web page publication processing unit 154 publishes a web page for receiving a metadata request stored in the page information storage unit 155 to the Internet 5.

  In step S102, the metadata supply control unit 152, via the communication unit 153, metadata corresponding to programs identified by a predetermined program ID from the home server 4 held by the user or a personal computer (not shown). It is determined whether or not an input of a signal indicating an operation input requesting is received. If it is determined in step S102 that a signal indicating an operation input requesting metadata is not received, the process returns to step S101, and the subsequent processes are repeated.

  If it is determined in step S102 that a signal indicating an operation input requesting metadata has been received, in step S103, the metadata supply control unit 152 encrypts metadata corresponding to the requested program. Is transmitted from the metadata storage unit 151 to the home server 4 owned by the user or a personal computer (not shown) via the communication unit 153 and the Internet 5, and the process is terminated.

  Through such processing, the encrypted metadata is sent to the home server 4 owned by the user or a personal computer (not shown). The sent metadata is stored in the home server 4, decrypted by processing to be described later, and used for search processing.

  Next, the decryption key supply control process executed by the accounting server 7 described with reference to FIGS. 9 and 10 will be described with reference to the flowchart of FIG.

  In step S <b> 121, the web page publication processing unit 201 publishes a web page for receiving a purchase request for a decryption key for decrypting metadata stored in the page information storage unit 202 to the Internet 5.

  In step S122, the operation input information acquisition unit 204 determines whether an operation input requesting a decryption key has been received from the home server 4 held by the user or a personal computer (not shown) via the communication unit 203. To do. If it is determined in step S122 that an operation input requesting a decryption key has not been received, the process returns to step S121, and the subsequent processes are repeated.

  If it is determined in step S122 that an operation input requesting a decryption key has been received, the operation input information acquisition unit 204 notifies the authentication processing unit 207 that an operation input requesting a decryption key has been received. The authentication processing unit 207 requests the home server 4 owned by the user or a personal computer (not shown) to send a user ID via the communication unit 205, and is registered in the user information database 206. The authentication process is executed by inquiring the current user ID.

  In step S124, the key supply processing unit 208 requests a decryption key using the home server 4 held by the user or a personal computer (not shown) based on the result of the authentication processing supplied from the authentication processing unit 207. The user who has performed the operation input determines whether or not the user has been correctly authenticated.

  If it is determined in step S124 that the authentication has been correctly performed, in step S125, the key supply processing unit 208 controls the charging processing unit 210 to input information input from the user, or the user information database 206 or the charging information database. Based on the information registered in 211, the settlement processing is executed. Payment processing includes, for example, credit card payment and electronic money payment. The billing processing unit 210 executes settlement processing using these general settlement methods.

  In step S <b> 126, the key supply processing unit 208 determines whether or not the settlement is correctly completed based on the signal supplied from the charging processing unit 210.

  If it is determined in step S126 that the payment has been correctly completed, in step S127, the key supply processing unit 208 receives a request from the signal indicating the request for the decryption key from the user supplied from the operation input information acquisition unit 204. The program ID of metadata corresponding to the decrypted key is acquired.

  In step S128, the key supply processing unit 208 reads the decryption key corresponding to the program ID from the key information database 209, and the home server 4 held by the user or a personal computer (not shown) via the communication unit 203 and the Internet 5. To send to.

  In step S129, the charging processing unit 210 registers the payment method, amount, or payment result selected by the user in the charging information database 211. The billing information database 211 stores the registered billing information, and the process ends.

  If it is determined in step S124 that the authentication has not been correctly performed, or if it is determined in step S125 that the payment has not been correctly completed, in step S130, the authentication processing unit 207 or the billing processing unit 210 determines that the communication unit 203 An error message for notifying the user that the process has not been completed correctly is output to the home server 4 owned by the user or a personal computer (not shown) via the Internet 5 and the process is terminated. The

  Through such processing, a decryption key for decrypting the metadata is purchased by the user and transmitted to the home server 4 owned by the user or a personal computer (not shown). This decryption key is used for decrypting metadata by a process described later. Further, since at least a part of the consideration obtained from the user by purchasing the decryption key is paid to the broadcasting station 1 that created the display selection subtitle data, the ratio of the program with the display selection subtitle added increases. Is predicted, and hearing-impaired persons can enjoy more programs.

  Next, referring to the flowchart of FIG. 17, the home server 4 owned by the user, described with reference to FIG. 3, in parallel with the metadata supply process of FIG. 15 and the decryption key supply control process of FIG. 16. The metadata storage process 1 executed in FIG.

  In step S141, a metadata acquisition process described later with reference to FIG. 18 is executed. Here, the metadata acquisition processing is executed in step S141 here, but may be executed at any timing as long as step S149 described later is executed.

  In step S <b> 142, the network interface 73 accesses a web page that is disclosed on the Internet 5 and accepts a purchase request for a decryption key for decrypting metadata, and displays the web page on the display unit 74. Since the user refers to the web page displayed on the display unit 74 and uses the operation input unit 71 to specify a program for which metadata is desired, the network interface 73 is supplied from the operation input unit 71. A signal for requesting the purchase of a decryption key for decrypting the encrypted metadata designated by the program ID, that is, the information designating the program for which the metadata desired to be used is transmitted via the Internet 5 Transmit to billing server 7.

  The network interface 73 receives data corresponding to a web page that requests input of information necessary for authentication processing from the accounting server 7 and causes the display unit 74 to display the web page. The user refers to a web page that is displayed on the display unit 74 and requests input of information necessary for the authentication process, and uses the operation input unit 71, for example, information necessary for the authentication process, such as a user ID. Therefore, in step S 143, the network interface 73 transmits information necessary for the authentication process supplied from the operation input unit 71 to the accounting server 7 via the Internet 5.

  In step S144, the network interface 73 determines whether or not the authentication has been correctly performed based on the signal supplied from the billing server 7.

  If it is determined in step S144 that the authentication has been correctly performed, the network interface 73 receives data corresponding to the web page requesting input of information necessary for the settlement process from the billing server 7, and displays the web page on the display unit 74. To display. The user refers to the web page that is displayed on the display unit 74 and requests input of information necessary for the settlement process, and inputs information necessary for the settlement process using the operation input unit 71. Therefore, step S145 is performed. The network interface 73 is necessary for the payment process supplied from the operation input unit 71 such as the user ID and password set in the contract with the financial institution for the payment method and the payment method, for example. Information is transmitted to the accounting server 7 via the Internet 5.

  In step S146, the network interface 73 determines whether or not the payment is correctly completed based on the signal supplied from the billing server 7.

  If it is determined in step S146 that the payment has been correctly completed, in step S147, the network interface 73 receives the decryption key corresponding to the designated program ID from the charging server 7 via the Internet 5, and the key The information is supplied to the information storage unit 76.

  In step S148, the key information storage unit 76 stores the supplied decryption key in association with the program ID.

  In step S 149, the decryption processing unit 77 decrypts the encrypted metadata stored in the encrypted metadata storage unit 75 using the decryption key stored in the key information storage unit 76, and generates metadata. The data is supplied to the storage unit 78.

  In step S150, the metadata storage unit 78 stores the decrypted metadata, and the process ends.

  If it is determined in step S144 that the authentication has not been correctly performed, or if it is determined in step S147 that the payment has not been correctly completed, in step S151, the network interface 73 is connected to the accounting server 7 via the Internet 5. Then, an error message indicating that the process has not been terminated properly is received, output and displayed on the display unit 74, and the process is terminated.

  Through such processing, the encrypted metadata is downloaded from the metadata creation server 6, the processing for purchasing the decryption key for decrypting the metadata is executed, and the decryption key is obtained from the billing server 7. Therefore, a decryption key for decrypting the metadata and using it for the search process is stored in the home server 4.

  Next, the metadata acquisition process executed in step S141 in FIG. 17 will be described with reference to the flowchart in FIG.

  In step S <b> 161, the network interface 73 accesses a web page published on the Internet 5 for receiving a metadata request, and displays the web page on the display unit 74. Since the user refers to the web page displayed on the display unit 74 and uses the operation input unit 71 to specify a program for which metadata is desired, the network interface 73 is supplied from the operation input unit 71. The program name or program ID corresponding to the program designated by the user's operation input is supplied to the metadata creation server 6 via the Internet 5.

  In step S <b> 162, the network interface 73 determines whether or not encrypted metadata has been received from the metadata creation server 6 via the Internet 5. If it is determined in step S162 that metadata has not been received, the process returns to step S161, and the subsequent processes are repeated.

  If it is determined in step S162 that metadata has been received, the network interface 73 supplies the received encrypted metadata to the encrypted metadata storage unit 75 in step S163. The encrypted metadata storage unit 75 stores the supplied encrypted metadata, and the process ends.

  Through such processing, the encrypted metadata can be downloaded from the metadata creation server 6.

  Next, with reference to the flowchart of FIG. 19, the search process performed in the home server 4 which a user owns demonstrated using FIG. 3 is demonstrated.

  In step S181, the operation input unit 71 receives an input designating a program to be searched from the user and supplies the input to the matching processing unit 97. In step S182, the operation input unit 71 stores text data serving as a search key for searching for the reproduction start position. The input is received and supplied to the matching processing unit 97. For example, when the broadcast program described with reference to FIG. 2 is recorded and the user tries to perform a search process for reproducing a portion of interest in the “7 o'clock news”, the operation input unit 71 receives an operation input for designating a program “7 o'clock news”, and also receives an input of the text “wheelchair” of “7 o'clock news”, and supplies it to the matching processing unit 97.

  In step S183, the matching processing unit 97 is stored in the metadata storage unit 78 using the program ID corresponding to the program designated by the user in step S181 and the text designated by the user in step S182 as search keys. Matching processing with the existing metadata is performed, text data including a search key and a time code corresponding to the text data are detected and supplied to the recorded data search output unit 80. For example, if the metadata described with reference to FIG. 7 is stored in the metadata storage unit 78, the matching process executed by the matching processing unit 97 starts corresponding to the text 2 including the text “wheelchair”. Since the time “19: 00: 46: 01” and the end time “19: 00: 56: 51” are detected, the matching processing unit 97 starts the time “19: 00: 46: 01” corresponding to the text 2. And the end time “19: 00: 56: 51” and “today's first topic is about a wheelchair” corresponding to the text 2 are supplied to the recorded data search output unit 80.

  If text data that is a search key is included in a plurality of text groups that are distinguished by the same program ID, the matching processing unit 97 uses a plurality of time codes and text data that correspond to the text data that is the search key. In this case, for example, a plurality of text groups including text data as search keys are displayed on the display unit 74 so that the user can select them. Based on the user's operation input, the playback start position desired by the user among a plurality of detection results is made possible by making it possible to sequentially change the playback start position from the earliest time in the time code. It is preferable that the text data including the start position can be selected by a simple operation.

  In step S184, as described with reference to FIG. 8, the recorded data search / output unit 80 determines the user from the number of sounds of the voice data corresponding to the supplied text data (in many cases, the number of characters) and the time code. From the time corresponding to the utterance timing of the text “wheelchair” used as a search key for the reproduction start position. The time information corresponding to the time earlier by the time Δt is calculated.

  In step S185, based on the calculated time information, the recorded data search output unit 80 reads from the recorded data storage unit 72 the reproduction start position corresponding to the text serving as the search key of the recorded data specified by the program ID. A position that is earlier than the estimated time by a predetermined time is searched and output to the display selection subtitle data decoder 3 via the output terminal 61-1 and the output terminal 61-2, and the process is terminated.

  By such processing, the time code corresponding to the start time and end time of the text group including the text data input by the user is detected, and based on the detected time code, the recording corresponding to the text data serving as the search key is detected. Time information of the playback start position is calculated, and recorded data is searched based on the calculated time information. By applying the present invention, for example, all text data corresponding to subtitle data included in the recorded data is searched, and compared with a case where the start position of recording / playback corresponding to the text data input by the user is determined. Thus, it is possible not only to easily and quickly search for the playback start position desired by the user, but also to search for the video corresponding to the search key, regardless of the length of the text group and the position of the search key in the text group. Recorded data can be reproduced from a position close to the sound.

  Next, the charging process executed by the charging server 7 described with reference to FIGS. 9 and 10 will be described with reference to the flowchart of FIG.

  In step S <b> 201, the billing processing unit 210 refers to information registered in the billing information database 211 and generates billing information for the user who purchased the decryption key. Specifically, the billing processing unit 210 refers to the information registered in the billing information database 211, and provides financial institution (for example, a credit card company, an electronic money service provider, etc.) that settled accounts for each user. Each time, the charges generated by the purchase of the decryption key are totaled and charged.

  In step S202, the billing processing unit 210 executes billing processing for a predetermined financial institution or the like. Specifically, the billing processing unit 210 accesses, for example, a billing server (not shown) that executes a settlement process that is held by a financial institution such as a card company via the Internet 5 or a predetermined dedicated line, The user billing information generated in S201 is transmitted.

  In step S203, the billing processing unit 210 refers to the information registered in the billing information database 211 and calculates the number of decryption keys supplied to decrypt the metadata corresponding to the display-selected caption data for each program. .

  In step S204, the accounting processing unit 210 calculates the supply number of the decryption key for decrypting the metadata corresponding to the provided display selection subtitle data for each broadcasting station 1 based on the calculation result of step S203. .

  In step S205, the billing processing unit 210 calculates a payment amount for each broadcasting station based on the calculation result in step S204. Specifically, the billing processing unit 210 obtains the profits obtained by the service provider that owns the billing server 7 from the consideration of the decryption key obtained from the user (between the broadcast station 1 and the service provider that owns the billing server 7). It is determined by the contract, and even if it is a predetermined amount, it may be a fraction of the consideration of the decryption key), and the amount is calculated as a payment amount for each broadcasting station.

  In step S206, the billing processing unit 210 executes a process of paying consideration to each broadcasting station based on the payment amount calculated by the process of step S205, and the process is terminated. Specifically, the billing processing unit 210 accesses a billing server (not shown) owned by a financial institution (for example, a bank) designated by the broadcasting station 1 via the Internet 5 or a predetermined dedicated line. Then, information necessary for transferring the payment amount calculated in step S205 to the designated account is transmitted.

  With such a process, it is possible to perform a billing process for a fee for distributing a decryption key used for decrypting metadata. Further, since at least a part of the consideration obtained from the user by purchasing the decryption key is paid to the broadcasting station 1 that created the display selection subtitle data, the ratio of the program with the display selection subtitle added increases. Is predicted, and hearing-impaired persons can enjoy more programs.

  Through the processing described above, using the display selection subtitle data, using the text data input by the user, it is possible to accurately search information desired by the user from the recorded data, that is, the user has input as a search key. Playback of recorded data can be started from a time close to the time when the voice corresponding to the text is spoken. In addition, a fee for decrypting the metadata used for the search processing is distributed to the user for a fee by the billing server 7, thereby paying the broadcasting station for the creation of the display selection subtitle data. Therefore, not only can it contribute to the development of the industry, but it also leads to an improvement in the ratio of subtitle data attached to the broadcast signal, which is very beneficial for the hearing impaired.

  Here, the metadata has been described as being created by the metadata creation server 6 and supplied to the home server 4 owned by the user via the Internet 5, but the metadata is the metadata creation server 6. Even if it is not created by the server, it may be created by any device including the home server 4 and the display selection subtitle decoder 3, and the home server 4 can acquire the metadata. Needless to say, the present invention can be applied. The present invention can also be applied to the case where the metadata acquired by the home server 4 is not decrypted. In such a case, the home server 4 uses a decryption key for decrypting the metadata. It is possible to omit the function of acquiring and executing the decoding process.

  The series of processes described above can also be executed by software. The software is a computer in which a program constituting the software is incorporated in dedicated hardware, or a various personal computer capable of executing various functions by installing various programs. For example, it is installed from a recording medium.

  As shown in FIG. 5 or FIG. 7, this recording medium is distributed to provide a program to the user separately from the computer, and includes a magnetic disk 121 (including a flexible disk) on which the program is recorded, and an optical disk 122. Package media including CD-ROM (compact disk-read only memory), DVD (digital versatile disk), magneto-optical disk 123 (including MD (mini-disk) (trademark)), or semiconductor memory 124 Etc.

  Further, in the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but may be performed in parallel or It also includes processes that are executed individually.

  In the present specification, the term “system” represents the entire apparatus constituted by a plurality of apparatuses.

  Further, it goes without saying that the present invention is applicable even when processing executed by a part or all of a system constituted by a plurality of devices is realized by processing of the same information processing device. Yes.

It is a figure for demonstrating the structure of the information processing system to which this invention is applied. It is a figure for demonstrating the broadcast signal broadcast from the broadcasting station of FIG. It is a block diagram for demonstrating the display selection subtitle decoder and home server of FIG. It is a figure for demonstrating the video recording data produced | generated by the display selection subtitle decoder of FIG. It is a block diagram for demonstrating the structure of the metadata production server of FIG. It is a functional block diagram for demonstrating the process which the metadata production server of FIG. 5 performs. It is a block diagram for demonstrating the metadata produced by a metadata production server. It is a figure for demonstrating the method to detect the starting point of the text used as the key of search. It is a block diagram for demonstrating the structure of the accounting server of FIG. It is a functional block diagram for demonstrating the process which the accounting server of FIG. 9 performs. It is a flowchart for demonstrating the process 1 of a display selection subtitle decoder. It is a flowchart for demonstrating the recording data creation process 1. FIG. 10 is a flowchart for explaining metadata creation processing 1; It is a flowchart for demonstrating a user registration process. It is a flowchart for demonstrating a metadata supply process. It is a flowchart for demonstrating a decryption key supply control process. 5 is a flowchart for explaining metadata storage processing 1; It is a flowchart for demonstrating a metadata acquisition process. It is a flowchart for demonstrating a search process. It is a flowchart for demonstrating an accounting process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Broadcasting station 2 Television receiver 3 Display selection subtitle decoder 4 Home server 5 Internet 6 Metadata production server 7 Billing server 15 Video data 16 Audio data 17 Display selection subtitle data 21 Input terminal 33 Output signal generation part 35 Display selection subtitle data Decoder 36 OSD
37 Compositing processing section 39 Program ID information extracting section 40 Timer 41 Operation input section 71 Operation input section 72 Recording data storage section 73 Network interface 77 Decoding processing section 78 Metadata storage section 79 Matching processing section 80 Recording data detection output section 95 Recording start Time information 141 Broadcast data acquisition unit 143 Program ID information extraction unit 144 Metadata generation unit 145 Display selected caption data decoder 147 Time code addition processing unit 149 Encryption processing unit 152 Metadata supply control unit 161 Metadata 165 Text data 166 Time code 167 Program ID
204 Operation Input Information Acquisition Unit 205 User Information Registration Processing Unit 206 User Information Database 207 Authentication Processing Unit 208 Key Supply Processing Unit 210 Accounting Processing Unit 211 Accounting Information Database

Claims (4)

In an information processing apparatus for searching recorded data including audio data using text information as a search key,
Recording data storage control means for controlling storage of the recording data;
Discrimination information for distinguishing programs of the recorded data, subtitle data that is associated with each audio data and is text data related to the recorded data, and metadata including start time information about the time at which each subtitle data starts Metadata storage means for storing;
Operation input means for receiving user operation input;
A matching process is executed between the information input from the user by the operation input means for designating a program to be searched and the text information as a search key and the metadata stored by the metadata storage means. Matching processing means for detecting start time information of the subtitle data corresponding to the text information serving as a search key and the subtitle data;
Wherein said detecting the position of the text that matches the text information in the subtitle data detected by the matching processing unit, and the detected position, the start time information of the subtitle data, display time of the subtitle data, and the subtitle data The start time of the text information input from the user is calculated based on the number of characters, and the text data corresponds to the text information from the recording data whose storage is controlled by the recording data storage control unit based on the start time. and a search means for reading by searching a portion,
Metadata acquisition means for acquiring the encrypted metadata;
Key information acquisition means for acquiring key information used to decrypt the encrypted metadata;
Decryption processing means for decrypting the encrypted metadata acquired by the metadata acquisition means using the key information acquired by the key information acquisition means;
Further comprising
The metadata stored by the metadata storage means is the metadata decrypted by the decryption processing means.
An information processing apparatus characterized by that . 2. The information according to claim 1, wherein the search unit searches a time before a predetermined time from a text position that matches the text information serving as a search key, as a start position for reading the recorded data. Processing equipment. In an information processing method of an information processing apparatus for searching for recorded data to which first time information is added using metadata,
Control storage of the metadata including discrimination information for distinguishing programs of the recorded data , text data corresponding to caption data included in the recorded data, and second time information corresponding to the text data A metadata storage control step;
A metadata acquisition step for acquiring the encrypted metadata;
A key information obtaining step for obtaining key information used for decrypting the encrypted metadata;
A decryption processing step of decrypting the encrypted metadata acquired by the metadata acquisition step using the key information acquired by the key information acquisition step;
The metadata whose storage is controlled by the metadata storage control step is the metadata decrypted by the decryption processing step,
An input control step for controlling input of information specifying a program to be searched and text information as a search key;
The second time information corresponding to the text information by executing a matching process between the information specifying the program whose input is controlled by the process of the input control step and the text information and the metadata; Detecting the text data including the text information;
Of the text data detected by the processing of the detection step, a calculation step for calculating the position of the text information;
A search is made for a recording position of the text data corresponding to the second time information detected by the process of the detection step, and the searched recording position and the text data calculated by the process of the calculation step And a reading step of searching for and reading out the recorded data based on the position of the text information. A program for causing a computer to execute a process of searching for recorded data to which first time information is added using metadata,
Control storage of the metadata including discrimination information for distinguishing programs of the recorded data , text data corresponding to caption data included in the recorded data, and second time information corresponding to the text data A metadata storage control step;
A metadata acquisition step for acquiring the encrypted metadata;
A key information obtaining step for obtaining key information used for decrypting the encrypted metadata;
A decryption processing step of decrypting the encrypted metadata acquired by the metadata acquisition step using the key information acquired by the key information acquisition step;
The metadata whose storage is controlled by the metadata storage control step is the metadata decrypted by the decryption processing step,
An input control step for controlling input of information specifying a program to be searched and text information as a search key;
The second time information corresponding to the text information by executing a matching process between the information specifying the program whose input is controlled by the process of the input control step and the text information and the metadata; Detecting the text data including the text information;
Of the text data detected by the processing of the detection step, a calculation step for calculating the position of the text information;
A search is made for a recording position of the text data corresponding to the second time information detected by the process of the detection step, and the searched recording position and the text data calculated by the process of the calculation step A program for causing a computer to execute a process, comprising: a reading step of searching for and reading out the recorded data based on the position of the text information.

Images