JP3884015B2 - Information processing system - Google Patents

Description

The present invention relates to an information processing system, in particular, by using the caption information included in the broadcast signal relates to good optimal information processing system when searching the recorded broadcast program.

  Broadcast program data includes video data and audio data. In addition to the so-called captions (introduction of program titles and casts, or Japanese captions in overseas works) that are always displayed as video data, the program data can be selected to be displayed or not. Contains data. Such selectable subtitle data is generally referred to as closed captioning, and is mainly developed for hearing-impaired people. Like Japanese subtitles in overseas works, not only the conversation of performers, for example, Explanation of BGM and sound effects is also included.

  For example, in NTSC analog terrestrial broadcasting, 525 scanning lines are used for video signals. Of these 525 lines, the first 21 lines in each field (one field consists of two fields) And VBI (Vertical Blanking Interval), which is called an interval for starting scanning. Closed captions are transmitted by multiplexing a 7-bit character code in the 21st VBI of the VBIs in each field, and each field is used to transmit two types of character sets to approximately 60 characters per second. It can be transmitted.

  As for the transmission of caption information for digital television broadcasting, as defined in the BS digital broadcasting operation regulations and technical materials (ARIB TR-B15), which are domestic regulations, video using a transport stream for caption information is used. Caption information can be transmitted simultaneously with information transmission. Then, in the digital television broadcast receiver, the code corresponding to the caption information is decoded, characters and figures constituting the caption are generated, and displayed superimposed on the video.

  In digital television broadcasting, text information transmitted simultaneously with video information transmission using a transport stream for subtitle information can be stored internally, and the text information stored internally can be displayed and viewed on a TV monitor at any time. By making it possible, there is a technique that allows a user to utilize subtitle information without taking a note of the displayed subtitle (for example, Patent Document 1).

JP 2003-78889 A

  Also, the CM program, text information, or communication data is automatically saved by the viewer's operation or received subtitle broadcast, and the broadcast station or CM provider uses the saved information by the viewer. There is a technique that enables the purchase of CM merchandise by communicating with (for example, Patent Document 2).

JP 2002-77772 A

  In addition, the video data and the audio data in the broadcast signal are, for example, not to be watched in real time at the time of broadcasting, for example, so that the time axis is not shifted when recorded and reproduced, for example, Have corresponding link information or have a time stamp of relative time. On the other hand, caption data does not have link data for video data or audio data, a time stamp of relative time, or the like.

  As described above, the caption data to be broadcast has begun to be used for various services.

  However, when subtitle data that is broadcast such as closed captions is used to search for recorded programs, subtitle data and video data or audio data are either analog broadcast or digital broadcast. Since a time stamp that matches the two is not added, after separating the text data corresponding to the closed caption from the video data, it is impossible to take a correspondence between the separated text and the video data. Therefore, the text obtained from the closed caption cannot be used for searching the recorded data.

  In addition, caption data for the hearing impaired, such as closed captions, is required to be attached to all broadcast signals. However, such subtitle data is usually not necessary for healthy people, so there is almost no possibility that a sponsor will be charged to generate the necessary cost for subtitle data creation, and the broadcasting station bears the cost of creation. This is the current situation. Therefore, although it is disadvantageous for the hearing impaired, the ratio that closed captions and other caption data for the hearing impaired are attached to the broadcast signal remains stagnant. Here, by using these subtitle data secondarily, the construction of a system capable of collecting the compensation to the broadcasting station for subtitle data creation can only contribute to the development of the industry. In addition, since it leads to an improvement in the rate at which caption data is attached to a broadcast signal, it is also beneficial for the hearing impaired.

  The present invention has been made in view of such a situation, and makes it possible to search for recorded data using caption data such as so-called closed captions.

  An information processing system according to the present invention includes a first information processing apparatus that acquires and processes a broadcast signal, a second information processing apparatus that searches recorded data using text information as a search key, and a second information processing apparatus. A third information processing device for generating metadata used for the search processing executed in step (b) and a decryption key for decrypting the metadata used for the search processing executed by the second information processing device. 4 is an information processing system configured to include a first broadcast signal acquisition unit that acquires a broadcast signal, and a first broadcast signal acquisition unit that acquires the broadcast signal. From the broadcast signal, first distinction information acquisition means for acquiring distinction information capable of uniquely distinguishing a program of the broadcast signal, first time information on the broadcast signal acquired by the first broadcast signal acquisition means, First distinction information collection Information adding means for generating recorded data by adding the discriminating information acquired by the obtaining means, and the second information processing apparatus stores the recording data to which the first time information and the discriminating information are added. Recording data storage control means for controlling the metadata, metadata acquisition means for acquiring the encrypted metadata, decryption key acquisition means for acquiring a decryption key used for decrypting the encrypted metadata, Distinguishing between the decryption processing means for decrypting the encrypted metadata obtained by the data obtaining means using the decryption key obtained by the decryption key obtaining means and the program of the recorded data decrypted by the decryption processing means Metadata storage means for storing metadata including distinction information for recording, text data relating to recorded data, and second time information corresponding to the text data, and a user Matching between the operation input means that receives the operation input, the information that designates the program to be searched and the text information that serves as the search key, which are input from the user by the operation input means, and the metadata that is stored by the metadata storage means The matching processing unit detects the second time information corresponding to the text information serving as the search key by executing the process, and the recording data whose storage is controlled by the recording data storage control unit. Search means for searching for a recording position corresponding to the second time information, and reading recorded data starting from the searched recording position, and the third information processing apparatus is configured to acquire a broadcast signal. Discrimination information that can uniquely distinguish the broadcast signal program from the broadcast signal acquired by the broadcast signal acquisition means and the second broadcast signal acquisition means. Subtitle data for extracting and decoding subtitle data that can be selected by the user from the broadcast signal acquired by the second distinction information acquisition means and the second broadcast signal acquisition means to be acquired. A decoding means; a time code adding means for adding a time code to text data corresponding to the subtitle data decoded by the subtitle data decoding means; and a discrimination information acquiring means for the text data to which the time code is added by the time code adding means. The fourth information processing apparatus includes a metadata generation unit that generates metadata by adding the distinction information acquired by the method, and an encryption unit that encrypts the metadata generated by the metadata generation unit. Authentication information acquisition means for acquiring information related to user authentication from the second information processing apparatus, and user registration Authentication based on registration information storage control means for controlling information storage, information on user authentication acquired by the authentication information acquisition means, and user registration information whose storage is controlled by the registration information storage control means Authentication processing means for executing processing, and decryption key supply control means for controlling supply of a decryption key for decrypting metadata to the second information processing apparatus when the user is correctly authenticated by the authentication processing means. It is characterized by that.

  In the information processing system of the present invention, a broadcast signal is acquired by the first information processing apparatus, and from the acquired broadcast signal, discrimination information that can uniquely distinguish a program of the broadcast signal is acquired, and the acquired broadcast signal In addition, the first time information and the discrimination information are added to generate the recording data, and the second information processing apparatus stores the recording data to which the first time information and the discrimination information are added, and encrypts it. Encrypted metadata is obtained, a decryption key used to decrypt the encrypted metadata is obtained, the encrypted metadata is decrypted using the decryption key, and the recorded data program is distinguished. Information for storing the discriminating information, the text data related to the recording data, and the metadata including the second time information corresponding to the text data, the user's operation being input, and the program for executing the search Then, the matching process between the text information serving as the search key and the metadata is executed, and the second time information corresponding to the text information serving as the search key is detected, and is detected from the stored recorded data by the matching process. The recording position corresponding to the second time information thus obtained is searched, the recording data starting from the searched recording position is read out, the third information processing apparatus acquires the broadcast signal, and from the broadcast signal, Discrimination information that can uniquely distinguish a broadcast signal program is acquired, subtitle data that can be selected by the user to be displayed or not is extracted from the broadcast signal, decoded, and the decoded subtitle data is supported The time code is added to the text data to be added, the identification information is added to the text data to which the time code is added, metadata is generated, The generated metadata is encrypted, the fourth information processing apparatus acquires information related to user authentication from the second information processing apparatus, stores user registration information, information related to user authentication, and When the authentication process is executed based on the user registration information and the user is correctly authenticated, a decryption key for decrypting the metadata is supplied to the second information processing apparatus.

According to the present invention, recorded data can be searched using metadata, and in particular, recorded data that can be searched using metadata having time information corresponding to text data and discrimination information for distinguishing programs. Can be generated, the encrypted metadata can be decrypted, and the recorded data can be searched using the metadata.

  Embodiments of the present invention will be described below. The correspondence relationship between the invention described in this specification and the embodiments of the invention is exemplified as follows. This description is intended to confirm that the embodiments supporting the invention described in this specification are described in this specification. Therefore, even if there is an embodiment that is described in the embodiment of the invention but is not described here as corresponding to the invention, the fact that the embodiment is not It does not mean that it does not correspond to the invention. Conversely, even if an embodiment is described herein as corresponding to an invention, that means that the embodiment does not correspond to an invention other than the invention. Absent.

  Further, this description does not mean all the inventions described in this specification. In other words, this description is for the invention described in the present specification, which is not claimed in this application, that is, for the invention that will be applied for in the future or that will appear and be added by amendment. It does not deny existence.

The information processing system according to claim 1 includes a first information processing apparatus (for example, the display selection subtitle decoder 3 in FIG. 3 or the display selection subtitle decoder 301 in FIG. 20) that acquires and processes a broadcast signal; A second information processing apparatus (for example, home server 4 in FIG. 3 or FIG. 20) that searches recorded data using text information as a search key, and a meta that is used for search processing executed by the second information processing apparatus. A third information processing apparatus that generates data (for example, the metadata creation server 6 in FIGS. 5 and 6), and a decryption key that decrypts metadata used for search processing executed by the second information processing apparatus Information processing system (for example, charging server 7 in FIG. 8 and FIG. 9), and the first information processing apparatus obtains a broadcast signal. broadcast The broadcast signal program can be uniquely distinguished from the broadcast signal acquired by the signal acquisition means (for example, the input terminals 21-1 and 21-2 in FIG. 3 or FIG. 20) and the first broadcast signal acquisition means. The first distinction information acquisition means (for example, the program ID information extraction unit 39 in FIG. 3 or FIG. 20) for acquiring information (for example, program ID) and the broadcast signal acquired by the first broadcast signal acquisition means, Information adding means (for example, FIG. 3) that adds first time information (for example, recording start time information 95 in FIG. 4) and the discrimination information acquired by the first discrimination information acquisition means to generate recording data. Or the output signal generation unit 33 in FIG. 20, and the second information processing apparatus includes a recording data storage control unit (for example, a storage unit for controlling recording data to which the first time information and the discrimination information are added). 3 or 20 A recorded data storage unit 72), metadata acquisition means for acquiring encrypted metadata (for example, the network interface 73 in FIG. 3 or FIG. 20), and decryption used to decrypt the encrypted metadata. Decryption key acquisition means (for example, the network interface 73 in FIG. 3 or FIG. 20) for acquiring a key, and the encrypted metadata acquired by the metadata acquisition means, the decryption key acquired by the decryption key acquisition means Decoding processing means (for example, the decoding processing unit 77 in FIG. 3 or FIG. 20) to be used for decoding, and discrimination information (for example, the program ID 167 in FIG. 7) for distinguishing the program of the recorded data decoded by the decoding processing means. ), Text data related to the recording data (for example, text data 165 in FIG. 7), and text data Metadata storage means (for example, the metadata storage unit 78 of FIG. 3 or FIG. 20) that stores metadata (for example, the metadata 161 of FIG. 7) including the second time information (for example, the time code 166 of FIG. 7). ), An operation input means (for example, the operation input unit 71 of FIG. 3 or FIG. 20) that receives the user's operation input, and information and a search key that are input from the user by the operation input means and that specify a program to be searched The matching processing means (for example, FIG. 3) detects the second time information corresponding to the text information serving as the search key by executing the matching processing between the text information to be and the metadata stored by the metadata storage means. Alternatively, the matching processing unit 79) of FIG. 20 and the recorded data whose storage is controlled by the recorded data storage control unit are used by the matching processing unit. Search means for searching for a recording position corresponding to the detected second time information and reading recorded data starting from the searched recording position (for example, the recorded data search output unit 80 in FIG. 3 or FIG. 20); The third information processing apparatus includes a second broadcast signal acquisition unit (for example, the broadcast data acquisition unit 141 in FIG. 6) that acquires a broadcast signal, and a broadcast signal acquired by the second broadcast signal acquisition unit. Second identification information acquisition means (for example, program ID information extraction unit 143 in FIG. 6) for acquiring identification information (for example, program ID) that can uniquely distinguish the program of the broadcast signal, and acquisition of the second broadcast signal Subtitle data decoding means for extracting and decoding subtitle data (for example, display selection subtitle data 17 in FIG. 2) that can be selected by the user from the broadcast signal acquired by the means. (For example, display selection subtitle data decoder 145 in FIG. 6) and time code adding means for adding time code to text data corresponding to the subtitle data decoded by the subtitle data decoding means (for example, time code adding means in FIG. 6) 147) and metadata generation means (for example, the meta data shown in FIG. 6) for generating metadata by adding the discrimination information acquired by the discrimination information acquisition means to the text data to which the time code is added by the time code addition means. A data generation unit 144) and an encryption unit (for example, the encryption processing unit 149 in FIG. 6) for encrypting the metadata generated by the metadata generation unit. Authentication information acquisition means (for example, the operation input information acquisition unit in FIG. 9) that acquires information related to user authentication from the information processing apparatus of FIG. 204), registration information storage control means for controlling storage of user registration information (for example, the user information database 206 in FIG. 9), information relating to user authentication acquired by the authentication information acquisition means, and registration information storage Based on the registration information of the user whose storage is controlled by the control unit, when the authentication processing unit (for example, the authentication processing unit 207 in FIG. 9) that executes the authentication process and the user is correctly authenticated by the authentication processing unit, A decryption key supply control unit (for example, the key supply processing unit 208 in FIG. 9) that controls supply of a decryption key for decrypting metadata to the second information processing apparatus is provided.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a system diagram for explaining the configuration of an information processing system to which the present invention is applied.

  The broadcasting station 1 broadcasts a program using terrestrial waves or satellite waves. Broadcast program data includes video data and audio data. In addition to the so-called captions (introduction of program titles and casts, or Japanese captions in overseas works) that are always displayed as video data, the program data can be selected to be displayed or not. Contains data. Such selectable subtitle data (so-called closed captions) includes not only text data corresponding to performers' conversations such as Japanese subtitles in overseas works, but also explanations such as BGM and sound effects. It may be included.

  For example, in NTSC analog terrestrial broadcasting, 525 scanning lines are used for video signals. Of these 525 lines, the first 21 lines in each field (one field consists of two fields) And VBI (Vertical Blanking Interval), which is called an interval for starting scanning. Closed captions are transmitted by multiplexing a 7-bit character code in the 21st VBI of the VBIs in each field, and each field is used to transmit two types of character sets to approximately 60 characters per second. It can be transmitted. Hereinafter, subtitle data typified by closed captions and capable of selecting display and non-display will be referred to as display selection subtitle data.

  Specific examples of video data, audio data, and display selection subtitle data will be described with reference to FIG.

  The video data 15 is moving image data, and in FIG. 2, frame image data at several timings is extracted from the moving image data. The audio data 16 is audio data to be reproduced simultaneously with the video data 15. The display selection subtitle data 17 may be, for example, text data corresponding to the voice data 17, and when the voice data other than the text data corresponding to the voice data is conversation, for explaining the speaker. Text data or the like may be included. The video data 15 and the audio data 16 are recorded and reproduced, for example, in addition to being viewed in real time at the time of broadcasting, for example, by having corresponding link information or having a relative time stamp. Even in such a case, the time axis is not shifted. On the other hand, since the display selection subtitle data 17 is assumed to be treated in the same way as the video data until it is decoded at the time of reproduction, the link data for the video data 15 or the audio data 16 or the time of the relative time is assumed. Does not have stamps.

  Returning again to the description of FIG.

  Using the television receiver 2, the user receives a broadcast signal composed of the video data 15 including the display selection subtitle data 17 described with reference to FIG. 2 and the audio data 16. The user who does not need to display the display selection subtitle data and does not perform the search processing described later using the display selection subtitle data can use the broadcast selected by the tuner 11 without using the display selection subtitle decoder 3. The video and audio signal processing unit 12 demodulates the signal, and the video signal is displayed on the display of the output unit 13, and the audio signal is output to the speaker of the output unit 13 to view the program.

  The display selection subtitle decoder 3 receives the broadcast signal selected by the tuner 11 of the television receiver 2, decodes the video signal and the audio signal, and displays the display selection subtitle data based on the user's operation input. It can be extracted and decoded, and output to the output unit 13 for display and audio output. Further, the display selection subtitle decoder 3 receives the input of the broadcast signal selected by the tuner 11 of the television receiver 2 and processes the broadcast signal, so that the home server 4 transmits the metadata creation server via the Internet 5. Recording data with a time stamp capable of executing a search process using the metadata acquired from 6 can be generated and supplied to the home server 4. Further, the display selection subtitle decoder 3 receives the supply of the recording data recorded by the home server and designated by the search position by the search process, decodes the display selection subtitle as necessary, and outputs the decoded subtitle to the output unit 13. Display and audio output can be performed.

  The home server 4 receives the recording data with a time stamp generated by the display selection subtitle decoder 3 based on the operation input of the user, and records (that is, records) on the internal recording medium. In addition, the home server 4 receives supply of metadata including text data corresponding to display selection subtitle data and a time code corresponding to the text data from the metadata creation server 6 via the Internet 5. The supply of key data for decrypting the metadata is received from the accounting server 7, the metadata is decrypted, and the matching process between the text input by the user and the metadata is executed using the decrypted metadata. As a result of the matching process, a time code corresponding to the text input by the user is detected, and the recorded data is searched based on the time code and supplied to the display selection subtitle decoder 3. Details of the search process will be described later. Here, the searched “program” is, for example, a whole program such as a two-hour drama, or a plurality of units even when each program is divided by a commercial or the like. Even a program may be included, or a commercial may be included or only a commercial may be indicated.

  The metadata creation server 6 obtains a broadcast signal with display selection subtitle data created by the broadcast station 1 by receiving it via the Internet 5, via a predetermined medium, or from an antenna (not shown), Based on that, metadata is created and the created metadata is encrypted. Further, the metadata creation server 6 publishes a web page for distributing encrypted metadata to users via the Internet 5 on the Internet 5, for example, the home server 4 or a personal computer (not shown). In response to access from the used user, the encrypted metadata used for searching for the program desired by the user is downloaded via the Internet 5.

  The accounting server 7 publishes on the Internet 5 a web page for distributing the decryption key for decrypting the metadata created by the metadata creation server 6 and encrypted and distributed to the user to the user via the Internet 5. For example, after receiving access from the user using the home server 4 or a personal computer (not shown), the user pays for the decryption key of the metadata desired by the user, and then distributes the key to the user. In addition, the accounting server 7 executes an accounting process for paying the broadcasting station 1 a fee for the broadcasting station 1 that has created the display selection subtitle data.

  FIG. 3 is a block diagram showing a configuration of the display selection subtitle decoder 3 and the home server 4 of FIG.

  Of the broadcast signals selected by the tuner 11 of the television receiver 2, a video signal including display selection caption data is supplied to the video signal decoder 31 from the input terminal 21-1, and an audio signal is input to the input terminal 21-. 2 is input to the audio signal decoder 34.

  The video signal decoder 31 decodes the supplied video signal and supplies the decoded video data to the memory 32. The memory 32 is a frame memory that temporarily holds the supplied video signal. The audio signal decoder 34 decodes the supplied audio signal and outputs the decoded audio data.

  When an instruction to output the received broadcast signal in real time by the user's operation input by the operation input unit 41, that is, to view a program currently being broadcast, the display selection subtitle data decoder 35 stores the memory Video data is acquired from 32. When the display selection subtitle data is instructed by the user's operation input from the operation input unit 41, the display selection subtitle data decoder 35 decodes the display selection subtitle data included in the acquired video data. The corresponding text data is supplied to the OSD (On Screen Display) 36 and the video data is supplied to the composition processing unit 37.

  The OSD 36 converts the supplied text data into OSD data, which is image data to be displayed superimposed on the display screen, and supplies the OSD data to the composition processing unit 37. The composition processing unit 37 superimposes the supplied OSD data on the supplied video data, and outputs it from the output terminal 22-1 to the display of the output unit 13 of the television receiver 2. At this time, the audio output processing unit 38 acquires the audio data decoded by the audio signal decoder 34 and outputs the audio data to the speaker of the output unit 13 of the television receiver 2 from the output terminal 22-2.

  Based on a user operation input from the operation input unit 41 or based on a control signal supplied from the home server 4 via the data terminal 61-3, the supplied video signal and audio signal are converted into the home server. 4, the output signal generation unit 33 causes the program ID information extraction unit 39 to extract the program ID included in the program management data from the video data held in the memory 32. To control. The program ID information extraction unit 39 indicates a unit to be searched from the program management data included in the video data decoded by the video signal decoder 31 (here, “program” is a unit to be searched, for example, a 2-hour drama) Even if it is the whole program, even if one program is divided by commercials, etc., each unit divided, or those that contain multiple programs, and those that contain commercials or only commercials The program ID information that can be uniquely distinguished is extracted and supplied to the output signal generation unit 33.

  The output signal generation unit 33 refers to the timer 40 to acquire the time (absolute time) when the recording was started, and the video data supplied from the memory 32 or the audio data supplied from the audio signal decoder 34 The acquired time information is added to at least one of them, and the program ID supplied from the program ID information extraction unit 39 is added to the video data and audio data to generate an output signal to be recorded. And supplied to the home server 4 from the output terminals 23-1 and 23-2. The added time information is used as a time stamp in a search process to be described later.

  The output signal to be recorded will be described with reference to FIG.

  In the output signal generation unit 33, the recording start time information 95 is added to at least one of the video data 15 and the audio data 16 among the recorded output signals. The video data 15 includes display selection subtitle data 17. Then, program ID information is associated with these data, and an output signal for recording is generated.

  Returning to FIG. 3, the configuration of the home server 4 will be described.

  The operation input unit 71 includes, for example, input devices such as buttons, keys, a touch panel, a touch pad, and a lever, and receives user operation inputs. The recorded data storage unit 72 stores video data and audio data to which a program ID and a time stamp are added supplied from the input terminal 61-1 and the input terminal 61-2. For example, the recorded data storage unit 72 may be configured by a large-capacity recording medium such as a hard disk, or may be configured by a removable recording medium such as a DVD (Digital Versatile Disk) or a video tape.

  When the user instructs the operation input unit 71 to record a broadcast program, the recording control unit 81 can record the video signal and the audio signal supplied to the display selection subtitle decoder 3 as searchable information. In order to be able to do so, a program ID and a time stamp are added to generate a control signal for output to the home server 4 and output from the display selection subtitle decoder 3 via the data terminal 61-3 and the data terminal 23-2. The signal is supplied to the signal generator 33.

  The network interface 73 acquires information on a web page published on the Internet 5 and displays the information on the display unit 74, or based on an operation input to the operation input unit 71 by a user who refers to the display unit 74. The predetermined information is transmitted to the metadata creation server 6 or the billing server 7, or the metadata is downloaded from the metadata creation server 6 and output to the encrypted metadata storage unit 75 for storage. The decryption key acquired from the accounting server 7 is output to the key information storage unit 76 and stored. Further, the network interface 73 receives encrypted metadata, a decryption key, etc. acquired by using a personal computer (not shown) owned by the user from a personal computer (not shown) by priority or wireless communication. It is also possible to do.

  The display unit 74 is configured by, for example, an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and information on a web page published on the Internet 5 acquired via the network interface 73 and an operation input unit. 71 displays information input by the user.

  The encrypted metadata storage unit 75 stores the acquired encrypted metadata. The key information storage unit 76 stores the acquired decryption key. The decryption processing unit 77 decrypts the encrypted metadata stored in the encrypted metadata 75 using the decryption key stored in the key information storage unit 76 and outputs the decrypted metadata to the metadata storage unit 78. To remember. The metadata storage unit 78 receives the supplied metadata and stores it.

  The matching processing unit 79 receives from the operation input unit 71 information specifying the program ID of the recorded data to be searched and text serving as a search key, and refers to the metadata stored in the metadata storage unit 78. Then, the matching process is executed, and the program ID and the time code as the matching result are supplied to the recorded data search output unit 80. The recorded data search output unit 80 searches and reads the recorded data storage unit 72 based on the program ID and the time code which are the matching results supplied from the matching processing unit 79, and outputs the output terminal 62-2 and the output terminal 62-2. Is supplied to the display selection subtitle decoder 3.

  Next, FIG. 5 is a block diagram showing the configuration of the metadata creation server 6.

  A CPU (Central Processing Unit) 101 executes various processes according to a program stored in a ROM (Read Only Memory) 102 or a program loaded from a storage unit 108 to a RAM (Random Access Memory) 103. The RAM 103 also appropriately stores data necessary for the CPU 101 to execute various processes.

  The CPU 101, ROM 102, and RAM 103 are connected to each other via a bus 104. An input / output interface 105 is also connected to the bus 104.

  The input / output interface 105 includes an input unit 106 including a keyboard and a mouse, an output unit 107 including a display and a speaker, a storage unit 108 including a hard disk, and a communication unit 109 including a modem and a terminal adapter. It is connected. The communication unit 109 performs communication processing via a network including the Internet 5.

  A drive 110 is connected to the input / output interface 105 as necessary, and a magnetic disk 121, an optical disk 122, a magneto-optical disk 123, a semiconductor memory 124, or the like is appropriately mounted, and a computer program read from them is loaded. These are installed in the storage unit 108 as necessary.

  FIG. 6 is a functional block diagram for explaining functions executed by the metadata creation server 6 described with reference to FIG. 5 (including functions executed by software executed by the CPU 101).

  The broadcast data acquisition unit 141 corresponds to the communication unit 109 in FIG. 5, acquires broadcast data via the Internet 5 or via an antenna (not shown), and supplies the broadcast data to the decoder 142.

  The decoder 142 decodes the supplied broadcast data. Here, the decoder 142 may decode only the video signal including the program management information including the program ID information necessary for creating the metadata and the display selection subtitle data in the broadcast data.

  The program ID information extraction unit 143 indicates a unit to be searched for from the program management data included in the video data decoded by the decoder 142 (here, “program” is a unit to be searched for, such as a two-hour drama). Even if it is the whole program, even if one program is divided by commercials, etc., each unit divided, including multiple programs, only those containing commercials or only commercials The program ID information that can be uniquely distinguished is extracted and supplied to the metadata generation unit 144, and the supplied video data is supplied to the display selection subtitle data decoder 145.

  The display selection subtitle data decoder 145 decodes the display selection subtitle data included in the acquired video data and supplies the corresponding text data to the display selection subtitle data analysis unit 146. The display selection subtitle data analysis unit 146 divides the text data corresponding to the display selection subtitle data supplied from the display selection subtitle data decoder 145 into a text group of an appropriate length (for example, the text displayed at one time). Are divided as one text group), and the divided text group is supplied to the time code addition processing unit 147.

  The time code addition processing unit 147 refers to the timer 148 and adds a time code corresponding to the start position and end position of the text to each of the supplied text group. When the broadcast data acquisition unit 141 acquires a broadcast signal in real time (ie, at the broadcast time of the program), the time code addition processing unit 147 indicates that the current time indicated by the timer 148 is the same as when the user acquires broadcast data. It is assumed that a time code is added to the text data based on the time. Further, the time code addition processing unit 147, when the broadcast data acquisition unit 141 acquires a broadcast signal with a delay from the broadcast time of the program, or the time taken by the decoder 142 to the display selection subtitle data analysis unit 146, When it becomes longer than the output processing of a broadcast signal using a general television receiver, the current time indicated by the timer 148 and the delay time for acquiring the broadcast signal, or the delay time due to the time required for the processing Based on this, a time code corresponding to the broadcast time of the program is calculated and added to the text data.

  The metadata generation unit 144 adds the program ID information supplied from the program ID information extraction unit 143 to the text data to which the time code supplied from the time code addition processing unit 147 is added, and generates metadata. The data is supplied to the encryption processing unit 249.

  The metadata will be described with reference to FIG.

  For the text data 165 divided into text 1, text 2,..., Which is a text group of an appropriate length by the display selection subtitle data analysis unit 146, each time text group is processed by the time code addition processing unit 147. A time code 166 in which the start time and the end time are described is added. For example, when the text of “A caster“ 7 o'clock news ”” B caster “Today's first topic is ...” is divided as text 1, this part is displayed in the broadcast of the program. The start time and the end time corresponding to the time when the selected subtitle is displayed are described in the time code 166. Further, the program ID information 167 supplied from the program ID information extraction unit 143 is added, and metadata is added. 161 is generated.

  Returning to the description of FIG.

  The encryption processing unit 149 encrypts the metadata supplied from the metadata creation unit 144 with the encryption key corresponding to the program ID stored in advance in the key information storage unit 150 and supplies the encrypted metadata to the metadata storage unit 151. To do. The metadata supply control unit 152 searches the metadata storage unit 151 for encrypted metadata corresponding to a program desired by the user based on a signal for requesting metadata supplied from the communication unit 153, and The data is supplied to the home server 4 held by the user or a personal computer (not shown) via the Internet 5.

  The page information storage unit 155 stores information necessary for downloading and using metadata such as a list of metadata that can be downloaded and a method of obtaining a decryption key necessary for using the metadata. Information corresponding to the web page to be provided is stored. The web page publication processing unit 154 publishes the web page stored in the page information storage unit to the Internet 5.

  The communication unit 153 corresponds to the communication unit 109 of FIG. 5, and exchanges information with the home server 4 held by the user or a personal computer (not shown) via the Internet 5.

  Next, FIG. 8 is a block diagram showing the configuration of the accounting server 7.

  A CPU (Central Processing Unit) 171 executes various processes according to a program stored in a ROM (Read Only Memory) 172 or a program loaded from a storage unit 178 to a RAM (Random Access Memory) 173. The RAM 173 also appropriately stores data necessary for the CPU 171 to execute various processes.

  The CPU 171, ROM 172, and RAM 173 are connected to each other via a bus 174. An input / output interface 175 is also connected to the bus 174.

  The input / output interface 175 includes an input unit 176 including a keyboard and a mouse, an output unit 177 including a display and a speaker, a storage unit 178 including a hard disk, and a communication unit 179 including a modem and a terminal adapter. It is connected. The communication unit 179 performs communication processing via a network including the Internet 5.

  A drive 180 is connected to the input / output interface 175 as necessary, and a magnetic disk 121, an optical disk 122, a magneto-optical disk 123, a semiconductor memory 124, or the like is appropriately mounted, and a computer program read from them is loaded. The storage unit 178 is installed as necessary.

  Next, FIG. 9 is a functional block diagram for explaining functions executed by the accounting server 7 of FIG. 8 (including functions executed by software executed by the CPU 171).

  The page information storage unit 202 includes, for example, input of user information and billing information for user registration, a method of obtaining a decryption key necessary for using the metadata, and transmission of a decryption key purchase request. A decryption key necessary for decrypting data is provided, and information corresponding to a web page for charging the data is stored. The web page publication processing unit 201 publishes the web page stored in the page information storage unit to the Internet 5.

  The communication unit 203 corresponds to the communication unit 179 in FIG. 8, and exchanges information with the home server 4 held by the user or a personal computer (not shown) via the Internet 5.

  The operation input information acquisition unit 204 acquires the operation input information transmitted by the user via the communication unit 203. When the operation input information relates to the operation of the web page, the operation input information acquisition unit 204 In the case of personal information for user registration, in the user information registration processing unit 205, in the case of information necessary for authentication processing, in the case of information that requests authentication processing unit 207 to purchase a key, When the information is related to the charging process to the supply processing unit 208, the information is supplied to the charging processing unit 210.

  The user information registration processing unit 205 receives supply of personal information for user registration from the operation input information acquisition unit 204 and supplies it to the user information database 206. The authentication processing unit 207 issues a user ID that can uniquely identify a user to a newly registered user, registers the user ID in the user information database 206, and sends the issued user ID via the communication unit 203. The data is sent to the home server 4 owned by the user or a personal computer (not shown). The authentication processing unit 207 receives supply of information necessary for the authentication process from the operation input information acquisition unit 204, executes the authentication process with reference to the user information registered in the user information database 206, and performs the authentication process. The result is output to the key supply processing unit 208.

  The key supply processing unit 208 receives supply of information requesting key purchase from the operation input information acquisition unit 204, and receives an input of an authentication result indicating that the user authentication processing has been correctly completed from the authentication processing unit 207. In this case, the corresponding decryption key is read from the key information database 209 and supplied to the home server 4 held by the user or a personal computer (not shown) via the communication unit 203, and the charge processing unit 210 receives the key. Output information about supply.

  The key information database 209 stores a decryption key for decrypting encrypted metadata for each program ID. That is, the key information database 209 is stored in advance in the key information storage unit 150 described with reference to FIG. 6, and the key information for each program ID used when the encryption processing unit 149 encrypts the metadata. The decryption key corresponding to is stored.

  The billing processing unit 210 performs billing processing based on the information related to billing supplied from the operation input information acquisition unit 204 and the key information processing unit 208, registers information necessary for billing in the billing information database 211, Based on the contents registered in the information database 206 and the billing information database 211, a process for paying the price of the supplied decryption key to the user, a process for paying the price for providing the display selection subtitle to the broadcast station 1, etc. are executed. . Information necessary for the accounting process is registered in the accounting information database 211.

  Next, the process 1 of the display selection subtitle decoder, which is the process executed by the display selection subtitle decoder 3 described with reference to FIG. 3, will be described with reference to the flowchart of FIG.

  In step S1, the video signal decoder 31 and the audio signal decoder 34 receive the program broadcast signal (video signal and audio signal) and decode it. The video signal decoder 31 supplies the decoded video data to the memory 32.

  In step S <b> 2, the display selection subtitle data decoder 35 and the audio output processing unit 38 determine whether viewing of the program is instructed based on the user's operation input supplied from the operation input unit 41.

  If it is determined in step S2 that viewing of the program is instructed, in step S3, the display selection subtitle data decoder 35 determines the display selection subtitle based on the user's operation input supplied from the operation input unit 41. Determine whether display is commanded.

  If it is determined in step S3 that display of the display selection subtitle is instructed, in step S4, the display selection subtitle data decoder 35 decodes the display selection subtitle data and supplies it to the OSD 36, and also the video data. This is supplied to the synthesis processing unit 37. The OSD 36 converts the supplied text data into video data and outputs it to the composition processing unit 37. The composition processing unit 37 synthesizes the supplied OSD data with video data, and outputs it to the television receiver 2 via the output terminal 22-1. The audio output processing unit 38 also acquires the audio data decoded by the audio signal decoder 34 and outputs it to the television receiver 2 via the output terminal 22-2.

  If it is determined in step S3 that the display selection subtitle display is not instructed, in step S5, the display selection subtitle data decoder 35 does not decode the display selection subtitle data, and the video data is combined with the synthesis processing unit 37 and The data is output to the television receiver 2 via the output terminal 22-1. The audio output processing unit 38 also acquires the audio data decoded by the audio signal decoder 34 and outputs it to the television receiver 2 via the output terminal 22-2.

  In step S2, if it is determined that viewing of the program is not instructed, or after the processing of step S4 or step S5 is completed, the output signal generation unit 33 is supplied from the operation input unit 41 in step S6. Based on a user operation input or a control signal supplied from the recording control unit 81 of the home server 4 supplied via the data terminal 23-3, it is determined whether or not a program recording is instructed. If it is determined in step S6 that recording of a program has not been instructed, the process ends.

  If it is determined in step S6 that the recording of the program has been instructed, in step S7, a recorded data creation process to be described later with reference to FIG. 11 is executed.

  In step S8, the output signal generation unit 33 supplies the recording data created by the process of step S6 to the home server 4 via the output terminal 23-1 and the output terminal 23-2, and the process ends. .

  By such processing, the display selection subtitle decoder 3 decodes the display selection subtitle and superimposes it on the video when viewing the received broadcast signal based on the user's operation input, or displays the display selection. Recording data that can use text data corresponding to subtitles for search processing can be generated and supplied to the home server 4 for recording.

  Next, the recording data creation process executed in step S7 of FIG. 10 will be described with reference to the flowchart of FIG.

  In step S21, the program ID information extraction unit 39 extracts program ID information that can individually identify the recorded program from the program management data included in the decoded video data held in the memory 32. To the output signal generator 33.

  In step S22, the output signal generation unit 33 refers to the timer 40 to at least one of the video data supplied from the memory 32 or the audio data supplied from the audio signal decoder 34, for example, A time stamp based on absolute time such as information indicating the recording start time is added.

  In step S23, the output signal generation unit 33 further adds a program ID to the video data or audio data to which the time stamp is added, and generates the recording output signal described with reference to FIG. Advances to step S8 in FIG.

  By such processing, recorded data to which a program ID and a time stamp are added, which can use text data corresponding to the display selection subtitles for search processing, is generated.

  Next, the metadata creation process 1 executed by the metadata creation server 6 described with reference to FIGS. 5 and 6 will be described with reference to the flowchart of FIG.

  In step S <b> 61, the broadcast data acquisition unit 141 receives a program broadcast signal (at least a video signal) and supplies it to the decoder 142. The decoder 142 decodes the supplied video signal and supplies it to the program ID information extraction unit 143.

  In step S62, the program ID information extraction unit 143 extracts a program ID, which is program-specific information for recognizing the program, from the program management data included in the supplied video data, and generates the program ID as metadata. And the decoded video data is supplied to the display selection subtitle data decoder 145.

  In step S <b> 63, the display selection subtitle data decoder 145 extracts and decodes the display selection subtitle data from the supplied video data, and supplies the extracted data to the display selection subtitle data analysis unit 146.

  In step S64, the display selection subtitle data analysis unit 146 analyzes the text data corresponding to the display selection subtitle data, and determines a predetermined length (for example, a predetermined number of characters displayed at a time when display is selected, It is divided into a text group of such a length that can be read by the user for a predetermined time and supplied to the time code addition processing unit 147.

  In step S <b> 65, the time code addition processing unit 147 adds time codes of the start time and the end time to the supplied text group, and supplies them to the metadata generation unit 144.

  In step S66, the metadata generation unit 144 adds the program ID supplied from the program ID information extraction unit 143 to the text data group with the time code supplied from the time code addition processing unit 147, and the process shown in FIG. The metadata 161 described above is created and supplied to the encryption processing unit 149.

  In step S <b> 67, the encryption processing unit 149 encrypts the supplied metadata 161 using a key corresponding to the program ID stored in the key information storage unit 150 and supplies the encrypted metadata 161 to the metadata storage unit 151. .

  In step S68, the metadata storage unit 151 stores the encrypted metadata, and the process ends.

  By such processing, text data corresponding to the display selection subtitle data, time code corresponding to the text data, and metadata including the program ID are generated, encrypted, and stored. The encrypted and stored metadata is downloaded to the home server 4 owned by the user by a process described later.

  Next, user registration processing executed by the accounting server 7 described with reference to FIGS. 8 and 9 will be described with reference to the flowchart of FIG.

  In step S <b> 81, the web page publication processing unit 201 publishes the web page for user registration stored in the page information storage unit 202 to the Internet 5.

  In step S82, the operation input information acquisition unit 204 determines whether a user registration request is received from the home server 4 owned by the user or a personal computer (not shown) via the communication unit 203. If it is determined in step S82 that a user registration request has not been received, the process returns to step S81, and the subsequent processes are repeated.

  If it is determined in step S82 that a user registration request has been received, the operation input information acquisition unit 204 notifies the web page publication processing unit 201 that the user registration request has been received. The unit 201 sends data corresponding to the user registration screen to the home server 4 owned by the user or a personal computer (not shown) via the communication unit 203 and the Internet 5.

  In step S84, the operation input information acquisition unit 204 is supplied with user registration data including, for example, information related to a charging method such as a payment method and personal information such as a user's name and email address, and receives a user information registration processing unit. 205.

  In step S85, the user information registration processing unit 205 supplies the user registration data to the user information database 206 to be stored. The user information database 206 stores the supplied user registration data.

  In step S86, the authentication processing unit 207 issues a user ID that can uniquely identify the user to the newly registered user, registers the user ID in the user information database 206, and sends the issued user ID to the communication unit. The data is sent to the home server 4 owned by the user or a personal computer (not shown) via the Internet 203 and the Internet 5, and the process is terminated.

  By such processing, user information is registered in the accounting server 7. The registered user information is used at the time of supplying key information, which will be described later, and at the time of billing processing.

  Next, the metadata supply process executed by the metadata creation server 6 described with reference to FIGS. 5 and 6 will be described with reference to the flowchart of FIG.

  In step S <b> 101, the web page publication processing unit 154 publishes a web page for receiving a metadata request stored in the page information storage unit 155 to the Internet 5.

  In step S102, the metadata supply control unit 152, via the communication unit 153, metadata corresponding to programs identified by a predetermined program ID from the home server 4 held by the user or a personal computer (not shown). It is determined whether or not an input of a signal indicating an operation input requesting is received. If it is determined in step S102 that a signal indicating an operation input requesting metadata is not received, the process returns to step S101, and the subsequent processes are repeated.

  If it is determined in step S102 that a signal indicating an operation input requesting metadata has been received, in step S103, the metadata supply control unit 152 encrypts metadata corresponding to the requested program. Is transmitted from the metadata storage unit 151 to the home server 4 owned by the user or a personal computer (not shown) via the communication unit 153 and the Internet 5, and the process is terminated.

  Through such processing, the encrypted metadata is sent to the home server 4 owned by the user or a personal computer (not shown). The sent metadata is stored in the home server 4, decrypted by processing to be described later, and used for search processing.

  Next, the decryption key supply control process executed by the billing server 7 described with reference to FIGS. 8 and 9 will be described with reference to the flowchart of FIG.

  In step S <b> 121, the web page publication processing unit 201 publishes a web page for receiving a purchase request for a decryption key for decrypting metadata stored in the page information storage unit 202 to the Internet 5.

  In step S122, the operation input information acquisition unit 204 determines whether an operation input requesting a decryption key has been received from the home server 4 held by the user or a personal computer (not shown) via the communication unit 203. To do. If it is determined in step S122 that an operation input requesting a decryption key has not been received, the process returns to step S121, and the subsequent processes are repeated.

  If it is determined in step S122 that an operation input requesting a decryption key has been received, the operation input information acquisition unit 204 notifies the authentication processing unit 207 that an operation input requesting a decryption key has been received. The authentication processing unit 207 requests the home server 4 owned by the user or a personal computer (not shown) to send a user ID via the communication unit 205, and is registered in the user information database 206. The authentication process is executed by inquiring the current user ID.

  In step S124, the key supply processing unit 208 requests a decryption key using the home server 4 held by the user or a personal computer (not shown) based on the result of the authentication processing supplied from the authentication processing unit 207. The user who has performed the operation input determines whether or not the user has been correctly authenticated.

  If it is determined in step S124 that the authentication has been correctly performed, in step S125, the key supply processing unit 208 controls the charging processing unit 210 to input information input from the user, or the user information database 206 or the charging information database. Based on the information registered in 211, the settlement processing is executed. Payment processing includes, for example, credit card payment and electronic money payment. The billing processing unit 210 executes settlement processing using these general settlement methods.

  In step S <b> 126, the key supply processing unit 208 determines whether or not the settlement is correctly completed based on the signal supplied from the charging processing unit 210.

  If it is determined in step S126 that the payment has been correctly completed, in step S127, the key supply processing unit 208 receives a request from the signal indicating the request for the decryption key from the user supplied from the operation input information acquisition unit 204. The program ID of metadata corresponding to the decrypted key is acquired.

  In step S128, the key supply processing unit 208 reads the decryption key corresponding to the program ID from the key information database 209, and the home server 4 held by the user or a personal computer (not shown) via the communication unit 203 and the Internet 5. To send to.

  In step S129, the charging processing unit 210 registers the payment method, amount, or payment result selected by the user in the charging information database 211. The billing information database 211 stores the registered billing information, and the process ends.

  If it is determined in step S124 that the authentication has not been correctly performed, or if it is determined in step S125 that the payment has not been correctly completed, in step S130, the authentication processing unit 207 or the billing processing unit 210 determines that the communication unit 203 An error message for notifying the user that the process has not been completed correctly is output to the home server 4 owned by the user or a personal computer (not shown) via the Internet 5 and the process is terminated. The

  Through such processing, a decryption key for decrypting the metadata is purchased by the user and transmitted to the home server 4 owned by the user or a personal computer (not shown). This decryption key is used for decrypting metadata by a process described later. Further, since at least a part of the consideration obtained from the user by purchasing the decryption key is paid to the broadcasting station 1 that created the display selection subtitle data, the ratio of the program with the display selection subtitle added increases. Is predicted, and hearing-impaired persons can enjoy more programs.

  Next, referring to the flowchart of FIG. 16, the home server 4 owned by the user described with reference to FIG. 3 in parallel with the metadata supply process of FIG. 14 and the decryption key supply control process of FIG. 15. The metadata storage process 1 executed in FIG.

  In step S141, metadata acquisition processing described later with reference to FIG. 17 is executed. Here, the metadata acquisition processing is executed in step S141 here, but may be executed at any timing as long as step S149 described later is executed.

  In step S <b> 142, the network interface 73 accesses a web page that is disclosed on the Internet 5 and accepts a purchase request for a decryption key for decrypting metadata, and displays the web page on the display unit 74. Since the user refers to the web page displayed on the display unit 74 and uses the operation input unit 71 to specify a program for which metadata is desired, the network interface 73 is supplied from the operation input unit 71. A signal for requesting the purchase of a decryption key for decrypting the encrypted metadata designated by the program ID, that is, the information designating the program for which the metadata desired to be used is transmitted via the Internet 5 Transmit to billing server 7.

  The network interface 73 receives data corresponding to a web page that requests input of information necessary for authentication processing from the accounting server 7 and causes the display unit 74 to display the web page. The user refers to a web page that is displayed on the display unit 74 and requests input of information necessary for the authentication process, and uses the operation input unit 71, for example, information necessary for the authentication process, such as a user ID. Therefore, in step S 143, the network interface 73 transmits information necessary for the authentication process supplied from the operation input unit 71 to the accounting server 7 via the Internet 5.

  In step S144, the network interface 73 determines whether or not the authentication has been correctly performed based on the signal supplied from the billing server 7.

  If it is determined in step S144 that the authentication has been correctly performed, the network interface 73 receives data corresponding to the web page requesting input of information necessary for the settlement process from the billing server 7, and displays the web page on the display unit 74. To display. The user refers to the web page that is displayed on the display unit 74 and requests input of information necessary for the settlement process, and inputs information necessary for the settlement process using the operation input unit 71. Therefore, step S145 is performed. The network interface 73 is necessary for the payment process supplied from the operation input unit 71 such as the user ID and password set in the contract with the financial institution for the payment method and the payment method, for example. Information is transmitted to the accounting server 7 via the Internet 5.

  In step S146, the network interface 73 determines whether or not the payment is correctly completed based on the signal supplied from the billing server 7.

  If it is determined in step S146 that the payment has been correctly completed, in step S147, the network interface 73 receives the decryption key corresponding to the designated program ID from the charging server 7 via the Internet 5, and the key The information is supplied to the information storage unit 76.

  In step S148, the key information storage unit 76 stores the supplied decryption key in association with the program ID.

  In step S 149, the decryption processing unit 77 decrypts the encrypted metadata stored in the encrypted metadata storage unit 75 using the decryption key stored in the key information storage unit 76, and generates metadata. The data is supplied to the storage unit 78.

  In step S150, the metadata storage unit 78 stores the decrypted metadata, and the process ends.

  If it is determined in step S144 that the authentication has not been correctly performed, or if it is determined in step S147 that the payment has not been correctly completed, in step S151, the network interface 73 is connected to the accounting server 7 via the Internet 5. Then, an error message indicating that the process has not been terminated properly is received, output and displayed on the display unit 74, and the process is terminated.

  As a result of such processing, the encrypted metadata is downloaded from the metadata creation server 6, the processing for purchasing the decryption key for decrypting the metadata is executed and acquired from the charging server 7. The metadata can be decrypted and stored inside the home server 4 for use in search processing.

  Next, the metadata acquisition process executed in step S141 in FIG. 16 will be described with reference to the flowchart in FIG.

  In step S <b> 161, the network interface 73 accesses a web page published on the Internet 5 for receiving a metadata request, and displays the web page on the display unit 74. Since the user refers to the web page displayed on the display unit 74 and uses the operation input unit 71 to specify a program for which metadata is desired, the network interface 73 is supplied from the operation input unit 71. The program name or program ID corresponding to the program designated by the user's operation input is supplied to the metadata creation server 6 via the Internet 5.

  In step S <b> 162, the network interface 73 determines whether or not encrypted metadata has been received from the metadata creation server 6 via the Internet 5. If it is determined in step S162 that metadata has not been received, the process returns to step S161, and the subsequent processes are repeated.

  If it is determined in step S162 that metadata has been received, the network interface 73 supplies the received encrypted metadata to the encrypted metadata storage unit 75 in step S163. The encrypted metadata storage unit 75 stores the supplied encrypted metadata, and the process ends.

  Through such processing, the encrypted metadata can be downloaded from the metadata creation server 6.

  Next, with reference to the flowchart of FIG. 18, the search process performed in the home server 4 which a user owns demonstrated using FIG. 3 is demonstrated.

  In step S181, the operation input unit 71 receives an input designating a program to be searched from the user and supplies the input to the matching processing unit 97. In step S182, the operation input unit 71 stores text data serving as a search key for searching for the reproduction start position. The input is received and supplied to the matching processing unit 97. For example, when the broadcast program described with reference to FIG. 2 is recorded and the user tries to perform a search process for reproducing a portion of interest in the “7 o'clock news”, the operation input unit 71 receives an operation input for designating a program “7 o'clock news”, and also receives an input of the text “wheelchair” of “7 o'clock news”, and supplies it to the matching processing unit 97.

  In step S183, the matching processing unit 97 is stored in the metadata storage unit 78 using the program ID corresponding to the program designated by the user in step S181 and the text designated by the user in step S182 as search keys. The time code corresponding to the text data that is the search key is detected and supplied to the recorded data search output unit 80. For example, when the metadata described with reference to FIG. 7 is stored in the metadata storage unit 78, the matching process executed by the matching processing unit 97 corresponds to the text group 2 including the text “wheelchair”. The start time “17: 01: 58: 55” is detected.

  If text data that is a search key is included in a plurality of text groups that are distinguished by the same program ID, the matching processing unit 97 detects a plurality of time codes that correspond to the text data that is the search key. In this case, for example, a plurality of text groups including text data as search keys are displayed on the display unit 74 so that the user can select them, or the user's operation Based on the input, the playback start position desired by the user among a plurality of detection results is obtained by making it possible to sequentially change the playback start position from the earliest time in the time code. It is preferable that the selection can be made by a simple operation.

  In step S184, the recorded data search output unit 80 searches the recorded data storage unit 72 for the reproduction start position indicated by the detected time code of the recorded data specified by the program ID, based on the detected time code. And it outputs to the display selection subtitle data decoder 3 via the output terminal 61-1 and the output terminal 61-2, and a process is complete | finished.

  By such processing, a time code corresponding to the text data input by the user is detected, and a recording / playback start position is searched based on the detected time code. By applying the present invention, for example, all text data corresponding to subtitle data included in the recorded data is searched, and compared with a case where the start position of recording / playback corresponding to the text data input by the user is determined. Thus, the reproduction start position desired by the user can be searched easily and at high speed.

  Next, with reference to the flowchart of FIG. 19, the charging process executed by the charging server 7 described with reference to FIGS. 8 and 9 will be described.

  In step S <b> 201, the billing processing unit 210 refers to information registered in the billing information database 211 and generates billing information for the user who purchased the decryption key. Specifically, the billing processing unit 210 refers to the information registered in the billing information database 211, and provides financial institution (for example, a credit card company, an electronic money service provider, etc.) that settled accounts for each user. Each time, the charges generated by the purchase of the decryption key are totaled and charged.

  In step S202, the billing processing unit 210 executes billing processing for a predetermined financial institution or the like. Specifically, the billing processing unit 210 accesses, for example, a billing server (not shown) that executes a settlement process that is held by a financial institution such as a card company via the Internet 5 or a predetermined dedicated line, The user billing information generated in S201 is transmitted.

  In step S203, the billing processing unit 210 refers to the information registered in the billing information database 211 and calculates the number of decryption keys supplied to decrypt the metadata corresponding to the display-selected caption data for each program. .

  In step S204, the accounting processing unit 210 calculates the supply number of the decryption key for decrypting the metadata corresponding to the provided display selection subtitle data for each broadcasting station 1 based on the calculation result of step S203. .

  In step S205, the billing processing unit 210 calculates a payment amount for each broadcasting station based on the calculation result in step S204. Specifically, the billing processing unit 210 obtains the profits obtained by the service provider that owns the billing server 7 from the consideration of the decryption key obtained from the user (between the broadcast station 1 and the service provider that owns the billing server 7). It is determined by the contract, and even if it is a predetermined amount, it may be a fraction of the consideration of the decryption key), and the amount is calculated as a payment amount for each broadcasting station.

  In step S206, the billing processing unit 210 executes a process of paying consideration to each broadcasting station based on the payment amount calculated by the process of step S205, and the process is terminated. Specifically, the billing processing unit 210 accesses a billing server (not shown) owned by a financial institution (for example, a bank) designated by the broadcasting station 1 via the Internet 5 or a predetermined dedicated line. Then, information necessary for transferring the payment amount calculated in step S205 to the designated account is transmitted.

  With such a process, it is possible to perform a billing process for a fee for distributing a decryption key used for decrypting metadata. Further, since at least a part of the consideration obtained from the user by purchasing the decryption key is paid to the broadcasting station 1 that created the display selection subtitle data, the ratio of the program with the display selection subtitle added increases. Is predicted, and hearing-impaired persons can enjoy more programs.

  In the above-described processing, when the absolute time indicated by the timer 40 held in the display selection subtitle decoder 3 is shifted or the timer 40 cannot count the absolute time, it is supplied to the home server 4. Since the time stamp added to the recorded data does not correspond to the correct time, the correct search process cannot be executed.

  In order to prevent this, when an output signal to be recorded is generated, the display selection subtitle data decoder decodes the display selection subtitle data included in the broadcast signal, and from the decoded text data. Alternatively, text data that can be used to estimate the correct time stamp may be extracted, and the time stamp value added to the recording data supplied to the home server 4 may be calculated using the extracted text data. .

  FIG. 20 illustrates a display selection subtitle decoder 301 configured to be able to calculate the value of a time stamp added to the recording data supplied to the home server 4 using the display selection subtitle data included in the broadcast signal. FIG. 16 is a block diagram showing a configuration of the home server 4 that executes a search process using the recording output signal generated by the display selection subtitle decoder 301.

  Note that portions corresponding to those in FIG. 3 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  That is, the display selection subtitle decoder 301 in FIG. 20 performs time stamp generation text for executing processing for extracting text data usable for generation of time stamp from the display selection subtitle data decoded by the display selection subtitle data decoder 35. Except that a data extraction unit 311 is newly provided, it has basically the same configuration as the display selection subtitle decoder 3 in FIG.

  The processing executed in the display selection subtitle decoder 301 in FIG. 20 replaces the recording data creation processing 1 described with reference to FIG. 11 in step S7 of the display selection subtitle decoder processing 1 described with reference to FIG. The processing is basically the same as that of the display selection subtitle decoder 3 except that the recorded data creation processing 2 described with reference to FIG.

  With reference to FIG. 21, the recording data creation process 2 executed in step S7 of FIG. 10 in the display selection subtitle decoder 301 of FIG. 20 will be described.

  In step S221, the program ID information extraction unit 39 extracts program ID information capable of individually identifying the recorded program from the program management data included in the decoded video data held in the memory 32. To the output signal generator 33.

  In step S222, the display selection subtitle data decoder 35 decodes the display selection subtitle data and supplies it to the text data extraction unit 311 for time stamp creation.

  In step S223, the text data extraction unit 311 for time stamp generation extracts text data related to time from the text data corresponding to the display selection subtitle data supplied from the display selection subtitle data decoder 35, and outputs an output signal generation unit. 33. For example, when the display selection subtitle data 17 described with reference to FIG. 2 is supplied from the display selection subtitle data decoder 35, the text data extraction unit 311 for time stamp generation extracts the text “7 o'clock news”. To do. The text data extraction unit 311 for time stamp creation adds text related to the time such as “6:30”, “3 o'clock time signal”, “noon” to the text data supplied from the display selection subtitle data decoder 35. If data is included, these text data are extracted.

  In step S224, the output signal generation unit 33 determines a reference value for the time stamp corresponding to the text data, based on the text data relating to the time supplied from the text data extraction unit 311 for time stamp generation.

  In step S225, the output signal generator 33 determines whether the video data supplied from the memory 32 or the audio data supplied from the audio signal decoder 34 is based on the reference value of the time stamp determined in step S224. A time stamp is added to at least one of the above.

  In step S226, the output signal generation unit 33 further adds the program ID to the video data or audio data to which the time stamp is added, and generates the output signal for recording described with reference to FIG. Advances to step S8 in FIG.

  By such processing, even when the timer 40 is not functioning correctly, the time information corresponding to the time stamp can be estimated with the displayed washing caption data below, so that the text data corresponding to the display selection caption data is Recorded data to which a program ID and a time stamp are added that can be used for the search process is generated.

  In the processing described above, the home server 4 owned by the user downloads the encrypted metadata generated by the metadata generation server 6 via the Internet 4 and receives the metadata from the accounting server 7. Although it has been explained that a decryption key for decryption is purchased and the metadata is decrypted and used for the search process, the metadata is generated based on the text data corresponding to the display selection subtitle data. The selected subtitle decoder may decode the display selected subtitle data and create metadata, and the home server may perform search processing using the metadata created by the display selected subtitle decoder.

  FIG. 22 shows a display selection subtitle decoder 351 capable of decoding the display selection subtitle data and generating metadata, and a search process using the metadata generated by the display selection subtitle decoder 351. It is a block diagram which shows the structure with the home server 352 made | formed so that it can be performed.

  Note that portions corresponding to those in FIG. 3 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  That is, the display selection subtitle decoder 351 in FIG. 22 includes a display selection subtitle data analysis unit 371, a time code addition processing unit, which are necessary for creating metadata from the display selection subtitle data decoded by the display selection subtitle data decoder 35. 3 and the display selection subtitle decoder 3 in FIG. 3 and the basics, except that a timer 373, a timer 373, a metadata generation unit 374, and an output terminal 361 for outputting the created metadata to the home server 352 are newly provided. The home server 352 is newly provided with an input terminal 381 that receives the selection of the created metadata and supplies it to the metadata generation unit 78, and includes a network interface 73, an encrypted metadata. The data storage unit 75, the key information storage unit 76, and the decryption processing unit 77 are omitted. Except that those having a home server 4 is basically the same configuration as in FIG.

  The display selection subtitle data analysis unit 371 divides the text data corresponding to the display selection subtitle data supplied from the display selection subtitle data decoder 35 into a text group of an appropriate length (for example, text displayed at a time). Are divided as one text group), and the divided text group is supplied to the time code addition processing unit 372.

  The time code addition processing unit 372 refers to the timer 373 and adds a time code corresponding to the start position and end position of the text to each of the supplied text group. When the broadcast signal is acquired in real time (that is, at the broadcast time of the program), the time code addition processing unit 372 adds the time code to the text data based on the current time indicated by the timer 373.

  The metadata generation unit 374 generates metadata by adding the program ID information supplied from the program ID information extraction unit 39 to the text data to which the time code supplied from the time code addition processing unit 372 is added. The data is supplied to the home server 352 via the output terminal 361.

  Needless to say, the timer 373 may be the same as or different from the timer 40 as long as the absolute time can be counted.

  When the display selection subtitle decoder 351 and the home server 352 of FIG. 22 are used, the processing of the metadata creation server 6 and the accounting server 7 of FIG. 1 is omitted. Therefore, in the system in which the display selection subtitle decoder 351 and the home server 352 in FIG. 22 are used, the metadata creation process 1 described with reference to FIG. 12, the user registration process 13 described with reference to FIG. The metadata supply process described with reference to FIG. 14 and the decryption key supply control process described with reference to FIG. 15 are omitted, and the display selection subtitle decoder process 1 described with reference to FIG. The display selection subtitle decoder process 2 to be described later is executed using, and the metadata storage process 2 described later using FIG. 25 is executed instead of the metadata storage process 1 described using FIG.

  Further, in the home server 352, processing similar to the search processing described with reference to FIG. 18 is executed, and thus description thereof is omitted.

  Next, processing 2 of the display selection subtitle decoder executed by the display selection subtitle decoder 351 of FIG. 22 will be described with reference to the flowchart of FIG.

  In steps S241 through S246, the same processing as in steps S1 through S6 described with reference to FIG. 10 is executed.

  That is, the video signal decoder 31 and the audio signal decoder 34 receive the input of the program broadcast signal (video signal and audio signal), the input program broadcast signal is decoded, and whether or not the user is instructed to view the program. Is judged. When it is determined that viewing of the program is instructed, it is determined whether display subtitle display is instructed. When it is determined that display subtitle display is instructed, display subtitle data is displayed. The decoder 35 decodes the display selection subtitle data, superimposes it on the video data, and outputs it to the television receiver 2. When it is determined that the display selection subtitle display is not instructed, the display selection subtitle data is not decoded, and the decoded video data and audio data are output to the television receiver 2.

  Then, in step S246, it is determined whether or not recording of a program is instructed. If it is determined in step S246 that recording of a program has not been instructed, the process ends.

  If it is determined in step S246 that the recording of the program has been instructed, the above-described recording data creation process is executed in step S247.

  In step S248, the output signal generation unit 33 supplies the recording data created by the process of step S6 to the home server 4 via the output terminal 23-1 and the output terminal 23-2.

  In step S249, metadata creation processing 2 described later with reference to FIG. 24 is executed.

  In step S250, the metadata generation unit 374 outputs the metadata created by the process of step S246 to the home server 352 via the output terminal 361, and the process ends.

  Next, the metadata creation process 2 executed in step S249 in FIG. 23 will be described with reference to the flowchart in FIG.

  In step S261, the program ID information extraction unit 39 extracts a program ID, which is program-specific information for recognizing the program, from the program management data included in the video data stored in the memory 32, and sets the program ID. Supply to the metadata generation unit 374

  In step S262, the display selection subtitle data decoder 35 acquires the video data stored in the memory 32, extracts the display selection subtitle data from the acquired video data, decodes it, and supplies it to the display selection subtitle data analysis unit 371. To do.

  In step S263, the display selection subtitle data analysis unit 371 analyzes text data corresponding to the display selection subtitle data, and determines a predetermined length (for example, a predetermined number of characters displayed at a time when display is selected, It is divided into text groups of such a length that can be read by the user for a predetermined time, and supplied to the time code addition processing unit 372.

  In step S264, the time code addition processing unit 372 adds a time code of the start time and the end time to the supplied text group with reference to the timer 373, and supplies the added time code to the metadata generation unit 374.

  In step S265, the metadata generation unit 374 adds the program ID supplied from the program ID information extraction unit 39 to the text data group with the time code supplied from the time code addition processing unit 372, and FIG. The metadata 161 described above is created and supplied to the home server 352 via the output terminal 361, and the processing is terminated.

  By such processing, the display selection subtitle decoder 351 decodes the display selection subtitle and superimposes it on the video when viewing the received broadcast signal based on the user's operation input, or displays the display selection. Recording data that can use text data corresponding to subtitles for search processing is generated and supplied to the home server 352 for recording, as well as using text data corresponding to decoded display selection subtitles, Metadata can be generated and supplied to the home server 352.

  Next, with reference to FIG. 25, the metadata storage process 2 executed by the home server 352 will be described.

  In step S <b> 381, the input terminal 381 acquires the metadata generated by the display selection subtitle decoder 351 and supplies the metadata to the metadata storage unit 78.

  In step S382, the metadata storage unit 78 stores the supplied metadata, and the process ends.

  The metadata stored in the home server 352 in this way is used when the search process described with reference to FIG. 18 is executed in the home server 362.

  Further, by encrypting the metadata created in the display selection subtitle decoder and supplying it to the home server 402, it is possible to execute the distribution of the decryption key and the billing process by the billing server 7.

  FIG. 26 uses the display selection subtitle decoder 401 configured to decode the display selection subtitle data and generate and encrypt the metadata, and the metadata generated by the display selection subtitle decoder 401. It is a block diagram which shows the structure with the home server 402 made | formed so that a search process can be performed.

  Note that portions corresponding to those in FIG. 3 or FIG. 22 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  That is, the display selection subtitle decoder 401 in FIG. 26 generates an encryption key using information supplied from the program ID information extraction unit 411 and encrypts the metadata created by the metadata generation unit 374. 412, a program ID information extraction unit 39 is provided, and program ID information that can uniquely distinguish programs is extracted from the program management data, and among the information included in the program management data, Basically the display selection subtitle decoder 351 in FIG. 22 is provided except that a program ID information extraction unit 411 that extracts information used to generate an encryption key and supplies the information to the encryption processing unit 412 is provided. The home server 402 has the same configuration, except that the encrypted metadata supplied from the input terminal 381 is stored in the encrypted metadata storage unit 75. And has a home server 4 is basically the same configuration as in FIG.

  When the display selection subtitle decoder 401 and the home server 402 in FIG. 26 are used, the processing of the metadata creation server 6 in FIG. 1 is omitted. Therefore, in the system in which the display selection subtitle decoder 401 and the home server 402 in FIG. 26 are used, the metadata generation process 1 described with reference to FIG. 12 and the metadata supply described with reference to FIG. The processing is omitted, and the processing 2 of the display selection subtitle decoder described with reference to FIG. 23 is executed. Instead of the metadata generation processing 2 executed in step S249, metadata described later with reference to FIG. Measure control interest 3 is executed, and instead of the metadata storage processing described with reference to FIG. 16 or FIG. 25, metadata storage processing 3 described later with reference to FIG. 28 is executed.

  Further, the charging server 7 executes the user registration process 13 described with reference to FIG. 13 and the decryption key supply control process described with reference to FIG. 15, and the home server 352 uses FIG. Since the same processing as the above search processing is executed, the description thereof is omitted.

  With reference to the flowchart in FIG. 27, the metadata creation process 3 executed in step S249 in FIG. 23 will be described.

  In step S301, the program ID information extraction unit 411 creates a program ID, which is program-specific information for recognizing a program, and an encryption key from the program management data included in the video data stored in the memory 32. Information (if the information can be generated by distinguishing the corresponding decryption key stored in the key information database 209 of the accounting server 7 for each program, the program ID may be used), and the program ID is generated as metadata. The information used for encryption is supplied to the encryption processing unit 412 to the unit 374

  In step S302, the display selection subtitle data decoder 35 acquires the video data stored in the memory 32, extracts the display selection subtitle data from the acquired video data, decodes it, and supplies it to the display selection subtitle data analysis unit 371. To do.

  In step S303, the display selection subtitle data analysis unit 371 analyzes text data corresponding to the display selection subtitle data, and determines a predetermined length (for example, a predetermined number of characters displayed at one time when display is selected, It is divided into text groups of such a length that the user can read and understand in a predetermined time, and is supplied to the time code addition processing unit 372.

  In step S <b> 304, the time code addition processing unit 372 adds a time code of the start time and the end time to the supplied text group with reference to the timer 373, and supplies the added time code to the metadata generation unit 374.

  In step S305, the metadata generation unit 374 adds the program ID supplied from the program ID information extraction unit 39 to the text data group with the time code supplied from the time code addition processing unit 372, and FIG. The metadata 161 described above is created and supplied to the encryption processing unit 412.

  In step S306, the encryption processing unit 412 uses the encryption key corresponding to the decryption key stored in the key information database 209 of the accounting server 7 based on the information used for encryption supplied from the program ID information extraction unit 411. Create

  In step S306, the encryption processing unit 412 encrypts the metadata 161 supplied from the metadata generation unit 374 with the encryption key generated by the processing in step S306, and sends it to the home server 352 via the output terminal 361. Then, the process is terminated.

  By such processing, the display selection subtitle decoder 401 decodes the display selection subtitle and superimposes it on the video when viewing the received broadcast signal based on the user's operation input, or displays selection. Recording data that can use text data corresponding to subtitles for search processing is generated and supplied to the home server 401 for recording as well as using text data corresponding to decoded display selection subtitles, Metadata can be generated, encrypted, and supplied to the home server 402.

  Next, the metadata storage process 3 executed in the home server 402 in FIG. 26 will be described with reference to the flowchart in FIG.

  In step S321, the input terminal 381 acquires the metadata generated by the display selection subtitle decoder 401 and supplies it to the encrypted metadata storage unit 75. Note that the processing in step S321 may be executed at any timing as long as step S329 described later is executed.

  In steps S322 to S311, processing similar to that in steps S142 to S151 described with reference to FIG. 16 is executed, and the processing ends.

  That is, access to a web page that is available on the Internet 5 and accepts a request for purchasing a decryption key for decrypting metadata, and is designated by information that designates a program for which metadata is desired, that is, designated by a program ID. The signal requesting the purchase of the decryption key for decrypting the encrypted metadata and the information necessary for the authentication process such as the user ID are transmitted to the accounting server 7 via the Internet 5. Based on the signal supplied from the accounting server 7, it is determined whether or not the authentication has been correctly performed. When it is determined that the authentication has been correctly performed, information necessary for the settlement process is transmitted to the billing server 7, and it is determined whether or not the settlement has been correctly completed. When it is determined that the payment has been correctly completed, the decryption key corresponding to the designated program ID is transmitted from the accounting server 7 and stored in the key information storage unit 76, and this decryption key is used to encrypt the metadata. The encrypted metadata stored in the storage unit 75 is decrypted, and the decrypted metadata is stored in the metadata storage unit 78. When it is determined that the authentication has not been correctly performed or when it has been determined that the payment has not been correctly completed, an error message indicating that the process has not been correctly completed is received and displayed on the display unit 74. Processing is terminated.

  By such processing, encrypted metadata is supplied from the display selection subtitle decoder 401, processing for purchasing a decryption key for decrypting the metadata is executed, and acquired from the billing server 7, The metadata can be decrypted and stored inside the home server 402 for use in search processing.

  Through the processing described above, it is possible to search the recorded data using the text data input by the user using the display selection subtitle data. In addition, a fee for decrypting the metadata used for the search processing is distributed to the user for a fee by the billing server 7, thereby paying the broadcasting station for the creation of the display selection subtitle data. Therefore, not only can it contribute to the development of the industry, but it also leads to an improvement in the ratio of subtitle data attached to the broadcast signal, which is very beneficial for the hearing impaired.

  The series of processes described above can also be executed by software. The software is a computer in which a program constituting the software is incorporated in dedicated hardware, or a various personal computer capable of executing various functions by installing various programs. For example, it is installed from a recording medium.

  As shown in FIG. 5 or FIG. 7, this recording medium is distributed to provide a program to the user separately from the computer, and includes a magnetic disk 121 (including a flexible disk) on which the program is recorded, and an optical disk 122. Package media including CD-ROM (compact disk-read only memory), DVD (digital versatile disk), magneto-optical disk 123 (including MD (mini-disk) (trademark)), or semiconductor memory 124 Etc.

  Further, in the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but may be performed in parallel or It also includes processes that are executed individually.

  In the present specification, the term “system” represents the entire apparatus constituted by a plurality of apparatuses.

  Further, it goes without saying that the present invention is applicable even when processing executed by a part or all of a system constituted by a plurality of devices is realized by processing of the same information processing device. Yes.

It is a figure for demonstrating the structure of the information processing system to which this invention is applied. It is a figure for demonstrating the broadcast signal broadcast from the broadcasting station of FIG. It is a block diagram for demonstrating the display selection subtitle decoder and home server of FIG. It is a figure for demonstrating the video recording data produced | generated by the display selection subtitle decoder of FIG. It is a block diagram for demonstrating the structure of the metadata production server of FIG. It is a functional block diagram for demonstrating the process which the metadata production server of FIG. 5 performs. It is a block diagram for demonstrating the metadata produced by a metadata production server. It is a block diagram for demonstrating the structure of the accounting server of FIG. It is a functional block diagram for demonstrating the process which the accounting server of FIG. 8 performs. It is a flowchart for demonstrating the process 1 of a display selection subtitle decoder. It is a flowchart for demonstrating the recording data creation process 1. FIG. 10 is a flowchart for explaining metadata creation processing 1; It is a flowchart for demonstrating a user registration process. It is a flowchart for demonstrating a metadata supply process. It is a flowchart for demonstrating a decryption key supply control process. 5 is a flowchart for explaining metadata storage processing 1; It is a flowchart for demonstrating a metadata acquisition process. It is a flowchart for demonstrating a search process. It is a flowchart for demonstrating an accounting process. It is a block diagram for demonstrating the structure from which a display selection subtitle decoder and a home server differ. It is a flowchart for demonstrating the recording data creation process 2. FIG. It is a block diagram for demonstrating the structure from which a display selection subtitle decoder and a home server differ. It is a flowchart for demonstrating the process 2 of a display selection subtitle decoder. 10 is a flowchart for explaining metadata creation processing 2; 10 is a flowchart for explaining metadata storage processing 2; It is a block diagram for demonstrating the structure from which a display selection subtitle decoder and a home server differ. 10 is a flowchart for explaining metadata creation processing 3; 10 is a flowchart for explaining metadata storage processing 3;

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Broadcasting station 2 Television receiver 3 Display selection subtitle decoder 4 Home server 5 Internet 6 Metadata production server 7 Billing server 15 Video data 16 Audio data 17 Display selection subtitle data 21 Input terminal 33 Output signal generation part 35 Display selection subtitle data Decoder 36 OSD
37 Compositing processing section 39 Program ID information extracting section 40 Timer 41 Operation input section 71 Operation input section 72 Recording data storage section 73 Network interface 77 Decoding processing section 78 Metadata storage section 79 Matching processing section 80 Recording data detection output section 95 Recording start Time information 141 Broadcast data acquisition unit 143 Program ID information extraction unit 144 Metadata generation unit 145 Display selected caption data decoder 147 Time code addition processing unit 149 Encryption processing unit 152 Metadata supply control unit 161 Metadata 165 Text data 166 Time code 167 Program ID
204 Operation Input Information Acquisition Unit 205 User Information Registration Processing Unit 206 User Information Database 207 Authentication Processing Unit 208 Key Supply Processing Unit 210 Charging Processing Unit 211 Accounting Information Database 301 Display Selection Subtitle Decoder 311 Text Data Extraction Unit for Timestamp Creation 351 Display Selection Subtitle decoder 352 Home server 372 Time code addition processing unit 374 Metadata generation unit 401 Display selection subtitle decoder 402 Home server 412 Encryption processing unit

Claims (1)

  A first information processing apparatus for acquiring and processing a broadcast signal;
  A second information processing apparatus for searching recorded data using text information as a search key;
  A third information processing device that generates metadata used for search processing executed by the second information processing device;
  A fourth information processing apparatus for supplying a decryption key for decrypting the metadata used in a search process executed by the second information processing apparatus;
  In an information processing system constituted by
  The first information processing apparatus includes:
    First broadcast signal acquisition means for acquiring the broadcast signal;
    First discrimination information acquisition means for acquiring discrimination information capable of uniquely distinguishing the program of the broadcast signal from the broadcast signal acquired by the first broadcast signal acquisition means;
    In the broadcast signal acquired by the first broadcast signal acquisition means, first time information,
Information adding means for generating the recording data by adding the discrimination information acquired by the first discrimination information acquiring means;
  With
  The second information processing apparatus
    Recording data storage control means for controlling storage of the recording data to which the first time information and the discrimination information are added;
    Metadata acquisition means for acquiring the encrypted metadata;
    Decryption key obtaining means for obtaining the decryption key used for decrypting the encrypted metadata;
    Decryption processing means for decrypting the encrypted metadata acquired by the metadata acquisition means using the decryption key acquired by the decryption key acquisition means;
    The metadata including the discrimination information for discriminating the program of the recorded data, the text data related to the recorded data, and the second time information corresponding to the text data, which is decoded by the decoding processing means, is stored. Metadata storage means for
    Operation input means for receiving user operation input;
    Performing a matching process between information specifying a program to be searched and text information as a search key input from the user by the operation input means and the metadata stored by the metadata storage means Matching processing means for detecting the second time information corresponding to the text information serving as the search key;
    A recording position corresponding to the second time information detected by the matching processing means is searched from the recording data whose storage is controlled by the recording data storage control means, and the recording position is started from the searched recording position. Search means for reading the recorded data;
  With
  The third information processing apparatus
    Second broadcast signal acquisition means for acquiring the broadcast signal;
    Second discrimination information acquisition means for acquiring the discrimination information capable of uniquely distinguishing the program of the broadcast signal from the broadcast signal acquired by the second broadcast signal acquisition means;
    Subtitle data decoding means for extracting and decoding subtitle data that can be selected by the user from the broadcast signal acquired by the second broadcast signal acquisition means;
    Time code adding means for adding a time code to text data corresponding to the caption data decoded by the caption data decoding means;
    Metadata generating means for generating the metadata by adding the discrimination information acquired by the discrimination information acquiring means to the text data to which the time code is added by the time code adding means;
    Encryption means for encrypting the metadata generated by the metadata generation means;
  With
  The fourth information processing apparatus
    Authentication information acquisition means for acquiring information related to authentication of the user from the second information processing apparatus;
    Registration information storage control means for controlling storage of the registration information of the user;
    Authentication processing means for executing authentication processing based on information on authentication of the user acquired by the authentication information acquisition means and registration information of the user whose storage is controlled by the registration information storage control means;
    Decryption key supply control means for controlling supply of the decryption key for decrypting the metadata to the second information processing apparatus when the user is correctly authenticated by the authentication processing means;
  An information processing system comprising:

Images