JP2006253960A - Information processing apparatus, mobile apparatus, information processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile phone whereby a plurality of programs can be browsed. <P>SOLUTION: A cradle 2 records a program of television broadcast instructed by the mobile phone 3. The recorded program is converted into thumbnail image data and text data on the basis of metadata generated by a metadata generating server 6. The thumbnail image data and the text data are cross-referenced with each other by means of time information. The cradle 2 supplies all the data above to the mobile phone 3. When receiving an instruction from a user, the mobile phone 3 displays the thumbnail image and the text corresponding to the thumbnail image on a display section. The user can grasp contents of the program by browsing the displayed thumbnail image and the displayed text. The technology disclosed herein is applicable to mobile phones. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information processing apparatus, method, and program, and in particular, when subtitle information included in a broadcast signal is used to carry and view a plurality of television broadcast programs on a portable apparatus. Information processing apparatus and method suitable for application

  The data of a program broadcast as a television broadcast includes video data and audio data. In addition, since the broadcast program data is included as video data, there are subtitles (introduction of program titles, casts, etc., or Japanese subtitles in overseas works) that cannot be selected by the user. May be included. In addition, the broadcast program data may include subtitle data that allows the user to select whether or not to display the program data. Such selectable subtitle data is generally referred to as closed captioning, and was developed mainly for the hearing impaired, not just for the conversation of performers like Japanese subtitles in overseas works. For example, descriptions of BGM, sound effects, and the like are also included.

  For example, in NTSC (National Television System Standard Committee) analog terrestrial broadcasting, 525 scanning lines are used for video signals, and each of these 525 lines (one field is composed of two fields). The first 21 lines are assigned for an interval called VBI (Vertical Blanking Interval) for starting scanning. The closed caption is transmitted by multiplexing a 7-bit character code in the 21st VBI of the VBIs in each field. Each field is used to transmit about 60 characters per second through two character sets.

  As for the transmission of caption information for digital television broadcasting, as defined in the BS digital broadcasting operation regulations and technical materials (ARIB TR-B15), which are domestic regulations, video using a transport stream for caption information is used. It is configured so that caption information can be transmitted simultaneously with information transmission. Then, in the receiver for digital television broadcasting, the code corresponding to the caption information is decoded, characters and figures constituting the caption are generated, and displayed superimposed on the video.

  In digital television broadcasting, the text information transmitted simultaneously with the transmission of video information using the transport stream for subtitle information is stored internally, and the text information stored internally can be displayed and viewed on a TV monitor at any time. Thus, there is a technique that allows a user to utilize subtitle information without taking a note of the displayed subtitle (for example, Patent Document 1).

JP 2003-78889 A

  In recent years, television broadcasts can be viewed on terminals that can be carried by users such as mobile phones and PDAs (Personal Digital Assistance). In addition, a program recorded by a recording device at home is recorded on a recording medium mounted on a portable device, and the recorded program is reproduced from the recording medium.

  As described above, the caption data to be broadcast has begun to be used for various services. In addition, a system is also provided in which television broadcasts themselves are received by various devices and the received programs can be browsed.

  However, when subtitle data to be broadcast such as closed caption is used in association with video by a method other than displaying it simultaneously with video, subtitle data and video data or audio data include analog broadcast or digital broadcast. In any of the above, since the time stamp for making both correspond is not added, the text data corresponding to the closed caption is separated from the video data, and then the correspondence between the separated text and the video data is taken. Therefore, the text obtained from the closed caption cannot be easily associated with the video by any other usage than displaying the text simultaneously with the video.

  In addition, caption data for the hearing impaired, such as closed captions, is required to be attached to all broadcast signals. However, such subtitle data is usually not necessary for healthy people, so there is almost no possibility that a sponsor will be charged to generate the necessary cost for subtitle data creation, and the broadcasting station bears the cost of creation. This is the current situation.

  Here, by using these subtitle data secondarily, the construction of a system capable of collecting the compensation to the broadcasting station for subtitle data creation can only contribute to the development of the industry. In addition, since it leads to an improvement in the rate at which caption data is attached to a broadcast signal, it is also beneficial for the hearing impaired.

  Also, television broadcasts are received by various devices, and programs broadcast by the television broadcasts are recorded on a predetermined recording medium and viewed on a portable device. There is a limit to the capacity of recording media. In addition, when a condition of a recording medium that can be mounted (built in) in a portable device is added, the capacity of the usable recording medium is further limited.

  Therefore, when viewing a program on a portable device, only a short time program can be viewed (only a part of the program can be viewed), and if a high compression ratio is recorded to record a long time program, the video becomes rough and the image quality is improved. There was a problem of being lowered. For this reason, there was a problem that it did not spread. Therefore, there is a demand for a function that allows a portable device to browse a long program or a plurality of programs while preventing the image quality from being deteriorated.

  The present invention has been made in view of such a situation, and an object of the present invention is to enable a portable device to browse a plurality of programs and a long-time program.

  The first information processing apparatus according to the present invention includes a management unit that manages data composed of moving images and sound, metadata that stores text data and metadata including at least time information corresponding to the text data. Storage means, data managed by management means, still image generation means for generating a still image from metadata stored in metadata storage means, still image generated by still image generation means, text An association means for associating data with reference to metadata, and a supply means for supplying data including at least a still image and text data associated by the association means to another device.

  A first information processing method of the present invention controls a management step for managing data composed of moving images and sound, and storage of metadata including at least text data and time information corresponding to the text data. A still image generation step for generating a still image from the data managed in the metadata storage control step, the data managed in the management step processing, and the metadata whose storage is controlled in the metadata storage step processing; An association step for associating the still image generated by the processing with text data with reference to the metadata, and for supplying data including at least the still image associated with the processing of the association step and the text data to another device And a supply control step for performing control.

  The first program of the present invention includes a management step for managing data composed of moving images and audio, metadata for controlling storage of text data and metadata including at least time information corresponding to the text data In the storage control step, the data managed in the management step processing, the still image generation step for generating a still image from the metadata whose storage is controlled in the metadata storage step processing, and the still image generation step processing An association step for associating the generated still image with text data with reference to metadata, and a control for supplying data including at least the still image and text data associated in the association step processing to another device And a supply control step to be executed by a computer. .

  A second information processing apparatus according to the present invention includes still image data generated from data including moving images and sound, text data and metadata including at least time information corresponding to the text data, and the still image A storage unit that stores data including at least text data associated with an image, an operation input unit that receives a user's operation input, and a user's operation input that is input by the operation input unit are stored in the storage unit. Display control means for controlling the display of at least one of a still image or text based on the stored data.

  The second information processing apparatus can be a portable apparatus.

  The display control means can update a still image or text whose display is controlled every time a predetermined time elapses or every time a user instruction is given.

  The display control means performs control to display only text, and when the user selects a predetermined text from the text displayed by the control, the display is switched to a still image corresponding to the selected text. Can be done.

  The still image data can be set such that the text indicated by the text data associated with the still image data is set as the file name.

  The display control means performs control to display only the file name, and when the user selects a predetermined file name from the file names displayed by the control, the selected file name is set to the static Control to switch the display to an image can be performed.

  A second information processing method according to the present invention includes still image data generated from data including moving images and sound, text data and metadata including at least time information corresponding to the text data, and the still image A storage control step for controlling storage of data including at least text data associated with the image, an operation input step for receiving user operation input, and storage according to the user operation input input in the process of the operation input step A display control step of controlling display of at least one of a still image and text based on the data whose storage is controlled in the processing of the step.

  The second program according to the present invention includes still image data generated from data including moving images and sound, text data and metadata including at least time information corresponding to the text data, and still images. A storage control step for controlling storage of data including at least associated text data, an operation input step for accepting a user operation input, and a user operation input input in the process of the operation input step. And a display control step for controlling display of at least one of a still image and text based on the data whose storage is controlled by the processing.

  In the first information processing apparatus and method and program of the present invention, reference is made to metadata including at least data including moving images and sound, text data, and time information corresponding to the text data. A still image is generated and the still image is associated with the text data.

  In the second information processing apparatus and method, and program of the present invention, a still image generated from data including at least moving image and sound, and text data and metadata including at least time information corresponding to the text data. Display based on image data and data including at least text data associated with the still image is performed.

  According to the present invention, it is possible to convert data composed of moving images and audio into data composed of still images and text.

  According to the present invention, for example, data of a plurality of television broadcast programs and long-term program data can be recorded on a small-capacity recording medium. By recording on a recording medium having a small capacity, the recording medium can be mounted (built in) in a portable device. Furthermore, it becomes possible to reproduce a program from a recording medium attached to a portable device.

  According to the present invention, data composed of moving images and audio can be compressed into data composed of still images and text. In addition, by recording the compressed data on a predetermined recording medium and using the recorded data, the contents of a program composed of, for example, moving images and sound can be transferred to a user by a portable device. It becomes possible to meet.

  BEST MODE FOR CARRYING OUT THE INVENTION The best mode of the present invention will be described below. The correspondence relationship between the disclosed invention and the embodiments is exemplified as follows. Although there is an embodiment which is described in the specification but is not described here as corresponding to the invention, it means that the embodiment corresponds to the invention. It doesn't mean not. Conversely, even if an embodiment is described herein as corresponding to an invention, that means that the embodiment does not correspond to an invention other than the invention. Absent.

  Further, this description does not mean all the inventions described in the specification. In other words, this description is an invention described in the specification and is not claimed in this application, that is, an invention that will be filed in division in the future, appearing by amendment, and added. The existence of is not denied.

  The first information processing apparatus of the present invention is, for example, the cradle 2 of FIG. The first information processing apparatus includes management means (for example, the recorded data storage unit 57 in FIG. 4) that manages data composed of moving images and audio, text data, and time information corresponding to the text data. A metadata storage unit (for example, the metadata storage unit 67 in FIG. 4) that stores metadata including at least, data managed by the management unit, and a still image from the metadata stored in the metadata storage unit Still image generation means to be generated (for example, the thumbnail generation unit 68 in FIG. 4), still image generated by the still image generation means, and association means for associating text data with reference to metadata (for example, FIG. 4) The data including at least the still image and the text data associated by the creation data storage unit 69) and the association means are supplied to another device. Comprising supply means (e.g., output data control unit 70 of FIG. 4) and.

  The second information processing apparatus of the present invention is, for example, the mobile phone 3 in FIG. The second information processing apparatus associates data composed of moving images and sound, still image data generated from text data and metadata including at least time information corresponding to the text data, and the still image. Storage means for storing data including at least the received text data (for example, the created data storage section 101 in FIG. 8), operation input means for receiving user operation input (for example, the operation section 105 in FIG. 8), and operation input Display control means for controlling the display of at least one of a still image or text based on the data stored in the storage means in accordance with a user operation input input by the means (for example, display selection subtitle data in FIG. 8) Decoder 103).

  Embodiments of the present invention will be described below with reference to the drawings.

[System configuration]
FIG. 1 is a system diagram for explaining the configuration of an information processing system to which the present invention is applied.

  The broadcasting station 1 broadcasts a program using terrestrial waves or satellite waves. Broadcast program data includes video data and audio data. Also, since the program data is included as video data, it includes subtitles (introduction of program titles and casts, or Japanese subtitles in overseas works) that cannot be selected by the user. There may be. In addition, the broadcast program data may include subtitle data that allows the user to select whether or not to display the program data. Such selectable subtitle data (so-called closed captions) includes not only text data corresponding to performers' conversations such as Japanese subtitles in overseas works, but also explanations such as BGM and sound effects. It may be included.

  For example, in NTSC analog terrestrial broadcasting, 525 scanning lines are used for video signals. Of these 525 lines, the first 21 lines in each field (one field consists of two fields) And VBI (Vertical Blanking Interval), which is called an interval for starting scanning. The closed caption is transmitted by multiplexing a 7-bit character code in the 21st VBI of each field's VBI, and each field can be used to transmit two types of character sets of approximately 60 characters per second. It is configured. Hereinafter, subtitle data that can be selected between display and non-display, represented by closed captions, will be referred to as display selection subtitle data.

  Specific examples of video data, audio data, and display selection subtitle data will be described with reference to FIG.

  The video data 15 is moving image data, and in FIG. 2, frame image data at several timings is extracted from the moving image data. The audio data 16 is audio data to be reproduced simultaneously with the video data 15. The display selection subtitle data 17 may be, for example, text data corresponding to the voice data 16, and is used to explain the speaker when the voice data other than the text data corresponding to the voice data is a conversation. Text data or the like may be included. The video data 15 and the audio data 16 are recorded and reproduced, for example, in addition to being viewed in real time at the time of broadcasting, for example, by having corresponding link information or having a relative time stamp. Even in such a case, the time axis is not shifted. On the other hand, since the display selection subtitle data 17 is assumed to be treated in the same way as the video data until it is decoded at the time of reproduction, the link data for the video data 15 or the audio data 16 or the time of the relative time is assumed. Does not have stamps.

  Returning again to the description of FIG.

  Using the cradle 2, the user receives a broadcast signal composed of the video data 15 including the display selection subtitle data 17 described with reference to FIG. The cradle 2 is attached with a mobile phone 3 and when the mobile phone 3 is attached, the cradle 2 supplies power (executes a charging process) or supplies recorded data to the mobile phone 3. It has a function to do.

  In the present embodiment, the cradle 2 has a function of displaying thumbnail images and text generated by a display selection subtitle decoder (described later) based on user operation input. Thumbnail images and text (hereinafter referred to as creation data or thumbnail data files as appropriate) are stored in the cradle 2 and supplied.

  As described above, the cradle 2 records a predetermined program. Information on the program to be recorded is performed directly from the mobile phone 3 using, for example, infrared rays or the telephone network. This is done indirectly via 4. When the mobile phone 3 indirectly outputs the information of the program instructed to be recorded by the user to the cradle 2, the mobile phone 3 first outputs the information to the base station 8 via the telephone network 4 and stores it. . The cradle 2 sets information related to recording by acquiring information stored in the base station 8 via the telephone network 4.

  The cradle 2 records a predetermined program based on the set information (details will be described later).

  The metadata creation server 6 obtains a broadcast signal with display selection subtitle data created by the broadcast station 1 by receiving it via the Internet 5, via a predetermined medium, or from an antenna (not shown), Based on that, metadata is created and the created metadata is encrypted. The metadata creation server 6 publishes a web page for distributing encrypted metadata to users via the Internet 5 on the Internet 5, for example, the cradle 2, a personal computer (not shown), a mobile phone 3, or by receiving access from a user using a PDA or the like, the encrypted metadata used for searching for a program desired by the user is downloaded via the Internet 5.

  The method of distributing metadata to users is not limited to publishing a web page on the Internet 5, for example, a so-called data communication is performed by connecting a plurality of information processing devices through a telephone line with a host computer at the center. It may be via any medium such as personal computer communication, communication via a dedicated line, or distribution of data via a removable recording medium.

  The authentication server 7 publishes on the Internet 5 a web page for distributing to the user via the Internet 5 a decryption key for decrypting the metadata created by the metadata creation server 6 and encrypted and distributed to the user. For example, the user receives access from a user using a cradle 2, a personal computer (not shown), a portable telephone, or a PDA, and settles the price for the decryption key of the metadata desired by the user. Distribute the decryption key. In addition, the authentication server 7 executes a billing process for paying the broadcasting station 1 a fee for the broadcasting station 1 that created the display selection subtitle data.

  The method of distributing the decryption key to the user is not limited to publishing the web page on the Internet 5, for example, a so-called data communication is performed by connecting a plurality of information processing devices through a telephone line, mainly with a host computer. It may be via any medium such as personal computer communication, communication via a dedicated line, or distribution of data via a removable recording medium.

[External configuration of cradle and mobile phone]
3A and 3B are diagrams showing the external configuration of the cradle 2 and the mobile phone 3. FIG. 3A illustrates a case where the creation data recorded in the cradle 2 is recorded in a recording unit (for example, the creation data storage unit 101 in FIG. 8 described later) built in the mobile phone 3. The cradle 2 is provided with a terminal (not shown) at a predetermined position. A terminal is also provided on the mobile phone 3 side at a position facing the terminal of the cradle 2. These terminals are configured to come into contact when the mobile phone 3 is mounted (installed) on the cradle 2.

  When the terminal of the cradle 2 and the terminal of the mobile phone 3 are in contact with each other, the creation data stored in the cradle 2 is supplied to the storage unit of the mobile phone 3 according to an instruction from the mobile phone 3 (in response to a user instruction). And memorized.

  In FIG. 3B, the creation data recorded in the cradle 2 is recorded on a predetermined recording medium 31 that is detachable from the cradle 2, and the creation data is recorded by attaching the recording medium 31 to the mobile phone 3. A case where the mobile phone 3 is moved from the cradle 2 is illustrated. In such a case, the cradle 2 is configured to be provided with a slot 21 into which the recording medium 31 is detachably mounted. Although not shown, the mobile phone 3 is also provided with a slot on which the recording medium 31 can be freely inserted.

  When the mobile phone 3 is attached to the cradle 2 as shown in FIG. 3A with the recording medium 31 attached, the created data recorded in the cradle 2 is recorded to the mobile phone 3. It is of course possible to provide a mechanism for supplying the medium 31. It is also possible to provide both a mechanism for moving the created data as shown in FIG. 3A and a mechanism for moving the created data as shown in FIG. 3B.

  In any case, in the present embodiment, creation data composed of thumbnail images and text data is created and stored on the cradle 2 side. Then, the creation data stored in the cradle 2 is supplied to and stored in the mobile phone 3.

  The configuration of the cradle 2 that creates, stores, and supplies the created data to the mobile phone 3 will be described with reference to FIG. Here, if the processing performed by the cradle 2 having the configuration described below is simply described, the data composed of moving images and sound is changed to data composed of still images (thumbnail images) and text. This is processing for performing compression processing and supplying the compressed data to the mobile phone 3.

[Cradle internal configuration example]
FIG. 4 is a diagram illustrating an internal configuration example of the cradle 2. The cradle 2 is provided with a connection terminal 51 that is connected to an antenna that receives a television broadcast. A broadcast signal supplied via the connection terminal 51 is supplied to the tuner 52. Among the broadcast signals selected by the tuner 52, a video signal including display selection caption data is supplied to the video signal decoder 53.

  The video signal decoder 53 decodes the supplied video signal and supplies the decoded video data to the memory 54. The memory 54 is a frame memory that temporarily holds the supplied video signal. The video data held in the memory 54 is supplied to the recording data generation unit 55 as necessary.

  The recording data generation unit 55 reads out video data held in the memory 54 according to an instruction from the recording control unit 56 and generates recording data to be stored and managed in the recording data storage unit 57. When the recording control unit 56 is instructed to output the supplied video data to the recording data storage unit 57 for recording based on the user's operation input from the operation input unit 58, the recording data generation unit 55. Controls the program ID information extraction unit 61 to extract the program ID included in the program management information from the video data held in the memory 54.

  The program ID information extraction unit 61 uses the program management information included in the video data decoded by the video signal decoder 53 to determine a program (here, “program” is the entire program such as a two-hour drama, for example). Even if one program is divided by a commercial or the like, each divided unit may include a plurality of programs, or may include only commercials or only commercials. Program ID information that is uniquely distinguishable is extracted and supplied to the recorded data generation unit 55.

When the video data does not include program management information, the program ID information extraction unit 61
The time information may be acquired from the timer 62 via the recording data generation unit 55, and the program ID information may be generated from the acquired time information.

  The recorded data generation unit 55 refers to the timer 62 to acquire the recording start time (absolute time), and associates the recording start time information, which is the acquired time information, with the video data supplied from the memory 54. The video data is associated with the program ID supplied from the program ID information extraction unit 61 to generate output data to be recorded. This recording start time information is used in a thumbnail screen display described later.

  The output data to be recorded will be described with reference to FIG. In the recording data generation unit 55, the recording start time information 95 is associated with the video data 15 among the output data to be recorded. The video data 15 includes display selection subtitle data 17. Then, program ID information is associated with these data, and output data for recording is generated.

  Returning to FIG. 4, the description of the configuration of the cradle 2 will be continued.

  The operation input unit 58 is a part that receives a user operation input. The operation input unit 58 includes a telephone network input unit 59 that acquires data related to recording from another device (for example, the base station 8 (FIG. 1)) via the telephone network 4 (FIG. 1). In addition, the operation input unit 58 includes an infrared input unit 60 that acquires data related to recording by wireless communication using infrared rays from the mobile phone 3.

  The recording data storage unit 57 stores video data generated by the recording data generation unit 55 and associated with the program ID and recording start time information. For example, the recorded data storage unit 57 may be configured by a large-capacity recording medium such as a hard disk or a removable recording medium such as a DVD (Digital Versatile Disc) or a video tape.

  The network interface 63 is provided for acquiring information on web pages that are open to the Internet 5. For example, the network interface 63 downloads metadata from the metadata creation server 6 (FIG. 1), outputs it to the encrypted metadata storage unit 64, stores it, or acquires it from the authentication server 7 (FIG. 1). The decryption key is output to the decryption key storage unit 65 and stored. In addition, the network interface 63 is a personal computer (not shown) that transmits encrypted metadata, a decryption key, etc. acquired by using a personal computer (not shown) or PDA owned by the user, via wired or wireless communication. Or from a PDA.

  The encrypted metadata storage unit 64 stores the acquired encrypted metadata. The decryption key storage unit 65 stores the acquired decryption key. The decryption processing unit 66 decrypts the encrypted metadata stored in the encrypted metadata storage unit 64 using the decryption key stored in the decryption key storage unit 65, and stores it in the metadata storage unit 67. Output and store. The metadata storage unit 67 receives the supplied metadata and stores it.

  The thumbnail generation unit 68 refers to the metadata stored in the metadata storage unit 67, and from the recorded data stored in the recorded data storage unit 57, the thumbnail which is one frame of image data of the video signal. A plurality of thumbnail data composed of image data and text data corresponding to the thumbnail image data is generated, and a thumbnail data file (creation data) generated from the thumbnail data for one program identified by the program ID is created. The data is stored in the data storage unit 69.

  When the creation data is stored in the creation data storage unit 69, the file name of the thumbnail image data included in the created creation data may be the text indicated by the text data corresponding to the thumbnail image data. . That is, the file name of the thumbnail image may be set as the corresponding text.

  The creation data stored in the creation data storage unit 69 is supplied to the mobile phone 3 based on the control of the output data control unit 70. As described with reference to FIG. 3A or 3B, the creation data is directly supplied between the cradle 2 and the mobile phone 3 (in the case of FIG. 3A), or between the cradle 2 and the mobile phone 3 Are indirectly supplied (in the case of FIG. 3B). When the creation data is directly supplied from the cradle 2 to the mobile phone 3, the output data control unit 70 includes a terminal provided in the cradle 2, and controls output from the terminal. Then, the creation data stored in the creation data storage unit 69 is read and supplied to the mobile phone 3.

  Alternatively, when the creation data is directly supplied from the cradle 2 to the mobile phone 3, the creation data storage unit 69 may be provided on the mobile phone 3 side instead of being provided on the cradle 2 side. That is, as shown in FIG. 6, a creation data storage unit 101 is provided in the mobile phone 3, and the output data control unit 70 supplies the creation data to the creation data storage unit 101. When the cradle 2 is configured as shown in FIG. 6, creation data is created on the cradle 2 side and supplied to the mobile phone 3 side when the mobile phone 3 is mounted on the cradle 2.

  When the creation data is indirectly supplied from the cradle 2 to the mobile phone 3, the cradle 2 is configured to be provided with the slot 21 as described with reference to FIG. 3B. In such a case, the cradle 2 is configured as shown in FIG.

  The slot 21 is provided with a portion (terminal) that physically contacts the recording medium 31, and the output data control unit 80 includes the terminal. By controlling the output from the terminal, Created data is supplied to the recording medium 31 as an alternative to the created data storage unit 69. In other words, in such a configuration, creation data is created on the cradle 2 side and supplied to the recording medium 31 side when the recording medium 31 is mounted on the cradle 2.

  Here, the description will be continued assuming that the cradle 2 has any one of the configurations shown in FIGS. 4 to 7. For example, as shown in FIG. 7, the creation data is recorded on the external recording medium 31. Even in such a case, it is of course possible to have a configuration once having a portion for recording the created data in the cradle 2, that is, the configuration shown in FIG. When the cradle 2 has the configuration shown in FIG. 4, the creation data stored in the creation data storage unit 69 is in a state where the recording medium 31 is attached or the mobile phone 3 is attached. Sometimes read and supplied.

[Configuration of mobile phone]
FIG. 8 is a diagram illustrating an internal configuration example of the mobile phone 3. The mobile phone 3 shown in FIG. 8 is the case where creation data is directly supplied from the cradle 2 to the mobile phone 3 as described with reference to FIG. 3A, and the cradle 2 is as shown in FIG. 4 or FIG. This corresponds to the case of having an internal structure.

  In the example of the internal configuration of the mobile phone 3 shown in FIG. 8, the configuration related to the functions that the mobile phone 3 normally has is not necessary for the description of the present invention. Are omitted as appropriate. The functions that the mobile phone 3 normally has are, for example, a function of communicating with another mobile phone via the telephone network 4 (FIG. 1), a function of transmitting and receiving e-mails, and the like. However, an embodiment in which the processing described below is executed using the normally provided functions is also within the scope of the present invention.

  The cellular phone 3 includes a creation data storage unit 101 that stores creation data. The creation data storage unit 101 is built in the mobile phone 3 and stores creation data supplied from the cradle 2 under the control of the input data control unit 102 when the creation data storage unit 101 is attached to the cradle 2. The

  The creation data stored in the creation data storage unit 101 is read by the display selection subtitle data decoder 103 in accordance with an instruction from the user. The display selection subtitle decoder 103 causes the display unit 104 to display thumbnail images and text data included in the created data at a predetermined timing. The display unit 104 is configured by, for example, an LCD (Liquid Crystal Display).

  The display selection subtitle data decoder 103 reads the created data stored in the created data storage unit 101 in accordance with an instruction from the user input via the operation unit 105. The operation unit 105 includes a plurality of push-down buttons (for example, a button for inputting a telephone number) normally provided in the mobile phone 3 and a rotary button.

  An instruction from the user input via the operation unit 105 is supplied to the input / output unit 106 as necessary. The input / output unit 106 includes a telephone network input / output unit 107 and an infrared input / output unit 108. The telephone network input / output unit 107 controls, for example, processing when transmitting or receiving some information to the base station 8 via the telephone network 4 (FIG. 1). The infrared input / output unit 108 controls processing when information is transmitted to the cradle 2 (for example, FIG. 4) by communication using infrared rays.

  The recording instruction unit 109 is provided for instructing the cradle 2 to record a television broadcast program (instructing a program for creating creation data). For example, the recording instruction unit 109 causes the display unit 104 to display an EPG (Electric Program Guide) acquired by the input / output unit 106. Then, the user browses the EPG, operates the operation unit 105, and the recording instruction unit 109 transmits the data of the program selected to be recorded to the cradle 2 from the infrared input / output unit 108. It is configured to do.

  FIG. 9 shows a case where creation data is indirectly supplied from the cradle 2 to the mobile phone 3 as described with reference to FIG. 3B, and the cradle 2 has an internal configuration as shown in FIG. 4 or FIG. It is a figure which shows the example of an internal structure of the mobile telephone 3 corresponding to.

  When the creation data is indirectly supplied from the cradle 2 to the mobile phone 3, the mobile phone 3 is provided with a slot (not shown) in which the recording medium 31 is mounted as described with reference to FIG. 3B. It is supposed to be configured. The slot is provided with a portion (terminal) that physically contacts the recording medium 31, and the input data control unit 121 is configured to include the terminal, and by controlling the input from the terminal, The creation data stored in the recording medium 31 is read and supplied to the display selection subtitle data decoder 103. The other parts are the same as those shown in FIG.

  In the following description, as described with reference to FIG. 3A, creation data is directly supplied from the cradle 2 to the mobile phone 3, and the cradle 2 has the configuration shown in FIG. 3 will be described by taking as an example the case of the configuration shown in FIG. Even when the cradle 2 and the mobile phone 3 have other configurations (for example, the configurations shown in FIGS. 5, 6, and 9), the operations described below are basically the same. is there.

[Configuration of metadata creation server]
Next, FIG. 10 is a block diagram showing a configuration of the metadata creation server 6. A CPU (Central Processing Unit) 201 executes various processes according to a program stored in a ROM (Read Only Memory) 202 or a program loaded from a storage unit 208 to a RAM (Random Access Memory) 203. The RAM 203 also appropriately stores data necessary for the CPU 201 to execute various processes.

  The CPU 201, ROM 202, and RAM 203 are connected to each other via a bus 204. An input / output interface 205 is also connected to the bus 204. The input / output interface 205 includes an input unit 206 including a keyboard and a mouse, an output unit 207 including a display and a speaker, a storage unit 208 including a hard disk, and a communication unit 209 including a modem and a terminal adapter. It is connected. The communication unit 209 performs communication processing via a network including the Internet 5.

  A drive 210 is connected to the input / output interface 205 as necessary, and a magnetic disk 221, an optical disk 222, a magneto-optical disk 223, a semiconductor memory 224, or the like is appropriately mounted, and a computer program read from them is loaded. Installed in the storage unit 208 as necessary.

  FIG. 11 is a functional block diagram for explaining functions (including functions realized by a program executed by the CPU 201) of the metadata creation server 6 described with reference to FIG. It is.

  The broadcast data acquisition unit 241 corresponds to the communication unit 209 in FIG. 10, acquires broadcast data via the Internet 5 or via an antenna (not shown), and supplies the broadcast data to the decoder 242. The decoder 242 decodes the supplied broadcast data. Here, the decoder 242 may decode only the video signal including the program management information including the program ID information and the display selection subtitle data necessary for creating the metadata among the broadcast data.

  The program ID information extraction unit 243 obtains a broadcast program (also referred to here as “program”, for example, a whole program such as a two-hour drama) from the program management information included in the video data decoded by the decoder 242. When one program is divided by commercials or the like, each unit divided may include a plurality of programs, or may include only commercials or only commercials. ) Is extracted and supplied to the metadata generation unit 244, and the supplied video data is supplied to the display selection subtitle data decoder 245.

  When the video data does not include program management information, the program ID information extraction unit 243 acquires time information from a timer (not shown) (or allows time information to be acquired from the timer 248). The program ID information may be generated from the acquired time information.

  The display selection subtitle data decoder 245 decodes the display selection subtitle data included in the acquired video data, and supplies the corresponding text data to the display selection subtitle data analysis unit 246. The display selection subtitle data analysis unit 246 divides the text data corresponding to the display selection subtitle data supplied from the display selection subtitle data decoder 245 into a text group having an appropriate length (for example, the text displayed at one time). Are divided as one text group), and the divided text group is supplied to the time code association processing unit 247.

  The time code association processing unit 247 refers to the timer 248 and executes a process of associating each of the supplied text groups with a time code corresponding to the start position and end position of the text. The time code association processing unit 247 indicates that the timer 248 indicates that the broadcast data acquisition unit 241 acquires a broadcast signal in real time (that is, at the broadcast time of the program) in the same manner as when the user acquires broadcast data. It is assumed that the time code is associated with the text data based on the current time.

  In addition, the time code association processing unit 247, when the broadcast data acquisition unit 241 acquires a broadcast signal with a delay from the broadcast time of the program, or the time required for processing by the decoder 242 to the display selection subtitle data analysis unit 246 In the case where it becomes longer than the output processing of a broadcast signal using a general television receiver, the current time indicated by the timer 248 and the delay time for acquiring the broadcast signal, or the delay time due to the time required for the processing Based on the above, a time code corresponding to the broadcast time of the program is calculated and associated with the text data.

  The metadata generation unit 244 generates metadata by associating the program ID information supplied from the program ID information extraction unit 243 with the text data associated with the time code supplied from the time code association processing unit 247. To the encryption processing unit 249.

  The metadata will be described with reference to FIG.

  The text data 265 divided into text 1, text 2,..., Which is a text group of an appropriate length by the display selection subtitle data analysis unit 246, is processed by the time code association processing unit 247. A time code 266 describing the start time and end time of the group is associated. For example, when the text of ““ This is the news at 7 o'clock ”and“ Today's first topic is ... ”” is divided as text 1, the display selection subtitle of this portion is displayed in the broadcast of the program. The start time and the end time corresponding to the received time are described in the time code 266. Further, the program ID information 267 supplied from the program ID information extracting unit 243 is associated with each other to generate the metadata 261. Is done.

  Returning to the description of FIG. The encryption processing unit 249 encrypts the metadata supplied from the metadata creation unit 244 with the encryption key corresponding to the program ID stored in advance in the encryption key storage unit 250 and supplies the encrypted metadata to the metadata storage unit 251. To do. The metadata supply control unit 252 searches the metadata storage unit 251 for encrypted metadata corresponding to a program desired by the user based on a signal for requesting metadata supplied from the communication unit 253, and The data is supplied to the cradle 2 held by the user, a personal computer (not shown), or a PDA via the Internet 5.

  For example, the page information storage unit 255 downloads metadata for use by the user (cradle 2) such as a list of metadata that can be downloaded and a method for obtaining a decryption key necessary for using the metadata. Information corresponding to a web page for providing necessary information is stored. The web page publishing processing unit 254 publishes the web page stored in the page information storage unit 255 to the Internet 5.

  The communication unit 253 corresponds to the communication unit 209 in FIG. 10, and exchanges information with the cradle 2 or the mobile phone 3 held by the user, or a personal computer or PDA (not shown) via the Internet 5. It is.

[Configuration of authentication server]
Next, FIG. 13 is a block diagram showing the configuration of the authentication server 7. A CPU (Central Processing Unit) 271 executes various processes according to a program stored in a ROM (Read Only Memory) 272 or a program loaded from a storage unit 278 to a RAM (Random Access Memory) 273.

  The RAM 273 also appropriately stores data necessary for the CPU 271 to execute various processes. The CPU 271, ROM 272, and RAM 273 are connected to each other via a bus 274. An input / output interface 275 is also connected to the bus 274.

  The input / output interface 275 includes an input unit 276 including a keyboard and a mouse, an output unit 277 including a display and a speaker, a storage unit 278 including a hard disk, and a communication unit 279 including a modem and a terminal adapter. It is connected. The communication unit 279 performs communication processing via a network including the Internet 5.

  A drive 280 is connected to the input / output interface 275 as necessary, and a magnetic disk 221, an optical disk 222, a magneto-optical disk 223, a semiconductor memory 224, or the like is appropriately mounted, and a computer program read from them is loaded. If necessary, it is installed in the storage unit 278.

  Next, FIG. 14 is a functional block diagram for explaining functions (including functions realized by a program executed by the CPU 271) of the authentication server 7 of FIG.

  The page information storage unit 302 includes meta data downloaded by the user, such as input of user information for user registration and billing information, acquisition method of a decryption key necessary for using the metadata, transmission of a purchase request for the decryption key, and the like. A decryption key necessary for decrypting data is provided, and information corresponding to a web page for charging the data is stored. The web page publishing processing unit 301 publishes the web page stored in the page information storage unit 302 to the Internet 5.

  The communication unit 303 corresponds to the communication unit 279 of FIG. 13, and exchanges information with the cradle 2 held by the user, a personal computer (not shown), a PDA, or the like via the Internet 5.

  The operation input information acquisition unit 304 acquires the operation input information transmitted by the user via the communication unit 303. If the operation input information relates to the operation of the web page, the operation input information acquisition unit 304 In the case of personal information for user registration, in the user information registration processing unit 305, in the case of information necessary for authentication processing, in the case of information that requests authentication processing unit 307 to purchase a key, When the information is related to the charging process to the supply processing unit 308, the operation input information is supplied to the charging processing unit 310, respectively.

  The user information registration processing unit 305 receives the supply of personal information for user registration from the operation input information acquisition unit 304 and supplies the personal information to the user information database 306. The user information database 306 stores user registration information that is personal information for user registration. The authentication processing unit 307 issues a user ID that can uniquely distinguish a user to a newly registered user, registers the user ID in the user information database 306, and sends the issued user ID via the communication unit 303. The data is sent to the cradle 2 or the mobile phone 3 held by the user, or a personal computer or PDA (not shown). Further, the authentication processing unit 307 receives supply of information necessary for the authentication process from the operation input information acquisition unit 304, executes the authentication process with reference to the user information registered in the user information database 306, and performs the authentication process. The result is output to the key supply processing unit 308.

  The key supply processing unit 308 receives supply of information requesting key purchase from the operation input information acquisition unit 304, and receives an authentication result input indicating that the user authentication processing has been completed successfully from the authentication processing unit 307. In this case, the corresponding decryption key is read from the decryption key storage unit 309 and supplied to the cradle 2 or the mobile phone 3 held by the user or a personal computer or PDA (not shown) via the communication unit 303 and charged. Information about key supply is output to unit 310.

  The decryption key storage unit 309 stores a decryption key for decrypting the encrypted metadata for each program ID. That is, the decryption key storage unit 309 stores the encryption for each program ID, which is stored in advance in the encryption key storage unit 250 described with reference to FIG. 11 and is used when the encryption processing unit 249 encrypts the metadata. A decryption key corresponding to the key is stored.

  The billing processing unit 310 performs billing processing based on the information related to billing supplied from the operation input information acquisition unit 304 and the key supply processing unit 308, and registers information necessary for billing in the billing information database 311 or Based on the contents registered in the information database 306 and the billing information database 311, a process for paying the price of the decryption key supplied to the user, a process for paying the price for providing the display selection subtitle to the broadcasting station 1, etc. are executed. . Information necessary for the accounting process is registered in the accounting information database 311.

[Processing related to recording reservation]
Next, processing related to recording reservation of a predetermined program performed in the information processing system shown in FIG. 1 will be described with reference to the flowchart of FIG. The recording reservation is performed when a program to be recorded is set by the mobile phone 3 and the cradle 2 acquires information on the set program.

  In step S11, the mobile phone 3 acquires an EPG. The EPG is provided from a predetermined server (not shown), and is acquired by accessing the server. When the EPG is acquired, a program guide based on the acquired EPG is provided to the user.

  For example, referring to the configuration of the mobile phone 3 shown in FIG. 8, the recording instruction unit 109 controls the input / output unit 106 when an instruction for obtaining an EPG is issued from the user via the operation unit 105. To obtain the EPG data. The EPG data acquired by the input / output unit 106 is provided to the recording instruction unit 109. The recording instruction unit 109 creates a program guide based on the provided EPG data and causes the display unit 104 to display the program guide.

  In this way, the user browses the program guide displayed on the display unit 104, and the user sets a program to be recorded. The setting is performed based on an instruction from the user input via the operation unit 105. Information on a program set to be recorded (hereinafter, appropriately described as recorded program information) is acquired by the recording instruction unit 109 in step S12. In step S13, it is determined whether or not the set program information is to be supplied to the cradle 2 by e-mail.

  For example, when the user can issue an instruction directly to the cradle 2, the recorded program information is supplied from the mobile phone 3 to the cradle 2 by infrared wireless communication as described later. When the instruction cannot be issued directly to the cradle 2, the recorded program information is supplied from the mobile phone 3 to the cradle 2 by e-mail. Here, it is assumed that the recorded program information is transmitted by e-mail when an instruction cannot be issued directly to the cradle 2, but it can also be transmitted by communication means other than e-mail.

  If it is determined in step S13 that an instruction to send recorded program information is sent by e-mail, the process proceeds to step S14. In step S14, an e-mail including recorded program information is created. Then, the created electronic mail is transmitted to the base station 8 via the telephone network 4 (FIG. 1) in step S15.

  The e-mail transmitted to the base station 8 is stored in the base station 8. The cradle 2 accesses the base station 8 every time a predetermined time elapses and checks whether or not an e-mail addressed to itself (e-mail transmitted from the mobile phone 3) is stored (polling function). . Recorded program information from the mobile phone 3 is supplied to the cradle 2 via the base station 8. Of course, the recorded program information is not temporarily stored in the base station 8 but may be transmitted (transferred) from the base station 8 to the cradle 2 when it reaches the base station 8.

  Returning to the description of the processing in the flowchart of FIG. 15, in step S13, when it is determined that the recorded program information is not transmitted by e-mail, that is, the recorded program information is determined to be transmitted to the cradle 2 by infrared rays. If so, the process proceeds to step S16. In step S16, data related to the recorded program information is created. In step S <b> 17, the created data is transmitted from the mobile phone 3 to the cradle 2 by performing modulation processing or the like of a predetermined method for transmitting the created data with infrared rays. .

  Thus, when an instruction can be issued directly to the cradle 2, the recorded program information is supplied by wireless communication such as infrared rays. Of course, the recorded program information may be supplied when the cradle 2 and the mobile phone 3 are connected by wire or the like (when the cradle 2 is in the state shown in FIG. 3A).

  Here, the recorded program information is set by the mobile phone 3 and supplied to the cradle 2 side. However, the recorded program information is set and supplied to the cradle 2 by a device (not shown) such as a personal computer or PDA. You may be made to do.

[Recording data creation process]
The cradle 2 records (records) the set program when the recorded program information is set. For processing related to the recording (processing for creating recorded data), refer to the flowchart of FIG. I will explain. The process of the flowchart shown in FIG. 16 is performed when a program to be recorded is broadcast based on the recorded program information.

  In step S21, the program ID information extraction unit 61 (FIG. 4) is selected from the program management information included in the decoded video data selected by the tuner 52, decoded by the video signal decoder 53, and held in the memory 54. The program ID information that can individually identify the recorded program is extracted and supplied to the recorded data generation unit 55.

  In step S <b> 22, the recording data generation unit 55 refers to the timer 62 and associates the recording start time information 95 with the video data supplied from the memory 54.

  In step S23, the recording data generation unit 55 further associates the program ID with the video data associated with the recording start time information 95, and generates the recording output data described with reference to FIG.

  Through such processing, recording data in which the program ID and the recording start time information 95 are associated is generated.

  When the program management information is not included in the video data, the program ID information extraction unit 61 acquires time information from the timer 62 via the recording data generation unit 55, and program ID information is acquired from the acquired time information. May be generated.

[About creating metadata]
Next, the metadata creation process executed by the metadata creation server 6 described with reference to FIGS. 10 and 11 will be described with reference to the flowchart of FIG.

  In step S <b> 41, the broadcast data acquisition unit 241 receives a program broadcast signal (at least a video signal) and supplies it to the decoder 242. The decoder 242 decodes the supplied video signal and supplies it to the program ID information extraction unit 243.

  In step S42, the program ID information extraction unit 243 extracts a program ID, which is program-specific information for recognizing the program, from the program management information included in the supplied video data, and generates the program ID as a metadata generation unit. The decoded video data is supplied to the display selection subtitle data decoder 245.

  In step S43, the display selection subtitle data decoder 245 extracts and decodes the display selection subtitle data from the supplied video data, and supplies it to the display selection subtitle data analysis unit 246.

  In step S44, the display selection subtitle data analysis unit 246 analyzes text data corresponding to the display selection subtitle data, and determines a predetermined length (for example, a predetermined number of characters displayed at a time when display is selected, It is divided into a text group of a length that can be read by the user in a predetermined time) and supplied to the time code association processing unit 247.

  In step S <b> 45, the time code association processing unit 247 associates the time codes of the start time and the end time with the supplied text group, and supplies them to the metadata generation unit 244.

  In step S46, the metadata generation unit 244 associates the program ID supplied from the program ID information extraction unit 243 with the text data group with the time code supplied from the time code association processing unit 247, so that FIG. The metadata 261 described using the above is created and supplied to the encryption processing unit 249.

  In step S 47, the encryption processing unit 249 encrypts the supplied metadata 261 using the key corresponding to the program ID stored in the encryption key storage unit 250 and supplies the encrypted metadata 261 to the metadata storage unit 251. .

  In step S48, the metadata storage unit 251 stores the encrypted metadata 261, and the process ends.

  By such processing, text data 265 corresponding to the display selection subtitle data, time code 266 corresponding to the text data, and metadata 261 composed of the program ID 267 are generated, encrypted and stored. The encrypted and stored metadata 261 is downloaded to the cradle 2 owned by the user by a process described later.

  In the process of FIG. 17 also, when the program management information is not included in the video data, the program ID information extraction unit 243 can acquire the time information and generate the program ID information. good.

[About user registration]
Next, the user registration process executed by the authentication server 7 described with reference to FIGS. 13 and 14 will be described with reference to the flowchart of FIG.

  In step S <b> 61, the web page publication processing unit 301 publishes the web page for user registration stored in the page information storage unit 302 to the Internet 5.

  In step S62, the operation input information acquisition unit 304 determines whether or not a user registration request has been received from the cradle 2 or the mobile phone 3 held by the user or a personal computer or PDA (not shown) via the communication unit 303. to decide. If it is determined in step S62 that a user registration request has not been received, the process returns to step S61, and the subsequent processes are repeated.

  If it is determined in step S62 that the user registration request has been received, the operation input information acquisition unit 304 notifies the web page publication processing unit 301 that the user registration request has been received. Therefore, in step S63, the web page publication process is performed. The unit 301 transmits data corresponding to the user registration screen via the communication unit 303 and the Internet 5.

  In step S64, the operation input information acquisition unit 304 receives supply of user registration information including information related to a charging method such as a payment method and personal information such as a user's name and email address, and receives a user information registration processing unit. 305 is supplied.

  In step S <b> 65, the user information registration processing unit 305 supplies user registration information to the user information database 306 for storage. The user information database 306 stores the supplied user registration information.

  In step S66, the authentication processing unit 307 issues a user ID that can uniquely identify the user to the newly registered user, registers the user ID in the user information database 306, and sends the issued user ID to the communication unit. 303 and the data are transmitted via the Internet 5, and the process is terminated.

  Through such processing, user registration information is registered in the authentication server 7. The registered user registration information is used at the time of supplying a decryption key, which will be described later, and at the time of billing processing.

[Supplying metadata]
Next, the metadata supply processing executed by the metadata creation server 6 described with reference to FIGS. 10 and 11 will be described with reference to the flowchart of FIG.

  In step S <b> 81, the web page publication processing unit 254 publishes to the Internet 5 a web page stored in the page information storage unit 255 for a user to request metadata.

  In step S82, the metadata supply control unit 252 identifies the program identified by the predetermined program ID from the cradle 2 or the mobile phone 3 held by the user, or a personal computer or PDA (not shown) via the communication unit 253. It is determined whether or not a signal indicating an operation input for requesting metadata corresponding to is received. If it is determined in step S82 that a signal indicating an operation input requesting metadata is not received, the process returns to step S81, and the subsequent processes are repeated.

  If it is determined in step S82 that a signal indicating an operation input requesting metadata has been received, in step S83, the metadata supply control unit 252 transmits the encrypted metadata corresponding to the requested program. Then, the data is read out from the metadata storage unit 251 and transmitted to the device that issued the request via the communication unit 253 and the Internet 5, and the processing is terminated.

  Through such processing, the encrypted metadata is sent to the user device (for example, the cradle 2). The sent metadata is stored in the cradle 2, decrypted by a process described later, and used for the search process.

[Supplying decryption key]
Next, the decryption key supply control process executed by the authentication server 7 described with reference to FIGS. 13 and 14 will be described with reference to the flowchart of FIG.

  In step S <b> 101, the web page publication processing unit 301 publishes to the Internet 5 a web page for receiving a request for purchasing a decryption key for decrypting metadata stored in the page information storage unit 302.

  In step S <b> 102, the operation input information acquisition unit 304 determines whether an operation input requesting a decryption key has been received from a device (for example, the cradle 2) owned by the user via the communication unit 303. If it is determined in step S102 that an operation input requesting a decryption key has not been received, the process returns to step S101, and the subsequent processes are repeated.

  If it is determined in step S102 that an operation input requesting a decryption key has been received, the operation input information acquisition unit 304 notifies the authentication processing unit 307 that an operation input requesting a decryption key has been received. For example, the authentication processing unit 307 requests the device that has issued the request via the communication unit 303 to send the user ID and inquires about the user ID registered in the user information database 306. The authentication process is executed by, for example.

  In step S104, the key supply processing unit 308 determines whether the user who has performed the operation input requesting the decryption key has been correctly authenticated based on the result of the authentication processing supplied from the authentication processing unit 307.

  If it is determined in step S104 that authentication has been correctly performed, in step S105, the key supply processing unit 308 controls the charging processing unit 310 to input information input by the user, or the user information database 306 or the charging information database. Based on the information registered in 311, the settlement process is executed. Payment processing includes, for example, credit card payment and electronic money payment. The billing processing unit 310 executes a payment process using these general payment methods.

  In step S <b> 106, the key supply processing unit 308 determines whether or not the payment has been correctly completed based on the signal supplied from the charging processing unit 310.

  If it is determined in step S106 that the payment has been correctly completed, in step S107, the key supply processing unit 308 requests a decryption key request from the user supplied from the operation input information acquisition unit 304. The program ID of metadata corresponding to the decrypted key is acquired.

  In step S108, the key supply processing unit 308 reads the decryption key corresponding to the program ID from the decryption key storage unit 309, and transmits it to the user side via the communication unit 303 and the Internet 5. In step S <b> 109, the charging processing unit 310 registers the payment method, amount, or payment result selected by the user in the charging information database 311. The billing information database 311 stores the registered billing information, and the process ends.

  If it is determined in step S104 that the authentication has not been correctly performed, or if it is determined in step S106 that the payment has not been correctly completed, in step S110, the authentication processing unit 307 or the billing processing unit 310 causes the communication unit 303 to Then, an error message for notifying the user that the process has not been completed properly is output to the user via the Internet 5 and the process is terminated.

  Through such processing, a decryption key for decrypting the metadata is purchased by the user and transmitted to the cradle 2 owned by the user. This decryption key is used for decrypting metadata by a process described later. Further, since at least a part of the consideration obtained from the user by purchasing the decryption key is paid to the broadcasting station 1 that created the display selection subtitle data, the ratio of the program with the display selection subtitle added increases. Is predicted, and hearing-impaired persons can enjoy more programs.

  In FIG. 20, it has been described that the payment processing for charging when the user purchases the decryption key is executed for each transaction. However, the charging method when the user purchases the decryption key is as follows. For example, any method such as a monthly fee, an annual fee, or a fixed fee system may be used.

[About billing]
Here, the settlement process (billing process) executed in step S105 will be described with reference to the flowchart of FIG.

  In step S131, the billing processing unit 310 refers to the information registered in the billing information database 311 and generates billing information for the user who purchased the decryption key. Specifically, the billing processing unit 310 refers to information registered in the billing information database 311 for each financial institution (for example, credit card company, electronic money service provider, etc.) that performs settlement for each user. In addition, the billing information is generated by collecting the charges generated by the purchase of the decryption key.

  In step S132, the billing processing unit 210 executes billing processing for a predetermined financial institution or the like. Specifically, the billing processing unit 210 accesses, for example, a billing server (not shown) that executes a settlement process that is held by a financial institution such as a card company via the Internet 5 or a predetermined dedicated line, The user billing information generated in S131 is transmitted.

  In step S133, the billing processing unit 310 refers to the information registered in the billing information database 311 and calculates the number of decryption keys supplied to decrypt the metadata corresponding to the display selection subtitle data for each program. .

  In step S134, the billing processing unit 310 calculates the supply number of the decryption key for decrypting the metadata corresponding to the provided display selection subtitle data for each broadcasting station 1 based on the calculation result of step S133. .

  In step S135, the billing processing unit 310 calculates a payment amount for each broadcasting station based on the calculation result in step S134. Specifically, the billing processing unit 310 obtains profits (between the broadcasting station 1 and the service provider holding the authentication server 7) that the service provider holding the authentication server 7 obtains from the consideration of the decryption key obtained from the user. It is determined by the contract, and even if it is a predetermined amount, it may be a fraction of the consideration of the decryption key), and the amount is calculated as a payment amount for each broadcasting station.

  In step S136, the billing processing unit 310 executes a process of paying consideration to each broadcasting station based on the payment amount calculated by the process of step S135, and the process is terminated. Specifically, the billing processing unit 310 accesses a billing server (not shown) held by a financial institution (for example, a bank) designated by the broadcasting station 1 via the Internet 5 or a predetermined dedicated line, Information necessary for transferring the payment amount calculated in step S135 to the designated account is transmitted.

  With such a process, it is possible to perform a billing process for a fee for distributing a decryption key used for decrypting metadata. Further, since at least a part of the consideration obtained from the user by purchasing the decryption key is paid to the broadcasting station 1 that created the display selection subtitle data, the ratio of the program with the display selection subtitle added increases. Is predicted, and hearing-impaired persons can enjoy more programs.

[About metadata storage]
Next, a metadata storage process executed in the cradle 2 owned by the user will be described with reference to the flowchart of FIG.

  In step S151, metadata acquisition processing is executed. Here, the metadata acquisition process is executed in step S151, but may be executed at any timing as long as step S158 described later is executed.

  A program to be recorded is set in advance in the recorded data storage unit 57 in accordance with a user instruction, and the set program is stored in the recorded data storage unit 57 in accordance with the broadcast time of the program. While processing related to creation and storage of such recorded data is performed, processing for acquiring metadata is also performed. That is, the network interface 63 first accesses a web page published on the Internet 5.

  The network interface 63 transmits the program ID of the program for which recording is set, and acquires metadata 261 (FIG. 12) having the same ID as the program ID. The metadata received at this time is encrypted metadata. The received encrypted metadata is supplied to and stored in the encrypted metadata storage unit 64.

  Through such processing, encrypted metadata is downloaded from the metadata creation server 6.

  In step S152, the network interface 63 accesses a web page that is disclosed on the Internet 5 and for requesting the user to purchase a decryption key for decrypting metadata. Then, a signal requesting the purchase of a decryption key for decrypting the encrypted metadata designated by the program ID is transmitted to the authentication server 7 via the Internet 5.

  The network interface 63 receives from the authentication server 7 a command for causing the cradle 2 to transmit information necessary for authentication processing. In response to the command, the network interface 63 of the cradle 2 transmits information necessary for the authentication process to the authentication server 7 via the Internet 5 in step S153.

  The information necessary for the authentication process is, for example, a user ID. For example, the user ID may be stored in the cradle 2 at the time of user registration, and the stored user ID may be transmitted.

  In step S154, the network interface 63 determines whether or not the authentication has been correctly performed based on the signal supplied from the authentication server 7. If it is determined in step S154 that the authentication has been correctly performed, the network interface 63 transmits information necessary for the settlement process to the authentication server 7. The processing necessary for the settlement processing is, for example, a user ID or a password set in a contract with a financial institution or the like for designating a settlement method.

  These pieces of information are also held in the cradle 2 in advance, and the held information is read and transmitted. Alternatively, in this case, since the recording reservation is performed using the mobile phone 3, for example, a mechanism charged as a mobile fee may be provided. In the case of this embodiment, since processing such as recording reservation is performed using the mobile phone 3, the telephone number of the mobile phone 3 may be used as a password.

  The network interface 63 transmits information necessary for the payment process to the authentication server 7 via the Internet 5.

  In step S <b> 156, the network interface 63 determines whether or not the payment is correctly completed based on the signal supplied from the authentication server 7. If it is determined in step S156 that the payment has been correctly completed, in step S157, the network interface 63 receives the decryption key corresponding to the designated program ID from the authentication server 7 via the Internet 5, and decrypts it. This is supplied to the key storage unit 65.

  In step S158, the decryption key storage unit 65 stores the supplied decryption key in association with the program ID. In step S 159, the decryption processing unit 66 decrypts the encrypted metadata stored in the encrypted metadata storage unit 64 using the decryption key stored in the decryption key storage unit 65, and the metadata The data is supplied to the storage unit 67.

  In step S160, the metadata storage unit 67 stores the decrypted metadata, and the process ends.

  On the other hand, if it is determined in step S154 that the authentication has not been correctly performed, or if it is determined in step S156 that the payment has not been correctly completed, the network interface 63 authenticates via the Internet 5 in step S161. An error message is received from the server 7 indicating that the process has not been completed properly. The received error message is supplied to the mobile phone 3 when the mobile phone 3 is mounted on the cradle 2 and displayed on the display unit 104 (FIG. 8) of the mobile phone 3, for example, to the user. Be notified.

  Through such processing, the encrypted metadata is downloaded from the metadata creation server 6, the processing for purchasing the decryption key for decrypting the metadata is executed, and the decryption key is obtained from the authentication server 7. Therefore, the metadata is decrypted using this decryption key.

[About thumbnail image generation]
Next, the thumbnail generation process executed in the cradle 2 will be described with reference to the flowchart of FIG.

  In step S181, the thumbnail generation unit 68 acquires the metadata 261 stored in the metadata storage unit 67. In step S182, the thumbnail generation unit 68 retrieves the recording data corresponding to the program ID information 267 of the metadata 261 acquired in step S181 from the recording data storage unit 57 and acquires it.

  In step S183, the thumbnail generation unit 68 determines, for example, a time corresponding to the start time or a start time based on the start time of each text included in the time code 266 of the acquired metadata 261. A video at a predetermined time before or after is extracted frame by frame from the recorded data to obtain a thumbnail image.

  In step S184, the thumbnail generation unit 68 associates the corresponding time code and text data described in the time code 266 and the text data 265 with the thumbnail image generated in step S183, and generates thumbnail data.

  In step S185, the thumbnail generation unit 68 generates a thumbnail data file that can be uniquely distinguished by the program ID information 267 (FIG. 12) based on the thumbnail data generated in step S184. That is, the thumbnail generation unit 68 configures the same number of thumbnail data as the text group constituting the time code 266 by the thumbnail image, the time code, and the text data, and gives the program ID information 267 to these thumbnail data. , A thumbnail data file.

  In step S186, the thumbnail generation unit 68 outputs the generated thumbnail data file to the creation data storage unit 69 as creation data to be stored, and the process is terminated.

  By such processing, thumbnail data in which an image, text, and time code are associated is generated, and a thumbnail data file (creation data) is generated from the thumbnail data group of the same program.

[About supply of creation data]
The processing of the cradle 2 when supplying the creation data created by such processing and stored in the creation data storage unit 69 (FIG. 4) to the mobile phone 3 will be described with reference to the flowchart of FIG. .

  In step S201, the output data control unit 70 of the cradle 2 determines whether or not the mobile phone 3 is attached. This determination is made, for example, by providing a physical switch (not shown) that conducts when the mobile phone 3 is attached, and the output data control unit 70 receives a signal from the switch. Alternatively, the output data control unit 70 may monitor whether or not communication with the mobile phone 3 is possible, and may be performed according to the monitoring result.

  In step S201, the creation data supply process is in a standby state until it is determined that the mobile phone 3 is attached. If it is determined that the mobile phone 3 is attached, the process proceeds to step S202. In step S202, it is determined whether or not creation data is stored in the creation data storage unit 69.

  If it is determined in step S202 that the created data is stored in the created data storage unit 69, the process proceeds to step S203. In step S <b> 203, the output data control unit 70 reads the created data from the created data storage unit 69 and outputs it to the connected (attached) mobile phone 3.

  The creation data supplied (output) to the mobile phone 3 is deleted from the creation data storage unit 69.

  On the other hand, if it is determined in step S202 that the creation data is not stored in the creation data storage unit 69, the creation data supply process is terminated because there is no creation data to be supplied to the mobile phone 3.

  Thus, the creation data created and stored in the cradle 2 is supplied to the mobile phone 3.

[Processing related to display based on created data]
Next, processing based on creation data (processing related to thumbnail image and text display) performed in the mobile phone 3 will be described with reference to the flowcharts of FIGS.

  In step S221, the operation input unit 105 of the mobile phone 3 receives an input designating a thumbnail screen and a program desired to display text (or either) from the user. In step S222, the thumbnail screen display style is displayed. And inputs the input to the display selection subtitle data decoder 103.

  In step S223, the display selection subtitle data decoder 103 determines whether or not automatic update display is selected as the display style. Here, description will be made assuming that there are three display styles. Although the details will be described later, the three display styles are “automatic update display” in which the text corresponding to the thumbnail image is automatically updated without bothering the user, and it corresponds to the thumbnail image according to a user instruction. “Manual update display” in which the text to be updated is displayed, and “text display” in which only the text is displayed and the thumbnail image is displayed only when the user gives an instruction.

  If it is determined in step S223 that automatic update display has been instructed, the process proceeds to step S224, and display process 1 (automatic update display process) is started. The display process 1 performed in step S224 will be described later with reference to the flowchart of FIG. 26, and the description of the process of the flowchart of FIG.

  On the other hand, if it is determined in step S223 that automatic update display has not been instructed, the process proceeds to step S225 to determine whether manual update display has been instructed. If it is determined in step S225 that manual update display has been instructed, the process proceeds to step S226, and display process 2 (manual update display process) is started. The display process 2 performed in step S226 will be described later with reference to the flowchart of FIG.

  On the other hand, if it is determined in step S225 that manual update display is not instructed, the process proceeds to step S227. In this case, since it is determined that the text display has been instructed, the display process 3 (text display process) is started in step S227. The display process 3 performed in step S227 will be described later with reference to the flowchart of FIG.

  With reference to the flowchart of FIG. 26, display processing 1, that is, processing related to automatic update display will be described. In step S241, the display selection subtitle data decoder 103 reads, from the creation data storage unit 101, thumbnail image data of a program instructed to be reproduced by the user and text data corresponding to the thumbnail image.

  The display selection subtitle data decoder 103 reads the creation data corresponding to the program selected by the user from the creation data stored in the creation data storage unit 101, and thumbnails from the thumbnail screen data of the read creation data. An image is generated, text is generated from the text data, and the generated thumbnail image and text are displayed on the display unit 104.

  An example of the screen displayed on the display unit 104 in this way is shown in FIG. As shown in FIG. 29, the display unit 104 displays one thumbnail image and text corresponding to the thumbnail image. The example shown in FIG. 29 is a screen when creation data created based on the metadata 261 shown in FIG. 12 is selected, and “text 1” is displayed as text. A thumbnail image generated by referring to the time code 266 corresponding to the “text 1” is displayed.

  When the display selection subtitle data decoder 103 displays the thumbnail image and the text corresponding to the thumbnail image on the display unit 104, the display selection subtitle data decoder 103 determines whether or not a predetermined time has elapsed in step S242. The predetermined time is an average time for the user to finish reading all of the text displayed on the display unit 104. In step S242, the screen of the display unit 104 is maintained without being updated until it is determined that a predetermined time has elapsed. When it is determined that the predetermined time has elapsed, the process proceeds to step S243.

  In step S243, the display on the display unit 104 is switched to the next thumbnail image and text for the thumbnail image and text displayed on the display unit 104 at that time. For example, referring to the metadata 261 shown in FIG. 12, when a “text 1” and a thumbnail image corresponding to the “text 1” are displayed, if a predetermined time elapses, “text 2” is displayed. The display on the display unit 104 is switched to the thumbnail image corresponding to the “text 2”. An example of the screen of the display unit 104 after switching is shown in FIG.

  In this way, when the automatic update display is selected, the thumbnail image and the text are sequentially updated every predetermined time without bothering the user. The process related to the automatic update display shown in FIG. 26 is terminated as an interrupt process when the user instructs to stop the display of the created data (program playback). That is, the display selection subtitle data decoder 103 reads the created data from the created data storage unit 101 when it is determined that the instruction from the user input via the operation unit 105 instructs to stop the program reproduction. Is stopped, the display unit 104 is switched to a display (for example, a clock display) before starting the reproduction of the program, and the program reproduction process is terminated.

  It should be noted that a mechanism for setting the “predetermined time” in step S242 by the user may be provided.

  Next, display processing 2 performed in step S226 (FIG. 25), that is, processing related to manual update display will be described with reference to the flowchart of FIG. When the display on the display unit 104 is switched by a user operation, the basic process is the same as the process related to the automatic update display with reference to the flowchart of FIG. 26 except that the process in step S262 is different. Details of the processing in steps S261 and S263 are omitted.

  When the thumbnail image of the program instructed by the user and the text corresponding to the thumbnail image are displayed in step S261, it is determined in step S262 whether or not there has been an update instruction from the user. If the display selection subtitle data decoder 103 determines in step S262 that the instruction from the user input via the operation unit 105 is an instruction to update the thumbnail image (text update), the process proceeds to step S263. Processing proceeds.

  In step S263, the next thumbnail image and the text corresponding to the thumbnail image are displayed on the display unit 104.

  In this way, the thumbnail image and text are updated when the user gives an instruction. For example, when the screen shown in FIG. 29 is displayed on the display unit 104 and the user performs a predetermined operation for instructing the update on the operation unit 105, the screen as shown in FIG. The display is switched to. By doing so, it is possible to update at a timing desired by the user, so that, for example, the user can browse the thumbnail images and text that are of interest slowly and postpone the thumbnail images and text that are not of interest. .

  Next, the display process 3 performed in step S227, that is, the process related to text display will be described with reference to the flowchart of FIG. In step S281, the text of the designated program is displayed. In this case, the display selection subtitle data decoder 103 reads the creation data corresponding to the program instructed to be reproduced by the user from the creation data storage unit 10. Then, only the text data is extracted from the read creation data, and the text based on the extracted text data is displayed on the display unit 104.

  By executing the processing in step S281, for example, a screen as shown in FIG. 31 is displayed on the display unit 104. As shown in FIG. 31, only text is displayed on the display unit 104. In this way, displaying only text can be said to be an effective means in terms of improving the user-friendliness in an apparatus having a relatively small display area such as the mobile phone 3.

  Returning to the description of the flowchart of FIG. 28, when text is displayed on the display unit 104 in step S281, it is determined in step S282 whether an instruction to display a thumbnail image has been issued. Referring to FIG. 31 again, the display unit 104 also displays a cursor 351 on a text and one text (sentence) of the text. In the example shown in FIG. 31, the text where the cursor 351 is positioned is displayed in a state where black and white are reversed so that the text can be distinguished from other text.

  The user is configured to be able to move the cursor 351 in the vertical direction by operating the operation unit 105. By moving the cursor 351 in the vertical direction, the display is performed on the display unit 104 at that time. It is configured to be able to display unfinished text (scroll function). In addition, when an operation indicating the determination is performed, the display on the display unit 104 is switched to the thumbnail image associated with the text where the cursor 351 is located.

  Therefore, in step S282, the display selection subtitle data decoder 103 determines whether the information input by operating the operation unit 105 indicates an instruction to display a thumbnail image. If it is determined in step S282 that the input information is an instruction to display a thumbnail image, the process proceeds to step S283, and the specified thumbnail image is displayed on the display unit 104. For example, in the state where the screen shown in FIG. 31 is being displayed, if the user gives an instruction to display a thumbnail image, the display on the display unit 104 is switched to the thumbnail image display as shown in FIG. It is done.

  If the display selection subtitle data decoder 103 determines that the input information is an instruction to display a thumbnail image, the display selection subtitle data decoder 103 determines the text where the cursor 351 is located, and the thumbnail of the thumbnail image associated with the text. Data is read from the created data storage unit 101, an image based on the read thumbnail data is created and displayed on the display unit 104, thereby executing the processing in step S283.

  Thus, when the thumbnail image is displayed on the display unit 104, it is determined in step S284 whether or not an instruction to return to the display of the text has been issued. For example, as shown in FIG. 32, when the thumbnail image is displayed on the display unit 104, an instruction to return to the state where the text is displayed on the display unit 104 as shown in FIG. It is determined whether it has been issued.

  In step S284, the thumbnail image display state is maintained until it is determined that an instruction to return to text display is issued. If it is determined that an instruction to return to text display is issued, the process proceeds to step S285. Is advanced. The process to step S285 comes also when it is determined in step S282 that there is no instruction to display a thumbnail image.

  In step S285, the display selection subtitle data decoder 103 determines whether there is an instruction for the next text (whether there is an instruction for scrolling). In step 285, the process in step S285 is repeated until it is determined that there is a scroll instruction. That is, the state where the text currently displayed on the display unit 104 is displayed as it is is maintained.

  On the other hand, if it is determined in step S285 that a scroll instruction has been issued, in step S286, the next text (text positioned in the direction in which the cursor 351 is operated) is compared with the text displayed at that time. Display is performed. Such a process is stopped as an interrupt process when a stop instruction is issued from the user.

  Here, the text is described as being updated when the user gives an instruction. However, it is of course possible to automatically update the text as in display processing 1.

  By repeating such processing, the user can grasp the content of the program from the text and can browse only the thumbnail image of the text (content) in which he / she is interested.

  As described above, when providing a mechanism for displaying a text and displaying a thumbnail image when an instruction is given, the name (file name) of the thumbnail image itself can be made into text. This will be described with reference to FIG. In FIG. 33, it is assumed that the thumbnail image is stored as a JPEG file (extension is jpg).

  As shown in FIG. 33, the created data is, for example, ““ 7 o'clock news. ” jpg "," "The first topic today is about wheelchairs." jpg ”, that is, the created data includes a jpg file with the file name“ 7 o'clock news. ”Similarly,“ The first topic is about wheelchairs. It includes a jpg file with the file name “”.

  This file name is the text constituting the text data 265 when referring to the metadata 261 shown in FIG. Thus, for each text constituting the text data 265, the text itself is set as a file name, and a thumbnail image corresponding to the set text is associated as the actual state of the file and managed in the created data. .

  If only the file name portion of the created data is displayed in the order of the time code 266, a screen composed of text as shown in FIG. 31 can be displayed on the display unit 104.

  Further, as described above, when switching from a screen displaying only text to a thumbnail image screen desired by the user, if “file name = text” is set in this way, it is simply selected. It is only necessary to read out a JPEG file corresponding to the file name (text), and it is necessary to construct a new program for executing the processing (to reduce the man-hours for creating the program). Can be reduced). That is, it is only necessary to perform a commonly performed process such as reading predetermined information from a predetermined recording medium, and it is not necessary to prepare a special program (for example, develop a program such as an applet).

  Therefore, it is possible to realize the processing as described above at a low cost. In addition, it is possible to reduce the time required for a series of processes such as displaying thumbnail images from text.

  As described above, according to the present invention, a television broadcast program can be converted into thumbnail image data and text data. That is, a television broadcast program is composed of video data and audio data. According to the present invention, the video data is converted into thumbnail image data, and the audio data is converted into text data (subtitle data included in the video data). To be created). In other words, the present invention can convert a program composed of moving images and sound into a program composed of still images and text.

  The creation data (thumbnail image data file) composed of the thumbnail image data and the text data thus converted has a capacity smaller than the recording capacity when the broadcasted program is recorded as it is, so that it is a portable device. Therefore, even in an apparatus that can mount only a recording medium having a relatively small capacity, it is possible to browse a plurality of programs and long-time programs.

  Thus, according to the present invention, data composed of moving images and sound can be compressed into data composed of still images and text. By compressing, more program data can be recorded on a recording medium with a small capacity.

  In addition, when viewing a moving image, such as a television broadcast program, for example, one hour is required to view a one-hour program. It is considered that one hour is not necessary to view the program converted to. That is, by using the cradle 2 or the mobile phone 3 to which the present invention is applied, the user can grasp the contents of the program in a short time. Further, by using a portable device, viewing of the program can be limited by location.

  In the above-described embodiment, the mobile phone 3 has been described as an example. However, instead of the mobile phone 3, a portable device such as a PDA, a notebook personal computer, or a wristwatch can be used. Even when these devices are used, the processing performed in each device can be performed in the same manner as described above.

[About recording media]
The series of processes described above can also be executed by software. The software is a computer in which the program constituting the software is incorporated in dedicated hardware, or various functions can be executed by installing various programs, for example, a general-purpose personal computer For example, it is installed from a recording medium.

  As shown in FIG. 10 or FIG. 13, this recording medium is distributed to provide a program to the user separately from the computer, and a magnetic disk 221 (including a flexible disk) on which the program is recorded and an optical disk 222 are distributed. (Including CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc)), magneto-optical disc 223 (including MD (Mini-Disc) (trademark)), or semiconductor memory 224 Etc.

  Further, in the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but may be performed in parallel or It also includes processes that are executed individually.

  In the present specification, the term “system” represents the entire apparatus constituted by a plurality of apparatuses.

  Further, in this specification, even when a process executed by a part or all of a system configured by a plurality of apparatuses is realized by the process of the same information processing apparatus, However, it goes without saying that the present invention is applicable even when processing executed by one device is realized by processing of a plurality of information processing devices.

It is a figure for demonstrating the structure of one Embodiment of the information processing system to which this invention is applied. It is a figure for demonstrating the broadcast signal broadcast from a broadcasting station. It is a figure for demonstrating the movement of the data from a cradle to a mobile telephone. It is a figure which shows the internal structural example of a cradle. It is a figure for demonstrating the video recording data produced | generated by the display selection subtitle decoder. It is a figure which shows the other internal structural example of a cradle. It is a figure which shows the further another internal structural example of a cradle. It is a figure which shows the internal structural example of a mobile telephone. It is a figure which shows the other internal structural example of a mobile telephone. It is a block diagram for demonstrating the structure of a metadata production server. It is a functional block diagram for demonstrating the process which a metadata production server performs. It is a block diagram for demonstrating the metadata produced by a metadata production server. It is a block diagram for demonstrating the structure of an authentication server. It is a functional block diagram for demonstrating the process which an authentication server performs. It is a flowchart for demonstrating recording reservation It is a flowchart for demonstrating recording data creation processing. It is a flowchart for demonstrating metadata creation processing. It is a flowchart for demonstrating a user registration process. It is a flowchart for demonstrating a metadata supply process. It is a flowchart for demonstrating a decryption key supply control process. It is a flowchart for demonstrating an accounting process. It is a flowchart for demonstrating a metadata storage process. It is a flowchart for demonstrating a thumbnail production | generation process. It is a flowchart for demonstrating creation data supply processing. It is a flowchart for demonstrating the process based on creation data. 10 is a flowchart for explaining display processing 1; 10 is a flowchart for explaining display processing 2; 10 is a flowchart for explaining display processing 3; It is a figure which shows an example of the screen displayed on a display part. It is a figure which shows an example of the screen displayed on a display part. It is a figure which shows an example of the screen displayed on a display part. It is a figure which shows an example of the screen displayed on a display part. It is a figure for demonstrating a file name.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Broadcasting station 2 Cradle 3 Mobile phone 4 Telephone network 5 Internet 6 Metadata production server 7 Authentication server 8 Base station 15 Video data 16 Audio data 17 Display selection subtitle data 51 Input terminal 52 Tuner 53 Video signal decoder 54 Memory 55 Recording data generation Unit 56 Recording control unit 57 Recording data storage unit 58 Operation input unit 59 Telephone network input unit 60 Infrared input unit 61 Program ID information extraction unit 62 Timer 63 Network interface 64 Encrypted metadata storage unit 65 Decryption key storage unit 66 Decryption Processing unit 67 Metadata storage unit 68 Thumbnail generation unit 69 Creation data storage unit 70 Output data control unit 101 Creation data storage unit 102 Input data control unit 103 Display selection subtitle data decoder 104 Display unit 105 Operation unit 106 Input / output Unit 107 Telephone network input / output unit 108 Infrared input / output unit 109 Recording instruction unit

Claims (11)

A management means for managing data composed of moving images and sounds;
Metadata storage means for storing text data and metadata including at least time information corresponding to the text data;
Still image generation means for generating a still image from the data managed by the management means and metadata stored in the metadata storage means;
Associating means for associating the still image generated by the still image generating means with the text data with reference to the metadata;
An information processing apparatus comprising: a supply unit that supplies data including at least the still image and the text data associated by the association unit to another device. A management step for managing data composed of moving images and sounds;
A metadata storage control step for controlling storage of metadata including at least text data and time information corresponding to the text data;
A still image generation step of generating a still image from the data managed in the process of the management step and the metadata whose storage is controlled in the process of the metadata storage step;
Associating the still image generated in the processing of the still image with the text data with reference to the metadata;
An information processing method comprising: a supply control step of performing control for supplying data including at least the still image and the text data associated in the processing of the association step to another device. A management step for managing data composed of moving images and sounds;
A metadata storage control step for controlling storage of metadata including at least text data and time information corresponding to the text data;
A still image generation step of generating a still image from the data managed in the process of the management step and the metadata whose storage is controlled in the process of the metadata storage step;
Associating the still image generated in the processing of the still image with the text data with reference to the metadata;
A program causing a computer to execute a process including: a supply control step for performing control for supplying data including at least the text data and the still image associated in the process of the association step to the other device. . Data composed of moving image and audio, still image data generated from metadata including at least text data and time information corresponding to the text data, and data including at least text data associated with the still image Storage means for storing
An operation input means for receiving a user's operation input;
Display control means for controlling display of at least one of the still image and the text based on data stored in the storage means in response to the user's operation input input by the operation input means. An information processing apparatus characterized by that. The information processing apparatus according to claim 4, wherein the information processing apparatus is a portable apparatus. The display control means updates the still image or the text whose display is controlled every time a predetermined time elapses or every time a user gives an instruction. The information processing apparatus described in 1. The display control means controls to display only the text, and when the user selects a predetermined text from the text displayed by the control, the display is switched to a still image corresponding to the selected text. The information processing apparatus according to claim 4, wherein control is performed. 5. The information processing apparatus according to claim 4, wherein the still image data has a text indicated by the text data associated with the still image data set as a file name. The display control means performs control to display only the file name, and when the user selects a predetermined file name from the file names displayed by the control, the selected file name is set. The information processing apparatus according to claim 8, wherein control for switching display to a still image is performed. Data composed of moving image and audio, still image data generated from metadata including at least text data and time information corresponding to the text data, and data including at least text data associated with the still image A memory control step for controlling the memory of
An operation input step for accepting a user operation input;
A display for controlling display of at least one of the still image and the text based on the data whose storage is controlled by the processing of the storage step in accordance with the operation input of the user input by the processing of the operation input step An information processing method comprising: a control step. Data composed of moving image and audio, still image data generated from metadata including at least text data and time information corresponding to the text data, and data including at least text data associated with the still image A memory control step for controlling the memory of
An operation input step for accepting a user operation input;
A display for controlling display of at least one of the still image and the text based on the data whose storage is controlled by the processing of the storage step according to the operation input of the user input by the processing of the operation input step A program that causes a computer to execute a process including a control step.

Images