JP3723412B2 - Stream transmission / reception system, semantic information server, and accounting method in stream transmission / reception system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a video providing service system in a video distribution server and client in network broadcasting such as Internet broadcasting, or in a broadcasting device and receiving device in digital broadcasting.
[0002]
[Prior art]
Recent video providing service systems are moving from analog base to digital base, and with the development of MPEG-2 video compressed bitstream transmission system, multiple video can be transmitted simultaneously and received at the receiving side. By selecting one of these images, a variety of services that were not possible before are now possible.
[0003]
For example, in the field of television broadcasting, high-quality programs with hundreds of channels are provided, program reservation and viewing using EPG (electronic program), program-linked broadcasting, and realization of live programs with viewer participation through interactive broadcasting. It is possible.
[0004]
In the field of Internet broadcasting, video data is compressed by video encoding, and network distribution (broadcasting) and on-demand services are also realized.
[0005]
In addition, a system that combines various material contents such as stored video, audio, HTML, etc., and composes and expresses it as a single content has also been proposed. Each content can be reproduced and displayed in accordance with a predetermined scenario. It is possible to synthesize and to express more diverse than conventional content.
[0006]
[Problems to be solved by the invention]
However, there is a problem that is difficult to realize in the video providing service system used in the prior art. For example, regarding transmission and reception of live video, reservation of a program to be viewed can be realized relatively easily, but reservation of a scene to be viewed cannot be performed. For example, taking a sports live broadcast as an example, highlight scenes such as soccer goal scenes and baseball home run scenes cannot be selectively reserved. In order to watch these scenes without missing them, it is necessary to take a method of watching live broadcasts from the beginning to the end without changing the line of sight from the monitor screen, or recording them on storage media (VTR, etc.) once. There must be.
[0007]
In addition, broadcasting services that allow clients to use video information (including audio information) from video distribution servers on the Internet have already been put to practical use and are actively used. However, text information and audio related to the provided video, The provision of services that support the search of image information is still insufficient.
[0008]
As a method for providing video reference information, there is a method of providing information that adds value to the video by sending an information stream at the same time as the video, but the provided information can only be switched by a server, It is not a method of providing appropriate information to individual users.
[0009]
  The present invention has been made in view of the above-described problems. A video information service system capable of efficiently grasping the contents of live broadcast without losing the joy of live performance and selecting a desired scene, and video A new video information service system that handles video as hypermedia for individual usersTechnologyThe purpose is to provide.
[0010]
[Means for Solving the Problems]
  In order to achieve the above object, the present inventionWith related technologyIn the Internet broadcast, index IDs are embedded in advance in a bit stream composed of video information (including audio information) provided to a client from a video distribution server in advance or in real time, according to a time series. The client associates the index ID embedded in the user area of the bitstream with the semantic information table, decodes the meaning of the index ID, and sends a predetermined information link to the bitstream transmitted based on the semantic information. ProcessTheThe index ID here is information necessary for the client to link the semantic information, and may be a simple symbol string.
[0011]
  In addition, the present inventionWith related technologyIn the digital broadcast, an index ID is embedded in advance in a bit stream composed of video information (including audio information) broadcast from a broadcasting device to a receiving device in advance or in real time. The receiving device side associates the index ID embedded in the user area of the bit stream with the semantic information table, decodes the meaning of the index ID, and adds a predetermined bit stream to the bit stream transmitted based on the semantic information. Information link processingThe
[0012]
In the information linking method to the above stream, the video is treated as hypermedia by linking detailed information that describes the video with the embedded index ID and semantic information, and independently for each client (receiving device). Edit, search, and reuse processing can be performed.
[0013]
In the information link method to the above stream, the embedded index ID can be combined with the semantic information corresponding to the content of the video to provide a desired video to each client or each receiving device.
[0014]
Further, in the information link method to the stream, the index ID can be encrypted and embedded in the bit stream using a digital watermark technique.
[0015]
The stream transmission / reception system of the present invention provides a video indexer that embeds an index ID in a bit stream consisting of video and audio, a video distribution server that transmits the bit stream, and semantic information in network broadcasting such as Internet broadcasting. In a system comprising a semantic information server, a client that receives a bitstream, a video distribution server and a client, and a network that connects the semantic information server and the client, the video indexer includes a video input device that inputs a bitstream, An indexer that embeds an index ID in the bitstream, the video distribution server includes an encoder that compresses the video, and an information transmitter that transmits the encoded bitstream to the network, and the semantic information server includes: A semantic information database that stores semantic information associated with an index ID; and a transmitter that transmits the semantic information to the client via a network. The client includes a receiver that receives the bitstream transmitted to the network; A decoder that decodes the received bitstream, a display that displays the bitstream, an information manpower that downloads the semantic information from the semantic information server and stores it in the semantic information database in the device, and the decoded A semantic coupler for extracting an index ID embedded from the bit stream and decoding the meaning of the index ID with reference to the semantic information database; and an operation unit for controlling the display unit based on the decoding result. Features.
[0016]
Another stream transmission / reception system according to the present invention includes a video indexer that embeds an index ID in a bitstream composed of video and audio in wired and wireless digital broadcasting, a broadcasting device that transmits the bitstream, and a receiving device that receives the bitstream. In the system comprising the semantic information server for providing the semantic information, a communication line for connecting the broadcasting device and the receiving device in a wired or wireless manner, and a network in which the semantic information server and the receiving device are connected, A video input device that inputs a stream; and an indexer that embeds an index ID in the bit stream, wherein the broadcasting device encodes a video, and a transmitter that sends the encoded bit stream to a communication line. And the semantic information server is associated with the index ID. A semantic information database for storing taste information; and a transmitter for transmitting semantic information to a client via a network. The receiving device receives the bit stream transmitted to a communication line; and decodes the bit stream. A decoder for displaying the information, a display for displaying the bit stream, an information input device for downloading the semantic information from the semantic information database of the semantic information server and storing it in the semantic information database in the own device, and the decoded bit stream A semantic coupler for extracting an embedded index ID from the semantic information database and deciphering the meaning of the index ID with reference to the semantic information database; and an operation unit for controlling the display unit based on the decoding result. To do.
[0017]
In the above stream transmission / reception system, the index ID may be encrypted using a digital watermark technique and embedded in the bitstream.
[0018]
The semantic information server in the stream transmission / reception system provides semantic information to be combined with the index ID embedded in the bitstream, or an application or encryption key that uses the index ID.
[0019]
As a charging method in the present system, a method of charging for the above semantic information and application program download can be used.
[0020]
In addition, the stream transmission / reception system can include a billing server that charges for downloading the semantic information and the application program. The accounting server includes an information receiver that receives accounting information from the semantic information server and a accounting information database that records accounting information when downloading semantic information, application programs, or encryption keys from the semantic information server to a client or a receiving device. With.
[0021]
In addition, the stream transmission / reception system includes a billing server that charges each time the application program is executed, and as a charging method, a method that charges each time the application program is executed can be used.
[0022]
According to the present invention, a user can efficiently view (collect information) a large amount of video information and audio information provided by digital compression or video compression technology such as MPEG2, and the provider side of these services can , The usage fee can be collected.
[0023]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0024]
FIG. 1 is a system configuration diagram of a first embodiment for transmitting and receiving a bit stream embedded with an index ID of the present invention in Internet broadcasting.
[0025]
This system includes a video indexer 101, a video distribution server 102, a semantic information server 104, a user client 103, a billing server 107, and networks 105, 106, 108, 109 connecting them. The networks 105, 106, 108, and 109 are, for example, the Internet or a telephone network, and these may all be the same. In this figure, one user client 103 is shown connected to the networks 105, 106, 108, and 109, but actually a plurality of user clients are connected to the network.
[0026]
The video indexer 101 includes a video input device 111 and an indexer 112. The video distribution server 102 includes an encoder 113 and a transmitter 114. The semantic information server 104 includes a semantic information database (DB) 122 and an information transmitter 123. The user client 103 includes a receiver 115, a decoder 116, an information input device 120, a semantic information database (DB) 121, a semantic coupler 117, an operating device 119, and a display 118. The billing server 107 includes an information receiver 124 and a billing information database (DB) 125.
[0027]
First, data processing in the video indexer 101 will be described. For example, a video captured by a video camera or a video stream generated by a video information database is input to the video input unit 111 of the video indexer 101, and an index ID is embedded in the input video stream in the indexer 112.
[0028]
FIG. 2 is an image diagram in which the index ID is embedded in the video stream in the indexer 112. That is, the original video stream 51 is converted by the indexer 112 into a video stream 52 with an index ID. The index ID can be embedded, for example, in the User area of the MPEG2 system (ISO / IECJTC1 / 13818-1). For example, index IDs corresponding to semantic information stored in the semantic information DB 122 of the semantic information server 104, such as cut points, camera angles, telops, and status changes, are embedded. The index ID here is a tag that can be connected to index information having some meaning, for example, an index ID corresponding to the Nth frame of the video = I_NMay be simply symbol information such as embedded in the form of a correspondence table.
[0029]
Also, the index ID may be embedded along the time series of the video stream, such as the index ID being embedded in the user data of the sequence header in MPEG2 video (ISO / IECJTC1 / 13818-2). Further, when the index ID is embedded, the embedded data is encrypted and embedded in the video itself, thereby preventing the tampering and misuse of the embedded data.
[0030]
The video stream in which the index ID is embedded is encoded by the encoder 113, and the encoded video stream is sent to the network 105 via the transmitter 114.
[0031]
In the user client 103 connected to the network 105, the receiver 115 receives the video stream with the index, the decoder 116 decodes the video stream, and extracts the index ID from the video stream (with digital watermark technology). If it has been encrypted by use, it is extracted after a predetermined restoration process), and the extracted index ID is input to the semantic coupler 117. The video stream is input to the display 118.
[0032]
On the other hand, the user client 103 accesses the semantic information server 104 connected to the network 106, and transmits the data in the semantic information DB 122 in the semantic information server 104 via the information transmitter 123 to the information input device 120 of the user client 103. And downloaded to the semantic information DB 121 in the user client 103. When this semantic information is downloaded, the access information is transmitted from the semantic information server 104 to the information receiver 124 of the charging server 107, and the charging information DB 125 of the charging server manages the access history, thereby allowing the user client 103 to It is possible to charge. Payment is made by paying a fee using an electronic payment system on the Internet, for example.
[0033]
The semantic coupler 117 decodes the semantic information corresponding to the input index ID with reference to the data information in the semantic information DB 121 and displays the decoded semantic information on the display 118 together with the video.
[0034]
It is also possible to interact with the user and display the result using the semantic information input to the operation device 119.
[0035]
FIG. 3 shows a configuration example of a semantic information table stored in the semantic information DB 122 held by the semantic information server 104. The table configuration of the semantic information DB 121 in the user client 103 is the same. For example, as shown in FIG. 3, the semantic information table holds information such as an index ID, a range of a target frame in which the index ID is valid, semantic information, and an application program that uses the index ID. The index ID is a simple symbol string, but such a semantic information table uniquely associates the index ID with specific semantic information for each application program, and its meaning changes depending on the application program used. Each entry in the semantic information table may be considered to correspond to a conversion rule for converting an index ID into semantic information.
[0036]
FIG. 4 shows a configuration example of a billing information table stored in the billing information DB 125 held by the billing server 107. For example, as shown in FIG. 4, the charging information table stores an operation time (usage time) related to charging, a usage type, a usage application program, and a user ID for accounting. The usage type “download” means that the accounting information is transmitted from the semantic information server 104. The usage type “operation” means the billing information sent from the user client 103. By periodically referring to this billing information table, payment can be automatically made using an electronic payment system or the like.
[0037]
Since the system configuration is as described above, the client can not only view the video but also use it as interactive content in association with the semantic information and the index ID in the video. As a result, the following video information service becomes possible.
[0038]
FIG. 5 is a service image diagram using the index ID. For example, as in an application that is realized by “Multimedia Data Management Method and Device” disclosed in Japanese Patent Laid-Open No. 8-305720, text and music can be transmitted during broadcasting by linking detailed information describing video as semantic information. , Image and video related information can be handled as hypermedia linked by links.
[0039]
For example, when detailed information is described on a WWW (World Wide Web) page, the client downloads a URL (Uniform Resource Locator) corresponding to the index ID as semantic information. By changing the URL for each person when downloading, different information can be provided to each person in synchronization with the video. As a result, each client can obtain an explanation of the video independently.
[0040]
As shown in FIG. 5, when the URL for adults and the URL for children are made to correspond to IDs embedded as semantic information in accordance with the client's request, the related information browsing for adults and the related information browsing for children are respectively performed on the Internet. Can provide services to do. For example, when a client receives a video about a historical building (castle or temple), a detailed description of the building and information about the historical background of the period can be obtained by voice or text for adult use. It becomes possible to provide easy-to-understand explanations by animation and sound for children.
[0041]
Further, the index ID assigned to the video can be combined with the semantic information corresponding to the content of the video to display only the desired scene. For example, an application (LiveWatch) realized by “live video transmission / reception system, live video transmission device and reception device” disclosed in Japanese Patent Application No. 11-214582 can be downloaded from the semantic information server 104. At this time, if progress information in a baseball game, that is, information on the number of front and back sides, SBO (Strike Ball Out) information, etc. are embedded in the video in time series as an index ID (for example, “ID = 1 → one time table”). By using the LiveWatch application, the client can display the progress of the game with characters and graphics.
[0042]
Further, by using this index ID and semantic information corresponding to the index ID, an application can determine whether or not to show to the client user for each frame, and a scene the user wants to see can be displayed. At this time, instead of displaying the desired scene, it is possible to notify the user by flashing the screen or an alarm, so that the desired scene such as a hit or home run or a highlight scene is not missed.
[0043]
When the user uses the above-described application, it is possible to charge by uploading information that the user has used, that is, the usage status from the user client 103 to the charging server 107. The usage status may be uploaded immediately or stored in the user client 103 and collected by the billing server 107 after the end of program viewing or every period determined by the contract. If this method is used, it becomes possible to charge based on the usage time and usage frequency of the application.
[0044]
The same applies to multi-angle switching, in which the user client 103 downloads the switching application from the semantic information server 104 and automatically switches the live relay according to the semantic information corresponding to the index ID, or the client user switches. The index can be displayed with characters and images according to the video, and the user can enjoy a video full of realism according to his / her preference.
[0045]
FIG. 6 is a process flowchart of the user client 103. When the user client 103 downloads the semantic information from the semantic information server 104, when the application program used in the user client 103 is statically downloaded, the index in the video stream received from the video distribution server 102 is used. In some cases, the ID is dynamically downloaded to decrypt the ID.
[0046]
In the case of downloading static semantic information, when an application program is selected in accordance with an instruction from the user (step S1), the application name and user ID of the selected application program are transmitted to the semantic information server 104 to correspond to the application program. The semantic information is downloaded (step S2). The downloaded semantic information is held in the semantic information DB 121.
[0047]
In the case of dynamic semantic information download, the user client 103 extracts an index ID from the video stream with an index ID received from the video distribution server 102 (step S3), and extracts it into the semantic information table of the semantic information DB 121. It is determined whether or not the index ID has been registered, that is, whether or not there is a rule for converting the index ID into semantic information (step S4). If there is a conversion rule for the corresponding index ID, the process proceeds to step S6. When there is no corresponding index ID conversion rule in the semantic information table, the semantic information server 104 is requested to download the semantic information using the extracted index ID, application name, and user ID as parameters, and the semantic information corresponding to the index ID is displayed. Download (step S5). The downloaded semantic information is held in the semantic information DB 121.
[0048]
In step S6, the index ID is converted into semantic information with reference to the semantic information DB 121, and processing corresponding to the user's operation is performed on the semantic information (step S7). When there is a user operation, the usage time, application name, and user ID associated with the operation are transmitted to the accounting server 107 as accounting information (step S8). The above steps S3 to S8 are repeated until the reception of the video bitstream is completed or the user ends the use of the application.
[0049]
FIG. 7 is a processing flowchart of the semantic information server 104. The semantic information server 104 receives the application name and user ID, or information obtained by adding an index ID to the semantic information DB 122 when a semantic information download request is received from the user client 103, and refers to the semantic information DB 122 using them as parameters. Semantic information is searched (step S10). A semantic information table including the searched semantic information is transmitted to the requesting user client 103 (step S11). Thereafter, usage information for accounting including usage time, usage application name, and user ID is transmitted to the accounting server 107 (step S12). The semantic information server 104 downloads an application program that uses an embedded index ID in response to a request from the user client 103, and if the embedded index ID is encrypted, the semantic information server 104 decrypts the encryption key. It can also handle downloads.
[0050]
FIG. 8 is a processing flowchart of the accounting server 107. The accounting server 107 receives accounting information including usage time, usage application name, and user ID from the semantic information server 104 or the user client 103. It is determined whether the received billing information is from the semantic information server 104 or the user client 103 (step S20), and if it is from the semantic information server 104, FIG. The value set in the usage type of the charging information table shown is “download” (step S21). If it is from the user client 103, the value set in the usage type is “operation” (step S22). Thereafter, the information is stored and stored in the charging information table of the charging information DB 125 (step S23).
[0051]
FIG. 9 is a system configuration diagram according to the second embodiment of the stream transmission / reception system to which the present invention is applied. This shows a system configuration when an index ID is embedded in a bit stream broadcast from a broadcasting device to a receiving device in digital broadcasting.
[0052]
This system includes a video indexer 201, a broadcasting device 202, a receiving device 203, a semantic information server 204, a charging server 207, a communication line 205, and networks 206, 208, and 209. The communication line 205 is a line that transmits a broadcast wave from the broadcast apparatus 202 to the reception apparatus 203, and may be either wired or wireless. The networks 206, 208, and 209 are, for example, the Internet or a telephone network, and these may all be the same. In this figure, one receiving device 203 is shown connected to the communication line 205, but actually a plurality of receiving devices are connected to the communication line 205.
[0053]
The video indexer 201 includes a video input device 211 and an indexer 212. The broadcast device 202 includes an encoder 213 and a transmitter 214. The semantic information server 204 includes a semantic information database (DB) 222 and an information transmitter 223. The receiving device 203 includes a receiver 215, a decoder 216, an information input device 220, a semantic information database (DB) 221, a semantic coupler 217, an operating device 219, and a display device 218. The billing server 207 includes an information receiver 224 and a billing information database (DB) 225.
[0054]
For example, video / audio captured by a video camera or a video stream generated by a video information database is input to the video input unit 211 of the video indexer 201, and the input video stream is input to the semantic information DB 222 of the semantic information server 204 in the indexer 212. The index ID corresponding to the semantic information stored in is embedded. The embedding of the index ID is the same as the image of FIG. 2 of the first embodiment, and thus detailed description is omitted.
[0055]
The video stream in which the index ID is embedded is encoded by the encoder 213 of the broadcasting device 202, and the video stream is sent to the communication line 205 via the transmitter 214.
[0056]
In the receiving device 203 connected to the communication line 205, the receiver 215 receives the indexed video stream, the decoder 216 decodes the video stream, and extracts the index ID from the video stream (electronic watermark technology). If the data is encrypted using the above, it is extracted after a predetermined restoration process), and the extracted index ID is input to the semantic coupler 217. The video stream from which the index ID is removed is input to the display 218.
[0057]
On the other hand, the data in the semantic information DB 222 of the semantic information server 204 is taken into the information input device 220 of the receiving device 203 via the information transmitter 223 and downloaded to the semantic information DB 221 in the receiving device 203. When this semantic information is downloaded, the access information is transmitted from the semantic information server 204 to the information receiver 224 of the accounting server 207, and the accounting information DB 225 of the accounting server manages the access history so that the receiving device 203 It is possible to charge. Settlement is performed, for example, by paying a fee using an electronic settlement system on the Internet or a broadcast reception fee contract.
[0058]
The semantic coupler 217 decodes the semantic information corresponding to the input index ID with reference to the data information in the semantic information DB 221 and displays the decoded semantic information on the display 218 together with the video. It is also possible to interact with the user and display the result using the semantic information input to the operation device 219.
[0059]
Since the system configuration is as described above, the client can not only view the video but also use it as interactive content by associating the semantic information with the index ID in the video. As a result, the user can enjoy various services similar to those in FIG.
[0060]
Since the processing contents of the receiving device 203, the semantic information server 204, and the accounting server 207 are the same as those of the user client 103, the semantic information server 104, and the accounting server 107 in the first embodiment, the explanation using the processing flowchart is as follows. Omitted.
[0061]
【The invention's effect】
According to the present invention, when an index ID is embedded in a video stream by a video indexer serving as an input of the server or the broadcasting device and sent to all of the clients or the receiving device side, the timing of the index is sent in common. Information sent from the broadcasting device can be reduced. Furthermore, since the time position in the index video can be grasped on the client or the receiving device side based on the embedded index ID, the index information and the video can be synchronized, and advanced video and information link processing can be realized. In addition, by combining the semantic information required by each person on the client or the receiving device side with each index, each can use a different index independently. Furthermore, by encrypting and embedding the index ID using a digital watermark technique, it is possible to ensure the confidentiality of preferences and requests of clients and broadcast receivers. On the other hand, it is possible to charge when downloading semantic information from the semantic information server that provides the semantic information, the application or encryption key to the client or receiving device, and when using the application program on the client or receiving device. It becomes possible to do.
[Brief description of the drawings]
FIG. 1 is a system configuration diagram of a first embodiment of this invention.
FIG. 2 is an image diagram in which an index ID of the present invention is embedded in a video stream.
FIG. 3 is a diagram illustrating a table configuration example of a semantic information DB.
FIG. 4 is a diagram showing a table configuration example of a charging information DB.
FIG. 5 is a service image diagram using the index ID of the present invention.
FIG. 6 is a process flowchart of a user client.
FIG. 7 is a processing flowchart of a semantic information server.
FIG. 8 is a processing flowchart of a billing server.
FIG. 9 is a system configuration diagram of a second embodiment of the present invention;
[Explanation of symbols]
101 Video indexer
102 Video distribution server
103 User client
104 Semantic information server
105, 106, 108, 109 network
107 Billing server
111 Video input device
112 Indexer
113 Encoder
114 Transmitter
115 Receiver
116 Decoder
117 semantic coupler
118 Display
119 Controller
120 Information input device
121,122 Semantic information DB
123 Information transmitter
124 Information receiver
125 Billing information DB
51 video stream
52 Video stream with index ID
201 Video indexer
202 Broadcasting equipment
203 Receiver
204 Semantic information server
205 Communication line
206, 208, 209 network
207 Billing server
211 Video input device
212 Indexer
213 encoder
214 Transmitter
215 receiver
216 decoder
217 Semantic coupler
218 Display
219 Controller
220 Information input device
221 and 222 semantic information DB
223 Information transmitter
224 Information receiver
225 Accounting information DB

Claims (8)

A video indexer that embeds an index ID associated with predetermined semantic information in a bit stream of video information in network broadcasting such as Internet broadcasting;
A video distribution server for transmitting the bitstream;
A semantic information server that provides semantic information;
A client receiving the bitstream;
A system comprising the video distribution server and the client, and a network connecting the semantic information server and the client,
The video indexer includes video input means for inputting a bit stream, and an indexer for embedding the index ID in the input bit stream,
The video distribution server includes encoding means for compressing video, and information transmission means for sending the encoded bit stream to the network,
The semantic information server includes a semantic information database that stores semantic information linked to the index ID, and a transmission unit that transmits the semantic information to a client via a network.
The client includes receiving means for receiving the bit stream sent to the network, decoding means for decoding the encoded bit stream, display means for displaying the bit stream, and semantic information from the semantic information server. An information input means for downloading the ID, a semantic combining means for extracting the embedded index ID from the decoded bitstream and decoding the meaning of the index ID based on the downloaded semantic information, and A stream transmission / reception system comprising: an operation unit that controls the display unit. A video indexer that embeds an index ID associated with predetermined semantic information in a bit stream of video information in wired or wireless digital broadcasting;
A broadcasting device for transmitting the bitstream;
A receiving device for receiving the bitstream;
A semantic information server that provides semantic information;
A communication line for connecting the broadcasting device and the receiving device by wire or wirelessly;
A system comprising a network connecting the semantic information server and the receiving device,
The video indexer includes video input means for inputting a bit stream, and an indexer for embedding the index ID in the input bit stream,
The broadcasting device includes an encoding unit that encodes video, and a transmission unit that transmits the encoded bit stream to a communication line.
The semantic information server includes a semantic information database that stores semantic information linked to the index ID, and a transmission unit that transmits the semantic information to a client via a network.
The receiving device includes: a receiving unit that receives the bit stream sent to the communication line; a decoding unit that decodes the bit stream; a display unit that displays the bit stream; and a semantic information database of the semantic information server. Information input means for downloading semantic information, semantic coupling means for extracting an embedded index ID from the decoded bitstream and decoding the meaning of the index ID based on the downloaded semantic information, and based on the decoding result The stream transmission / reception system further comprising: an operation unit that controls the display unit. In the stream transmission / reception system according to claim 1 or 2 ,
The video indexer encrypts an index ID using a digital watermark technique and embeds it in a bit stream. A semantic information server in the stream transmission / reception system according to claim 1 or 2 ,
Meaning information server comprising means for downloading semantic information to be combined with the embedded index ID to the client or the receiving device via a network. A semantic information server in the stream transmission / reception system according to claim 1 or 2 ,
A semantic information server comprising means for causing the client or the receiving device to download an application program using the embedded index ID via a network. A semantic information server in the stream transmission / reception system according to claim 3 ,
A semantic information server comprising means for causing the client or the receiving device to download a key for decrypting the encrypted and embedded index ID via a network. Claim 4, semantic information from the semantic information server according to claim 5 or claim 6, when to download an application program or an encryption key, to charge for the client or the receiving equipment has requested the download Charging method in stream transmission / reception system characterized by 6. A charging method in a stream transmission / reception system, characterized in that, when the client or the receiving device uses the application program downloaded from the semantic information server according to claim 5 , the client or the receiving device is charged.

Images