JP4252324B2 - Receiver, broadcast transmission device, and auxiliary content server - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a receiver, a broadcast transmission device, and an auxiliary content server that constitute a content synchronous reproduction system that synchronously reproduces broadcast content received by broadcasting and auxiliary content received through a communication network other than broadcast.
[0002]
[Prior art]
In a conventional system, a URL is assigned to each CM (second content) stored in a CM storage device on a network, and a program (first content) broadcasted by a TV broadcasting device through a satellite digital broadcasting network is assigned to each CM (second content). Tag information for specifying the URL of a CM to be reproduced and output in association with the program is embedded. The TV commerce terminal specifies a URL based on tag information embedded in the received program, and acquires a CM to which the URL is assigned (for example, see Patent Document 1).
[0003]
[Patent Document 1]
Japanese Patent Laid-Open No. 2001-204005 (page 9 to page 16, FIG. 1)
[0004]
[Problems to be solved by the invention]
The conventional system as described above only inserts and reproduces the second content at the timing when the tag information indicating the second content is embedded in the first content broadcast on the broadcast wave. There is a problem in that the second content cannot be selectively reproduced by the reproduction start timing, the screen layout designation, the region or the user setting of the second content related to this content.
[0005]
The present invention has been made to solve the above-described problems. The purpose of the present invention is to select a playback content based on the playback start time and screen layout for the auxiliary content together with the broadcast content transmitted by broadcasting, and the selection of the auxiliary content based on the region and user settings. By including the function as the synchronous description information, a receiver, a broadcast transmission device, and an auxiliary content server are obtained that enable the broadcast content and the auxiliary content to be synchronized and reproduced at the timing intended by the broadcast station.
[0006]
[Means for Solving the Problems]
The receiver according to the present invention is: A broadcast wave receiving unit that receives a multiplexed stream in which broadcast content and synchronization description information are multiplexed and is transmitted by broadcast waves from a broadcast transmission device, and video, audio from the multiplexed stream received by the broadcast wave receiving unit And the attribute information received from the auxiliary content server by transmitting an instruction to acquire auxiliary content related to the broadcast content according to the synchronous description information separated by the broadcast wave separating unit Storing and outputting a reproduction start instruction for simultaneously reproducing the broadcast content and the auxiliary content related to the broadcast content based on the reproduction start time included in the synchronization description information while synchronizing, and The address described in the synchronization description information is transmitted through the network other than the broadcast wave according to the instruction of the synchronous playback control unit. The attribute acquisition request is transmitted to the auxiliary content server to acquire the attribute information of the auxiliary content related to the broadcast content, and when the attribute information is received, transmission of the auxiliary content related to the broadcast content is started. A request transmission unit that transmits a request; an auxiliary content reception unit that receives auxiliary content related to the broadcast content transmitted from the auxiliary content server through the network; and a video from the auxiliary content received by the auxiliary content reception unit; Auxiliary content separation unit that separates audio, and the video separated by the broadcast wave separation unit and the video separated by the auxiliary content separation unit are simultaneously played back while being synchronized by a playback start instruction from the synchronous playback control unit Combine and display in the video display An audio reproduction unit that simultaneously reproduces the audio separated by the broadcast wave separation unit and the audio separated by the auxiliary content separation unit while synchronizing with the reproduction start instruction from the synchronous reproduction control unit The synchronization description information includes an address of auxiliary content related to the broadcast content and a playback start time, and the multiplexed stream is a predetermined time before the beginning of the broadcast content and halfway through the broadcast content. The synchronization description information is multiplexed every certain period of time Is.
[0007]
DETAILED DESCRIPTION OF THE INVENTION
Embodiment 1 FIG.
A content synchronized playback system according to Embodiment 1 of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a configuration of a content synchronized playback system according to Embodiment 1 of the present invention.
[0008]
In the first embodiment, an explanation is given using an example in which a broadcast is transmitted by a broadcast wave from a broadcast station, but this is not necessarily the case, and the broadcast may be transmitted in another form.
[0009]
In FIG. 1, the present system is provided with a broadcast transmission device 101, a receiver 102, and an auxiliary content server 103. The receiver 102 is connected to the auxiliary content server 103 through a network 107 other than the broadcast wave 106. The data 104 flowing on the broadcast wave 106 is composed of broadcast content 109 and synchronization description information 110. Further, the auxiliary content information 105 includes auxiliary content 111 and the like.
[0010]
FIG. 7 is a diagram showing a basic configuration of the synchronous description information of the content synchronous reproduction system according to Embodiment 1 of the present invention.
[0011]
In FIG. 7, the synchronous description information 110 includes a content name 701, an address 702, and a reproduction start time 703.
[0012]
FIG. 8 is a diagram showing multiplexing of the synchronous description information and broadcast content in the content synchronous reproduction system according to Embodiment 1 of the present invention.
[0013]
In FIG. 8, 802 is synchronization description information, 803 is the audio of the broadcast content, 804 is the video of the broadcast content, and 805 is an empty TS packet.
[0014]
Next, the operation of the content synchronized playback system according to the first embodiment shown in FIG. 1 will be described with reference to the drawings.
[0015]
In the first embodiment, the broadcast content 109 and the auxiliary content 111 are examples of content (program) composed of video and audio data encoded in MPEG, and multiplexing is performed using MPEG-2TS (transport stream). The description will be given as being used.
[0016]
First, the auxiliary content server 103 creates auxiliary content 111 related to the broadcast content 109 broadcast by the broadcast transmission device 101, and transmits information related to the auxiliary content 111, that is, auxiliary content information 105 to the broadcast transmission device 101. . The transmission means is not particularly limited, such as transmission through a network or transmission through a storage medium.
[0017]
In the present embodiment, the auxiliary content server 103 generates the auxiliary content information 105 and transmits it to the broadcast transmission apparatus 101. However, for example, the auxiliary content 111 is created by the broadcast transmission apparatus 101 separately. The auxiliary content information 105 for creating the synchronization description information 110 inside the broadcast transmission apparatus 101 may not be necessary. This is because the broadcast transmission apparatus 101 manages the auxiliary content 111 in this case. The main role of the auxiliary content server 103 is not to transmit the auxiliary content information 105 but to transmit the auxiliary content 111 to the receiver 102 in accordance with the request of the receiver 102.
[0018]
The auxiliary content information 105 includes a server address, a file name 702, a reproduction start time 703, and the like for specifying the related broadcast content 109 and auxiliary content 111 on the network 107.
[0019]
The broadcast transmission apparatus 101 generates synchronization description information 110 based on the received auxiliary content information 105. The synchronization description information 110 includes the address 702 and the reproduction start time 703 of the auxiliary content 111 as shown in FIG. Note that the content name 701 shown in FIG. 7 is given for convenience of description, and may not be included in the actual synchronization description information 110.
[0020]
It is a feature of this system that the playback description time 703 is included in the synchronous description information 110, and the broadcast content 109 and the auxiliary content 111 can be synchronously played back by the receiver 102 using this. When the content is broadcast across dates, the reproduction start time is expressed as a time including 24 hours when the date is changed.
[0021]
The broadcast transmission apparatus 101 multiplexes the broadcast content 109 and the synchronization description information 110, and sends a stream (data) 104 in which the synchronization description information 110 and the broadcast content 109 are multiplexed on the broadcast wave 106.
[0022]
The receiver 102 receives and separates the multiplexed stream 104 by the broadcast wave 106, refers to the address 702 of the auxiliary content 111 included in the separated synchronization description information 110, and transmits the multiplexed content 104 to the auxiliary content 111 through the network 107 other than the broadcast wave. Access is made using an AV distribution control protocol such as RTSP, the auxiliary content 111 is obtained by streaming, and is simultaneously reproduced in synchronization with the broadcast content 109.
[0023]
However, the multiplexed stream 104 is multiplexed in the form as shown in FIG. 8, and only the synchronization description information 110 is sent several seconds before the start of broadcasting, so that sufficient time for the receiver 102 to acquire the auxiliary content 111 is secured. In addition, the auxiliary content 111 is buffered in the receiver 102, and when the reproduction start time 703 of the synchronous description information 110 is reached, the broadcast content 109 and the auxiliary content 111 are synchronized and reproduced simultaneously from the beginning of the program. Is possible.
[0024]
Further, the synchronization description information 110 is multiplexed and distributed at regular intervals even during the program as shown in FIG. This is because the broadcast sending apparatus 101 creates the synchronization description information 110 while adjusting the playback start time 703 according to the progress of the time at regular intervals, whereby the receiver 102 multiplexes from the middle of the program. Even when the reception of the stream 104 is started, the service of the auxiliary content 111 can be received.
[0025]
In order to establish synchronization, since the playback start time 703 of the synchronization description information 110 is used, the clocks of the broadcast transmission apparatus 101, the receiver 102, and the auxiliary content server 103 need to match. Are matched by using a radio clock or the like.
[0026]
FIG. 2 is a block diagram showing an internal configuration of the receiver in FIG.
[0027]
In FIG. 2, the receiver 102 includes an auxiliary content receiving unit 201, an auxiliary content separating unit 202, a broadcast wave receiving unit 203, a broadcast wave separating unit 204, a video composition unit 206, a synchronous reproduction control unit 207, An audio playback unit 208, a video display unit 209, and a request transmission unit 210 are configured. The broadcast wave separation unit 204 separates the synchronous description information 205 from the broadcast wave.
[0028]
FIG. 5 is a block diagram showing the internal configuration of the video composition unit in FIG.
[0029]
In FIG. 5, the video composition unit 206 includes an auxiliary content video decoder 501, a broadcast wave video decoder 502, and a composition unit 503.
[0030]
Further, FIG. 6 is a block diagram showing an internal configuration of the sound reproducing unit in FIG.
[0031]
In FIG. 6, the audio reproduction unit 208 includes an auxiliary content audio decoder 601, a broadcast wave audio decoder 602, a speaker 603, and an audio output control unit 604.
[0032]
Next, the operation of the receiver of the content synchronized playback system according to the first embodiment shown in FIG. 2 will be described with reference to the drawings.
[0033]
The receiver 102 receives the multiplexed description 104 of the synchronization description information 110 and the broadcast content 109 transmitted by the broadcast wave 106 by the broadcast wave reception unit 203, and the video / audio / synchronization description information by the broadcast wave separation unit 204. 205 and the like, which are sent to the video composition unit 206, the audio reproduction unit 208, and the synchronous reproduction control unit 207, respectively.
[0034]
The synchronized playback control unit 207 transmits an instruction to acquire the auxiliary content 111 to the request transmission unit 210 according to the synchronous description information 205 including the address 702 of the auxiliary content 111 and the playback start time 703.
[0035]
The request transmission unit 210 sends attribute information of the auxiliary content 111 to the auxiliary content server 103 based on the address 702 described in the synchronous description information 205 through the network 107 other than the broadcast wave according to the instruction of the synchronous reproduction control unit 207. Send an attribute acquisition request to acquire. Here, the auxiliary content attribute information is information including the encoding method, bit rate, total reproduction time, and the like of the auxiliary content 111.
[0036]
When receiving the attribute information from the auxiliary content server 103, the synchronized playback control unit 207 stores the content, and further transmits a transmission start request for the auxiliary content 111 to the auxiliary content server 103.
[0037]
The auxiliary content reception unit 201 receives the auxiliary content 111 transmitted from the auxiliary content server 103 and separates the auxiliary content 111 by the auxiliary content separation unit 202, and then the video is input to the video synthesis unit 206 and the audio is input to the audio reproduction unit 208.
[0038]
In the video composition unit 206, the video data from the auxiliary content separation unit 202 is input to the auxiliary content video decoder 501, and the video data from the broadcast wave separation unit 204 is input to the broadcast wave video decoder 502. After the auxiliary content video decoder 501 and the broadcast wave video decoder 502 convert the video formats to the video formats that can be output, the synthesizing unit 503 synthesizes them as videos and displays them on the video display unit 209.
[0039]
In the audio reproduction unit 208, the audio data from the auxiliary content separation unit 202 is input to the auxiliary content audio decoder 601, and the audio data from the broadcast wave separation unit 204 is input to the broadcast wave audio decoder 602. The outputs of both decoders are reproduced by a speaker 603 via an audio output control unit 604.
[0040]
However, since the playback start is controlled by the synchronized playback control unit 207, a playback start instruction is issued from the synchronized playback control unit 207 to the video synthesis unit 206 and the audio playback unit 208. Buffering is performed until an instruction to start playback is given. As described above, the auxiliary content 111 and the broadcast content 109 are simultaneously reproduced.
[0041]
FIG. 3 is a block diagram showing the internal configuration of the auxiliary content server in FIG.
[0042]
In FIG. 3, the auxiliary content server 103 includes an auxiliary content information table 301, an auxiliary content transmission unit 303, a request reception unit 304, and an auxiliary content attribute information table 305.
[0043]
Next, the operation of the auxiliary content server of the content synchronized playback system according to the first embodiment shown in FIG. 3 will be described with reference to the drawings.
[0044]
First, before the broadcast content 109 is broadcast from the broadcast transmission device 101, the auxiliary content server 103 needs to transmit the auxiliary content information 105 related to the auxiliary content 111 related to the broadcast content 109 to the broadcast transmission device 101. is there.
[0045]
The auxiliary content information 105 includes the address 702 and the reproduction start time 703 of the auxiliary content 111. The transmission method of the auxiliary content information 105 to the broadcast transmission apparatus 101 is not particularly limited.
[0046]
With reference to the auxiliary content information table 301, the auxiliary content information 105 is transmitted to the broadcast transmission apparatus 101.
[0047]
In addition, after the broadcast starts, an attribute acquisition request regarding the auxiliary content 111 from the receiver 102 is received through the network 107 other than the broadcast wave. The attribute information of the corresponding auxiliary content 111 is searched from the auxiliary content attribute information table 305 and transmitted to the receiver 102.
[0048]
Next, when the request reception unit 304 receives a transmission start request from the receiver 102, the auxiliary content transmission unit 303 transmits the auxiliary content 111 to the receiver 102 via the network 107 other than the broadcast wave.
[0049]
Here, the auxiliary content 111 is, for example, MPEG-2 Video encoded video converted to MPEG-2TS, or MPEG-2 Audio encoded audio converted to MPEG-2TS, and RTP (RTP ( It is delivered to the receiver 102 using Real-time Transport Protocol. Here, the auxiliary content 111 is assumed to store one video or audio in one TS.
[0050]
FIG. 4 is a block diagram showing the internal configuration of the broadcast transmission apparatus in FIG.
[0051]
In FIG. 4, the broadcast transmission apparatus 101 includes a synchronization description information production unit 401, a transmission unit 402, a multiplexing unit 404, and an auxiliary content information table 405.
[0052]
Next, the operation of the broadcast transmission apparatus of the content synchronous reproduction system according to Embodiment 1 shown in FIG. 4 will be described with reference to the drawings.
[0053]
First, the auxiliary content information 105 is acquired from the auxiliary content server 103 before the broadcast starts. The auxiliary content information 105 includes the address of the auxiliary content 111 related to the broadcast content 109 and the reproduction start time.
[0054]
The auxiliary content information 105 is received and stored in the auxiliary content information table 405. The auxiliary content information table 405 is a table in which addresses and reproduction start times of the auxiliary contents are registered.
[0055]
The synchronization description information production unit 401 refers to the auxiliary content information table 405 and creates the synchronization description information 110. The synchronization description information 110 includes the address 702 and the reproduction start time 703 of the auxiliary content 111 as shown in FIG. The content name 701 is only given for convenience of explanation, and may not be included in the actual synchronization description information 110.
[0056]
The multiplexing unit 404 multiplexes the broadcast content 109 and the synchronization description information 110, and the transmission unit 402 transmits the multiplexed stream 104 using the broadcast wave 106. Here, the broadcast content 109 includes, for example, MPEG-2 Video encoded video and MPEG-2 Audio encoded audio stored in a PES (Packetized Elementary Stream) format. And transmitted as broadcast content 109 by the transmission unit 402.
[0057]
FIG. 12 is a diagram showing the relationship between the broadcast content and auxiliary content time information of the content synchronized playback system according to the first embodiment.
[0058]
In FIG. 12, broadcast content (video) 1201, broadcast content (sound) 1202, and auxiliary content 1203 are shown from the top.
[0059]
FIG. 12 will be described. Both the broadcast content 109 and the auxiliary content 111 are one-hour content, and the reproduction starts at 14:00 and ends at 15:00. The time in FIG. 12 represents the time information of each part of each content 1201-1203. The broadcast content 109 and the auxiliary content 111 both have the same time information value for data reproduced at the same time.
[0060]
At this time, if both the broadcast content 109 and the auxiliary content 111 are MPEG-2 TS, it is the PTS that deserves this time information, and it is necessary to assign the PTS to the broadcast content 109 and the auxiliary content 111 as such. is there. Since the reproduction start time is described in the synchronization description information 110, and the clocks of the broadcast transmission device 101, the receiver 102, and the auxiliary content server 103 match, the broadcast content 109 and the auxiliary content 111 are synchronized. It becomes possible.
[0061]
As an example of the synchronization description information 110, FIG. 9 shows a description example in which SMIL is extended. FIG. 9 is a diagram of a basic configuration of the synchronous description information 110 obtained by extending SMIL, and an example in which the auxiliary content 111 is a sign language video of the broadcast content 109.
[0062]
9, the address of the auxiliary content server 103 is 192.168.0.1, and the file name of the auxiliary content 111 is Shuwa. ts. It is assumed that the content length of the broadcast content 109 and the auxiliary content 111 is one hour. Src of the synchronous description information 110 in FIG. 9 indicates the address 702 of the auxiliary content 111, and the playback start time 703 is described in begin. The video described immediately before src indicates that the auxiliary content 111 is a video.
[0063]
At this time, from 14:00 to 15:00, the auxiliary content 111 is reproduced in synchronization with the broadcast content 109 as a sign language video for explaining the broadcast content 109 as shown in FIG. FIG. 10 is a display example of the broadcast content 109 and the auxiliary content 111. In FIG. 10, 1001 is broadcast content (video), 1002 is a sign language video, and 1003 and 1004 are speakers for reproducing the broadcast content (sound).
[0064]
FIG. 13 is an example of synchronous description information when viewing from the middle of a program. For example, when viewing from the middle of the program (14:30), the synchronization description information 110 shown in FIG. 13 is transmitted in the multiplexed stream 104 several seconds before 14:30, so the reception of the auxiliary content 111 is immediately started. Then, with reference to the time information in FIG. 12, both the broadcast content 109 and the auxiliary content 111 can be started to be reproduced from 14:30 at the same time. As a result, the broadcast content 109 and the auxiliary content 111 can be synchronously reproduced in accordance with the reproduction start time 703 described in the synchronous description information 110.
[0065]
Next, an example in which a part of the content media is replaced with the auxiliary content 111 and played back will be described.
[0066]
The auxiliary content 111 is written in English, and the description of the audio content is replaced with the auxiliary content 111 without reproducing the audio of the broadcast content 109 in the synchronization description information 110. In this case, the video of the broadcast content 109 can be viewed with the English audio of the auxiliary content 111 as it is.
[0067]
An example of the synchronous description information 110 at this time is shown in FIG. In FIG. 42, 4201 is an address (identifier), and 4202 is synchronization description information. The address (identifier) 4201 describes an address in the case of the auxiliary content 111 and an identifier (Broadcast) indicating broadcast in the case of the broadcast content 109. The media of the broadcast content 109 that is not included in the synchronization description information 4202 is not reproduced.
[0068]
An example of the synchronous description information 110 obtained by extending SMIL at this time is shown in FIG. In the description of FIG. 14, src indicates the address of the auxiliary content 111 or the identifier (Broadcast) of the broadcast content 109. “Video” is broadcast content 109, but “audio” is described as auxiliary content 111. The address of the auxiliary content server 103 is 192.168.0.1, and the file name of the auxiliary content 111 is English. ts.
[0069]
As another example, in the case where the broadcast content 109 is a music program and music and a broadcast content 109 in which a mountain landscape flows as video, if the auxiliary content 111 is a sea landscape video, Next, a description is made that the video of the broadcast content 109 is not reproduced and the video is replaced with the auxiliary content 111. Then, it is possible to view the seascape of the auxiliary content 111 and the music of the broadcast content 109 in synchronization.
[0070]
A specific example of the synchronous description information 110 at this time is as shown in FIG. FIG. 15 shows an example of the synchronous description information 110 obtained by extending SMIL when the video of the broadcast content 109 is replaced with the auxiliary content 111. In the description of FIG. 15, the address of the auxiliary content server 103 is 192.168.0.1, and the file name of the auxiliary content 111 is Sea. ts. In FIG. 15, audio is described as broadcast content 109, and video is described as auxiliary content 111. Further, in the case of such music-based broadcast content 109, the auxiliary content 111 does not necessarily have to be a video, and for example, a still image that changes with a frequency of several seconds to several tens of seconds can be used.
[0071]
Accordingly, a part of media included in the broadcast content 109 can be replaced with the auxiliary content 111, and a user who can receive the auxiliary content 111 can view content different from the broadcast content 109.
[0072]
Next, an example in which the entire broadcast content 109 is replaced with the auxiliary content 111 for reproduction and an example in which the synchronization description information 110 includes the content reproduction end time will be described.
[0073]
When the playback end time of the auxiliary content 111 is described in the synchronous description information 110, the synchronous playback control unit 207 of the receiver 102 sends the request transmission unit 210 of the corresponding auxiliary content 111 at the timing of the playback end time. An end notification is given. The request transmission unit 210 transmits a transmission end request to the auxiliary content server 103 that is transmitting the content.
[0074]
The request receiving unit 304 of the auxiliary content server 103 that has received the transmission end request transmits a transmission stop command for the corresponding auxiliary content 111 to the auxiliary content transmitting unit 303. Thereby, the transmission of the auxiliary content 111 ends.
[0075]
On the receiver 102 side, when the playback end time has passed, even if the auxiliary content 111 has been transmitted, a playback stop command for the auxiliary content 111 is transmitted to the video synthesis unit 206 or the audio playback unit 208, and the auxiliary content 111 Stop playback. Similarly, when the reproduction end time of the broadcast content 109 is described in the synchronization description information 110, the synchronous reproduction control unit 207 performs the video synthesis unit 206 or the audio reproduction while receiving the broadcast content in the broadcast wave reception unit 203. The unit 208 is instructed to stop the reproduction of the broadcast content 109.
[0076]
If the auxiliary content 111 is a CM, a description is given in the synchronization description information 110 that the broadcast content 109 is not reproduced and replaced with the auxiliary content 111 at the time of the CM of the broadcast content 109. As a result, the CM of the broadcast content 109 can be replaced with the CM of the auxiliary content 111.
[0077]
An example of the synchronous description information 110 at this time is shown in FIG. FIG. 46 shows an example of the synchronization description information 110 including the reproduction end time, where 4601 is the reproduction end time and 4602 is the synchronization description information.
[0078]
FIG. 16 shows an example of the synchronous description information 110 obtained by extending SMIL when the CM of the broadcast content 109 is replaced with the CM of the auxiliary content 111. In the example of FIG. 16, the broadcast content 109 is reproduced from 14:00 to 14:29, the auxiliary content 111 is reproduced from 14:29 to 14:30, and the broadcast content 109 is reproduced from 14:30 to 15:00. This is synchronous description information 110 for reproduction. In the example of the synchronous description information 110 in FIG. 16, the reproduction end time 4601 is designated by end. When described as shown in FIG. 16, the CM video and audio can be replaced with the auxiliary content 111. The address of the auxiliary content server 103 is 192.168.0.1, and the file name of the auxiliary content 111 is CM_com.v. ts, CM audio is Comm_a. ts.
[0079]
In this example, a plurality of auxiliary contents 111 appear in the synchronization description information 110. FIG. 11 shows a system in which a plurality of auxiliary contents servers 103 exist, and such a form is also conceivable. In FIG. 11, a plurality of auxiliary content servers 1101 to 1103 are illustrated.
[0080]
Similarly, the replacement of the entire content can be realized even when the reproduction end time 4601 is not described in the synchronous description information 110. For example, if the auxiliary content 111 is a 10-minute content, and the description starts to play the auxiliary content 111 from 14:00 and starts to play the broadcast content 109 at 14:10, the first 10 minutes from the start of the broadcast The content 111 is reproduced, and after the auxiliary content 111 is finished, the broadcast content 109 is reproduced.
[0081]
Next, an example where the synchronization description information 110 includes an instruction to repeatedly reproduce the auxiliary content 111 will be described.
[0082]
When the repeated description is included in the synchronous description information 110, the synchronized playback control unit 207 realizes repeated playback by transmitting a playback start command of the auxiliary content 111 to be repeated to the request transmitting unit 210 at a repeated timing. .
[0083]
For example, if the auxiliary content 111 is a weather forecast content, the broadcast content 109 is designated such that the auxiliary content 111 is reproduced four times in succession, or the auxiliary content 111 is repeatedly reproduced until the broadcast content 109 ends. Repeat playback in a form dependent on the end of the operation is possible.
[0084]
FIG. 17 shows a specific example of the synchronous description information 110 in which SMIL is extended when such repeat reproduction depending on the end of the broadcast content 109 is performed. In FIG. 17, the address of the auxiliary content server 103 is 192.168.0.1, and the file name of the auxiliary content 111 is Weather. ts, which indicates weather forecast content with a playback time of about 1 minute or less. The broadcast content 109 is normally played back, and the auxiliary content 111 starts to be played on a part of the screen 5 minutes before the end. When the broadcast content 109 ends, the auxiliary content 111 also ends. In the description of FIG. 17, repeatCount = “indefinit” represents infinite repeats. By end = “15:00” at par, it means that all media sandwiched between the pars end at 15:00.
[0085]
Thereby, the creation of the synchronous description information 110 for repeatedly reproducing the auxiliary content 111 during the broadcast time of the broadcast content is saved.
[0086]
Next, a method for selective reception according to information set in the receiver 102 from two or more auxiliary contents 111 included in the synchronization description information 110 will be described.
[0087]
FIG. 18 is a diagram illustrating a configuration of a receiver 1803 in which a user setting table 1801 and a user setting receiving unit 1802 are added to the receiver 102 in FIG.
[0088]
FIG. 43 shows the synchronized playback control unit 207 in FIG. 2 in which the internal block is changed in response to the user setting, and the synchronized playback control unit 4303 in which the internal block is changed includes the user setting control unit 4301 and the playback. It includes a control unit 4302 and synchronization description information 4304 corresponding to user settings. Note that the synchronized playback control unit 207 in FIG. 2 includes only the playback control unit 4302, and a detailed block diagram is omitted.
[0089]
The operation of the receiver shown in FIG. 18 will be described. The user setting receiving unit 1802 receives user input and stores the user input result in the user setting table 1801. Then, the user setting table 1801 is input to the user setting control unit 4301 of the synchronous reproduction control unit 4303 shown in FIG. 43, the condition in the synchronous description information 205 is compared with the input user setting, and the matching part is determined. The synchronization description information 4304 corresponding to the user setting is extracted and input to the reproduction control unit 4302. The playback control unit 4302 requests the video synthesis unit 206 and the audio playback unit 208 to start playback and playback end, and requests the request transmission unit 210 to transmit an attribute acquisition request, a transmission start request, and the like of the auxiliary content 111. Has function. As described above, the auxiliary content 111 acquired by the user setting is automatically changed.
[0090]
For example, when “language” is listed as the user setting item, the user sets the language to be used in the receiver 1803 in the form of “English”, “French”, “Spanish”, “Japanese”. Then, as shown in FIG. 19, when the synchronization description information 4304 is described, the audio can be replaced with the user-set language by obtaining the user-set audio auxiliary content 111 without changing the video of the broadcast content 109. It becomes.
[0091]
FIG. 19 is a specific example of the synchronous description information 4304 obtained by extending SMIL when the sound of the broadcast content 109 is replaced by the user-set language setting. The auxiliary content server 103 has an address of 192.168.0.1, and there are three auxiliary content 111 files, all of which are audio files. Each name is English. ts, French. ts, Spanish. ts. In the part sandwiched between <switch></switch> in FIG. 19, the system language is checked in order from the top, and the content that matches the user setting of the receiver 1803 is requested as the auxiliary content 111. Further, SystemLanguage is represented by a two-letter code, en represents English, fr represents French, and es represents Spanish.
[0092]
As a result, the relationship between the user settings and the auxiliary content 111 actually acquired is as shown in FIG. FIG. 20 is a diagram showing the relationship between the user setting (language) 2001 and the received content 2002.
[0093]
Also, by inputting the user's age from the user setting accepting unit 1802 and accumulating it in the user setting table 1801, auxiliary contents that match the age when the age-specific conditional statements are described in the synchronous description information 205 111 can be received. As a result, for example, it is possible to replace the “extreme violence scene” included in the broadcast content 109 with another scene for younger viewers.
[0094]
Furthermore, by setting the location information of the region where the receiver 1803 is installed in the user setting table 1801 in advance, if the conditional statement for each region is described in the synchronization description information 205, it matches the region. It is possible to selectively receive the auxiliary content 111 that has been selected. Thereby, for example, part of the weather forecast content can be replaced with the auxiliary content 111 of the detailed weather forecast for each region.
[0095]
Further, by setting information related to the performance of the receiver 1803 in the user setting table 1801 in advance, when a conditional statement related to the performance of the receiver 1803 is described in the synchronization description information 205, the performance of the receiver 1803 is set. It is possible to selectively receive the auxiliary content 111 that matches the above. Thus, for example, a receiver capable of reproducing only the normal TV broadcast resolution uses the conditional statement of the synchronization description information 205 when the high-definition resolution content and the normal TV broadcast resolution content exist as the auxiliary content 111. Can be selectively received.
[0096]
Further, by setting a decoder information list of the receiver 1803 in the user setting table 1801 in advance, when a conditional statement regarding the content encoding method is described in the synchronization description information 205, the receiver It is possible to selectively receive the auxiliary content 111 that can be decoded by the decoder included in. Thus, for example, the auxiliary content 111 encoded with AMR and MPEG-4 Audio can be selected as the auxiliary content 111 in the synchronous description information, and the receiver 1803 can only use the MPEG-2 Audio and MPEG-4 Audio decoders as audio decoders. In the case of having it, it becomes possible to selectively receive content encoded with MPEG-4 Audio.
[0097]
As a result, the user can customize and view the broadcast content 109 in a format that matches the viewing conditions and preferences.
[0098]
Next, a method for selecting whether to receive the auxiliary content 111 according to the viewing fee will be described.
[0099]
As shown in FIG. 24, description will be made with an example in which the synchronous description information 110 is described. FIG. 24 shows the explanation video of the broadcast content 109 as the auxiliary content 111 for 5 minutes of 14:15 to 14:20 in the one-hour broadcast content 109. This is a specific example of the synchronous description information 110 that is an extension of SMIL, in which the receiver automatically selects and acquires one auxiliary content 111.
[0100]
The address of the auxiliary content server 103 is 192.168.0.1, three auxiliary contents 111 are set according to the viewing fee, and the file names are 384 k. ts, 256 k. ts, 128 k. ts. 384k. ts is 384 kbps, 256 k. ts is 256 kbps, 128 k. ts is the auxiliary content 111 of the video encoded at the encoding rate of 128 kbps, but SystemPrice represents the viewing fee condition, and the prices are 200 yen, 100 yen, and 50 yen, respectively. Among the three auxiliary contents 111, the auxiliary contents 111 having a price corresponding to the “billing” set by the user is selectively received.
[0101]
If the set amount is lower than 50 yen, the auxiliary content 111 is not received as shown in FIG. FIG. 25 is a correspondence table between the auxiliary content 111 to be received and the charge amount with respect to the user setting (charge).
[0102]
Thereby, the user can automatically view the auxiliary content 111 according to the budget.
[0103]
Next, a method for selecting the auxiliary content 111 according to the situation of the network 107 other than the broadcast wave will be described.
[0104]
FIG. 21 is a diagram illustrating a receiver 2102 in which the auxiliary content receiving unit 201 of the receiver 102 in FIG. 2 can calculate a packet discard rate for each predetermined period and transmit the packet discard rate to the synchronous reproduction control unit 4403.
[0105]
FIG. 44 is a block diagram showing the internal configuration of the synchronous playback control unit when selecting auxiliary content to be acquired according to the network status. In FIG. 44, a synchronized playback control unit 4403 includes a network status adaptive control unit 4401, a playback control unit 4402, and synchronization description information 4404 corresponding to the current network status.
[0106]
The operations of the receiver shown in FIG. 21 and the synchronized playback control unit shown in FIG. 44 will be described. In the synchronous description information 205, a correspondence relationship between a plurality of bit rate conditions and the auxiliary content 111 is shown. At the start of reproduction of the auxiliary content 111, the auxiliary content 111 to be received is determined based on the values set in the user setting table 2101, and reception starts in a normal procedure. Thereafter, considering an example in which the auxiliary content 111 transmitted to the auxiliary content receiving unit 201 uses RTP, the packet discard rate can be calculated from the sequence number of the received RTP packet.
[0107]
The auxiliary content receiving unit 201 inputs the discard rate for each fixed period to the network status adaptive control unit 4401 in the synchronous reproduction control unit 4403, compares the current packet discard rate with the past packet discard rate, A bit rate condition is selected, and synchronization description information 4404 corresponding to the current network status is input to the playback control unit 4402. The reproduction control unit 4402 performs an attribute acquisition and transmission start operation for the auxiliary content 111 having a new bit rate, and performs an operation for ending transmission of the auxiliary content 111 that is currently transmitted.
[0108]
Description will be made with an example in which the synchronous description information 4404 is described as shown in FIG. FIG. 22 shows a plurality of supplementary contents 111 corresponding to the current network status and a plurality of auxiliary contents 111 corresponding to the current network situation for 5 minutes of 14:15 to 14:20 in one hour of broadcast contents 109. In this example, the receiver 2102 automatically selects and adaptively acquires the auxiliary content 111, and the synchronization description information 4404 is an extension of SMIL.
[0109]
The auxiliary content server 103 has an address of 192.168.0.1, four auxiliary contents 111 are set according to the bit rate, and the file names are 384 k. ts, 256 k. ts, 128 k. ts, 64k. ts. systemBitrate represents the bit rate condition, and 384k. ts is 384 kbps, 256 k. ts is 256 kbps, 128 k. ts is 128 kbps, 64 k. ts is the auxiliary content 111 of the video encoded at the encoding rate of 64 kbps. Among the four auxiliary contents 111, the auxiliary contents 111 having a bit rate corresponding to the current network situation are selectively received.
[0110]
Assuming that the bit rate setting is 384 kbps in the user setting, at the start of reproduction of the auxiliary content 111 (14:15), as shown in FIG. The reception of ts is started. After that, by sequentially calculating the packet discard rate, for example, when the packet discard rate has increased, 384 k. ts is stopped, and 256 k. The reception of ts is started. In this way, it is possible to acquire the auxiliary content 111 with the encoding rate that adaptively matches the network situation.
[0111]
Thereby, the user can browse the auxiliary content 111 according to the network status even in a system in which the network status changes.
[0112]
Next, a method including layout information for designating a playback area on the screen of the broadcast content 109 and the auxiliary content 111 will be described.
[0113]
FIG. 45 is a diagram in which the internal block of the synchronized playback control unit 207 is changed to enable layout control. In FIG. 45, the synchronized playback control unit 4503 includes a layout control unit 4501 and a playback control unit 4502.
[0114]
The operation of the synchronized playback control unit 4503 shown in FIG. 45 will be described. In the synchronous description information 110, layout information regarding the broadcast content 109 and the auxiliary content 111 can be described. The layout information included in the synchronous description information 205 can be recognized by the synchronous playback control unit 4503 and transmitted to the synthesizing unit 503 in the video synthesizing unit 206, and the display position of the video output from the decoder can be synthesized according to the layout information. .
[0115]
Since the synchronization description information 205 includes a layout, the synchronization description information 205 is input to both the layout control unit 4501 and the playback control unit 4502, and the layout control unit 4501 instructs the video composition unit 206 to perform the layout.
[0116]
FIG. 26 shows an example in which the synchronous description information 110 including the layout information is described by the extension of SMIL. If described in this way, the sign language image arranged in the upper left in FIG. 10 can be arranged in the lower right part as shown in FIG.
[0117]
FIG. 27 shows an example of a playback screen when the layout information is included in the synchronization description information 110, 2711 is broadcast content (video), and 2712 is auxiliary content (sign language video).
[0118]
In the description of FIG. 26, layout information is described in a portion between <layout></layout>. The size of the entire area is set with the root-layout, and the id name, the vertical and horizontal widths, and the offset are set with the regions indicated by 2611 and 2612. A display area can be set in a region of 2613 and 2614 in an area to be displayed. The address of the auxiliary content server 103 is 192.168.0.1, and the file name of the auxiliary content 111 is Shuwa. ts.
[0119]
As a result, the user can browse the content arranged in a layout in which the broadcast content 109 and the auxiliary content 111 are easy to see.
[0120]
Embodiment 2. FIG.
A content synchronized playback system according to Embodiment 2 of the present invention will be described with reference to the drawings. FIG. 28 is a diagram showing a configuration of a content synchronized playback system according to Embodiment 2 of the present invention.
[0121]
In the second embodiment, a user registration, management, and billing method in the content synchronized playback system will be described.
[0122]
In FIG. 28, this system includes a broadcast transmission apparatus 101A, a receiver 102A, and an auxiliary content server 103A.
[0123]
In the present embodiment, user registration of the receiver 102A for browsing the auxiliary content 111 is required.
[0124]
First, a method for performing user management in the auxiliary content server 103A will be described.
[0125]
FIG. 29 is a block diagram showing the internal configuration of the receiver of the content synchronized playback system according to Embodiment 2 of the present invention.
[0126]
In FIG. 29, a receiver 102A is obtained by adding a user information input unit 2901 and user contract information 2902 to the receiver 102 shown in FIG.
[0127]
FIG. 31 is a block diagram showing the internal configuration of the auxiliary content server of the content synchronized playback system according to Embodiment 2 of the present invention.
[0128]
In FIG. 31, the auxiliary content server 103A is obtained by adding a user registration authentication unit 3101 and user management information 3102 to the auxiliary content server 103 shown in FIG.
[0129]
Next, the operation of the content synchronized playback system according to the second embodiment will be described with reference to the drawings.
[0130]
First, operations of the receiver 102A and the auxiliary content server 103A will be described.
[0131]
In order to perform user registration, the user inputs a user attribute and password including a name, address, age, telephone number, date of birth, and the like from a user information input unit 2901 in the receiver 102A. When the user finishes inputting the user attribute and password, the user information input unit 2901 transmits the user attribute information and the password to the auxiliary content server 103A through the network 107 other than the broadcast wave.
[0132]
When the auxiliary content server 103A receives the user attribute and password transmitted from the receiver 102A by the user registration authentication unit 3101, the auxiliary content server 103A acquires a new user ID, registers it in the user management information 3102, and receives it through the network 107 other than the broadcast wave. The user ID is transmitted to the machine 102A.
[0133]
The user information input unit 2901 in the receiver 102A receives the user ID and registers the registered address and password of the auxiliary content server 103A in the user contract information 2902.
[0134]
An example of the user contract information 2902 in the receiver 102A is shown in FIG. 30, and an example of the user management information 3102 in the auxiliary content server 103A is shown in FIG. Here, it is assumed that the valid flag stored at the top of the user management information 3102 shown in FIG. 32 is set to valid.
[0135]
A method of user authentication during browsing will be described. In the receiver 102A, the request transmission unit 210 retrieves the user ID and password of the corresponding auxiliary content server 103A from the user contract information 2902 at the time of the transmission start request for the auxiliary content 111, and through the network 107 other than the broadcast wave together with the transmission start request. Transmit to the auxiliary content server 103A.
[0136]
When the transmission start request is transmitted, the auxiliary content server 103A receives the transmission start request information by the user registration authentication unit 3101 and extracts the user ID and password, and then searches the user management information 3102. Thus, it is determined whether the user ID and the password are valid. If the result of the determination is that it is valid, the auxiliary content 111 is transmitted to the receiver 102A by transmitting the transmission start request information to the request receiving unit 304. If the request from the receiver 102A is not a transmission start request, the user registration authentication unit 3101 transfers the request to the request reception unit 304 as it is.
[0137]
Next, a method for performing user management in the broadcast transmission apparatus 101A will be described.
[0138]
FIG. 33 is a block diagram showing a detailed configuration of the broadcast transmission apparatus of the content synchronous reproduction system according to Embodiment 2 of the present invention.
[0139]
In FIG. 33, a broadcast transmission apparatus 101A is obtained by adding a user registration authentication unit 3301 and user management information 3302 to the broadcast transmission apparatus 101 shown in FIG.
[0140]
As in the case of the auxiliary content server 103A, the user registration transmits the user attribute and password from the receiver 102A to the broadcast transmission apparatus 101A, and when receiving the user ID, registers it in the user contract information 2902. Here, the server address column of the user contract information 2902 of the receiver 102A is unused.
[0141]
User authentication during browsing will be described. When a request to start transmission of the auxiliary content 111 is made, the request transmission unit 210 of the receiver 102A retrieves the user ID and password from the user contract information 2902 and transmits the user ID and password to the auxiliary content server 103A through the network 107 other than the broadcast wave together with the transmission start request. The user registration authentication unit 3101 in the auxiliary content server 103A receives the transmission start request information once.
[0142]
When user management is performed by the broadcast transmission apparatus 101A, the validity flag of the user management information 3102 of each auxiliary content server 103A is set to invalid. When the validity flag of the user management information 3102 is set to invalid, the user registration authentication unit 3101 sends the user ID and password received from the receiver 102A to the broadcast transmission apparatus 101A through the network 107 other than the broadcast wave. Send. If the request from the receiver 102A is other than the transmission start request, the user registration authentication unit 3101 transfers the request to the request reception unit 304 as it is.
[0143]
The user registration and authentication unit 3301 of the broadcast transmission apparatus 101A determines whether the transmitted user ID and password are valid by searching the user management information 3302 and determines the determination result through the network 107 other than the broadcast wave. Reply to the auxiliary content server 103A. The user management information 3302 of the broadcast transmission apparatus 101A is the same as that shown in FIG. The determination result is received by the user registration authentication unit 3101 of the auxiliary content server 103A. When the user ID and password are valid, the reproduction start request information is transmitted to the request reception unit 304, and the auxiliary content 111 is transmitted to the receiver 102A. Sent.
[0144]
In this manner, user registration and user authentication can be performed between the receiver 102A and the auxiliary content server 103A, and a system that distributes the auxiliary content 111 only to registered users can be realized.
[0145]
In addition, the user ID and password used for user authentication can be transmitted and received more safely by performing encryption during communication.
[0146]
Next, a charging method for using the auxiliary content 111 of each user will be described.
[0147]
First, a method of performing user registration for each content by the auxiliary content server 3403 and charging according to the viewing time will be described.
[0148]
FIG. 34 is a diagram showing an auxiliary content server 3403 in which a user billing unit 3401 and user billing information 3402 are added to the auxiliary content server 103A of FIG.
[0149]
FIG. 35 is a diagram illustrating a receiver 3502 in which a browsing content selection unit 3501 is added to the receiver 102A of FIG.
[0150]
User registration and billing for each content are performed as follows. After performing user registration with respect to the auxiliary content server 3403 as described above, the user inputs the address of the auxiliary content 111 to be browsed from the browse content selection unit 3501 of the receiver 3502. The browsing content selection unit 3501 searches the user contract information 2902 for a user ID and password corresponding to the auxiliary content server 3403, and transmits the auxiliary content name, user ID, and password to the auxiliary content server 3403.
[0151]
The user registration authentication unit 3101 of the auxiliary content server 3403 receives the auxiliary content address, user ID, and password transmitted from the receiver 3501, and performs user authentication. If the authentication is successful, the user ID and the auxiliary content name are transmitted to the user billing unit 3401. The user billing unit 3401 searches the auxiliary content information table 301 and registers the user ID and the auxiliary content address in the user billing information 3402 when the requested auxiliary content 111 exists.
[0152]
At the time of browsing the content, after user authentication, the user registration authentication unit 3101 transmits the requested user ID and auxiliary content name to the user billing unit 3401. This user billing unit 3401 confirms whether or not the auxiliary content name requested for transmission start and the user ID are registered in the user billing information 3402. If registered, a transmission start request is transmitted to the request reception unit 304 and auxiliary content transmission to the receiver 3502 is started. When the transmission of the auxiliary content ends, the auxiliary content transmission unit 303 transmits an end notification and a transmission time to the user billing unit 3401. When the end notification is transmitted, the user billing unit 3401 adds the viewing time to the viewing time of the user billing information 3402 and registers it.
[0153]
FIG. 36 shows user billing information 3402 in the auxiliary content server 3403. This makes it possible to charge for each content.
[0154]
Next, a method for performing user registration using the broadcast transmission apparatus 3703 and charging in a batch according to the viewing time will be described.
[0155]
FIG. 37 is a diagram showing a broadcast sending device 3703 in which a user billing unit 3701 and user billing information 3702 are added to the broadcast sending device 101A of FIG.
[0156]
User registration and collective billing in the broadcast transmission apparatus 3703 are performed as follows. Registration in the user management information 3302 and user billing information 3702 of the broadcast transmission device 3703 is performed in the same procedure as the user registration and billing for each content.
[0157]
When browsing content, user billing is performed as follows. When a request to start transmission of the auxiliary content 111 is made, the request transmission unit 210 of the receiver 3502 searches the user contract information 2902 for the user ID and password, and transmits the user ID and password to the auxiliary content server 3403 through the network 107 other than the broadcast wave. The user registration authentication unit 3101 in the auxiliary content server 3403 receives the transmission start request information once.
[0158]
When user management is performed by the broadcast transmission device 3703, the validity flag of the user management information 3102 of each auxiliary content server 3403 is set to invalid. When the validity flag of the user management information 3102 is set to invalid, the user registration authentication unit 3101 transmits the user ID and password received from the receiver 3502 to the broadcast transmission device 3703 through the network 107 other than the broadcast wave. To do.
[0159]
If the request from the receiver 3502 is other than a transmission start request, the user registration authentication unit 3101 transfers the request to the request reception unit 304 as it is. The user registration authentication unit 3301 of the broadcast transmission apparatus 3703 determines whether the transmitted user ID and password are valid by searching the user management information 3302. If the password is valid, the user registration authentication unit 3301 transmits the user ID and auxiliary content address requested to start transmission to the user billing unit 3701. The user billing unit 3701 determines whether or not the auxiliary content address requested to start transmission and the user ID are registered in the user billing information 3702. The determination result is transmitted to the auxiliary content server 3403 via the user registration authentication unit 3301. If the corresponding content has been registered, a transmission start request is transmitted from the user registration authentication unit 3101 of the auxiliary content server 3403 to the user billing unit 3401.
[0160]
When user authentication and billing are performed by the broadcast transmission device 3703, the valid flag of the user billing information 3402 is set to invalid, so a transmission start request is transmitted to the request reception unit 304 as it is and assistance to the receiver 3502 is performed. The content 111 transmission is started. When the transmission of the auxiliary content 111 is completed, the auxiliary content transmission unit 303 transmits an end notification and a transmission time to the user billing unit 3401. Since the billing is performed by the broadcast transmission device 3703, when the end notification is transmitted, the user ID, the auxiliary content server name, the auxiliary content name, and the transmission are transmitted to the user billing unit 3701 of the broadcast transmission device 3703 through the network 107 other than the broadcast. Send time. The user billing unit 3701 adds the transmission time to the viewing time in the corresponding column of the user billing information 3702.
[0161]
FIG. 38 shows user billing information 3702 in the broadcast transmission apparatus 3703. Since the billing information in the system is collectively managed in the user billing information 3702 of the broadcast transmission device 3703, the billing process is collectively performed by adding the viewing times of the same user ID in the user billing information 3702. This makes it possible to collect charges for the user in units of broadcast transmission devices.
[0162]
Embodiment 3 FIG.
A content synchronized playback system according to Embodiment 3 of the present invention will be described with reference to the drawings. FIG. 39 is a diagram showing a configuration of a content synchronized playback system according to Embodiment 3 of the present invention.
[0163]
In FIG. 39, this system includes a broadcast transmission apparatus 101B, a receiver 102B, an auxiliary content server 103, and broadcast content 104B.
[0164]
In the third embodiment, a description will be given of a method in which the synchronization description information 110 is embedded as digital watermark information in the broadcast content 109 and transmitted. In this embodiment, a method for embedding synchronization description information in a video of broadcast content will be described as an example.
[0165]
In this embodiment, since the synchronization description information 110 is embedded as a digital watermark in the video of the broadcast content 109, the data transmitted by the broadcast wave 106 is only the broadcast content 104B.
[0166]
FIG. 40 is a block diagram showing an internal configuration of the broadcast transmission apparatus of the content synchronous reproduction system according to Embodiment 3 of the present invention.
[0167]
In FIG. 40, a broadcast transmission apparatus 101B is obtained by adding a broadcast content (Baseband) 4001, a digital watermark embedding unit 4002, and an encoder 4003 to the broadcast transmission apparatus 101.
[0168]
In this embodiment, a method for embedding a digital watermark in broadcast content (video) will be described. Broadcast content (Baseband) 4001 is content before encoding, and in this embodiment, video and audio exist. The digital watermark embedding unit 4002 embeds the synchronization description information 110 as a digital watermark in the broadcast content (video). The broadcast content (video) in which the digital watermark is embedded is encoded by the encoder 4003 to generate the broadcast content 109. Note that the broadcast content (sound) does not embed a digital watermark, so the broadcast content 109 is generated directly by the encoder 4003.
[0169]
The multiplexing unit 404 multiplexes content (video) and content (sound), and the transmission unit 402 broadcasts the broadcast content 104 </ b> B using the broadcast wave 106. Note that the synchronous description information 110 that needs to be transmitted before the broadcast of the broadcast content 104B is embedded as a digital watermark in the final portion of the video of the broadcast content 104B that is being broadcast immediately before.
[0170]
FIG. 41 is a block diagram showing the internal configuration of the receiver of the content synchronous playback system according to Embodiment 3 of the present invention.
[0171]
In FIG. 41, the receiver 102B is obtained by replacing the video composition unit 206 of the receiver 102 in FIG. 2 with a digital watermark detection / video composition unit 206B.
[0172]
The broadcast content 104B transmitted by the broadcast transmission apparatus 101B is received by the broadcast wave receiving unit 203 of the receiver 102B. The video and audio multiplexed by the broadcast wave separation unit 204 are separated, and the audio is input to the audio reproduction unit 208 and the video is input to the digital watermark detection / video synthesis unit 206B. In the digital watermark detection / video synthesis unit 206B, the broadcast content (video) is decoded and then the digital watermark information is detected to acquire the synchronous description information 205, which is input to the synchronous reproduction control unit 207. Subsequent processing is the same as in the first embodiment.
[0173]
Note that the synchronization description information 110 that needs to be transmitted before the start of the broadcast content 104B is embedded as digital watermark information in the last part of the video of the broadcast content 104B that is broadcast immediately before, but the playback start time is clearly stated. Therefore, the auxiliary content 111 can be reproduced in synchronization with the associated broadcast content 104B.
[0174]
In this way, even when the synchronization description information 110 is embedded in the broadcast content 109 as a digital watermark and transmitted, the broadcast content 104B and the auxiliary content 111 can be reproduced in synchronization, and effective use of limited broadcast waves is possible. It becomes.
[0175]
【The invention's effect】
As described above, the receiver according to the present invention has an effect that the broadcast content and the auxiliary content can be synchronously reproduced at the timing intended by the broadcast station.
[Brief description of the drawings]
FIG. 1 is a diagram showing an overall configuration of a content synchronized playback system according to Embodiment 1 of the present invention.
FIG. 2 is a block diagram showing a configuration of a receiver of the content synchronized playback system according to the first embodiment of the present invention.
FIG. 3 is a block diagram showing a configuration of an auxiliary content server in the content synchronous playback system according to Embodiment 1 of the present invention.
FIG. 4 is a block diagram showing a configuration of a broadcast transmission apparatus of the content synchronous reproduction system according to Embodiment 1 of the present invention.
FIG. 5 is a block diagram showing a configuration of a video synthesizing unit of the receiver of the content synchronized playback system according to the first embodiment of the present invention.
FIG. 6 is a block diagram showing a configuration of an audio reproducing unit of the receiver of the content synchronous reproduction system according to the first embodiment of the present invention.
FIG. 7 is a diagram showing a structure of synchronization description information of the content synchronized playback system according to the first embodiment of the present invention.
FIG. 8 is a diagram showing a structure of a synchronized description information and a multiplexed stream of broadcast content in the content synchronized playback system according to the first embodiment of the present invention.
FIG. 9 is a diagram showing a basic configuration example of synchronous description information obtained by extending SMIL when the auxiliary content of the content synchronous reproduction system according to Embodiment 1 of the present invention is a sign language video of broadcast content.
FIG. 10 is a diagram showing a display example of broadcast content and auxiliary content of the content synchronized playback system according to the first embodiment of the present invention.
FIG. 11 is a diagram showing an overall configuration in which a plurality of auxiliary content servers exist in the content synchronous playback system according to Embodiment 1 of the present invention;
FIG. 12 is a diagram showing a relationship between time information of broadcast content and auxiliary content of the content synchronous reproduction system according to the first embodiment.
FIG. 13 is a diagram showing a configuration example of synchronous description information when viewing from the middle of a program of the content synchronous reproduction system according to Embodiment 1 of the present invention;
FIG. 14 is a diagram showing a configuration example of synchronous description information in a case where English audio of auxiliary content is reproduced without reproducing audio of broadcast content in the content synchronous reproduction system according to Embodiment 1 of the present invention.
FIG. 15 is a diagram showing a configuration example of synchronous description information when replacing broadcast content video with auxiliary content in the content synchronous reproduction system according to Embodiment 1 of the present invention;
FIG. 16 is a diagram showing a configuration example of synchronous description information when a CM of broadcast content in the content synchronous playback system according to Embodiment 1 of the present invention is replaced with a CM of auxiliary content.
FIG. 17 is a diagram showing a configuration example of synchronization description information when repeat reproduction is performed depending on the end of broadcast content in the content synchronous reproduction system according to Embodiment 1 of the present invention;
FIG. 18 is a block diagram showing a configuration of another receiver of the content synchronized playback system according to the first embodiment of the present invention.
FIG. 19 is a diagram showing a configuration example of synchronization description information in the case where the audio of broadcast content is replaced by the user-set language setting of the content synchronized playback system according to the first embodiment of the present invention.
FIG. 20 is a diagram showing a relationship between user settings (language) and received content in the content synchronized playback system according to the first embodiment of the present invention.
FIG. 21 is a block diagram showing a configuration of still another receiver of the content synchronized playback system according to the first embodiment of the present invention.
FIG. 22 is a diagram showing a configuration example of synchronous description information when an explanation video of broadcast content of the content synchronous reproduction system according to Embodiment 1 of the present invention is acquired from a plurality of auxiliary content according to a bit rate. is there.
FIG. 23 is a diagram showing a relationship between a user setting (bit rate) and initial received content in the content synchronous playback system according to Embodiment 1 of the present invention;
FIG. 24 is a diagram showing a configuration example of synchronous description information in the case where a commentary video of broadcast content of the content synchronous reproduction system according to Embodiment 1 of the present invention is acquired from a plurality of auxiliary content according to a viewing fee. is there.
FIG. 25 is a diagram showing a relationship between user settings (billing), received content, and billing amount in the content synchronized playback system according to the first embodiment of the present invention.
FIG. 26 is a diagram showing a configuration example of synchronization description information when layout information is included in the content synchronized playback system according to the first embodiment of the present invention.
FIG. 27 is a diagram showing another display example of the broadcast content and auxiliary content of the content synchronized playback system according to the first embodiment of the present invention.
FIG. 28 is a diagram showing an overall configuration of a content synchronized playback system according to Embodiment 2 of the present invention.
FIG. 29 is a block diagram showing a configuration of a receiver of the content synchronized playback system according to the second embodiment of the present invention.
FIG. 30 is a diagram showing a configuration of user contract information in the receiver of the content synchronized playback system according to the second embodiment of the present invention.
FIG. 31 is a block diagram showing a configuration of an auxiliary content server in the content synchronized playback system according to the second embodiment of the present invention.
FIG. 32 is a diagram showing a configuration of user management information in an auxiliary content server of the content synchronous playback system according to Embodiment 2 of the present invention.
FIG. 33 is a block diagram showing a configuration of a broadcast transmission device of the content synchronized playback system according to the second embodiment of the present invention.
FIG. 34 is a block diagram showing a configuration of another auxiliary content server of the content synchronized playback system according to the second embodiment of the present invention.
FIG. 35 is a block diagram showing a configuration of another receiver of the content synchronized playback system according to the second embodiment of the present invention.
FIG. 36 is a diagram showing a configuration of user billing information in another auxiliary content server of the content synchronized playback system according to the second embodiment of the present invention.
FIG. 37 is a block diagram showing a configuration of another broadcast transmission device of the content synchronized playback system according to the second embodiment of the present invention.
FIG. 38 is a diagram showing a structure of user billing information in another broadcast transmission device of the content synchronized playback system according to the second embodiment of the present invention.
FIG. 39 is a diagram showing an overall configuration of a content synchronized playback system according to Embodiment 3 of the present invention.
FIG. 40 is a block diagram showing a configuration of a broadcast transmission apparatus of a content synchronous reproduction system according to Embodiment 3 of the present invention.
FIG. 41 is a block diagram showing a configuration of a receiver of a content synchronized playback system according to Embodiment 3 of the present invention.
FIG. 42 is a diagram showing a structure of synchronous description information that replaces English audio of auxiliary content without reproducing audio of broadcast content in the content synchronous reproduction system according to Embodiment 1 of the present invention.
FIG. 43 is a block diagram showing a configuration of a synchronized playback control unit of another receiver of the content synchronized playback system according to Embodiment 1 of the present invention;
FIG. 44 is a block diagram showing a configuration of a synchronous playback control unit of still another receiver of the content synchronous playback system according to Embodiment 1 of the present invention.
FIG. 45 is a block diagram showing a configuration of a synchronous playback control unit of still another receiver of the content synchronous playback system according to Embodiment 1 of the present invention;
FIG. 46 is a diagram showing a structure of synchronous description information including a reproduction end time of the content synchronous reproduction system according to Embodiment 1 of the present invention.
[Explanation of symbols]
101, 101A, 101B Broadcast transmission device, 102, 102A, 102B Receiver, 103, 103A Auxiliary content server, 105 Auxiliary content information, 106 Broadcast wave, 107 Network, 109 Broadcast content, 110 Synchronization description information, 111 Auxiliary content, 201 Auxiliary content reception unit 202 Auxiliary content separation unit 203 Broadcast wave reception unit 204 Broadcast wave separation unit 206 Video synthesis unit 207 Synchronous playback control unit 208 Audio playback unit 209 Video display unit 210 Request transmission unit 301 Auxiliary content information table, 303 Auxiliary content transmission unit, 304 request reception unit, 305 Auxiliary content attribute information table, 401 synchronization description information production unit, 402 transmission unit, 404 multiplexing unit, 405 auxiliary content information table.

Claims (15)

A broadcast wave receiver that receives a multiplexed stream in which broadcast content and synchronization description information are multiplexed, transmitted by broadcast waves from a broadcast transmission device;
A broadcast wave separating unit that separates video, audio and synchronization description information from the multiplexed stream received by the broadcast wave receiving unit;
According to the synchronization description information separated by the broadcast wave separation unit, the attribute information received from the auxiliary content server by transmitting an auxiliary content acquisition instruction related to the broadcast content is stored, and the reproduction start time included in the synchronization description information A synchronous playback control unit that outputs a playback start instruction for simultaneously playing back broadcast content and auxiliary content related to the broadcast content while synchronizing,
In order to acquire attribute information of auxiliary content related to the broadcast content to the auxiliary content server based on the address described in the synchronous description information through a network other than the broadcast wave according to the instruction of the synchronous reproduction control unit A request transmission unit that transmits an attribute acquisition request and transmits a request to start transmission of auxiliary content related to the broadcast content upon receiving attribute information;
An auxiliary content receiving unit that receives auxiliary content related to the broadcast content transmitted from the auxiliary content server through the network;
An auxiliary content separator that separates video and audio from the auxiliary content received by the auxiliary content receiver;
The video separated by the broadcast wave separation unit and the video separated by the auxiliary content separation unit are simultaneously reproduced while being synchronized in accordance with a reproduction start instruction from the synchronous reproduction control unit, and displayed on the video display unit A synthesis unit;
An audio reproduction unit that simultaneously reproduces the audio separated by the broadcast wave separation unit and the audio separated by the auxiliary content separation unit while synchronizing with the reproduction start instruction from the synchronous reproduction control unit;
The synchronization description information includes an address of auxiliary content related to the broadcast content and a reproduction start time,
In the multiplexed stream, the synchronization description information is multiplexed for a predetermined time before the beginning of the broadcast content and for a certain period in the middle of the broadcast content . The synchronized playback control unit instructs the video synthesizing unit and the audio playback unit to replace and play a part of media included in the broadcast content with the auxiliary content based on the synchronization description information. The receiver according to claim 1. The said synchronous reproduction | regeneration control part instruct | indicates to the said image | video synthetic | combination part and the said audio | voice reproduction | regeneration part to replace and reproduce the whole of the said broadcast content by the said auxiliary content based on the said synchronous description information. Receiver. The receiver according to claim 1, 2, or 3, wherein the synchronization description information includes a playback end time of the auxiliary content. The receiver according to claim 1, 2, or 3, wherein the synchronization description information includes a description for instructing repeated reproduction of the auxiliary content. The receiver according to claim 1, 2 or 3, wherein the synchronized playback control unit selects from two or more auxiliary contents included in the synchronized description information according to information set by a user. 4. The receiver according to claim 1, wherein the synchronized playback control unit selects the two or more auxiliary contents included in the synchronized description information according to the state of the network. . The said synchronous reproduction | regeneration control part selects whether the said auxiliary content is received according to the viewing-and-listening charge for every said auxiliary content contained in the said synchronous description information. Receiver. The receiver according to claim 1, 2 or 3, wherein the synchronization description information includes layout information for designating a playback area on the screen of the broadcast content and the auxiliary content. When a user attribute and a password are input and transmitted to the auxiliary content server through the network and a user ID is received from the auxiliary content server, a user information input unit that registers the address and password of the auxiliary content server in the user contract information is further provided.
The receiver according to any one of claims 1 to 9, wherein the auxiliary content receiving unit receives the auxiliary content only when user registration is performed . The receiver according to claim 10, wherein the user registration is performed for each auxiliary content, and charging is performed according to a viewing time of the auxiliary content. The receiver according to claim 10, wherein the user registration is performed by the broadcast transmission device and is charged in a lump according to the viewing time of the auxiliary content. The receiver according to any one of claims 1 to 12, wherein the synchronization description information is embedded as a digital watermark in the broadcast content. An auxiliary content information table obtained by accumulating auxiliary content information from the auxiliary content server before broadcasting,
A synchronization description information production unit that creates synchronization description information with reference to the auxiliary content information table;
A multiplexing unit that multiplexes broadcast content and synchronization description information created by the synchronization description information production unit;
A transmission unit for transmitting the multiplexed stream multiplexed by the multiplexing unit by broadcast waves,
The auxiliary content information includes an address of auxiliary content related to the broadcast content and a reproduction start time,
In the auxiliary content information table, the address and reproduction start time of each auxiliary content are registered,
The synchronization description information includes an address of auxiliary content related to the broadcast content and a reproduction start time,
The broadcast transmission apparatus , wherein the multiplexed stream is multiplexed with the synchronization description information for a predetermined time before the beginning of the broadcast content and for a certain period in the middle of the broadcast content . When an attribute acquisition request regarding auxiliary content related to broadcast content is received from a receiver via a network other than the broadcast wave after the broadcast starts, the attribute information of the corresponding auxiliary content is searched from the auxiliary content attribute information table to the receiver. A request receiving unit that transmits a request to start transmission of auxiliary content related to the broadcast content from the receiver,
When a transmission start request is received by the request receiving unit, an auxiliary content transmitting unit that transmits auxiliary content related to the broadcast content to a receiver via a network other than broadcast waves,
Auxiliary content information related to the broadcast content is sent to the broadcast sending device with reference to the auxiliary content information table before the broadcast starts,
The auxiliary content server, wherein the auxiliary content information includes an address of auxiliary content related to the broadcast content and a reproduction start time .

Images