JP2003298541A - Digital broadcast interpolation method and digital broadcast reception system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technique for preventing momentary interruption of digital broadcasting. <P>SOLUTION: This invention predicts missing of digital data due to momentary interruption of a broadcast radio wave, acquires in advance digital data whose missing is expected beforehand through communication from a broadcast station or through a broadcast wave and a terminal stores the data. On the occurrence of missing, the terminal interpolates the missing data with interpolation data having been prepared in advance to prevent interruption of broadcast. In this case, the missing data estimate is not limited to prediction of complete missing of data but predicts a state of an expected danger with a margin. Thus, the data are quickly interpolated and provability of stopping video/audio output can be reduced due to unexpected rapid interruption of a digital radio wave. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a transmitter and a receiver of digital broadcasting, and more particularly to a technique for preventing instantaneous interruption of digital broadcasting.

[0002]

2. Description of the Related Art Conventionally, when a radio wave is interrupted and data cannot be received while receiving a digital broadcast, a "cliff
Sudden interruption of broadcasting called "effect"
The phenomenon may occur. Therefore, JP 2000-2
As disclosed in Japanese Patent No. 16848, it is detected whether or not discontinuity information is included in additional information in a transport stream received from another device via a digital interface, and the discontinuity information is detected. In this case, by capturing the additional information in the transport stream, the video data and audio data can be quickly decoded when the program input from the outside changes, and the decoded output is not interrupted. There is technology.

Further, according to the technique disclosed in Japanese Unexamined Patent Publication No. 10-243366, when a transmission data file by data broadcasting is interrupted due to non-arrival, the data file is transmitted using a radio wave from a broadcasting station. In addition, a data broadcasting system is described in which a transmission file list having auxiliary information including the file attribute of the data file is transmitted as a file different from the data file. A data broadcast receiving and displaying apparatus in this data broadcast system receives a data broadcast data receiving means for receiving a data broadcast including a data file and a transmission file list, a data file storing means for storing the received data as a file, respectively. File list extraction means for extracting a transmission file list from files, non-arrival file identification means for identifying non-arrival files from the transmission file list and received data files, and file attributes of the identified non-arrival files are determined. File attribute determination means, alternative data generation means for generating data including information that the non-arrival file has not arrived, and data generated by the alternative data generation means with the same file name as the non-arrival file To the data file storage means And a substitute file generation means for force. With this, it is possible to confirm the existence of the non-arrival data file and specify the file name. Also,
There is no need to display an error message separately and it does not get in the way. Furthermore, there is an effect that it is possible to avoid the problem that it takes a long time to display already received data and an error message by repeating the retry to retrieve the unarrival data.

[0004]

However, in the above-mentioned prior art, after the discontinuity information is detected, for example, when the video data becomes discontinuous, until the digital data is normally detected again. During that time, it continues to output the last normally output digital data. In this way,
The sound becomes unnatural to the viewer.

In both of the above-mentioned two prior arts, there is a processing time delay because it is detected that the broadcast data does not come, the alternative data is created, and the last normally output data is output. It is easy to occur and it is difficult to satisfy the real-time property. This time delay is not comfortable for viewers of digital broadcasting, and a method of complementing and outputting digital data in real time so that the viewer does not notice is desired.

[0006]

In order to solve the above-mentioned problems, the present invention predicts the loss of digital data in advance, and transmits the digital data expected to be lost in advance from a broadcasting station via communication or via broadcast waves. The data is stored in the terminal side, and the missing data is promptly complemented by the terminal side at the same time as the occurrence of the missing, thereby realizing an uninterrupted broadcast. The prediction of data loss at this time does not only predict the case where the data is completely lost, but also predicts a risky state with a margin. As a result, it is possible to provide a digital broadcast with less stress on the viewer, which can reduce the probability that the output of video and audio to the viewer is stopped due to an unexpected and sudden break of the broadcast radio wave.

[0007]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a schematic diagram of a digital broadcast complementary service system using the present invention. This digital broadcasting supplementary service system includes a mobile unit 1 represented by a content distribution station 101, a terrestrial digital broadcasting station 120, and a passenger car.
10. Consists of content data 150 broadcast using digital terrestrial broadcasting. In the following embodiments, the case of using terrestrial digital broadcasting as a broadcasting means from the content distribution station 101 to the mobile body 110 will be described. However, as will be described later, this is a communication satellite, a broadcasting satellite, or a bidirectional communication. It can also be applied to a service using a long elliptical orbit satellite capable of communication.

Next, the content distribution station 101 and the mobile unit 1
The configuration of the mobile's receiver terminal 201 installed in the No. 10 will be described. The content distribution station 101 includes a transmission device 1805 that transmits content on broadcast waves, an encoder 1807 that encodes the content, a content DB 1809 that stores the content to be broadcast, an encoded content that is to be broadcast, and various data. Encoded content DB 180 that multiplexes the data with a multiplexing device 514 (not shown)
6 and these functions are connected by one bus. The data stored in the encoded content DB 1809 is stored in the content distribution station 10 according to an instruction from a program management unit 252 (not shown) that manages the broadcast order of programs.
A radio wave is transmitted from 1 through the transmitting device 1805. The data transmitted from the content distribution station 101 using this radio wave as a medium is the antenna 180 of the mobile receiving terminal 200.
Received at 1. The mobile body receiving terminal 201 includes a radio wave receiver (RF receiver) 1802, a radio wave intensity monitoring device 1803 that periodically monitors the radio wave intensity, and a digital demodulator 180 that extracts digital data contained in the received radio wave.
4, a data complementing platform 1005, a decoder 1006, a video / graphics display device 2 for complementing the missing data when the extracted digital data is missing
16, a music reproducing unit (speaker) 217 is provided.

Next, referring to FIGS. 2 and 3, the digital broadcast complementing method in the first embodiment of the present invention will be described.
The concept and mechanism will be explained. The present embodiment is an example of realizing an uninterrupted digital broadcast targeting a terrestrial digital broadcast in which a 5.6 MHz band is divided into 13 segments as shown in FIG. Of the 13 segments, 10 segments are used for transmitting the high bit rate data 411, and 3 segments are used for transmitting the low bit rate data 412. On the side of the content distribution station 101 using this hierarchical transmission mechanism, content data of different qualities can be transmitted to the high bit rate data 41.
1 and the low bit rate data 412 are transmitted with a time shift (FIG. 2). The mobile unit 110 predicts in advance whether or not a loss will occur in received data while receiving a digital broadcast while moving, and acquires in advance data that is expected to be lost based on the prediction. . When the predicted data loss actually occurs, the data acquired in advance is used to promptly perform complementary processing,
Realize uninterrupted digital broadcasting for users.
Therefore, as shown in FIG. 2, the content data including the same content is set as high bit rate data 310 that is high quality content data and low bit rate data 320 that is low quality content data of lower quality.
The low bit rate data 320 is transmitted from the content distribution station so as to be stored in the terminal side by the time D represented by the time interval 330 first. Then, when content is reproduced with the currently received high bit rate data 310, if reception loss is expected to occur in the portion of the data indicated by 312, the low bit previously received is received. The portion 322 corresponding to the portion of the rate data 320 where the data loss is expected is stored in the data storage area in the terminal in advance, and the data can be promptly supplemented even if the data loss occurs at the corresponding portion. To be able to do it.

Next, a detailed description will be given of a configuration example of a computer system for realizing the above-mentioned uninterrupted digital broadcasting. First, the configuration of the content distribution station 101 will be described with reference to FIGS. FIG. 4 is a block diagram showing in detail the periphery of the encoder 1807 which is an element on the content distribution station side of the present invention. The encoder 1807 is
It includes a timer 511, a content transmission manager 512, and a content encoder 513. Further, the content sending manager 512 includes a data storage area 521 for storing the low bit rate encoded content and a data storage area 522 for storing the high bit rate encoded content. As shown in FIG. 5, the content encoder 513 includes a low bit rate encoder 601 that encodes content at a low bit rate and a high bit rate encoder 602 that encodes content at a high bit rate, and the content encoder 513 is encoded by each encoder. The content is stored in the low bit rate encoded content data storage area 521 and the high bit rate encoded content data storage area 522. In this embodiment, the high bit rate encoder 602 and the low bit rate encoder 601 are independently used, but the bit rate can be changed by changing the parameters at the time of encoding using the same encoder program or hardware device. It is also possible to change the contents to sequentially encode the high bit rate encoding and the low bit rate encoding of the content data. Particularly, when the encoding method by changing the parameters is used, it is suitable for encoding the offline content which does not require real-time property.

Next, the actual content encoding method will be described with reference to FIG. In the following, ISO / IEC international standard 13818-1 (hereinafter, referred to as “standardized as a method of transmitting digital contents on broadcast waves”)
A case where digital broadcasting is performed based on MPEG 2000 will be described. MPEG2000 uses a format called MPEG2-TS as a format for transmitting and receiving broadcast data. This is Sync_byte 701, transport_error_indicator, as shown in the transport stream 700 (hereinafter TS) shown in FIG.
702, payload_unit_start_indicator 703, transport_
priority 704, PID 705, transport_scrambling_contro
l 706, adaptation_field_control 707, continuity_co
This is a transmission method in which a set of data including fields of unter 708 and data_byte 709 is one unit. First, in order to realize uninterrupted digital broadcasting, it is necessary to attach a consistent serial number to this TS. However, although the PID and the value of continuity_counter can be used as an identifier for identifying each TS in the MPEG200 standard described above, since continuity_counter takes only a numerical value from 0 to 15, in particular, cont
Even if the value of inuity_counter changes from 4 to 6, there is no way to determine whether only one TS is missing or 17 TSs are missing during that time. Therefore, in order to reduce such uncertainties, in the present embodiment, co is added to the head portion of the data_byte field 709 corresponding to the payload (hereinafter, TS payload) 720 of the TS packet.
Two fields, unter_flag721 and sequential_counter722, are provided, and then data_byte_main 723
As, the data corresponding to the conventional data_byte is added. As a result, it becomes easy for the transmitting side to manage what kind of data is contained in which transport stream, and it becomes easy to perform indexing when performing data complement in the case of data loss.

Next, the procedure for encoding the content data by the content encoder 513 will be described with reference to FIG. FIG. 8 shows a processing procedure in the case of encoding content data in which real time property is not required to be encoded. First, process 8
01, the above sequential_count which is a serial number
Initialize er to 0. Next, the file of the content to be encoded is loaded from the content DB in process 802, and the T file according to the MPEG2000 standard described above is loaded.
In step 803, the content data is divided into a size that matches the size of the payload of the S packet. Next process 80
At 4, the counter_flag, which is an identifier for recognizing that the sequential_counter contains a serial number, is set to 1. Note that counter_flag takes a value of 0 or 1, and when 0 indicates that there is no serial number in the sequential_counter area, when 1 is included, sequential_cou
Indicates that the nter area contains a serial number. Process 8
After increasing the value of sequential_counter by 1 in 05, it is checked in step 806 whether the value of sequential_counter is smaller than a MAX value that is predetermined based on the size of the content. This MAX value is generally determined by the total data size of the content and the payload size. If the value of sequential_counter is smaller than the MAX value, counter_flag, sequential is found in processing 808.
Each value of al_counter and the data of the content file cut out in the process 803 are set in the TS packet,
A low bit rate encoder 601 or a high bit rate encoder 602 according to the encoding bit rate.
After being encoded in step S1, the content is stored in the low bit rate encoded content storage area 521 or the high bit rate encoded content storage area 522, respectively. If it becomes larger than the preset MAX value,
In process 807, the sequential_counter value is initialized. In this embodiment, the initial value is 0. Next, it is determined whether the content file to be encoded reaches the end 80
Check at 9. If it is not at the end, the process 803 and subsequent steps are repeated for the next part of the content, and if it is at the end of the content, the encoding is ended.

The content encoding method shown in FIG. 5 is a case where real-time processing is not required. on the other hand,
Content of digital broadcasting includes traffic jams and live broadcasting represented by sports relay. When encoding content represented by live broadcasting, real-time streaming distribution is difficult with the method shown in FIG. Therefore, as shown in FIG. 6, the content encoder 513 is provided with a buffer 603 (a remaining data amount that can be stored in the buffer is SZ) having a size that can temporarily store streaming data for about several seconds, and FIG. Encode streaming content according to the procedure shown in.

First, in processing 901, sequential_counter
The value of is initialized to 0. After that, the set buffer 60
3 is initialized to null in process 902. Next processing 903
Then, the stream file of the live broadcast transmitted from the live camera or the like via the network is taken into the content encoder 513. Next, in process 904, it is determined whether the stream file has ended. If the stream file ends here, that is, if the live broadcast ends, the encoding process ends. When the live broadcast is continuing, the remaining data amount SZ that can be stored in the payload buffer 603 of the TS packet shown in FIG. 6 and the size (SZST) of the captured stream file are compared in processing 905. . As a result of this comparison process, when SZ> SZST is determined in process 906, there is still room in the set buffer 603, and therefore the process returns to process 903 to read the streaming data again. Otherwise, the buffer 603 has no room, and therefore data corresponding to the amount of SZST accumulated in the buffer 603 is pushed out from the buffer in the order in which the data arrives first and passed to the content encoder 513 in step 907. Next, in process 908, the data of the stream file that is larger than the size of SZ in process 907 is stored in the file after the buffer is once cleared.

Then, in processing 909, sequential_counter
Is incremented by 1 and the value of counter_flag is set to 1, and then it is determined in step 910 whether the sequential_counter value is smaller than the preset MAX value. If it is determined to be small in process 910, process 9
At 12, the sequential_counter, counter_flag, and the encoded content are set in the TS packet. Process 9
If it is determined to be large in step 10, in process 911
After initializing the sequential_counter value, the process proceeds to step 912.

The description up to this point has been made on the side of transmitting contents. In the following, implementation of the mobile reception terminal 201 capable of displaying and reproducing data without interruption even when data loss having a sequential_counter value in the TS packet as described above is received and data loss due to momentary interruption occurs An example will be described.

First, the first embodiment will be described. As shown in FIG. 1, the mobile receiving terminal 201 includes an antenna 1801, an RF receiver 1802, and a radio wave intensity monitoring device 18.
03, digital demodulator 1804, data complementing platform 1005, decoder 1006, video / graphics display device 216, and music reproducing unit (speaker) 217. As the antenna 1801, a generally used parabolic antenna, Yagi antenna, diversity antenna, or the like is used. RF receiver 1802, digital demodulator 1804
Is a generally used broadcast receiving module and demodulator. As will be described later, the decoder 1006 is a device that acquires and converts desired data from encoded data such as video, audio, still images, character graphics, subtitles, map data, and navigation data. The received decoded broadcast data is connected by a signal line as shown in FIG. 1, and is output from a video / graphics display device 216 and a music reproducing unit (speaker) 217.

An example of the detailed configuration of the decoder 1006 is shown in FIG.
Shown in. The decoder 1006 distributes the data that has passed through the data complement platform 1005 to a desired decoding processing unit according to the above-mentioned MPEG2000 standard, based on each content identification ID. In this embodiment, AV decoding processing 1111,
The data is distributed to the decoding processing unit that performs the character / graphics still image decoding process 1112, the subtitle character superimposing process 1113, and the map decoding process 1114. Other than this, it is also possible to use a decoding processing unit that decodes point information (POI), traffic congestion information represented by binary data, alarms related to emergency information, and the like. The data decoded by each decoding processing unit is output to an output device such as a drawing plane suitable for the output device of the terminal. In this example, the speaker output unit 1116 and each plane of a moving image plane 1117, a still image plane 1118, a character / graphic plane 1119, a subtitle plane 1120, and a map screen plane 1121 are provided. Since information to be superimposed and output at the same time or information to be output independently is mixed in these planes, output switching of these information is manually performed in the video / still image switching 1115, or a data supplement platform. 100
After automatically determining based on the data input from 5, the screen switching information is determined by the video / still image / map screen switching plane 1122, and the screen is synthesized by the screen synthesizing device 1123. , To the graphic display device 216.

Next, the data complementing platform 1005
Will be described. Data complement platform 100
As shown in FIG. 10, 5 is a splitter 1201 for separating the data in which different bit rate data is multiplexed by the multiplexing device 514 of FIG. High bit rate data storage area 1202, a decoder cache 1203 for temporarily storing a necessary portion of contents encoded at a low bit rate for interpolation, a packet shortage determination unit 1204 for detecting a data defect, and a data defect When this is detected in 1204, the content merge unit 1205 that complements the missing data, and the low bit rate data storage area 1206 that temporarily stores the content encoded at the low bit rate. A data processing method on the side of a terminal that provides an uninterrupted broadcast to a viewer when data loss due to a momentary interruption occurs in a terminal having such a configuration will be described with reference to FIGS. 13 and 14.

FIG. 13 shows the relationship between the levels of radio field intensity defined in this embodiment. For the radio field intensity, a safe level Ps indicated by 1601, a caution level Pc indicated by 1602,
Three levels of danger level Pd indicated by 1603 are set. Of course, it is possible to set a finer grain level than this. Further, a solid line 1604 in FIG. 13 shows a change in radio field intensity. The relationship between the radio wave intensity and the reception state of the digital broadcast is that the safe level Ps can receive the digital broadcast without any problem and the caution level Pc can also receive the digital broadcast without any problem. However, at the above-mentioned caution level Pc, although the digital broadcast can be received without any trouble, if the received radio field intensity is greatly reduced at this level, the digital broadcast cannot be received. The danger level Pd means a level at which digital broadcasting cannot be received when the level reaches this level. In the present embodiment, the received radio wave intensity of digital broadcasting is 1605 or less,
In other words, when a caution level is reached, future data loss due to a momentary interruption is predicted, and in preparation for data loss, the data for supplementation is acquired in advance using the layered transmission mechanism. Is a way to keep.

A specific processing method will be described with reference to FIG. First, the data sent from the digital demodulation unit 1804 is separated into high bit rate data and low bit rate data by the splitter 1201 and stored in the high bit rate data storage area 1202 and the low bit rate data storage area 1206, respectively. Thereafter, the monitoring value of the radio wave intensity P observed by the radio wave intensity monitoring device 1003 is detected (process 1701). Then, it is checked whether or not the radio wave intensity P monitored in the process 1702 is in the dangerous area Pd. If it is not entered, the processing proceeds to processing 1703.
If this is not the case, it is expected that data loss due to instantaneous interruption of reception has already occurred or is likely to occur, so the complementing process 1307 (FIG. 12) is executed. Process 17
When it is not determined in 03 that the radio field intensity is within the caution area Pc, the process returns to the process 1701 and the process is repeated. If not, it is expected that data loss due to a momentary interruption will occur in the near future, and therefore the processing proceeds to the processing 1704 and thereafter.

In process 1704, the PID value (x0) and the sequential_counter value (y0) of the broadcast content being received are detected. Next, in processing 1705, the PID in the decoder cache 1203 is the above-mentioned x0, and sequ.
It is searched whether there is low bit rate content data in which the value of ential_counter is between y0 and y0 + N. Here, N is a preset offset value that takes into account the content processing time when a momentary interruption occurs, and is a value that is manually set when the software is installed in the terminal. Next, in process 1706, it is checked whether the data expected to be missing exists in the decoder cache 1203. If it does not exist,
In this embodiment, the data complementing process ends.

In the embodiment in which communication described later is combined, it is possible to acquire the insufficient content data via the mobile phone or the modem connected to the terminal here. If the data exists, it is checked in step 1707 whether or not it overlaps with the low bit rate data already existing in the decoder cache 1203.
Search based on sequential_counter value, sequential_c
Processing 1708 when there is data with overlapping ounter values
After clearing the decoder cache at, the retrieved data is stored. Otherwise, process 1709
Confirm that all the data to be stored in can be stored in the decoder cache. If it can be stored in the decoder cache, it is stored in processing 1711. Otherwise, it is sequential in processing 1710.
The required amount of data having the old value of _counter is deleted, and the data is stored in the free area. This is repeated until the end of the content data is reached or the power of the terminal is turned off.

Next, the complementing process 1307 will be described with reference to FIG. First, when data loss is detected, the processing 140
2, the sequencent corresponding to the missing TS packet
It is searched whether low bit rate data having al_counter exists in the decoder cache 1203. As a result of the search, if the existence is confirmed in the process 1403, the low bit rate data corresponding to the memory in the data complementing platform 1202 is loaded in the process 1404, and the above-mentioned sequential_counter and counter_flag are loaded.
After deleting the header information such as, the content data is taken out, and this content data is passed to the decoder in processing 1405.

If the presence of the data is not confirmed in the decoder cache in the process 1403, the data complementation by only the broadcast wave is not performed. In this case, as described in a fourth embodiment described later, the above-mentioned insufficient data will be acquired via communication.

As described above, in the first embodiment of the present invention, the missing of digital data is predicted based on the strength of the radio wave, and the complemented digital data is passed to the output device. It is possible to enjoy a comfortable broadcast without any discomfort.

Next, a second embodiment of the receiving terminal according to the present invention will be described. In the second embodiment, the loss of data due to a momentary interruption is detected by the sequential_count of TS packets.
Detected by discontinuity of er value. The receiving terminal is, as shown in FIG. 15, an antenna 1801, an RF receiver 1802, a digital demodulator 1804, and a data complementing platform 100.
5, a decoder 1006, a graphic display device 216, and a music reproducing unit (speaker) 217. Antenna 1001
Is a commonly used parabolic antenna, Yagi antenna, diversity antenna, or the like. RF180
2. The digital demodulator 1804 is a generally used broadcast receiving module and demodulator. Decoder 1006
As will be described later, is a device for obtaining and converting desired data from encoded data such as video, audio, still image, character graphic, subtitles, map data, and navigation data. The received broadcast data is output from the graphic display device 216 and the music reproducing unit (speaker) 217 connected by the signal line.

Next, with reference to FIGS. 16 and 17, the data processing method on the terminal side for providing a viewer with a continuous broadcast when data loss due to a momentary interruption occurs in the terminal having such a configuration will be described with reference to FIGS. It demonstrates using. In the second embodiment, as described above, the continuity of the sequential_counter values in the TS packets is judged to detect the data loss due to the momentary interruption. Therefore, in the initial state, the sequential_counter value before the temporary point is processed 1301. initialize. After that, the TS packet transmitted by broadcasting is acquired. At this time, the high bit rate data, that is, the data that is mainly viewed is stored in the high bit rate data storage area 1202 in the data complementing platform in FIG. 16 and is used for the normal complementing which is the low bit rate data. After the data is acquired by the splitter 1201, the data is stored in the low bit rate data storage area 1 in order to improve the access speed when complementing the data.
After being stored in 206, it is stored in the decoder cache 1203. If the data access speeds of the low-bit data area and the decoder cache are the same, it is possible to make 1203 and 1206 the same. Next, in process 1303, the PID is used to determine whether the program data has been sequentially switched from the data stored in the data storage area.
Get the value.

Next, in process 1304, the sequential_counter (i) value at the current time i added by the content distribution station is acquired from the payload portion of the TS packet. Here, the value of sequential_counter (i-1) obtained one time ago and
The values of sequential_counter (i) are compared and whether the difference is 1 is calculated in processing 1305. If the difference is not 1 in the process 1306, it means that a missing TS packet has occurred, so the data complement process is performed in the complement process 1307. The contents of the complementary processing 1307 are as described in the first embodiment. In the complementary processing 1307 in this case, if the presence of low bit rate data corresponding to the missing TS packet in the processing 1403 is confirmed in the decoder cache, the data complementation using only the broadcast wave is not performed. In this case, the above-mentioned insufficient data will be acquired via communication as shown in a fourth embodiment described later. If the difference between the sequential_counter values is 1, in processing 1308, the current sequential_c
The ounter value is stored, then the content data is extracted from the TS payload in process 1309, and the content data is stored in the content merge unit in process 1310. Next, in decoding processing 1311, the content data in the buffer is decoded. In this decoding processing 1311, each content data is transmitted to an appropriate decoder in the above-mentioned decoder 1006 based on the content ID embedded in the data for each type. If the stored data in the buffer is less than the above-mentioned fixed value, the process returns to step 1302 and the next content data is acquired. This is repeated until the content is determined to be finished in processing 1312.

In the second embodiment of the terminal for digital broadcasting, the sequential_counter embedded in the TS packet is used.
The loss of TS packets is determined based on the value of and the continuity is determined by the data complementing platform 1005. As a result, even if data loss occurs due to a momentary interruption in the received broadcast, the missing data is supplemented by using the low bit rate data that has been stored in the terminal in advance, providing a continuous digital broadcast to the viewer. It becomes possible to do.

Next, as a third embodiment of the present invention, an embodiment in which missing data due to momentary interruption of broadcasting is complemented via another communication medium will be described with reference to FIG. FIG. 18 shows a content distribution station 101 and a mobile unit 110.
Is an example of a digital broadcast complementing system in which communication is performed not only by broadcasting but also by a communication device using a mobile phone, a modem, etc., and is a functional configuration diagram for performing data complementation via the communication device 1810. is there. The content distribution station 101 is a transmission device 1805, an encoded content DB 180.
6, encoder 1807, content DB 1809, W
The eb server 1808 is provided. These encoded content DB 1806, encoder 1807,
The content DB 1809 is the same as that described in the first embodiment. Further, the in-vehicle terminal 201 includes an antenna 1801, an RF receiver 1802, a radio wave intensity monitoring device 1803, a data complementing platform 1005, a video / graphic display device 216, and a music reproducing unit (speaker) 21.
7, communication device 1810. Content distribution station 10
1 is different from the first embodiment described above in that a communication network 1820 typified by the Internet is connected to a Web server 1808 in a content distribution station and a mobile phone 1810 provided in an in-vehicle terminal 201. The point is that bidirectional communication is performed between content distribution stations.

The configuration of the data complementing platform 1105 in this embodiment will be described with reference to FIG.
The data complementing platform 1105 detects the missing of broadcast data, and a communication manager 1904 which controls the complementation function thereof and a communication cache 1904 which caches the data acquired via communication, and caches the data via broadcasting input by the digital demodulator 1804. A broadcast cache 1902 for controlling the broadcast is provided. And further,
The communication cache 1904 and the broadcast cache 1902
The PID of the TS packet relating to the contents of the data stored here (here, the stored data) and
A common cache 1903 is provided which compares sequential_counters to detect the presence / absence of digital data loss and complements the data using communication means 1810 such as a mobile phone when the digital data loss is detected. The communication cache 1904 is connected to a communication device 1810 represented by a mobile phone and a modem. The data integrated in the common cache is output to the output device according to a command from the platform manager 1901.

Next, details of a method for implementing digital broadcast complementation using the communication shown in FIG. 18 will be described with reference to FIG. In the following description, the part for predicting data loss due to instantaneous interruption of digital broadcasting is the same as in the first embodiment described above, so the function after that point will be described.

The content distribution station 101 of FIG. 18 stores the accumulation history of the TS packets transmitted in the process 2001 of FIG. 21 in advance when performing stream broadcasting. This can be realized by storing the time for transmission from the content distribution station and the above-mentioned sequential_counter value of the TS packet in the storage device. In this way, as shown in the process 2002 while accumulating the history, the content distribution station broadcasts the stream data to the in-vehicle terminal. The stream data broadcast here is stored in the above-described broadcast cache 1902 on the in-vehicle terminal 201 side (process 2003). After that, based on the information from the radio field intensity monitoring device 1803, it is determined by the instruction from the platform manager 1901 whether or not the reception data loss is expected to occur (process 2004). If it is predicted that data loss will occur, communication processing 2005 requests the content delivery station 100 for the expected lost packet. The data quality required here can be flexibly changed according to the congestion status of the communication line and the contract form of digital broadcasting. The request method at this time is CGI (Common Gateway) of a general Web server.
Using the function called Interface), the following U
It can be realized by specifying RL. "Http: // web
server.hogehoge.com/cgi-bin/getData?start_id=00000
&amp; end_id = 00030 ”This means http: //webserver.ho
"gehoge.com/cgi-bin" indicates the address of the Web server of the content distribution station where the program for data complement exists, and "getData" is a program that acquires the data to be complemented, "start_id" Packet number (sequential_counte
r) and “end_id” indicate the packet number at the end of the data to be complemented. Of course, this is one expression for data acquisition, so other expression methods or JAVA
It is also possible to use other language processing systems such as (registered trademark) applet and Java (registered trademark) Script.

The data thus obtained is obtained via the communication device 1810 (process 2007) and stored in the communication cache 1904 (process 2008). Since some time is required during this processing, it is determined in processing 2009 whether new data loss is expected during that time. The above processing, that is, a range 2010 surrounded by a dotted line in FIG.
Alternatively, repeat for a certain period while the terminal is powered on. Then, when a data loss actually occurs according to a command from the platform manager 1901, the contents of the broadcast cache and the communication cache are merged in the process 2011, and the decoding process is performed via the process 2012. Output the data to the display device.

By using the third embodiment of the present invention described above, it is possible to predict the loss of broadcast waves and obtain the loss prediction data from the content distribution station via communication beforehand. Since data complementation can be performed promptly when data is lost due to a momentary interruption, it is possible to provide the viewer with a digital broadcasting that is not interrupted and to provide a comfortable digital broadcasting environment. In addition, because it is a data complement method using communication, it is possible to provide digital broadcasting that is not interrupted even in the environment where a mobile body is sandwiched between tunnels and trucks where broadcast waves do not easily reach. It will be possible.

In the first, second, and third embodiments, data complementation is performed independently by using only communication or broadcasting, respectively. The fourth embodiment is realized by combining these plural data acquisition means (FIG. 26). The configuration of the data complementing platform 1105 in the fourth embodiment is shown in FIG. As a basic configuration, the broadcast cache 1902 of the data supplement platform in the third embodiment shown in FIG. 19 performs the processing of the data supplement platform in the first embodiment shown in FIG. However, the packet shortage determination unit 1
The processing in 204 and the content merging unit 1205 is
Instead, the platform manager 1901 is used.

This data complementing platform 1105
First, similarly to the first embodiment, when data loss due to instantaneous interruption of broadcast waves is expected, data complementation is performed using the hierarchical transmission mechanism of digital broadcasting. Therefore, according to the instruction from the platform manager 1901, it is determined based on the information from the radio wave intensity monitoring device 1803 described above whether data loss due to a momentary interruption is expected in the near future. If it is expected that data loss will occur, it is checked whether the data expected to be lost exists in the decoder cache 1203. When it is predicted that the data cannot be complemented by this complementing method, that is, whether the low bit rate encoded data corresponding to the missing prediction data is detected in the decoder cache 1203 in the complementing processing 1403 described with reference to FIG. If there is a shortage, the necessary data is requested to the Web server of the content distribution station in which a program for performing data complementation by communicating with a mobile phone or the like is present similarly to the third embodiment. . In this way, the complementary data acquired from the content distribution station is acquired via the communication device 1810 to obtain the communication cache 19
Store in 04.

Since the amount of low bit rate data accumulated on the terminal side is very limited, the fourth embodiment, which complements the communication costly as compared with broadcasting, takes a long time. Even if data loss is expected, the duration of uninterrupted digital broadcasting will increase.

Next, data multiplexing for carrying out uninterrupted digital broadcasting will be described. In the first, second and fourth embodiments, as described in the first embodiment, 5.6M
Of the 13 segments into which the Hz band is divided, 10 segments are assigned to high quality data and 3 segments are assigned to low quality data, and content data of different qualities are distributed. In digital broadcasting, especially for mobiles, it is not efficient to use the broadcasting service by using all the segments as in the first embodiment. Broadcasting for mobiles is practical. When performing music / video data broadcasting using only one segment, it is necessary to multiplex different data with a time shift on one segment. The implementation of the encoder that performs this function will be described with reference to FIG.

In FIG. 22, it is assumed that the data to be multiplexed is only audio data, but of course video data and audio data may be multiplexed. In FIG. 22, first, the audio data 2400 is, for example, A1 to An.
Suppose it is divided into units. When encoding this data, two types of encoding are performed: high bit rate encoding and low bit rate encoding. Further, since packetization is performed at the same time, the encoded high bit rate data 2401 and low bit rate data 2402 are represented by 701 to 70 in FIG.
Headers corresponding to 8, 721 and 722 (hereinafter referred to as AV headers) are added. The data encoded at the high bit rate is represented as A1 to An, and the data encoded at the low bit rate is A1 'to An'.
Is displayed. In order to realize an uninterrupted digital broadcast, the low bit rate data is sent first after being shifted by a preset time delay k to multiplex the data. This is indicated by 2403 in FIG. This multiplexed data is placed on digital broadcasting and broadcast to terminals. In addition,
The part such as An here corresponds to data_byte_main 723 in FIG. 6, and Psude_PES header is counter_flag 721 and se.
It is equivalent to quential_counter722.

Next, the decoding operation of the terminal when receiving such digital data will be described with reference to FIG. In FIG. 23, the data multiplexed in FIG. 22 is first received by the packet receiver 2501 and then the data separator 2502.
Send the received data to. Here, the high bit rate data and the low bit rate data multiplexed as shown in FIG. 22 are separated into main streams and sub streams of 2503 and 2504. The main stream here is usually high-bit-rate data, which means data that is mainly played back, and the sub-stream is usually low-bit-rate data, which is data used for complementation. Data selector 25
In 05, information indicating the time count included in the header of these data (for example, sequential_c shown in FIG. 7).
ounter) to detect if the mainstream data arrives seamlessly. If the data of the main stream is interrupted here, it is determined whether or not there is missing data of the main stream in the data of the sub-stream where the data arrives earlier than the main stream. If there is sub-stream data corresponding to the missing data, this low bit rate data is used to pass it to the decoder that complements the missing part in the main stream. If no omission is found, the main stream data is continuously passed to the decoder and the data is reproduced by the player. The sub-stream data is exepied when the reproduction of the corresponding data of the main stream is completed.

Next, the function display screen of unbroken digital broadcasting using the present invention will be described with reference to FIGS. 24 and 25.
FIG. 24 is an example of a screen display of unbroken digital broadcasting, especially unbroken digital radio. This is not normally displayed on the digital broadcasting terminal, but if necessary,
For example, it is displayed by calling the screen when the reception status of digital broadcasting is poor and it is desired to check the reception status. Of course, the display screen of this digital radio may be always displayed. On the display screen of FIG. 24, a bar graph 2601 showing the packet reception status of music data,
A bar graph 260 showing the main buffer / sub-buffer switching status that visualizes whether the current music uses the main stream or the sub stream.
2. Further, a main buffer / sub-buffer packet status bar graph 2603 showing the current main stream and sub stream data reception status is displayed.

When the reception of the digital broadcast is interrupted, first, as shown in FIG. 25, the reception status graph 2 of the music data is displayed.
At 601 the color of the bar graph is changed for the portion 2701 where the data is interrupted, and it is shown that a momentary interruption occurs and the packet is lost. At the same time, the color of the bar graph showing the portion 2702 where the main stream is switched to the sub stream is changed to indicate that the data used for reproducing the music is switched from the main buffer to the sub buffer. In FIG. 25, the data reception status and the length of the data cut portion of the stream switching graph are different because the bar graph 2601 is a time display and the bar graph 2602 is a packet count display. . Of course, it is also possible to display the same lengths. In this example, when the broadcast is cut off, it can be seen that the buffer data in the main stream is smaller than in the normal state shown in FIG. 24, and the buffer amount of the substream is also reduced. However, since the substream data is used and complemented by measuring the timing, the music broadcast itself is not cut off. When the data of the main stream is restored, the bar graph showing the switching of the streams is in the state of reproducing the main stream, and the data reception is normally performed.

Although the terrestrial digital broadcasting is used in the above embodiments, it is possible to use media represented by broadcasting satellites and communication satellites instead of the terrestrial digital broadcasting. By using such media, it is possible to provide a wide range of uninterrupted digital broadcasting services.

Further, as a modification of the third embodiment, FIG.
As in the second embodiment, data loss due to momentary interruption is detected by the discontinuity of the sequential_counter value of the TS packet, and data missing due to both communication between the mobile phone 1810 and the content distribution station is detected as shown in FIG. It is also possible to make a request.

In the above-mentioned embodiments, the judgment of the instantaneous interruption of the electric wave of the digital broadcasting is made by using the electric field strength and the continuity of the transport stream. , The number of non-existent error data that occurs during decoding, the number of macroblocks other than the specified value, the number of uncompleted decodes for one frame within a predetermined time, the parity check of the bit stream, etc. It is also possible.

[0048]

According to the present invention, even if data is lost due to a momentary interruption, the data supplemented by using the low bit rate data stored in the terminal in advance is passed to the output device. It is possible for a person to enjoy a comfortable broadcast without feeling uncomfortable due to data interruption.

By using the other configuration of the present invention, it is possible to predict the loss of the broadcast wave and obtain the expected loss data from the content distribution station in advance via communication.
Since it is possible to quickly supplement data when data is lost due to a momentary interruption, it is possible to provide the viewer with uninterrupted digital broadcasting and a comfortable digital broadcasting environment. In addition, since it is a data complementing method using communication, it is possible to provide uninterrupted digital broadcasting even in an environment where a mobile body is sandwiched between tunnels and tracks where broadcast waves are hard to reach. It will be possible.

[Brief description of drawings]

FIG. 1 is a functional configuration diagram of a digital broadcast complement system based on the present invention.

FIG. 2 is a processing conceptual diagram of a digital broadcast complementing system based on the present invention.

FIG. 3 is a broadcast data format used in a digital broadcast supplement system according to the present invention.

FIG. 4 is a configuration diagram of an encoder of a content distribution station.

FIG. 5 is a detailed diagram of a content encoder.

FIG. 6 is another detailed view of the content encoder.

FIG. 7 is a detailed diagram of a TS packet.

FIG. 8 is a flowchart showing processing of a content encoder for non-real time content.

FIG. 9 is a flowchart showing a process of a content encoder for real-time content.

FIG. 10 is a configuration diagram of a data complementing platform according to the first embodiment.

FIG. 11 is a configuration diagram of a decoder.

FIG. 12 is a flowchart of data complement processing.

FIG. 13 shows an example of the relationship between radio wave intensity and radio wave missing prediction.

FIG. 14 is a flowchart of data complementing processing on the terminal side in the first embodiment.

FIG. 15 is a configuration diagram of a second embodiment using the present invention.

FIG. 16 is a configuration diagram of a data complementing platform in the second embodiment.

FIG. 17 is a flowchart of a digital broadcast complementing process when using communication in the second embodiment.

FIG. 18 is a configuration diagram of a third embodiment using the present invention.

FIG. 19 is a detailed diagram of a data complementing platform according to the third embodiment.

FIG. 20 is a configuration diagram of a modification of the third embodiment using the present invention.

FIG. 21 is a timing chart of a data complementing method.

FIG. 22 is a diagram showing an encoding process of data multiplexing.

FIG. 23 is a block diagram showing a decoding operation of multiplexed data in a receiving terminal.

FIG. 24 is a diagram showing a function display screen of digital broadcasting in a normal reception state.

FIG. 25 is a diagram showing a function display screen of digital broadcasting at the time of occurrence and recovery of instantaneous interruption of broadcasting.

FIG. 26 is a detailed diagram of a data complementing platform according to the fourth embodiment.

[Explanation of symbols]

100 ... Content distribution station, 110 ... Mobile unit, 120 ...
Terrestrial digital broadcasting station, 150 ... Content data, 2
01 ... Mobile receiving terminal, 216 ... Video, graphic display device,
217 ... Speaker, 252 ... Program management section, 310 ... High bit rate data, 312 ... Data loss prediction section, 32
0 ... Low bit rate data, 322 ... Complementary data, 33
0 ... time interval, 411 ... high bit rate data, 412
... Complementary low bit rate data, 511 ... Timer, 51
3 ... Content encoder, 514 ... Multiplexing device, 521
… Low bit rate encoded content, 522…
High bit rate encoded content, 601 ... Low bit rate encoder, 602 ... High bit rate encoder, 700 ... TS packet, 1005 ... Data complement platform, 1006 ... Decoder, 1111 ... A
V decoding processing, 1112 ... Character / graphic still image decoding processing, 1113 ... Subtitle character super processing, 1114 ... Map decoding processing, 1115 ... Moving picture still image switching device, 111
6 ... Speaker output unit, 1117 ... Movie plane, 111
8 ... Still image plane, 1119 ... Character / graphic plane, 1
120 ... Subtitle plane, 1121 ... Map screen plane,
1122 ... Video / still image / map screen switching plane, 11
23 ... Synthesizer, 1203 ... Decoder cache, 1204
... packet insufficiency portion determination unit, 1205 ... content merge unit, 1601 ... radio wave intensity level at which data loss is not expected, 1602 ... radio wave intensity level at which data loss should be noted, 1603 ... Strength level, 1604 ... Example of radio wave strength, 1605 ... First radio wave strength level for performing data complement processing, 1805 ... Transmission device, 1806 ... Encoded content DB, 1807 ... Encoder, 1808 ... Web
Server, 1809 ... Content DB, 1810 ... Mobile phone, 1901 ... Platform manager, 1902
… Broadcast cache, 1903… Common cache, 1904…
Communication cache.

─────────────────────────────────────────────────── ─── Continued Front Page (51) Int.Cl. ⁷ Identification Code FI Theme Coat (Reference) H04N 7/03 H04N 7/08 A 7/035 7/04 7/045 (72) Inventor Osamu Tomobe Ibaraki Prefecture Hitachi City Omika-cho 7-1-1, Hitachi Co., Ltd. Hitachi Research Laboratory (72) Inventor Kimiya Yamafoot 7-1-1, Omika-cho, Hitachi City, Ibaraki Prefecture Hitachi Term Hitachi Research Laboratory F-term ( Reference) 5C025 BA12 DA01 5C063 AB03 AB07 AC01 AC05 AC10 DA03 DA13 EB03 EB21 EB31 5K027 AA10 AA16 BB07 HH26 5K061 BB06 FF11 JJ07

Claims (9)

[Claims] 1. A digital broadcast complementing method in a digital broadcast receiving terminal for receiving a digital broadcast wave broadcast from a data broadcasting transmission station and outputting desired data, wherein a reception level of a broadcast radio wave is below a predetermined value. And a process of preliminarily accumulating data on the side of the terminal where data loss of the received broadcast wave is predicted based on the prediction result, and when the predicted data loss occurs, A method for complementing digital broadcasting, characterized by complementing missing data with data. 2. A digital broadcast receiving device in a digital broadcast receiving terminal that receives a digital broadcast wave broadcast from a data broadcast transmitting station and outputs desired data, measures the reception level of the broadcast radio wave, and receives the reception level. When the data loss due to the prediction occurs, the radio wave intensity monitoring device that predicts that the data will be equal to or less than a predetermined value, and a storage area that stores data that is expected to be missing data of the broadcast wave based on the prediction result In addition, a digital broadcast receiving apparatus, characterized in that the missing data is complemented by the data in the storage area. 3. A digital broadcast transmission system for broadcasting content data as a data broadcast, wherein broadcast data is composed of data packets, and the same data packet stores two kinds of data having different reproduction times and different bit rates. And a data encoder for adding a header having a series of index numbers to each data packet when converting the content to be transmitted into digital data and then converting into the data packet for digital broadcast transmission. Digital broadcast transmission system. 4. A digital broadcast receiving method in a digital broadcast receiving terminal which receives a digital broadcast wave broadcast from a data broadcasting transmitting station and outputs desired data, wherein a reception level of broadcast radio waves is below a predetermined value. And a process of preliminarily accumulating data on the side of the terminal where data loss of the received broadcast wave is predicted based on the prediction result, and when the predicted data loss occurs, The process of complementing the missing data with the data, the deterioration index of the data bit string represented by the strength of the radio wave at the peripheral position where the receiving terminal exists, or the predicted movement position of the receiving terminal, and the loss at the time of receiving the broadcast data are predicted. , Requesting the predicted missing data to the transmitting station in advance based on the prediction result, and requesting the receiving terminal from the transmitting station based on the request. A method for receiving digital broadcasting, characterized by receiving the data of. 5. The digital broadcast receiving method according to claim 4, wherein the deterioration index of the data bit string is the radio field intensity at the receiving terminal, the discontinuity of the transport stream packet, and the decoded audio / image reproduction. At least one of a quantum scale error, the number of error data that does not exist at the time of decoding, the number of macroblocks other than the specified value, the number of uncompleted decodes for one frame within a predetermined time, or the parity check of the bit stream. A digital broadcasting receiving method characterized by using one. 6. A digital broadcast wave broadcast by adding a data head uniquely assigned in preparation for bit string loss to the same content of arbitrary type data quality is received, and the received data is temporarily stored. In a digital broadcast receiving system which stores desired data extracted from a storage device or a received radio wave in a device, in the digital broadcast receiving terminal, a radio wave at a peripheral position where the terminal exists or a predicted movement position of the terminal The deterioration index of the data bit string represented by the strength of the data and the loss at the time of receiving the broadcast data are predicted, and when it is predicted that the loss of the data bit string will occur based on the prediction result, it is temporarily stored in the storage device. If the corresponding data exists in the stored data, the data is stored in the cache in advance. A digital broadcast receiving system, characterized in that, when data loss actually occurs, the data is complemented by the accumulated data. 7. The digital broadcast receiving system according to claim 6, wherein as the deterioration index of the data bit string, the radio field intensity at the receiving terminal, the discontinuity of the transport stream packet, the decoded voice / image reproduction A digital broadcast receiving system characterized by using a quantum scale error, the number of error data that does not exist at the time of decoding, the number of macroblocks other than a specified value, or a parity check of a bitstream. 8. A digital broadcast wave broadcast by adding a data head uniquely assigned in preparation for a bit string loss to the same content of arbitrary kind of data quality, and temporarily storing the received data. In a digital broadcast receiving system which stores desired data extracted from a storage device or a received radio wave in a device, in the digital broadcast receiving terminal, a radio wave at a peripheral position where the terminal exists or a predicted movement position of the terminal The deterioration index of the data bit string represented by the strength of the data and the loss at the time of receiving the broadcast data are predicted, and when it is predicted that the loss of the data bit string will occur based on the prediction result, the data is temporarily stored in the storage device. If the corresponding data exists in the stored data, the data is stored in the cache in advance. If the data expected to be missing does not exist in the data temporarily stored in the storage device, the transmitter requests the data expected to be missing, and the data transmitted by the transmitting station. Is temporarily stored in a storage device, and when data loss actually occurs, the accumulated data is used to complement the digital broadcast receiving system. 9. The digital broadcast receiving system according to claim 8, wherein the deterioration index of the data bit string is the radio field intensity at the receiving terminal, the discontinuity of the transport stream packet, and the decoded voice / image reproduction. A digital broadcast receiving system characterized by using either a quantum scale error, the number of macroblocks other than a specified value, or a bitstream parity check.