JPH09247633A - Information supply system, information supply device and output terminal equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To surely take synchronization of both audio and video information sets at the time of outputting the audio and video information externally. SOLUTION: A central processing unit 61 in an information output device 60 allows a system decoder 60 to separate a transport stream fed from an information supply device into an audio PES packet and a video PES packet. Then as to basic information of either of them, it is reproduced based on reproduction time management information included in the data and the result is outputted as a playing tone or video image. On the other hand, as to other subordinate information, it is reproduced by taking a reproduction timing of the PES packet of corresponding to basic information.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention supplies external output information including audio information and video information from an information supply device to an output terminal, and the output terminal performs predetermined external output processing based on the external output information. The present invention relates to a technique for providing information, and particularly to a technique for supplying information that has been compressed.

[0002]

2. Description of the Related Art Conventionally, video-on-demand (VOD) services have been studied which allow a user to watch a desired movie or the like when desired. In this VOD service, for example, when a desired video broadcast is requested from a set top box (STB) provided on the user side which is an information output side, an information supply device called a video server prepared on the service provider side is requested. The video / audio according to the request is transmitted to the user.

When a user requests a movie to be broadcast, the video server transmits the requested movie information to the user's STB. Therefore, the video server is provided with an information storage device, and the information storage device stores video information including video and audio. In this case, the audio signal converted into digital data and the video signal converted into digital data are packetized before being recorded in the storage device, further converted into one digital data string by a multiplexer, and then recorded in the storage device. .

For example, when the video is the same and only the audio can be in Japanese or in a foreign language, a format in which a video signal and an audio signal are previously set as movie information is adopted. Then, it is not necessary to prepare the first movie information in which the video signal and the Japanese audio signal are set, and the second movie information in which the video signal and the foreign language audio signal are set, although they are the same movie. Should not be. If more than one foreign language can be selected, the number of movie information items must be prepared.

Therefore, only one common video signal is prepared, a necessary audio signal is prepared separately from the video signal, and an audio signal and a video signal in a specified language are sent when information is transmitted. It is possible to In this case, the video signal and the audio signal, which have been converted into digital data, are stored in a storage device in a packetized state, and are first converted into one digital data string by a multiplexer when they are transmitted to the user side. .

In this case, MPEG (Moving Picture Image Coding Exper) is used, for example, to realize high-speed transmission.
Although it is conceivable that the information compressed information is transmitted based on the information compression coding standard such as ts Group), in that case, there are already standards for audio information and video information. That is, on the output terminal side,
By reproducing the received audio information and video information based on the time management information set for each piece of information, the two pieces of information can be synchronized with each other.

[0007]

However, basically, since the reproduction control is separately executed for the audio information and the video information, one of the information is affected by a supply error on the information supply device side or noise on the transmission line. If the transmission timing is deviated only with respect to, there may be a case where the two pieces of information cannot be temporarily synchronized. For example, when only the video information is delayed by 1 to 2 seconds in the movie, the audio information is reproduced as usual, so that a state where the video and the audio do not match occurs for a predetermined period.
When the video information and the audio information are set, only one of them is not delayed, and when they are delayed, both are delayed together. Therefore, when it is restarted, the video and the audio are reproduced from the beginning in a state where they match each other. However, if the method of individually controlling the reproduction is adopted, the state where the both do not match occurs as described above. is there.

It should be noted that these are not limited to movie information, and may be the same as long as they supply external output information including audio information and video information such as music information with video, karaoke information, game information and the like. Is. And, with the development of multimedia technology in recent years, the scope of application is expected to expand further.

The present invention has been made in order to solve the above-mentioned problems, and supplies external output information including audio information and video information from an information supply device to an output terminal in a state where the information is compressed. However, it is an object of the present invention to make it possible to implement a predetermined external output process in which both pieces of information are synchronized on the output terminal side.

[0010]

In order to achieve the above-mentioned object, the invention according to claim 1 transmits information for external output including audio information and video information from an information supply device through a transmission path. In the information supply system, which supplies the output terminal via the output terminal, and causes the output terminal to perform a predetermined external output process based on the external output information.
The information supply device packetizes the audio information and the video information in a format that includes time management information indicating when to reproduce for each predetermined access unit, based on a predetermined information compression coding standard. The output terminal stores the basic information storage means for storing the packetized audio information and the video information, and the multiplexing means for multiplexing the packetized audio information and video information in time series to generate a transport stream. Separation means for separating the transport stream supplied from the information supply device into audio-side and video-side packets, and whether the time management information is read from which of the audio-side or video-side packets separated by the separating means Selecting means for selecting, and the audio side or video selected by the selecting means When the time management information is read from any one of the packets, and when the predetermined time to be played is reached, either the audio information or the video information of the corresponding packet is played to produce a performance sound or image. The basic information reproducing and outputting means for outputting and the packet not selected by the selecting means are reproduced with reference to the timing at which either the corresponding audio information or video information is decoded by the basic information reproducing and outputting means, An information supply system characterized by comprising subordinate information reproduction output means for outputting as performance sound or video.

The information supply system of the present invention supplies external output information including audio information and video information from an information supply device to an output terminal via a transmission path, and the output terminal determines a predetermined value based on the external output information. The external output processing is performed. Here, the basic information storage means of the information supply device transmits audio information and video information to a predetermined access / access point based on a predetermined information compression coding standard.
The time management information indicating when to reproduce each unit is stored in a packetized form in a header part. Then, the multiplexing means multiplexes the packetized audio information and video information in time series to generate a transport stream (hereinafter also abbreviated as TS), and this TS is transmitted from the information supply device to the output terminal. Supplied.

On the other hand, in the output terminal, the separating means is
The TS supplied from the information supply device is separated into audio-side and video-side packets. Then, the basic information reproduction output means reads the time management information from either the audio side packet or the video side packet separated by the separation means, and when a predetermined time to be reproduced has come,
The audio information or video information of the corresponding packet is reproduced and reproduced and output as a performance sound or image.

Then, the subordinate information reproduction output means reproduces the packet not selected by the selection means with reference to the timing at which either the corresponding audio information or video information is decoded by the basic information reproduction output means. Output as performance sound or video.

As described above, either the audio information or the video information is reproduced on the output terminal side supplied with the external output information including the individually packetized audio information and video information from the information supply device. Since the other is reproduced based on the timing, it is possible to output the other information in synchronization with the reproduction timing of the basic information of either the audio information or the video information.

Therefore, even if the transmission timing of only one piece of information is deviated due to a supply error in the information supplying apparatus or noise in the transmission path, for example, only one piece of information is output at the information output apparatus side. Never. For example, in a movie, only video information is 1
Even if it is delayed by about 2 seconds, normally transmitted audio information will not be independently reproduced. For example, if the audio information is reproduced based on the video information, even if the audio information can be physically reproduced only with the audio information, the audio information is not reproduced unless the reproduction timing of the corresponding video information is reached. In other words, the audio information is also played back based on the playback timing on the video information side, so if the video information is not sent normally and is delayed, the audio information is also waiting and the video information can be played back. After that, the information will be reproduced so that both pieces of information always match.

If the external output information relates to a movie, it is considered preferable to use the video information as basic information and reproduce the audio information based on the reproduction timing of the video information. On the other hand, for example, in the case of music information with video or karaoke information, it is considered preferable to use audio information as the basic information and reproduce the video information based on the reproduction timing of the audio information. Other information for external output includes game information,
With the development of multimedia technology in recent years, the scope of application is expected to expand further.

Further, as an information supply device effective for use in such an information supply system, for example, the one shown in claim 2 can be considered. That is, in the information supply device that supplies the external output information including the audio information and the video information to the output terminal that performs the predetermined external output processing based on the external output information through the transmission line, the audio information and the video Basic information storage means for storing information in a packetized state in which the time management information indicating when to reproduce for each predetermined access unit is included in a header portion based on a predetermined information compression coding standard. And a multiplexing unit that multiplexes the packetized audio information and video information in time series to generate a transport stream, and supplies to the output terminal in the transport stream state. .

On the other hand, as an output terminal effective for use in such an information supply system, for example, one shown in claim 3 can be considered. That is, an output terminal that receives external output information including audio information and video information from an information supply device via a transmission path, and executes predetermined external output processing based on the external output information. From the information supply device, audio information and video in a state of being packetized in a format including a header part with time management information indicating when to reproduce for each predetermined access unit based on a predetermined information compression coding standard. In an output terminal to which a transport stream generated by multiplexing information in time series is transmitted, separating means for separating the transport stream supplied from the information supply device into packets on the audio side and the video side, The time management information is obtained from either the audio side packet or the video side packet separated by the separating means. If the time management information is read out from the selection means for selecting whether or not to output, and the time management information is read out from either the audio side packet or the video side packet selected by the selection means, it is applicable. Corresponding to the basic information reproducing / outputting means for reproducing either audio information or video information of the packet to be output as a performance sound or video, and the packet not selected by the selecting means in the basic information reproducing / outputting means. Audio information or video information to be reproduced is used as a reference for reproduction, and dependent information reproduction output means for outputting as a performance sound or image is provided.

The information supply device according to claim 2 or the output terminal according to claim 3 also exerts the operation described in claim 1, so that the output terminal side has a predetermined external condition in which both information are synchronized. This is effective for realizing output processing.

[0020]

Next, embodiments of the present invention will be described in detail. As shown in FIG. 1, in an information supply system 10 according to an embodiment of the present invention, an information supply device 20 and an information output device 60 as an output terminal are connected via a transmission line 90 formed of a coaxial cable or the like. Connected and configured. Although the information supply device 20 is provided with the encoding device 50, the encoding device 50 can be attached to and detached from the information supply device 20. Although only one information output device 60 is illustrated in FIG. 1, a plurality of information output devices 6 are provided.
It is usual that 0 is connected to one information supply device 20. Further, the transmission path 90 may be of any type regardless of whether it is wired or wireless.

First, the encoding device 50 will be described with reference to FIG. The encoding device 50 is used to input information to be supplied to the information output device 60 by the information supply device 20 from the outside. The encoding device 50 includes a video encoder 51, a video PES packetizer 52, an audio encoder 53, and an audio PES packetizer 54.

The video encoder 51 is capable of encoding an analog video signal input from the outside and converting it into a digital data string, and the video signal converted into the digital data string is processed by the video PES packetizer 52, in this case. It is converted into a PES packet according to the MPEG2 standard and output as a video PES packet. This video PES packet is composed of a header part and an effective data part, as shown in FIG. The header section includes a packet start code, a packet length, a header length, and reproduction time management information.

Similarly, the audio encoder 53
Can encode an analog audio signal input from the outside and convert it into a digital data string. The audio signal converted into the digital data string is converted into a PES packet by the audio PES packetizer 54 in accordance with the MPEG2 standard, Output as a packet. As shown in FIG. 4B, the data structure of the audio PES packet is the same as the video PES packet.
The basic configuration is the same except that the contents of the packet and the effective data section are different. Note that P for identifying the packet
The ID (Packet Identity) is included in the packet start code.

Next, the structure of the information supply device 20 will be described. The encoding device 50 is the information supply device 20.
1, the video PES packet as the output of the video PES packetizer 52 is input to the input interface 21 of the information supply device 20, and the audio PES packet as the output of the audio PES packetizer 54 is The structure is input to the input interface 22.

The video PES packet input to the input interface 21 is transferred to the video storage device control unit 27 via the bus 24, and the video storage device control unit 27 controls the video storage device control unit 27.
It is written and stored in a predetermined area of the video storage device 28 as basic information storage means. On the other hand, the audio PES packet input to the input interface 22 is
4, and is written to and stored in a predetermined area of the voice storage device 26 as basic information storage means.
The PES packetized video data and audio data stored in the video storage device 28 and the audio storage device 26 can be read out by the video storage device control unit 27 and the audio storage device control unit 25, respectively.

The video storage device control unit 27 reads the video data stored in the video storage device 28 and transfers it to the video buffer memory 31, and the audio storage device control unit 25 is stored in the audio storage device 26. The audio data stored therein can be read and transferred to the audio buffer memory 32.

The video buffer memory 31 can temporarily store the video data sent from the video storage device controller 27 and output it in response to a request from the multiplexer 35. Similarly, the audio buffer memory 32 can temporarily store the audio data sent from the audio storage device control unit 25 and output the audio data in response to a request from the multiplexer 35.

Multiplexer 35 as multiplexing means
Is a PES packet sequence of video data sent from the two buffer memories 31 and 32 and a PE of audio data.
An S packet sequence can be multiplexed into one transport stream (TS) and output to the head end 37 through the output interface 36.

Although not shown, the information supply device 20 is provided with a plurality of data output mechanisms including the above-mentioned video buffer memory 31, audio buffer memory 32, multiplexer 35 and output interface 36. The headend 37 can send the TS sent from the plurality of data output mechanisms to the transmission line 90 through the channel assigned to each output interface 36. In addition, the head end 37 can transmit a signal transmitted from the modem 47 through a channel for bidirectional communication, and can transfer a signal input from the transmission line 90 through a channel for bidirectional communication to the modem 47. .

The modem 47 is connected to the input / output control unit 30 as a control means via the bus 24, and the input / output control unit 30 is connected to the transmission line 90 via the modem 47 and the head end 37. Information output device 6
0, or receive data from the information output device 60. Also, the input / output control unit 30
Can control the operation of each unit of the information supply device 20 described above.

Next, the configuration of the information output device 60 will be described with reference to FIG. As shown in FIG. 3, the information output device 60 includes a central control device 61 as a control unit and a selection unit for controlling the operation of each unit of the information output device 60. The central control device 61 is configured as a known microcomputer. The central control device 61 is connected to an input device 63 as an input means having a keyboard (not shown). By operating the input device 63, various data and instructions can be input to the central control device 61. it can. Further, the central controller 61 includes a modem 62
, And can communicate with the input / output control unit 30 of the information supply device 20 using the above-described bidirectional communication channel.

Further, a tuner 64 as receiving means is connected to the transmission line 90. The tuner 64 can select a channel according to an instruction from the central control device 61, and can receive information transmitted on the selected channel. The information received by the tuner 64 is sent to a system decoder 65 as separating means. The system decoder 65 can divide a TS (transport stream) received and transferred by the tuner 64 into a video PES packet and an audio PES packet, and output them to the video buffer 73 and the audio buffer 66, respectively.

The audio decoder 67 can read the audio PES packet from the audio buffer 66, decode it, and output it to the amplifier 69 as an analog audio signal. The amplifier 69 can amplify the audio signal, send the amplified signal to the speaker 70, and output the sound.

The video decoder 74 can read the video PES packet from the video buffer 73, decode the video PES packet, and output the decoded video PES packet to the video display device 75 as an analog video signal. A monitor television 76 is connected to the video display device 75, and the video reproduced on the monitor television 76 can be displayed.

The above-mentioned audio decoder 67 and video decoder 74 function as basic information reproduction output means or subordinate information reproduction output means, and reproduction management in them is performed by the reproduction time management section 82. This reproduction time management unit 82
Which of the audio information and the video information is to be used as the reference for reproduction in accordance with the instruction from the central controller 61.
In other words, the audio decoder 67 and the video decoder 74 are notified of which time management information is read and reproduction control is executed. The audio decoder 67 and the video decoder 74 execute the reproduction process according to the instruction from the reproduction time management unit 82.

Next, the information supply system 10 of the present embodiment.
Will be described. Here, the information supply device 20
The video storage device 28 and the audio storage device 26 of the above store video data and audio data of a movie in a PES packet string state, and the audio storage device 26 stores three types (Japanese, English) corresponding to the movie. , French) audio data is stored in a PES packet string state, and a case where the information output device 60 designates a voice in a desired language and information for a movie is transmitted is taken as an example. The operation will be explained.

First, when the user of the information output device 60 operates the input device 63 to request the supply of desired movie information, the central control device 61 sends a request for sending this movie information through the modem 62 to the transmission line. It transmits to the information supply apparatus 20 via 90. Further, at this time, the user can notify the information supply device 20 of the selection of the Japanese voice by, for example, a key operation for instructing the voice in Japanese.

On the other hand, in the information supply device 20, the input / output control unit 30 receives this request through the modem 47. Next, the input / output control unit 30 reads out the video data of the specified movie and the audio data in the selected language (in this case, Japanese) and the video buffer memory of the data output mechanism selected by the input / output control unit 30. 31, and instructs the video storage device control unit 27 and the audio storage device control unit 25 to transfer the data to the audio buffer memory 32, respectively.

Further, the input / output control section 30 notifies the information output device 60 which has requested the movie information of the channel assigned to the output interface 36 of the selected data output mechanism. In the information output device 60, the central control device 61 instructs the tuner 64 to select a channel. Thus, the information output device 60 waits for a TS (transport stream) to be transmitted by the channel.

Next, in the information supply device 20, the video storage device control unit 27 reads out predetermined video data from the video storage device 28 and transfers it to the video buffer memory 31, and the audio storage device control unit 25 reads out the audio storage device. A predetermined audio data is read out from an audio buffer memory 32.
Transfer to

The video data and audio data read from the video buffer memory 31 and the audio buffer memory 32 are input to the multiplexer 35. The multiplexer 35 has two buffer memories 31, 32.
Multiplexes the PES packet sequence of video data and the PES packet sequence of audio data sent from the PC to generate one TS, and outputs the TS to the head end 37 through the output interface. The head end 37
S is transmitted on a predetermined channel.

In the information output device 60, the tuner 64 receives the TS through the designated channel. Information output device 6 from the point of receiving this TS
The operation at 0 will be described with reference to FIGS.

FIG. 5 shows the processing executed in the system decoder 65. First, in the first step S1, T
It is determined whether an S packet has been obtained. When the TS packet is acquired, the process proceeds to S2 and the PID is decrypted. 4A and 4B, regardless of whether the TS packet is an audio PES or a video PES.
Has a common header section, and its packet start code includes a PID. Therefore, S
In step 2, the PID is decrypted, and S
Steps S3 and S4 are performed.

That is, if the acquired TS packet is an audio PES packet (S3: YES), the flow shifts to S5 and is distributed to the audio buffer 66. If it is a video PES packet (S4: YES), the flow shifts to S6 and is distributed to the video buffer 81.

After the processing of S5 and S6 is completed, the process returns to S1 and waits for the next TS packet. In this way, the audio PES packet and the video PES distributed to the audio buffer 66 and the video buffer 73 based on the PID.
The packets are read out by the audio decoder 67 and the video decoder 74, respectively, and execute predetermined processing. Since the audio decoder 67 and the video decoder 74 perform the instruction according to the instruction from the reproduction time management unit 82, the processing in the reproduction time management unit 82 will be described first with reference to the flowchart of FIG.

First, in the first step S11,
Receiving the reproduction reference information from the central controller 61,
In subsequent S12, it is determined whether the received reproduction reference information is the video reference. If the video information is to be played back as a reference (S12: YES), S
If it is determined that the video standard is notified to the audio decoder 67 and the video decoder 74 and the audio information is to be reproduced as the standard (S12: N).
O) and S14, and informs the audio decoder 67 and the video decoder 74 that they are audio standards.

When the user of the information output device 60 operates the input device 63 to request supply of desired movie information,
The central controller 61 sends a request for sending this movie information to the modem 6
Although it has been described that the data is transmitted to the information supply device 20 via the transmission line 90 through the No. 2, the process shown in FIG. 6 is executed at that time. For example, if movie information is requested, in that case, the central control unit 61 notifies the reproduction time management unit 82 that it is the video reference. Subsequent synchronization processing is entrusted to the audio decoder 67 and the video decoder 74, respectively.

Next, the processing in the video decoder 74 is shown in FIG.
This will be described with reference to the flowchart of FIG. First, in S21, the reproduction time management unit 82 receives notification from the video reference or the audio, and in S22, it is determined whether or not it is the video reference. Then, if it is the video reference (S22:
If YES, the process proceeds to S23, and if it is not the video reference (S
22: NO), since it is an audio standard, the process proceeds to S28.

In S23, the video PES packet is read from the video buffer 73, and in the following S24,
Header part in the PES packet (see FIG. 4A)
The reproduction time management information is read out. Then, in S25, it is judged whether or not it is the time for reproduction, and if it is the reproduction time, the video synchronization signal is sent to the reproduction time management unit 82 in S26, and then the process proceeds to S27 to decode the video PES packet. And outputs it as an analog video signal to the video display device 75. After the end of this video output process, S
Return to 21.

Whether or not it is the reproduction time in S25 is determined by comparing the basic synchronization signal with the reproduction time management information. The video decoder 74 starts the reproduction process after the synchronization signal is first reset, and when the basic synchronization signal matches the reproduction time management information, an affirmative decision is made in S25. Further, the video synchronization signal sent to the reproduction time management unit 82 in S26 is sent to the audio decoder 67 via the reproduction time management unit 82.

On the other hand, in S28 to which the negative determination is made in S22, the video buffer 73 is moved in the same manner as in S23.
More video PES packets are read, but in this case,
Then, in S29, the audio sync signal is reproduced at the reproduction time management unit 8
It is in a condition that can be received from 2. That is, the reproduction time management information is not read and reproduced from the header portion (see FIG. 4A) in the video PES packet read in S23, but is reproduced based on the audio synchronization signal of the other party. .

Therefore, in the following S30, it is determined whether or not the time at which the corresponding video PES packet is to be reproduced has come, based on the audio synchronization signal received from the reproduction time management unit 82. When the reproduction time has come, the process proceeds to S31, and the video PES packet is decoded and output to the video display device 75 as an analog video signal. After the end of the video output process, the process returns to S21.

Next, the processing in the audio decoder 67 will be described with reference to FIG. First, in S41, the reproduction time management unit 82 notifies the video standard or audio,
In S42 it is determined whether it is an audio reference. If it is the audio standard (S42: YE
S) and S43, and if not audio standard (S
42: NO), since it is a video standard, the process proceeds to S48.

In S43, the audio buffer 6
Read audio PES packet from 6 and continue S4
At 4, the reproduction time management information is read from the header portion (see FIG. 4B) in the audio PES packet.
Then, in S45, it is determined whether or not it is time to reproduce. Whether or not it is the reproduction time in S45 is similar to the case of the video PES packet. That is, the audio decoder 67 starts the reproduction processing after the basic synchronization signal is reset, and when the basic synchronization signal matches the reproduction time management information, an affirmative determination is made in S45. If the affirmative judgment is made in S45, that is, if the reproduction time is reached, the reproduction time management unit 82 is notified in S46, and then the process proceeds to S47 to decode the audio PES packet and output it to the amplifier 69 as an analog audio signal. To do. After the end of the audio output process, the process returns to S41.

On the other hand, in S48 to which a negative determination is made in S42, the audio PES packet is read from the audio buffer 66 in the same manner as in S43, but in this case, in S49, the reproduction time management section 82 outputs the video synchronization signal. Make it more acceptable. That is, the header portion (see FIG. 4) in the audio PES packet read in S43.
The reproduction time management information is not read and reproduced from (see (B)), but is reproduced based on the video synchronization signal of the other party.

Therefore, in the following S50, it is judged whether or not the time at which the corresponding audio PES packet is to be reproduced is reached based on the video synchronization signal received from the reproduction time management unit 82. When the reproduction time has come, the process shifts to S51 to decode the audio PES packet and output it to the amplifier 69 as an analog audio signal. After the end of this audio output process, S41
Return to

By performing the above processing, the analog audio signal output from the audio decoder 67 is amplified by the amplifier 69, and the speaker 7
It is sent to 0 and output as voice. Also, the video decoder 6
The analog video signal output from the monitor 8 is displayed on the monitor television 76 via the image display device 72. Therefore, the user of the information output device 60 can enjoy the movie in the sound of the language specified by the user.

As described above, this information supply system 10
Then, the audio information and the video information are subjected to information compression by MPEG2 and stored in the state of PES packets. Then, corresponding audio information and video information are read out in response to a request from the information output device 60, and are multiplexed in time series by the multiplexer 35 to generate a transport stream (TS), and the TS is transmitted to the information output device 60. We are supplying.

Then, the information output device 60 separates the supplied TS into audio-side and video-side PES packets. Then, for basic information (for example, video information for a movie) of either one of the audio PES packet and the video PES packet, M
Playback is performed based on predetermined playback time management information defined by PEG2, and output as performance sound or video.
On the other hand, the PES packet of the other subordinate information that is not the basic information (for example, audio information in the case of a movie) is reproduced based on the reproduction timing of the corresponding PES packet of the basic information.

As described above, even if the information output device 60 supplies the external output information including the audio information and the video information to the information output device 60 in the information-compressed state, the audio information is output on the information output device 60 side. Alternatively, since the other is reproduced with reference to the timing at which one of the video information is reproduced, the other information can be output in synchronization with the reproduction timing of the basic information of either the audio information or the video information.

Therefore, even if the transmission timing of only one information is deviated due to a supply error on the information supply device 10 side or noise on the transmission path, for example, only one information is output on the information output device side. It is never output. For example, even if only video information is delayed by 1 to 2 seconds in a movie, normally transmitted audio information will not be independently reproduced.

For example, if the audio PES packet is reproduced based on the reproduction time management information of the video PES packet, the reproduction timing of the corresponding video PES packet must be reached even if the audio PES packet can be reproduced. The audio PES packet is not reproduced either. If the video PES packet is not normally sent and is delayed, the audio PES packet is sent.
Since the packet is also waiting to be reproduced, the video PES packet is always reproduced so that the two pieces of information match each other after the video PES packet is ready to be reproduced.

In this way, the video and audio can be firmly synchronized, and the user can watch a high-quality movie. Although the embodiments of the present invention have been described above, it is needless to say that the present invention is not limited to such embodiments and can be variously implemented without departing from the gist of the present invention.

For example, in the above embodiment, the case of supplying the information for the movie is taken as an example. Therefore, the example in which the video information is used as the basic information and the audio information is reproduced on the basis of the reproduction timing of the video information has been described. It can be something other than a movie.
For example, in the case of music information with video or karaoke information, on the contrary, it is considered that audio information has a higher priority, so that it is preferable to use this as basic information and reproduce the video information based on the reproduction timing of the audio information. Conceivable. That is, in this case, it is meaningless if there is no audio information, and the video information is ancillary information. Ah, other external output information includes game information, etc., and it is expected that the scope of application will continue to expand with the development of multimedia technology in recent years. Furthermore, MPE is used as a predetermined information compression coding standard.
G2 was taken as an example, but is not limited to this.
EG1 or JPEG may be used.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an information supply system according to an embodiment.

FIG. 2 is a block diagram illustrating a configuration of an encoding device according to the embodiment.

FIG. 3 is a block diagram showing a configuration of an information output device of the embodiment.

4A is an explanatory diagram illustrating a data configuration of a video PES packet, and FIG. 4B is an explanatory diagram illustrating a data configuration of an audio PES packet.

FIG. 5 is a flowchart showing processing executed in a system decoder of the information output device.

FIG. 6 is a flowchart showing processing executed by a reproduction time management unit of the information output device.

FIG. 7 is a flowchart showing processing executed in the video decoder of the information output device.

FIG. 8 is a flowchart showing processing executed in the audio decoder of the information output device.

[Explanation of symbols]

10 ... Information supply system 20 ... Information supply device 25 ... Audio storage device control unit 26 ... Audio storage device 27 ... Video storage device control unit 28 ... Video storage device 30 ... Input / output control unit 31 ... Video buffer memory 32 ... Audio buffer memory 35 ... Multiplexer 36 ... Output interface 37 ... Headend 41 ... Telop buffer memory 50 ... Encoding device 51 ... Video encoder 52 ... Video PE
S packetizer 53 ... Audio encoder 54 ... Audio PES packetizer 60 ... Information output device 61 ... Central control device 62 ... Modem 63 ... Input device 64 ... Tuner 65 ... System decoder 66 ... Audio buffer 67 ... Audio decoder 69 ... Amplifier 70 ... Speaker 73 ... video buffer 74 ... video decoder 75 ... video display device 76 ... monitor TV 82 ... reproduction time management unit 90 ... transmission path

Claims (3)

[Claims] 1. External output information including audio information and video information is supplied from an information supply device to an output terminal via a transmission path, and the output terminal performs predetermined external output processing based on the external output information. In the information supply system, the information supply device is time management information indicating when to reproduce the audio information and the video information for each predetermined access unit based on a predetermined information compression coding standard. And a basic information storage unit that stores the packetized information in a format including a header portion, and a multiplexing unit that multiplexes the packetized audio information and video information in time series to generate a transport stream. Wherein the output terminal outputs the transport stream supplied from the information supply device to the audio side and the video side. Separating means for separating into packets, selecting means for selecting whether to read the time management information from the audio side or video side packet separated by the separating means, and the audio side or video selected by the selecting means Basic information for reading out the time management information from one of the packets and reproducing the audio information or video information of the selected packet at the predetermined time to be reproduced and outputting it as a performance sound or image. The reproduction output means and the audio information or video information of the packet not selected by the selection means are reproduced on the basis of the timing at which the corresponding audio information or video information is decoded by the basic information reproduction output means, and the performance sound is reproduced. Or subordinate information output as video Information supply system comprising: a raw output means. 2. An information supply device for supplying external output information including audio information and video information to an output terminal which performs a predetermined external output process based on the external output information via a transmission path, wherein the audio Basically, information and video information are stored in a packetized form in a header part that includes time management information indicating when to reproduce each predetermined access unit based on a predetermined information compression coding standard. An information storage unit; and a multiplexing unit that multiplexes the packetized audio information and video information in time series to generate a transport stream, and supplies the transport stream state to the output terminal. Characteristic information supply device. 3. An output terminal that receives external output information including audio information and video information from an information supply device via a transmission path, and executes a predetermined external output process based on the external output information. Therefore, the information supply device outputs audio in a packetized state in a format including a header part with time management information indicating when to reproduce each predetermined access unit based on a predetermined information compression coding standard. In an output terminal for transmitting a transport stream generated by time-sequentially multiplexing information and video information, a separating means for separating the transport stream supplied from the information supply device into audio-side and video-side packets And the time management information from the audio side packet or the video side packet separated by the separating means. Selection means for selecting whether or not to read the time management information, and the time management information is read from either the audio side packet or the video side packet selected by the selection means. The basic information reproducing / outputting means for reproducing the audio information or the video information of the packet and outputting it as the performance sound or the image, and the audio information or the video information of the packet not selected by the selecting means in the basic information reproducing / outputting means. An output terminal comprising: subordinate information reproduction output means for reproducing the corresponding audio information or video information as a reference and outputting it as performance sound or video.