CN101232623A - System and method for transmitting stereo audio and video numerical coding based on transmission stream - Google Patents
System and method for transmitting stereo audio and video numerical coding based on transmission stream Download PDFInfo
- Publication number
- CN101232623A CN101232623A CN 200710002455 CN200710002455A CN101232623A CN 101232623 A CN101232623 A CN 101232623A CN 200710002455 CN200710002455 CN 200710002455 CN 200710002455 A CN200710002455 A CN 200710002455A CN 101232623 A CN101232623 A CN 101232623A
- Authority
- CN
- China
- Prior art keywords
- transmission
- video
- audio
- binocular
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to a stereo audio and video stream data coding transmission method and system based on transmission streams. The invention comprises: a. Perform camera picking up to gain binocular audio and video data before synchronous compression and multiplex respectively in synchronous control; b. respectively perform envelopment in the synchronous control for transmission stream; c. perform secondary multiplex coding in transmission stream synchronous control, so as to gain single data stream; d. follow real-time transmission protocols to perform envelopment transmission and receive feedback adjusting; f. in the transmission service quality control, the invention can perform real-time transmission protocol de-envelopment and feedback information; g. de-multiplex to gain transversal binocular audio and video data; h. in synchronous monitoring condition, perform audio and video data de-compression and de-multiplexing; i. A display apparatus realizes stereo playing. The invention supports audio and video coding, such as MPEG-1/2/4, VC1, H263, H.264 and etc, as well as such transmission methods as wireless, cable, time division multiplex, block transmission and so on. The invention can realize remote stereophonical reoccurrence of local audio/video, and is simple, universal and reliable.
Description
Technical field:
The present invention relates to a kind of digital coding transmission method and system of three-dimensional audio frequency and video, particularly based on the three-dimensional audio frequency and video digital coding transmission method and the system of transport stream.
Background technology:
Along with progress of science and technology, audio frequency is from simulation, and monophony develops into digitlization, surround sound; Video image also develops bit digitalization, colour, dull and stereotyped large-screen from simulation, black and white, CRT the small screen simultaneously, and then has better met the needs of human seeing and hearing enjoyment.
Compare with traditional monocular video, three-dimensional video-frequency (binocular video) has increased the scene depth information sign, can strengthen the sense of reality and the fidelity of visual effect.Three-dimensional audio frequency and video technology can be widely used in fields such as information service such as multimedia news briefing, online live, the web advertisement, ecommerce, video request program, long-distance education, tele-medicine, network radio station, real-time video meeting.
Coding and transmission technology are two big key technologies of three-dimensional video-frequency.H.263 and H.264 or the like the audio/video coding technology makes constant progress in recent years, VC1, audio/video encoding standard have occurred such as MPEG-1/2/4.The appearance of these technology makes the audio frequency and video editor, and storage and Digitized Transmission become a reality.And the development of network technology and digital communication technology makes multiple business such as can realizing voice, data, image on the single network platform transmit.Can be for the also appearance thereupon of three-dimensional audiovisual applications system of multimedia interaction program request and multicast.
Just because of having a extensive future of this technology, CN1561019 discloses a kind of based on the three-dimensional video-frequency method for monitoring of internet and the technical scheme of system.Its scheme comprises: 1) video acquisition and processing, 2) video data Network Transmission, 3) by local system video data is handled and demonstration.This system is made of through the input that the internet video network transmission system is communicated with local binary channels stereoscopic display system displays the output of binary channels video acquisition system.
The disclosed scheme of CN156101 is based on the time-division technique for displaying.Utilize the eye storage characteristic of human eye, under the effect of synchronizing signal, when showing left order image, shield right order, when showing right order image, shield left order, promptly left eye can only be seen the image of left eye, and right eye can only be seen the image of right eye; So go round and begin again,, thereby obtain stereopsis with speed Alternation Display faster than the persistence of vision.The shortcoming of this technology is that the flickering of video is very strong, and not smooth for the moving image demonstration, third dimension is poor, and the human eye comfort level is poor, is easy to fatigue.This scheme lacks the consideration to network congestion and packet loss problem, and effect is difficult to meet the demands in the network environment of reality.The expansion of this scheme and poor compatibility are only supported the MPEG-4 coding standard, are difficult to support new development H.264, and the higher better coding of efficient such as VC1 is accurate.This scheme is poor to the support property of a plurality of three-dimensional audio frequency and video, all links from the coding side to the decoding end, all need set up the actual conversation (RTP Session) of a plurality of audio frequency and video and other data flow, therefore when being the I/O of streaming server (Streaming Server), need a plurality of input and output of management, the management of a plurality of buffers (Buffer) and between them synchronously, the disposal ability requirement of Streaming Server will greatly be increased, also bring bigger algorithm complexity, reduced the stability and the reliability of system simultaneously.And this scheme needs the support of many software and hardwares such as computer, the technology relative complex, and cost is higher.
Summary of the invention:
The present invention is intended to solve the problems of the technologies described above, and provides a kind of solution network transmission process neutral body audio-visual synchronization problem, the method and the system thereof of network congestion packet loss problem.
The invention provides a kind of three-dimensional audio frequency and video digital coding transmission method and system based on transport stream (Transport Stream), it comprises the steps:
A. the twin camera that adopts stereo camera or adjust angle is taken under the effect of synchronous control signal synchronously, and the left and right sides binocular audio, video data that obtains compresses multiplexing under the effect of synchronous control signal respectively synchronously;
B. the left and right sides binocular audio, video data after will compressing is synchronously sealed respectively under the effect of synchronous control signal and is transport stream, and identifies about filling in transport stream;
C. the left and right sides binocular transport stream after will sealing is carried out the secondary multiplexing coding and is obtained single binocular data flow under the control of synchronizing signal, realizes that the dominance of left and right sides binocular audio, video data is synchronous;
D. the single binocular data flow behind the secondary multiplexing coding is sealed with RTP, then transmission;
E. compress adjustment, adjust synchronously and transmit adjustment according to the quality services Control and Feedback of receiving terminal;
F. receive the single binocular data after sealing from transmission network, under transmission service quality control, carry out RTP and separate and seal, feed back to the corresponding information of transmitting terminal simultaneously;
G. unpack the secondary multiplexing encoded data stream of being honored as a queen and carry out demultiplexing, the left and right sides binocular audio, video data transport stream of gained is further separated and is sealed, and solves corresponding left and right sides binocular audio, video data, tells the audio, video data of left and right sides binocular according to the tag slot;
H. carry out the decompression and the demultiplexing of left and right sides binocular audio, video data under the monitoring of synchronous control signal, relatively the time difference of left and right sides binocular audio, video data is adjusted and is made it convergent;
I. the binocular audio, video data of demultiplexing is realized three-dimensional the broadcast via display unit simultaneously.
Wherein the single binocular data stream packets behind the secondary multiplexing coding is honored as a queen by Network Transmission or via the chnnel coding modulating system, utilizes digital broadcasting (DVB) technology to transmit.
Be coded in after wherein said binocular audio-visual data is multiplexing in the same standard transmission stream.
Left order audio, video data and right order audio, video data are sealed based on RTP via alignment binding back in the standard transmission stream bag respectively in the wherein said binocular audio, video data.
Left order audio, video data and right order audio, video data are sealed based on two-way program multiplexing multiple transport respectively in the wherein said binocular audio, video data, obtain single channel standard transmission stream, described single channel standard transmission stream is merged into multichannel standard transmission stream, and described multichannel standard transmission stream is sealed based on RTP.
Wherein said RTP is sealed and is adopted intersection group packet mode to load described binocular audio, video data.
Wherein said enveloping data adopts the institute of error correction method verification forward data packets for transmission in transmission, transmit with DVB for Network Transmission and can adopt identical error correction method, also can adopt different error correction methods, for example two-stage error correction, phase mapping.
During the wherein said verification of error correction method forward institute data packets for transmission, only the feedback information that returns when receiving terminal shows that transmitting terminal just sent the verification bag and remedies when received data packet was less than default bag number.
The present invention also provides a kind of three-dimensional audio, video data coding transmission system based on transport stream, and it comprises following subsystem:
1. synchronous three-dimensional audio frequency and video shooting, compression and multiplex system;
2. Synchronization Control and quality services transmission control system;
3. the demultiplexing of synchronous three-dimensional audio frequency and video, decompression and display system;
Wherein:
Shooting, collecting system in described synchronous three-dimensional audio frequency and video shooting, compression and the multiplex system be stereo camera or adjust angle and by the twin camera of synchronous control signal effect; Compressibility wherein is two-way is taken the compressed encoding that synchronous difference adjusts and carried out the multiplexing two-way encoder of audio-visual synchronization by synchronous control system control; Multiplex system wherein is to seal adapter and binocular data secondary multiplexing encoder by the two-way standard transmission stream of synchronous control signal effect; Described synchronous control system comprises that secondary multiplexing encoder and quality services unpack adapter; Demultiplexing system in the demultiplexing of described synchronous three-dimensional audio frequency and video, decompression and the display system is by binocular quality of data service transmission; Decompression systems wherein is the two-way audio/video decoder by the synchronous control signal effect; Display system wherein is independently LCDs or the plasma panel that corresponds respectively to left and right sides binocular.
The synchronous control system of wherein said synchronous control system and quality services transmission control system is exactly to receive and sending the two ends basis at binocular, take, the system that the time difference of encoder or decoder is adjusted and controlled, wherein the quality services system solves time delay exactly, packet loss or network congestion and the re-transmission taked, the system of the forward error correction and the methods such as group bag that interweave.
Description of drawings:
Fig. 1: based on of the present invention based on the three-dimensional audio frequency and video digital coding transmission method of transport stream and the schematic flow sheet of system;
Fig. 2: flow (TS) packets headers structural representation based on the three-dimensional audio frequency and video digital coding transmission method of transport stream and the standard transmission of system based on of the present invention;
Fig. 3: based on of the present invention based on the three-dimensional audio frequency and video digital coding transmission method of transport stream and the single channel audio and video standard transmission flow multiplex principle schematic of system;
Fig. 4: based on three-dimensional audio frequency and video digital coding transmission method and the secondary multiplexing of the system a kind of method A that encodes based on transport stream of the present invention;
Fig. 5: based on of the present invention based on transport stream three-dimensional audio frequency and video digital coding transmission method and the realization schematic block diagram of the secondary multiplexing coding method A of system;
Fig. 6: based on three-dimensional audio frequency and video digital coding transmission method and the secondary multiplexing of the system another kind of method B that encodes based on transport stream of the present invention;
Fig. 7: based on three-dimensional audio frequency and video digital coding transmission method and the secondary multiplexing coding method B of the system code stream form after multiplexing based on transport stream of the present invention;
Fig. 8: based on of the present invention based on the three-dimensional audio frequency and video digital coding transmission method of transport stream and the IP stack of system;
Fig. 9: calculate schematic diagram based on the three-dimensional audio frequency and video digital coding transmission method of transport stream and the RTP maximum load of system based on of the present invention;
Figure 10: based on of the present invention based on the three-dimensional audio frequency and video digital coding transmission method of transport stream and the secondary multiplexing coding method A encapsulation process schematic diagram of system;
Figure 11: based on of the present invention based on transport stream three-dimensional audio frequency and video digital coding transmission method and the secondary multiplexing coding method A of system do not do the two kinds of encapsulating methods that interweave;
Figure 12: based on of the present invention based on the three-dimensional audio frequency and video digital coding transmission method of transport stream and the secondary multiplexing coding method B encapsulation process schematic diagram of system;
Figure 13: based on of the present invention based on transport stream three-dimensional audio frequency and video digital coding transmission method and the secondary multiplexing coding method B of system do not do the two kinds of encapsulating methods that interweave;
Figure 14: based on of the present invention based on transport stream three-dimensional audio frequency and video digital coding transmission method and the host-host protocol schematic diagram of the embodiment that interweaves of secondary system multiplexing and encoding method B;
Figure 15: based on of the present invention based on transport stream three-dimensional audio frequency and video digital coding transmission method and the host-host protocol schematic diagram of another embodiment that interweaves of secondary system multiplexing and encoding method B;
Figure 16: based on of the present invention based on the three-dimensional audio frequency and video digital coding transmission method of transport stream and the forward error correction flow chart of system.
Embodiment:
With reference to accompanying drawing, following non-limiting example will be explained in more detail to technical scheme of the present invention, so that those skilled in the art better understand the present invention.
As long as just can realize the synchronous of audio frequency and video in order to make receiving terminal do simple processing, the present invention proposes a kind of based on the synchronous method of transport stream.Its basic procedure as shown in Figure 1.
MPEG-2 is as the most ripe current digital video solution, for chip design merchant, equipment manufacturers and institute of operator generally accept, Disposition ﹠ Operation.Because TS stream has the ability of stronger opposing transmission error code, and, can adopt method for synchronous based on TS stream for more good utilisation existing device and network.
The TS bag is a regular length, its Bao Changwei 188Bytes.A TS bag is formed (packet header+payload) by the connector stem of 4Bytes, the self adaptation prefix and the valid data load of variable length byte, and its packet header structure is seen Fig. 2, and wherein PID is the bag identifier, and OPCR is an original program clock reference.
TS stream is for importing to such an extent that the coded format of audio/video flow is hard-core, can support MPEG1/2/4, VC1 and H.264 wait various encoding and decoding standards, its basic skills is that the coded data after the non-MPEG-2 compression standard compression is encapsulated into TS and goes in flowing as meeting.Its principle of multiplexing as shown in Figure 3.
Scheme provided by the present invention is actually based on multiplexed simultaneous techniques: be with the data multiplex to of two kinds of Media Streams of an audio frequency and video TS stream, thereby make them keep correlation between medium naturally in transmission, to reach purpose synchronous between medium.The recipient need not again synchronous, realizes simple.
Audio frequency and video are multiplexed into the back transmission of TS stream and use unique port.This method has increased the quantity that can serve, and its performance collision when having eliminated the audio and video stream that is applied to separate at two ports of client.Voice ﹠ Video is provided explicit synchronously.Reduced the overhead of head.Make the improvement of audio or video quality.And can reduce the buffer size of receiver all sidedly.
Be solution left and right sides two-way audio video synchronization problem, the two-way audio/video flow is alignd bundlees transmission.
The such scheme transmitting terminal has been taked the Synchronization Control strategy of prevention mechanism, and what packet loss, shake brought during network change is little than the former to inconsistent influence for left and right sides passage frame of video, and the receiving terminal Synchronous Processing is easier to.
Multiplexing sealing can be adopted following scheme to TS stream:
The multiplexing a kind of method A of left and right sides binocular TS stream secondary coding is as shown in Figure 4, be MPTS (MPTS stream) with left and right sides two-way audio frequency and video by the two-way program multiplexing earlier, seal again, the multiplexing difference of itself and common Polymera be exactly left and right sides two-way audio/video flow be fully synchronous, concrete realization can be with reference to figure 5.
MPTS directly seals as the load of RTP bag, and as shown in figure 11, its encapsulation process as shown in figure 10.
The multiplexing another kind of method B of left and right sides binocular TS stream secondary coding is as shown in Figure 6, earlier left and right sides two-way audio frequency and video transport stream is multiplexed into single binocular data flow shown in Figure 7 by the TS inter-packet gap, seals again, and as shown in figure 13, its encapsulation process as shown in figure 12.
In order to solve the packet loss problem of data in Network Transmission, the technical scheme below adopting:
A. the group that interweaves bag
When RTP packing carries a series of continuous audio frequency and video TS stream bag, if this packet loss, can cause receiving terminal to produce the decoding gap.Can adopt the mode of intersection group bag to alleviate this problem.This is to spend the robustness that very little cost realizes strengthening packet loss.Specific implementation method such as Figure 14, Figure 15.
The B.FEC error correction method
The transmission of three-dimensional audio frequency and video is for quite strict in time-delay and synchronous requirement, so the unlikely problem that solves packet loss by simple re-transmission.Therefore adopt forward error correction (FEC) to solve packet loss problem on the network.Using of traditional error correcting code such as check code, RS sign indicating number, Hamming code etc. can provide fine error correction quality as the three-dimensional video-frequency transmission.
The FEC encoding and decoding technique is a kind of certain redundant data that adds in the data of transmitting terminal, through the overprotection operation, generates specific verification bag, and the packet of these verification bags and raw information composition is together sent.After receiving terminal is received these packets and verification bag, recover the packet that raw information is formed by the reconstruction of wrapping.
The audio/video flow inclusion of varying number gets up to produce a FEC bag, can cause in expense a different half-way house between time-delay and the recovery capability.This paper has proposed the parameter scheme that a kind of and three-dimensional audio/video flow critical data is associated according to the discontinuous characteristic of critical data in the three-dimensional audio/video flow.
Consider that the packet loss overwhelming majority that takes place in the network is losing of single bag.Consider to contain according to the transmission quality of internet and bandwidth and carry out the FEC computing between the significant data bag, produce the FEC bag at two.If expense is bigger, increase under the bandwidth ratio condition with higher and can carry out the FEC computing between the significant data bag in a plurality of containing, produce the FEC bag.
By top argumentation, this paper problem that the transmission on the internet runs at three-dimensional audio/video flow and difficulty propose corresponding solution, below we elaborate its host-host protocol.
Adopt the multiplexing mode of sealing of TS stream that following advantage is arranged:
1) audio frequency and video transmit simultaneously, reduce independent data stream.
2) TS can provide limited capacity wrong ability, and its fallibility is not to be difficult to stand when network condition is better.
3) the TS grouping can directly be exported/be imported to the hardware coder/decoder, comparatively general in this form in the application of transmission simultaneously.
The protocol stack of MPEG-2TS over IP as shown in Figure 8.
The RTP bag is the size of bag without limits, if but the too big meeting of packet causes the burst transmission at the IP layer.Burst transmission for fear of bottom may influence the use of agreements such as bottom RSVP.We do following the analysis to the bag size based on three-dimensional audio/video flow for this reason:
The largest frames structure of considering Ethernet is 1500bytes, and IP head length degree is 20bytes (not being with option), and the UDP head is 8bytes, and the RTP head is 12bytes.For not at the lower-layer protocols burst, the packet maximum length of RTP is 1460bytes.That is to say if the load length of RTP less than 1460 bytes, so at UDP, IP and network interface layer can burst transmission.The burst on upper strata has been avoided the burst of lower floor.The RTP maximum load is calculated schematic diagram as shown in Figure 9:
It is many more that a bag comprises TS fluxion amount, and then its expense proportion is more little, and is more little to the consumption of the network bandwidth.Can calculate in each RTP bag institute thus comprises TS stream bag number and can reach 7 at most.When the MPTS code stream after the multiplexing a kind of method A of secondary coding is multiplexing is sealed and wrapped into RTP, can comprise 7 TS streams in each RTP bag and wrap.
Single binocular data after the multiplexing a kind of method B of secondary coding is multiplexing consider should comprise at most the RTP bag 6 TS stream bags from the solution of two-way audio video synchronization, and each road comprises 3 TS stream bags.
Its host-host protocol:
Left and right sides two-way TS stream parlor shown in Figure 14 is inserted intersection-protocol;
Another left and right sides two-way TS stream parlor shown in Figure 15 is inserted intersection-protocol.
The RTP encapsulation scheme of TS, its encapsulation process such as Figure 12.
In order to reduce the influence of packet loss, also adopt the FEC method to three-dimensional audio frequency and video.The importance of each field in decoding is different in the data of TS stream, and some field is very important to decoder, may cause decoder can not decode or the decoding error accumulation if these message transmission are made mistakes.
In order better to guarantee service quality, this paper has also done to improve to RTP, and its principle is as follows:
1) the RTP bag of the transmitting terminal three-dimensional audio/video flow that to finish one group of quantity be n should calculate the verification bag simultaneously.At first be not to send all bags of every group to the opposite end, but only send packet, send packet after, then send request, the other side to return a feedback information.If the information that the opposite end is returned shows that packet receives successfully, then should organize the end of transmission, server then sends next group packet, and the verification bag abandons not to be sent out.
2) if 1) the bag number that shows reception that returns of opposite end is less than n, then sends the verification bag and remedies, and sends request then.If showing successfully to receive, the information that the opposite end is returned recovers n bag, then should the group end of transmission.Server then sends next grouping;
3) if 2) information returned of opposite end shows and receives the bag number that recovers less than n that server continues to send the verification bag that is lacked, and no longer requires client's feedback.
In a word, first transmit stage only passes packet, and two other transmit stage will be replenished the FEC grouping that needs.This three phases will start in succession to finish the transmission of each frame data, and one of four kinds of situations below having take place:
1) ACK indicates the grouping of required transmission of this stage all successfully to receive.
2) ACK indication packet loss number surpasses the startup thresholding of next stage, just surpasses the delay thresholding of video.
3) transmission ends is finished the 3rd transmit stage.
As shown in figure 16:
Because the available bandwidth of internet is dynamic change, very big to the transmission influence of three-dimensional audio/video flow, the application has proposed a kind of based on the adaptation mechanism of abandoning strategy.
The real time monitoring network code stream sends situation or obtains feedback information from receiving terminal, goes out the suitable parameters value according to these data computation and adopts the adaptation rate control method of abandoning based on initiatively.Promptly when the network bandwidth is not enough, wrap and reduce code check by initiatively abandon part TS at transmitting terminal, make itself and actual available network bandwidth coupling.This active abandon with Network Transmission in the essential difference of loss of data be that the latter is at random, uncontrollable.The position that the former then can control data " loses ".When having to obliterated data, should abandon which data so? different groupings is owing to the information type difference that comprises, and its importance is also different.According to the required bag that abandons of the different choice of importance.
Be encoded to example with MPEG-2, as system information (PSI, PCR) etc. most important these packet decoder of having lost can't be decoded,
The I frame data are more important than B frame data in addition, because lose the data of a B frame frame before and after it all do not had influence, and the data of losing an I frame then can influence all P frames in its back and B frame.So should at first abandon the B frame data, be from I frame P frame far away then, be from the nearer P frame of I frame once more, be only the I frame data at last." initiatively abandoning " process of frame data is finished in " transmission buffering area " by adaptive scheduling and adjuster control." transmission buffering area " is divided into two parts, and a part is the FIFO that is used to send, and another part is to be used for the buffering area that temporary transient storage has sent grouping.During transmission " adaptive scheduling and adjuster " according to the priority of data filling degree among the FIFO and application layer packet to be sent from low to high respectively decision abandon the B frame, the P frame is so that the TS bag of I frame.So that the code check and the network rate of FIFO output are complementary.Data volume after network availability bandwidth increases gradually among the FIFO can lower again gradually, when the FIFO filling degree is reduced to a certain thresholding when following, the TS bag that then stops respective frame being abandoned, and the code check of FIFO output is increased gradually, keeps and actual network rate coupling.
The process of initiatively abandoning was finished before the application layer packing, so receiving terminal is unaware of this process.
Can make various changes to above-mentioned, and not depart from scope of the present invention, the objective of the invention is, comprise and should be understood that exemplary with all substances illustrated in the accompanying drawings in the superincumbent description, but not determinate.Scope of the present invention is limited by appended claims, and can make the modification that does not depart from scope of the present invention to the foregoing description.
Claims (11)
1. three-dimensional audio frequency and video digital coding transmission method based on transport stream, it comprises the steps:
A. the twin camera that adopts stereo camera or adjust angle is taken under the effect of synchronous control signal synchronously, and the left and right sides binocular audio, video data that obtains compresses multiplexing under the effect of synchronous control signal respectively synchronously;
B. the left and right sides binocular audio, video data after will compressing is synchronously sealed respectively under the effect of synchronous control signal and is transport stream, and identifies about filling in transport stream;
C. the left and right sides binocular transport stream after will sealing is carried out the secondary multiplexing coding and is obtained single binocular data flow under the control of synchronizing signal, realizes that the dominance of left and right sides binocular audio, video data is synchronous;
D. the single binocular data flow behind the secondary multiplexing coding is sealed with RTP, then transmission;
E. compress adjustment, adjust synchronously and transmit adjustment according to the quality services Control and Feedback of receiving terminal;
F. receive the single binocular data after sealing from transmission network, under transmission service quality control, carry out RTP and separate and seal, feed back to the corresponding information of transmitting terminal simultaneously;
G. unpack the secondary multiplexing encoded data stream of being honored as a queen and carry out demultiplexing, the left and right sides binocular audio, video data transport stream of gained is further separated and is sealed, and solves corresponding left and right sides binocular audio, video data, tells the audio, video data of left and right sides binocular according to the tag slot;
H. carry out the decompression and the demultiplexing of left and right sides binocular audio, video data under the monitoring of synchronous control signal, relatively the time difference of left and right sides binocular audio, video data is adjusted and is made it convergent;
I. the binocular audio, video data of demultiplexing is realized three-dimensional the broadcast via display unit simultaneously.
2. the digitally coded transmission method of three-dimensional audio frequency and video based on transport stream as claimed in claim 1, wherein the single binocular data stream packets behind the secondary multiplexing coding is honored as a queen and is passed through Network Transmission.
3. the three-dimensional audio frequency and video digital coding transmission method based on transport stream as claimed in claim 1, wherein the single binocular data stream packets behind the secondary multiplexing coding is honored as a queen via the chnnel coding modulating system, utilizes the digital broadcasting technology to transmit.
4. the three-dimensional audio frequency and video digital coding transmission method based on transport stream as claimed in claim 1, wherein said transport stream are standard transmission stream, are coded in after wherein said binocular audio-visual data is multiplexing in the same standard transmission stream.
5. the three-dimensional audio frequency and video digital coding transmission method based on transport stream as claimed in claim 1, left order audio, video data and right order audio, video data are sealed based on RTP via alignment binding back in the standard transmission stream bag respectively in the wherein said binocular audio, video data.
6. the three-dimensional audio frequency and video digital coding transmission method based on transport stream as claimed in claim 1, left order audio, video data and right order audio, video data are sealed based on two-way program multiplexing multiple transport respectively in the wherein said binocular audio, video data, obtain single channel standard transmission stream, described single channel standard transmission stream is merged into multichannel standard transmission stream, and described multichannel standard transmission stream is sealed based on RTP.
7. as claim 5 or 6 described three-dimensional audio frequency and video digital coding transmission methods based on transport stream, wherein said RTP is sealed and is adopted intersection group packet mode to load described binocular audio, video data.
8. as claim 5 or 6 described three-dimensional audio frequency and video digital coding transmission methods based on transport stream, wherein said enveloping data adopts the institute of error correction method verification forward data packets for transmission in transmission, transmission can be adopted identical error correction method for Network Transmission and DVB, also can adopt different error correction methods.
9. the three-dimensional audio frequency and video digital coding transmission method based on transport stream as claimed in claim 8, during the wherein said verification of error correction method forward institute data packets for transmission, only the feedback information that returns when receiving terminal shows that received data packet is less than when presetting the bag number, and transmitting terminal just sends the verification bag and remedies.
10. the digitally coded coding transmission of three-dimensional audio frequency and video system based on transport stream, it comprises following subsystem:
1. synchronous three-dimensional audio frequency and video shooting, compression and multiplex system;
2. Synchronization Control and quality services transmission control system;
3. the demultiplexing of synchronous three-dimensional audio frequency and video, decompression and display system;
Wherein:
Shooting, collecting system in described synchronous three-dimensional audio frequency and video shooting, compression and the multiplex system be stereo camera or adjust angle and by the twin camera of synchronous control signal effect; Compressibility wherein is two-way is taken the compressed encoding that synchronous difference adjusts and carried out the multiplexing two-way encoder of audio-visual synchronization by synchronous control system control; Multiplex system wherein is to seal adapter and binocular data secondary multiplexing encoder by the two-way standard transmission stream of synchronous control signal effect;
Described synchronous control system comprises that secondary multiplexing encoder and quality services unpack adapter;
Demultiplexing system in the demultiplexing of described synchronous three-dimensional audio frequency and video, decompression and the display system is by binocular quality of data service transmission; Decompression systems wherein is the two-way audio/video decoder by the synchronous control signal effect; Display system wherein is independently LCDs or the plasma panel that corresponds respectively to left and right sides binocular.
11. the digitally coded coding transmission of the three-dimensional audio frequency and video system based on transport stream as claimed in claim 10, the synchronous control system of wherein said synchronous control system and quality services transmission control system is exactly to receive and sending the two ends basis at binocular, take, the system that the time difference of encoder or decoder is adjusted and controlled, wherein the quality services system solves time delay exactly, packet loss or network congestion and the re-transmission taked, the system of the forward error correction and the methods such as group bag that interweave.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710002455 CN101232623A (en) | 2007-01-22 | 2007-01-22 | System and method for transmitting stereo audio and video numerical coding based on transmission stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710002455 CN101232623A (en) | 2007-01-22 | 2007-01-22 | System and method for transmitting stereo audio and video numerical coding based on transmission stream |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101232623A true CN101232623A (en) | 2008-07-30 |
Family
ID=39898751
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200710002455 Pending CN101232623A (en) | 2007-01-22 | 2007-01-22 | System and method for transmitting stereo audio and video numerical coding based on transmission stream |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101232623A (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102131097A (en) * | 2011-03-21 | 2011-07-20 | 中国电信股份有限公司 | Method and system for transmitting 3D streaming media |
| CN102148952A (en) * | 2010-02-05 | 2011-08-10 | 鸿富锦精密工业（深圳）有限公司 | Video image compression method and playing method thereof |
| CN102223518A (en) * | 2010-04-14 | 2011-10-19 | 鸿富锦精密工业（深圳）有限公司 | Stereoscopic digital imaging monitoring system and stereoscopic digital imaging monitoring method |
| CN102244796A (en) * | 2010-05-10 | 2011-11-16 | 联发科技股份有限公司 | Stream processing method and stream processing apparatus |
| CN102316252A (en) * | 2010-06-30 | 2012-01-11 | 宁波Gqy视讯股份有限公司 | Stereophonic network shooting terminal for monitoring |
| CN102364952A (en) * | 2011-10-25 | 2012-02-29 | 浙江万朋网络技术有限公司 | Method for processing audio and video synchronization in simultaneous playing of a plurality of paths of audio and video |
| CN102549957A (en) * | 2009-10-09 | 2012-07-04 | 汤姆森特许公司 | A digital receiver and corresponding digital transmission system server |
| CN102780896A (en) * | 2012-05-31 | 2012-11-14 | 新奥特（北京）视频技术有限公司 | Method for supporting three-dimensional (3D) technology through stream media materials |
| CN103220543A (en) * | 2013-04-25 | 2013-07-24 | 同济大学 | Real time three dimensional (3D) video communication system and implement method thereof based on Kinect |
| CN103262554A (en) * | 2010-12-07 | 2013-08-21 | 三星电子株式会社 | Transmitter and receiver for transmitting and receiving multimedia content, and reproduction method therefor |
| CN103338353A (en) * | 2013-06-17 | 2013-10-02 | 中国人民银行印制科学技术研究所 | Image acquisition, transmission and storage system |
| CN103685966A (en) * | 2012-09-19 | 2014-03-26 | 联想(北京)有限公司 | Electronic device and image acquisition method |
| CN105306867A (en) * | 2014-06-05 | 2016-02-03 | 掌赢信息科技（上海）有限公司 | Method, device and system for improving end-to-end video transmission quality |
| CN105550976A (en) * | 2015-12-15 | 2016-05-04 | 上海华力创通半导体有限公司 | Real-time image data receiving fault-tolerant method for accidental bus bandwidth insufficiency |
| CN105684383A (en) * | 2014-09-25 | 2016-06-15 | 华为技术有限公司 | Data packet transmission device, system and method |
| CN105763867A (en) * | 2016-04-20 | 2016-07-13 | 青岛海信电器股份有限公司 | Processing method and apparatus of 3D display signal, and 3D player |
| US9491437B2 (en) | 2010-12-07 | 2016-11-08 | Samsung Electronics Co., Ltd. | Transmitter for transmitting data for constituting content, receiver for receiving and processing data, and method therefor |
| CN108337320A (en) * | 2012-04-13 | 2018-07-27 | 高盛有限责任公司 | The system and method being distributed for expansible structural data |
| CN109450606A (en) * | 2019-01-07 | 2019-03-08 | 北京三体云联科技有限公司 | Data transmit management-control method and device |
-
2007
- 2007-01-22 CN CN 200710002455 patent/CN101232623A/en active Pending
Cited By (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102549957B (en) * | 2009-10-09 | 2015-09-30 | 汤姆森特许公司 | Digit receiver and corresponding digital transmission system server |
| CN102549957A (en) * | 2009-10-09 | 2012-07-04 | 汤姆森特许公司 | A digital receiver and corresponding digital transmission system server |
| US9143270B2 (en) | 2009-10-09 | 2015-09-22 | Thomson Licensing | Digital receiver and corresponding digital transmission system server |
| CN102148952B (en) * | 2010-02-05 | 2013-12-11 | 鸿富锦精密工业（深圳）有限公司 | Video image compression method and playing method thereof |
| CN102148952A (en) * | 2010-02-05 | 2011-08-10 | 鸿富锦精密工业（深圳）有限公司 | Video image compression method and playing method thereof |
| CN102223518A (en) * | 2010-04-14 | 2011-10-19 | 鸿富锦精密工业（深圳）有限公司 | Stereoscopic digital imaging monitoring system and stereoscopic digital imaging monitoring method |
| CN102244796A (en) * | 2010-05-10 | 2011-11-16 | 联发科技股份有限公司 | Stream processing method and stream processing apparatus |
| CN102316252A (en) * | 2010-06-30 | 2012-01-11 | 宁波Gqy视讯股份有限公司 | Stereophonic network shooting terminal for monitoring |
| US9491437B2 (en) | 2010-12-07 | 2016-11-08 | Samsung Electronics Co., Ltd. | Transmitter for transmitting data for constituting content, receiver for receiving and processing data, and method therefor |
| US9628771B2 (en) | 2010-12-07 | 2017-04-18 | Samsung Electronics Co., Ltd. | Transmitter and receiver for transmitting and receiving multimedia content, and reproduction method therefor |
| CN103262554A (en) * | 2010-12-07 | 2013-08-21 | 三星电子株式会社 | Transmitter and receiver for transmitting and receiving multimedia content, and reproduction method therefor |
| CN102131097B (en) * | 2011-03-21 | 2016-05-18 | 中国电信股份有限公司 | 3D flow-medium transmission method and system |
| CN102131097A (en) * | 2011-03-21 | 2011-07-20 | 中国电信股份有限公司 | Method and system for transmitting 3D streaming media |
| CN102364952A (en) * | 2011-10-25 | 2012-02-29 | 浙江万朋网络技术有限公司 | Method for processing audio and video synchronization in simultaneous playing of a plurality of paths of audio and video |
| CN108337320A (en) * | 2012-04-13 | 2018-07-27 | 高盛有限责任公司 | The system and method being distributed for expansible structural data |
| US10904308B2 (en) | 2012-04-13 | 2021-01-26 | Goldman Sachs & Co. LLC | Systems and methods for scalable structured data distribution |
| CN108337320B (en) * | 2012-04-13 | 2020-09-01 | 高盛有限责任公司 | System and method for scalable structured data distribution |
| CN102780896A (en) * | 2012-05-31 | 2012-11-14 | 新奥特（北京）视频技术有限公司 | Method for supporting three-dimensional (3D) technology through stream media materials |
| CN103685966A (en) * | 2012-09-19 | 2014-03-26 | 联想(北京)有限公司 | Electronic device and image acquisition method |
| CN103220543B (en) * | 2013-04-25 | 2015-03-04 | 同济大学 | Real time three dimensional (3D) video communication system and implement method thereof based on Kinect |
| CN103220543A (en) * | 2013-04-25 | 2013-07-24 | 同济大学 | Real time three dimensional (3D) video communication system and implement method thereof based on Kinect |
| CN103338353A (en) * | 2013-06-17 | 2013-10-02 | 中国人民银行印制科学技术研究所 | Image acquisition, transmission and storage system |
| CN105306867A (en) * | 2014-06-05 | 2016-02-03 | 掌赢信息科技（上海）有限公司 | Method, device and system for improving end-to-end video transmission quality |
| CN105684383A (en) * | 2014-09-25 | 2016-06-15 | 华为技术有限公司 | Data packet transmission device, system and method |
| CN105550976B (en) * | 2015-12-15 | 2019-03-15 | 上海华力创通半导体有限公司 | For the sporadic insufficient image data real-time reception fault-tolerance approach of bus bandwidth |
| CN105550976A (en) * | 2015-12-15 | 2016-05-04 | 上海华力创通半导体有限公司 | Real-time image data receiving fault-tolerant method for accidental bus bandwidth insufficiency |
| CN105763867A (en) * | 2016-04-20 | 2016-07-13 | 青岛海信电器股份有限公司 | Processing method and apparatus of 3D display signal, and 3D player |
| CN109450606A (en) * | 2019-01-07 | 2019-03-08 | 北京三体云联科技有限公司 | Data transmit management-control method and device |
| CN109450606B (en) * | 2019-01-07 | 2021-07-06 | 北京世纪好未来教育科技有限公司 | Data transmission control method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101232623A (en) | System and method for transmitting stereo audio and video numerical coding based on transmission stream | |
| US7177357B2 (en) | Data processing system for stereoscopic 3-dimensional video based on MPEG-4 and method thereof | |
| KR102000260B1 (en) | Apparatus and method for transmitting/receiving multimedia frame in broadcast system | |
| US7864805B2 (en) | Buffering in streaming delivery | |
| US8335266B2 (en) | Expedited splicing of video streams | |
| CN101453639B (en) | Encoding, decoding method and system for supporting multi-path video stream of ROI region | |
| US8009742B2 (en) | Method and system for retransmitting internet protocol packet for terrestrial digital multimedia broadcasting service | |
| US20020003811A1 (en) | Method of encapsulation of data into transport packets of constant size | |
| KR20130040090A (en) | Apparatus and method for delivering multimedia data in hybrid network | |
| US20140317475A1 (en) | Adaptive Forward Error Correction (FEC) System and Method | |
| WO2013098811A1 (en) | Packets recovery system and method | |
| CN101193289A (en) | A real time conversion method from MPEG-4 transmission code stream to Internet stream media alliance stream | |
| EP1491009A2 (en) | Media transmitting method, media receiving method, media transmitter and media receiver | |
| CN102752669A (en) | Transfer processing method and system for multi-channel real-time streaming media file and receiving device | |
| WO2009114557A1 (en) | System and method for recovering the decoding order of layered media in packet-based communication | |
| CN104079870A (en) | Video monitoring method and system for single-channel video and multiple-channel audio frequency | |
| JP2004537226A (en) | System and method for broadcasting separately encoded signals over ATSC channels | |
| WO2006066454A1 (en) | A method for transmitting the multichannel video sources on video conferencing system | |
| CN101193290A (en) | A real time conversion system from MPEG-4 transmission code stream to Internet stream media alliance stream | |
| US20040190629A1 (en) | System and method for broadcast of independently encoded signals on atsc channels | |
| KR20180000320A (en) | Method and apparatus for transmitting timed metadata in hybrid broadcating service | |
| CN111131785A (en) | MPEG-4 video transmission system based on DirectShow | |
| KR100881312B1 (en) | Apparatus and Method for encoding/decoding multi-channel audio signal, and IPTV thereof | |
| Shuaib et al. | De-jittering in the transport of MPEG-4 and MPEG-2 video over ATM | |
| Papadimatos et al. | Performance analysis of a selective rejection algorithm on compressed disparity data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20080730 |