CN105898353A - Real-time audio and video transmission method and device, transmission stream packaging method and multiplexer - Google Patents
Real-time audio and video transmission method and device, transmission stream packaging method and multiplexer Download PDFInfo
- Publication number
- CN105898353A CN105898353A CN201510869931.XA CN201510869931A CN105898353A CN 105898353 A CN105898353 A CN 105898353A CN 201510869931 A CN201510869931 A CN 201510869931A CN 105898353 A CN105898353 A CN 105898353A
- Authority
- CN
- China
- Prior art keywords
- primary flow
- video
- program
- packet
- audio frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 66
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000004806 packaging method and process Methods 0.000 title claims abstract description 11
- 230000015572 biosynthetic process Effects 0.000 claims description 5
- 238000013507 mapping Methods 0.000 claims description 5
- 230000006978 adaptation Effects 0.000 description 6
- 230000006835 compression Effects 0.000 description 5
- 238000007906 compression Methods 0.000 description 5
- 238000012856 packing Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000010304 firing Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23113—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving housekeeping operations for stored content, e.g. prioritizing content for deletion because of storage space restrictions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23608—Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23614—Multiplexing of additional data and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2362—Generation or processing of Service Information [SI]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a real-time audio and video transmission method. The method comprises the steps that original video stream and audio stream are respectively packaged as grouped video original stream and grouped audio original stream; a program association table, a program map table, the grouped video original stream and the grouped audio original stream are multiplexed and stored as program slices, wherein each program slice comprises a program association table and a program map table; and a request is received, and the program slices are transmitted according to the request. The invention further provides a transmission stream packaging method and a multiplexer. According to the invention, redundant data produced in real-time audio and video transmission can be reduced.
Description
Technical field
The present embodiments relate to technical field of audio/video, particularly relate to a kind of audio frequency and video live transmission method
And device, transmission stream packaging method and multiplexer.
Background technology
HLS (HTTP Live Streaming) agreement is that Apple develops, and is used in network direct broadcasting
With the extension http protocol in program request scene, this agreement uses transmission stream (Transport Stream, TS)
Mode encapsulation of data.Each transmission stream carries the data such as video (Video), audio frequency (Audio)
Information, and carry Program Association Table (Program Association Table, PAT), program map
The stream index information such as table (Program Map Table, PMT).
In live, search correct to allow user can be reached by Program Association Table and Program Map Table
Video and voice data, need Program Association Table and Program Map Table are periodically inserted into transmission stream
In.
Owing to periodically inserting Program Association Table and Program Map Table, the section at HLS can be made excessive,
Not only occupy download time, and cause more time delays in live middle meeting and take more clothes
Business device memory space.
Summary of the invention
The embodiment of the present invention provide a kind of audio frequency and video live transmission method and device, transmission stream packaging method and
Multiplexer, the technical problem that during in order to solve prior art middle pitch realtime video transmission, redundant data is too much.
The embodiment of the present invention provides a kind of audio frequency and video live transmission method, including:
Video primary flow and audio frequency primary flow are packaged as respectively video primary flow and the audio frequency of packet of packet
Primary flow；
By Program Association Table, Program Map Table, the video primary flow of described packet, and described packet
Being stored as program section after audio frequency primary flow multiplexing, the section of each described program includes a programming association
Table and a Program Map Table；
Receive request, and transmit the section of described program according to described request.
Further, the above-mentioned video being packaged as respectively being grouped by video primary flow and audio frequency primary flow is original
Include before the audio frequency primary flow step of stream and packet: video data and voice data are separately encoded formation
Described video primary flow and described audio frequency primary flow.
The embodiment of the present invention provides one transmission stream packaging method, including:
Receive the video primary flow of packet, the audio frequency primary flow of packet, Program Association Table, a joint
Mesh mapping table；
By a described Program Association Table, a described Program Map Table, the video primary flow of described packet,
And the audio frequency primary flow of described packet is multiplexed with one section of program section；
Store described one section of program section.
Further, the video primary flow of above-mentioned reception packet, the audio frequency primary flow of packet, a program
Also include before contingency table, a Program Map Table step；
Video primary flow and audio frequency primary flow are packaged as respectively video primary flow and the audio frequency of packet of packet
Primary flow, and the step exported.
The embodiment of the present invention provides a kind of audio frequency and video real-time Transmission device, including:
Video packetizer, for being packaged as the video primary flow of packet by video primary flow；
Audio packet device, for being packaged as the audio frequency primary flow of packet by audio frequency primary flow；
Multiplexer, for by Program Association Table, Program Map Table, the video primary flow of described packet, with
And after the audio frequency primary flow multiplexing of described packet, it being stored as program section, the section of each described program includes
One Program Association Table and a Program Map Table；
Described multiplexer, is additionally operable to receive request, and transmits the section of described program according to described request.
Further, above-mentioned device, also include:
Video encoder, for forming described video primary flow by video data encoding.
Further, above-mentioned device, also include:
Audio coder, for being separately encoded the described audio frequency primary flow of formation by voice data.
The embodiment of the present invention provides a kind of multiplexer, including:
Transceiver module, for receiving the video primary flow of packet, the audio frequency primary flow of packet, a program
Contingency table, a Program Map Table, and export；
Program section Multiplexing module, for by a described Program Association Table, a described Program Map Table,
The video primary flow of described packet, and the audio frequency primary flow of described packet is multiplexed with the section of one section of program；
Memory module, is used for storing described one section of program section.
Further, above-mentioned transceiver module is connected with video packetizer and audio packet device, described video
Burster and audio packet device are former to the video primary flow of described transceiver module output grouping and the audio frequency of packet
Begin stream.
The audio frequency and video live transmission method of embodiment of the present invention offer and device, transmission is flowed packaging method and answers
With device, it is not necessary to periodically insert Program Association Table and Program Map Table, and only need in each section
Beginning add a Program Association Table and a Program Map Table, it is possible to reach both can keep with existing
There is the transmission stream in technology compatible, reduce the effect of the redundant data transmitted in stream the most simultaneously.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to reality
Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that under,
Accompanying drawing during face describes is some embodiments of the present invention, for those of ordinary skill in the art,
On the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the form schematic diagram of the section transmitting stream in prior art；
Fig. 2 is that the form of the section of the transmission stream of the embodiment of the present invention a kind of audio frequency and video live transmission method shows
It is intended to；
Fig. 3 is the structure of the bag of the section of the transmission stream of the embodiment of the present invention a kind of audio frequency and video live transmission method
Become schematic diagram；
Fig. 4 is the flow chart of the embodiment of the present invention a kind of audio frequency and video live transmission method；
Fig. 5 is a kind of flow chart transmitting stream packaging method of the embodiment of the present invention；
Fig. 6 is a kind of process of analysis figure transmitting stream section of the embodiment of the present invention；
Fig. 7 is the structural representation of the embodiment of the present invention a kind of audio frequency and video real-time Transmission device；
Fig. 8 is the structural representation of a kind of multiplexer of the embodiment of the present invention.
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with this
Accompanying drawing in bright embodiment, is clearly and completely described the technical scheme in the embodiment of the present invention,
Obviously, described embodiment is a part of embodiment of the present invention rather than whole embodiments.Based on
Embodiment in the present invention, those of ordinary skill in the art are obtained under not making creative work premise
The every other embodiment obtained, broadly falls into the scope of protection of the invention.
For better illustrating technical scheme and produced beneficial effect, the present invention of the embodiment of the present invention
To first introduce the form of the section transmitting stream in prior art.
Fig. 1 is the form schematic diagram of the section transmitting stream in prior art.
Transmission stream is the encapsulation format of hierarchical, needs first to find Program Association Table, to obtain in transmission stream
The quantity of Program Map Table, obtains the quantity of program in transmission stream with this, and each of which opens Program Map Table
A corresponding program, then obtains the video bag indications (Packet of program further according to Program Map Table
Identification, PID) and audio pack indications.
According to the regulation of HLS protocol, long program is generally cut out when being divided into multiple a length of 10
The section of second.Therefore, transmitting the section of stream in prior art, user receives transmission stream at any time for convenience,
Program Association Table and Program Map Table are periodically to be inserted in the section of transmission stream, thus cause existing
The section of the transmission stream in technology at least includes the Program Association Table of more than two, and the program of more than two
Contingency table.
Such as, in Fig. 1, a program is cut into n section, and user A can be from Program Association Table
Receiving at 1, user B can receive at Program Association Table n, to find Program Map Table nearby, from
And facilitate live.Therefore, the redundant data during prior art increases transmission stream.
The present inventor, in finding in each section after long-time research, is not required to week
The insertion Program Association Table of phase property and Program Map Table, and only need to add in the beginning of each section one
Open Program Association Table and a Program Map Table, it is possible to reach both can keep and transmission of the prior art
Stream compatibility, reduces the effect of the redundant data transmitted in stream the most simultaneously.
Hereinafter the form that the present invention is transmitted the section of stream is illustrated.
Fig. 2 is that the form of the section of the transmission stream of the embodiment of the present invention a kind of audio frequency and video live transmission method shows
It is intended to.
Transmission stream in the embodiment of the present invention is a kind of stream based on bag, if each group of transmission stream is divided into
Dry section, it should be noted that the form that illustrate only a section in Fig. 2, the form of other section
In fact similar with the section form in Fig. 2.
Section in the embodiment of the present invention includes 1, wraps 2 ... bag n-1, bag n, and each section
All only include a Program Association Table and a Program Map Table.
Fig. 3 is the structure of the bag of the section of the transmission stream of the embodiment of the present invention a kind of audio frequency and video live transmission method
Become schematic diagram.
In the embodiment of the present invention, the bag of section is made up of packet header and data, and each bag is 188 bytes or 204
Individual byte, wherein the bag of 204 bytes is the CRC adding 16 bytes after the bag of 188 bytes
Verification data are formed.
Packet header can also include that extend uses district certainly, and packet header length accounts for 4 bytes, from using district and bag
Data account for 184 bytes altogether.Packet header includes sync byte, transmission error code designator, PU Payload Unit
Start indicator, transmission preferences, bag identifier, transmission scrambling control, self adaptation district control and count continuously
Number device 8 part composition.
Wherein it is possible to by the automatic correlation properties of the bit string of sync byte, the bag limit in detection data stream
System, sets up bag and synchronizes；Transmission error code designator, when having referred to indelible error code, uses error code school
Positive decoder can represent the error code of 1, but cannot correct this error code；PU Payload Unit start indicator,
Represent whether this bag exists the start information determined；Transmission preferences is with then giving bag allocation priority；Bao Biao
Show that identifier value is determined by user, by decoder according to the different primary flow (Elementary of bag indications difference
Stream, ES) bag, to rebuild primary flow；Transmission scrambling control may be used to indicate whether bag content adds
Disturb；Self adaptation district controls to be intended to indicate that whether self adaptation district, generally represents with 2, such as " 01 "
Indicate useful information, but without self adaptation district, " 10 " indicate without useful information, and have self adaptation district, " 11 "
Indicating useful information and have self adaptation district, " 00 " indicates without definition；Continuous counter can be to bag indications
Transmitting sequential counting, according to the reading of continuous counter, receiving terminal can decide whether packet loss and bag
Transmit sequence error.Sum it up, packet header has synchronization, identification, error detection and encryption function to transmission stream.
Additionally, bag indications is the unique recognition marks in transmission stream, the data content in bag is to be marked by bag
Show that symbol determines.If the bag indications in the packet header of a bag in a transmission stream is 0, then this bag
Data content be exactly Program Association Table, if not 0, it is simply that video data, voice data, program
Mapping table, or other types data.
Fig. 4 is the flow chart of the embodiment of the present invention a kind of audio frequency and video live transmission method.
The real-time Transmission of audio frequency and video includes the real-time Transmission to video data and the real-time biography to voice data
Defeated, it is therefore desirable to video primary flow and audio frequency primary flow to be packaged as the video primary flow of packet respectively and divides
The audio frequency primary flow of group；Then by Program Association Table, Program Map Table, the video primary flow of packet, with
And after the audio frequency primary flow multiplexing of packet, it being stored as program section, the section of each program includes a program
Contingency table and a Program Map Table, specific as follows:
Specifically comprising the following steps that of the packing of the video primary flow of packet
S101: video data encoding is formed video primary flow (Elementary Stream, ES)；
Video primary flow is the original base code stream exported by encoder, comprises only necessary to decoder,
And the information being close with original image.Video primary flow after coding can be MPEG-2 or MPEG-4
Form, it is also possible to being H.264 form or extended formatting, this is not construed as limiting by the present invention.
S102: video primary flow is packaged as packet video primary flow (Packet Elemental Stream,
PES)；
The video primary flow of packet, is to exist, mainly at video primary flow with the data packet form of segmentation
On added the descriptive information to Frame such as timestamp, the video primary flow of packet provide standard packet header and
Packaging method, and the time tag of decoding is provided.
Specifically comprising the following steps that of the packing of the audio frequency primary flow of packet
S201: audio data coding is formed audio frequency primary flow；
If digital audio and video signals directly transmits not compressedly, it will take great bandwidth, because of
This needs to use audio compression techniques to process voice data, could effectively transmit voice data.
Audio coding mode in this step can be MPEG-1 audio coding, it is also possible to be MPEG-2AAC
(Advanced Audio Coding) encodes, and this is not construed as limiting by the present invention.
S202: video primary flow is packaged as the audio frequency primary flow of packet.
202 audio frequency primary flow sections of being divided into of audio packet device or packing in groups, and add corresponding
Header file is packed into the audio frequency primary flow of packet, can be discontinuous between bag and the bag of audio frequency primary flow
's.
After the audio frequency primary flow of the video primary flow of packet, packet of having packed, enter step S300；
S300: audio frequency primary flow, Program Association Table and the program of the video primary flow of packet, packet are reflected
Being stored as program section after firing table multiplexing, the section of described program comprises a Program Association Table and a program
Mapping table.
Due to multiple sections of a length of 10 seconds when HLS protocol specifies to be partitioned into complete program, should
Multiple sections constitute a complete program, therefore until disconnecting the process of this link after link establishes
(i.e. watching the whole process of this program), the link being continued for the multiple sections downloading this program, should
Downloading process is using a byte as least unit, it is therefore desirable to periodically provide Program Association Table and joint
Mesh mapping table, to ensure that user can download section from arbitrfary point.
The minimum that the section comprising Program Association Table and Program Map Table is then flowed by the present embodiment as transmission
Unit, it is ensured that user can download section from arbitrfary point, the most both can keep and existing HLS protocol
Compatibility can periodically insert again Program Association Table and Program Map Table.
S400: receive request, and according to request transmission program section.
Fig. 5 is a kind of flow chart transmitting stream packaging method of the embodiment of the present invention.
S301: receive the video primary flow of packet, the audio frequency primary flow of packet, Program Association Table,
One Program Map Table；
S302: by a Program Association Table, Program Map Table, a video primary flow for packet, and
The audio frequency primary flow of packet is multiplexed with one section of program section；
S303: store one section of program section.
Fig. 6 is a kind of process of analysis figure transmitting stream section of the embodiment of the present invention:
501: searching programs contingency table；
Being in the present embodiment in units of 188 bytes, search bag indications is the Program Association Table of 0.
Owing to the bag indications of Program Association Table is to be fixed as 0, and Program Association Table is also the form transmission with bag,
So packet header Zhong Bao indications searched for the most exactly by searching programs contingency table is the bag of 0.
502: resolve Program Association Table, to obtain the bag indications of Program Map Table；
First resolving bag indications is the Program Association Table of 0, to obtain Program Map Table
Bag indications.
503: according to the bag indications searching programs mapping table of mapping table；
In the present embodiment, the quantity of Program Map Table is equal to the quantity of program.
504: according to bag indications and the bag indications of voice data of Program Map Table search video data；
In the present embodiment, the bag indications of search video data and the bag indications of voice data are exactly
Acquisition video data and voice data.
505: according to bag indications and the bag indications of voice data of video data, resolve video data and
Voice data.
Above-mentioned resolving is to be completed by receiving terminal, and receiving terminal is usually consumption electronic products, Ke Yiwei
Intelligent television, Set Top Box, projector, video player, personal computer, smart mobile phone, flat board electricity
Brain etc..
Fig. 7 is the structural representation of the embodiment of the present invention a kind of audio frequency and video real-time Transmission device.
Embodiment of the present invention one audio frequency and video real-time Transmission device 10 includes: video encoder 101, audio frequency
Encoder 201, video packetizer 102, audio packet device 202, and multiplexer 300.
Video data and voice data owing to collecting are analog data, it is therefore desirable to be sampled,
Quantify and compressed encoding forms video primary flow and audio frequency primary flow, video primary flow and audio frequency primary flow are
The continuous bit stream of not segmentation.
Video encoder 101 for forming video primary flow by video data encoding.In the present embodiment,
Video primary flow includes multiple access unit, and each accesses the coded data that unit is piece image.This
The Video coding mode of invention can use transition coding, entropy code, Motion estimation and compensation, or
Person is that hybrid coding mode encodes, and this is not construed as limiting by the present invention.
Audio coder 201 for being separately encoded formation audio frequency primary flow by voice data.At the present embodiment
In, if digital audio and video signals directly transmits not compressedly, it will take great bandwidth, because of
This needs to use audio compression techniques to process voice data, could effectively transmit voice data.
Digital Audio Compression Coding is on the premise of ensureing that signal does not produces distortion in terms of audition, to voice data
Signal carries out the biggest compression.Digital Audio Compression Coding is taked to remove existence of redundant in acoustical signal
Method realize.The audio coding mode of the present invention can be waveform coding, parameter coding, or mixed
Compiling in collaboration with code, this is not construed as limiting by the present invention.
Video packetizer 102 for being packaged as the video primary flow of packet by video primary flow.In details of the words,
102 video primary flow sections of being divided into of video packetizer or packing in groups, and add corresponding head literary composition
Part is packed into the video primary flow of packet, can be discontinuous between bag and the bag of video primary flow.
Audio packet device 202 for being packaged as the audio frequency primary flow of packet by audio frequency primary flow.In details of the words,
202 audio frequency primary flow sections of being divided into of audio packet device or packing in groups, and add corresponding head literary composition
Part is packed into the audio frequency primary flow of packet, can be discontinuous between bag and the bag of audio frequency primary flow.
Multiplexer 300 is used for Program Association Table, Program Map Table, the video primary flow of packet, and
Being stored as program section after the audio frequency primary flow multiplexing of packet, the section of each described program includes a joint
Mesh contingency table and a Program Map Table.In the present embodiment, program is closed by multiplexer 300 when transmission
Join table, Program Map Table, the video primary flow of packet, and the audio frequency primary flow of packet is packaged into fixing
The section of a length of 188 bytes.
Multiplexer 300, is additionally operable to receive request, and according to request transmission program section.
The above-mentioned audio frequency and video real-time Transmission device 100 that the embodiment of the present invention provides can have in actual applications
Body is applied in electronic equipment, can pass through hardware processor (hardware processor) and realize phase
Closing functional module, this electronic equipment is usually all kinds of video server.
Fig. 8 is the structural representation of a kind of multiplexer of the embodiment of the present invention.
Embodiment of the present invention one multiplexer 300 includes transceiver module 302, program section Multiplexing module 303,
And memory module 301.
Transceiver module 302 is for receiving the video primary flow of packet, the audio frequency primary flow of packet, a joint
Mesh contingency table, a Program Map Table, and export to program section Multiplexing module 303；
Program section Multiplexing module 303 is for by a Program Association Table, Program Map Table, a packet
Video primary flow, and the audio frequency primary flow of packet is multiplexed with the section of one section of program；
Memory module 301 is for one section of program section of storage.
By the technique scheme of the embodiment of the present invention, the present invention need not periodically insert program and closes
Connection table and Program Map Table, and only need to add a Program Association Table and in the beginning of each section
Open Program Map Table, it is possible to reach both can keep and transmission stream compatibility of the prior art, subtract the most simultaneously
The effect of the redundant data in few transmission stream.
Device embodiment described above is only schematically, wherein said illustrates as separating component
Unit can be or may not be physically separate, the parts shown as unit can be or
Person may not be physical location, i.e. may be located at a place, or can also be distributed to multiple network
On unit.Some or all of module therein can be selected according to the actual needs to realize the present embodiment
The purpose of scheme.Those of ordinary skill in the art are not in the case of paying performing creative labour, the most permissible
Understand and implement.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive each reality
The mode of executing can add the mode of required general hardware platform by software and realize, naturally it is also possible to by firmly
Part.Based on such understanding, the portion that prior art is contributed by technique scheme the most in other words
Dividing and can embody with the form of software product, this computer software product can be stored in computer can
Read in storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that one
Computer equipment (can be personal computer, server, or the network equipment etc.) performs each to be implemented
The method described in some part of example or embodiment.
Last it is noted that above example is only in order to illustrate technical scheme, rather than to it
Limit；Although the present invention being described in detail with reference to previous embodiment, the ordinary skill of this area
Personnel it is understood that the technical scheme described in foregoing embodiments still can be modified by it, or
Person carries out equivalent to wherein portion of techniques feature；And these amendments or replacement, do not make corresponding skill
The essence of art scheme departs from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (9)
1. an audio frequency and video live transmission method, it is characterised in that including:
Video primary flow and audio frequency primary flow are packaged as respectively video primary flow and the audio frequency of packet of packet
Primary flow；
By Program Association Table, Program Map Table, the video primary flow of described packet, and described packet
Being stored as program section after audio frequency primary flow multiplexing, the section of each described program includes a programming association
Table and a Program Map Table；
Receive request, and transmit the section of described program according to described request.
Method the most according to claim 1, it is characterised in that include described by video primary flow and
Audio frequency primary flow wraps before being packaged as the video primary flow of packet and the audio frequency primary flow step of packet respectively
Include: video data and voice data are separately encoded the described video primary flow of formation and described audio frequency primary flow.
3. a transmission stream packaging method, it is characterised in that including:
Receive the video primary flow of packet, the audio frequency primary flow of packet, Program Association Table, a joint
Mesh mapping table；
By a described Program Association Table, a described Program Map Table, the video primary flow of described packet,
And the audio frequency primary flow of described packet is multiplexed with one section of program section；
Store described one section of program section.
4. method as claimed in claim 3, it is characterised in that original at the video of described reception packet
Also include before stream, the audio frequency primary flow of packet, Program Association Table, a Program Map Table step；
Video primary flow and audio frequency primary flow are packaged as respectively video primary flow and the audio frequency of packet of packet
Primary flow, and the step exported.
5. an audio frequency and video real-time Transmission device, it is characterised in that including:
Video packetizer, for being packaged as the video primary flow of packet by video primary flow；
Audio packet device, for being packaged as the audio frequency primary flow of packet by audio frequency primary flow；
Multiplexer, for by Program Association Table, Program Map Table, the video primary flow of described packet, with
And after the audio frequency primary flow multiplexing of described packet, it being stored as program section, the section of each described program includes
One Program Association Table and a Program Map Table；
Described multiplexer, is additionally operable to receive request, and transmits the section of described program according to described request.
Device the most according to claim 5, it is characterised in that also include:
Video encoder, for forming described video primary flow by video data encoding.
Device the most according to claim 5, it is characterised in that also include:
Audio coder, for being separately encoded the described audio frequency primary flow of formation by voice data.
8. a multiplexer, it is characterised in that including:
Transceiver module, for receiving the video primary flow of packet, the audio frequency primary flow of packet, a program
Contingency table, a Program Map Table, and export；
Program section Multiplexing module, for by a described Program Association Table, a described Program Map Table,
The video primary flow of described packet, and the audio frequency primary flow of described packet is multiplexed with the section of one section of program；
Memory module, is used for storing described one section of program section.
9. multiplexer as claimed in claim 3, it is characterised in that described transceiver module and video packets
Device and audio packet device connect, and described video packetizer and audio packet device are to the output point of described transceiver module
The video primary flow of group and the audio frequency primary flow of packet.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510869931.XA CN105898353A (en) | 2015-12-01 | 2015-12-01 | Real-time audio and video transmission method and device, transmission stream packaging method and multiplexer |
| PCT/CN2016/096991 WO2017092435A1 (en) | 2015-12-01 | 2016-08-26 | Method and device for audio/video real-time transmission, transmission stream packing method, and multiplexer |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510869931.XA CN105898353A (en) | 2015-12-01 | 2015-12-01 | Real-time audio and video transmission method and device, transmission stream packaging method and multiplexer |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105898353A true CN105898353A (en) | 2016-08-24 |
Family
ID=57002114
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510869931.XA Pending CN105898353A (en) | 2015-12-01 | 2015-12-01 | Real-time audio and video transmission method and device, transmission stream packaging method and multiplexer |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105898353A (en) |
| WO (1) | WO2017092435A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017092435A1 (en) * | 2015-12-01 | 2017-06-08 | 乐视控股（北京）有限公司 | Method and device for audio/video real-time transmission, transmission stream packing method, and multiplexer |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1601937A (en) * | 2003-09-25 | 2005-03-30 | 三星电子株式会社 | Apparatus and method for servicing both wide area broadcasting and local area broadcasting and terminal for receiving the broadcast |
| CN1980375A (en) * | 2005-12-07 | 2007-06-13 | 中国科学院研究生院 | Method for real-time inserting signature and identifying signature indigit TV transmission flow |
| CN101406063A (en) * | 2006-04-06 | 2009-04-08 | 三星电子株式会社 | Method and apparatus for transmitting digital broadcasting signal in advanced-VSB (A-VSB) system in which transport packet without adaptation field is provided at fixed location in data field slices |
| US20110202674A1 (en) * | 2006-11-03 | 2011-08-18 | Apple Computer, Inc. | Dynamic Adjustments of Video Streams |
| CN103067745A (en) * | 2011-10-24 | 2013-04-24 | 北大方正集团有限公司 | Video data segmentation method, video data segmentation device, video data online editing method and video data online editing system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898353A (en) * | 2015-12-01 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Real-time audio and video transmission method and device, transmission stream packaging method and multiplexer |
-
2015
- 2015-12-01 CN CN201510869931.XA patent/CN105898353A/en active Pending
-
2016
- 2016-08-26 WO PCT/CN2016/096991 patent/WO2017092435A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1601937A (en) * | 2003-09-25 | 2005-03-30 | 三星电子株式会社 | Apparatus and method for servicing both wide area broadcasting and local area broadcasting and terminal for receiving the broadcast |
| CN1980375A (en) * | 2005-12-07 | 2007-06-13 | 中国科学院研究生院 | Method for real-time inserting signature and identifying signature indigit TV transmission flow |
| CN101406063A (en) * | 2006-04-06 | 2009-04-08 | 三星电子株式会社 | Method and apparatus for transmitting digital broadcasting signal in advanced-VSB (A-VSB) system in which transport packet without adaptation field is provided at fixed location in data field slices |
| US20110202674A1 (en) * | 2006-11-03 | 2011-08-18 | Apple Computer, Inc. | Dynamic Adjustments of Video Streams |
| CN103067745A (en) * | 2011-10-24 | 2013-04-24 | 北大方正集团有限公司 | Video data segmentation method, video data segmentation device, video data online editing method and video data online editing system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017092435A1 (en) * | 2015-12-01 | 2017-06-08 | 乐视控股（北京）有限公司 | Method and device for audio/video real-time transmission, transmission stream packing method, and multiplexer |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017092435A1 (en) | 2017-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10869106B2 (en) | Data transmission method and apparatus, and electronic device | |
| CN105009595B (en) | Sending device, sending method, receiving device and method of reseptance | |
| US8289998B2 (en) | Method and apparatus for generating three (3)-dimensional image data stream, and method and apparatus for receiving three (3)-dimensional image data stream | |
| KR101639358B1 (en) | Transmission apparatus and method, and reception apparatus and method for providing 3d service using the content and additional image seperately transmitted with the reference image transmitted in real time | |
| CN103141069B (en) | For retrieving the method and system with transmitting multimedia data | |
| CN105915493A (en) | Audio and video real-time transmission method and device and audio and video real-time playing method and device | |
| CN103765914A (en) | Network streaming of coded video data | |
| CN107113462A (en) | Sending method, method of reseptance, dispensing device and reception device | |
| CN105393547B (en) | Sending method, method of reseptance, sending device and reception device | |
| CN107431845A (en) | Sending method, method of reseptance, dispensing device and reception device | |
| CN102783167A (en) | Method and apparatus for generating and reproducing adaptive stream based on file format, and recording medium thereof | |
| JP2016029816A (en) | Transmitter, transition method, receiver and reception method | |
| CN108141636A (en) | Reception device and method of reseptance | |
| CN106134208A (en) | Transmission equipment, sending method, reception equipment and method of reseptance | |
| CN103888813A (en) | Audio and video synchronization realization method and system | |
| US8798441B2 (en) | Recording apparatus and recording system | |
| CN101690200A (en) | Method and apparatus for providing high-quality multimedia service in dmb system | |
| US7555009B2 (en) | Data processing method and apparatus, and data distribution method and information processing apparatus | |
| US11356749B2 (en) | Track format for carriage of event messages | |
| EP2685729A2 (en) | Transmission device and method for providing program-linked stereoscopic broadcasting service, and reception device and method for same | |
| JP2021036721A (en) | Transmission apparatus, transmitting method, receiving apparatus, and receiving method | |
| KR102407513B1 (en) | Transmission device, transmission method, reception device, and reception method | |
| CN105916011A (en) | Video real-time playing method and device | |
| CN105898353A (en) | Real-time audio and video transmission method and device, transmission stream packaging method and multiplexer | |
| US20110096775A1 (en) | System and method for multiplexing and streaming contents |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160824 |
|
| WD01 | Invention patent application deemed withdrawn after publication |