CN105847873B - HD video code stream and data multiplexing system and method towards monitoring application - Google Patents

HD video code stream and data multiplexing system and method towards monitoring application Download PDF

Info

Publication number
CN105847873B
CN105847873B CN201610322317.6A CN201610322317A CN105847873B CN 105847873 B CN105847873 B CN 105847873B CN 201610322317 A CN201610322317 A CN 201610322317A CN 105847873 B CN105847873 B CN 105847873B
Authority
CN
China
Prior art keywords
data
packet
code stream
field
video code
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610322317.6A
Other languages
Chinese (zh)
Other versions
CN105847873A (en
Inventor
王勇
及翠婷
宫丰奎
张南
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xidian University
Original Assignee
Xidian University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xidian University filed Critical Xidian University
Priority to CN201610322317.6A priority Critical patent/CN105847873B/en
Publication of CN105847873A publication Critical patent/CN105847873A/en
Application granted granted Critical
Publication of CN105847873B publication Critical patent/CN105847873B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/10Active monitoring, e.g. heartbeat, ping or trace-route
    • H04L43/106Active monitoring, e.g. heartbeat, ping or trace-route using time related information in packets, e.g. by adding timestamps
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23608Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614Multiplexing of additional data and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385Channel allocation; Bandwidth allocation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389Multiplex stream processing, e.g. multiplex stream encrypting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2407Monitoring of transmitted content, e.g. distribution time, number of downloads
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H04N21/4351Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving reassembling additional data, e.g. rebuilding an executable program from recovered modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention discloses a kind of HD video code streams and data multiplexing system and method towards monitoring application, mainly solve the problems, such as that transmission band utilization rate is low low with data transmission credibility in existing code stream multiplex technology.Its system includes data packaging unit (1) and data Multiplexing Unit (2);The data packaging unit (1) generates and adds empty packet time stamp for receiving HD video code stream, receives and updates diversified data, and is packaged generation data packet to the data;The packet multiplexing forward (FWD) that should be used to re-recognize out by data-reusing unit (2) to have the empty packet of time stamp label, and encapsulate data unit output has in the empty packet of time stamp label, with the HD video code stream being multiplexed.The present invention improves the efficiency of transmission of data and the utilization rate of redundancy bandwidth, can be used for industrial field control, environment measuring, intelligent transportation, health care wired and wireless monitor.

Description

HD video code stream and data multiplexing system and method towards monitoring application
Technical field
The invention belongs to video signal processing technology fields, and in particular to the data-reusing skill of HD video code stream Art, can be used for industrial field control, environment measuring, intelligent transportation, health care wired and wireless monitor.
Background technique
With the high speed development of multimedia technology, digital video technology has been widely used in the communications field, increasingly It is abundant integrate audio, video, image, text, data multimedia messages be increasingly becoming the focus of public concern.And day The video coding technique of benefit optimization makes HD video standard obtain significant raising in terms of performance and efficiency, compared to SD, it is incomparable that HD video standard has the advantages that image resolution ratio is high, image information amount is big, image quality is fine etc., therefore Spectators can enjoy clearer picture, observe more details.In general, the reachable transmission rate of wired or wireless channel The code rate that should be higher than that HD video code stream contains in video code flow after the rate-matched by information source and channel adapts to Certain redundancy, these redundancies have no substantial role, therefore in order to further increase the bandwidth availability ratio of transmission channel and mention The diversity for rising its transmission services can make full use of the redundancy in HD video code stream to transmit more data letters abundant Breath.
On the other hand, it as the development evolution of Video Supervision Technique, application range gradually expand, mainly relates to as industry now The various types of wired and wireless monitor fields such as field control, environment measuring, intelligent transportation, health care.In addition, public family The new markets of monitoring application are increasingly becoming, monitoring is mainly used in the safety precaution to house and the safeguard protection of property. It can be seen that the application prospect of monitoring technology significantly shows.In this context, monitoring application field is in addition to master Transmit outside video, it is also necessary to transmit voice, file, monitoring test data and other heat transfer agents, as GPS positioning, temperature, The diversified data informations such as humidity, industry spot monitoring sensor, therefore these diversified data informations can be multiplexed into The redundancy sky packet of HD video code stream achievees the purpose that substantially effectively to utilize bandwidth by means of the transmission of video code flow.
Sichuan Changhong Electric Appliance Co., Ltd is in its number of patent application:200910312688.6 publication number: A kind of " method utilized to the continuous null byte of TS packet " is proposed in CN101765005A.Data are divided by this method Several data blocks of the same size, each data block replace the continuous empty word of transmission code stream TS packet in the form of byte arrays Section.This method directly replaces the continuous null byte of TS packet in DVB broadcast due to not carrying out protocol encapsulation to data, because And data is caused to be easily lost in transmission process, so that the Reliability comparotive of data transmission is low.
Acoustical Inst., Chinese Academy of Sciences is in its number of patent application:201110223791.0 publication number:CN102916936A In disclose a kind of " more IP data encapsulation methods for IP over DVB ".This method is by several IP Internet Protocols Data envelope is attached in same digital video broadcasting DVB sections and is transmitted, to realize HD video code stream in IP data and DVB Multiplexing.But this method is not multiplexed due to being directly multiplexed into HD video code stream after protocol encapsulation to IP data Into in the redundancy sky packet of HD video code stream, therefore the redundancy sky packet of HD video code stream is not made full use of to transmit significant figure According to wasting transmission band resource.
Summary of the invention
It is an object of the invention in view of the above shortcomings of the prior art, provide a kind of HD video towards monitoring application Code stream and data multiplexing system and method save transmission band resource, further increase channel strip to improve the reliability of transmission Wide utilization rate.
The technical proposal of the invention is realized in this way:
One, technical principle
The present invention realizes monitoring function by being multiplexed diversified data information in the redundancy sky packet of HD video code stream Energy.This method combines monitoring technology with multimedia technology, under the premise of normally transmission multimedia video audio data, by The transmission of the TS data flow redundancy packet caused by channel and information source Adaptive matching voice, file, monitoring test data and its The diversified data information such as his heat transfer agent, such as the diversified number of GPS positioning, temperature, humidity, industry spot monitoring sensor According to acquisition and real-time Transmission answered with further increasing the bandwidth availability ratio of HD video bit stream to meet to monitoring The Diversity of information demand of HD video transmission.
According to HD video code stream and data multiplexing system that above-mentioned principle, the present invention are applied towards monitoring, including:Data Encapsulation unit and data Multiplexing Unit;
The encapsulation unit includes:
Time stamp processing module for generating time stamp for the redundancy sky packet in HD video code stream, and the time stamp of generation is added It is added in corresponding empty packet;
Data update cache module, for inspection data with the presence or absence of update, that is, receive current time data, and with it is preceding The one moment data of storage are compared, if comparison result is identical, retain the data of previous moment, conversely, then deleting previous The data at moment cache the data at current time;
Protocol encapsulation module, for completing data packet operation, i.e. reception data update the data that cache module is sent, and press According to the standard of tunneling, corresponding header fields information is added for data;
The data-reusing unit includes:
Empty packet identification module, for identification out in HD video code stream marked time stamp redundancy sky packet, i.e., reception time stamp The transmission code stream TS data that processing module is sent identify superfluous in transmission code stream TS according to the packet identification number PID field of empty packet Remaining empty packet;
Data insertion module receives association for completing the multiplexing of redundancy sky packet in packet data and HD video code stream The packet data that sends of view package module, and packet data is properly inserted in band that sky packet identification module is sent sometimes In the payload field for stabbing the redundancy sky packet of label.
According to HD video code stream and data multiplexing method that above-mentioned principle, the present invention are applied towards monitoring, including:
1) externally input HD video code stream TS is received and by voice, file, monitoring test data and other sensings The enriched data MI of information composition;
2) Random Discrete in the HD video code stream is identified according to packet identification number PID field in HD video code stream TS packet The empty packet of distribution, and generate the time stab information TE of empty packet;
3) time stab information TE is added to behind the header field of empty packet, obtains the empty packet TSE with time stamp label;
4) diversified data MI is updated, i.e., is stored the enriched data MI of current time storage and previous moment more Sample data MI is compared:If comparison result is identical, retain the data of previous moment, and generates the update that numerical value is 0 and refer to Show field U;Conversely, then deleting the data of previous moment, the data at current time are cached, obtain updated enriched data KMI, and generate the update instruction field U that numerical value is 1;
5) package operation is carried out to updated enriched data KMI, obtains the enriched data packet of several standards XMI:
5a) calculate the byte length L of updated enriched data KMI;
5b) judge whether byte length L is less than the length N of empty packet payload field:If so, executing 5d), otherwise, hold Row 5c);
5c) judge L whether the integral multiple for being N:If so, executing 5e), otherwise, execute 5d);
5d) it is less than the data of N for L, fills N-L redundancy bytes at the data end, so that after filling redundancy bytes The byte length L ' of data be exactly the integral multiple of N, and generate numerical value and be 1 Redundant representations field R, and execute 5e);
It is several data blocks KMIB of N that updated enriched data KMI, which 5e) is divided into regular length, is followed successively by Each data block distributes a fragment serial number A;
5f) according to the data information in data block KMIB, be sequentially generated data type field Y, priority indication field P and Destination address field (DAF) D;
5g) by the update instruction field U in 4), with Redundant representations field R, fragment serial number A, data type field Y, preferential Grade indication field J and destination address field (DAF) W is combined into a protocol header field ZH;
Protocol header field ZH 5h) is added to the stem of data block KMIB, obtains the enriched data packet XMI of standard;
6) enriched data packet XMI is multiplexed into 3) in the empty packet TSE with time stamp label, obtains diversified high definition Video code flow.
Compared with prior art, the present invention having the following advantages that:
First, since the present invention has carried out protocol encapsulation to data, the data packet encapsulated, according to the head of data packet Information can be properly received and extract initial data, overcome and do not carry out protocol encapsulation to data in the prior art, but directly The continuous null byte for replacing HD video code stream TS packet in digital video broadcasting DVB, causes data to be easy to lose in transmission process It loses, the deficiency for causing data transmission credibility to reduce improves the reliability of data transmission.
Second, since the present invention has been multiplexed enriched data in the redundancy sky packet of HD video code stream, overcome existing Valid data are not multiplexed into the redundancy sky packet of HD video code stream in technology, waste the deficiency of transmission band resource, are improved The utilization rate of transmission band resource.
Detailed description of the invention
Fig. 1 is HD video code stream and data multiplexing system schematic diagram of the present invention towards monitoring application;
Fig. 2 is the schematic diagram of the time stamp processing module in Fig. 1;
Fig. 3 is HD video code stream and data multiplexing method flow chart of the present invention towards monitoring application;
Fig. 4 is the flow chart that enriched data is encapsulated in Fig. 3.
Specific embodiment
With reference to the accompanying drawing and specific embodiment carries out clear detailed complete description to the technology in the present invention.The present embodiment Implemented premised on technology of the invention, gives detailed embodiment and specific operation process, but guarantor of the invention Shield range is not limited to following embodiments, those of ordinary skill in the art under the premise of not making creativeness it is obtained it is all its His embodiment, shall fall within the protection scope of the present invention.
Referring to Fig.1, a kind of HD video code stream and data multiplexing system towards monitoring application provided in this embodiment, packet It includes:Data packaging unit 1 and data Multiplexing Unit 2;
The encapsulation unit 1, including:Time stamp processing module 11, data update cache module 12 and protocol encapsulation module 13. Wherein, time stamp processing module 11 includes:Time stamp generates submodule 111 and time stamp adds submodule 112, as shown in Figure 2.
The time stamp generates submodule 111, for generating the time stamp of empty packet.Since empty packet is that sequencing temporally is tested It measures, the corresponding time stamp of each detection moment is unique and unduplicated, therefore time stamp can be used as and empty wrap exclusive time mark Label.
The time stamp adds submodule 112, for time stamp to be added to empty packet.Transmitting terminal is realized pair using the time stamp of addition The counting of sky packet, and know the time interval of adjacent vacant packet, and receiving end can use the time stamp of addition then to realize shake Eliminate the reconstruction with bag data.
The data update cache module 12, are used to update and data cached.Due to collected comprising language in monitoring field Sound, file, monitoring test data and other heat transfer agents diversified data, be all constantly it is slowly varying, therefore, need It constantly to update to guarantee acquisition in real time and transmission.
The protocol encapsulation module 13, for completing data packet operation.Initial data be multiplexed into HD video code stream it Before, it needs to be packaged into data packet according to tunneling.Due to the related instruction in the header field of data packet containing initial data Information, therefore the efficiency of transmission of initial data and the reliability of transmission can be improved.
The data-reusing unit 2 includes:Empty packet identification module 21 and Data insertion module 22.
The sky packet identification module 21, for identification out in HD video code stream marked time stamp redundancy sky packet.Due to superfluous Remaining empty packet is discrete and random distribution in HD video code stream TS, therefore for convenience of the progress of multiplexing operation, needs basis Packet identification number PID field re-recognizes out the redundancy sky packet in TS code stream.
The Data insertion module 22, for being multiplexed into packet data in the redundancy sky packet of HD video code stream.Multiplexing Key is packet data to be accurately inserted into the payload field for the empty packet that Discrete Stochastic in TS code stream is distributed, and is made diversified Data can be by means of TS transmission, it is not necessary to individually reserve extra bandwidth, save band resource, further improve frequency band Utilization rate.
The working principle of above-mentioned multiplex system is as follows:
Time stamp generates submodule 111 and receives the external HD video code stream TS continuously inputted, detects HD video code stream TS In sync byte, confirmation clock is synchronous, identifies redundancy further according to the packet mark PID field in HD video code stream TS later Empty packet, and obtain the system identification time of empty packet, according to the Bit Transmission Rate of HD video code stream, generate empty packet when Stamp, and time stamp is sent to time stamp addition submodule 112;
After time stamp addition submodule 112 receives the time stamp that time stamp generation submodule 111 is sent, time stamp is added to empty packet Header field behind, i.e., the stem of the payload field of empty packet obtains the HD video code stream with time stamp label, and by band There is the HD video code stream of time stamp label to be sent to sky packet identification module 21;
Empty packet identification module 21 receives the HD video code stream with time stamp label that time stamp addition submodule 112 is sent Afterwards, it is re-recognized out according to the packet identification number PID field in HD video code stream and has time stamp label in HD video code stream Sky packet, and the empty packet with time stamp label is sent to Data insertion module 22;
Data update cache module 12 receive the input of external current time comprising voice, file, monitoring test data with And the diversified data of other heat transfer agents, and be compared with the data of previous moment storage, if comparison result is identical, The data for retaining previous moment cache the data at current time conversely, then deleting the data of previous moment, the number updated According to, and the data of update are sent to protocol encapsulation module 13;
Protocol encapsulation module 13 receives data and updates the more new data that cache module 12 is sent, and calculates the byte long of data Degree, and data are divided into several data blocks of the same size, further according to the information of each data block, according to tunneling Standard generates corresponding header fields information, and the addition of header fields information is obtained several encapsulation in the stem of data block Data packet, the Data insertion module 22 being finally sent to these data packets in data-reusing unit 2.
Data insertion module 22 receives the empty packet and agreement with time stamp label that empty packet identification module 21 is sent simultaneously The data packet that package module 13 is sent, and data packet is properly inserted in the payload field with time stamp label sky packet In, the HD video code stream that is multiplexed.
Referring to Fig. 3, a kind of HD video code stream and data multiplexing method towards monitoring application provided in this embodiment, Realize that steps are as follows:
Step 1, it receives TS code stream and generates time stamp TE.
1.1) externally input HD video code stream TS is received;
1.2) synchronization field in TS stream packet is detected:It is primary every the detection of 188 bytes to the synchronization field in TS code stream, When the numerical value for detecting synchronization field is hexadecimal " 47 ", show that code stream clock has been in synchronous regime, without again Detection sync byte needs to detect sync byte again conversely, showing that the clock of code stream is not in synchronous regime;
1.3) the packet identification number PID field in TS stream packet is detected:To the packet identification number PID field in TS code stream every The detection of 188 bytes is primary, when the numerical value for detecting packet identification number PID is hexadecimal " 1FFF ", shows to detect empty packet, And sky packet is cached, conversely, showing to detect non-empty packet, and filter the non-empty packet;
1.4) 1.3) any one sky packet in the TS code stream detected in empty is wrapped into k as first1, and by first Sky packet k1Detection time as k1Detection moment t1
1.5) take an arbitrary random number as first empty packet k1Time stamp T1
1.6) to first empty packet k1Each sky Bao Jun successively detected later is proceeded as follows:
1.6a) obtain current empty packet knDetection moment tn
1.6b) calculate current empty packet knDetection moment tnWith previous empty packet kn-1Detection moment tn-1Difference DELTA tn
Δtn=tn-tn-1
1.6c) according to the Bit Transmission Rate f, calculating difference moment Δ t of given HD video code stream TSnInterior transmission The number N of HD video code stream TS packetn
1.6d) calculate current empty packet knTime stamp Tn
Step 2, according to time stamp TnObtain the empty packet TSE of time stamp label.
By the time stamp T in 1.6d)nIt is added to behind the header field of empty packet, i.e. the stem of payload field field, obtains Empty packet TSE with time stamp label.
Step 3, reception and more new data MI.
3.1) receive and store externally input data MI, data MI be by voice, file, monitoring test data and The enriched data of other heat transfer agents composition;
3.2) the enriched data MI that current time stores is compared with the enriched data MI that previous moment stores: If comparison result is identical, retain the data of previous moment, and generates the update instruction field U that numerical value is 0;Conversely, then deleting The data of previous moment cache the data at current time, obtain updated enriched data KMI, and generating numerical value is 1 more New indication field U.
Step 4, package operation is carried out to updated enriched data KMI, obtains the enriched data of several standards Wrap XMI.
Referring to Fig. 4, this step is implemented as follows:
4.1) the byte length L of updated enriched data KMI is calculated;
4.2) judge whether byte length L is less than the length N of empty packet payload field:If so, execute 4.4), otherwise, It executes 4.3);
Since any one sky Bao Jun includes the header field of 4 bytes and the load domain word of 184 bytes in TS code stream Section, and agreement used in encapsulation of data has the protocol header field of 10 bytes, therefore, the value of N is load domain in the present invention The byte difference of field and protocol header field, i.e. N take 174;
4.3) judge byte length L whether the integral multiple for being payload length of field N:If so, execute 4.5), otherwise, It executes 4.4);
4.4) it is less than the data of payload length of field N for byte length L, fills N-L redundancy at the data end Byte so that the byte length L ' of the data after filling redundancy bytes is exactly the integral multiple of N, and generates the redundancy that numerical value is 1 Identification field R, and execute 4.5);
4.5) updated enriched data KMI is divided into regular length is several data blocks KMIB of N, is followed successively by Each data block distributes a fragment serial number A;
4.6) according to the data information in data block KMIB, data type field Y, priority indication field J are sequentially generated With destination address field (DAF) W;Wherein:The value of data type field is as shown in table 1 below, the value of priority indication field such as following table Shown in 2:
1 data type field value of table
Data type field value The data class of transmission
00 It is not used
01 Sensing data
10 IP file
11 Sensing data+IP file
00 indicates not using the data type field in table 1;01 indicates only to transmit sensing data in a data packet, such as GPS positioning, temperature, humidity, the monitoring test data of industry spot monitoring sensor acquisition;10 indicate in a data packet only Transmit IP file;11 indicate that sensing data and IP file can be transmitted simultaneously in a data packet.
2 priority indication field value of table
Priority indication field value Data type and ratio
00 Without using this field
01 Sensing data (80%)
10 IP file (80%)
11 It is not provided with priority
00 indicates not using the priority indication field in table 2;01 indicates preferentially to transmit sensing in a data packet Data, and the total amount of sensing data transmission accounts for the 80% of entire packet size, remaining capacity is for transmitting it in data packet The data of his type;10 indicate preferentially to transmit IP file in a data packet, and the total amount of IP file transmission accounts for entire number According to the 80% of inclusion quantity, remaining capacity is for transmitting other kinds of data in data packet;11 indicate in a data packet The sensing data and IP file of arbitrary proportion can be transmitted;
4.7) with it is above-mentioned 3.2) in update instruction field U, 4.4) in Redundant representations field R, 4.5) in fragment sequence Number A and 4.6) in data type field Y, priority indication field P, destination address field (DAF) D be combined into a protocol headers word Section ZH;
4.8) protocol header field ZH is added to the stem of data block KMIB, obtains the enriched data packet XMI of standard.
Step 5, enriched data packet XMI is multiplexed into step 2 in the empty packet TSE with time stamp label, obtains multiplicity The HD video code stream of change.
This step is implemented as follows:
5.1) total data in the empty packet TSE in detecting step 2 with time stamp label, retains the header data of TSE, deletes Except the data of the payload field of TSE, empty packet KSE to be multiplexed is obtained;
5.2) enriched data packet XMI is added in the payload field of empty packet KSE to be multiplexed, has been multiplexed Data packet FSE;
5.3) the data packet FSE being multiplexed is inserted into HD video code stream, obtains diversified HD video code stream.
In conclusion the embodiment of the present invention is under the premise of influencing audio/video information normal transmission, by that will include language Sound, file, monitoring test data and other heat transfer agents diversified data be packaged into data packet, and by packet multiplexing Into in the redundancy sky packet of HD video code stream, transmit diversified data by the redundant channels of HD video code stream, To make full use of the redundancy bandwidth of channel, the reliability of band efficiency and data transmission is improved.
Be provided for the embodiments of the invention above towards monitoring application HD video code stream and data multiplexing system and Method is introduced in detail, is meticulously explained using specific case the principle of the present invention and embodiment in the present invention It states.The explanation of above embodiments is merely preferred embodiments of the present invention, and is merely used to help understand method of the invention And core concept, but scope of protection of the present invention is not limited thereto, for those of ordinary skill in the art, according to the present invention Thought, the variation expected in specific embodiments and applications or change place, should all cover in protection of the invention Within the scope of.

Claims (3)

1. a kind of HD video code stream and data multiplexing method towards monitoring application, which is characterized in that including:
1) externally input HD video code stream TS is received and by voice, file, monitoring test data and other heat transfer agents The enriched data MI of composition;
2) identify that Random Discrete is distributed in the HD video code stream according to packet identification number PID field in HD video code stream TS packet Empty packet, and generate the time stab information TE of empty packet;
3) time stab information TE is added to behind the header field of empty packet, obtains the empty packet TSE with time stamp label;
4) diversified data MI is updated, i.e., by the diversification of the enriched data MI of current time storage and previous moment storage Data MI is compared:If comparison result is identical, retain the data of previous moment, and generates the update instruction word that numerical value is 0 Section U;Conversely, then deleting the data of previous moment, the data at current time are cached, obtain updated enriched data KMI, and Generate the update instruction field U that numerical value is 1;
5) package operation is carried out to updated enriched data KMI, obtains the enriched data packet XMI of several standards:
5a) calculate the byte length L of updated enriched data KMI;
5b) judge whether byte length L is less than the length N=174 of empty packet payload field:If so, executing 5d), otherwise, hold Row 5c);
5c) judge L whether the integral multiple for being N:If so, executing 5e), otherwise, execute 5d);
5d) it is less than the data of N for L, fills N-L redundancy bytes at the data end, so that the number after filling redundancy bytes According to byte length L ' be exactly the integral multiple of N, and generate numerical value be 1 Redundant representations field R, and execute 5e);
It is several data blocks KMIB of N that updated enriched data KMI, which 5e) is divided into regular length, is followed successively by each Data block distributes a fragment serial number A;
5f) according to the data information in data block KMIB, it is sequentially generated data type field Y, priority indication field P and purpose Address field D;
5g) by the update instruction field U in 4), refer to Redundant representations field R, fragment serial number A, data type field Y, priority Show that field J and destination address field (DAF) W are combined into a protocol header field ZH;
Protocol header field ZH 5h) is added to the stem of data block KMIB, obtains the enriched data packet XMI of standard;
6) enriched data packet XMI is multiplexed into 3) in the empty packet TSE with time stamp label, obtains diversified HD video Code stream.
2. the method according to claim 1, wherein the time stab information TE of empty packet is generated in step 2), by as follows Step carries out:
Any one sky packet in HD video code stream TS 2a) be will test as first empty packet k1, and first sky is wrapped into k1 Detection time as k1Detection moment t1
2b) take an arbitrary random number as first empty packet k1Time stamp T1
2c) to first empty packet k1Each sky Bao Jun successively detected later is proceeded as follows:
2c1) obtain current empty packet knDetection moment tn
2c2) calculate current empty packet knDetection moment tnWith previous empty packet kn-1Detection moment tn-1Difference DELTA tn
Δtn=tn-tn-1
2c3) according to the Bit Transmission Rate f, calculating difference moment Δ t of given HD video code stream TSnThe high definition of interior transmission regards The number N of frequency code stream TS packetn
2c4) calculate current empty packet knTime stamp Tn
3. the method according to claim 1, wherein enriched data packet XMI is multiplexed into 3) in step 6) Empty packet TSE with time stamp label, carries out as follows:
6a) the total data in empty packet TSE of the detection with time stamp label, retains the header data of TSE, deletes the effective of TSE The data in load domain obtain empty packet KSE to be multiplexed;
6b) enriched data packet XMI is added in the payload field of empty packet KSE to be multiplexed, the data being multiplexed Wrap FSE;
6c) the data packet FSE being multiplexed is inserted into HD video code stream, obtains diversified HD video code stream.
CN201610322317.6A 2016-05-16 2016-05-16 HD video code stream and data multiplexing system and method towards monitoring application Active CN105847873B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610322317.6A CN105847873B (en) 2016-05-16 2016-05-16 HD video code stream and data multiplexing system and method towards monitoring application

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610322317.6A CN105847873B (en) 2016-05-16 2016-05-16 HD video code stream and data multiplexing system and method towards monitoring application

Publications (2)

Publication Number Publication Date
CN105847873A CN105847873A (en) 2016-08-10
CN105847873B true CN105847873B (en) 2018-11-16

Family

ID=56592470

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610322317.6A Active CN105847873B (en) 2016-05-16 2016-05-16 HD video code stream and data multiplexing system and method towards monitoring application

Country Status (1)

Country Link
CN (1) CN105847873B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107526562A (en) * 2017-08-17 2017-12-29 深圳市华星光电半导体显示技术有限公司 Display device and its driving method
FR3079909B1 (en) 2018-04-05 2022-10-14 Microoled ELECTROLUMINESCENT DEVICE WITH IMPROVED RESOLUTION AND RELIABILITY
CN108712677B (en) * 2018-05-31 2019-07-16 杭州视在数科信息技术有限公司 TS method for stream processing and application to intelligent algorithm close friend
CN108833950B (en) * 2018-06-29 2021-05-28 武汉斗鱼网络科技有限公司 Barrage message issuing method, server, system and storage medium
CN111147795B (en) * 2019-12-27 2022-12-23 视联动力信息技术股份有限公司 Resource scheduling method, server, terminal, electronic device, and storage medium
CN112218115B (en) * 2020-09-25 2022-07-29 深圳市捷视飞通科技股份有限公司 Control method and device for streaming media audio and video synchronization and computer equipment
CN112929228B (en) * 2021-01-08 2022-06-07 浙江大华技术股份有限公司 Bandwidth testing method, user equipment and storage device
CN113573104B (en) * 2021-07-15 2023-05-23 北京数字电视国家工程实验室有限公司 Method for branching and combining transmission code stream, code stream branching device, combining device and system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003058869A2 (en) * 2002-01-04 2003-07-17 Scientific-Atlanta, Inc. Receiving streams over asynchronous networks
CN101098445A (en) * 2006-06-30 2008-01-02 株式会社日立制作所 Television program receiving equipment and method for receiving and broadcasting television program
CN101765005A (en) * 2009-12-30 2010-06-30 四川长虹电器股份有限公司 Method for realizing data transmission by utilizing TS-packet continuous null bytes in DVB
CN101931818A (en) * 2009-06-25 2010-12-29 深圳力合视达科技有限公司 Method and device for inserting data information into transport stream
CN102647619A (en) * 2012-04-16 2012-08-22 辛欣 Information service system and method based on digital television system or IPTV (Internet Protocol television) system
CN102916936A (en) * 2011-08-05 2013-02-06 中国科学院声学研究所 IP data encapsulating method and system applicable to IP over DVB (digital video broadcasting)
CN103108214A (en) * 2013-01-29 2013-05-15 辛欣 Method for identifying test set (TS) packet with information in empty packet replacing process
CN203193806U (en) * 2012-10-23 2013-09-11 辛欣 IPQAM apparatus with null packet replacement function

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7415528B2 (en) * 2003-12-27 2008-08-19 Electronics And Telecommunications Research Institute Apparatus and method for transmitting hierarchically multimedia data TS to prevent jitter of timing information and for recovering the multimedia data TS

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003058869A2 (en) * 2002-01-04 2003-07-17 Scientific-Atlanta, Inc. Receiving streams over asynchronous networks
CN101098445A (en) * 2006-06-30 2008-01-02 株式会社日立制作所 Television program receiving equipment and method for receiving and broadcasting television program
CN101931818A (en) * 2009-06-25 2010-12-29 深圳力合视达科技有限公司 Method and device for inserting data information into transport stream
CN101765005A (en) * 2009-12-30 2010-06-30 四川长虹电器股份有限公司 Method for realizing data transmission by utilizing TS-packet continuous null bytes in DVB
CN102916936A (en) * 2011-08-05 2013-02-06 中国科学院声学研究所 IP data encapsulating method and system applicable to IP over DVB (digital video broadcasting)
CN102647619A (en) * 2012-04-16 2012-08-22 辛欣 Information service system and method based on digital television system or IPTV (Internet Protocol television) system
CN203193806U (en) * 2012-10-23 2013-09-11 辛欣 IPQAM apparatus with null packet replacement function
CN103108214A (en) * 2013-01-29 2013-05-15 辛欣 Method for identifying test set (TS) packet with information in empty packet replacing process

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Analytical and Experimental IP Encapsulation Efficiency Comparison of GSE, MPE, and ULE over DVB-S2;A. Mayer ET AL;《International Workshop on Satellite and Space Communications, 2007. IWSSC "07》;20071226;全文 *
MPEG-2的传输流多路复用算法;陈辉;王养利;《微机发展》;20050428;第3卷;全文 *

Also Published As

Publication number Publication date
CN105847873A (en) 2016-08-10

Similar Documents

Publication Publication Date Title
CN105847873B (en) HD video code stream and data multiplexing system and method towards monitoring application
CN101505316B (en) Method and device for reordering and multiplexing multimedia packets from multimedia streams pertaining to interrelated sessions
JP3802003B2 (en) RTP packet generation / restoration apparatus and method
CN101785278B (en) streaming data content in a network
CN1751518B (en) Picture coding method
CN101151829A (en) Buffering in streaming delivery
JP2015222954A (en) Fast channel zapping and high quality streaming protection over broadcast channel
US7924889B2 (en) Method for transmitting packets in a transmission system
BR112012005106B1 (en) Method and device for distributing a multiplexed stream of multimedia over a network, and method and device for receiving a multiplexed stream of multimedia over a network
JP2012513139A (en) Method for synchronizing transport streams in a multiplexer with an external coprocessor
CN106603192A (en) Adaptive FEC mechanism based on media content
JP2009100411A (en) Video image distributing system, video image relay apparatus, and video image relay method
KR20130126932A (en) Method and system for asynchronous and isochronous data transmission in a high speed video network
CN102938839B (en) A kind of monitoring frontend and encoder server
CN114339488B (en) Method and device for protecting Ethernet service in optical transmission network
KR20110007038A (en) Data-rate adjusting device, data feeding system, and computer-readable medium for recording program
US20120002683A1 (en) Method and apparatus for compressing frame
CN107710627B (en) Communication device, communication system, communication method, and program
CN108988977A (en) The methods, devices and systems of business transferring stream in a kind of flexible Ethernet protocol
CN102215425B (en) Method and equipment for realizing live video on demand
JP4391412B2 (en) Dynamic multiplexing method of digital stream
CN100551076C (en) Transmission flow demultiplexing apparatus and method
KR20190073321A (en) Method configuring and transmitting m-unit
WO2010009652A1 (en) Transmission method for multiplex data stream
KR20160021759A (en) Broadcasting transmission/reception apparatus and broadcasting transmission/reception method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant