CN106210923A - A kind of based on the real time flow medium multichannel transmission control method H.264 encoded - Google Patents
A kind of based on the real time flow medium multichannel transmission control method H.264 encoded Download PDFInfo
- Publication number
- CN106210923A CN106210923A CN201610540068.8A CN201610540068A CN106210923A CN 106210923 A CN106210923 A CN 106210923A CN 201610540068 A CN201610540068 A CN 201610540068A CN 106210923 A CN106210923 A CN 106210923A
- Authority
- CN
- China
- Prior art keywords
- video
- client
- server end
- idr
- chained list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a kind of based on the real time flow medium multichannel transmission control method H.264 encoded, the method mainly includes following content: (1) client application real-time video, server end forwards up-to-date history every IDR frame video data to the client of application real-time video；(2) the up-to-date real time video data in the range of server end every road video only retains 2 frame IDR；(3) the up-to-date real time video data in the range of client every road video only retains 2 frame IDR；(4) server end and client respectively use dual-thread, and server sub-line journey is used for Streaming Media forwarding capability, and client child thread is used for video render function, and cross-thread uses thread lock, in order to controls multiple thread and shares public video data；(5), during client cloud control video sampling equipment, server end and client empty the every other non-cloud control channel history video data in addition to cloud control channel respectively, and restart to continue to forward/play from every IDR frame respectively.
Description
Technical field
The present invention relates to real-time video Streaming Media reflecting software, be specifically related to a kind of based on the real-time streams matchmaker H.264 encoded
Body multichannel transmission control method, belongs to real time flow medium software field.
Background technology
Streaming Media refers to the video data transmitted on network with streaming manner, and the video data of transmission uses coding
Compression, to reduce the data volume of transmission, uses at present and is compressed with H.264 coding standard, and user is decoded by decoding device
The data stream of compression i.e. can play video.
Real Time Streaming is a kind of transmission means in Streaming Media, mainly ensures stream medium data and the network of transmission
Transmission performance matches, and making Consumer's Experience real-time performance is purport, more emphasizes real-time.Real Time Streaming needs special stream
Media server and host-host protocol, special streaming media server has QuickTime Streaming Server, Windows
Media Server etc.；Special host-host protocol has RTSP (Real-time Streaming Protocol) or MMS
(Microsoft Media Server) etc..
Streaming Media carries out discontinuous transmission with bag transmission means on network, wherein Transmission Control Protocol be can ensure bag order can
By transmission, for continuous print streaming media video data stream, simple employing Transmission Control Protocol can ensure its succession.Owing to network is
Dynamically change, and the video stream data collected to be continuous print average rate obtain, it is necessary to assure the speeds match of the two with
Reach live preview effect.During user's video sampling to be controlled equipment, need the video image after real-time feedback control, the most also
Require the real-time performance controlled.
H.264 coding standard is the coding standard being widely used in field of video compression at present, is to be suitable for real-time video to lead to
The coding criterion of letter, it is with high compression high-quality and supports that multiple network Streaming Media is as principal character.Define in H.264 agreement
Three kinds of frames, the frame of complete coding is I frame, and the frame only comprising difference section coding generated with reference to I frame before, P frame, is gone back
There is before and after a kind of reference the frame of frame coding B frame.Every IDR frame is instantaneous decoding refresh frame, is the one in I frame, for distinguishing first I
Frame and other I frames, be every IDR frame first I frame definition.The effect of every IDR frame is to refresh at once, makes mistake to propagate, and plays
Device receives every IDR frame and plays every IDR frame the most at once, all of historical frames before abandoning every IDR frame.
The invention discloses a kind of based on the real time flow medium multichannel transmission control method H.264 encoded, server end with
Client each uses dual-thread and two-way annular chain meter technological improvement to forward real-time performance and the video sampling equipment cloud of video
The real-time performance of control, the video flowing of forwarding uses H.264 coding standard, improves sub server end and two independent entering of client
Journey, mainly includes following content: (1) client application real-time video, server end forwards up-to-date history every IDR frame video data
Give the client of application real-time video；(2) the up-to-date real-time video number in the range of server end every road video only retains 2 frame IDR
According to；(3) the up-to-date real time video data in the range of client every road video only retains 2 frame IDR；(4) server end and client
Respectively using dual-thread, server sub-line journey is used for Streaming Media forwarding capability, and client child thread is used for video render function, line
Thread lock is used, in order to control multiple thread and share public video data between journey；(5) during client cloud control video sampling equipment,
Server end and client empty the every other non-cloud control channel history video data in addition to cloud control channel respectively, and respectively from
Every IDR frame restarts to continue to forward/play.By innovatory algorithm, system can be optimized, reduce system resource waste, improve system
Combination property, the real-time improving user is experienced.
Summary of the invention
It is an object of the invention to realize a kind of based on the real time flow medium multichannel transmission control method H.264 encoded, visitor
Client terminal playing video is made with minimum latency penalty after the end application real-time video of family；After client cloud control video sampling equipment,
Make client play the video pictures after cloud control with minimum latency penalty, thus improve user's real-time and experience.
Specifically, the method for the present invention includes following content:
A. server end Buffer Design is two class chained lists: particular content is as follows:
A1 server end safeguards that a two-way annular big chain Table A, as relief area, is used for record from video sampling equipment
The video streaming data packet H.264 encoded got, the node of chain Table A is mainly including but not limited to following member:
A1.1 video flowing pointer, points to obtained from video sampling equipment and wraps the head pointer of H.264 encoded video streams；
A1.2 video flowing length, numerical value is the byte that obtained from video sampling equipment wraps H.264 encoded video streams
Number；
A1.3 video sampling equipment, points to obtained from video sampling equipment and wraps H.264 corresponding to encoded video streams
Video sampling device pointer, the corresponding road video of each video sampling equipment, i.e. one channel or passage；
A1.4 video data type, indicates the type of the bag video flowing obtained from video sampling equipment；
The most each video sampling plant maintenance one two-way annular chainlet table B, one pointer of this chained list essential record, should
Pointer points to and belongs to the video streaming node of certain video sampling equipment specific on big chain Table A, the node of chained list B mainly comprise but
It is not limited to following member:
A2.1 points to the pointer of chain Table A node；
Whether the H.264 coding video frequency data bag that A2.2 chain Table A node is corresponding is every IDR frame mark；
B. client application real-time video, server end forwards up-to-date history every IDR frame and rear video data thereof to application
Real-time video client, its concrete methods of realizing is:
B1. after client correct login service device, server end it is sent to the video sampling that this client can access
List of devices；
B2. client selects certain video sampling device-to-server end to send real-time video request；
B3., after server end receives the request of client real-time video, the video flowing currently whether having client to ask is checked,
The most then send to video sampling equipment and obtain video request；The bag H.264 encoded got is regarded by server software
Frequently flow data adds chain Table A and constructs the node of corresponding chained list B and increase in chained list B；
The most each video sampling equipment retains the up-to-date every IDR frame of 2 frames and later video data bag thereof forever, works as client
During request live video stream, no matter the up-to-date every IDR frame retained has been transmitted across (now having other clients to broadcast the most in real time
Fang Gai road video), all immediate precedences send this up-to-date every IDR frame of road video and rear video stream packets thereof to client, until chain
The transmission of this priority level is stopped at the node that Table A does not sends.This mode, after user's program request road video can be made, energy
Showing the picture of this road video immediately, user's real-time is experienced good；
C. the up-to-date real time video data in the range of server end every road video only retains 2 frame IDR, implements step such as
Under:
C1. server end obtains video streaming data packet bag of the video sampling equipment H.264 encoded；
C2. packet bag is connected to the afterbody of chain Table A, builds the corresponding node of chained list B simultaneously；
C3. server end every road video safeguards an every IDR frame counting IDRCount respectively；
C4. judging whether packet bag is every IDR frame, if every IDR frame, then every IDR frame counting IDRCount adds 1；
C5. every IDR frame counting IDRCount is checked, if this counting is more than given threshold value 2, then from reverse time of chain Table A afterbody
Go through, find the second-to-last every IDR frame of this road video, delete about all history before this road video second-to-last every IDR frame
Video data, by this kind of technology, can improve the real-time performance of the video data of forwarding；
D. client buffer district is designed as two class chained lists: particular content is as follows:
The two-way annular chain meter CA of D1 client maintenance one, as receiving relief area, forwards not for recording server end
The video stream data of subpackage, the node of chained list CA is mainly including but not limited to following member:
D1.1 video flowing pointer, points to the head pointer of the one section of video flowing forwarded from server end；
D1.2 video flowing length, numerical value is the byte number of the one section of video flowing forwarded from server end, is usually set to one
Individual definite value, such as 10000；
The two-way annular chain meter CB of D2 client maintenance one is as play buffer, and in chained list CA, subpackage is each
Road video data bag, the node of chained list CB is mainly including but not limited to following member:
D2.1 video flowing pointer, points to the head pointer of the video flowing that H.264 bag from server end forwarding encodes；
D2.2 video flowing length, numerical value is the byte number of the video flowing that H.264 bag forwarded from server end encodes；
D2.3 video sampling equipment, points to regarding corresponding to the video flowing that H.264 bag from server end forwarding encodes
Frequency sampling device pointer, the corresponding road video of each video sampling equipment；
E. the up-to-date real time video data in the range of client every road video only retains 2 frame IDR, implementing step is:
E1. client every road video safeguards an every IDR frame counting IDRCount respectively；
E2. the video flowing after client obtains subpackage, it may be judged whether every IDR frame；
E3. the video flowing after subpackage is if every IDR frame, then every IDR frame counting IDRCount adds 1；
If E4. every IDR frame counting IDRCount is more than given threshold value 2, then inversely search second-to-last from chained list CB afterbody
Every IDR frame, all history video data bags of this channel before deletion chained list CB second-to-last every IDR frame, this is that client is real-time
One of performance improvement technology；
F. server end uses dual-thread and buffer zone method to forward live video stream, soft to solve network speed and server end
The problem that video flowing speed that part gets from video sampling equipment is inconsistent, is embodied as step as follows:
F1. (main thread startup), simultaneously promoter thread T when server software runs；
F2. sub-line journey T is exclusively used in server end and client video flowing forwards；
F3. server end main thread, sub-line journey share chain Table A, use thread lock technology to ensure public chain Table A data
Concordance, the additions and deletions read-write to chain Table A will use thread lock mechanism；
G. client uses dual-thread and buffer zone method preview to play in real time and video, in order to solve to obtain from server end
The video flowing speed taken and the inconsistent problem of client player broadcasting speed, implement step as follows:
G1. (main thread startup), simultaneously promoter thread CT when client software runs；
G2. sub-line journey CT is exclusively used in player plays video data；
G3. client main thread, sub-line journey share chained list CB, use thread lock technology to ensure public chained list CB data
Concordance, the additions and deletions read-write to chained list CB will use thread lock mechanism；
H., during client cloud control video sampling equipment, server end and client empty owning in addition to cloud control channel respectively
Other channel history video datas, and restart to continue to forward from every IDR frame respectively, implement step as follows:
H1. client sends the cloud control order of certain video sampling equipment by Transmission Control Protocol to server end；
H2. client starts inverted order traversal from chained list CB afterbody, only retains the video stream data of cloud control channel, other channels
Video stream data empties, and during cloud control, user focuses on cloud control channel, empties other channels, is to allow cloud control channel
Video pictures after the control of real-time play cloud is experienced with the real-time improving user as early as possible；
H3., after server end receives this order of cloud control, start backward traversal from the afterbody of chain Table A, empty except cloud control channel
The video data of outer every other channel；
H4. the non-cloud control channel of server end starts to continuously add chain Table A from respective new every IDR frame and lays equal stress on and newly start to turn
Send out, so also for improving the experience of client user's real-time, it is considered to cloud control channel video data preferentially forwards；
It is an advantage of the invention that to do respectively from server end and two processes of client and forward based on the video H.264 encoded
And the implementation performance improvement controlled, utilize real-time application demand, abandon the history video data affecting real-time performance opportune moment,
Thus the real-time performance improving client user is experienced, therefore the method has a good application prospect and market value.
Accompanying drawing explanation
Fig. 1: system construction drawing
Fig. 2: server end list structure figure
Fig. 3: real-time modified flow figure
Detailed description of the invention
Below in conjunction with the accompanying drawings, implement to improve example by a set of system having disposed realization, the present invention is made further
Describe.The system configuration that this deployment realizes is:
| Title | Unit type | Quantity |
| Haikang NVR | DSA-7300 | 1 |
| Video sampling equipment | Rifle ball all-in-one, network ball machine, hemisphere machine | 4 |
| Server | Windows server 2008R2、Access 2007 | 1 |
| Client | OS:windows XP | 2 |
Real-time system is made up of multiple hardware devices, and its structure chart is as it is shown in figure 1, server list structure schematic diagram is as schemed
Shown in 2, specifically include and implement step as follows: a) video sampling equipment is connected to NVR, the IP of browser input NVR, can pass through
Webpage arranges connection video sampling equipment；B) server end adds NVR equipment and video sampling facility information, and this is server end
A functional module；C) server end adds user record, and this is a functional module of server software；D) client
Input IP at server end address, inputs user name cryptographic acess server end and does login authentication；E) server end returns client
Have permission the video sampling list of devices of access；F) client selects video sampling device request real-time video preview；G) service
Device end forwards the live video stream of client request；H) client sends cloud control order to server end；I) server end passes through
NVR cloud control video sampling equipment；
Below in conjunction with system example, the invention will be further described:
The corrective measure of the inventive method is divided into preview to play real-time performance improvement and cloud control real-time performance is improved, and improves again
Divide client to improve and server end improves, see Fig. 3；
Server end improves and shares 2 chained lists: chain Table A and chained list B, chain Table A is to forward from the NVR of Haikang
H.264 the encoding video stream data of each channel of packing；Chained list B is a little chained list of each channel maintenance, has several frequency
Road needs to forward just several chained list B；Asking according to client, server end is applied for video flowing on NVR, is started to receive NVR
H.264 the video stream data of packing encoded of upper forwarding；Received server-side, can be according to H.264 to after this video stream data
Video flowing identification every IDR frame after coding also does this bag whether every IDR frame mark in chain Table A；Server end receives a bag from NVR
H.264 encoding video stream data, connects this bag immediately in chain Table A, and increases a node in the chained list B of corresponding channel；
If the bag data that server end receives from NVR are every IDR frame, then chained list B inversely finds penultimate every IDR frame, clearly
All nodes of this channel before this every IDR frame in empty chain table B, and delete respective nodes in the chain Table A pointed by this node；Clothes
After business device termination receives the cloud control order that client sends, stop forwarding all non-cloud control channel videos until non-cloud in chain Table A
The control the most up-to-date every IDR frame of channel is further continued for joining chain Table A and continuing to forward；
Client is improved and is shared 2 chained lists: chained list CA and chained list CB, chained list CA are that the server end received forwards not
H.264 the coding video frequency data of subpackage, including the video data of each channel of client application, and it is possible to be to block clothes
Business device end forward one H.264 complete packet, this wraps in the embodiment of the present invention and uses regular length 10000 word
Joint；Chained list CB is the H.264 coding video frequency data bag of each passage that video is play in the client request of subpackage, now point
The H.264 coding video frequency data bag that bag and server end forward is identical bag；In chained list CB, if the node newly increased is certain
The every IDR frame (mark that server end forwards) of individual channel P, reverse traversal chained list CB finds penultimate every IDR frame, empties
The all non-played data of channel P before this every IDR frame in chained list CB；After client sends cloud control order, empty non-cloud immediately
The all non-playing video data of control channel；
Embodiment result
Forwarding based on the Streaming Media Multichannel H.264 encoded according to what the method for the present invention realized and control, real-time performance changes
Entering effect obvious, it is as follows that its various functions realizes result:
1) result of implementation after server end improves
By recording video data bag quantity to be forwarded, often bag video data size, material time dot information, intercept certain
Time point, obtains improvement effect numerical value as shown in the table:
2) result of implementation after client is improved
By recording video data bag quantity to be played, often bag video data size, material time dot information, intercept certain
Time point, obtains improvement effect numerical value as shown in the table:
3) real-time result of implementation is play in preview
By one journal file of design, record client application video and video commence play out material time point, can obtain
Take preview before and after improvement and play the time delay of video pictures, such as following table:
| Number of videos | Client terminal quantity | Time delay (s) before improving | Time delay (s) after improvement |
| 1 | 1 | 0.67 | 0.42 |
| 1 | 2 | 3.35 | 0.36 |
| 2 | 1 | 4.12 | 0.89 |
| 2 | 2 | 4.35 | 0.56 |
| 3 | 1 | 5.79 | 0.47 |
| 3 | 2 | 5.91 | 0.98 |
| 4 | 1 | 6.23 | 0.96 |
| 4 | 2 | 6.89 | 0.77 |
4) cloud control real-time result of implementation
By one journal file of design, material time point when record video cloud control occurs, cloud before and after improvement can be obtained
Control channel plays the time delay of the video pictures after cloud control, such as following table:
| Number of videos | Client terminal quantity | Time delay (s) before improving | Time delay (s) after improvement |
| 1 | 1 | 1.91 | 1.51 |
| 1 | 2 | 2.12 | 1.57 |
| 2 | 1 | 3.09 | 1.69 |
| 2 | 2 | 3.23 | 1.76 |
| 3 | 1 | 5.24 | 1.71 |
| 3 | 2 | 5.93 | 1.82 |
| 4 | 1 | 7.27 | 1.78 |
| 4 | 2 | 7.91 | 1.86 |
Claims (5)
1., based on the real time flow medium multichannel transmission control method H.264 encoded, its step includes:
A. server end Buffer Design is two class chained lists: particular content is as follows:
A1 server end safeguards that a two-way annular big chain Table A, as relief area, obtains from video sampling equipment for record
To the video streaming data packet attribute H.264 encoded；
The most each video sampling plant maintenance one two-way annular chainlet table B, one pointer of this chained list essential record, this pointer
Point to the video streaming node belonging to certain video sampling equipment specific on big chain Table A；
B. client application real-time video, server end forwards up-to-date history every IDR frame and rear video data thereof to application in real time
Videoconference client, its concrete methods of realizing is:
B1. after client correct login service device, server end it is sent to the video sampling equipment that this client can access
List；
B2. client selects certain video sampling device-to-server end to send real-time video request；
B3., after server end receives the request of client real-time video, check the video flowing currently whether having client to ask, do not have
Then send to video sampling equipment and obtain video request；The bag video flowing H.264 encoded that server software will get
Data add chain Table A and construct the node of corresponding chained list B and increase in chained list B；
The most each video sampling equipment retains the up-to-date every IDR frame of 2 frames and later video data bag thereof forever, when client is asked
During live video stream, no matter the up-to-date every IDR frame retained has been transmitted across, all immediate precedences send the up-to-date IDR of this road video
Frame and rear video stream packets thereof are to client, until stopping the transmission of this priority level at the node that do not sends of chain Table A；
C. the up-to-date real time video data in the range of server end every road video only retains 2 frame IDR, implements step as follows:
C1. server end obtains video streaming data packet bag of the video sampling equipment H.264 encoded；
C2. packet bag is connected to the afterbody of chain Table A, builds the corresponding node of chained list B simultaneously；
C3. server end every road video safeguards an every IDR frame counting IDRCount respectively；
C4. judging whether packet bag is every IDR frame, if every IDR frame, then every IDR frame counting IDRCount adds 1；
C5. check every IDR frame counting IDRCount, if this counting is more than given threshold value 2, then inversely travels through from chain Table A afterbody, look for
To the second-to-last every IDR frame of this road video, delete about all history video counts before this road video second-to-last every IDR frame
According to；
D. client buffer district is designed as two class chained lists: particular content is as follows:
The two-way annular chain meter CA of D1 client maintenance one is as receiving relief area, for recording the non-subpackage that server end forwards
Video stream data, the node of chained list CA is mainly including but not limited to following member:
The two-way annular chain meter CB of D2 client maintenance one is as play buffer, and in chained list CA, each road of subpackage regards
Frequently packet, the node of chained list CB is mainly including but not limited to following member:
E. the up-to-date real time video data in the range of client every road video only retains 2 frame IDR, implementing step is:
E1. client every road video safeguards an every IDR frame counting IDRCount respectively；
E2. the video flowing after client obtains subpackage, it may be judged whether every IDR frame；
E3. the video flowing after subpackage is if every IDR frame, then every IDR frame counting IDRCount adds 1；
If E4. every IDR frame counting IDRCount is more than given threshold value 2, then inversely search second-to-last IDR from chained list CB afterbody
Frame, all history video data bags of this channel before deletion chained list CB second-to-last every IDR frame；
F. server end uses dual-thread and buffer zone method to forward live video stream, with solve network speed and server software from
The problem that the video flowing speed that gets on video sampling equipment is inconsistent, is embodied as step as follows:
F1. when server software runs, promoter thread T simultaneously；
F2. sub-line journey T is exclusively used in server end and client video flowing forwards；
F3. server end main thread, sub-line journey share chain Table A, use thread lock technology to ensure the consistent of public chain Table A data
Property, the additions and deletions read-write to chain Table A will use thread lock mechanism；
G. client uses dual-thread and buffer zone method preview to play in real time and video, in order to solve from server end acquisition
Video flowing speed and the inconsistent problem of client player broadcasting speed, implement step as follows:
G1. when client software runs, promoter thread CT simultaneously；
G2. sub-line journey CT is exclusively used in player plays video data；
G3. client main thread, sub-line journey share chained list CB, use thread lock technology to ensure the consistent of public chained list CB data
Property, the additions and deletions read-write to chained list CB will use thread lock mechanism；
H., during client cloud control video sampling equipment, it is every other that server end and client empty respectively in addition to cloud control channel
Channel history video data, and restart to continue to forward from every IDR frame respectively, implement step as follows:
H1. client sends the cloud control order of certain video sampling equipment by Transmission Control Protocol to server end；
H2. client starts inverted order traversal from chained list CB afterbody, only retains the video stream data of cloud control channel, other channel videos
Flow data empties, and during cloud control, user focuses on cloud control channel, empties other channels, is to allow cloud control channel as early as possible
Video pictures after real-time play cloud control is experienced with the real-time improving user；
H3., after server end receives this order of cloud control, start backward traversal from the afterbody of chain Table A, empty institute in addition to cloud control channel
There is the video data of other channels；
H4. the non-cloud control channel of server end starts to continuously add chain Table A from respective new every IDR frame and lays equal stress on and newly start to forward.
2. as claimed in claim 1 based on the real time flow medium multichannel transmission control method H.264 encoded, it is characterised in that
In A1 step, the node of chain Table A is mainly including but not limited to following member:
A1.1 video flowing pointer, points to obtained from video sampling equipment and wraps the head pointer of H.264 encoded video streams；
A1.2 video flowing length, numerical value is the byte number that obtained from video sampling equipment wraps H.264 encoded video streams；
A1.3 video sampling equipment, points to obtained from video sampling equipment and wraps regarding corresponding to H.264 encoded video streams
Frequency sampling device pointer, the corresponding road video of each video sampling equipment, i.e. one channel or passage；
A1.4 video data type, shows the type of the bag video flowing obtained from video sampling equipment.
3. as claimed in claim 1 based on the real time flow medium multichannel transmission control method H.264 encoded, it is characterised in that
In A2 step, the node of chained list B is mainly including but not limited to following member:
A2.1 points to the pointer of chain Table A node；
Whether the H.264 coding video frequency data bag that A2.2 chain Table A node is corresponding is every IDR frame mark.
4. as claimed in claim 1 based on the real time flow medium multichannel transmission control method H.264 encoded, it is characterised in that
In D1 step, the node of chained list CA is mainly including but not limited to following member:
D1.1 video flowing pointer, points to the head pointer of the one section of video flowing forwarded from server end；
D1.2 video flowing length, numerical value is the byte number of the one section of video flowing forwarded from server end, is set as 10000.
5. as claimed in claim 1 based on the real time flow medium multichannel transmission control method H.264 encoded, it is characterised in that
In D2 step, the node of chained list CB is mainly including but not limited to following member:
D2.1 video flowing pointer, points to the head pointer of the video flowing that H.264 bag from server end forwarding encodes；
D2.2 video flowing length, numerical value is the byte number of the video flowing that H.264 bag forwarded from server end encodes；
D2.3 video sampling equipment, points to the video corresponding to the video flowing that H.264 bag from server end forwarding encodes and adopts
Sample device pointer, the corresponding road video of each video sampling equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610540068.8A CN106210923B (en) | 2016-07-11 | 2016-07-11 | It is a kind of based on the real time flow medium multichannel transmission control method H.264 encoded |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610540068.8A CN106210923B (en) | 2016-07-11 | 2016-07-11 | It is a kind of based on the real time flow medium multichannel transmission control method H.264 encoded |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106210923A true CN106210923A (en) | 2016-12-07 |
| CN106210923B CN106210923B (en) | 2018-10-30 |
Family
ID=57473259
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610540068.8A Expired - Fee Related CN106210923B (en) | 2016-07-11 | 2016-07-11 | It is a kind of based on the real time flow medium multichannel transmission control method H.264 encoded |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106210923B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111586589A (en) * | 2020-04-30 | 2020-08-25 | 上海交通大学 | Multi-receiving-end audio streaming media wireless transmission and synchronous playing method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101330609A (en) * | 2008-07-31 | 2008-12-24 | 南京大学 | Method and system for multi-path wireless video transmission |
| CN102209232A (en) * | 2010-04-09 | 2011-10-05 | 佛山市智邦电子科技有限公司 | Remote audio and video monitor system and method thereof |
| US20120011267A1 (en) * | 2009-03-19 | 2012-01-12 | Azuki Systems, Inc. | Live streaming media delivery for mobile audiences |
| CN103997623A (en) * | 2014-05-06 | 2014-08-20 | 四川长虹电器股份有限公司 | Video monitoring method based on P2P technology |
| CN104935958A (en) * | 2015-06-24 | 2015-09-23 | 青岛科技大学 | Real-time video transmission device and method |
| CN105306959A (en) * | 2015-10-24 | 2016-02-03 | 广东医群科技有限公司 | Low-delay adaptive network live broadcast system, |
-
2016
- 2016-07-11 CN CN201610540068.8A patent/CN106210923B/en not_active Expired - Fee Related
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101330609A (en) * | 2008-07-31 | 2008-12-24 | 南京大学 | Method and system for multi-path wireless video transmission |
| US20120011267A1 (en) * | 2009-03-19 | 2012-01-12 | Azuki Systems, Inc. | Live streaming media delivery for mobile audiences |
| CN102209232A (en) * | 2010-04-09 | 2011-10-05 | 佛山市智邦电子科技有限公司 | Remote audio and video monitor system and method thereof |
| CN103997623A (en) * | 2014-05-06 | 2014-08-20 | 四川长虹电器股份有限公司 | Video monitoring method based on P2P technology |
| CN104935958A (en) * | 2015-06-24 | 2015-09-23 | 青岛科技大学 | Real-time video transmission device and method |
| CN105306959A (en) * | 2015-10-24 | 2016-02-03 | 广东医群科技有限公司 | Low-delay adaptive network live broadcast system, |
Non-Patent Citations (2)
| Title |
|---|
| 李罗涛: "基于RTSP的H.264实时流媒体传输方案的研究与实现", 《中国优秀硕士学位论文全文数据库》 * |
| 甄聪聪: "基于RTSP和H.264的嵌入式网络视频监控系统", 《中国优秀硕士学位论文全文数据库》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111586589A (en) * | 2020-04-30 | 2020-08-25 | 上海交通大学 | Multi-receiving-end audio streaming media wireless transmission and synchronous playing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106210923B (en) | 2018-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6027291B1 (en) | Switching between adaptive sets during media streaming | |
| JP6612249B2 (en) | Targeted ad insertion for streaming media data | |
| US9160777B2 (en) | Adaptive variable fidelity media distribution system and method | |
| DE112012001770T5 (en) | Real-time processing capability based quality adjustment | |
| US9043479B2 (en) | Data retrieval in a two-way network | |
| WO2021147448A1 (en) | Video data processing method and apparatus, and storage medium | |
| DE112012002159T5 (en) | Context-aware client buffer thresholds | |
| CN108040286A (en) | Video previewing method, device, electronic equipment and computer-readable recording medium | |
| CN101321275B (en) | System and method for processing video stream | |
| TW201328332A (en) | System and method for providing and transmitting condensed streaming content | |
| CN101917389A (en) | Network television direct broadcasting system | |
| CN109618188B (en) | Video data encoding and forwarding method, device, equipment and storage medium | |
| DE112011101908T5 (en) | Quality adjustment using a fragmented media stream | |
| CN101917613A (en) | Acquiring and coding service system of streaming media | |
| CN107295364B (en) | For the real-time streaming transport control method of barrage video, control device | |
| US20190289052A1 (en) | Video streaming | |
| CN108494792A (en) | A kind of flash player plays the converting system and its working method of hls video flowings | |
| US20080310445A1 (en) | Provisioning Bandwidth For A Digital Media Stream | |
| US11671636B2 (en) | Per-segment parameters for content | |
| WO2012011466A1 (en) | Relay device, relay method, communications system, relay control program, and recoding medium | |
| US20190020734A1 (en) | Reduced content manifest size | |
| CN106210923B (en) | It is a kind of based on the real time flow medium multichannel transmission control method H.264 encoded | |
| CN106534889B (en) | A kind of real time flow medium multichannel retransmission method based on loop buffer | |
| EP3627842A1 (en) | Systems and methods for generating individualized playlists | |
| CN114501052B (en) | Live broadcast data processing method, cloud platform, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20181030 Termination date: 20190711 |