CN103561260A - Method and device for measuring lost step between network side audio and video streams based on RTSP - Google Patents
Method and device for measuring lost step between network side audio and video streams based on RTSP Download PDFInfo
- Publication number
- CN103561260A CN103561260A CN201310529271.1A CN201310529271A CN103561260A CN 103561260 A CN103561260 A CN 103561260A CN 201310529271 A CN201310529271 A CN 201310529271A CN 103561260 A CN103561260 A CN 103561260A
- Authority
- CN
- China
- Prior art keywords
- audio
- video flow
- rtsp
- video
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method for measuring a lost step between streaming media service flow. The method can be applied to a network side. At a network node, only a streaming media control protocol RTSP in a large number of audio and video streams needs to be analyzed, and fast matching of the audio and video streams in coderivative video is achieved through corresponding port numbers. Furthermore, the timestamp information of an RTP is utilized, and the value of the lost step between the audio and video streams can be measured well. In addition, according to the method, an RTCP does not need to be analyzed, the algorithm complexity of measuring the lost step between the audio and video streams is reduced to a large extent, and the method can adapt to the actual needs of the network side better.
Description
Technical field
The present invention relates to network video service evaluating objective quality field, more specifically, relate to when being applied in network side in this field and receiving a large amount of audio/video flow the measurement of step-out between the matching technique of homology audio/video flow and audio/video flow.
Background technology
In recent years, along with the lifting at full speed of Internet bandwidth, streaming media video business has obtained good development.At network side, streaming media service being carried out to evaluating objective quality can helping service provider more clearly understand the satisfaction of user to video quality, thereby can improve service quality further.In actual flow media business, audio/video flow normally transmits by different rtp streamings.Therefore, in network side video objective quality evaluation, how in a large amount of data flow Rapid matching out from the audio/video flow of same video traffic and to measure step-out between stream be a key technology.
In streaming media service, be based upon RTSP agreement on Internet Transmission layer protocol TCP for realizing negotiation and the foundation that between server and client, streaming media service is connected; Be based upon transmission and quality-monitoring that RTP on UDP and rtcp protocol are respectively used to realize audio/video flow.Between existing each audio/video flow of Streaming Media client, be synchronously according to Real-time Transport Protocol standard (RFC3550), by what the parsing of rtcp protocol was realized.In the Sender Report (Sender Report) that Streaming Media client periodically sends server, npt timestamp and rtp timestamp are analyzed, and realize the synchronous and calibration between audio/video flow.But this synchronization mechanism synchronously depend on for the first time the time of advent of first Sender Report, thereby affect the initial broadcasting of video.Therefore, in certain methods application RTSP agreement Play response, synchronous initialization is carried out in range and rtptime territory, utilizes rtcp protocol in the process of playing simultaneously, carries out calibration synchronous between audio/video flow.
Yet, in network side video objective quality evaluation, between the above-mentioned stream based on rtcp protocol, synchronously there is certain problem.The first, on network node, simultaneous audio/video flow is more, needs first in a large amount of audio/video flows, to separate fast each audio/video flow from same video, could further to the step-out between audio/video flow, measure.The second, the data throughput of network side is larger, to having relatively high expectations of data processing speed.Therefore the step-out method of measurement between audio/video flow can not be too complicated.The 3rd, rtcp protocol is option in streaming media service, therefore at network side, cannot not carry out video objective quality evaluation to disposing the streaming media service of rtcp protocol, and this has limited the scope of application of method of measurement to a great extent.The 4th, rtcp protocol is based upon on UDP, is based upon on unreliable connection, and when network quality is poor, the RTCP bag that comprises Sender Report may be lost, and causes method of measurement to measure the step-out between audio/video flow.
The present invention proposes the method for measurement of step-out between a kind of streaming media service stream that can be applied to network side.At network node place, only need the Streaming Media control protocol RTSP in a large amount of audio/video flows to resolve, utilize respective ends slogan, realize the Rapid matching of each audio/video flow in homology business.Further, the present invention utilizes the timestamp information of Real-time Transport Protocol, can measure preferably step-out between audio/video flow.In addition, the method in the present invention, without rtcp protocol is resolved, has reduced the algorithm complex that between audio/video flow, step-out is measured largely, can better adapt to the actual demand of network side.
Summary of the invention
Technical problem to be solved by this invention is: overcome the parsing, the method that between the audio/video flow existing in prior art, synchronously depend on rtcp protocol too complicated, cannot be applicable to problem and defect that between network side audio/video flow, step-out is measured.
In order to solve the problems of the technologies described above, the invention provides a kind of method that between the audio/video flow based on RTSP protocol port Rapid matching, step-out is measured at network side, comprise the following steps:
(a) at network side, obtain the RTSP bag of streaming media service.
(b) the RTSP bag obtaining is resolved, and record essential information, Internet Transmission information and the initial synchronisation information of homology audio/video flow.
(c), according to the port number information in the homology audio/video flow Internet Transmission information of record, at network side, obtain sound, the video flowing of streaming media service.
(d) according to the timestamp of the essential information of the homology audio/video flow of record, initial synchronisation information and RTP bag, step-out between homology audio/video flow is measured.
Further, said method also can have following characteristics: in step (a), need to obtain same IP address to and DESCRIBE order and the response of the RTSP agreement of port numbers, SETUP order and response, PLAY order and response and TEARDOWN order and respond.Can guarantee like this can to parse Internet Transmission port numbers and the needed information of all audio/video flows of this video stream media business in (b).
Further, the above-mentioned consideration that RTSP bag is obtained also can have following characteristics: because RTSP agreement adopts default port numbers 554 conventionally at server, therefore at network side, only need to the port numbers of Transmission Control Protocol, resolve at transport network layer, can obtain RTSP bag.Guaranteed like this to obtain realizing of RTSP bag simple in the situation that network side mass data flows.
Further, the above-mentioned consideration that RTSP bag is resolved also can have following characteristics: in step (b), the DESCRIBE order of RTSP agreement and response thereof are resolved.SDP in analyzing responding (Session Description Protocol) message, can obtain the audio/video flow information that the video of client-requested comprises, sample frequency and the orbit number trackID of record audio stream, and the sample frequency of video flowing, frame per second and orbit number trackID respectively.The essential information of these audio/video flows can be measured for step-out between subsequent sound video flowing.
Further, the above-mentioned consideration that RTSP bag is resolved also can have following characteristics: in step (b), the SETUP order of RTSP agreement and response thereof are resolved.Analyzing responding message, according to orbit number trackID, can find and record client network transmission ends slogan and the task number session of corresponding audio/video flow.Wherein, the RTP bag that client network transmission ends slogan obtains audio/video flow for (c) obtains.Task number session is for the coupling of homology audio/video flow.
Further, the above-mentioned consideration that RTSP bag is resolved also can have following characteristics: in step (b), the PLAY order of RTSP agreement and response thereof are resolved.Analyzing responding message, according to task number session and orbit number trackID, finds and records the timestamp information of the first RTP bag of Audio/Video Streaming.Because each audio/video flow initial time stamp is that independent random produces.Therefore, realize in (d) synchronous between audio/video flow according to the timestamp information of the first RTP bag transmitting in RTSP control protocol.
Further, the above-mentioned consideration that RTSP bag is resolved also can have following characteristics: in step (b), the TEARDOWN order of RTSP agreement and response thereof are resolved.When connecting disconnection, according to session, delete the record of corresponding audio/video flow.Can avoid like this port numbers of the middle connection breaking of reality to continue to monitor the computational resource of waste network side.
Further, the above-mentioned consideration that RTSP bag is resolved also can have following characteristics: in method, only by control protocol RTSP in process that streaming media service is connected, resolve, can complete the Rapid matching to homology audio/video flow.Method realizes simple and quick, and method computation complexity is lower, can better adapt to the feature that network side data amount is larger.
Further, the above-mentioned consideration that RTSP bag is resolved also can have following characteristics: in method, only utilize PLAY order and the response thereof of RTSP agreement, just can complete between audio/video flow synchronously.So, without in the process of streaming media playing by rtcp protocol being monitored to realize synchronous between audio/video flow, so greatly simplified process synchronous between audio/video flow, can save a large amount of resources at network side, thereby can provide fast the measurement result of step-out between streaming media service stream.
Further, the above-mentioned consideration that homology audio/video flow is obtained also can have following characteristics: in step (c), according to the Internet Transmission port numbers of the audio/video flow of record in (b), at network side, obtain the RTP bag of each audio/video flow, for the measurement of the step-out between (d) homology audio/video flow.
Further, above-mentioned to homology audio/video flow, synchronous consideration also can have following characteristics: in step (d), according to the essential information of the audio/video flow of record in (b), can calculate the timestamp increment of sound, video flowing, for step-out between subsequent sound video flowing, measure.
Further, above-mentioned to homology audio/video flow, synchronous consideration also can have following characteristics: in step (d), according to the timestamp increment of the initial time stamp information of the homology audio/video flow obtaining in (b), audio/video flow with the timestamp information of each RTP bag obtaining (c), can realize synchronous between homology audio/video flow.
Further, the above-mentioned consideration that step-out between homology audio/video flow is measured also can have following characteristics: in the process that step-out is measured between homology audio/video flow, introduce the concept of time window.In time window, calculate step-out between audio/video flow and guarantee that the measured value obtaining is more level and smooth, Output rusults is more stable.
The present invention also provides a kind of network side apparatus of realizing said method, comprises between RTSP bag parsing module, RTP audio/video flow extraction module, audio/video flow step-out measurement module between synchronization module and audio/video flow.
Further, described RTSP bag parsing module also can have following characteristics: from RTSP bag, extract DESCRIBE order and response, SETUP order and response thereof, PLAY order and response thereof and TEARDOWN order and response thereof.Parsing obtains audio/video flow essential information, Internet Transmission information and initial synchronisation information.
Further, described RTSP bag parsing module also can have following characteristics: audio/video flow essential information comprises sample frequency and the orbit number of audio stream, the sample frequency of video flowing, frame per second and orbit number.
Further, described RTSP bag parsing module also can have following characteristics: audio/video flow Internet Transmission packets of information includes network transmission ends slogan and task number.
Further, described RTSP bag parsing module also can have following characteristics: initial synchronisation information comprises the timestamp information of the first RTP bag of audio/video flow.
Further, described RTP audio/video flow extraction module also can have following characteristics: according to the Internet Transmission port numbers of record, extract the RTP audio/video flow of related streams media business, and resolve the timestamp information that head obtains this RTP bag.
Further, between described audio/video flow, synchronization module also can have following characteristics: according to the task number of record, and can Rapid matching homology audio/video flow.
Further, described audio/video flow synchronization module also can have following characteristics: according to audio/video flow initial synchronisation information, can realize the Fast synchronization between audio/video flow.
Further, described audio/video flow synchronization module also can have following characteristics: according to the audio/video flow essential information of record, can calculate the timestamp increment of audio/video flow, for the step-out between audio/video flow, measure.
Further, between described audio/video flow, step-out measurement module also can have following characteristics: on the basis that the step-out of each frame is calculated, introduced the concept of time window.In time window, the step-out of each frame is weighted on average, thereby obtains more level and smooth stable measurement result.
Beneficial effect
This method is measured the step-out between network side homology audio/video flow in streaming media service.Finally set up step-out method of measurement between a simple and effective network side streaming media service stream.Between more existing audio/video flow, simultaneous techniques is compared, the present invention only utilizes Streaming Media control protocol RTSP to realize the Rapid matching of homology audio/video flow in network side audio/video flow with synchronously, method is simple, can adapt to better the feature that network side data amount is large.
Accompanying drawing explanation
Fig. 1 is embodiment of the present invention overall process block diagram.
Fig. 2 is embodiment of the present invention RTSP bag parsing module block diagram.
Fig. 3 is embodiment of the present invention RTP audio/video flow extraction module block diagram.
Fig. 4 is synchronization module block diagram between embodiment of the present invention audio/video flow.
Fig. 5 is step-out measurement module block diagram between embodiment of the present invention audio/video flow.
Embodiment
Fig. 1 is the overall procedure of this method.RTSP bag parsing module is mainly used in extracting RTSP at network side and wraps and resolve RTSP control information.First, according to RTSP Internet Transmission port numbers, at network side, extract RTSP bag.Then the control information in RTSP bag is resolved, obtains synchronous initiation information between audio/video flow essential information, Internet Transmission information, stream, for the audio/video flow of subsequent step extract and stream between step-out measure.Wherein, audio/video flow essential information comprises sample frequency and the orbit number of audio stream, and the sample frequency of video flowing, frame per second and orbit number; Internet Transmission information comprises Internet Transmission port numbers and the task number of audio/video flow; Between stream, synchronous initiation information comprises the timestamp information of sound, the first RTP bag of video flowing.RTP audio/video flow extraction module is responsible for, according to the Internet Transmission port numbers of RTSP bag parsing module record, at network side, carrying out obtaining of audio/video flow RTP bag.Between audio/video flow, synchronization module is responsible for calculating respectively audio/video flow timestamp increment according to sound, video flowing essential information, then synchronous according to synchronous initiation information realization homology audio/video flow between stream.Finally, by step-out measurement module between audio/video flow, in time window, calculated the step-out value of homology audio/video flow.
Fig. 2 is the specific descriptions of RTSP bag parsing module, and this module comprises following steps:
Step 210, because most of RTSP streaming media servers of practical application are all used default port number 554 transmit pories as RTSP agreement.Therefore, in the present invention, easy for realizing, according to default port numbers 554, at network side, extract RTSP bag.RTSP agreement is based upon on Internet Transmission layer protocol TCP, to the extraction of RTSP bag, can resolve by the destination slogan in TCP packet header and two territories of source port number.If destination slogan is 554, it is RTSP request command; If source port number is 554, it is RTSP response command.
Step 215, to RTSP, order is resolved, and obtain RTSP control command type (DESCRIBE, SETUP, PLAY and TEARDOWN), and a minute situation is processed.
Step 220, if RTSP request command is DESCRIBE order, records the sequence number CSeq of this request command flag information, source IP address and port numbers and object IP address and port numbers.
Step 225, continues to monitor to the RTSP bag in network flow, and according to the request command flag information of record in step 220, finds the next message with same request order flag information in response command, is the response of this DESCRIBE order.
Step 230, the SDP message in the response of parsing DESCRIBE order.SDP message is resolved, can obtain the essential information of audio/video flow.
For example the SDP message of the streaming media service stream of a H264 coding is as follows:
Media Description from above-mentioned message, name and address (m) territory can parse this streaming media service stream and comprise a video flowing (video0RTP/AVP96) and an audio stream (audio0RTP/AVP97).
In this example, the video flowing essential information of business can be resolved from Media Attribute (a) territory of video flowing.By Media Attribute (a): rtpmap:96H264/90000 territory, can obtain video flowing sample frequency is freq
vidco=90000Hz.By Media Attribute (a): control:trackID=65536 territory, can obtain video track Taoist monastic name trackID
vidco=65536.Again by SPS in sprop-parameter-sets territory (being Z2QAHqy0BaGfL4CIAAADA+gAALtUeLF1) is carried out to Base64 decoding and decapsulation, obtain SPS=6764001e ac b405a19f2f8088000003e80000bb5478b175, it is resolved and can obtain num_units_in_tick=125 and time_scale=5994, so the frame per second fps=time_scale/num_units_in_tick/2=23.976frames/second of video.
In this example, the audio stream essential information of business can be resolved from Media Attribute (a) territory of audio stream.By Media Attribute (a): rtpmap:97mpeg4-generic/44100/2 territory, can obtain audio sampling frequency is freq
audio=44100 * 2Hz.By Media Attribute (a): control:trackID=65537 territory, can obtain audio track Taoist monastic name trackID
audio=65537.
Step 235, if RTSP request command is SETUP order, records the sequence number CSeq of this request command flag information, source IP address and port numbers and object IP address and port numbers.And by the REQUEST territory in this SETUP request command is resolved, obtain the trackID of corresponding audio/video flow.
Step 240, continues to monitor to the RTSP bag in network flow, and according to the request command flag information of the record in step 235, finds the next one to have the message of same request order flag information, is the response of this SETUP order.
For example, the SETUP command response of a RTSP bag is as follows:
Wherein, by Session:2519348816218767898 territory, can parse the task number session=2519348816218767898 of this stream.By Transport territory, can parse Internet Transmission port numbers client_port=54994.
Step 250, if RTSP request command is PLAY order, records the sequence number CSeq of this request command flag information, source IP address and port numbers and object IP address and port numbers.
Step 255, continues to monitor to the RTSP bag in network flow, and according to the request command flag information of the record in step 250, finds the next one to have the message of same request order flag information, is the response of this PLAY order.
Step 260, the response of parsing PLAY order, obtains synchronous initiation information between audio/video flow, comprises the timestamp information rtptime of the first RTP bag of sound, video flowing
audioand rtptime
vidco.
For example, the PLAY command response of a RTSP bag is as follows:
By RTP-Info territory, can parse the timestamp information rtptime of first RTP bag of the audio stream of trackID=65536
audio=527607500; The timestamp information rtptime of the first RTP bag of the video flowing of trackID=65537
vidco=64458855.
Step 265, if RTSP request command is TEARDOWN order, records the sequence number CSeq of this request command flag information, source IP address and port numbers and object IP address and port numbers.
Step 270, continues to monitor to the RTSP bag in network flow, and according to the request command flag information of record in step 265, obtains the response of this TEARDOWN order.
Step 275, TEARDOWN order represents that this streaming media service stream connection disconnects, and therefore should according to session value wherein, delete all information of this Business Stream, comprises audio/video flow essential information, Internet Transmission information and synchronous initiation information etc.
Fig. 3 is the specific descriptions of RTP audio/video flow extraction module, and this module comprises following steps:
Step 310 according to Internet Transmission port numbers, is obtained the RTP bag of audio/video flow from network flow.Because Real-time Transport Protocol is to be based upon on Internet Transmission layer protocol UDP, therefore the destination slogan territory in UDP packet header is resolved, can obtain the RTP bag of corresponding network transmission ends slogan.
Step 315, resolves the timestamp timestamp territory in the RTP bag packet header obtaining, and obtains the timestamp information cur_rtptime of each RTP bag in audio/video flow.This information is measured for step-out between subsequent step audio/video flow.
Fig. 4 is the specific descriptions of synchronization module between audio/video flow, and this module comprises following steps:
Step 410, stabs increment δ computing time by audio/video flow essential information
audioand δ
video, suppose that the every T of voice data encapsulates once second.
δ
audio=freq
audio×T
δ
video=freq
video/fps
Step 420, according to audio/video flow initialization information rtptime
audioand rtptime
vidco, the timestamp of sound, the first RTP bag of video flowing, carries out synchronously, calculating the reproduction time playtime of current Audio/Video Streaming to each RTP bag of homology audio/video flow.
For example, the timestamp of supposing current last packets of audio data of receiving is cur_rtptime
audio; The timestamp of last video packets of data is cur_rtptime
vidco, the reproduction time of sound, video flowing is respectively
playtime
audio=(cur_rtptime
audio-rtptime
audio)／δ
audio
playtime
video=(curr_rtptime
video-rtptime
video)／δ
video
Fig. 5 is the specific descriptions of step-out measurement module between audio/video flow, and this module comprises following steps:
Step 510, according to the reproduction time of the audio/video flow obtaining in step 420, calculates the step-out value D between homology audio/video flow.
For example, (the unit: be second) of the step-out D between single frames homology audio/video flow in this example
D=|playtime
audio-playtime
video|
Step 515, according to the single frames homology audio frequency and video fluid sound step-out value D obtaining in step 510, weighted average in time window, obtains average step-out value D
avg, make result more stable.
Suppose that time window length is W, average step-out value is:
Although step-out method of measurement and device have been illustrated and have described between the network side audio/video flow based on RTSP, clearly the present invention is unrestricted.Under the condition not departing from by the determined the spirit and scope of the present invention of appended claims book, those skilled in the art will can take into account many corrections, replacing, variation, substitute and equivalent content.
For example, for obtaining of RTSP bag, be not limited to the mode that embodiment proposes, can adopt the mode that data payload package is resolved, obtain RTSP bag.
For example, the calculating for step-out degree between homology audio/video flow is not limited to the mode that embodiment proposes.Can adopt other Environmental Evaluation Model to assess or weighting the step-out between homology audio/video flow.
Claims (11)
1. a step-out method of measurement between the network side audio/video flow based on RTSP, is characterized in that, comprising:
(1) at network side, obtain the RTSP bag of streaming media service
(2) the RTSP bag obtaining is resolved, and record essential information, Internet Transmission information and the initial synchronisation information of homology audio/video flow.
(3) according to the timestamp of the homology audio/video flow essential information of record, initial synchronisation information and RTP bag, step-out between homology audio/video flow is measured.
2. the method for claim 1, is characterized in that, the RTSP that obtains network side streaming media service comprises:
According to same IP address to and default port numbers 554 at network side, extract control command and the responses of RTSP;
Need the network side RTSP extracting comprise the DESCRIBE order of RTSP agreement and respond, SETUP order and response, PLAY order and response and TEARDOWN order and response.
3. the method for claim 1, is characterized in that, the RTSP bag obtaining is resolved, and the essential information, Internet Transmission information and the initial synchronisation information that record homology audio/video flow comprises:
Resolve DESCRIBE order and the response thereof of RTSP agreement, the SDP(Session Description Protocol in analyzing responding) message, can obtain the essential information of audio/video flow, for step-out measurement between subsequent sound video flowing.Wherein, audio/video flow essential information comprises sample frequency and the orbit number of audio stream, and the sample frequency of video flowing, frame per second and orbit number.
Resolve SETUP order and the response thereof of RTSP agreement, analyzing responding message, can obtain the Internet Transmission information of audio/video flow, for the RTP of audio/video flow, wraps and obtains and the coupling of homology audio/video flow.Wherein, the Internet Transmission information of audio/video flow comprises Internet Transmission port numbers and the task number of audio/video flow.
Resolve PLAY order and the response thereof of RTSP agreement, analyzing responding message, can obtain the initial synchronisation information of audio/video flow, between audio/video flow synchronously.Wherein, the initial synchronisation information of audio/video flow comprises the timestamp information of the first RTP bag of audio/video flow waiting for transmission.
Resolve TEARDOWN order and the response thereof of RTSP agreement, when connecting disconnection, according to task number, delete the record of corresponding audio/video flow, avoid the port numbers of middle connection breaking business to continue to monitor the computational resource of waste network side.
4. the method for claim 1, is characterized in that, according to the timestamp of the homology audio/video flow essential information of record, initial synchronisation information and RTP bag, step-out measurement between homology audio/video flow is comprised:
According to the audio/video flow essential information of record, calculate the timestamp increment of sound, video flowing, for step-out between subsequent sound video flowing, measure.
According to the audio/video flow initial synchronisation information of record, the timestamp information of timestamp increment and each RTP bag, calculates the reproduction time of each RTP bag, realizes synchronous between homology audio/video flow.
5. method as claimed in claim 3, is characterized in that, RTSP request command and mating of response are comprised:
According to the sequence number of solicited message, source IP address and port numbers and object IP address and port numbers, connect and set up control command and response is mated the RTSP of same flow media business.
6. method as claimed in claim 5, is characterized in that, the measurement of step-out value between homology audio/video flow is comprised:
In the process that step-out is measured between homology audio/video flow, introduce the concept of time window.In time window, calculate step-out value between audio/video flow, guarantee that the measured value obtaining is more level and smooth, Output rusults is more stable.
7. a step-out measurement mechanism between the network side audio/video flow based on RTSP, is characterized in that, described device comprises:
(1) RTSP bag parsing module
(2) RTP audio/video flow extraction module
(3) synchronization module between audio/video flow
(4) step-out measurement module between audio/video flow.
8. as claimed in claim 7, it is characterized in that, described RTSP bag parsing module comprises:
RTSP bag obtains subelement, for receive RTSP request command and response at network side.
Subelement is resolved in the DESCRIBE order of RTSP agreement and response, for the SDP message of resolution response, obtains the essential information of audio/video flow.
Subelement is resolved in the SETUP order of RTSP agreement and response, for obtaining the Internet Transmission information of audio/video flow.
Subelement is resolved in the PLAY order of RTSP agreement and response, for obtaining the initial synchronisation information of homology audio/video flow.
Subelement is resolved in the TEARDOWN order of RTSP agreement and response, for when connecting disconnection, deletes this Business Stream relevant information, avoids the waste of network side computational resource.
9. as claimed in claim 7, it is characterized in that, described RTP audio/video flow extraction module comprises:
Audio/video flow RTP bag obtains subelement, for according to the Internet Transmission information of record, obtains the RTP bag of homology audio/video flow at network side.
Audio/video flow RTP bag is resolved subelement, for resolving RTP bag packet header, obtains the timestamp information of each RTP bag.
10. as claimed in claim 7, it is characterized in that, between described audio/video flow, synchronization module comprises:
Audio/video flow timestamp incremental computations subelement, for according to the audio/video flow essential information of record, calculates respectively the timestamp increment of audio/video flow.
Homology audio/video flow coupling subelement, for according to the audio/video flow task number of record, carries out the coupling of homology audio/video flow.
The synchronous subelement of homology audio/video flow, for according to the timestamp increment of audio/video flow, initial synchronisation information and each RTP bag timestamp information, calculate the reproduction time that each RTP wraps corresponding audio frequency and video.
11. as claimed in claim 7, it is characterized in that, between audio/video flow, step-out measurement module comprises:
Step-out value calculating sub module between single frames homology audio/video flow, wraps corresponding sound, the reproduction time of video for the sound receiving according to last, the RTP of video flowing, calculates step-out value between single frames audio/video flow.
Average step-out value calculating sub module, for according to step-out value between single frames homology audio/video flow, weighted average in time window, obtains the average step-out value in time window.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310529271.1A CN103561260A (en) | 2013-10-31 | 2013-10-31 | Method and device for measuring lost step between network side audio and video streams based on RTSP |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310529271.1A CN103561260A (en) | 2013-10-31 | 2013-10-31 | Method and device for measuring lost step between network side audio and video streams based on RTSP |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103561260A true CN103561260A (en) | 2014-02-05 |
Family
ID=50015397
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310529271.1A Pending CN103561260A (en) | 2013-10-31 | 2013-10-31 | Method and device for measuring lost step between network side audio and video streams based on RTSP |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103561260A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1645944A (en) * | 2004-12-13 | 2005-07-27 | 武汉大学 | Method for testing audio and video frequency step falling out of audio and video frequency coding-decoding system |
| CN102665141A (en) * | 2012-05-16 | 2012-09-12 | 哈尔滨工业大学深圳研究生院 | AVS (audio video standard) audio and video presynchronizing method based on RTP (real time protocol) package |
-
2013
- 2013-10-31 CN CN201310529271.1A patent/CN103561260A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1645944A (en) * | 2004-12-13 | 2005-07-27 | 武汉大学 | Method for testing audio and video frequency step falling out of audio and video frequency coding-decoding system |
| CN102665141A (en) * | 2012-05-16 | 2012-09-12 | 哈尔滨工业大学深圳研究生院 | AVS (audio video standard) audio and video presynchronizing method based on RTP (real time protocol) package |
Non-Patent Citations (1)
| Title |
|---|
| 蔡庆元: "《基于RTP的手机视频点播系统的设计与实现》", 《华南理工大学硕士学位论文》, 20 November 2010 (2010-11-20), pages 60 - 61 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102868666B (en) | Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience | |
| JP6190525B2 (en) | A concept for determining the quality of media data streams with varying quality versus bit rate | |
| CN1951083B (en) | Refined quality feedback in streaming services | |
| TW200531472A (en) | Method and system for quality feedback in a streaming service | |
| CN106803951A (en) | The live interim card method for diagnosing faults of HLS | |
| CN102014284B (en) | Method, system and device for acquiring parameter set value of video code stream in transcoding business | |
| CN102223260A (en) | Method, system and device for testing transmission quality of IPTV (Internet Protocol Television) video data streams | |
| Lei et al. | Design and implementation of streaming media processing software based on RTMP | |
| CN107105224A (en) | Method, device and system that a kind of quality of experience of video is assessed | |
| CN106657143A (en) | Streaming media transmission method and device, server and terminal | |
| US8451830B2 (en) | System and method for measuring quality of multimedia service | |
| CN111656791B (en) | Signaling and reporting interactivity usage in streaming services | |
| CN106254902A (en) | A kind of based on mobile Internet video user perception and the method and system of analysis | |
| Calyam et al. | Multi‐resolution multimedia QoE models for IPTV applications | |
| Li et al. | Real‐Time QoE Monitoring System for Video Streaming Services with Adaptive Media Playout | |
| CN101179480A (en) | Method for forwarding stream media | |
| Ben Letaifa | Real time ml-based qoe adaptive approach in SDN context for HTTP video services | |
| Zhang et al. | Performance of low-latency HTTP-based streaming players | |
| US9674515B2 (en) | Endpoint information for network VQM | |
| CN101094159B (en) | Method for penetrating through private network of media stream | |
| WO2012029648A1 (en) | Server device, video image quality measurement system, video image quality measurement method and program | |
| Chen et al. | Study on relationship between network video packet loss and video quality | |
| CN103561260A (en) | Method and device for measuring lost step between network side audio and video streams based on RTSP | |
| CN105657460B (en) | Flow media playing method, device and mobile terminal | |
| Zhang et al. | Performance of Low-Latency DASH and HLS Streaming in Mobile Networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: WUXI BUPT SENSING TECHNOLOGY INDUSTRY INSTITUTE CO Free format text: FORMER OWNER: BEIJING POSTAL AND TELECOMMUNICATIONS UNIV. Effective date: 20141106 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: 100876 HAIDIAN, BEIJING TO: 214135 WUXI, JIANGSU PROVINCE |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20141106 Address after: 214135 Jiangsu New District of Wuxi City Linghu Road No. 97 University Science and Technology Park industrial building E, Beijing University of Posts and Telecommunications Applicant after: Wuxi BUPT Perceptive Technology Industry Institute Co., Ltd. Address before: 100876 Beijing city Haidian District Xitucheng Road No. 10 Applicant before: Beijing University of Posts and Telecommunications |
|
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140205 |