CN107770473A - A kind of audio, video data transfer control method and device - Google Patents
A kind of audio, video data transfer control method and device Download PDFInfo
- Publication number
- CN107770473A CN107770473A CN201610676612.1A CN201610676612A CN107770473A CN 107770473 A CN107770473 A CN 107770473A CN 201610676612 A CN201610676612 A CN 201610676612A CN 107770473 A CN107770473 A CN 107770473A
- Authority
- CN
- China
- Prior art keywords
- audio
- equipment
- video data
- sent
- notification message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
Abstract
The invention discloses a kind of audio, video data transfer control method and device.In technical scheme provided in an embodiment of the present invention, during the first equipment sends audio, video data to the second equipment, when second equipment detects that the audio, video data transmission performance that the first equipment is sent changes, the notification message of audio, video data transmission performance change is sent to the first equipment, so that the first equipment is adjusted to coding parameter used in being sent to the audio, video data of the second equipment.Audio, video data transfer control method provided by the invention, audio, video data coding parameter can be adjusted in time according to the situation of change of audio video transmission performance, be adjusted for transmission of the change of network environment in time to audio, video data.
Description
Technical field
The present invention relates to communication technical field, more particularly to a kind of audio/video data transmission method and device.
Background technology
Audio, video data transmission is a kind of current common business.In audio frequency and video, terminal passes through IP multimedia subsystem
(IP Multimedia Subsystem, abbreviation IMS) network carries out calling procedure, and in calling procedure, voice and video telephone is smooth
Degree not only has relation with the quality of wireless network where calling terminal and terminal called, and is covered with quality of wireless network and network
The factors such as lid, building block, mobility have relation.Voice and video telephone is limited to the complexity of wireless network environment, in nothing
Tape is wide do not reach standard transmission requirement in the case of, it may appear that audio frequency and video Caton phenomenon, influence the fluency of audio frequency and video.
When realizing audio, video data transmission, calling terminal and terminal called pass through session initiation protocol (Session
Initiation Protocol, abbreviation SIP) signaling establishes session, and passes through Session Description Protocol (Session
Description Protocol, abbreviation SDP) consult the voice and video telephone established between calling terminal and terminal called.Sound regards
For frequency calling both sides after consulting to establish, calling terminal and terminal called pass through a kind of H.264 Video coding (high performance audio frequency and video
Encoding and decoding technique) voice and video telephone is carried out, and in communication process, the code check parameter of use is fixed, can not be directed to net
Network environmental change adjusts in time.
The content of the invention
The embodiments of the invention provide a kind of audio/video data transmission method and device, to according to audio video transmission performance
Dynamic adjustment audio, video data coding parameter.
Audio, video data transfer control method provided in an embodiment of the present invention, including：
First equipment receives the notification message for the audio, video data transmission performance change that the second equipment is sent；Wherein, it is described
Notification message is that the second equipment detects that the audio, video data transmission performance that the first equipment is sent is sent when changing；
First equipment is according to the notification message, to being sent to coding parameter used in the audio, video data of the second equipment
It is adjusted.
Alternatively, the reception in the notification message comprising the second equipment according to the audio, video data sent to the first equipment
Situation counts obtained audio, video data configured transmission；
First equipment is according to the notification message, to being sent to coding parameter used in the audio, video data of the second equipment
It is adjusted, including：
First equipment is according to adjustment judgment condition, if it is determined that the audio, video data configured transmission included in the notification message
Meet the adjustment judgment condition, then coding parameter used in being sent to the audio, video data of the second equipment is adjusted.
Alternatively, the audio, video data configured transmission includes packet loss and/or propagation delay time is shaken.
Alternatively, first equipment judges whether the audio, video data configured transmission that statistics obtains is full using following steps
The judgment condition of the foot transmission performance change：
The grade belonging to each audio, video data configured transmission is determined respectively；
According to the grade belonging to each audio, video data configured transmission, the high audio, video data transmission ginseng of its middle grade is chosen
Number；
By the grade belonging to the audio, video data configured transmission of selection and the audio, video data configured transmission institute of the upper cycle
The grade of category is compared, if inconsistent, meets the judgment condition of the transmission performance change.
Alternatively, the coding parameter of the data includes the code check of audio, video data.
Alternatively, before the first equipment sends audio, video data to the second equipment, in addition to：
First equipment and the second equipment establish RTCP Real-time Transport Control Protocol RTCP passages by media negotiation；
First equipment receives the notification message for the audio, video data transmission performance change that the second equipment is sent, including：
The notification message that first equipment is sent from the equipment of RTCP channel receptions second.
The audio, video data transfer control method that further embodiment of the present invention provides, including：
Second equipment detects the audio, video data transmission performance that the first equipment is sent；
If the second equipment detects that the audio, video data transmission performance that the first equipment is sent changes, to the first equipment
Send the notification message of audio, video data transmission performance change, the notification message is used to indicating that the adjustment of the first equipment to be sent to the
The coding parameter of the audio, video data of two equipment.
Alternatively, the second equipment detects the audio, video data transmission performance that the first equipment is sent, including：
Second equipment counts according to the reception condition of the audio, video data sent to the first equipment and obtains audio, video data biography
Defeated parameter；
Second equipment detects that the audio, video data transmission performance that the first equipment is sent changes in a case where：The
Two equipment change judgment condition according to transmission performance, and the audio, video data configured transmission that decision statistic obtains meets the transporting
Judgment condition can be changed.
Alternatively, the reception in the notification message comprising the second equipment according to the audio, video data sent to the first equipment
Situation counts obtained audio, video data configured transmission, and the audio, video data configured transmission includes packet loss and/or transmission
Delay variation.
Alternatively, second equipment judges whether the audio, video data configured transmission that statistics obtains is full using following steps
The judgment condition of the foot transmission performance change：
The grade belonging to each audio, video data configured transmission is determined respectively；
According to the grade belonging to each audio, video data configured transmission, the high audio, video data transmission ginseng of its middle grade is chosen
Number；
By the grade belonging to the audio, video data configured transmission of selection and the audio, video data configured transmission institute of the upper cycle
The grade of category is compared, if inconsistent, meets the judgment condition of the transmission performance change.
Alternatively, the coding parameter of the data includes the code check of audio, video data.
Alternatively, before the first equipment sends audio, video data to the second equipment, in addition to：
Second equipment and the first equipment establish RTCP Real-time Transport Control Protocol RTCP passages by media negotiation；
The notification message of audio, video data transmission performance change is sent to the first equipment, including：
Described notification message is sent to the first equipment by the RTCP passages.
Audio, video data transmission control equipment provided in an embodiment of the present invention, as the first equipment application in the second equipment
The process of audio, video data is sent, the equipment includes：
Receiving module, the notification message of the audio, video data transmission performance change sent for receiving the second equipment；Wherein,
The notification message is that the second equipment detects that the audio, video data transmission performance that the first equipment is sent is sent when changing；
Adjusting module, for according to the notification message, adjustment to be sent to the coding ginseng of the audio, video data of the second equipment
Number.
Alternatively, the reception in the notification message comprising the second equipment according to the audio, video data sent to the first equipment
Situation counts obtained audio, video data configured transmission；
The adjusting module is specifically used for：If according to adjustment judgment condition, the sound for judging to include in the notification message regards
Frequency data transmission parameters meet the adjustment judgment condition, then adjustment is sent to the coding ginseng of the audio, video data of the second equipment
Number.
Alternatively, the coding parameter of the data includes the code check of audio, video data.
Audio, video data transmission control equipment provided in an embodiment of the present invention, set as the second equipment application in reception first
The process for the audio, video data that preparation is sent, the equipment include：
Detection module, the audio, video data transmission performance sent for detecting the first equipment；
Sending module, for when the audio, video data transmission performance for detecting that the first equipment is sent changes, to the
One equipment sends the notification message of audio, video data transmission performance change, and the notification message is used to indicate the first equipment adjustment hair
Give the coding parameter of the audio, video data of the second equipment.
Alternatively, the detection module is specifically used for：According to the reception condition of the audio, video data sent to the first equipment,
Statistics obtains audio, video data configured transmission；
The sending module is specifically used for：The audio, video data transporting that the first equipment is sent is detected in a case where
It can change：Second equipment changes judgment condition, the audio, video data configured transmission that decision statistic obtains according to transmission performance
Meet the transmission performance change judgment condition.
Alternatively, the reception in the notification message comprising the second equipment according to the audio, video data sent to the first equipment
Situation counts obtained audio, video data configured transmission, and the audio, video data configured transmission includes packet loss and/or transmission
Delay variation.
Alternatively, the coding parameter of the data includes the code check of audio, video data.
In the above embodiment of the present invention, during the first equipment sends audio, video data to the second equipment, second sets
When the standby audio, video data transmission performance for detecting that the first equipment is sent changes, send audio, video data to the first equipment and pass
The notification message of defeated performance change, so that the first equipment is to being sent to coding parameter used in the audio, video data of the second equipment
It is adjusted.Because audio video transmission performance is influenceed by network transmission performance, therefore according to the change feelings of audio video transmission performance
Condition is adjusted to audio, video data coding parameter in time, can be directed to the change of network environment transmission to audio, video data in time
It is adjusted.
Brief description of the drawings
Technical scheme in order to illustrate the embodiments of the present invention more clearly, make required in being described below to embodiment
Accompanying drawing is briefly introduced, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for this
For the those of ordinary skill in field, without having to pay creative labor, it can also be obtained according to these accompanying drawings
His accompanying drawing.
Fig. 1 is audio, video data transfer control method schematic flow sheet provided in an embodiment of the present invention；
Fig. 2 is that the flow that whether the second equipment detection audio, video data transmission performance changes in flow shown in Fig. 1 is shown
It is intended to；
Fig. 3 is the flow signal of the coding parameter adjustment judgement that the first equipment carries out audio, video data in flow shown in Fig. 1
Figure；
Fig. 4 is the Sender Report form schematic diagram in the embodiment of the present invention；
Fig. 5 is the signaling process schematic diagram that middle pitch video call both sides of the embodiment of the present invention are called；
Fig. 6 is the structural representation of audio, video data transmission equipment provided in an embodiment of the present invention；
Fig. 7 is the structural representation for the audio, video data transmission equipment that further embodiment of the present invention provides.
Embodiment
In order that the object, technical solutions and advantages of the present invention are clearer, the present invention is made below in conjunction with accompanying drawing into
One step it is described in detail, it is clear that the described embodiment only a part of embodiment of the present invention, rather than whole implementation
Example.Based on the embodiment in the present invention, what those of ordinary skill in the art were obtained under the premise of creative work is not made
All other embodiment, belongs to the scope of protection of the invention.
In IMS network, audio frequency and video calling both sides after SDP negotiation, by H.264 video compiled by calling terminal and terminal called
Code carries out voice and video telephone, in communication process, employs fixed coding parameter, because fixed coding parameter is for change
Network environment can not timely adjust, audio frequency and video Caton phenomenon is occurred.
To solve the above problems, the embodiment of the present invention proposes a kind of method of audio-visual quality dynamic adjustment.
The method for the audio-visual quality dynamic adjustment that the embodiment of the present invention proposes, the dynamic analysis transporting in communication process
Can, and the coding parameter of audio, video data is adjusted in time.
Described in the following examples of the present invention so that the first equipment carries out audio, video data transmission with the second equipment as an example.Its
In, audio, video data can be encoded using H.264 coded format, can also use other coded formats certainly, and the present invention is implemented
Example is without limitation.
Before first equipment carries out audio frequency and video session service with the second equipment, audio frequency and video meeting is established by media negotiation first
Words, that is, establish the transmission channel of audio, video data.On this basis, in the embodiment of the present invention, the first equipment and the second equipment it
Between can also establish the passage for transmitting control information, such as RTCP Real-time Transport Control Protocol (Real-time Transport
Control Protocol, abbreviation RTCP) passage.
Referring to the schematic flow sheet that Fig. 1 is audio, video data transmission control procedures method provided in an embodiment of the present invention.Should
Flow comprises the following steps：
Step 101：First equipment sends audio, video data to the second equipment.
Step 102：Second equipment detects the audio, video data transmission performance that the first equipment is sent, if detecting the first equipment
The audio, video data transmission performance of transmission changes, then is transferred to step 103.
In the step, the second equipment can obtain according to the reception condition of the audio, video data sent to the first equipment, statistics
Audio, video data configured transmission.
Audio, video data transmission performance can be characterized using a variety of configured transmissions.In the embodiment of the present invention, packet loss can be used
Rate and/or propagation delay time are shaken to characterize audio video transmission performance, and packet loss is bigger, and audio, video data transmission performance is poorer, are passed
Defeated delay variation is bigger, and audio, video data transmission performance is poorer.
Step 103：Second equipment sends the notification message of audio, video data transmission performance change to the first equipment.
Wherein, the reception condition in the notification message comprising the second equipment according to the audio, video data sent to the first equipment
Obtained audio, video data configured transmission is counted, for example may include packet loss and/or propagation delay time shake.
Alternatively, transmission performance change judgment condition can be pre-set, for adjudicating whether transmission performance changes.This
Sample, in step 103, the second equipment can change judgment condition according to transmission performance, judge the audio, video data transmission that statistics obtains
Parameter meets that the transmission performance changes judgment condition, if satisfied, then determining that transmission performance changes, otherwise, it determines transporting
It can keep constant.Audio, video data configured transmission can be filtered out using transmission performance change judgment condition, and minor variations occur
Situation, in order to avoid excessively continually send a notification message and carry out the adjustment of audio, video data coding parameter.
Step 104：The notification message that first equipment is sent according to the second equipment received, to being sent to the second equipment
Coding parameter is adjusted used in audio, video data.
Wherein, coding parameter may include code check, frame per second, resolution ratio etc..
So that coding parameter includes code check as an example, the first equipment can be according to the sound that carries in the notification message that the second equipment is sent
Video data transmission parameter, improve or reduce code check.If for example, carried in notification message packet loss and propagation delay time shake compared with
Greatly, then show the first equipment be sent to the second equipment audio, video data transmission performance it is poor, therefore the first equipment can reduce
To the code check for the audio, video data for being sent to the second equipment, to improve transmission performance；If the conversely, packet loss carried in notification message
Rate and propagation delay time shake it is smaller, then show the first equipment be sent to the second equipment audio, video data transmission performance it is preferable, because
This first equipment can improve the code check of the audio, video data to being sent to the second equipment, so that the second equipment obtains preferable sound
Video quality.So, it both ensure that and connect with regard to obtaining a balance between code check and whole picture or the presentation mode of audio
The data of receipts completely save Internet resources again., can be according to setting step-length when code check is heightened or turned down during above-mentioned adjustment code check
It is adjusted, untill being adjusted to the upper limit or lower limit.
Alternatively, in the present embodiment, adjustment judgment condition can be pre-set, for deciding whether to carry out coding parameter tune
It is whole.So, in step 104, the second equipment can judge the audio, video data transmission that the second equipment is sent according to adjustment judgment condition
Whether parameter meets the adjustment judgment condition, if satisfied, then to being sent to coding used in the audio, video data of the second equipment
Parameter is adjusted, otherwise, without adjustment.Using adjustment judgment condition, audio, video data configured transmission hair can be filtered out
The situation of raw minor variations, in order to avoid excessively continually carry out the adjustment of audio, video data coding parameter.
By above description as can be seen that during the first equipment sends audio, video data to the second equipment, second sets
When the standby audio, video data transmission performance for detecting that the first equipment is sent changes, send audio, video data to the first equipment and pass
The notification message of defeated performance change, so that the first equipment is to being sent to coding parameter used in the audio, video data of the second equipment
It is adjusted.Because audio video transmission performance is influenceed by network transmission performance, therefore according to the change feelings of audio video transmission performance
Condition is adjusted to audio, video data coding parameter in time, can be directed to the change of network environment transmission to audio, video data in time
It is adjusted.
In above-mentioned flow, the transporting for the audio, video data that the second equipment can be sent according to the cycle of setting to the first equipment
Cycle detection can be carried out.The length of detection cycle can be set according to factors such as the network architecture, network performance, audio-visual quality requirements
Put, for example detection cycle length can be arranged to 3 seconds.
With reference to Fig. 2, the process that audio, video data transmission performance is detected to the second equipment is described in detail.
It is that the second equipment detects the stream whether audio, video data transmission performance changes in flow shown in Fig. 1 referring to Fig. 2
Journey schematic diagram.The flow describes by taking the packet loss of the second equipment detection audio video transmission parameter and propagation delay time shake as an example, should
Flow comprises the following steps：
Step 201：Second device periodically detects packet loss and propagation delay time shake.Wherein, packet loss and propagation delay time
Shake the transmission performance for judging medium surface.
Step 202：Second equipment is shaken according to the packet loss and propagation delay time detected, it is determined that the grade belonging to each.
When it is implemented, packet loss and propagation delay time shake can be pre-set 3 etc. according to the threshold value of the second equipment
Level, according to the transmission performance order from low to high of sign, packet loss can be divided into high, medium and low 3 grades, according to sign
The order of transmission performance from low to high, propagation delay time shake can be divided into high, medium and low 3 grades.In step 202, the second equipment
The concrete numerical value and corresponding threshold value that can be shaken according to the packet loss and propagation delay time detected, determine packet loss and transmission
Delay variation each belonging to grade.
Step 203：The grade belonging to grade and propagation delay time shake according to belonging to packet loss, judges the sound that statistics obtains
Whether video data transmission parameter reaches the trigger condition of transmission performance change, if judging the triggering bar for reaching transmission performance change
Part, then step 204 is performed, is otherwise transferred to step 201.
In the step, the second equipment can respectively obtain the grade and propagation delay time shake belonging to packet loss from step 202
Affiliated grade, packet loss and propagation delay time is taken to shake higher one of both middle grades, because being by packet loss during divided rank
The order that rate and propagation delay time shake gradually reduce, so grade more high packet loss is higher, propagation delay time shake is also bigger, this
When, corresponding transmission performance is poor.
Packet loss and propagation delay time is taken to shake a higher grade ratio counted on upper a cycle of both middle grades
Compared with if grade changes, illustrating that transmission performance changes.For example, when this is detected, if the grade ratio of packet loss
The grade of propagation delay time shake is high, then compares the grade that the grade of packet loss and upper a cycle count on.
, then can optionally one and upper a cycle if it is determined that as grade belonging to the shake of packet loss and propagation delay time
The grade counted on compares；It can also be provided that the grade of the grade of obtained packet loss and upper a cycle is compared.For example,
If it is determined that it is all advanced that packet loss and propagation delay time, which shake affiliated grade, then the grade and upper a cycle system of packet loss are taken
Obtained grade is counted to compare.
Step 204：By the RTCP passages of above-mentioned foundation, to the first equipment dispatch order message, the notification message can be adopted
With RTCP formatted data bags.
Flow shown in above-mentioned Fig. 2 describes by taking packet loss and propagation delay time shake as an example, for other kinds of sound
Video data transmission parameter can also refer to above-mentioned flow and carry out the judgement whether audio, video data transmission performance changes.
, can be according to the transporting carried in the notification message after first equipment receives the notification message that the second equipment is sent
Can parameter coding parameter used in being sent to the audio, video data of the second equipment is adjusted.
In certain embodiments, after the first equipment receives the notification message of the second equipment transmission, the first equipment can be based on
The adjustment judgment condition used judges transmission performance again.So, some unnecessary adjustment can be filtered, ensure audio frequency and video number
According to the stability of transmission.
With reference to Fig. 3, it is described in detail so that the first equipment is adjusted to the coding parameter of audio, video data as an example.
It is the stream that the first equipment is adjusted judgement to the coding parameter of audio, video data in flow shown in Fig. 1 referring to Fig. 3
Journey schematic diagram.The flow comprises the following steps：
Step 301：First equipment listens to RTCP packets.
Step 302：Shaken according to the RTCP data packet analysis packet loss and propagation delay time received.
First equipment can shake according to the packet loss and propagation delay time of the RTCP packets received determines respective grade.
When it is implemented, packet loss and propagation delay time shake can be pre-set 3 etc. according to the threshold value of the first equipment
Level, according to the transmission performance order from low to high of sign, packet loss can be divided into high, medium and low 3 grades, according to sign
The order of transmission performance from low to high, propagation delay time shake can be divided into high, medium and low 3 grades.In step 302, the first equipment
The concrete numerical value and corresponding threshold value that can be shaken according to the packet loss and propagation delay time of the RTCP packets received, it is determined that
Grade belonging to packet loss and propagation delay time shake each.
Step 303：The grade belonging to grade and propagation delay time shake according to belonging to packet loss, judges that audio, video data passes
Whether defeated parameter reaches the trigger condition of transmission performance change, if judging the trigger condition for reaching transmission performance change, performs
Step 304, otherwise it is transferred to step 301.
In the step, the first equipment can respectively obtain the grade and propagation delay time shake belonging to packet loss from step 302
Affiliated grade, packet loss and propagation delay time is taken to shake higher one of both middle grades, because being by packet loss during divided rank
The order that rate and propagation delay time shake gradually reduce, so grade more high packet loss is higher, propagation delay time shake is also bigger, this
When, corresponding transmission performance is poor.
Packet loss and propagation delay time is taken to shake a higher grade ratio counted on upper a cycle of both middle grades
Compared with if grade changes, illustrating that transmission performance changes.For example, when this is detected, if the grade ratio of packet loss
The grade of propagation delay time shake is high, then the grade that the grade of packet loss and upper a cycle count on compares.
, then can optionally one and upper a cycle if it is determined that as grade belonging to the shake of packet loss and propagation delay time
The grade counted on compares；It can also be provided that the grade of the grade of obtained packet loss and upper a cycle is compared.For example,
If it is determined that it is all advanced that packet loss and propagation delay time, which shake affiliated grade, then the grade and upper a cycle system of packet loss are taken
Obtained grade is counted to compare.
Step 304：First equipment dynamic adjusts the code check of video.
After first equipment judges transmission performance again using adjustment judgment condition, code check can be improved or reduced.For example,
If packet loss and the propagation delay time shake judged is larger, show that audio, video data transmission performance is poor, therefore the first equipment can
To reduce to the code check for the audio, video data for being sent to the second equipment, to improve transmission performance；If conversely, judge packet loss and
Propagation delay time shake is smaller, then show the first equipment be sent to the second equipment audio, video data transmission performance it is preferable, therefore the
One equipment can improve the code check of the audio, video data to being sent to the second equipment, so that the second equipment obtains preferable audio frequency and video
Quality.So, it both ensure that reception with regard to obtaining a balance between code check and whole picture or the presentation mode of audio
Data completely save Internet resources again.During above-mentioned adjustment code check, when code check is heightened or turned down, it can be carried out according to setting step-length
Adjustment, untill being adjusted to the upper limit or lower limit.
Flow shown in above-mentioned Fig. 3 describes by taking packet loss and propagation delay time shake as an example, for other kinds of sound
Video data transmission parameter can also refer to above-mentioned flow and carry out the judgement whether audio, video data transmission performance changes.
When above-mentioned audio video transmission performance changes, passed by the RTCP passages above established with RTCP packets
Defeated notification message, foundation is done for the first equipment dynamic adjustment code check.Rtcp protocol is used during transmission, rtcp protocol is used for medium surface
The guarantee of transmission performance and Stateful Inspection, and by transmitting SR (Sender Report, abbreviation Sender Report) or RR
(Receiver Report, abbreviation Receiver Report) is transmitted the control of performance.
SR and RR be used for provide receive transmission performance feedback, in addition to Packet type code, between SR and RR the only difference is that
SR contains a 20 byte sender information sections, and RR does not have.RR can be used to be transmitted the control of performance in the embodiment of the present invention
System.
Referring to Fig. 4, the form schematic diagram for being the RR used in the embodiment of the present invention.As shown in the figure, it can be seen that wrapped in RR
Include：Head (header shown in figure) and one or more report blocks (show 2 report blocks, are respectively in figure
Report block 1 and report block 2), different report blocks corresponds to different audio, video data source devices.
Following information unit can be included in block 1 is reported：
There is provided packets lost number, received packet maximum sequence number, arrival time shake, receive last SR when
Between, the information unit such as the delay that receives last SR.
fraction lost：Packet loss is carried, accounts for a byte, since representing to send from previous RR, has been transmitted from SSRC_1
RTP bags loss ratio, packet loss represents in the form of fractional fixed point, is defined as losing the bag number that bag number/expectation receives.Its
In, SSRC_1 identifies the first equipment.
interarrival jitter：It is carried to and reaches time jitter, account for 4 bytes, represents that arrival time interval stats are inclined
The estimated value of difference, time interval refer to that recipient is with respect to the time interval difference of sender in a pair of bags.
As can be seen that by the way that " fraction lost " judge the packet loss of RTCP bags, if the packet loss of RTCP bags is more than door
Limit value, then transmission performance is poor, and otherwise transmission performance is good；By " when interarrival jitter " judge the transmission of RTCP bags
Prolong shake, if the propagation delay time shake of RTCP bags is more than threshold value, transmission performance is poor, and otherwise transmission performance is good.
Fig. 5 is the signaling process schematic diagram that middle pitch video call both sides of the embodiment of the present invention are called.As can be seen that
In audio, video data transmission control procedures, including calling terminal, Calling Side agent call conversation control entity (Proxy-CSCF,
Abbreviation P-CSCF), media forwarding module MP (Media Proxy, abbreviation Media proxy), service call conversation control entity
(Serving-CSCF, abbreviation S-CSCF), callee side P-CSCF, terminal called.Calling terminal and terminal called, by the beginning of session
Beginning agreement (Session Initiation Protocol, abbreviation SIP) signaling establishes session, by SDP negotiation, increases in sdp
Add RTCP information, RTCP information includes the information such as IP ports.
The flow chart comprises the following steps：
Step 501~504：Calling terminal sends INVITE (calling) message to terminal called, and it is whole that the message carries caller
The SDP information (being expressed as SDP1) at end, and (calling terminal is used to establish the RTP information in the SDP information comprising calling terminal
The IP address and port numbers of RTP passages) calling terminal RTCP information, the message successively by Calling Side P-CSCF, S-CSCF,
Callee side P-CSCF is forwarded to terminal called.Wherein, may include but be not limited in the RTCP information of calling terminal：Calling terminal is used
In establishing the IP address of RTCP passages, the port numbers for establishing RTCP passages.
When being performed in step 501~504, connection notice opens caller between Calling Side P-CSCF and media forwarding module MP
Side forwards port；Connection notice opens network side forwarding port between callee side P-CSCF and media forwarding module MP.
Step 505~508：After terminal called receives INVITE (calling) message, it is (same to reply 200OK to calling terminal
Meaning) message, the message carries the SDP information (being expressed as SDP2) of terminal called, the RTP of terminal called included in the SDP information
The RTCP information of information (terminal called is used to establish the IP address and port numbers of RTP passages) and terminal called, the message according to
Secondary to pass through callee side P-CSCF, S-CSCF, Calling Side P-CSCF is forwarded to calling terminal.Wherein, the RTCP information of terminal called
In may include but be not limited to：Terminal called is used to establish the IP address of RTCP passages, the port numbers for establishing RTCP passages.
When being performed in step 505~508, connection notice is opened called between callee side P-CSCF and media forwarding module MP
Side forwards port；Connection notice opens forwarded port between Calling Side P-CSCF and media forwarding module MP.
Step 509~512：After calling terminal receives the return information of terminal called, calling terminal returns to called terminal side
Multiple ACK (confirmation) message, the message are forwarded to terminal called by Calling Side P-CSCF, S-CSCF, callee side P-CSCF successively.
By above-mentioned flow, RTP passages are established between calling terminal and terminal called and are used to carry out audio, video data biography
It is defeated, and RTCP passages are established to carry out the transmission of notification message.
In the signaling diagram of the audio, video data transmission control procedures, the media forwarding module MP of calling terminal and Calling Side
Between have the forwarding of media bag, there is media bags to turn between the media forwarding module MP and callee side media forwarding module MP of Calling Side
Hair, have between the media forwarding module MP and terminal called of callee side media bag forwarding, media bag forward for each interface it
Between code check parameter it is corresponding.
Based on identical technical concept, the embodiments of the invention provide a kind of audio, video data transmission equipment.
Referring to Fig. 6, for the constructional device schematic diagram of audio, video data transmission equipment provided in an embodiment of the present invention, the sound regards
As the first equipment application, in the process that audio, video data is sent to the second equipment, it is real that the present invention can be achieved in frequency data transmission set
Apply the process of the audio, video data transmission of example description.
As shown in fig. 6, first equipment includes：Receiving module 601, adjusting module 602, wherein：
Receiving module 601, the notification message of the audio, video data transmission performance change sent for receiving the second equipment；Its
In, the notification message is that the second equipment detects that the audio, video data transmission performance that the first equipment is sent is sent when changing
's；
Adjusting module 602, for being sent to the coding of the audio, video data of the second equipment according to the notification message, adjustment
Parameter.
Alternatively, the reception in the notification message comprising the second equipment according to the audio, video data sent to the first equipment
Situation counts obtained audio, video data configured transmission；
Alternatively, the adjusting module is specifically used for：If according to adjustment judgment condition, judge to include in the notification message
Audio, video data configured transmission meet the adjustment judgment condition, then adjustment be sent to the second equipment audio, video data volume
Code parameter.
Alternatively, the audio, video data configured transmission includes packet loss and/or propagation delay time is shaken.
Alternatively, the coding parameter of the data includes the code check of audio, video data.
Referring to Fig. 7, the constructional device schematic diagram of the audio, video data transmission equipment provided for further embodiment of the present invention.
The process for the audio, video data that the audio, video data transmission equipment is sent as the second equipment application in the first equipment of reception, can be real
The process of the audio, video data transmission of existing description of the embodiment of the present invention.
As shown in fig. 7, the second equipment includes：Detection module 701, sending module 702, wherein：
Detection module 701, the audio, video data transmission performance sent for detecting the first equipment；
Sending module 702, for when detect the first equipment send audio, video data transmission performance change when, to
First equipment sends the notification message of audio, video data transmission performance change, and the notification message is used to indicate the first equipment adjustment hair
Give the coding parameter of the audio, video data of the second equipment.
Alternatively, the detection module is specifically used for：According to the reception condition of the audio, video data sent to the first equipment,
Statistics obtains audio, video data configured transmission；
Alternatively, the sending module is specifically used for：The audio frequency and video number that the first equipment is sent is detected in a case where
Changed according to transmission performance：Second equipment changes judgment condition, the audio, video data that decision statistic obtains according to transmission performance
Configured transmission meets the transmission performance change judgment condition.
Alternatively, the reception in the notification message comprising the second equipment according to the audio, video data sent to the first equipment
Situation counts obtained audio, video data configured transmission, and the audio, video data configured transmission includes packet loss and/or transmission
Delay variation.
Alternatively, the coding parameter of the data includes the code check of audio, video data.
The present invention is the flow with reference to method according to embodiments of the present invention, equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram
Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided
The processors of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real
The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in individual square frame or multiple square frames.
Although preferred embodiments of the present invention have been described, but those skilled in the art once know basic creation
Property concept, then can make other change and modification to these embodiments.So appended claims be intended to be construed to include it is excellent
Select embodiment and fall into having altered and changing for the scope of the invention.
Obviously, those skilled in the art can carry out the essence of various changes and modification without departing from the present invention to the present invention
God and scope.So, if these modifications and variations of the present invention belong to the scope of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to comprising including these changes and modification.
Claims (19)
1. a kind of audio, video data transfer control method, the mistake of audio, video data is sent to the second equipment applied to the first equipment
Journey, it is characterised in that including：
First equipment receives the notification message for the audio, video data transmission performance change that the second equipment is sent；Wherein, the notice
Message is that the second equipment detects that the audio, video data transmission performance that the first equipment is sent is sent when changing；
First equipment is carried out according to the notification message to being sent to coding parameter used in the audio, video data of the second equipment
Adjustment.
2. the method as described in claim 1, it is characterised in that set in the notification message comprising the second equipment according to first
The reception condition for the audio, video data that preparation is sent counts obtained audio, video data configured transmission；
First equipment is carried out according to the notification message to being sent to coding parameter used in the audio, video data of the second equipment
Adjustment, including：
First equipment is according to adjustment judgment condition, if it is determined that the audio, video data configured transmission included in the notification message meets
The adjustment judgment condition, then coding parameter used in being sent to the audio, video data of the second equipment is adjusted.
3. method as claimed in claim 2, it is characterised in that the audio, video data configured transmission include packet loss and/or
Propagation delay time is shaken.
4. method as claimed in claim 2 or claim 3, it is characterised in that first equipment judges to count using following steps
To audio, video data configured transmission whether meet the judgment condition of transmission performance change：
The grade belonging to each audio, video data configured transmission is determined respectively；
According to the grade belonging to each audio, video data configured transmission, the high audio, video data configured transmission of its middle grade is chosen；
By belonging to the grade belonging to the audio, video data configured transmission of selection and the upper cycle audio, video data configured transmission
Grade is compared, if inconsistent, meets the judgment condition of the transmission performance change.
5. the method as described in claim 1, it is characterised in that the coding parameter of the data includes the code of audio, video data
Rate.
6. the method as any one of Claims 1-4, it is characterised in that the first equipment sends sound to the second equipment and regarded
Before frequency evidence, in addition to：
First equipment and the second equipment establish RTCP Real-time Transport Control Protocol RTCP passages by media negotiation；
First equipment receives the notification message for the audio, video data transmission performance change that the second equipment is sent, including：
The notification message that first equipment is sent from the equipment of RTCP channel receptions second.
7. a kind of audio, video data transfer control method, the mistake of audio, video data is sent to the second equipment applied to the first equipment
Journey, it is characterised in that including：
Second equipment detects the audio, video data transmission performance that the first equipment is sent；
If the second equipment detects that the audio, video data transmission performance that the first equipment is sent changes, sent to the first equipment
The notification message of audio, video data transmission performance change, the notification message are used to indicate that the adjustment of the first equipment is sent to second and set
The coding parameter of standby audio, video data.
8. method as claimed in claim 7, it is characterised in that the second equipment detects the audio, video data that the first equipment is sent and passed
Defeated performance, including：
Second equipment counts according to the reception condition of the audio, video data sent to the first equipment and obtains audio, video data transmission ginseng
Number；
Second equipment detects that the audio, video data transmission performance that the first equipment is sent changes in a case where：Second sets
Standby to change judgment condition according to transmission performance, the audio, video data configured transmission that decision statistic obtains meets that the transmission performance becomes
Change judgment condition.
9. method as claimed in claim 8, it is characterised in that set in the notification message comprising the second equipment according to first
The reception condition for the audio, video data that preparation is sent counts obtained audio, video data configured transmission, the audio, video data transmission
Parameter includes packet loss and/or propagation delay time is shaken.
10. the method as any one of claim 7 to 9, it is characterised in that second equipment is sentenced using following steps
The disconnected judgment condition for counting obtained audio, video data configured transmission and whether meeting the transmission performance change：
The grade belonging to each audio, video data configured transmission is determined respectively；
According to the grade belonging to each audio, video data configured transmission, the high audio, video data configured transmission of its middle grade is chosen；
By belonging to the grade belonging to the audio, video data configured transmission of selection and the upper cycle audio, video data configured transmission
Grade is compared, if inconsistent, meets the judgment condition of the transmission performance change.
11. method as claimed in claim 7, it is characterised in that the coding parameter of the data includes the code of audio, video data
Rate.
12. the method as any one of claim 7 to 10, it is characterised in that the first equipment sends sound to the second equipment
Before video data, in addition to：
Second equipment and the first equipment establish RTCP Real-time Transport Control Protocol RTCP passages by media negotiation；
The notification message of audio, video data transmission performance change is sent to the first equipment, including：
Described notification message is sent to the first equipment by the RTCP passages.
A kind of 13. audio, video data transmission control equipment, applied to the process that audio, video data is sent to the second equipment, its feature
It is, including：
Receiving module, the notification message of the audio, video data transmission performance change sent for receiving the second equipment；Wherein, it is described
Notification message is that the second equipment detects that the audio, video data transmission performance that the first equipment is sent is sent when changing；
Adjusting module, for being sent to the coding parameter of the audio, video data of the second equipment according to the notification message, adjustment.
14. equipment as claimed in claim 13, it is characterised in that comprising the second equipment according to first in the notification message
The reception condition for the audio, video data that equipment is sent counts obtained audio, video data configured transmission；
The adjusting module is specifically used for：If according to adjustment judgment condition, the audio frequency and video number included in the notification message is judged
Meet the adjustment judgment condition according to configured transmission, then adjustment is sent to the coding parameter of the audio, video data of the second equipment.
15. equipment as claimed in claim 13, it is characterised in that the coding parameter of the data includes the code of audio, video data
Rate.
16. a kind of audio, video data transmission control equipment, the process of the audio, video data sent applied to the first equipment of reception, its
It is characterised by, including：
Detection module, the audio, video data transmission performance sent for detecting the first equipment；
Sending module, for when the audio, video data transmission performance for detecting that the first equipment is sent changes, being set to first
Preparation send the notification message that audio, video data transmission performance changes, and the notification message is used to indicate that the adjustment of the first equipment is sent to
The coding parameter of the audio, video data of second equipment.
17. equipment as claimed in claim 16, it is characterised in that the detection module is specifically used for：According to the first equipment
The reception condition of the audio, video data of transmission, statistics obtain audio, video data configured transmission；
The sending module is specifically used for：The audio, video data transmission performance hair that the first equipment is sent is detected in a case where
Changing：Second equipment changes judgment condition according to transmission performance, and the audio, video data configured transmission that decision statistic obtains meets
The transmission performance changes judgment condition.
18. equipment as claimed in claim 17, it is characterised in that comprising the second equipment according to first in the notification message
The reception condition for the audio, video data that equipment is sent counts obtained audio, video data configured transmission, and the audio, video data passes
Defeated parameter includes packet loss and/or propagation delay time is shaken.
19. equipment as claimed in claim 16, it is characterised in that the coding parameter of the data includes the code of audio, video data
Rate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610676612.1A CN107770473B (en) | 2016-08-16 | 2016-08-16 | Audio and video data transmission control method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610676612.1A CN107770473B (en) | 2016-08-16 | 2016-08-16 | Audio and video data transmission control method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107770473A true CN107770473A (en) | 2018-03-06 |
| CN107770473B CN107770473B (en) | 2020-05-26 |
Family
ID=61261047
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610676612.1A Active CN107770473B (en) | 2016-08-16 | 2016-08-16 | Audio and video data transmission control method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107770473B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111416999A (en) * | 2020-03-09 | 2020-07-14 | 西安万像电子科技有限公司 | Data transmission method, terminal and system |
| CN111934823A (en) * | 2020-08-12 | 2020-11-13 | 中国联合网络通信集团有限公司 | Data transmission method, radio access network equipment and user plane functional entity |
| CN112511782A (en) * | 2019-09-16 | 2021-03-16 | 中兴通讯股份有限公司 | Video conference method, first terminal, MCU, system and storage medium |
| CN114915655A (en) * | 2022-05-06 | 2022-08-16 | 广州市保伦电子有限公司 | Information pushing method for filtering frequent operation and background server |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101909060A (en) * | 2010-08-05 | 2010-12-08 | 浙江工业大学 | Qos control method suitable for real-time streaming media transmission of mobile videos |
| CN103686227A (en) * | 2012-09-17 | 2014-03-26 | 南京中兴力维软件有限公司 | Method, device and system for capturing and coding audio/video of mobile terminal |
| CN103888846A (en) * | 2014-03-04 | 2014-06-25 | 浙江大学 | Wireless video streaming service self-adaption rate control method based on QoE |
| CN104009819A (en) * | 2013-02-22 | 2014-08-27 | 中兴通讯股份有限公司 | Anti-packet-loss real-time communication method and system based on layered coding, and related devices |
| CN105100675A (en) * | 2015-09-11 | 2015-11-25 | Tcl集团股份有限公司 | Terminal video communication quality adjusting method and system |
-
2016
- 2016-08-16 CN CN201610676612.1A patent/CN107770473B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101909060A (en) * | 2010-08-05 | 2010-12-08 | 浙江工业大学 | Qos control method suitable for real-time streaming media transmission of mobile videos |
| CN103686227A (en) * | 2012-09-17 | 2014-03-26 | 南京中兴力维软件有限公司 | Method, device and system for capturing and coding audio/video of mobile terminal |
| CN104009819A (en) * | 2013-02-22 | 2014-08-27 | 中兴通讯股份有限公司 | Anti-packet-loss real-time communication method and system based on layered coding, and related devices |
| CN103888846A (en) * | 2014-03-04 | 2014-06-25 | 浙江大学 | Wireless video streaming service self-adaption rate control method based on QoE |
| CN105100675A (en) * | 2015-09-11 | 2015-11-25 | Tcl集团股份有限公司 | Terminal video communication quality adjusting method and system |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112511782A (en) * | 2019-09-16 | 2021-03-16 | 中兴通讯股份有限公司 | Video conference method, first terminal, MCU, system and storage medium |
| CN111416999A (en) * | 2020-03-09 | 2020-07-14 | 西安万像电子科技有限公司 | Data transmission method, terminal and system |
| CN111934823A (en) * | 2020-08-12 | 2020-11-13 | 中国联合网络通信集团有限公司 | Data transmission method, radio access network equipment and user plane functional entity |
| CN111934823B (en) * | 2020-08-12 | 2022-08-02 | 中国联合网络通信集团有限公司 | Data transmission method, radio access network equipment and user plane functional entity |
| CN114915655A (en) * | 2022-05-06 | 2022-08-16 | 广州市保伦电子有限公司 | Information pushing method for filtering frequent operation and background server |
| CN114915655B (en) * | 2022-05-06 | 2024-02-09 | 广东保伦电子股份有限公司 | Information pushing method for filtering frequent operation and background server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107770473B (en) | 2020-05-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7310334B1 (en) | Method and apparatus for media stream monitoring | |
| US7944880B2 (en) | Method and arrangement for establishing a communication session for multimedia | |
| US11252201B2 (en) | Communications methods, apparatus and systems to provide optimal media routing | |
| US8730942B2 (en) | Method and arrangement for enabling a multimedia communication session | |
| CN100431311C (en) | Communication quality control using real-time bag to transmit condition and transmit path blocked condition | |
| CN100525504C (en) | Multimedia session service quality management method under multiple radio network integrated environment | |
| CN103118238B (en) | The control method of video conference and video conferencing system | |
| CN106301679B (en) | Method and device for adjusting service rate | |
| US9282133B2 (en) | Communicating control information within a real-time stream | |
| US7983244B2 (en) | Interworking between domains of a communication network operated based on different switching principles | |
| CN107770473A (en) | A kind of audio, video data transfer control method and device | |
| WO2007128217A1 (en) | Method of internet protocol(ip) message transmission, negotiated bandwidth saving capability and saving network bandwidth | |
| CN101909208A (en) | Video wireless transmission control method suitable for CDMA2000 | |
| US9674737B2 (en) | Selective rate-adaptation in video telephony | |
| CN107333091A (en) | Audio-video conversion method and device | |
| WO2010037293A1 (en) | Method and system for improving quality of multimedia calls, media controlling equipment and media processing equipment | |
| US7978604B2 (en) | Optimising resource usage in a packet switched network | |
| CN107277420A (en) | A kind of video calling implementation method and terminal | |
| US20090259460A1 (en) | Silence-based adaptive real-time voice and video transmission methods and system | |
| US7756108B2 (en) | Transmission of voice over a network | |
| US20060062251A1 (en) | Session data and setting method thereof in a sychronous wireless communication system | |
| US8391284B2 (en) | Usage of feedback information for multimedia sessions | |
| EP2264959B1 (en) | Media gateway, media gateway controller, method and system for communication of multimedia phones | |
| WO2007091207A1 (en) | Providing and handling information on a state of a media stream | |
| CN101552771A (en) | Media gateway, media gateway controller, multimedia telephone intercommunication method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |