CN107295395A - Code check adaptive regulation method, device and electronic equipment - Google Patents
Code check adaptive regulation method, device and electronic equipment Download PDFInfo
- Publication number
- CN107295395A CN107295395A CN201710500737.3A CN201710500737A CN107295395A CN 107295395 A CN107295395 A CN 107295395A CN 201710500737 A CN201710500737 A CN 201710500737A CN 107295395 A CN107295395 A CN 107295395A
- Authority
- CN
- China
- Prior art keywords
- code check
- rate
- encoded
- frame losing
- lowest bit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000003044 adaptive effect Effects 0.000 title claims abstract description 26
- 230000005540 biological transmission Effects 0.000 claims abstract description 55
- 238000004891 communication Methods 0.000 claims abstract description 7
- 230000001105 regulatory effect Effects 0.000 claims description 22
- 230000006870 function Effects 0.000 claims description 11
- 238000001514 detection method Methods 0.000 claims description 10
- 230000015654 memory Effects 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 7
- 238000011017 operating method Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 13
- 230000008569 process Effects 0.000 description 4
- 230000009467 reduction Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440236—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44227—Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention provides a kind of code check adaptive regulation method, device and electronic equipment, and applied to the user terminal being connected with server communication, methods described includes：According to current system network state setting maximal rate and lowest bit rate, and the first code check is obtained, the Media Stream of transmission is encoded with the first code check；If occurring frame losing in preset duration, reduce the first code check and obtain third yard rate, Media Stream is encoded with third yard rate；If not occurring frame losing, increase the first code check and obtain the second code check, whether frame losing occur when being encoded with the second code check to Media Stream, and judging to be encoded with the second code check, the second code check is reduced if there is frame losing and obtains third yard rate.The code check automatic adjusument scheme increases or reduced code check by detecting data frame loss condition, correspondingly, and Media Stream is encoded using amended code check.By the adjustment of above-mentioned frame losing and code check adaptively, efficiently solve because occurring watching end video cardton phenomenon caused by frame losing.
Description
Technical field
The present invention relates to network communication technology field, in particular to a kind of code check adaptive regulation method, device and
Electronic equipment.
Background technology
How much time delay is to weigh the good and bad important indicator of direct broadcast service, when delay than it is larger when, be used as spectators
The picture in main broadcaster side can just be seen after the long time.If being related to the interaction of main broadcaster and spectators, then both sides
Interactive information delay will be very big, strong influence Consumer's Experience.Causing for live delay is many, wherein,
A kind of main delay results from live source and produces end, that is, the live delay that main broadcaster end is produced, and main broadcaster is typically straight using some
It is live to carry out to broadcast software, and the information such as the video at main broadcaster end, sound by coding, are then passed through related network by live software
Host-host protocol, sends to Internet Service Provider, so the live delay that main broadcaster end is produced is exactly mainly to be caused by live software
, and the delay that live software is caused is mainly caused by the upload network of main broadcaster is inadequate.
The existing method for solving delay is frame losing, and by abandoning, related frame of video or audio frame, live to reduce
Coding queue caching in software, to realize reduction delay.Although this method reduces live delay to a certain extent,
It is the live information for having abandoned correlation, spectators can be made to produce interim card when watching video, the Experience Degree of user still can be influenceed.Cause
How this, realize during frame losing, it is to avoid the problem of watching the video cardton phenomenon at end is particularly significant.
The content of the invention
In view of this, it is an object of the invention to provide a kind of code check adaptive regulation method, device and electronic equipment, with
Improve above mentioned problem.
The embodiment of the present invention provides a kind of code check adaptive regulation method, applied to the user being connected with server communication
Live audio frequency and video are carried out code check automatic adjusument by end, and methods described includes：
According to current system network state setting maximal rate and lowest bit rate, according to the maximal rate and described minimum
Code check is calculated and obtains the first code check, and the Media Stream of transmission is encoded with first code check；
Judge whether frame losing occur in preset duration, if there is frame losing, reduce by first code check and obtain third yard rate,
The Media Stream of transmission is encoded with the third yard rate；
If not occurring frame losing, increase first code check and obtain the second code check, with matchmaker of second code check to transmission
Body stream is encoded；
Judge whether frame losing occur when being encoded with second code check, if there is frame losing, reduce the second code
Rate obtains third yard rate, and the Media Stream of transmission is encoded with the third yard rate.
Further, it is described that the step of obtaining the first code check, bag are calculated according to the maximal rate and the lowest bit rate
Include：
The maximal rate and the lowest bit rate are pressed into the first calculating formula：B1=(B (max)+B (min))/2 is calculated
To the first code check, wherein, B1 is the first code check, and B (max) is the maximal rate of setting, and B (min) is the lowest bit rate of setting.
Further, the step of increase first code check obtains the second code check, including：
System lowest bit rate is reset to first code check for calculating and obtaining；
Lowest bit rate after replacement and the maximal rate of setting are pressed into the second calculating formula：B2=(B (max)+B '
(min))/2 calculate and obtain second code rate, wherein, B2 is the second code check, and B (max) is the maximal rate of setting, and B ' (min) attaches most importance to
The lowest bit rate postponed.
Further, the third yard rate is obtained by following steps：
System maximal rate is reset to and calculates obtained first code check and system lowest bit rate is set to setting
The lowest bit rate, or system maximal rate is reset into second code check and system lowest bit rate is set to after replacement
Lowest bit rate；
Lowest bit rate by the maximal rate after replacement and after resetting is by the 3rd calculating formula：B3=(B ' (max)+B "
(min))/2 calculate and obtain third yard rate, wherein, B3 is third yard rate, and B ' (max) attaches most importance to the maximal rate postponed, B " (min)
Attach most importance to newly-installed lowest bit rate.
Further, methods described also includes：
Whether detection current system there is packet loss, if there is packet loss, triggering code rate adjustment request；
It is described to obtain the code check tune according to the step of current system network state setting maximal rate and lowest bit rate
Trigger and perform after section request.
Further, the Media Stream include video flowing and audio stream, detection current system whether occur packet loss by with
Lower step is performed：
In network transmission thread, detect whether video streaming data packet or audio stream packet in queue to be sent accumulate
Predetermined threshold value is reached, if reaching the predetermined threshold value, judges that packet loss occurs in current system, and trigger packet loss logic.
Further, the video streaming data packet and the audio stream packet are obtained by following steps：
In Video coding thread, the live video of acquisition is encoded, the video streaming data packet that will be generated after coding
It is delivered to the network transmission thread；
In audio coding thread, the live sound of acquisition is encoded, the audio stream packet generated after coding is thrown
It is handed to the network transmission thread.
Another embodiment of the present invention also provides a kind of code check self-adaptive regulating, applied to what is be connected with server communication
Live audio frequency and video are carried out code check automatic adjusument by user terminal, and the code check self-adaptive regulating includes：
Setting module, for according to current system network state setting maximal rate and lowest bit rate, according to the maximum
Code check and the lowest bit rate, which are calculated, obtains the first code check, and the Media Stream of transmission is encoded with first code check；
Judge module, for judging whether frame losing occur in preset duration；
First modified module, obtains third yard rate, with the described 3rd for when there is frame losing, reducing by first code check
Code check is encoded to the Media Stream of transmission；
Second modified module, for when not occurring frame losing, increases first code check and obtains the second code check, with described the
Two code checks are encoded to the Media Stream of transmission；
Whether the second judge module, there is frame losing during for judging and encoded with second code check；
3rd modified module, obtains third yard rate, with the described 3rd for when there is frame losing, reducing by second code check
Code check is encoded to the Media Stream of transmission.
Another embodiment of the present invention also provides a kind of electronic equipment, including：
Memory；
Processor；And
Code check self-adaptive regulating, the code check self-adaptive regulating is installed in the memory and including one
Or multiple software function modules by the computing device.
Another embodiment of the present invention also provides a kind of storage medium, is stored thereon with computer program, the computer journey
The step of above-mentioned code check adaptive regulation method is realized when sequence is executed by processor.
Code check adaptive regulation method provided in an embodiment of the present invention, device and electronic equipment, according to grid state
Corresponding code check is obtained, and the Media Stream of transmission is encoded using obtained code check.By detecting data frame loss condition, root
Correspondingly increase according to data frame loss condition or reduce code check, Media Stream is encoded using amended code check.By above-mentioned
The adaptive adjustment of frame losing and code check, efficiently solve and use because of live delay after frame losing, the sight because of caused by frame losing
The problem of seeing end interim card.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be attached to what is used required in embodiment
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, therefore is not construed as pair
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to this
A little accompanying drawings obtain other related accompanying drawings.
A kind of application scenarios schematic diagram for code check adaptive regulation method that Fig. 1 provides for present pre-ferred embodiments.
Fig. 2 is the schematic block diagram of user terminal provided in an embodiment of the present invention.
Fig. 3 is the flow chart of code check adaptive regulation method provided in an embodiment of the present invention.
Fig. 4 is another flow chart of code check adaptive regulation method provided in an embodiment of the present invention.
Fig. 5 is another flow chart of code check adaptive regulation method provided in an embodiment of the present invention.
The flow chart for the sub-step that Fig. 6 is step S104 in Fig. 3.
Fig. 7 is another flow chart of code check adaptive regulation method provided in an embodiment of the present invention.
Fig. 8 is the functional block diagram of code check self-adaptive regulating provided in an embodiment of the present invention.
Fig. 9 is another functional block diagram of code check self-adaptive regulating provided in an embodiment of the present invention.
Figure 10 is another functional block diagram of code check self-adaptive regulating provided in an embodiment of the present invention.
Figure 11 is the functional block diagram of the second modified module provided in an embodiment of the present invention.
Figure 12 is another functional block diagram of code check self-adaptive regulating provided in an embodiment of the present invention.
Icon：100- user terminals；110- code check self-adaptive regulatings；111- setting modules；The judge modules of 112- first；
The modified modules of 113- first；The modified modules of 114- second；1141- reset cells；1142- computing units；115- second judges mould
Block；The modified modules of 116- the 3rd；117- exits judge module；118- video encoding modules；119- audio coding modules；1110-
Detection module；1111- determination modules；1112- resets module；1113- computing modules；120- processors；130- memories；200-
Server.
Embodiment
Below in conjunction with accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Ground is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Generally exist
The component of the embodiment of the present invention described and illustrated in accompanying drawing can be arranged and designed with a variety of configurations herein.Cause
This, the detailed description of the embodiments of the invention to providing in the accompanying drawings is not intended to limit claimed invention below
Scope, but it is merely representative of the selected embodiment of the present invention.Based on embodiments of the invention, those skilled in the art are not doing
The every other embodiment obtained on the premise of going out creative work, belongs to the scope of protection of the invention.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined in individual accompanying drawing, then it further need not be defined and explained in subsequent accompanying drawing.Meanwhile, the present invention's
In description, unless otherwise clearly defined and limited, term " installation ", " setting ", " connection " should be interpreted broadly, for example, can
To be to be fixedly connected or be detachably connected, or it is integrally connected；Can be mechanical connection or electrical connection；Can
It to be to be joined directly together, can also be indirectly connected to by intermediary, can be the connection of two element internals.For this area
For those of ordinary skill, the concrete meaning of above-mentioned term in the present invention can be understood with concrete condition.
Code check is a very important parameter during audio/video coding, and it has directly influenced the clear of Voice ＆ Video
Clear degree, code check is bigger, and the definition of audio frequency and video is bigger, and code check is smaller, and the definition of audio frequency and video is smaller.But code check is bigger, lead to
When crossing network transmission, the amount of bytes transmitted is more, and the network bandwidth consumed is bigger, so being accomplished by bigger network
Uploading speed.And the delay that live software is caused is mainly caused by the upload network of main broadcaster is inadequate.Generally solve delay
Method be frame losing, related frame of video or audio frame by abandoning, to reduce the caching of the coding queue in live software, come
Realize reduction delay.Although this method reduces live delay to a certain extent, the live information of correlation has been abandoned,
Spectators can be made to produce interim card when watching video, still can cause the Experience Degree of user.Therefore, the present invention proposes one kind in frame losing
Cheng Zhong, the scheme of code check automatic adjusument is carried out by network state, so that live delay can be reduced, interim card will not be produced again
The problem of.
Referring to Fig. 1, being a kind of application scenarios schematic diagram of code check adaptive regulation method provided in an embodiment of the present invention.
The scene includes user terminal 100 and server 200.The user terminal 100 is communicated to connect by network with the server 200,
To enter row data communication or interaction.In the present embodiment, the user terminal 100 can include multiple (one is only shown in figure),
Multiple user terminals 100 are communicated to connect with the server 200.In the present embodiment, described user terminal 100 mainly for
User terminal 100 used in main broadcaster end.
Wherein, the user terminal 100 can be but not limited to PC, tablet personal computer, smart mobile phone, mobile Internet access and set
It is standby etc..Net cast application software is installed on the user terminal 100, so that user carries out net cast.The server 200
For the background server corresponding to the net cast application software installed on the user terminal 100.The server 200 can be
The webserver, database server, can be that single server can also be server cluster etc..
Referring to Fig. 2, being the schematic block diagram of a kind of electronic equipment provided in an embodiment of the present invention.In the present embodiment
In, the electronic equipment can be above-mentioned user terminal 100, the user terminal 100 include code check self-adaptive regulating 110,
Processor 120 and memory 130.Wherein, it is direct or indirect between the memory 130 and the processor 120 electrically to connect
Connect, to realize the transmission or interaction of data.The code check self-adaptive regulating 110 can be with software or firmware including at least one
Form be stored in the memory 130 or be solidificated in software function module in the operating system of the user terminal 100.Institute
Stating processor 120 is used to perform the executable module stored in the memory 130, such as described code check self-adaptive regulating
110 software function modules or computer program included.
Referring to Fig. 3, being a kind of code check automatic adjusument applied to above-mentioned user terminal 100 provided in an embodiment of the present invention
The flow chart of method.It should be noted that, the method that the present invention is provided is not using Fig. 3 and particular order as described below as limitation.
Each step shown in Fig. 3 will be described in detail below.
Step S101, according to current system network state setting maximal rate and lowest bit rate, according to the maximal rate
Calculated with the lowest bit rate and obtain the first code check, the Media Stream of transmission is encoded with first code check.
The Media Stream that the user terminal 100 at main broadcaster end is issued is completed by live software, and live software is to media
Stream is carried out after respective handling, is pushed by RTMP (Real Time Messaging Protocol, real-time messages host-host protocol)
To server 200.Three different threads are had in systems to be respectively completed corresponding function, including Video coding thread,
Audio coding thread and network transmission thread.
Wherein, network transmission thread main function is that media stream data bag is transmitted, wherein media stream data bag
Include video streaming data packet and audio stream packet.Referring to Fig. 4, video streaming data packet and audio fluxion in network transmission thread
It is main through the following steps that obtaining according to bag：
Step S201, in Video coding thread, is encoded, the video that will be generated after coding to the live video of acquisition
Stream packets are delivered to the network transmission thread.
Step S203, in audio coding thread, is encoded, the audio that will be generated after coding to the live sound of acquisition
Stream packets are delivered to the network transmission thread.
Encoder refers to carry out coding compression to original data using related algorithm, so that beneficial to the storage of initial data
With transmission, encoder can be software form or example, in hardware.In MultiMedia Field, conventional encoder master
To be video encoder and audio coder, video encoder mainly uses H264 encoders, audio in live software
Encoder mainly uses AAC encoders.Data after the compression produced after coding, commonly referred to as corresponding bag.
Alternatively, in Video coding thread, according to the frame per second pre-set, H264 Video codings are utilized to live video
Device is encoded to image.In audio coding thread, AAC audio coders pair mainly are utilized to the system sounds collected
Sound is encoded.
In network transmission thread, the packet generated after Video coding thread and audio coding thread coding is utilized
RTMP protocol propellings are to server 200, and live delay is exactly to produce in this process.Therefore, in the present embodiment, institute
State code check adaptive regulation method further comprising the steps of：Whether detection current system there is packet loss, if there is packet loss, triggers
Code rate adjustment is asked.In the present embodiment, step according to current system network state setting maximal rate and lowest bit rate be
Obtain triggering after the code rate adjustment is asked and perform.Referring to Fig. 5, and for how to detect whether current system is lost
Bag can then be obtained according to following steps：
Step S301, in network transmission thread, detects the video streaming data packet or audio stream data in queue to be sent
Whether bag, which is accumulated, reaches predetermined threshold value, if reaching predetermined threshold value, performs following steps S203.
Step S303, judges that packet loss occurs in current system, and trigger packet loss logic.
Due to be in network transmission thread by the packet in video line of codes journey and audio coding thread according to
Time sequencing, is sequentially stored in transmit queue, and then another one ground is sent to RTMP servers.If a upper data
Bag is not sent completely, then next packet can only just wait a packet to be sent after being sent completely.This
If sample, if network uploading speed is inadequate, then will will be accumulated very with the increase of live time in transmit queue
Many video streaming data packets and audio stream packet.This is also the basic reason for postponing to occur at main broadcaster end.
In order to solve because live delay caused by uploading speed is inadequate, can optimize live prolong by the way of frame losing
Late.When the packet accumulation in the queue to be sent in network transmission thread reaches predetermined threshold value, then packet loss logic can be triggered,
When packet loss occurs in the system of detecting, then code rate adjustment request can be triggered.
Alternatively, the media stream data that network transmission thread is transmitted includes video streaming data packet and audio stream data
Bag.The frame losing priority of video flowing and audio stream can be examined in logic in the frame losing Processing Algorithm to media stream data bag
Consider.It should be appreciated that for a video, sense organ above all sound, if sound is not smooth, the experience of beholder will
Can be very poor, and if video has somewhat not smooth, it is still able to what is received.Also, in the cost of network transmission, depending on
The expense of frequency can be bigger than audio.Because much bigger than audio of volume size shared by video, lead in frame losing strategy
Chang Youxian abandons video streaming data packet.
But be not that any one frame of video can all be abandoned during video is abandoned, if so,
It is possible to cause the player picture for watching end to occur the phenomenon of flower screen.When abandoning frame of video, it is necessary first to judge that this is regarded
Whether frequency stream packets are key frame, if not key frame, then the video streaming data packet can not be abandoned.If key frame,
Then the video streaming data packet will be dropped, and all non-key frames after the frame will be all dropped.Team after frame losing
Remaining packet is reached after predetermined threshold value in row, then can stop frame losing, could be very until key frame of video but need
Normal incidence stops frame losing.It is to be abandoned since key frame when abandoning frame of video, and just terminates untill being discarded into key frame always.
Alternatively, when packet loss occurs in the system of detecting, then code rate adjustment request can be triggered.Please triggering code rate adjustment
After asking, system responds regulation request, and according to the current maximal rate of network state setting one and a lowest bit rate, example
Such as, maximal rate is set as B (max), lowest bit rate is set as B (min).According to the maximal rate and lowest bit rate of setting
The first code check is calculated, and the video flowing and audio stream of transmission are encoded with the first code check calculated.
Alternatively, obtain the first code check according to maximal rate and lowest bit rate calculating and can perform in the following manner：
The maximal rate and the lowest bit rate are pressed into the first calculating formula：B1=(B (max)+B (min))/2 is calculated
To the first code check, wherein, B1 is the first code check, and B (max) is the maximal rate of setting, and B (min) is the lowest bit rate of setting.
Step S102, judges whether frame losing occur in preset duration, if there is frame losing, performs following steps S103, if
Do not occur frame losing, then perform following steps S104.
Step S103, is reduced by first code check and obtains third yard rate, the media of transmission are flowed into the third yard rate
Row coding.
Step S104, is increased first code check and obtains the second code check, the media of transmission are flowed into second code check
Row coding.
Step S105, judges whether frame losing occur when being encoded with second code check, if there is frame losing, perform with
Lower step S106.
Step S106, is reduced by second code check and obtains third yard rate, the media of transmission are flowed into the third yard rate
Row coding.
Step S107, judges whether to meet exit criteria according to the obtained third yard rate, if meeting exit criteria,
Terminate code check automatic adjusument, if being unsatisfactory for exit criteria, whether frame losing occur in detection preset duration.
Alternatively, during video flowing and audio stream are encoded and transmitted, system can real-time detector data bag
Whether frame losing phenomenon is occurred.If not occurring frame losing in preset duration, show currently employed code check can adapt in work as
Preceding network uploading speed, therefore code check value can be increased on the basis of current code check.Now, can be on the basis of the first code check
Code check increase is carried out, the second code check is obtained, is encoded with the second obtained code check.
Alternatively, referring to Fig. 6, in the present embodiment, the first code check of increase, which obtains the second code check, to be entered in the following manner
OK：
Step S1041, system lowest bit rate is reset to first code check for calculating and obtaining.
Step S1043, the second calculating formula is pressed by the lowest bit rate after replacement and the maximal rate of setting：B2=(B
(max)+B ' (min))/2 calculate obtain second code rate, wherein, B2 be the second code check, B (max) for setting maximal rate, B '
(min) attach most importance to the lowest bit rate postponed.
Alternatively, the mode of the first code check of increase can be that the lowest bit rate of current system is reset to set maximum
Code check B (max) and lowest bit rate B (min) average value, that is, calculate the first obtained code check B1.Then by B2=(B (max)+
B ' (min))/2 calculate and obtain second code rate, wherein, B2 is the second code check, and B (max) is the maximal rate of setting, and B ' (min) is
Lowest bit rate after replacement, B ' (min)=B1=(B (max)+B (min))/2.With the second code check for calculating to video flowing and
Audio stream is encoded.If not occurring frame losing yet in preset duration, show that the second currently available code check can still be fitted
It should can then continue to reduce the second code check in the uploading speed of current network, and be encoded with the second code check after reduction, by this
Logic until there is B2 (n)=(B2 (n-1)+B (max))/2, wherein, B (min)=B2 (n-1) and B2 (n)<B2, n are represented
The number of times that second code check updates.
If in cataloged procedure is carried out with the first code check, detecting that packet occurs in that frame losing is then needed in the first code check
On the basis of reduce the first code check and obtain third yard rate, encoded with third yard rate.If carrying out cataloged procedure with the second code check
In occur in that frame losing, then need to reduce the second code check on the basis of the second code check and obtain third yard rate, carried out with third yard rate
Coding.
Alternatively, referring to Fig. 7, in the present embodiment, above-mentioned two situations are accounted for, then the third yard rate
It can be obtained by following steps：
Step S401, system maximal rate is reset to and calculates obtained first code check and sets system lowest bit rate
The lowest bit rate of setting is set to, or system maximal rate is reset into second code check and system lowest bit rate is set
Attach most importance to the lowest bit rate postponed.
Step S403, the lowest bit rate by the maximal rate after replacement and after resetting is by the 3rd calculating formula：B3=(B '
(max)+B " (min))/2 calculate and obtain third yard rate, wherein, B3 is third yard rate, and B ' (max) attaches most importance to the maximal rate postponed,
B " (min) attaches most importance to newly-installed lowest bit rate.
Alternatively, in the present embodiment, it is if when being encoded with the first code check, occurring in that frame losing, then system is maximum
Code check resets to the first code check B1 for calculating and obtaining, and the lowest bit rate B (min) that system lowest bit rate is set to set,
The lowest bit rate by the maximal rate after replacement and after resetting is by the 3rd calculating formula again：B3=(B ' (max)+B " (min))/
2 calculate and obtain third yard rate, wherein, B3 is third yard rate, and B ' (max) attaches most importance to the maximal rate postponed, and B " (min) is sets again
The lowest bit rate put.B ' (max)=B1 now, B " (min)=B (min).
If occurring in that frame losing when being encoded with the second code check, system maximal rate is reset to for calculating and obtaining
Two code checks, and system lowest bit rate is set to the lowest bit rate after resetting.That is, if the second current code check is B2, show
Current lowest bit rate is B1, then the maximal rate after resetting is B2, the lowest bit rate reset as B1.It will reset again
Rear maximal rate and the lowest bit rate after resetting are by the 3rd calculating formula：B3=(B ' (max)+B " (min))/2 are calculated
To third yard rate, wherein, B3 is third yard rate, and B ' (max) attaches most importance to the maximal rate postponed, B " (min) attach most importance to it is newly-installed most
Low bit- rate.B ' (max)=B2 now, B " (min)=B1.According to this logic, encoder bit rate can be constantly reduced, is worked as with being adapted to
Preceding network uploading speed, until poor absolute between obtained third yard rate and the lowest bit rate reset after updating
Untill value is less than or equal to preset value, such as 100, now resulting third yard rate is optimal code check, can be optimal with this
Code check is encoded to Media Stream, to avoid because there is video cardton phenomenon caused by frame losing.
When implementing, for example, when most starting, the maximal rate B (max)=2000 of setting, lowest bit rate B (min)=
0, obtained the first code check B1=(B (max)+B (min))/2=(2000+0)/2=1000 is calculated, with 1000 the first code check
Media Stream is encoded.Do not occur frame losing phenomenon now if detecting, increase the first code check, lowest bit rate is reset to
1000, the second obtained code check is B2=(1000+2000)/2=1500, is then encoded with 1500 code check.If now
Frame losing is occurred in that, then reduces the second code check and obtains third yard rate, now, system maximal rate 1500 are reset to, by minimum code
Rate is set to 1000, then repeats the above steps, and third yard rate is obtained for B3=(1500+1000)/2=1250, with 1250
Code check is encoded.If not occurring frame losing now, lowest bit rate is set to 1250, obtains the second new code check B2=(1250+
1500)/2=1375, is then encoded with 1375 code checks to video, if without frame losing, the current optimal code check of system is just
For 1375.If occurring in that frame losing, system optimal code check is just 1250 code checks.In the case where meeting exit criteria, it can terminate
To the dynamic regulation of code check, and it is live with optimal code check progress.
Referring to Fig. 8, being a kind of functional module frame of code check self-adaptive regulating 110 provided in an embodiment of the present invention
Figure.The code check self-adaptive regulating 110 include setting module 111, the first judge module 112, the first modified module 113,
Second modified module 114, the second judge module 115, the 3rd modified module 116 and exit judge module 117.
The setting module 111 is used for according to current system network state setting maximal rate and lowest bit rate, according to institute
State maximal rate and the lowest bit rate calculates and obtains the first code check, the Media Stream of transmission is compiled with first code check
Code.Specifically, the setting module 111 can be used for performing the step S101 shown in Fig. 3, and specific operating method refers to step
S101 detailed description.
First judge module 112 is used to judge whether frame losing occur in preset duration.Specifically, this first judges mould
Block 112 can be used for performing the step S102 shown in Fig. 3, and specific operating method refers to step S102 detailed description.
First modified module 113 is used for when there is frame losing, reduces by first code check and obtains third yard rate, with institute
Third yard rate is stated to encode the Media Stream of transmission.Specifically, first modified module 113 can be used for performing shown in Fig. 3
Step S103, specific operating method refers to step S103 detailed description.
Second modified module 114 is used for when not occurring frame losing, reduces by first code check and obtains the second code check, with
Second code check is encoded to the Media Stream of transmission.Specifically, second modified module 114 can be used for performing institute in Fig. 3
The step S104 shown, specific operating method refers to step S104 detailed description.
Second judge module 115 is used to judge whether frame losing occur when being encoded with second code check.Specifically
Ground, second judge module 115 can be used for performing the step S105 shown in Fig. 3, and specific operating method refers to step
S105 detailed description.
3rd modified module 116 is used for when there is frame losing, reduces by second code check and obtains third yard rate, with institute
Third yard rate is stated to encode the Media Stream of transmission.Specifically, the 3rd modified module 116 can be used for performing shown in Fig. 3
Step S106, specific operating method refers to step S106 detailed description.
The judge module 117 that exits is used to judge whether to meet exit criteria according to the obtained third yard rate.Tool
Body, this exits judge module 117 and can be used for performing the step S107 shown in Fig. 3, and specific operating method refers to step
S107 detailed description.
Referring to Fig. 9, in the present embodiment, the code check self-adaptive regulating 110 also includes video encoding module 118
With audio coding module 119.
The video encoding module 118 is used in Video coding thread, and the live video of acquisition is encoded, will be compiled
The video streaming data packet generated after code is delivered to the network transmission thread.Specifically, the video encoding module 118 can be used for holding
Step S201 shown in row Fig. 4, specific operating method refers to step S201 detailed description.
The audio coding module 119 is used in audio coding thread, and the live sound of acquisition is encoded, will be compiled
The audio stream packet generated after code is delivered to the network transmission thread.Specifically, the audio coding module 119 can be used for holding
Step S203 shown in row Fig. 4, specific operating method refers to step S203 detailed description.
Referring to Fig. 10, in the present embodiment, the code check self-adaptive regulating 110 also includes the He of detection module 1110
Determination module 1111.
The detection module 1110 is used in network transmission thread, detect video streaming data packet in queue to be sent or
Whether audio stream packet, which accumulates, reaches predetermined threshold value.Specifically, the detection module 1110 can be used for performing the step shown in Fig. 5
Rapid S301, specific operating method refers to step S301 detailed description.
The determination module 1111 is used for when reaching predetermined threshold value, judges that packet loss occurs in current system, and trigger packet loss
Logic.Specifically, the determination module 1111 can be used for performing the step S303 shown in Fig. 5, and specific operating method is referred to
Step S303 detailed description.
Alternatively, refer to Figure 11, in the present embodiment, second modified module 114 include reset cell 1141 with
And computing unit 1142.
The reset cell 1141 is used to resetting to system lowest bit rate into first code check for calculating and obtaining.Specifically
Ground, the reset cell 1141 can be used for performing the step S1041 shown in Fig. 6, and specific operating method refers to step S1041
Detailed description.
The computing unit 1142 is used to calculate the lowest bit rate after replacement and the maximal rate of setting by second
Formula：B2=(B (max)+B ' (min))/2 is calculated and is obtained second code rate, wherein, B2 is the second code check, and B (max) is to set most
Big code check, B ' (min) attaches most importance to the lowest bit rate postponed.Specifically, the computing unit 1142 can be used for performing the step shown in Fig. 6
Rapid S1043, specific operating method refers to step S1043 detailed description.
Alternatively, Figure 12 is referred to, in the present embodiment, the code check self-adaptive regulating 110 also includes resetting mould
Block 1112 and computing module 1113.
The replacement module 1112, which is used to reset to system maximal rate, to be calculated obtained first code check and will be
System lowest bit rate is set to the lowest bit rate of setting, or system maximal rate is reset into second code check and by system
Lowest bit rate is set to the lowest bit rate after resetting.Specifically, the step of replacement module 1112 can be used for performing shown in Fig. 7
S401, specific operating method refers to step S401 detailed description.
Maximal rate of the computing module 1113 after by replacement and lowest bit rate after resetting are based on the 3rd
Formula：B3=(B ' (max)+B " (min))/2 calculate and obtain third yard rate, wherein, B3 is third yard rate, and B ' (Max) is resets
Maximal rate afterwards, B " (min) attaches most importance to newly-installed lowest bit rate.Specifically, the computing module 1113 can be used for performing in Fig. 7
Shown step S403, specific operating method refers to step S403 detailed description.
In addition, another preferred embodiment of the invention also provides a kind of storage medium, computer program is stored thereon with, it is described
The step of above-mentioned code check adaptive regulation method is realized when computer program is executed by processor.
In summary, the present invention is provided a kind of code check adaptive regulation method, device and electronic equipment, according to system network
Network state obtains corresponding code check, and the Media Stream of transmission is encoded using obtained code check.By detecting data frame losing
Situation, according to the increase accordingly of data frame loss condition or reduction code check, is encoded using amended code check to Media Stream.It is logical
The adjustment of frame losing and code check adaptively is crossed, efficiently solves and is used because of live delay after frame losing, seen because of caused by frame losing
The problem of seeing end interim card.
, can also be by other in embodiment provided herein, it should be understood that disclosed apparatus and method
Mode realize.Device embodiment described above is only schematical, for example, the flow chart and block diagram in accompanying drawing are shown
Devices in accordance with embodiments of the present invention, architectural framework in the cards, function and the behaviour of method and computer program product
Make.At this point, each square frame in flow chart or block diagram can represent a part for a module, program segment or code, institute
The part for stating module, program segment or code includes one or more executable instructions for being used to realize defined logic function.
It should also be noted that in some implementations as replacement, the function of being marked in square frame can also be with different from accompanying drawing
The order marked occurs.For example, two continuous square frames can essentially be performed substantially in parallel, they sometimes can also be by
Opposite order is performed, and this is depending on involved function.It is also noted that each square frame in block diagram and/or flow chart,
And the combination of the square frame in block diagram and/or flow chart, can be with function or action as defined in performing it is special based on hardware
System realize, or can be realized with the combination of specialized hardware and computer instruction.
It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row
His property is included, so that process, method, article or equipment including a series of key elements not only include those key elements, and
And also including other key elements being not expressly set out, or also include for this process, method, article or equipment institute inherently
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including institute
Also there is other identical element in process, method, article or the equipment of stating key element.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should be included in the scope of the protection.It should be noted that：Similar label and letter exists
Similar terms is represented in following accompanying drawing, therefore, once being defined in a certain Xiang Yi accompanying drawing, is then not required in subsequent accompanying drawing
It is further defined and explained.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (10)
1. a kind of code check adaptive regulation method, it is characterised in that applied to the user terminal being connected with server communication, to live
Audio frequency and video carry out code check automatic adjusument, and methods described includes：
According to current system network state setting maximal rate and lowest bit rate, according to the maximal rate and the lowest bit rate
Calculating obtains the first code check, and the Media Stream of transmission is encoded with first code check；
Judge whether frame losing occur in preset duration, if there is frame losing, reduce by first code check and obtain third yard rate, with institute
Third yard rate is stated to encode the Media Stream of transmission；
If not occurring frame losing, increase first code check and obtain the second code check, with Media Stream of second code check to transmission
Encoded；
Judge whether frame losing occur when being encoded with second code check, if there is frame losing, reduce by second code check and obtain
To third yard rate, the Media Stream of transmission is encoded with the third yard rate.
2. code check adaptive regulation method according to claim 1, it is characterised in that it is described according to the maximal rate and
The lowest bit rate calculates the step of obtaining the first code check, including：
The maximal rate and the lowest bit rate are pressed into the first calculating formula：B1=(B (max)+B (min))/2, which is calculated, obtains the
One code check, wherein, B1 is the first code check, and B (max) is the maximal rate of setting, and B (min) is the lowest bit rate of setting.
3. code check adaptive regulation method according to claim 2, it is characterised in that increase first code check is obtained
The step of to the second code check, including：
System lowest bit rate is reset to first code check for calculating and obtaining；
Lowest bit rate after replacement and the maximal rate of setting are pressed into the second calculating formula：B2=(B (max)+B ' (min))/2
Calculating obtains second code rate, wherein, B2 is the second code check, and B (max) is the maximal rate of setting, and B ' (min), which attaches most importance to, to be postponed most
Low bit- rate.
4. code check adaptive regulation method according to claim 3, it is characterised in that the third yard rate passes through following step
It is rapid to obtain：
System maximal rate is reset to the institute for calculating obtained first code check and system lowest bit rate being set to setting
Lowest bit rate is stated, or system maximal rate is reset into second code check and is set to system lowest bit rate after resetting most
Low bit- rate；
Lowest bit rate by the maximal rate after replacement and after resetting is by the 3rd calculating formula：B3=(B ' (max)+B "
(min))/2 calculate and obtain third yard rate, wherein, B3 is third yard rate, and B ' (max) attaches most importance to the maximal rate postponed, B " (min)
Attach most importance to newly-installed lowest bit rate.
5. code check adaptive regulation method according to claim 1, it is characterised in that methods described also includes：
Whether detection current system there is packet loss, if there is packet loss, triggering code rate adjustment request；
It is described to be asked according to the step of current system network state setting maximal rate and lowest bit rate in the acquisition code rate adjustment
Triggering is performed after asking.
6. code check adaptive regulation method according to claim 5, it is characterised in that the Media Stream include video flowing and
Audio stream, whether detection current system packet loss occurs is performed by following steps：
In network transmission thread, detect whether video streaming data packet or audio stream packet in queue to be sent are accumulated and reached
Predetermined threshold value, if reaching the predetermined threshold value, judges that packet loss occurs in current system, and trigger packet loss logic.
7. code check adaptive regulation method according to claim 6, it is characterised in that the video streaming data packet and described
Audio stream packet is obtained by following steps：
In Video coding thread, the live video of acquisition is encoded, the video streaming data packet generated after coding is delivered
To the network transmission thread；
In audio coding thread, the live sound of acquisition is encoded, the audio stream packet generated after coding is delivered
To the network transmission thread.
8. a kind of code check self-adaptive regulating, it is characterised in that applied to the user terminal being connected with server communication, to live
Audio frequency and video carry out code check automatic adjusument, and the code check self-adaptive regulating includes：
Setting module, for according to current system network state setting maximal rate and lowest bit rate, according to the maximal rate
Calculated with the lowest bit rate and obtain the first code check, the Media Stream of transmission is encoded with first code check；
First judge module, for judging whether frame losing occur in preset duration；
First modified module, obtains third yard rate, with the third yard rate for when there is frame losing, reducing by first code check
The Media Stream of transmission is encoded；
Second modified module, obtains the second code check, with the second code for when not occurring frame losing, increasing first code check
Rate is encoded to the Media Stream of transmission；
Whether the second judge module, there is frame losing during for judging and encoded with second code check；
3rd modified module, obtains third yard rate, with the third yard rate for when there is frame losing, reducing by second code check
The Media Stream of transmission is encoded.
9. a kind of electronic equipment, it is characterised in that including：
Memory；
Processor；And
Code check self-adaptive regulating, the code check self-adaptive regulating is installed in the memory and including one or many
The individual software function module by the computing device, the code check self-adaptive regulating includes：
Setting module, for according to current system network state setting maximal rate and lowest bit rate, according to the maximal rate
Calculated with the lowest bit rate and obtain the first code check, the Media Stream of transmission is encoded with first code check；
Judge module, for judging whether frame losing occur in preset duration；
First modified module, during for frame losing do not occur, reducing by first code check and obtaining third yard rate, with the third yard rate
The Media Stream of transmission is encoded；
Second modified module, obtains the second code check, with second code check for when not occurring frame losing, increasing first code check
The Media Stream of transmission is encoded；
Whether the second judge module, there is frame losing during for judging and encoded with second code check；
3rd modified module, obtains third yard rate, with the third yard rate for when there is frame losing, reducing by second code check
The Media Stream of transmission is encoded.
10. a kind of storage medium, it is characterised in that be stored thereon with computer program, the computer program is held by processor
The step of code check adaptive regulation method described in claim 1-7 any one is realized during row.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710500737.3A CN107295395A (en) | 2017-06-27 | 2017-06-27 | Code check adaptive regulation method, device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710500737.3A CN107295395A (en) | 2017-06-27 | 2017-06-27 | Code check adaptive regulation method, device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107295395A true CN107295395A (en) | 2017-10-24 |
Family
ID=60098961
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710500737.3A Pending CN107295395A (en) | 2017-06-27 | 2017-06-27 | Code check adaptive regulation method, device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107295395A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108769826A (en) * | 2018-06-22 | 2018-11-06 | 广州酷狗计算机科技有限公司 | Live media stream acquisition methods, device, terminal and storage medium |
| CN108833930A (en) * | 2018-06-20 | 2018-11-16 | 广州华多网络科技有限公司 | Live data transfer control method, device, live streaming equipment and storage medium |
| CN109660879A (en) * | 2018-12-20 | 2019-04-19 | 广州虎牙信息科技有限公司 | Frame losing method, system, computer equipment and storage medium is broadcast live |
| CN110446081A (en) * | 2019-09-04 | 2019-11-12 | 南京安谱软件有限公司 | A kind of method for processing video frequency, apparatus and system |
| CN111107382A (en) * | 2018-10-29 | 2020-05-05 | 阿里巴巴集团控股有限公司 | Data flow control method, device and system |
| CN111869142A (en) * | 2020-02-20 | 2020-10-30 | 深圳市汇顶科技股份有限公司 | Data transmission method, device, equipment, system and medium |
| CN113079103A (en) * | 2021-03-19 | 2021-07-06 | 北京达佳互联信息技术有限公司 | Audio transmission method, audio transmission device, electronic equipment and storage medium |
| CN113259730A (en) * | 2021-07-06 | 2021-08-13 | 北京达佳互联信息技术有限公司 | Code rate adjustment method and device for live broadcast |
| CN113411646A (en) * | 2021-04-21 | 2021-09-17 | 北京国际云转播科技有限公司 | Cloud rebroadcasting code rate adjusting method and device, readable storage medium and cloud rebroadcasting system |
| CN113490020A (en) * | 2021-06-30 | 2021-10-08 | 众立智能科技(深圳)有限公司 | Method and system for prioritizing network transmission audio and video streaming media data |
| CN114245131A (en) * | 2021-12-18 | 2022-03-25 | 杭州视洞科技有限公司 | Optimization algorithm for dynamically adjusting video code rate based on buffer queue |
| CN117714693A (en) * | 2024-02-06 | 2024-03-15 | 成都科玛奇信息科技有限责任公司 | Medical image data compression transmission method, system, equipment and medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102118357A (en) * | 2009-12-31 | 2011-07-06 | 华为技术有限公司 | Method, device and system for processing streaming media |
| CN104349219A (en) * | 2013-07-29 | 2015-02-11 | 中国科学院大学 | Strict increase loose decrease equal step congestion control algorithm based on mobile communication network |
| CN105263037A (en) * | 2014-07-18 | 2016-01-20 | 中国科学院声学研究所 | Self-adaptive streaming method based on client cache |
| CN105847182A (en) * | 2016-04-18 | 2016-08-10 | 武汉烽火众智数字技术有限责任公司 | Method and system thereof for preferentially transmitting audio in audio and video system |
| CN105933241A (en) * | 2016-04-19 | 2016-09-07 | 武汉顶翔智控科技有限公司 | Network congestion adaption device and method in multimedia streaming transmission system |
| CN106488176A (en) * | 2015-08-26 | 2017-03-08 | 重庆西线科技有限公司 | A kind of video frequency transmitter |
| CN106488265A (en) * | 2016-10-12 | 2017-03-08 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus sending Media Stream |
| CN106507024A (en) * | 2016-11-17 | 2017-03-15 | 北京数码视讯技术有限公司 | A kind of self-adaption code rate method of adjustment and device |
-
2017
- 2017-06-27 CN CN201710500737.3A patent/CN107295395A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102118357A (en) * | 2009-12-31 | 2011-07-06 | 华为技术有限公司 | Method, device and system for processing streaming media |
| CN104349219A (en) * | 2013-07-29 | 2015-02-11 | 中国科学院大学 | Strict increase loose decrease equal step congestion control algorithm based on mobile communication network |
| CN105263037A (en) * | 2014-07-18 | 2016-01-20 | 中国科学院声学研究所 | Self-adaptive streaming method based on client cache |
| CN106488176A (en) * | 2015-08-26 | 2017-03-08 | 重庆西线科技有限公司 | A kind of video frequency transmitter |
| CN105847182A (en) * | 2016-04-18 | 2016-08-10 | 武汉烽火众智数字技术有限责任公司 | Method and system thereof for preferentially transmitting audio in audio and video system |
| CN105933241A (en) * | 2016-04-19 | 2016-09-07 | 武汉顶翔智控科技有限公司 | Network congestion adaption device and method in multimedia streaming transmission system |
| CN106488265A (en) * | 2016-10-12 | 2017-03-08 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus sending Media Stream |
| CN106507024A (en) * | 2016-11-17 | 2017-03-15 | 北京数码视讯技术有限公司 | A kind of self-adaption code rate method of adjustment and device |
Non-Patent Citations (1)
| Title |
|---|
| 王建国,焦莉娟: "《Visual Basic程序设计》", 30 June 2011, 中国铁道出版社 * |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108833930A (en) * | 2018-06-20 | 2018-11-16 | 广州华多网络科技有限公司 | Live data transfer control method, device, live streaming equipment and storage medium |
| CN108833930B (en) * | 2018-06-20 | 2020-10-02 | 广州华多网络科技有限公司 | Live broadcast data transmission control method and device, live broadcast equipment and storage medium |
| CN108769826A (en) * | 2018-06-22 | 2018-11-06 | 广州酷狗计算机科技有限公司 | Live media stream acquisition methods, device, terminal and storage medium |
| CN111107382A (en) * | 2018-10-29 | 2020-05-05 | 阿里巴巴集团控股有限公司 | Data flow control method, device and system |
| CN111107382B (en) * | 2018-10-29 | 2022-05-06 | 阿里巴巴集团控股有限公司 | Data flow control method, device and system |
| CN109660879B (en) * | 2018-12-20 | 2021-11-19 | 广州虎牙信息科技有限公司 | Live broadcast frame loss method, system, computer equipment and storage medium |
| CN109660879A (en) * | 2018-12-20 | 2019-04-19 | 广州虎牙信息科技有限公司 | Frame losing method, system, computer equipment and storage medium is broadcast live |
| CN110446081A (en) * | 2019-09-04 | 2019-11-12 | 南京安谱软件有限公司 | A kind of method for processing video frequency, apparatus and system |
| CN110446081B (en) * | 2019-09-04 | 2022-02-22 | 南京安谱软件有限公司 | Video processing method, device and system |
| CN111869142A (en) * | 2020-02-20 | 2020-10-30 | 深圳市汇顶科技股份有限公司 | Data transmission method, device, equipment, system and medium |
| CN111869142B (en) * | 2020-02-20 | 2023-05-02 | 深圳市汇顶科技股份有限公司 | Data transmission method, device, equipment, system and medium |
| CN113079103A (en) * | 2021-03-19 | 2021-07-06 | 北京达佳互联信息技术有限公司 | Audio transmission method, audio transmission device, electronic equipment and storage medium |
| CN113411646A (en) * | 2021-04-21 | 2021-09-17 | 北京国际云转播科技有限公司 | Cloud rebroadcasting code rate adjusting method and device, readable storage medium and cloud rebroadcasting system |
| CN113490020A (en) * | 2021-06-30 | 2021-10-08 | 众立智能科技(深圳)有限公司 | Method and system for prioritizing network transmission audio and video streaming media data |
| CN113259730A (en) * | 2021-07-06 | 2021-08-13 | 北京达佳互联信息技术有限公司 | Code rate adjustment method and device for live broadcast |
| US11553224B1 (en) | 2021-07-06 | 2023-01-10 | Beijing Dajia Internet Information Technology Co., Ltd. | Method and device for adjusting bit rate during live streaming |
| CN113259730B (en) * | 2021-07-06 | 2021-12-14 | 北京达佳互联信息技术有限公司 | Code rate adjustment method and device for live broadcast |
| CN114245131A (en) * | 2021-12-18 | 2022-03-25 | 杭州视洞科技有限公司 | Optimization algorithm for dynamically adjusting video code rate based on buffer queue |
| CN117714693A (en) * | 2024-02-06 | 2024-03-15 | 成都科玛奇信息科技有限责任公司 | Medical image data compression transmission method, system, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107295395A (en) | Code check adaptive regulation method, device and electronic equipment | |
| US11349900B2 (en) | Voice encoding and sending method and apparatus | |
| US20220046068A1 (en) | Dynamic adaptation to increased sfu load by disabling video streams | |
| CN111107382B (en) | Data flow control method, device and system | |
| EP3840390A1 (en) | Method and device for controlling video transcoding code rate | |
| CN112218172B (en) | Code stream transmission method and device and network camera | |
| US20110299588A1 (en) | Rate control in video communication via virtual transmission buffer | |
| CN107529069A (en) | A kind of video stream transmission method and device | |
| CN109729437B (en) | Streaming media self-adaptive transmission method, terminal and system | |
| CN108347645B (en) | Method and device for decoding and displaying video frame | |
| TW201021576A (en) | System and method for dynamic video encoding in multimedia streaming | |
| CN114222194A (en) | Video code stream adjusting method, device and system | |
| CN113490055B (en) | Data processing method and device | |
| CN106375790A (en) | QoE-driven adaptive scheduling method of multichannel HAS code rate | |
| CN104270649A (en) | Image encoding device and image encoding method | |
| CN114640886A (en) | Bandwidth-adaptive audio and video transmission method and device, computer equipment and medium | |
| CN114827662A (en) | Video resolution self-adaptive adjusting method, device, equipment and storage medium | |
| CN108810468B (en) | Video transmission device and method for optimizing display effect | |
| CN103929682A (en) | Method and device for setting key frames in video live broadcast system | |
| CN109862386A (en) | Live data transmission method and device | |
| CN115701709A (en) | Video coding method and device, computer readable medium and electronic equipment | |
| CN106254873B (en) | Video coding method and video coding device | |
| CN111787417B (en) | Audio and video transmission control method based on artificial intelligence AI and related equipment | |
| CN112737971B (en) | Data processing method, device, storage medium and network equipment | |
| CN115623155A (en) | Video data processing method, video data processing apparatus, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171024 |