CN112087627A - Image coding control method, device, equipment and storage medium - Google Patents

Image coding control method, device, equipment and storage medium Download PDF

Info

Publication number
CN112087627A
CN112087627A CN202010771812.1A CN202010771812A CN112087627A CN 112087627 A CN112087627 A CN 112087627A CN 202010771812 A CN202010771812 A CN 202010771812A CN 112087627 A CN112087627 A CN 112087627A
Authority
CN
China
Prior art keywords
image
average
frame
preset threshold
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010771812.1A
Other languages
Chinese (zh)
Other versions
CN112087627B (en
Inventor
许龙龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Wanxiang Electronics Technology Co Ltd
Original Assignee
Xian Wanxiang Electronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Wanxiang Electronics Technology Co Ltd filed Critical Xian Wanxiang Electronics Technology Co Ltd
Priority to CN202010771812.1A priority Critical patent/CN112087627B/en
Publication of CN112087627A publication Critical patent/CN112087627A/en
Application granted granted Critical
Publication of CN112087627B publication Critical patent/CN112087627B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/32—Flow control; Congestion control by discarding or delaying data units, e.g. packets or frames
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The application provides an image coding control method, an image coding control device, image coding control equipment and a storage medium, relates to the technical field of image processing, and can solve the problem of long time delay of image coding. The specific technical scheme is as follows: after the current frame image is transmitted, calculating the average value of network time delay of all images transmitted in a preset time period; judging whether the average value of the network time delay is larger than a preset threshold value or not; when the number of the lost frames is larger than a preset threshold value, determining the number of the lost frames M according to a preset rule; the consecutive M-frame pictures that are not currently starting to be encoded are discarded. The invention is used for encoding control of the image.

Description

Image coding control method, device, equipment and storage medium
Technical Field
The present application relates to the field of image processing, and in particular, to a method, an apparatus, a device, and a storage medium for controlling encoding of an image.
Background
At present, in the encoding and decoding process of a graphic image, image acquisition is generally performed at a fixed frame rate, and after the image which is acquired is encoded, the image is waited to be transmitted in a buffer. In the transmission process, whether the coded image in the buffer needs to be discarded or not is judged according to the network delay.
For all the images, since it is determined whether discarding is needed after the encoding is completed, the image encoding time delay is increased, and the encoding resources of a Central Processing Unit (CPU) are wasted.
Disclosure of Invention
The embodiment of the application provides an image coding control method, device and equipment and a storage medium, which can solve the problem of long time delay of image coding. The technical scheme is as follows:
according to a first aspect of embodiments of the present application, there is provided an encoding control method for an image, the method including:
after the current frame image is transmitted, calculating the average value of network time delay of all images transmitted in a preset time period, wherein the preset time period is the time interval between the current time point and a target time point before the current time point;
judging whether the network delay average value is larger than a preset threshold value or not;
when the network delay average value is larger than the preset threshold value, determining a frame loss number M according to a preset rule, wherein M is an integer;
the consecutive M-frame pictures that are not currently starting to be encoded are discarded.
In one embodiment, the determining the number of lost frames M according to the preset rule includes:
and determining the number M of lost frames according to the difference between the network delay average value and the preset threshold value.
In one embodiment, the determining the number of frames M according to the difference between the network delay average and the preset threshold includes:
determining a frame loss number M according to a first formula, wherein the first formula is as follows: m ═ [ (T)Average-A)/(tCollecting+tEncoding)]；
Wherein, T isAverageIs the average value of network time delay, A is a preset threshold value, tCollectingAverage duration, t, required for acquiring a frame of imageEncodingThe average time duration required to encode a frame of image.
In one embodiment, the determining the number of frames M according to the difference between the network delay average and the preset threshold includes:
determining the number M of lost frames according to a second formula, wherein the second formula is as follows:
M＝[(Taverage-A)/(tCollecting+tEncoding)]+1；
Wherein, T isAverageIs the average value of network time delay, A is a preset threshold value, tCollectingAverage duration, t, required for acquiring a frame of imageEncodingThe average time duration required to encode a frame of image.
In one embodiment, when it is determined that the network delay average value is greater than the preset threshold, the method further includes:
and updating the time value of the target time point to the time value of the current time point.
According to the image coding control method provided by the embodiment of the application, after the current frame image is transmitted, the network delay average value of all images transmitted in a preset time period is calculated, whether the network delay average value is larger than a preset threshold value or not is judged, when the network delay average value is larger than the preset threshold value, a frame loss number M is determined according to a preset rule, and then continuous M frame images which do not start to be coded at present are discarded. The frame loss quantity can be determined once after each frame of image is transmitted, the frame loss quantity can be determined before image coding, and the corresponding quantity of images can be discarded before coding, so that the network pressure can be relieved, the image coding time delay can be shortened, and the coding load of a CPU can be reduced.
According to a second aspect of the embodiments of the present application, there is provided an encoding control apparatus for an image, including:
the calculation module is used for calculating the network delay average value of all images transmitted in a preset time period after the current frame image is transmitted, wherein the preset time period is a time interval between a current time point and a target time point before the current time point;
the determining module is used for judging whether the network delay average value is larger than a preset threshold value or not, and determining the number of lost frames M according to a preset rule when the network delay average value is larger than the preset threshold value, wherein M is an integer;
and the frame dropping module is used for dropping the continuous M frames of images which are not started to be coded currently.
In an embodiment, the determining module is specifically configured to determine the number of lost frames M according to a difference between the network delay average and the preset threshold.
In one embodiment, the apparatus further comprises:
and the updating module is used for updating the time value of the target time point to the time value of the current time point when the network delay average value is judged to be larger than the preset threshold value.
According to the image coding control device provided by the embodiment of the application, the average value of network time delay of all images transmitted in a preset time period is calculated through the calculation module after the current frame image is transmitted; the determining module judges whether the average network delay value is greater than a preset threshold value or not, and determines the number of lost frames M according to a preset rule when the average network delay value is greater than the preset threshold value; the frame dropping module drops the continuous M frames of images which are not started to be coded currently. The frame loss quantity can be determined once after each frame of image is transmitted, the frame loss quantity can be determined before image coding, and the corresponding quantity of images can be discarded before coding, so that the network pressure can be relieved, the image coding time delay can be shortened, and the coding load of a CPU can be reduced.
According to a third aspect of embodiments of the present application, there is provided an encoding control device for an image, the encoding control device for an image comprising a processor and a memory, the memory having stored therein at least one computer instruction, the instruction being loaded and executed by the processor to implement the steps performed in the encoding control method for an image as described above.
According to a fourth aspect of embodiments of the present application, there is provided a computer-readable storage medium having at least one computer instruction stored therein, the instruction being loaded and executed by a processor to implement the steps performed in the encoding control method of an image as described above.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
Fig. 1 is a flowchart of an image encoding control method according to an embodiment of the present application;
fig. 2 is a flowchart of a specific image encoding control method according to an embodiment of the present application;
fig. 3 is a schematic diagram for calculating a network delay average value of all images transmitted between a target time point and a current time point according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an image encoding control apparatus according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of another image encoding control apparatus according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an image encoding control apparatus according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
An embodiment of the present application provides an image coding control method, as shown in fig. 1, the image coding control method includes the following steps:
step 101: and calculating the average value of the network time delay of all the images transmitted in the preset time period.
In the process of encoding and transmitting the images, after the transmission of the current frame image is finished, the average value of the network time delay of all the images transmitted in the preset time period is calculated. The preset time period is a time interval between a current time point and a target time point before the current time point, wherein the target time point is a certain time point before the current time point. In one embodiment, the target time point is a time node which has been subjected to the network delay average calculation last time and subjected to frame loss processing once based on the calculation result.
Specifically, the network delay of one frame of image is equal to the difference between the timestamp of the image received by the receiving end and the timestamp of the image when the image is sent by the sending end. The network delay of each frame of image transmitted in a preset time period can be counted, and then the average value of the network delay is calculated according to the network delay obtained through counting.
Step 102: and judging whether the average value of the network time delay is larger than a preset threshold value or not.
After the network delay average value of all the images transmitted in the preset time period is obtained through calculation, whether the network delay average value is larger than a preset threshold value or not is judged, if so, the step 103 is executed, otherwise, the step 101 is carried out to continue statistical calculation.
Step 103: and determining the number M of lost frames according to a preset rule.
And when the average value of the network time delay of all images transmitted in a preset time period is greater than a preset threshold value, determining the number of lost frames M according to a preset rule, wherein M is an integer. For example, the number of lost frames M may be determined according to a difference between the average value of the network delay and a preset threshold. In one embodiment, the number of lost frames M can be obtained by using the difference and the ratio of the sum of the average duration required for acquiring one frame of image and the average duration required for encoding one frame of image.
Step 104: the consecutive M-frame pictures that are not currently starting to be encoded are discarded.
After the number of lost frames M is determined, directly discarding the continuous M frames of images which are not encoded at present, and then, turning to step 101 to continue to calculate the network delay average value. In this step, the pictures that have started to be transmitted or encoded are not discarded, and the subsequent processing is still performed normally, and only the consecutive M-frame pictures that have not started to be encoded are discarded.
According to the image coding control method provided by the embodiment of the application, after the current frame image is transmitted, the network delay average value of all images transmitted in a preset time period is calculated, whether the network delay average value is larger than a preset threshold value or not is judged, when the network delay average value is larger than the preset threshold value, a frame loss number M is determined according to a preset rule, and then continuous M frame images which do not start to be coded at present are discarded. The frame loss quantity can be determined once after each frame of image is transmitted, the frame loss quantity can be determined before image coding, and the corresponding quantity of images can be discarded before coding, so that the network pressure can be relieved, the image coding time delay is shortened, the coding load of a CPU is reduced, and the pause phenomenon in video watching of a user is avoided.
Based on the image coding control method provided in the embodiment corresponding to fig. 1, another embodiment of the present application provides a specific image coding control method, which may be applied to a video image coding end device, for example, the video image coding end device may be a terminal device or a network server. Referring to fig. 2, the method for controlling encoding of an image according to the present embodiment may include the following steps:
step 201: and calculating the average value of the network time delay of all the images transmitted in the preset time period.
In the process of encoding and transmitting the images, after the transmission of the current frame image is finished, the average value of the network time delay of all the images transmitted in the preset time period is calculated. The preset time period is a time interval between the current time point and a target time point before the current time point.
The target time point is a certain time point before the current time point. In one embodiment, the target time point may be a time point at which the network delay average is calculated last and frame loss processing is performed based on the calculation result.
Referring to fig. 3, which is a schematic diagram for calculating a network delay average value of all images transmitted between a target time point and a current time point, in fig. 3, a time point t0 is the target time point, and after a marked target time point t0, image frames a1, a2, A3, and the like are sequentially transmitted. For example, when the current transmission is completed for the image frame a1, after the transmission of the image frame a1 is completed, the average value of the network delays of all the images transmitted between the current time point t1 and the target time point t0, that is, the network delay of the image frame a1 in the transmission process, can be calculated. For another example, assuming that the current transmission is completed for the image frame A3, after the transmission of the image frame A3 is completed, the network delay average of all the images transmitted between the current time point t2 and the target time point t0, that is, the network delay average of the image frame a1, the image frame a2 and the image frame A3 is calculated.
Specifically, the network delay of one frame of image is equal to the difference between the timestamp of the image received by the receiving end and the timestamp of the image when the image is sent by the sending end. For example, if N frames of images are continuously transmitted within a preset time period, the network delay of each frame of image can be obtained through statistics, and then the network delay average value T of the N frames of images is obtained through calculation by using the following calculation formulaAverage：
Figure BDA0002616928500000061
Wherein,
Figure BDA0002616928500000062
is the network delay of the x-th frame image, x is an integer greater than 0 and less than or equal to N,
Figure BDA0002616928500000063
wherein RtxTime stamp, St, representing the transmission of the x-th frame image to the receiving endxWhich indicates the time stamp of the xth frame image when it is transmitted at the transmitting end. Therefore, the average value of the network time delay of all the images transmitted in the preset time period can be obtained.
Step 202: and judging whether the average value of the network time delay is larger than a preset threshold value or not.
After the network delay average value of all the images transmitted in the preset time period is calculated, whether the network delay average value is larger than a preset threshold value is judged, if so, the step 203 and the step 205 are respectively executed, otherwise, the step 101 is switched to continue the statistical calculation.
In this step, the calculated average value of the network delay is compared with a preset threshold, where the preset threshold is a preset value, and may be set empirically in practical applications, for example, 100ms, 90ms, 80ms, and the like, and may also be set as other values. The higher the preset threshold is set, the higher the tolerance to the delay is, and thus the setting of the preset threshold may depend on the usage scenario.
In an embodiment, a function of setting a preset threshold may be provided, and specifically, the following method may be implemented: detecting a setting operation for setting a preset threshold; and determining a preset threshold according to the setting operation. For example, a setting interface for setting a preset threshold may be provided for the user, and the user may input the preset threshold according to the interface prompt, such as setting to 100ms, 90ms, 80ms, and so on; alternatively, the preset threshold may be set by a shortcut key for setting the threshold.
Step 203: and determining the number M of lost frames according to the difference between the network delay average value and a preset threshold value.
Assuming that the calculated average value of the network time delay is TAverageThe frame loss number M can be calculated by the following first formula, or can be calculated by the following second formula.
Wherein the first formula is: m ═ [ (T)Average-A)/(tCollecting+tEncoding)]；
The second formula is: m ═ [ (T)Average-A)/(tCollecting+tEncoding)]+1；
In the above formula, TAverageRepresents the average value of network time delay, A represents a preset threshold value, tCollectingAverage duration, t, required for acquiring a frame of imageEncodingAverage duration, t, required for encoding a frame of imageCollectingAnd tEncodingCan be set according to empirical values. Wherein the symbol [ alpha ], [ alpha]Denotes the rounded symbol, i.e., [ (T)Average-A)/(tCollecting+tEncoding)]Is equal to (T)Average-A)/(tCollecting+tEncoding) The integer part of the result obtained.
Step 204: the consecutive M-frame pictures that are not currently starting to be encoded are discarded.
After the frame loss number M is determined, directly discarding the continuous M frames of images which are not encoded at present, and then turning to the step 101 to continue to count the network delay.
In this step, the consecutive M-frame pictures that are not currently encoded are directly discarded, and meanwhile, the pictures that have already started to be transmitted or encoded are not discarded, and the subsequent processing is still normally performed, and the discarded consecutive M-frame pictures that are not encoded are discarded.
Step 205: and updating the time value of the target time point to the time value of the current time point.
And when the network delay average value is judged to be larger than the preset threshold value, updating the time value of the target time point to the time value of the current time point, namely, taking the current time point as a new target time point.
In this embodiment of the application, the target time point is continuously updated and adjusted, taking fig. 3 as an example, assuming that the calculated network delay average value is greater than the preset threshold value in the preset time period from the target time point t0 to the current time point t2, determining the number of lost frames M according to the difference between the network delay average value and the preset threshold value, discarding consecutive M frame images that are not currently encoded, and adjusting the target time point to t2, that is, starting from the time point t2, recalculating the network delay average value, and determining whether frame loss is needed based on the calculation result.
In the image coding and transmitting process, after transmission of a current frame image is completed, a network delay average value of all images transmitted within a preset time period is calculated, and when the average value is greater than a preset threshold, on one hand, a frame loss number M is determined according to a difference value between the network delay average value and the preset threshold, and consecutive M frame images which do not start to be coded at present are discarded, on the other hand, a time value of a target time point is updated to a time value of the current time point, and updating adjustment of the target time point is continuously performed. The frame loss amount can be determined before coding, and the corresponding number of images can be discarded before coding, so that the network pressure can be relieved, the image coding time delay is shortened, the phenomenon of pause in video watching by a user is avoided, and the coding load of a CPU is also reduced.
Based on the image encoding control method described in the embodiments corresponding to fig. 1 and fig. 2, the following is an embodiment of the apparatus of the present application, which can be used to execute the embodiment of the method of the present application.
An embodiment of the present application provides an image encoding control apparatus, and as shown in fig. 4, the image encoding control apparatus 40 includes: a calculation module 401, a determination module 402 and a frame dropping module 403;
the calculating module 401 is configured to calculate a network delay average value of all images transmitted within a preset time period after transmission of a current frame image is completed, where the preset time period is a time interval between a current time point and a target time point before the current time point;
the determining module 402 is configured to determine whether the network delay average value obtained by the calculating module 401 is greater than a preset threshold, and determine a number of lost frames M according to a preset rule when the network delay average value is greater than the preset threshold, where M is an integer;
the frame dropping module 403 is used to drop consecutive M-frame images that are not currently starting to be encoded.
In an embodiment, the determining module 402 is specifically configured to determine the number of lost frames M according to a difference between the network delay average and a preset threshold.
In an embodiment, the determining module 402 is specifically configured to determine the number of lost frames M according to a first formula, where the first formula is: m ═ [ (T)Average-A)/(tCollecting+tEncoding)]；
Wherein, TAverageIs the average value of network time delay, A is a preset threshold value, tCollectingAverage duration, t, required for acquiring a frame of imageEncodingThe average time duration required to encode a frame of image.
In an embodiment, the determining module 402 is specifically configured to determine the number of lost frames M according to a second formula, where the second formula is:
M＝[(Taverage-A)/(tCollecting+tEncoding)]+1；
Wherein, TAverageIs the average value of network time delay, A is a preset threshold value, tCollectingAverage duration, t, required for acquiring a frame of imageEncodingThe average time duration required to encode a frame of image.
In one embodiment, as shown in fig. 5, the image encoding control device 40 further includes an updating module 404, where the updating module 404 is configured to update the time value of the target time point to the time value of the current time point when the determining module 402 determines that the network delay average value is equal to the preset threshold value.
According to the image coding control device provided by the embodiment of the application, the average value of network time delay of all images transmitted in a preset time period is calculated through the calculation module after the current frame image is transmitted; the determining module judges whether the average network delay value is greater than a preset threshold value or not, and determines the number of lost frames M according to a preset rule when the average network delay value is greater than the preset threshold value; the frame dropping module drops the continuous M frames of images which are not started to be coded currently. The frame loss quantity can be determined once after each frame of image is transmitted, the frame loss quantity can be determined before image coding, and the corresponding quantity of images can be discarded before coding, so that the network pressure can be relieved, the image coding time delay is shortened, the phenomenon of pause in video watching of a user is avoided, and the coding load of a CPU is also reduced.
Referring to fig. 6, an embodiment of the present application further provides an image encoding control apparatus 60, which includes a processor 601 and a memory 602, where the memory 602 stores at least one computer instruction, and the computer instruction is loaded and executed by the processor 601 to implement the image encoding control method described in the embodiment corresponding to fig. 1 or fig. 2.
Based on the image encoding control method described in the embodiment corresponding to fig. 1 and fig. 2, an embodiment of the present application further provides a computer-readable storage medium, for example, the non-transitory computer-readable storage medium may be a Read Only Memory (ROM), a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. The storage medium stores computer instructions for executing the image encoding control method described in the embodiment corresponding to fig. 1 and fig. 2, which is not described herein again.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims (10)

1. A method for controlling encoding of an image, the method comprising:
after the current frame image is transmitted, calculating the average value of network time delay of all images transmitted in a preset time period, wherein the preset time period is the time interval between the current time point and a target time point before the current time point;
judging whether the network delay average value is larger than a preset threshold value or not;
when the network delay average value is larger than the preset threshold value, determining a frame loss number M according to a preset rule, wherein M is an integer;
the consecutive M-frame pictures that are not currently starting to be encoded are discarded.
2. The method of claim 1, wherein the determining the number of lost frames M according to the preset rule comprises:
and determining the number M of lost frames according to the difference between the network delay average value and the preset threshold value.
3. The method of claim 2, wherein determining the number of frames M according to the difference between the network delay average and the preset threshold comprises:
determining a frame loss number M according to a first formula, wherein the first formula is as follows: m ═ [ (T)Average-A)/(tCollecting+tEncoding)]；
Wherein, T isAverageIs the average value of network time delay, A is a preset threshold value, tCollectingAverage duration, t, required for acquiring a frame of imageEncodingThe average time duration required to encode a frame of image.
4. The method of claim 2, wherein determining the number of frames M according to the difference between the network delay average and the preset threshold comprises:
determining the number M of lost frames according to a second formula, wherein the second formula is as follows:
M＝[(Taverage-A)/(tCollecting+tEncoding)]+1；
Wherein, T isAverageIs the average value of network time delay, A is a preset threshold value, tCollectingAverage duration, t, required for acquiring a frame of imageEncodingThe average time duration required to encode a frame of image.
5. The method of claim 1, wherein when the network delay average is determined to be greater than the preset threshold, the method further comprises:
and updating the time value of the target time point to the time value of the current time point.
6. An apparatus for controlling encoding of an image, the apparatus comprising:
the calculation module is used for calculating the network delay average value of all images transmitted in a preset time period after the current frame image is transmitted, wherein the preset time period is a time interval between a current time point and a target time point before the current time point;
the determining module is used for judging whether the network delay average value is larger than a preset threshold value or not, and determining the number of lost frames M according to a preset rule when the network delay average value is larger than the preset threshold value, wherein M is an integer;
and the frame dropping module is used for dropping the continuous M frames of images which are not started to be coded currently.
7. The apparatus of claim 6, wherein the determining module is specifically configured to determine the number of frame losses M according to a difference between the network delay average and the preset threshold.
8. The apparatus of claim 6, further comprising:
and the updating module is used for updating the time value of the target time point to the time value of the current time point when the network delay average value is judged to be larger than the preset threshold value.
9. An image encoding control device, characterized in that the image encoding control device comprises a processor and a memory, wherein the memory stores at least one computer instruction, and the instruction is loaded and executed by the processor to realize the steps executed in the image encoding control method according to any one of claims 1 to 5.
10. A computer-readable storage medium, wherein at least one computer instruction is stored in the storage medium, and the instruction is loaded and executed by a processor to implement the steps executed in the encoding control method of the image according to any one of claims 1 to 5.
CN202010771812.1A 2020-08-04 2020-08-04 Image coding control method, device, equipment and storage medium Active CN112087627B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010771812.1A CN112087627B (en) 2020-08-04 2020-08-04 Image coding control method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010771812.1A CN112087627B (en) 2020-08-04 2020-08-04 Image coding control method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN112087627A true CN112087627A (en) 2020-12-15
CN112087627B CN112087627B (en) 2024-09-17

Family

ID=73736017

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010771812.1A Active CN112087627B (en) 2020-08-04 2020-08-04 Image coding control method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112087627B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112087635A (en) * 2020-08-04 2020-12-15 西安万像电子科技有限公司 Image coding control method, device, equipment and computer readable storage medium
CN113489745A (en) * 2021-07-29 2021-10-08 百果园技术(新加坡)有限公司 Video data transmitting method, device, equipment and storage medium
WO2022267733A1 (en) * 2021-06-25 2022-12-29 荣耀终端有限公司 Method for dynamically adjusting frame-dropping threshold value, and related devices

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5592225A (en) * 1993-09-30 1997-01-07 Matsushita Electric Industrial Co., Ltd. Device and method for controlling coding
US6031584A (en) * 1997-09-26 2000-02-29 Intel Corporation Method for reducing digital video frame frequency while maintaining temporal smoothness
JP2003102011A (en) * 2001-09-21 2003-04-04 Ricoh Co Ltd Image encoder, image decoder, image coding method, image decoding method, program and recording medium
CN101510998A (en) * 2009-02-24 2009-08-19 山东大学 Self-adapting flow control method for data transmission of wireless video monitoring system
CN101715129A (en) * 2009-12-24 2010-05-26 四川长虹电器股份有限公司 Video decoding method
US20130170342A1 (en) * 2011-02-03 2013-07-04 King Saud University Data communication systems and methods
CN104620595A (en) * 2012-10-11 2015-05-13 坦戈迈公司 Proactive video frame dropping
US20160050398A1 (en) * 2014-08-15 2016-02-18 Xiaomi Inc. Method and apparatus for adjusting video quality based on network environment
CN105989844A (en) * 2015-01-29 2016-10-05 中国移动通信集团公司 Audio transmission adaptive method and device
CN106954101A (en) * 2017-04-25 2017-07-14 华南理工大学 The frame losing control method that a kind of low latency real-time video Streaming Media is wirelessly transferred
CN107026856A (en) * 2017-03-30 2017-08-08 上海七牛信息技术有限公司 The optimization method and optimization system of a kind of network plug-flow quality
CN108702511A (en) * 2017-07-28 2018-10-23 深圳市大疆创新科技有限公司 Method, equipment and the system of transmission of video
CN110572695A (en) * 2019-08-07 2019-12-13 苏州科达科技股份有限公司 media data encoding and decoding methods and electronic equipment
US20200042368A1 (en) * 2018-07-31 2020-02-06 International Business Machines Corporation Determining when to send message to a computing node to process items by training a machine learning module

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5592225A (en) * 1993-09-30 1997-01-07 Matsushita Electric Industrial Co., Ltd. Device and method for controlling coding
US6031584A (en) * 1997-09-26 2000-02-29 Intel Corporation Method for reducing digital video frame frequency while maintaining temporal smoothness
JP2003102011A (en) * 2001-09-21 2003-04-04 Ricoh Co Ltd Image encoder, image decoder, image coding method, image decoding method, program and recording medium
CN101510998A (en) * 2009-02-24 2009-08-19 山东大学 Self-adapting flow control method for data transmission of wireless video monitoring system
CN101715129A (en) * 2009-12-24 2010-05-26 四川长虹电器股份有限公司 Video decoding method
US20130170342A1 (en) * 2011-02-03 2013-07-04 King Saud University Data communication systems and methods
CN104620595A (en) * 2012-10-11 2015-05-13 坦戈迈公司 Proactive video frame dropping
US20160050398A1 (en) * 2014-08-15 2016-02-18 Xiaomi Inc. Method and apparatus for adjusting video quality based on network environment
CN105989844A (en) * 2015-01-29 2016-10-05 中国移动通信集团公司 Audio transmission adaptive method and device
CN107026856A (en) * 2017-03-30 2017-08-08 上海七牛信息技术有限公司 The optimization method and optimization system of a kind of network plug-flow quality
CN106954101A (en) * 2017-04-25 2017-07-14 华南理工大学 The frame losing control method that a kind of low latency real-time video Streaming Media is wirelessly transferred
CN108702511A (en) * 2017-07-28 2018-10-23 深圳市大疆创新科技有限公司 Method, equipment and the system of transmission of video
US20200042368A1 (en) * 2018-07-31 2020-02-06 International Business Machines Corporation Determining when to send message to a computing node to process items by training a machine learning module
CN110572695A (en) * 2019-08-07 2019-12-13 苏州科达科技股份有限公司 media data encoding and decoding methods and electronic equipment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
韩军;邵志一;宋海华;: "在低码率信道中提高视频编码质量的方法", 上海大学学报(自然科学版), no. 06, 15 December 2007 (2007-12-15) *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112087635A (en) * 2020-08-04 2020-12-15 西安万像电子科技有限公司 Image coding control method, device, equipment and computer readable storage medium
WO2022267733A1 (en) * 2021-06-25 2022-12-29 荣耀终端有限公司 Method for dynamically adjusting frame-dropping threshold value, and related devices
CN113489745A (en) * 2021-07-29 2021-10-08 百果园技术(新加坡)有限公司 Video data transmitting method, device, equipment and storage medium
CN113489745B (en) * 2021-07-29 2024-04-05 百果园技术(新加坡)有限公司 Video data transmission method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN112087627B (en) 2024-09-17

Similar Documents

Publication Publication Date Title
CN112087627B (en) Image coding control method, device, equipment and storage medium
US11089305B2 (en) Video frame coding method during scene change, terminal and storage medium
CN110913245A (en) Method and device for controlling video transcoding code rate
CN109729353B (en) Video coding method, device, system and medium
CN111263153B (en) Video encoding method, device, equipment and storage medium
CN111741249B (en) Network congestion detection method and device
CN108063973A (en) A kind of method for decoding video stream and equipment
CN114245196B (en) Screen recording and stream pushing method and device, electronic equipment and storage medium
CN110620939B (en) Network state determination method and device, electronic equipment and storage medium
CN111617466A (en) Method and device for determining coding format and method for realizing cloud game
CN109218722B (en) Video coding method, device and equipment
CN107566795A (en) A kind of method, apparatus and system for improving real-time pictures fluency
CN112689148B (en) Method, system and storage medium for peak value removal of multi-layer video transmission in cloud conference
CN113573142A (en) Resolution adjustment method and device
CN112087635A (en) Image coding control method, device, equipment and computer readable storage medium
CN114513651A (en) Video equipment key frame collision detection method, data transmission method and related device
CN114793299B (en) Streaming media transmission control method, system, equipment and medium
CN112511702B (en) Media frame pushing method, server, electronic equipment and storage medium
CN113194340B (en) Video transmission adjusting method and device
CN113473125B (en) Code rate control method, equipment, storage medium and product
CN111954001A (en) Image coding method, device, coding end equipment and storage medium
CN114302142A (en) Video encoding method, image transmission apparatus, and storage medium
CN111953978A (en) Frame rate control method, device and storage medium
CN115514916B (en) Image group processing method and device, communication device and storage medium
CN115103235B (en) Data transmission method, device, equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant