CN114302140B - Pre-frame-loss method, system, equipment and computer readable storage medium - Google Patents
Pre-frame-loss method, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN114302140B CN114302140B CN202111442558.1A CN202111442558A CN114302140B CN 114302140 B CN114302140 B CN 114302140B CN 202111442558 A CN202111442558 A CN 202111442558A CN 114302140 B CN114302140 B CN 114302140B
- Authority
- CN
- China
- Prior art keywords
- frame
- image
- compression engine
- storage module
- compressed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 230000006835 compression Effects 0.000 claims abstract description 140
- 238000007906 compression Methods 0.000 claims abstract description 140
- 238000004364 calculation method Methods 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 9
- 230000001960 triggered effect Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 4
- 230000000903 blocking effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Abstract
The application discloses a method, a system, equipment and a computer readable storage medium for pre-frame loss, which ensure that the frame number of the interval between the preset image frames to be compressed obtained by a compression engine from a first storage module is fixed due to the fact that the current frame loss ratio is determined, so that the condition that the frame number interval between two frame images processed by the compression engine is overlarge in the prior art is avoided, and the continuity of the image frames output by the compression engine is ensured. In addition, when all the image frames to be compressed stored in the first storage module are compressed and the compression engine is idle, uncompressed image frames to be discarded stored in the second storage module are sent to the compression engine, so that the compression engine is prevented from being in an idle state for a long time when all the image frames to be compressed stored in the first storage module are compressed, the utilization efficiency of the compression engine is improved, and the continuity of images output by the compression engine is further improved.
Description
Technical Field
The present application relates to the field of image processing, and in particular, to a method, system, device, and computer readable storage medium for pre-frame loss.
Background
In managing the remote server, the remote server compresses and transmits the interface of the remote server to the local, and in order to reduce the amount of data transmitted to the local, the remote server typically discards some image frames in the captured original image. In the prior art, when a compression engine of a remote server compresses a current frame image, the remote server discards an original image captured during the compression of the current frame image by the compression engine, and after the compression engine compresses the current frame image, the compression engine sends a captured next frame original image to the compression engine for compression, so that the frame number interval between two frame images compressed by the compression engine is too large, and the images are discontinuous.
Disclosure of Invention
The application aims to provide a pre-frame-loss method, a system, equipment and a computer readable storage medium, which can not generate the situation that the frame number interval between two frames of images processed by a compression engine is overlarge in the prior art, ensure the continuity of image frames output by the compression engine and improve the utilization efficiency of the compression engine.
In order to solve the technical problems, the present application provides a method for pre-frame loss, comprising:
determining an image frame according to the received original image;
storing the image frames to be compressed in a first storage module when determining the current frame loss ratio and determining the image frames to be compressed as preset image frames to be compressed according to the current frame loss ratio, and storing the image frames to be discarded in a second storage module when determining the image frames to be discarded as preset image frames to be discarded according to the current frame loss ratio, wherein the current frame loss ratio is the ratio of the number of frames of all preset image frames to the number of frames of the preset image frames to be compressed;
judging whether uncompressed image frames to be compressed are stored in the first storage module or not when the compression engine is idle;
if yes, the uncompressed image frame with the earliest time in the first storage module and preset to be compressed is sent to a compression engine;
if the image frames are not stored, judging whether uncompressed preset image frames to be discarded exist in the second storage module after the image frames which are finally sent to the compression engine in the first storage module;
if so, the uncompressed preset image frame to be discarded, which is the earliest in time after the image frame finally sent to the compression engine in the first storage module, is sent to the compression engine.
Preferably, determining the image frame from the received original image includes:
and determining the image frame according to the frame head and the frame tail of the original image.
Preferably, the method further comprises:
judging whether the compression engine is in an idle state or not when the current frame loss ratio is not determined;
if yes, determining the image frame as an image frame to be compressed in advance and storing the image frame to be compressed in the first storage module;
if not, determining the image frame as the image frame to be discarded in a preset mode and storing the image frame to be discarded in the second storage module.
Preferably, determining the current frame loss ratio includes:
determining a first frame number of an image frame determined according to a received original image and a second frame number of the image frame sent to the compression engine in a current calculation period, wherein the current calculation period is a preset time period not later than the current time;
and calculating the ratio of the first frame number to the second frame number as the current frame loss ratio.
Preferably, the cut-off time of the current computing period is the current time.
Preferably, determining a first frame number of image frames determined from the received original image and a second frame number of image frames transmitted to the compression engine in the current calculation period includes:
determining the number of frame tails of the image frames determined according to the received original image in the current calculation period as the first frame number;
and determining the number of frame tails of the image frames sent to the compression engine as the second frame number.
Preferably, determining the current frame loss ratio includes:
and when receiving a frame loss ratio instruction input by a user, determining the current frame loss ratio according to the frame loss ratio instruction.
The application also provides a pre-frame loss system, which comprises:
an image frame determining unit for determining an image frame from the received original image;
an image frame storage selection unit, configured to store an image frame to be compressed in advance into a first storage module when determining a current frame loss ratio and determining that the image frame is an image frame to be compressed in advance according to the current frame loss ratio, and store the image frame to be discarded in advance into a second storage module when determining that the image frame is an image frame to be discarded in advance according to the current frame loss ratio, where the current frame loss ratio is a ratio of a number of frames of all image frames to a number of frames of the image frame to be compressed in advance;
the first storage module searching unit is used for judging whether uncompressed image frames to be compressed preset exist in the first storage module when the compression engine is idle, if so, triggering the image frame transmitting unit to be compressed preset, and if not, triggering the second storage module searching unit;
the image frame sending unit is used for sending the uncompressed image frame to be compressed, which is the earliest in time, in the first storage module to a compression engine;
the second storage module searching unit is used for judging whether an uncompressed preset image frame to be discarded exists in the second storage module after the image frame which is finally sent to the compression engine in the first storage module, and if so, the preset image frame to be discarded sending unit is triggered;
the image frame sending unit is configured to send an uncompressed image frame to be discarded, which is the earliest in time after the image frame to be discarded is finally sent to the compression engine in the first storage module, to the compression engine.
The application also provides a pre-frame loss device, which comprises:
a memory for storing a computer program;
and the processor is used for realizing the steps of the pre-frame loss method when executing the computer program.
The present application also provides a computer readable storage medium having stored thereon a computer program which when executed by a processor implements the steps of the pre-frame dropping method as described above.
The application provides a method, a system, equipment and a computer readable storage medium for pre-frame loss, which ensure that the frame number of the interval between the preset image frames to be compressed obtained by a compression engine from a first storage module is fixed due to the fact that the current frame loss ratio is determined, so that the condition that the frame number interval between two frame images processed by the compression engine is overlarge in the prior art is avoided, and the continuity of the image frames output by the compression engine is ensured. In addition, when all the image frames to be compressed stored in the first storage module are compressed and the compression engine is idle, uncompressed image frames to be discarded stored in the second storage module are sent to the compression engine, so that the compression engine is prevented from being in an idle state for a long time when all the image frames to be compressed stored in the first storage module are compressed, the utilization efficiency of the compression engine is improved, and the continuity of images output by the compression engine is further improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required in the prior art and the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of a method for pre-dropping frames according to the present application;
fig. 2 is a schematic structural diagram of a pre-frame-loss system according to the present application;
fig. 3 is a schematic structural diagram of a pre-frame-loss device provided by the present application.
Detailed Description
The core of the application is to provide a pre-frame-loss method, a system, equipment and a computer readable storage medium, which can not generate the condition that the frame number interval between two frames of images processed by a compression engine in the prior art is overlarge, ensure the continuity of image frames output by the compression engine and improve the utilization efficiency of the compression engine.
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Referring to fig. 1 in detail, fig. 1 is a flowchart of a method for pre-dropping frames according to the present application.
The pre-frame loss method comprises the following steps:
s11, determining an image frame according to the received original image;
in managing the remote server, it is necessary to view the interface of the remote server, and thus it is necessary to transmit the interface of the remote server to the local, and before transmitting the interface of the remote server to the local, it is necessary to compress the original image of the interface of the remote server with a compression engine, considering that the original image of the interface of the remote server is mixed together by a plurality of continuous frame images, and the compression engine compresses the images frame by frame when compressing the images, so in this embodiment, it is necessary to determine the image frame from the original image mixed together by the continuous frame images, so that the subsequent compression engine compresses the image frame.
S12, when the current frame loss ratio is determined and the image frame is determined to be the image frame to be compressed in advance according to the current frame loss ratio, storing the image frame to be compressed in advance into a first storage module, and when the image frame is determined to be the image frame to be discarded in advance according to the current frame loss ratio, storing the image frame to be discarded in advance into a second storage module, wherein the current frame loss ratio is the ratio of the number of frames of all the image frames to the number of frames of the image frame to be compressed in advance;
in the prior art, compressed image frames are determined according to the state of a compression engine, and excessive number of frames of intervals between two image frames continuously output by the compression engine is easy to occur. For example, after the first frame image frame is determined according to the received original image, the first frame image frame is sent to the compression engine for compression, while during the period that the compression engine compresses the first frame image, if the second frame image frame to the tenth frame image frame are determined according to the received original image, the second frame image frame to the tenth frame image frame are discarded in the prior art, after the first frame image frame is compressed, if the eleventh frame image frame is determined according to the received original image, the compression engine directly compresses the eleventh frame image frame, so that the compression engine directly outputs the eleventh frame image after the first frame image frame is output, and nine frame images are absent in the middle, which results in poor continuity and blocking of the output image.
In the application, after the received original image determines the image frame, the image frame is judged to be the image frame to be compressed or the image frame to be discarded according to the current frame loss ratio, if the image frame is the image frame to be compressed, the image frame is stored in the first storage module, and if the image frame is the image frame to be discarded, the image frame is stored in the second storage module. For example, when the frame loss ratio is 2 to 1, two image frames are determined according to the received original image, 1 frame of the two image frames is stored as a preset image frame to be compressed in the first storage module so that the compression engine compresses the preset image frame to be compressed, and the other 1 frame of the two image frames is stored as the preset image frame to be discarded in the second storage module so as to be distinguished from the preset image frame to be compressed. Because the current frame loss ratio is determined, in the application, the preset interval frame number between the image frames to be compressed is determined by the current frame loss ratio, rather than by judging the state of the compression engine, so that the condition that the interval frame number between two image frames is large is avoided, and the continuity of the image output by the compression engine is improved. The current frame loss ratio herein may be, but is not limited to, a technician based on a determined speed of the image frames and a compression speed of the compression engine.
S13, judging whether uncompressed image frames to be compressed are stored in the first storage module when the compression engine is idle;
s14, if yes, the uncompressed image frame which is preset to be compressed and is the earliest in time in the first storage module is sent to a compression engine;
s15, if the image frames are not stored, judging whether uncompressed preset image frames to be discarded exist in the second storage module after the image frames which are finally sent to the compression engine in the first storage module;
and S16, if the image frames exist, the uncompressed preset image frames to be discarded, which are the earliest in time after the image frames finally sent to the compression engine in the first storage module, are sent to the compression engine.
When the compression engine is idle, that is, when the compression engine is not currently compressing an image frame, because the image frame to be compressed is stored in the first storage module, in order to ensure the continuity of images, the image frame to be compressed needs to be sent to the compression engine to be compressed first, so in this embodiment, it is determined whether an uncompressed image frame to be compressed is stored in the first storage module, if the uncompressed image frame to be compressed is stored in the first storage module, the uncompressed image frame to be compressed with the earliest time is selected from all the uncompressed image frames to be compressed, and the image frame to be compressed is sent to the compression engine to be compressed.
Considering that in some cases, the time for compressing an image frame by the compression engine may be shorter than the time for determining an image frame according to the received original image, in this case, the preset image frame to be compressed stored in the first storage module is already compressed by the compression engine, and the compression engine enters an idle state until the preset image to be compressed of the next frame is obtained, which greatly reduces the utilization efficiency of the compression engine. In order to solve the above-mentioned problem, in this embodiment, when the compression engine is idle, the first storage module does not store the uncompressed preset image frame to be compressed, and then it is determined whether the second storage module stores the uncompressed preset image frame to be discarded after the image frame last sent to the compression engine in the first storage module. If so, the uncompressed preset image frame to be discarded, which is the earliest in time after the image frame last sent to the compression engine in the first storage module, is sent to the compression engine.
For example, when the current frame loss ratio is 3 to 1, if the 6-frame image frame is determined according to the received original image, the 1 st and 4 th frames are stored in the first storage module, the 2 nd, 3 rd, 5 th and 6 th frames are stored in the second storage module, and because the 1 st and 4 th frames are preset image frames to be compressed, the 1 st and 4 th frames are sent to the compression engine to be compressed first, after the 4 th frame is compressed, if the next preset image frame to be compressed, namely the 7 th frame, is not received yet, it is determined whether the uncompressed preset image frame to be discarded is present in the second storage module after the last image frame sent to the compression engine in the first storage module, namely whether the image frame after the 4 th frame is present in the second storage module, namely the 5 th and 6 th image frames, and then the earliest time in the image frames are sent to the compression engine to be compressed, namely the 5 th image frame is sent to the compression engine to be compressed. Therefore, in this embodiment, since the second storage module is configured to store the image frames to be discarded, and when all the image frames to be compressed preset in the first storage module are compressed, the image frames to be discarded with the preset band are sent to the compression engine to be compressed, so that the idle time of the compression engine is shortened, the utilization efficiency of the compression engine is improved, and in addition, since the image frames to be discarded are sent to the compression engine, the compression engine compresses the image frames to be discarded preset in addition to all the image frames to be compressed preset band, and the continuity of the image frames output by the compression engine is further improved. In addition, there is no sequence of the two parts S11 to S12 and S13 to S15, and the speed at which the compression engine compresses the image frame may be greater than or equal to the speed at which the image frame is determined from the original image. The compression engine herein may be, but is not limited to, a JPEG (Joint Photographic Experts Group, joint image experts group) compression engine.
In summary, in this embodiment, by determining the current frame loss ratio, the number of frames of the interval between the preset image frames to be compressed, which are acquired by the compression engine from the first storage module, is fixed, so that the continuity of the image frames output by the compression engine is ensured. In addition, when all the image frames to be compressed stored in the first storage module are compressed and the compression engine is idle, uncompressed image frames to be discarded stored in the second storage module are sent to the compression engine, so that the compression engine is prevented from being in an idle state for a long time when all the image frames to be compressed stored in the first storage module are compressed, the utilization efficiency of the compression engine is improved, and the continuity of the image frames output by the compression engine is further improved.
Based on the above embodiments:
as a preferred embodiment, determining an image frame from the received original image includes:
the image frames are determined from the frame header and frame trailer of the original image.
In order to extract each image frame image from the original image in which a plurality of frame image frames are mixed, in this embodiment, the image frames are determined according to the frame header and the frame tail of the original image, so that the image data of each frame image frame can be accurately extracted, and the implementation is relatively simple.
As a preferred embodiment, further comprising:
judging whether the compression engine is in an idle state or not when the current frame loss ratio is not determined;
if yes, determining the image frame as the image frame to be compressed in advance and storing the image frame to be compressed in the first storage module;
if not, the image frame is determined to be the image frame to be discarded in advance, and the image frame to be discarded in advance is stored in the second storage module.
Considering that when capturing an interface of a remote server is just started, that is, when an image frame is determined according to the frame head and the frame tail of an original image, since the compression engine has not compressed a certain number of image frames at this time, it is difficult for a technician to obtain a current frame loss ratio according to the determination speed of the image frame and the compression speed of the compression engine, in this embodiment, compression is performed based on the state of the compression engine when the current frame loss ratio is not determined. If the compression engine is not performing image compression, i.e. in an idle state, the next frame of image frame is indicated to be sent to the compression engine for compression, so that the image frame is determined to be the image frame to be compressed in advance and the image frame to be compressed in advance is stored in the first storage module, and if the compression engine is performing image compression, i.e. in a busy state, the next frame of image frame is indicated to be discarded, so that the image frame is determined to be the image frame to be discarded in advance and the image frame to be discarded in advance is stored in the second storage module. When the current frame loss ratio cannot be determined, whether the image frames are compressed or not is selected according to the state of the compression engine, all the image frames are prevented from being sent to the compression engine and sent to the local after being compressed, and the data size sent to the local is reduced. As a preferred embodiment, determining the current frame loss ratio includes:
determining a first frame number of an image frame determined according to a received original image and a second frame number of the image frame sent to a compression engine in a current calculation period, wherein the current calculation period is a preset time period not later than the current time;
and calculating the ratio of the first frame number to the second frame number as the current frame loss ratio.
Considering that if the current frame loss ratio is too large, that is, the image frames stored in the second storage module are too many, the continuity of the image frames output by the compression engine is poor, if the current frame loss ratio is too small, that is, the image frames stored in the first storage module are too many, the number of frames of the image frames obtained by compression of the compression engine is too many, the amount of data transmitted to the local area is too large, and the first storage module is possibly full, so that new preset image frames to be compressed cannot be stored continuously. Therefore, an appropriate current frame loss ratio needs to be determined, in this embodiment, by calculating, as the current frame loss ratio, a ratio of a first frame number of an image frame determined according to a received original image in a current calculation period to a second frame number of an image frame sent to a compression engine in the current calculation period, that is, determining the current frame loss ratio by determining a speed of the image frame according to the original image and a speed of the compression engine compression image frame in the same period, fully considering performance of the compression engine in the current calculation period and determining the speed of the image frame according to the original image, predicting the most appropriate current frame loss ratio at the current time by referring to an image processing condition in the current calculation period, so that the current frame loss ratio is neither too large nor too small.
It should be noted that when the new current frame loss ratio is different from the previous current frame loss ratio, if the current frame loss ratio is in a frame loss period of the current frame loss ratio, the frame loss period is processed first, and then the frame loss is performed with the new current frame loss ratio, that is, whether the image frame is the image frame to be compressed or the image frame to be discarded is determined according to the current frame loss ratio. One frame loss period refers to processing all preset image frames according to the current frame loss ratio. For example, when the current frame loss ratio is 3 to 1, every 3 frames is a frame loss period; when the current frame loss ratio is 4 to 1, every 4 frames are one frame loss period.
As a preferred embodiment, the expiration time of the current calculation period is the current time.
In this embodiment, the cut-off time of the current calculation period is the current time, that is, the current frame loss ratio is calculated through the image frame processing condition in the time period closest to the current time, so that the obtained current frame loss ratio is more accurate.
As a preferred embodiment, determining a first number of image frames determined from a received original image and a second number of image frames sent to a compression engine in a current calculation period includes:
determining the number of frame tails of image frames determined according to the received original image in a current calculation period as a first frame number;
the number of frame tails of the image frames sent to the compression engine is determined to be a second number of frames.
In the present embodiment, the number of frames of each image frame can be accurately determined and the implementation is relatively simple by determining the number of frames of the image frame determined from the received original image and the number of frames of the image frame transmitted to the compression engine by the number of frame tails.
As a preferred embodiment, determining the current frame loss ratio includes:
and when receiving a frame loss ratio instruction input by a user, determining the current frame loss ratio according to the frame loss ratio instruction.
In this embodiment, the current frame loss ratio is determined according to the input frame loss ratio instruction of the user, so that the user can input the current frame loss ratio according to the actual needs of the user, and when the user needs more continuous images, the current frame loss ratio can be input to make the discarded image frames less.
Referring to fig. 2 specifically, fig. 2 is a schematic structural diagram of a pre-frame loss system according to the present application.
The application also provides a pre-frame loss system, which comprises:
an image frame determining unit 21 for determining an image frame from the received original image;
an image frame storage selection unit 22, configured to store an image frame to be compressed in advance into the first storage module when determining a current frame loss ratio and determining that the image frame is an image frame to be compressed in advance according to the current frame loss ratio, and store the image frame to be discarded in advance into the second storage module when determining that the image frame is an image frame to be discarded in advance according to the current frame loss ratio, where the current frame loss ratio is a ratio of a number of frames of all image frames to a number of frames of the image frame to be compressed in advance;
a first storage module retrieving unit 23, configured to determine whether an uncompressed preset image frame to be compressed exists in the first storage module when the compression engine is idle, if so, trigger the preset image frame to be compressed transmitting unit 24, and if not, trigger the second storage module retrieving unit 25;
a preset image frame to be compressed transmitting unit 24, configured to transmit an uncompressed preset image frame to be compressed with the earliest time in the first storage module to the compression engine;
a second storage module retrieving unit 25, configured to determine whether an uncompressed preset image frame to be discarded exists in the second storage module after the image frame last sent to the compression engine in the first storage module, and if so, trigger the preset image frame to be discarded sending unit 26;
the preset image frame to be discarded transmitting unit 26 is configured to transmit, to the compression engine, an uncompressed preset image frame to be discarded having the earliest time after the image frame last transmitted to the compression engine in the first storage module.
For a related description of the pre-lost frame system, please refer to the above embodiment, and the disclosure is not repeated here.
Referring to fig. 3 specifically, fig. 3 is a schematic structural diagram of a frame loss device according to the present application.
The application also provides a pre-frame loss device, which comprises:
a memory 31 for storing a computer program;
a processor 32 for implementing the steps of the pre-frame dropping method as described above when executing the computer program.
For a related description of the pre-lost frame device, please refer to the above embodiment, and the disclosure is not repeated here.
The application also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of the pre-frame-loss method described above.
For a related description of the computer-readable storage medium, please refer to the above embodiment, the disclosure is not repeated here.
In the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, and identical and similar parts between the embodiments are all enough to refer to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section.
It should also be noted that in this specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. The method for pre-frame loss is characterized by comprising the following steps:
determining an image frame according to the received original image;
storing the image frames to be compressed in a first storage module when determining the current frame loss ratio and determining the image frames to be compressed as preset image frames to be compressed according to the current frame loss ratio, and storing the image frames to be discarded in a second storage module when determining the image frames to be discarded as preset image frames to be discarded according to the current frame loss ratio, wherein the current frame loss ratio is the ratio of the number of frames of all preset image frames to the number of frames of the preset image frames to be compressed;
judging whether uncompressed image frames to be compressed are stored in the first storage module or not when the compression engine is idle;
if yes, the uncompressed image frame with the earliest time in the first storage module and preset to be compressed is sent to a compression engine;
if the image frames are not stored, judging whether uncompressed preset image frames to be discarded exist in the second storage module after the image frames which are finally sent to the compression engine in the first storage module;
if so, the uncompressed preset image frame to be discarded, which is the earliest in time after the image frame finally sent to the compression engine in the first storage module, is sent to the compression engine.
2. The method of pre-frame loss as set forth in claim 1, wherein determining an image frame from the received original image includes:
and determining the image frame according to the frame head and the frame tail of the original image.
3. The pre-frame loss method of claim 1, further comprising:
judging whether the compression engine is in an idle state or not when the current frame loss ratio is not determined;
if yes, determining the image frame as an image frame to be compressed in advance and storing the image frame to be compressed in the first storage module;
if not, determining the image frame as the image frame to be discarded in a preset mode and storing the image frame to be discarded in the second storage module.
4. A method of pre-frame loss as claimed in any one of claims 1 to 3, wherein determining the current frame loss ratio comprises:
determining a first frame number of an image frame determined according to a received original image and a second frame number of the image frame sent to the compression engine in a current calculation period, wherein the current calculation period is a preset time period not later than the current time;
and calculating the ratio of the first frame number to the second frame number as the current frame loss ratio.
5. The method of pre-lost frames according to claim 4, wherein the expiration time of the current calculation period is the current time.
6. The method of pre-dropping frames of claim 4, wherein determining a first number of image frames determined from the received original image and a second number of image frames sent to the compression engine in the current calculation period comprises:
determining the number of frame tails of the image frames determined according to the received original image in the current calculation period as the first frame number;
and determining the number of frame tails of the image frames sent to the compression engine as the second frame number.
7. A method of pre-frame loss as claimed in any one of claims 1 to 3, wherein determining the current frame loss ratio comprises:
and when receiving a frame loss ratio instruction input by a user, determining the current frame loss ratio according to the frame loss ratio instruction.
8. A pre-lost frame system, comprising:
an image frame determining unit for determining an image frame from the received original image;
an image frame storage selection unit, configured to store an image frame to be compressed in advance into a first storage module when determining a current frame loss ratio and determining that the image frame is an image frame to be compressed in advance according to the current frame loss ratio, and store the image frame to be discarded in advance into a second storage module when determining that the image frame is an image frame to be discarded in advance according to the current frame loss ratio, where the current frame loss ratio is a ratio of a number of frames of all image frames to a number of frames of the image frame to be compressed in advance;
the first storage module searching unit is used for judging whether uncompressed image frames to be compressed preset exist in the first storage module when the compression engine is idle, if so, triggering the image frame transmitting unit to be compressed preset, and if not, triggering the second storage module searching unit;
the image frame sending unit is used for sending the uncompressed image frame to be compressed, which is the earliest in time, in the first storage module to a compression engine;
the second storage module searching unit is used for judging whether an uncompressed preset image frame to be discarded exists in the second storage module after the image frame which is finally sent to the compression engine in the first storage module, and if so, the preset image frame to be discarded sending unit is triggered;
the image frame sending unit is configured to send an uncompressed image frame to be discarded, which is the earliest in time after the image frame to be discarded is finally sent to the compression engine in the first storage module, to the compression engine.
9. A pre-lost frame device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the pre-frame loss method according to any of claims 1 to 7 when executing said computer program.
10. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the pre-frame dropping method according to any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111442558.1A CN114302140B (en) | 2021-11-30 | 2021-11-30 | Pre-frame-loss method, system, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111442558.1A CN114302140B (en) | 2021-11-30 | 2021-11-30 | Pre-frame-loss method, system, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114302140A CN114302140A (en) | 2022-04-08 |
| CN114302140B true CN114302140B (en) | 2023-11-03 |
Family
ID=80964943
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111442558.1A Active CN114302140B (en) | 2021-11-30 | 2021-11-30 | Pre-frame-loss method, system, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114302140B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115633181B (en) * | 2022-12-06 | 2023-03-17 | 山东云海国创云计算装备产业创新中心有限公司 | Picture processing method, system, device, image compression device and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20020058635A (en) * | 2000-12-30 | 2002-07-12 | 오길록 | Bandwidth Adaptation Transcording Method using Frame Dropping Ratio |
| CN101159862A (en) * | 2007-11-29 | 2008-04-09 | 北京中星微电子有限公司 | Frame rate control method and device |
| WO2014038927A1 (en) * | 2012-09-10 | 2014-03-13 | Mimos Berhad | Load balancing of graphics processing units in an image processing system |
| EP2757793A1 (en) * | 2013-01-22 | 2014-07-23 | ViXS Systems Inc. | Video processor with frame buffer compression and methods for use therewith |
| WO2017128314A1 (en) * | 2016-01-29 | 2017-08-03 | 深圳市大疆创新科技有限公司 | Method, system and device for video data transmission, and photographic apparatus |
| CN111277836A (en) * | 2020-01-19 | 2020-06-12 | 苏州浪潮智能科技有限公司 | Video extraction frame loss control method, system, terminal and storage medium |
| CN111970518A (en) * | 2020-08-14 | 2020-11-20 | 山东云海国创云计算装备产业创新中心有限公司 | Image frame loss processing method, system, equipment and computer storage medium |
| CN112087635A (en) * | 2020-08-04 | 2020-12-15 | 西安万像电子科技有限公司 | Image coding control method, device, equipment and computer readable storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4616765B2 (en) * | 2005-12-15 | 2011-01-19 | 富士通株式会社 | Video encoding device |
| US8699808B2 (en) * | 2007-10-15 | 2014-04-15 | Chih-Ta Star Sung | Method and apparatus of temporary image frame compression |
-
2021
- 2021-11-30 CN CN202111442558.1A patent/CN114302140B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20020058635A (en) * | 2000-12-30 | 2002-07-12 | 오길록 | Bandwidth Adaptation Transcording Method using Frame Dropping Ratio |
| CN101159862A (en) * | 2007-11-29 | 2008-04-09 | 北京中星微电子有限公司 | Frame rate control method and device |
| WO2014038927A1 (en) * | 2012-09-10 | 2014-03-13 | Mimos Berhad | Load balancing of graphics processing units in an image processing system |
| EP2757793A1 (en) * | 2013-01-22 | 2014-07-23 | ViXS Systems Inc. | Video processor with frame buffer compression and methods for use therewith |
| WO2017128314A1 (en) * | 2016-01-29 | 2017-08-03 | 深圳市大疆创新科技有限公司 | Method, system and device for video data transmission, and photographic apparatus |
| CN111277836A (en) * | 2020-01-19 | 2020-06-12 | 苏州浪潮智能科技有限公司 | Video extraction frame loss control method, system, terminal and storage medium |
| CN112087635A (en) * | 2020-08-04 | 2020-12-15 | 西安万像电子科技有限公司 | Image coding control method, device, equipment and computer readable storage medium |
| CN111970518A (en) * | 2020-08-14 | 2020-11-20 | 山东云海国创云计算装备产业创新中心有限公司 | Image frame loss processing method, system, equipment and computer storage medium |
Non-Patent Citations (1)
| Title |
|---|
| Non-EE2: Low-Complexity Improvements of Intra Coding for Screen Content;Damian Ruiz Coll等;《Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29 24th Meeting, by teleconference, 6–15 October 2021, Document: JVET-X0131-v2》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114302140A (en) | 2022-04-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7877777B2 (en) | Network camera apparatus and distributing method of video frames | |
| CN111432169B (en) | Video transmission method, device, equipment and system | |
| EP1835391A2 (en) | Storage apparatus and method for processing in the same | |
| CN114302140B (en) | Pre-frame-loss method, system, equipment and computer readable storage medium | |
| CN111263153B (en) | Video encoding method, device, equipment and storage medium | |
| CN111726657A (en) | Live video playing processing method and device and server | |
| CN116684659A (en) | Video output control module, method, equipment and server of BMC chip | |
| CN113873255A (en) | Video data transmission method, video data decoding method and related devices | |
| US10044833B2 (en) | Data processing method and apparatus used for terminal application | |
| CN109151245B (en) | Image data transmission method and system based on FPGA, storage medium and FPGA | |
| WO2013143250A1 (en) | Image compression method, apparatus and device | |
| CN115604052B (en) | Vehicle communication interaction method and system and electronic equipment | |
| CN114116234B (en) | Three-dimensional scene model decompression loading method based on browser | |
| TWI680668B (en) | Screen image transmission method, image restoration method, screen image transmission system, image restoration system, screen image transmission program, image restoration program, image compression method, image compression system, and image compression program | |
| CN110868373A (en) | Multimedia data transmission method, device and computer readable storage medium | |
| CN114567787A (en) | Video compression method, system and related device applied to BMC | |
| CN115633181B (en) | Picture processing method, system, device, image compression device and storage medium | |
| CN111669431B (en) | Message transmission method and device, computer equipment and storage medium | |
| CN112073747A (en) | Streaming media data preview method, user end equipment and relay server | |
| CN112422618A (en) | Position sensing data reporting method, device and system | |
| CN115037741B (en) | File transmission method and device | |
| CN110958433B (en) | Image uploading method, monitoring device, electronic equipment and storage medium | |
| CN109672923B (en) | Data processing method and device | |
| CN113704652B (en) | Data processing method, device, transfer station and data processing system | |
| CN114785456A (en) | Data transmission method and device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |