CN117082194B

CN117082194B - Video image processing method, device, system, electronic equipment and storage medium

Info

Publication number: CN117082194B
Application number: CN202311338034.7A
Authority: CN
Inventors: 刘家豪
Original assignee: Suzhou Metabrain Intelligent Technology Co Ltd
Current assignee: Suzhou Metabrain Intelligent Technology Co Ltd
Priority date: 2023-10-16
Filing date: 2023-10-16
Publication date: 2024-02-20
Anticipated expiration: 2043-10-16
Also published as: CN117082194A

Abstract

The application provides a video image processing method, a video image processing device, a video image processing system, electronic equipment and a storage medium. The method comprises the following steps: when the back-end module needs to read the image data from the memory, a current memory writing area is obtained, wherein the current memory writing area is a writing position when the front-end module writes the image data into the memory at the moment; determining a memory area to be read according to the current memory writing area by a preset reading judgment condition; and reading the image data from the memory through the back-end module according to the memory area to be read. Because the image data is read after being cached in the memory, the operation speed of the front end module and the back end module can not influence the normal transmission of the image data, the image processing modules of the front end module and the back end module are not limited by the output frame frequency and the input frame frequency, and the application range of the image transmission is enlarged.

Description

Video image processing method, device, system, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a video image processing method, apparatus, system, electronic device, and non-volatile readable storage medium.

Background

Image data in video often requires that the image data flow from one processing module to another, achieving a multiprocessing effect on the image data. However, in this image data transmission method, the operation rates or frame rates of the front and rear modules are required to be consistent, and when there is a difference between the operation rates or frame rates of the front and rear modules, the image data transmission effect is poor.

Disclosure of Invention

The application provides a video image processing method, a video image processing device, a video image processing system, electronic equipment and a non-volatile readable storage medium. Compared with the prior art, the method for analyzing and processing the adjacent frames or similar data is needed to discard, the front-end module and the back-end module with different running speeds can be connected without any analysis and processing on the image data, the image transmission is simple and reliable, the universality is high, and the problems that the front-end module and the back-end module are difficult to match and the transmission effect is poor in the prior art are solved.

In a first aspect, the present application provides a video image processing method, including:

acquiring a writing area reference condition of a front-end module, wherein the front-end module is used for writing image data into a memory;

acquiring a read area reference condition of a back-end module, wherein the back-end module is used for reading the image data from the memory;

Judging according to the writing area reference condition, the reading area reference condition and a preset reading and writing reference judgment condition to obtain a reference condition judgment result;

and when the reference condition judgment result is that the read area reference condition is that the back-end module determines the memory read area according to the current memory write area of the front-end module, the back-end module reads the image data from the memory.

Optionally, the video image processing method provided in the present application further includes:

when the back-end module needs to read the image data from the memory, a current memory writing area is obtained, wherein the current memory writing area is a writing position when the front-end module writes the image data into the memory at the moment;

determining a memory area to be read according to the current memory writing area by a preset reading judgment condition;

and reading the image data from the memory through the back-end module according to the memory area to be read.

comparing the output frame frequency of the front end module with the input frame frequency of the rear end module to obtain a frame frequency comparison result;

And when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, determining the memory area to be read according to the current memory writing area, wherein the current memory writing area is the same as the memory area to be read.

Optionally, the memory includes a multi-frame storage space, and the front-end module cyclically writes the image data into the memory according to a fixed sequence, and the video image processing method provided by the application further includes:

and when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, determining the memory area to be read according to the current memory writing area, wherein the current memory writing area and the memory area to be read are the same frame storage space of the memory.

and when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, determining the memory area to be read according to the current memory writing area, wherein the current memory writing area and the memory area to be read are different.

And when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, determining the memory area to be read according to the current memory writing area, wherein the memory area to be read is the storage space of the last frame of the current memory writing area.

and when the reference condition judgment result is that the writing area reference condition is that the front-end module determines the memory writing area according to the current memory reading area of the back-end module, writing the image data into the memory through the front-end module.

when the front-end module needs to write the image data into the memory, a current memory reading area is obtained, wherein the current memory reading area is a reading position when the back-end module reads the image data from the memory at the moment;

determining a memory area to be written according to the current memory reading area by a preset writing judgment condition;

and writing image data into the memory through the front-end module according to the memory writing area.

and when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, determining the memory writing-in area according to the current memory reading area, wherein the current memory reading area and the memory writing-in area are different.

Optionally, the memory includes a multi-frame storage space, and the back-end module circularly reads the image data from the memory according to a fixed sequence, and the video image processing method provided by the application further includes:

and when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, determining the memory writing-in area according to the current memory reading area, wherein the memory writing-in area is the next frame storage space of the current memory reading area.

and when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, determining the memory writing-in area according to the current memory reading area, wherein the current memory reading area is the same as the memory writing-in area.

and when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, determining the memory writing-in area according to the current memory reading area, wherein the current memory reading area and the memory writing-in area are the same frame storage space of the memory.

when the reference condition judgment result is that the writing area reference condition is that the front end module determines a memory writing area to be written according to the current memory writing area of the back end module and the back end module determines a memory reading area to be read according to the current memory writing area of the front end module, writing the image data into the memory through the front end module, and reading the image data from the memory through the back end module.

reading image data from the memory through the back-end module according to the memory area to be read;

Optionally, the memory includes a multi-frame storage space, and the video image processing method provided in the application further includes:

In a second aspect, the present application provides a video image processing apparatus, comprising:

the writing area reference condition acquisition module is used for acquiring writing area reference conditions of the front end module, wherein the front end module is used for writing image data into the memory;

the read area reference condition acquisition module is used for acquiring the read area reference condition of the back-end module, wherein the back-end module is used for reading the image data from the memory;

the reference condition judging module is used for judging according to the writing area reference condition, the reading area reference condition and a preset reading and writing reference judging condition to obtain a reference condition judging result;

and the back-end reading module is used for reading the image data from the memory through the back-end module when the reference condition judgment result shows that the read area reference condition is that the back-end module determines the memory area to be read according to the current memory writing area of the front-end module.

In a third aspect, the present application provides a video image processing system, the system comprising:

the front end module is used for writing image data into the memory;

the memory is used for receiving the image data written by the front-end module and for the back-end module to read the image data;

The back-end module is configured to obtain a writing area reference condition and a reading area reference condition of the front-end module, determine according to the writing area reference condition, the reading area reference condition and a preset reading and writing reference determination condition, obtain a reference condition determination result, and when the reference condition determination result is that the reading area reference condition is that the back-end module determines that a memory needs to be read according to a current memory writing area of the front-end module, read the image data from the memory.

In a fourth aspect, the present application also provides an electronic device comprising a processor and a memory storing a program or instructions executable on the processor, the program or instructions implementing the steps of any one of the video image processing methods of the first aspect when executed by the processor.

In a fifth aspect, embodiments of the present application provide a non-volatile readable storage medium, on which a program or instructions are stored which, when executed by a processor, implement the steps of any one of the video image processing methods of the first aspect.

According to the technical scheme, the memory is arranged between the front end module and the rear end module to transfer image data, the rear end module selects the position from the memory to read the image data according to the action that the front end module is about to write the memory, when the rear end module finishes reading one frame of image data and then reads the next frame of image data, the action information of reading the next frame of image data can be determined according to the action of the front end module and the image data stored in the memory in advance is read, the operation speed of the front end module and the rear end module cannot influence the normal transmission of the image data, the image processing module of the front end module and the image processing module of the rear end module is not limited by the output frame frequency and the input frame frequency, the application range of the image transmission is widened, the problem that the rear end module cannot be connected when the operation speed of the front end module is not matched with the operation speed of the front end module is avoided, and the stability of the image transmission is further ensured.

In addition, compared with the prior art, the technical scheme provided by the application can connect the front-end module and the back-end module with different running rates without any analysis processing on the image data by discarding the adjacent frames or the analysis processing method of the similar data, and has the advantages of simple and reliable image transmission and strong universality.

The foregoing description is merely an overview of the technical solutions provided in the present application, and may be implemented according to the content of the specification in order to make the technical means of the present application more clearly understood, and in order to make the above-mentioned and other objects, features and advantages of the present application more clearly understood, the following detailed description of the present application is given.

Drawings

One or more embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements, and in which the figures of the drawings are not to be taken in a limiting sense, unless otherwise indicated.

Fig. 1 is an example of a conventional transmission scheme provided in the present application;

FIG. 2 is a schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 3 is a second schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 4 is a third schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 6 is a diagram illustrating an example of image transmission of a front end module with fixed write memory;

FIG. 7 is a second example of image transfer for a front end module to be fixedly written into memory;

FIG. 8 is a third example of image transfer for a front end module to be fixedly written into memory;

FIG. 9 is a fifth schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 10 is a schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 11 is a diagram illustrating an example of image transmission of a front-end module with fixed write memory provided in the present application;

FIG. 12 is a fifth example of image transfer for a front end module to be fixedly written into memory;

FIG. 13 is a diagram illustrating an example of image transfer of a front-end module fixed write memory provided in the present application;

FIG. 14 is a schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 15 is a schematic diagram eighth embodiment of a video image processing method according to the present disclosure;

FIG. 16 is a diagram illustrating a video image processing method according to an embodiment of the present disclosure;

FIG. 17 is a diagram illustrating an example of image transmission of a back-end module fixed read memory provided in the present application;

FIG. 18 is a second example of image transmission of a back-end module fixed read memory provided in the present application;

FIG. 19 is a third example of image transmission of a back-end module fixed read memory provided in the present application;

FIG. 20 is a schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 21 is a diagram of an eleventh embodiment of a video image processing method;

FIG. 22 is a diagram illustrating an example of image transmission of a back-end module fixed read memory provided in the present application;

FIG. 23 is a fifth example of image transmission of a back-end module fixed read memory provided in the present application;

FIG. 24 is a diagram illustrating an example of image transmission of a back-end module fixed read memory provided in the present application;

FIG. 25 is a schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 26 is a diagram of thirteenth embodiment of a video image processing method;

fig. 27 is a diagram showing an example of image transmission in which a back-end module and a front-end module both refer to each other to read and write a memory;

FIG. 28 is a second example of image transmission in which both the back-end module and the front-end module provided in the present application refer to each other to read and write the memory;

FIG. 29 is a schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 30 is a third example of image transmission for a back-end module and a front-end module provided in the present application to read from and write to a memory with reference to each other;

FIG. 31 is a diagram showing an example of image transmission in which both the back-end module and the front-end module provided in the present application refer to each other to read and write a memory;

FIG. 32 is a schematic diagram of a video image processing method according to an embodiment of the present disclosure;

FIG. 33 is a fifth example of image transmission for a back-end module and a front-end module provided in the present application to read from and write to a memory with reference to each other;

FIG. 34 is a diagram showing an example of image transmission in which both the back-end module and the front-end module provided in the present application refer to each other to read and write a memory;

FIG. 35 is a diagram illustrating a video image processing method according to an embodiment of the present disclosure;

FIG. 36 is a diagram of a back-end module and a front-end module according to the present application, which refer to each other for performing image transmission of a read-write memory;

FIG. 37 is a diagram showing an example of image transmission in which both the back-end module and the front-end module provided in the present application refer to each other to read and write a memory;

FIG. 38 is a schematic diagram of a video image processing apparatus according to an embodiment of the present application;

FIG. 39 is a schematic diagram of a video image processing apparatus according to a second embodiment of the present disclosure;

FIG. 40 is a third schematic diagram of a video image processing apparatus according to an embodiment of the present disclosure;

FIG. 41 is a schematic diagram of a video image processing apparatus according to an embodiment of the present application;

fig. 42 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

As shown in fig. 1, when video images are transmitted between different modules, for example, from one front-end module, for example, a front-end module, to another back-end module, for example, a back-end module, it is necessary to ensure that the operating rates of the two image processing modules or the frame rates of the two image processing modules are consistent. However, it is difficult for the front-end module and the back-end module to ensure that the operation rates are completely consistent, and an inconsistent operation rate may cause connection failure between the front-end module and the back-end module, so that normal image transmission is difficult.

In view of the foregoing problems, in the prior art, an image output by a front-end module is often analyzed and processed, for example, by discarding adjacent frames or similar data, so as to ensure that the running rate of the image output by the front-end module is consistent with that of an image to be input by a back-end module. Although the selection range of the front end module and the back end module in the video image processing system is enlarged, the operation speed of the front end module and the back end module is required, namely, the operation speed of the front end module is integral multiple of the operation speed of the back end module. The running rate of the front end module and the running rate of the back end module are in an irregular relation, for example, the frame frequency of an image generated or acquired by the front end module in the system is 60hz, the back end module is a functional module for scaling the image, the highest running frame frequency is 25hz, and at the moment, the communication between the front end module and the back end module is difficult to realize in a mode of discarding adjacent frames or similar data. And when the running rate of the front end module is smaller than that of the back end module, for example, the frame frequency of an image generated or acquired by the front end module in the system is 30hz, and the frame frequency of the image required to be input by the back end module is 50hz in order to meet the display requirement, the running rate cannot be controlled in an image analysis processing mode, and the transmission of video images in a video image processing system is blocked.

According to the technical scheme, the Double Data Rate (DDR) or the memory is arranged between the front-end module and the back-end module, so that the two image processing modules with inconsistent running frame frequency or running Rate, such as the front-end module and the back-end module, are connected. Writing the video images output by the front end module into the memory for caching the multi-frame video images, and reading the multi-frame video images cached by the rear end module from the memory. When the front-end module outputs or writes a new frame of image, the front-end module acquires a storage area of a read memory of the back-end module and selects the storage area of the image output or the image writing; when the back-end module inputs a new frame of image or reads the image, the back-end module acquires a storage area of the writing memory of the front-end module, and selects the storage area of the image input or the image writing. At this time, the memory realizes the transfer and isolation of the input and output data of the front end module and the back end module, and solves the connection problem of the front module and the back module caused by unmatched image processing rates. The connection between any two image processing modules in the video image processing system can be realized without any analysis processing action such as adjacent frame discarding on the video image output by the front end module, so that the method is simple and reliable and has strong feasibility.

It should be emphasized that, in the technical solution provided in this application, when the front end module performs writing of the first frame image data and needs writing of the second frame image data, the front end module can determine the writing position of the second frame image data according to the memory position that the back end module is reading from the memory, after the front end module finishes writing the second frame image data, the front end module continues to determine the writing position of the third frame image data according to the memory position that the back end module is reading from the memory, and this application does not limit the writing position of the second frame image data and the writing position of the third frame image data, and both can be the same, so as to avoid the problem of read-write back caused by different existing read-write rates.

Similarly, when the back end module reads the first frame image data and needs to read the second frame image data, the back end module can determine the reading position of the second frame image data according to the memory position where the front end module is writing into the memory, and when the back end module reads the second frame image data, the back end module continues to determine the reading position of the third frame image data according to the memory position where the front end module is writing into the memory.

The video image processing method provided by the embodiment of the application is described in detail below by means of specific embodiments and application scenes thereof with reference to the accompanying drawings.

A first embodiment of the present application relates to a video image processing method, as shown in fig. 2, including:

step 801, acquiring a writing area reference condition of a front-end module, wherein the front-end module is used for writing image data into a memory;

step 802, acquiring a read area reference condition of a back-end module, wherein the back-end module is used for reading the image data from the memory;

803, judging according to the writing area reference condition, the reading area reference condition and a preset reading and writing reference judgment condition to obtain a reference condition judgment result;

step 804, when the reference condition is that the read area reference condition is that the back-end module determines that the memory needs to be read according to the current memory writing area of the front-end module, the back-end module reads the image data from the memory.

Specifically, the technical solution provided in the present application first determines read-write reference conditions of the front end module and the back end module, for example, whether the front end module writes image data into the memory according to a preset write rule, for example, writes the image data into the memory according to a fixed sequence cycle or determines a memory to-be-written area of the back end module with reference to a current memory read area of the back end module, for example, whether the back end module reads the image data from the memory according to a preset read rule, for example, reads the image data from the memory according to a fixed sequence cycle or determines a memory to-be-read area of the back end module with reference to the current memory write area of the front end module. And executing the read-write action according to the preset read-write reference judgment condition.

The second embodiment of the present application relates to a video image processing method, which is applied to a video image processing system, the video image processing system includes a front-end module, a memory and a back-end module, the front-end module writes image data into the memory according to a preset writing rule, as shown in fig. 3, and includes:

step 101, when the back-end module needs to read the image data from the memory, acquiring a current memory writing area, wherein the current memory writing area is a writing position when the front-end module writes the image data into the memory;

102, determining a memory area to be read according to the current memory writing area by a preset reading judgment condition;

and 103, reading image data from the memory through the back-end module according to the memory area to be read.

Specifically, in the technical scheme provided by the application, when the front end module writes the image data into the memory according to the preset rule, the back end module reads the image data from the memory after the back end module needs to read the image data of the next frame, and the front end module refers to the writing area of the image data written into the memory at this time to determine the reading area of the image data of the next frame read from the memory. The problems of read-write pursuit caused by the difference of read-write speeds due to inconsistent running speeds of the front end module and the back end module are avoided.

For example, when the back-end module finishes reading the first frame of image data, the front-end module writes the image data in an area of the memory, and the back-end module can determine an area of itself for reading the image data according to the area and read the second frame of image data from the memory. When the second frame of image data is read, the back end module needs to read the third frame of image data, and is influenced by the difference of the reading and writing rates, the front end module is also writing the image data into the area at the moment, and the back end module still executes the reading action in the well-determined reading area of the second frame of image data.

According to the technical scheme, the memory is arranged between the front end module and the rear end module to transfer image data, the rear end module selects the position from the memory to read the image data according to the action that the front end module is about to write the memory, when the rear end module finishes reading one frame of image data and then reads the next frame of image data, the action information of reading the next frame of image data can be determined according to the action of the front end module and the image data stored in the memory in advance is read, the operation speed of the front end module and the rear end module cannot influence the normal transmission of the image data, the image processing module of the front end module and the image processing module of the rear end module is not limited by the output frame frequency and the input frame frequency, the application range of image transmission is enlarged, the connection when the operation speed of the rear end module and the front end module is not matched is avoided, and the stability of the image transmission is further ensured.

Moreover, the technical scheme provided by the application can be applied to the situation that the permission of adjusting the writing action of the front-end module is not obtained, the writing action of the front-end module is predetermined and unchanged, and the effect of image data processing can be achieved through control of the reading action of the rear-end module.

On the basis of the above embodiment, as shown in fig. 4, in the video image processing method provided in the present application, step 102 includes:

step 121, comparing the output frame frequency of the front end module with the input frame frequency of the back end module to obtain a frame frequency comparison result;

and 122, determining the memory area to be read according to the current memory writing area when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, wherein the current memory writing area and the memory area to be read are the same.

Specifically, when the front-end module circularly writes the image data into the memory according to a fixed sequence, the output frame frequency of the front-end module is compared with the input frame frequency of the back-end module to obtain a frame frequency comparison result. When the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, the running speed of the front-end module is larger than the running speed of the rear-end module, and the memory area to be read when the rear-end module reads the image data is determined according to the area written into the memory by the front-end module at the moment, namely the current memory writing area. At this time, in order to prevent the problem of read-write pursuit when the read-write speeds are different, the memory area to be read and the current memory writing area can be consistent.

On the basis of the above embodiment, as shown in fig. 5, the memory includes a multi-frame storage space, and the front-end module cyclically writes the image data into the memory according to a fixed sequence, in the video image processing method provided in the present application, step 122 includes:

and step 123, when the frame frequency comparison result is that the output frame frequency is greater than the input frame frequency, determining the memory area to be read according to the current memory writing area, wherein the current memory writing area and the memory area to be read are the same frame storage space of the memory.

For example, when the output frame rate of the front-end module is greater than the input frame rate of the back-end module, three frames of images are buffered in the memory. The front-end module writes the images into the memory in a circulating manner according to the fixed sequence of the first frame, the second frame, the third frame and the first frame. When the back-end module or the back-end module reads a new frame of image each time, the back-end module firstly acquires the area where the front-end module is writing the image in the DDR, and because the writing speed is faster than the reading speed, the back-end module can prevent the occurrence of the read-write pursuit phenomenon by utilizing the buffer space to the greatest extent, and reduce the time delay between the front-end module and the back-end module images as much as possible, and the back-end module reads the new frame of image from the same storage area as the frame area where the front-end module is writing the image in the DDR. As shown in fig. 6, when the front-end module is currently writing an image into the storage area of the first frame in the DDR, the back-end module also reads a new image from the storage area of the first frame in the DDR; as shown in fig. 7, when the front-end module is currently writing an image into the storage area of the second frame in the DDR, the back-end module also reads a new frame image from the storage area of the second frame in the DDR; as shown in fig. 8, when the front-end module is currently writing an image to the storage area of the third frame in the DDR, the back-end module also reads a new image from the storage area of the third frame in the DDR.

On the basis of the above embodiment, as shown in fig. 9, in the video image processing method provided in the present application, after step 121, the method further includes:

and 124, determining the memory area to be read according to the current memory writing area when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, wherein the current memory writing area and the memory area to be read are different.

Specifically, when the front-end module circularly writes the image data into the memory according to a fixed sequence, the output frame frequency of the front-end module is compared with the input frame frequency of the back-end module to obtain a frame frequency comparison result. When the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, the running speed of the front-end module is larger than the running speed of the rear-end module, and the memory area to be read when the rear-end module reads the image data is determined according to the area written into the memory by the front-end module at the moment, namely the current memory writing area. In this case, in order to prevent the problem of the write-read-and-write-after collision when the read-and-write speeds are different, the memory area to be read cannot be consistent with the current memory writing area, for example, the memory area to be read is the last writing area of the current memory writing area when the memory area to be read is circularly arranged in sequence.

On the basis of the above embodiment, as shown in fig. 10, the memory includes a multi-frame storage space, and the front-end module cyclically writes the image data into the memory according to a fixed sequence, in the video image processing method provided in the present application, step 124 includes:

and step 125, when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, determining the memory area to be read according to the current memory writing area, wherein the memory area to be read is the storage space of the last frame of the current memory writing area.

For example, when the output frame rate of the front-end module is smaller than the input frame rate of the back-end module, three frames of images are buffered in the memory. The front-end module writes the images into the memory in a circulating manner according to the fixed sequence of the first frame, the second frame, the third frame and the first frame. When the back-end module or the back-end module reads a new frame of image each time, the back-end module firstly acquires the area of the front-end module which is writing the image into the DDR, and the writing speed is slower than the reading speed, so that the cache space is utilized to the greatest extent, the phenomenon of reading, writing and knocking is prevented, the time delay between the front-end module and the back-end module is reduced as much as possible, and the back-end module reads the new frame of image from the storage area of the previous frame of the storage area of the frame area which is writing the image into the DDR with the front-end module. As shown in fig. 11, when the front-end module is currently writing an image into the storage area of the first frame in the DDR, the back-end module reads a new frame image from the storage area of the third frame in the DDR; as shown in fig. 12, when the front-end module is currently writing an image into the storage area of the second frame in the DDR, the back-end module reads a new frame image from the storage area of the first frame in the DDR; as shown in fig. 13, when the front-end module is currently writing an image to the storage area of the third frame in the DDR, the back-end module reads a new frame image from the storage area of the second frame in the DDR.

The third embodiment of the present application relates to a video image processing method, which is applied to a video image processing system, the video image processing system includes a front-end module, a memory, and a back-end module, the back-end module reads image data from the memory according to a preset reading rule, as shown in fig. 14, and includes:

step 201, when the front-end module needs to write the image data into the memory, acquiring a current memory reading area, wherein the current memory reading area is a reading position when the back-end module reads the image data from the memory at the moment;

step 202, determining a memory area to be written according to the current memory reading area by a preset writing judgment condition;

and 203, writing image data into the memory through the front-end module according to the memory area to be written.

Specifically, in the present embodiment, in a scenario where the reference condition of the writing area of the front end module is to reference the current memory reading area of the back end module to determine the memory writing area of the front end module, and the reference condition of the reading area of the back end module is to read the image data from the memory according to the preset reading rule, in the technical scheme provided in the present application, the front end module can refer to the processing action of the back end module when writing the image data into the memory. When the back-end module reads the image data from the memory according to a preset rule, the front-end module writes one frame of image data into the memory, and when the next frame of image data needs to be written, the back-end module refers to the read area of the image data read from the memory at the moment, and determines the write area of the next frame of image data written into the memory. The problems of read-write pursuit caused by the difference of read-write speeds due to inconsistent running speeds of the front end module and the back end module are avoided.

For example, after the front-end module finishes writing the first frame of image data, the back-end module reads the image data in an area of the memory at this time, and the front-end module may determine the area where the front-end module writes the image data according to the area and write the second frame of image data into the memory. When the second frame of image data is written, the front end module is influenced by the difference of the reading and writing rates when the third frame of image data is required to be written, and at the moment, the back end module reads the image data from the area, and the front end module still executes the writing action in the well-determined writing area of the second frame of image data.

Moreover, the technical scheme provided by the application can be applied to the situation that the authority for adjusting the reading action of the back-end module is not obtained, the reading action of the back-end module is predetermined and unchanged, and the effect of image data processing can be achieved through control of the writing action of the front-end module.

On the basis of the above embodiment, as shown in fig. 15, in the video image processing method provided in the present application, step 202 includes:

step 221, comparing the output frame frequency of the front end module with the input frame frequency of the back end module to obtain a frame frequency comparison result;

Step 222, determining the memory writing-required area according to the current memory reading area when the frame frequency comparison result is that the output frame frequency is greater than the input frame frequency, wherein the current memory reading area and the memory writing-required area are different.

Specifically, when the back-end module reads image data from the memory according to a fixed sequence, the output frame frequency of the front-end module is compared with the input frame frequency of the back-end module to obtain a frame frequency comparison result. When the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, the running speed of the front-end module is larger than the running speed of the back-end module, and the memory writing-in area when the front-end module writes the image data is determined according to the area where the back-end module reads the memory at the moment, namely the current memory reading area. In this case, in order to prevent the problem of writing and reading and pursuing when the writing and reading speeds are different, the memory writing area and the current memory reading area cannot be consistent, for example, the memory writing area is the next writing area of the current memory reading area when the memory writing areas are circularly arranged in sequence.

On the basis of the above embodiment, the memory includes a multi-frame storage space, and the back-end module circularly reads the image data from the memory according to a fixed sequence, as shown in fig. 16, in the video image processing method provided in the present application, step 222 includes:

And step 223, when the frame frequency comparison result is that the output frame frequency is greater than the input frame frequency, determining the memory writing-in area according to the current memory reading area, wherein the memory writing-in area is the next frame storage space of the current memory reading area.

For example, when the output frame rate of the front-end module is greater than the input frame rate of the back-end module, three frames of images are buffered in the memory. The back-end module or the back-end module reads the images from the memory in a fixed sequence of the first frame, the second frame, the third frame and the first frame. When a new frame of image is to be written into the front-end module, the front-end module firstly acquires the area of the frame area which is currently being read into the DDR by the back-end module, and because the writing speed is faster than the reading speed, the front-end module can prevent the occurrence of the phenomenon of reading, writing and knocking in order to utilize the buffer space to the greatest extent, and reduce the time delay between the front-end module image and the back-end module image as much as possible, and the front-end module writes the new frame of image into the storage area of the next frame of the frame area which is currently being read from the DDR by the back-end module. As shown in fig. 17, when the back-end module is currently reading an image from the storage area of the first frame in the DDR, the front-end module writes a new image in the storage area of the second frame in the DDR; as shown in fig. 18, when the back-end module is currently reading an image from the storage area of the second frame in the DDR, the front-end module writes a new frame image into the storage area of the third frame in the DDR; as shown in fig. 19, when the back-end module is currently reading an image from the storage area of the third frame in the DDR, the front-end module writes a new frame image to the storage area of the first frame in the DDR.

It should be emphasized that, in the technical scheme provided by the present application, when the next frame of storage space of the storage space where the current memory reading area is located is selected as the memory area needing to be written, compared with the technical scheme of setting positions of other writing areas, the distance between the current memory reading area and the memory area needing to be written is the smallest, so that the delay from the current memory reading area to the memory area needing to be written of the back-end module is reduced, and the video image processing efficiency is further improved.

On the basis of the above embodiment, as shown in fig. 20, in the video image processing method provided in the present application, after step 221, the method further includes:

and 224, determining the memory writing-in area according to the current memory reading area when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, wherein the current memory reading area is the same as the memory writing-in area.

Specifically, when the back-end module reads image data from the memory according to a fixed sequence, the output frame frequency of the front-end module is compared with the input frame frequency of the back-end module to obtain a frame frequency comparison result. When the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, and the running speed of the front-end module is smaller than the running speed of the back-end module, the memory writing-in area when the front-end module writes the image data is determined according to the area where the back-end module reads the memory at the moment, namely the current memory reading area. At this time, in order to prevent the problem of the write-read-write-after collision when the read-write speeds are different, the memory writing-in area and the current memory reading area can be consistent.

On the basis of the above embodiment, as shown in fig. 21, in the video image processing method provided in the present application, step 224 includes:

and 225, determining the memory writing-in area according to the current memory reading area when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, wherein the current memory reading area and the memory writing-in area are the same frame storage space of the memory.

For example, when the output frame rate of the front-end module is smaller than the input frame rate of the back-end module, three frames of images are buffered in the memory. The back-end module or the back-end module reads the images from the memory in a fixed sequence of the first frame, the second frame, the third frame and the first frame. When the front end module is about to write a new frame of image each time, the front end module firstly acquires the area of the image which is currently being read from the DDR by the back end module, and the writing speed is slower than the reading speed, so that the buffer space is utilized to the greatest extent, the phenomenon of reading, writing and knocking is prevented, and the front end module writes the new frame of image in the same storage area as the frame area which is currently being read from the DDR by the back end module. As shown in fig. 22, when the back-end module is currently reading an image from the storage area of the first frame in the DDR, the front-end module also writes a new image in the storage area of the first frame in the DDR; as shown in fig. 23, when the back-end module is currently reading an image from the storage area of the second frame in the DDR, the front-end module also writes a new frame image into the storage area of the second frame in the DDR; as shown in fig. 24, when the back-end module is currently reading an image from the storage area of the third frame in the DDR, the front-end module also writes a new frame image to the storage area of the third frame in the DDR.

A fourth embodiment of the present application relates to a video image processing method, which is applied to a video image processing system, where the video image processing system includes a front-end module, a memory, and a back-end module, the front-end module performs a writing action based on a reading action of the back-end module, and the back-end module performs a reading action based on the writing action of the front-end module, as shown in fig. 25, and includes:

step 301, when the back-end module needs to read the image data from the memory, acquiring a current memory writing area, where the current memory writing area is a writing position when the front-end module writes the image data into the memory at this time;

step 302, determining a memory area to be read according to the current memory writing area by a preset reading judgment condition;

step 303, according to the area to be read of the memory, reading image data from the memory through the back-end module;

step 304, when the front-end module needs to write the image data into the memory, acquiring a current memory reading area, wherein the current memory reading area is a reading position when the back-end module reads the image data from the memory at the moment;

Step 305, determining a memory area to be written according to the current memory read area by a preset writing judgment condition;

step 306, writing image data into the memory through the front-end module according to the memory area to be written.

Specifically, in this embodiment, for the writing area reference condition of the front end module and the reading area reference condition of the back end module, the memory area to be read and the memory area to be written are determined according to the current memory writing area or the current memory reading area of the other party. Because the technical scheme provided by the application can provide corresponding read-write areas for different operation speed differences of the front end module and the rear end module, the problem of connection of the front module and the rear module due to mismatching of image processing speeds is solved.

In addition, the technical scheme provided by the application can be applied to the scene that the read-write actions of the front end module and the back end module can be adjusted, and the effect of image data processing can be achieved through the control of the read action of the back end module.

Based on the above embodiment, the memory includes a multi-frame storage space, as shown in fig. 26, in the video image processing method provided in the present application, step 302 includes:

step 321, comparing the output frame frequency of the front end module with the input frame frequency of the back end module to obtain a frame frequency comparison result;

and step 322, determining the memory area to be read according to the current memory writing area when the frame frequency comparison result is that the output frame frequency is greater than the input frame frequency, wherein the current memory writing area and the memory area to be read are the same frame storage space of the memory.

For example, when the output frame rate is greater than the input frame rate, the operation rate of the front end module is greater than the operation rate of the back end module, and taking the case of caching two frames of images, the front end module and the back end module select the DDR area used when reading and writing a new frame of images according to the area that the opposite side is currently reading and writing DDR.

When the back-end module is about to read a new frame of image each time, the back-end module firstly acquires the area where the front-end module is writing the image in the DDR, and because the writing speed is faster than the reading speed, in order to reduce the time delay between the images of the front-end module and the back-end module and not to generate mutual exclusion of the reading and writing areas, the back-end module reads the new frame of image from the same storage area of the frame area where the front-end module is writing in the DDR.

In the case that the front-end module is currently writing an image into the storage area of the first frame in the DDR as shown in fig. 27, the back-end module also reads a new image from the storage area of the first frame in the DDR; as shown in fig. 28, when the front-end module is currently writing an image to the storage area of the second frame in the DDR, the back-end module also reads a new image from the storage area of the second frame in the DDR.

On the basis of the above embodiment, as shown in fig. 29, in the video image processing method provided in the present application, after step 321, the method further includes:

and step 323, when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, determining the memory area to be read according to the current memory writing area, wherein the memory area to be read is the storage space of the last frame of the current memory writing area.

For example, when the output frame rate is smaller than the input frame rate, the operation rate of the front end module is smaller than the operation rate of the back end module, and when two frames of images are buffered, the front end module and the back end module select the DDR area used when reading and writing a new frame of image according to the area that the opposite side is currently reading and writing DDR.

When the back-end module is about to read a new frame of image each time, the back-end module firstly acquires the area of the frame area which is written in the DDR by the front-end module at present, and because the reading speed is faster than the writing speed, in order to prevent the phenomenon of reading, writing and chasing, the back-end module reads the new frame of image from the storage area of the other frame of the frame area which is written in the DDR by the front-end module at present.

As shown in fig. 30, when the front-end module is currently writing an image into the storage area of the first frame in the DDR, the back-end module reads a new frame image from the storage area of the second frame in the DDR; as shown in fig. 31, when the front-end module is currently writing an image to the storage area of the second frame in the DDR, the back-end module reads a new image from the storage area of the first frame in the DDR.

On the basis of the above embodiment, the memory includes a multi-frame storage space, as shown in fig. 32, in the video image processing method provided in the present application, step 305 includes:

And 351, determining the memory writing-in area according to the current memory reading area when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, wherein the memory writing-in area is the next frame storage space of the current memory reading area.

When the front-end module is about to write a new frame of image each time, firstly acquiring the area of the image which is currently being read from the DDR by the back-end module, and because the writing speed is faster than the reading speed, in order to prevent the occurrence of the read-write pursuit phenomenon, writing the new frame of image into the storage area of the other frame of the frame area which is currently being read from the DDR by the back-end module.

As shown in fig. 33, when the back-end module is currently reading an image from the storage area of the first frame in the DDR, the front-end module writes a new image in the storage area of the second frame in the DDR; as shown in fig. 34, when the back-end module is currently reading an image from the storage area of the second frame in the DDR, the front-end module writes a new image in the storage area of the first frame in the DDR.

On the basis of the above embodiment, as shown in fig. 35, in the video image processing method provided in the present application, step 305 further includes:

and step 352, determining the memory writing-in area according to the current memory reading area when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, wherein the current memory reading area and the memory writing-in area are the same frame storage space of the memory.

When the front-end module is about to write a new frame of image each time, firstly acquiring the area of the image which is currently being read from the DDR by the back-end module, and because the writing speed is slower than the reading speed, in order to not generate mutual exclusion of the reading and writing areas, writing the new frame of image into the same storage area of the frame area which is currently being read from the DDR by the back-end module by the front-end module.

As shown in fig. 36, when the back-end module is currently reading an image from the storage area of the first frame in the DDR, the front-end module also writes a new image in the storage area of the first frame in the DDR; as shown in fig. 37, when the back-end module is currently reading an image from the storage area of the second frame in the DDR, the front-end module also writes a new image frame to the storage area of the second frame in the DDR.

A fifth embodiment of the present application relates to a video image processing apparatus, as shown in fig. 38, including:

a writing area reference condition obtaining module 901, configured to obtain writing area reference conditions of a front end module, where the front end module is configured to write image data into a memory;

a read area reference condition obtaining module 902, configured to obtain a read area reference condition of a back-end module, where the back-end module is configured to read the image data from the memory;

a reference condition judging module 903, configured to judge according to the writing area reference condition, the reading area reference condition, and a preset reading and writing reference judgment condition, and obtain a reference condition judgment result;

and the back-end reading module 904 is configured to read the image data from the memory through the back-end module when the reference condition determination result indicates that the read area reference condition is that the back-end module determines that the memory needs to be read according to the current memory writing area of the front-end module.

A sixth embodiment of the present application relates to a video image processing apparatus, as shown in fig. 39, including:

a first current memory writing area obtaining module 401, configured to obtain a current memory writing area when the back end module needs to read the image data from the memory, where the current memory writing area is a writing position when the front end module writes the image data into the memory at this time;

A first memory read-required area determining module 402, configured to determine a memory read-required area according to the current memory writing area by using a preset read judgment condition;

the first memory reading action module 403 is configured to read image data from the memory through the back-end module according to the memory area to be read.

Based on the foregoing embodiments, in the video image processing apparatus provided in the present application, the first memory area-to-be-read determining module 402 includes:

the first frame frequency comparison unit is used for comparing the output frame frequency of the front end module with the input frame frequency of the rear end module to obtain a frame frequency comparison result;

and the first memory read-required area determining unit is used for determining the memory read-required area according to the current memory writing area when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, wherein the current memory writing area is the same as the memory read-required area.

On the basis of the above embodiment, in the video image processing apparatus provided in the present application, the first memory read-required area determining unit includes:

and the first memory read-required area generating subunit is configured to determine the memory read-required area according to the current memory writing area when the frame frequency comparison result is that the output frame frequency is greater than the input frame frequency, where the current memory writing area and the memory read-required area are the same frame storage space of the memory.

Based on the foregoing embodiments, in the video image processing apparatus provided in the present application, the first memory area-to-be-read determining module 402 further includes:

and the second memory read-required area determining unit is used for determining the memory read-required area according to the current memory writing area when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, wherein the current memory writing area and the memory read-required area are different.

On the basis of the above embodiment, in the video image processing apparatus provided in the present application, the second memory read-required area determining unit includes:

and the second memory read-required region generating subunit is configured to determine the memory read-required region according to the current memory writing region when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, where the memory read-required region is a storage space of a previous frame of the current memory writing region.

A fifth embodiment of the present application relates to a video image processing apparatus, as shown in fig. 40, including:

a first current memory read area obtaining module 501, configured to obtain a current memory read area when the front end module needs to write the image data into the memory, where the current memory read area is a read position when the back end module reads the image data from the memory at this time;

The first memory writing-in area determining module 502 is configured to determine a memory writing-in area according to the current memory reading area by using a preset writing judgment condition;

a first memory writing action module 503, configured to write image data into the memory through the front end module according to the memory writing area.

Based on the foregoing embodiment, in the video image processing apparatus provided in the present application, the first memory writing-required area determining module 502 includes:

the second frame frequency comparison unit is used for comparing the output frame frequency of the front end module with the input frame frequency of the rear end module to obtain a frame frequency comparison result;

and the first memory writing-in area determining unit is used for determining the memory writing-in area according to the current memory reading area when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, wherein the current memory reading area and the memory reading-in area are different.

On the basis of the above embodiment, in the video image processing apparatus provided in the present application, the first memory writing-required area determining unit includes:

and the first memory writing-in-required area generating subunit is used for determining the memory writing-in-required area according to the current memory reading area when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, wherein the memory writing-in-required area is the next frame storage space of the current memory reading area.

Based on the foregoing embodiment, in the video image processing apparatus provided in the present application, the first memory writing-required area determining module 502 further includes:

and the second memory writing-in area determining unit is used for determining the memory writing-in area according to the current memory reading area when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, wherein the current memory reading area is the same as the memory writing-in area.

On the basis of the above embodiment, in the video image processing apparatus provided in the present application, the second memory writing-required area determining unit includes:

and the second memory writing-in area generating subunit is configured to determine, when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, the memory writing-in area according to the current memory reading area, where the current memory reading area and the memory writing-in area are the same frame storage space of the memory.

A seventh embodiment of the present application relates to a video image processing apparatus, as shown in fig. 41, including:

a second current memory writing area obtaining module 601, configured to obtain a current memory writing area when the back end module needs to read the image data from the memory, where the current memory writing area is a writing position when the front end module writes the image data to the memory at this time;

A second memory read-required area determining module 602, configured to determine a memory read-required area according to the current memory writing area by using a preset read judgment condition;

a second memory reading action module 603, configured to read image data from the memory through the back-end module according to the memory area to be read;

a second current memory read area obtaining module 604, configured to obtain a current memory read area when the front end module needs to write the image data into the memory, where the current memory read area is a read position when the back end module reads the image data from the memory at this time;

a second memory writing-required area determining module 605, configured to determine a memory writing-required area according to the current memory reading area by using a preset writing judgment condition;

the second memory writing action module 606 is configured to write image data into the memory through the front end module according to the memory writing area.

Based on the foregoing embodiment, in the video image processing apparatus provided in the present application, the second memory area-to-be-read determining module 602 includes:

The third frame frequency comparison unit is used for comparing the output frame frequency of the front end module with the input frame frequency of the rear end module to obtain a frame frequency comparison result;

and the third memory writing-in area determining unit is used for determining the memory reading-in area according to the current memory writing-in area when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, wherein the current memory writing-in area and the memory reading-in area are the same frame storage space of the memory.

Based on the foregoing embodiment, in the video image processing apparatus provided in the present application, the second memory area-to-be-read determining module 602 further includes:

and the fourth memory writing-in area determining unit is used for determining the memory reading-in area according to the current memory writing-in area when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, wherein the memory reading-in area is the storage space of the last frame of the current memory writing-in area.

Based on the foregoing embodiment, in the video image processing apparatus provided in the present application, the second memory writing-required area determining module 605 includes:

And the third memory read-required area determining unit is used for determining the memory write-required area according to the current memory read area when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, wherein the memory write-required area is the next frame storage space of the current memory read area.

On the basis of the foregoing embodiment, in the video image processing apparatus provided in the present application, the second memory writing-required area determining module 605 further includes:

and the fourth memory read-required area determining unit is used for determining the memory write-required area according to the current memory read area when the frame frequency comparison result is that the output frame frequency is smaller than the input frame frequency, wherein the current memory read area and the memory write-required area are the same frame storage space of the memory.

An eighth embodiment of the present application relates to a video image processing system, comprising:

the front end module is used for writing image data into the memory;

A ninth embodiment of the present application relates to an electronic device, as shown in fig. 42, including:

at least one processor 701; the method comprises the steps of,

a memory 702 communicatively coupled to the at least one processor 701; wherein,

the memory 702 stores instructions executable by the at least one processor 701 to enable the at least one processor 701 to implement the video image processing method according to any one of the first, second, third and fourth embodiments of the present application.

Where the memory and the processor are connected by a bus, the bus may comprise any number of interconnected buses and bridges, the buses connecting the various circuits of the one or more processors and the memory together. The bus may also connect various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or may be a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor is transmitted over the wireless medium via the antenna, which further receives the data and transmits the data to the processor.

The processor is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And memory may be used to store data used by the processor in performing operations.

A tenth embodiment of the present application relates to a computer-readable storage medium storing a computer program. The computer program, when executed by a processor, implements the video image processing method according to any one of the first, second, third, and fourth embodiments of the present application.

That is, it will be understood by those skilled in the art that all or part of the steps in implementing the methods of the embodiments described above may be implemented by a program stored in a storage medium, where the program includes several instructions for causing a device (which may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps in the methods of the embodiments described herein. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.

It is to be understood that the present application is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims

1. A method of video image processing, the method comprising:

acquiring writing area reference conditions of a front-end module, wherein the front-end module is used for writing image data into a memory, the writing area reference conditions comprise first writing area reference conditions corresponding to the writing image data into the memory according to preset writing rules by the front-end module, and second writing area reference conditions corresponding to the memory writing area required to be written by the front-end module according to the current memory reading area of a rear-end module;

Acquiring a read region reference condition of the back-end module, wherein the read region reference condition comprises a first read region reference condition corresponding to a region to be read of a memory determined by the back-end module according to a current memory writing region of the front-end module, and a second read region reference condition corresponding to image data read from the memory by the back-end module according to a preset read rule, and the back-end module is used for reading the image data from the memory;

judging according to the writing area reference condition, the reading area reference condition and a preset reading and writing reference judgment condition to obtain a reference condition judgment result, wherein the reading and writing reference judgment condition is used for judging that the writing area reference condition belongs to the first writing area reference condition or the second writing area reference condition and judging that the reading area reference condition belongs to the first reading area reference condition or the second reading area reference condition;

when the reference condition judgment result is that the writing area reference condition belongs to the first writing area reference condition and the reading area reference condition belongs to the first reading area reference condition, acquiring the current memory writing area, wherein the current memory writing area is a writing position when the front-end module writes the image data into the memory at the moment;

when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, determining the memory area to be read according to the current memory writing area, wherein the current memory writing area is the same as the memory area to be read;

2. The method of claim 1, wherein the memory includes a multi-frame memory space, wherein the first writing region reference condition is that the front-end module cyclically writes the image data into the memory in a fixed order, and wherein determining the memory read-required region according to the current memory writing region when the frame rate comparison result is that the output frame rate is greater than the input frame rate comprises:

3. The method according to claim 1, wherein the comparing the output frame frequency of the front-end module with the input frame frequency of the back-end module to obtain the frame frequency comparison result further comprises:

4. The method of claim 3, wherein the memory includes a multi-frame memory space, the first writing region reference condition is that the front-end module cyclically writes the image data into the memory in a fixed order, and the determining the memory read-required region according to the current memory writing region when the frame rate comparison result is that the output frame rate is less than the input frame rate includes:

5. The method according to claim 1, wherein the determining according to the writing area reference condition, the reading area reference condition, and a preset reading/writing reference determination condition, after obtaining a reference condition determination result, further comprises:

when the reference condition judgment result is that the writing area reference condition belongs to the second writing area reference condition and the reading area reference condition belongs to the second reading area reference condition, acquiring a current memory reading area, wherein the current memory reading area is a reading position when the back-end module reads the image data from the memory at the moment;

when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, determining the memory writing-in area according to the current memory reading area, wherein the current memory reading area and the memory writing-in area are different;

6. The method of claim 5, wherein the memory includes a multi-frame memory space, wherein the second read region reference condition is that the back-end module cyclically reads the image data from the memory in a fixed order, and wherein determining the memory write-required region according to the current memory read region when the frame rate comparison result is that the output frame rate is greater than the input frame rate comprises:

7. The method of claim 6, wherein comparing the output frame rate of the front-end module with the input frame rate of the back-end module to obtain the frame rate comparison result, further comprises:

8. The method of claim 7, wherein the memory comprises a multi-frame memory space, the back-end module is configured to read the image data from the memory in a fixed order cycle, and wherein determining the memory write-required area from the current memory read area when the frame rate comparison result is that the output frame rate is less than the input frame rate comprises:

9. The method according to claim 1, wherein the determining according to the writing area reference condition, the reading area reference condition, and a preset reading/writing reference determination condition, after obtaining a reference condition determination result, further comprises:

when the reference condition judgment result is that the writing area reference condition belongs to the second writing area reference condition and the reading area reference condition belongs to the first reading area reference condition, when the back-end module needs to read the image data from the memory, acquiring a current memory writing area, wherein the current memory writing area is a writing position when the front-end module writes the image data into the memory at the moment;

when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, determining the memory writing-in area according to the current memory reading area, wherein the memory writing-in area is different from the current memory reading area;

10. The method of claim 9, wherein the memory comprises a multi-frame memory space, and wherein determining the memory read-required area from the current memory write area when the frame rate comparison result is that the output frame rate is greater than the input frame rate comprises:

11. The method according to claim 10, wherein the comparing the output frame frequency of the front-end module with the input frame frequency of the back-end module to obtain the frame frequency comparison result further comprises:

12. The method of claim 10, wherein the memory comprises a multi-frame memory space, and wherein determining the memory write-required area according to the current memory read area when the frame rate comparison result is that the output frame rate is greater than the input frame rate comprises:

13. The method of claim 12, wherein the memory includes a multi-frame memory space, and wherein after the front-end module obtains the current memory read area when the front-end module needs to write the image data to the memory, further comprising:

14. A video image processing apparatus, comprising:

the writing area reference condition acquisition module is used for acquiring writing area reference conditions of the front end module, wherein the front end module is used for writing image data into the memory, the writing area reference conditions comprise first writing area reference conditions corresponding to the writing image data into the memory by the front end module according to preset writing rules, and second writing area reference conditions corresponding to the memory writing area required to be written by the front end module according to the current memory reading area of the rear end module;

a read area reference condition obtaining module, configured to obtain a read area reference condition of the back end module, where the read area reference condition includes a first read area reference condition corresponding to a memory area to be read determined by the back end module according to a current memory writing area of the front end module, and a second read area reference condition corresponding to image data read by the back end module from the memory according to a preset read rule, and the back end module is configured to read the image data from the memory;

A reference condition judging module, configured to judge according to the writing area reference condition, the reading area reference condition and a preset reading and writing reference judging condition, and obtain a reference condition judging result, where the reading and writing reference judging condition is used to judge that the writing area reference condition belongs to the first writing area reference condition or the second writing area reference condition, and judge that the reading area reference condition belongs to the first reading area reference condition or the second reading area reference condition;

a current memory writing area determining module, configured to obtain, when the reference condition determination result indicates that the writing area reference condition belongs to the first writing area reference condition and the reading area reference condition belongs to the first reading area reference condition, a current memory writing area, where the current memory writing area is a writing position when the front end module writes the image data into the memory at this time;

the frame frequency comparison module is used for comparing the output frame frequency of the front end module with the input frame frequency of the rear end module to obtain a frame frequency comparison result;

the memory read-required area determining module is used for determining the memory read-required area according to the current memory writing area when the frame frequency comparison result is that the output frame frequency is larger than the input frame frequency, wherein the current memory writing area is the same as the memory read-required area;

And the image reading module is used for reading the image data from the memory through the back-end module according to the memory area to be read.

15. A video image processing system implementing a video image processing method according to any one of claims 1 to 13, comprising:

the front end module is used for writing image data into the memory;

16. An electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the video image processing method of any one of claims 1-13.

17. A non-transitory readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the video image processing method of any one of claims 1-13.