CN116248845A

CN116248845A - Image processing method, apparatus, system, device, and computer-readable storage medium

Info

Publication number: CN116248845A
Application number: CN202310110497.1A
Authority: CN
Inventors: 彭庆欢; 李永杰; 赵多; 黄斌
Original assignee: Shenzhen Zhouming Technology Co Ltd
Current assignee: Shenzhen Zhouming Technology Co Ltd
Priority date: 2023-01-31
Filing date: 2023-01-31
Publication date: 2023-06-09

Abstract

The present application relates to an image processing method, apparatus, system, device, and computer-readable storage medium. The method comprises the following steps: acquiring at least one path of video source image, and determining a target video image based on the video source image; outputting the target video image to a display screen so that the display screen displays the target video image; performing color correction processing on the target video image based on the correction color parameters to obtain a return video image, and outputting the return video image to the monitoring screen so that the monitoring screen displays the return video image; the correction color parameters are determined according to the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen. Before the monitoring screen carries out the passback display to the target video image, the target video image is subjected to color correction processing based on correction color parameters to obtain the passback video image, so that the consistency of the color of the monitoring screen and the color of the target video image displayed by the display screen when the passback video image is displayed by the monitoring screen can be ensured, the passback display effect is better, and the high application requirement of color restoration can be met.

Description

Image processing method, apparatus, system, device, and computer-readable storage medium

Technical Field

The present disclosure relates to the field of display technologies, and in particular, to an image processing method, apparatus, system, device, and computer readable storage medium.

Background

Along with the development of science and technology, an LED (Light Emitting Diode ) screen control technology is gradually formed and tends to be rich in functions, a monitoring feedback technology is also widely applied, and through monitoring the display content of an LED display screen through a monitoring screen at a far end, workers do not need to go to and from the scene, so that the efficiency of remote control of the workers is improved, and when an on-site emergency is met, the workers can timely switch or close a display channel through feedback, and the capability of coping with the emergency is improved.

However, in the existing monitoring feedback technology, the situation that the color of the feedback video image displayed by the monitoring screen is inconsistent with that of the video image displayed by the LED display screen often occurs, and the application requirement cannot be met in the occasion with higher color restoration requirement. For example, when color replacement or color adjustment is required for a video image displayed by the LED display screen, the returned video image cannot be accurately restored, so that the display colors of the monitor screen and the LED display screen are inconsistent, the actual display effect of color replacement or adjustment for the display of the LED display screen based on the display of the monitor screen is poor, and the application requirement is not satisfied.

Disclosure of Invention

In view of the foregoing, it is desirable to provide an image processing method, apparatus, system, device, and computer-readable storage medium that can improve the color reduction degree of a return display.

In a first aspect, the present application provides an image processing method. The method comprises the following steps:

acquiring at least one path of video source image, and determining a target video image based on the video source image;

outputting the target video image to a display screen so that the display screen displays the target video image;

performing color correction processing on the target video image based on the correction color parameters to obtain a feedback video image, and outputting the feedback video image to a monitoring screen so that the monitoring screen displays the feedback video image; and the correction color parameters are determined according to the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen.

In one embodiment, the display screen color parameter includes a first color look-up table of the display screen, and the monitor screen color parameter includes a second color look-up table of the monitor screen; determining correction color parameters according to the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen, including:

Correcting the color gamut parameters of the monitoring screen according to the first color lookup table and the second color lookup table to obtain a corrected color lookup table;

and determining correction color parameters according to the correction color lookup table.

In one embodiment, the corrected color parameters include a first color correction parameter, a second color correction parameter, and a third color correction parameter, and performing color correction processing on the target video image based on the corrected color parameters to obtain a return video image, including:

and carrying out color correction on the target video image based on the first color correction parameter, the second color correction parameter and the third color correction parameter to obtain a return video image.

In one embodiment, the method further comprises: performing color correction processing on the video source image based on the correction color parameters to obtain a monitoring video image;

and outputting the monitoring video image to the monitoring screen so that the monitoring screen displays the monitoring video image.

In one embodiment, after obtaining the feedback video image, before outputting the feedback video image to the monitor screen, the method further includes: and scaling the returned video image.

In a second aspect, the present application also provides an image processing apparatus. The apparatus comprises: a main processor and a data processor;

the main processor is used for acquiring a video source image and transmitting the video source image to the data processor;

the data processor is used for acquiring at least one path of video source image from the video source images, determining a target video image based on the video source images, carrying out color correction processing on the target video image based on correction color parameters to obtain a return video image, wherein the correction color parameters are determined according to display screen color parameters of a display screen and monitor screen color parameters of a monitor screen;

the main processor is further configured to output the target video image to the display screen, so that the display screen displays the target video image, and output the feedback video image to the monitor screen, so that the monitor screen displays the feedback video image.

In one embodiment, the main processor is further configured to obtain a backhaul display scaling parameter, and send the backhaul display scaling parameter to the data processor;

the data processor is further configured to perform data scaling processing on the backhaul video image based on the backhaul display scaling parameter.

In a third aspect, the present application also provides an image processing system. The system comprises: the image processing device, at least one signal source device connected with the image processing device, a display screen and a monitoring screen.

In a fourth aspect, the present application also provides an image processing apparatus. The device comprises:

the target image determining module is used for acquiring at least one path of video source image and determining a target video image based on the video source image;

the transmission module is used for outputting the target video image to a display screen so that the display screen displays the target video image;

the feedback processing module is used for carrying out color correction processing on the target video image based on the correction color parameters to obtain a feedback video image, and outputting the feedback video image to a monitoring screen so that the monitoring screen displays the feedback video image; and the correction color parameters are determined according to the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen.

In a fifth aspect, the present application also provides a computer-readable storage medium. The computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of:

The image processing method, the device, the system, the device and the computer readable storage medium are used for determining a target video image based on at least one video source image by acquiring the video source image; outputting the target video image to a display screen so that the display screen displays the target video image; performing color correction processing on the target video image based on the correction color parameters to obtain a return video image, and outputting the return video image to the monitoring screen so that the monitoring screen displays the return video image; the correction color parameters are determined according to the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen. Therefore, when the display screen and the monitoring screen are determined, the display screen color parameters of the display screen and the monitoring screen color parameters of the monitoring screen are determined, and further, correction color parameters for carrying out color correction on the target video image can be determined based on the display screen color parameters and the monitoring screen color parameters when the monitoring screen carries out feedback display on the target video image. Before the monitoring screen carries out the passback display to the target video image, the target video image is subjected to color correction processing based on correction color parameters to obtain the passback video image, so that the consistency of the color of the monitoring screen and the color of the target video image displayed by the display screen when the passback video image is displayed by the monitoring screen can be ensured, the passback display effect is better, and the high application requirement of color restoration can be met.

Drawings

FIG. 1 is a block diagram of an image processing system in one embodiment;

FIG. 2 is a flow chart of an image processing method in one embodiment;

FIG. 3 is a block diagram of an image processing system according to another embodiment;

FIG. 4 is a schematic diagram of a monitor display interface in one embodiment;

FIG. 5 is a schematic diagram of a CPU controlled video PHY controller and protocol decoder in one embodiment;

FIG. 6 is a block diagram of a monitor correction LUT table processing unit in one embodiment;

FIG. 7 is a timing diagram of the internal RAM of the CPU and FPGA read-write correction data LUT in one embodiment;

FIG. 8 is a block diagram of a scaler module processing unit in one embodiment;

FIG. 9 is a block diagram of a memory writing unit according to one embodiment;

FIG. 10 is a state machine block diagram of a read/write Frame buffer memory in one embodiment;

FIG. 11 is a block diagram of an image processing apparatus in one embodiment;

FIG. 12 is a schematic workflow diagram of an image processing device in one embodiment;

FIG. 13 is a schematic diagram of CPU and FPGA communication in one embodiment;

FIG. 14 is a block diagram showing the structure of an image processing apparatus in one embodiment;

fig. 15 is an internal structural view of a computer device in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.

The image processing method provided in the embodiment of the present application may be applied to an image processing system as shown in fig. 1, where the image processing system includes an image processing apparatus 100, at least one signal source apparatus 200 connected to the image processing apparatus 100, a display screen 300, and a monitor screen 400. Wherein, the image processor 100 is configured to receive a video source image output by at least one signal source device 200 (each signal source device 200 outputs a video source image); determining a target video image based on the video source image; outputting the target video image to the display screen 300 so that the display screen 300 displays the target video image; performing color correction processing on the target video image based on the correction color parameters to obtain a returned video image, and outputting the returned video image to the monitor screen 400 so that the monitor screen 400 displays the returned video image; the corrective color parameter is determined based on the display screen color parameter of the display screen 300 and the monitor screen color parameter of the monitor screen 400.

The signal source device 200 for outputting a video source image may be a video player or a PC (personal computer) or the like having a video output function. The types of the plurality of signal source devices 200 may be the same or different, and furthermore, the interface types of the transmission lines for transmitting the video source images between the respective signal source devices 200 and the image processing device 100 may be the same or different, and specifically may include, but not limited to, HDMI (High Definition Multimedia Interface ) 2.1 and DP1.4 (displayport 1.4). The display screen 300 may be an LED screen, an LCD (Liquid Crystal Display ) or other type of display screen, and the image processing apparatus 100 may be a transmission card or other display controller. For ease of understanding, the following description will take the display screen 300 as an LED display screen and the image processing apparatus 100 as a transmitting card as an example.

In one embodiment, as shown in fig. 2, an image processing method is provided, taking an example that the method is applied to the image processing apparatus in fig. 1 as an illustration, comprising the steps of:

step 200, at least one path of video source image is acquired, and a target video image is determined based on the video source image.

When only one path of video source image is input to the image processing device, the image processing device decodes the path of video source image and then performs display processing to obtain a target video image. When the video source images input to the image processing equipment are multiple paths, the image processing equipment decodes each path of video source image to obtain each path of source signal, and meanwhile, the image processing equipment also acquires a selection signal, selects a corresponding source signal as a target source signal according to the selection signal, and performs display processing on the corresponding source signal to obtain a target video image. The target source signals can be one path or multiple paths, and the selection signals can be input by a user through interaction equipment connected with the image processing equipment according to the selection signals. The display processing may include video signal processing associated with LED display screens such as color adjustment, color replacement, GAMMA (GAMMA) change, and the like.

Step 300, outputting the target video image to the display screen, so that the display screen displays the target video image.

It can be understood that the LED display screen includes a receiving processing unit (such as a receiving card) and a plurality of LED display modules that are connected, and the image processing apparatus can output the target video image to the receiving card built in the LED display screen, and then the receiving card drives each LED display module of the LED display screen to display, as shown in fig. 3. When the image processing device outputs the target video image to a receiving card arranged in the LED display screen, the target video image can be particularly packaged and then sent to the receiving card through a multi-path connector interface (such as Registered Jack-45), and the receiving card drives the LED display module to display.

Step 400, performing color correction processing on the target video image based on the correction color parameters to obtain a return video image, and outputting the return video image to the monitor screen so that the monitor screen displays the return video image; the correction color parameters are determined according to the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen.

In order to improve the color reduction degree of the monitor screen, the display colors of the monitor screen and the display screen are consistent, and when the display screen and the monitor screen are determined, the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen can be determined, so that the correction color parameters for carrying out color correction on the target video image are firstly determined based on the display screen color parameters and the monitor screen color parameters when the monitor screen carries out back transmission display on the target video image; before the monitoring screen displays the target video image, color correction processing is carried out on the target video image based on the correction color parameters to obtain the returned video image, so that the color of the target video image displayed by the time domain display screen of the returned video image displayed by the monitoring screen is consistent.

If the user changes the display screen and/or the monitoring screen in the use process, the user only needs to determine new correction color parameters according to the color parameters of the changed screen, and the new correction color parameters are utilized to carry out color correction processing on the target video image to obtain the returned video image, so that the color consistency between the display of the returned video image by the monitoring screen and the display of the target video image by the display screen can be ensured.

The image processing method comprises the steps of obtaining at least one path of video source image, and determining a target video image based on the video source image; outputting the target video image to a display screen so that the display screen displays the target video image; performing color correction processing on the target video image based on the correction color parameters to obtain a return video image, and outputting the return video image to the monitoring screen so that the monitoring screen displays the return video image; the correction color parameters are determined according to the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen. Therefore, when the display screen and the monitoring screen are determined, the display screen color parameters of the display screen and the monitoring screen color parameters of the monitoring screen are determined, and further, correction color parameters for carrying out color correction on the target video image can be determined based on the display screen color parameters and the monitoring screen color parameters when the monitoring screen carries out feedback display on the target video image. Before the monitoring screen carries out the passback display to the target video image, the target video image is subjected to color correction processing based on correction color parameters to obtain the passback video image, so that the consistency of the color of the monitoring screen and the color of the target video image displayed by the display screen when the passback video image is displayed by the monitoring screen can be ensured, the passback display effect is better, and the high application requirement of color restoration can be met. In addition, when the user changes the display screen or the monitoring screen, the color restoration degree of the feedback display can be ensured only by determining the correction color parameters according to the color parameters of the changed screen, and the flexibility of the system is improved.

In one embodiment, the display screen color parameters include a first color look-up table of the display screen and the monitor screen color parameters include a second color look-up table of the monitor screen; determining correction color parameters according to display screen color parameters of a display screen and monitor screen color parameters of a monitor screen, comprising: correcting the color gamut parameters of the monitoring screen according to the first color lookup table and the second color lookup table to obtain a corrected color lookup table; and determining correction color parameters according to the correction color lookup table.

The color lookup Table is a Look-Up Table (LUT), the first color lookup Table of the display screen is referred to as a first LUT, the second color lookup Table of the monitor screen is referred to as a second LUT, and the correction color lookup Table is referred to as a correction LUT.

In the traditional feedback technology, the display screen displays according to the first LUT table, the monitoring screen displays according to the second LUT table, and because of the difference between the two screens, the two LUT tables are also mismatched, so that the color reduction degree is low. In this embodiment, the correction color parameters include correction LUT tables, and the correction LUT tables are generated by establishing a correspondence between the first LUT tables and the second LUT tables, so that when the monitor screen displays the target video image, the color gamut parameters of the monitor screen can be corrected by the correction LUT tables, so that the display colors of the monitor screen and the display screen are consistent.

In one embodiment, the corrected color parameters include a first color correction parameter, a second color correction parameter, and a third color correction parameter, and in step 400, performing color correction processing on the target video image based on the corrected color parameters to obtain a return video image, including: and carrying out color correction on the target video image based on the first color correction parameter, the second color correction parameter and the third color correction parameter to obtain a return video image.

The first color, the second color, and the third color may be Red (Red), green (Red), and Blue (Blue), respectively, and the first color correction parameter, the second color correction parameter, and the third color correction parameter include correction LUT tables of Red, green, and Blue, respectively. Taking Red as a first color, green as a second color and Blue as a third color as an example, the first color correction parameters include Red-correction LUT tables, the second color correction parameters include Green-correction LUT tables, and the third color correction parameters include Blue-correction LUT tables. And when the color correction is carried out on the target video image, respectively correcting the target video image based on the Red-correction LUT table, the Green-correction LUT table and the Blue-correction LUT table, and finally obtaining the corrected feedback video image.

In one embodiment, after obtaining the feedback video image, the method further comprises scaling the feedback video image before outputting the feedback video image to the monitor screen.

The zooming processing of the returned video image may specifically include obtaining a returned display zooming parameter, and zooming the returned video image based on the returned display zooming parameter. The return display scaling parameters may be pre-stored in the image processing device, so that the return display scaling parameters may also be input by a user through an interaction device connected to the image processing device, where the return display scaling parameters include scaling related parameters such as a scaling ratio.

In one embodiment, the image processing method further includes: performing color correction processing on the video source image based on the correction color parameters to obtain a monitoring video image; and outputting the monitoring video image to a monitoring screen so that the monitoring screen displays the monitoring video image.

In this embodiment, the video source image is color corrected based on the correction color parameter to obtain the monitoring video image, and then the monitoring video image is displayed through the monitoring screen, so that monitoring of the original video source content is realized.

In one embodiment, after obtaining the monitoring video image, before outputting the monitoring video image to the monitor screen, scaling the monitoring video image is further included.

The scaling of the surveillance video image may specifically include obtaining a surveillance display scaling parameter, and scaling the surveillance video image based on the surveillance display scaling parameter. The monitoring display scaling parameters may be pre-stored in the image processing device, so that the monitoring display scaling parameters may also be input by a user through an interaction device connected to the image processing device, and the monitoring display scaling parameters include scaling related parameters such as scaling.

In order to facilitate understanding of the foregoing embodiments, please refer to fig. 4, taking the received video source image as an example of three paths, "video source 1 image", "video source 2 image" and "video source 3 image" respectively represent video images obtained by performing color correction processing and scaling processing on the three paths of video source images, "return video image" represents a video image obtained by performing color correction processing and scaling processing on the target video image, and "return video image" is used for monitoring content actually displayed on the display screen.

Further, according to actual needs, the display size of the original images (i.e. "video source 1 image", "video source 2 image" and "video source 3 image") can be set to be a smaller display area, and the display size of the "return video image" can be set to be a larger display area, so that the actual display content of the current display screen can be observed more clearly while the original images are monitored.

It should be understood that, although the steps in the flowcharts related to the embodiments described above are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.

In one embodiment, an image processing apparatus is provided that includes a main processor and a data processor. The main processor is used for acquiring the video source image and transmitting the video source image to the data processor. The data processor is used for acquiring at least one path of video source image from the video source images, determining a target video image based on the video source images, carrying out color correction processing on the target video image based on correction color parameters to obtain a return video image, and determining the correction color parameters according to the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen. The main processor is also used for outputting the target video image to the display screen so that the display screen displays the target video image, and outputting the return video image to the monitoring screen so that the monitoring screen displays the return video image.

The types of the main processor and the data processor can be set according to actual needs, for example, the main processor is a CPU (Central Processing Unit ), the data processor is an FPGA (Field Programmable Gate Array ), and the CPU communicates with the FPGA.

The CPU controls the input interface of the multi-path video source through the driving mode of the bottom layer, wherein the input interface comprises a PHY (Physical, i.e. Physical layer) controller and a protocol decoder (both of which are internally implemented by the FPGA), as shown in fig. 5, so that the FPGA decodes the video stream image of the multi-path video source, and the CPU obtains the resolution information of the input source through the driving of the bottom layer to prepare for the subsequent scaling process.

Further, the CPU issues video processing related parameters such as correction color parameters, color replacement, a display screen Gamma table and the like to the FPGA. The FPGA comprises a monitor screen correction LUT table processing unit, as shown in fig. 6, a CPU writes correction LUT tables into three internal RAMs of the FPGA, namely a Red RAM, a Green RAM and a Blue RAM, respectively, the correction LUT tables represent Red, green and Blue, write Address inputs is input with a numerical value before correction by the CPU, write Data input is input with a numerical value after correction by the CPU, write Enable signal is input by the CPU, and the relation between addresses and Data is established in such a way that the relation between the Data before correction and the Data after correction is one-to-one. Secondly, the FPGA uses Video data valid as a Read Enable signal (Read Enable) of the RAM, the source display RGB data is used as a Read address input (Read Address input), the RAM output is the corresponding corrected RGB data, so that the display data before correction is input, the corrected display data is output, and a time sequence diagram of the RAM in the Read-write correction data LUT can be shown by referring to FIG. 7.

In this embodiment, the target video image before correction is input to obtain the corrected return video image, the return video image is written into the display memory, and the CPU reads the display memory to display the return video image on the monitor screen.

Further, the FPGA is also used for carrying out color correction processing on the video source image before correction to obtain a corrected monitoring video image, writing the corrected monitoring video image into the display memory, and the CPU displays the monitoring video image on the monitoring screen by reading the display memory, so that the original image is monitored.

In one embodiment, the main processor is further configured to obtain a return display scaling parameter, and send the return display scaling parameter to the data processor; the data processor is further configured to perform a data scaling process on the backhaul video image based on the backhaul display scaling parameters.

Further, the main processor is further used for acquiring the monitoring display scaling parameters and sending the monitoring display scaling parameters to the data processor; the data processor is also used for monitoring the display scaling parameters to scale the monitoring video image.

In order to solve the problem that the conventional return display is limited in processing capacity due to the fact that CPU software is required for zooming and displaying images, and the return display images are blocked frequently, an image zooming algorithm realized by using a CPU to control an FPGA (field programmable gate array) is used for processing the return display images in a hardware acceleration mode, so that the number of image display frames of the return display is improved, and the smoothness of the return display is improved.

Specifically, the FPGA includes a scaler (image scaler) module processing unit, as shown in fig. 8, first, the CPU writes the transverse resolution before scaling, the longitudinal resolution before scaling, the transverse resolution after scaling, the longitudinal resolution after scaling, the scaling, and the enable signal into an internal register of the scaler module through the dynamic configuration interface, where the address range of the register is 0-255, and when the scaler module reads that the internal enable signal register is 1, the internal scaler bilinear algorithm module is started to scale the video image (the feedback video image and/or the monitoring video image) after color correction to the size formulated by the CPU, and output the scaled video image. Wherein the internal registers are as shown in table 1:

register address	Register name
			00	Reset signal
01	Input lateral resolution
		02	Input longitudinal resolution
03	Input scaling
		04	Outputting lateral resolution
05	Output longitudinal resolution
		06	Output scaling
07	Enable signal

TABLE 1

The bit width of the register is 16 bits, the maximum input/output horizontal resolution is 4096, the maximum input/output vertical resolution is 2160, when the reset signal register is 1, the registers 01-06 are reset to 0, when the enable signal is 1, the registers 01-06 are applied to the internal logic, and the internal scaler bilinear algorithm module is started. When the input resolution or the output resolution is changed, the reset signal register is set to be 1, after a small period of time delay, the 01-06 register is written into a new value, when the filling of the register is completed, the enable signal register is set to be 1, and the dynamic configuration scaler module can be realized through the steps, namely, a user can change the monitoring screen or the input source resolution on line.

The Scaler algorithm is a general scaling algorithm, and the scaling ratio of the Scaler bilinear algorithm module is calculated as follows: setting the transverse resolution of the monitor screen as Horres1 and the longitudinal resolution as VerRes1; the video source has the transverse resolution of Horres2 and the longitudinal resolution of VerRes2; the transverse duty ratio of the picture in the monitoring screen is Xhor; the transverse duty ratio of the picture in the monitoring screen is Xver; the lateral scaling is Yhor; the longitudinal scaling is Yver; yhor= (Xhor. HorRes1/HorRes 2). 65536; yver= (Xver x VerRes1/VerRes 2) x 65536; the multiplication 65536 is to convert the decimal to a 16bit integer.

The display memory writing unit is shown in fig. 9, and firstly, the scaled video image is transferred into a line buffer (line buffer), after one line of data is written, the line buffer is read out and transferred to a Burst Write data module (Burst Write DDR 4), and the line buffer data is written into a memory (DDR 4) according to a Burst Write mode, so that the display data is written into the memory. Single pixel data arrangements written into memory such as

Table 2 shows:

8bit:0xFF	Red:8bit	Green:8bit	Blue:8bit
				31bit～24bit～	23bit～16bit	15bit～8bit	7bit～0bit

TABLE 2

If the Burst write DDR4 interface is 128 bits, 4 pixels (pixels) are required to be output at a time, so that a data arrangement mode of the FPGA can be conveniently achieved by 32 bits, meanwhile, the upper computer can directly read 32 bits to represent one pixel at a time, splicing and decomposition are not needed, and the load of CPU operation is reduced.

Regarding the frame buffer area in the memory, in order to avoid the situation that the writing memory and the reading memory are in the same frame area and have picture tearing, at least two frame buffer areas are needed, when the frame rate is increased, the number of buffers is also increased, so that 4 buffer areas are adopted, and the state machine for reading and writing the memory is shown in fig. 10. When the memory is read and written, the FPGA firstly writes Frame buffer (Frame buffer) 0, waits for the completion of writing, executes write Frame buffer1, waits for the completion of writing, executes write Frame buffer2, waits for the completion of writing, executes write Frame buffer3, waits for the completion of writing and returns to write Frame buffer0, and sequentially loops.

Specifically, as shown in fig. 11, the image processing apparatus includes an FPGA and a CPU, where the FPGA includes a video signal decoding module, a monitor correction LUT table processing unit, and a scaler module processing unit, and after multiple paths of video source signals (for example, three paths of video sources) are input to the image processing apparatus, the corresponding original video source images, such as a video source image 1, a video source image 2, and a video source image 3, are decoded by each video signal decoding module of the FPGA; processing is carried out in two ways, wherein the original multipath video source image 1, video source image 2 and video source image 3 are written into a display memory after passing through three correction LUT tables and three scaler modules; the other is that the CPU communicates with the FPGA to issue a selection signal, the FPGA selects one path of video source image as a display screen to display by switching a multiplexer, the selected video source image is processed by video display related to an LED screen (such as color adjustment, color replacement and GAMMA change) to obtain a target video image, the processed target video image is packaged by an Ethernet packaging module and then is sent to a plurality of receiving cards through a plurality of RJ45 interfaces, and the target video image is written into a display memory after passing through a correction LUT table and a scaler module; and the CPU reads the memories of the four display areas and displays the original image of the video source and the image processed by the video processing module in a monitoring screen. Therefore, the original video images of the video sources are displayed, the original content conditions of a plurality of signal sources can be monitored, the video images after image processing are displayed, and the content conditions of the user, which are actually displayed on the display screen after adjustment, can be monitored.

As shown in fig. 12, the detailed workflow of the image processing apparatus is that first, the CPU controls the input interface of the multiple video sources through the driving mode of the bottom layer, which includes the PHY controller and the protocol decoder, so that the FPGA decodes the video stream data of the multiple video sources, and the CPU obtains the resolution information of the input sources through the driving mode of the bottom layer.

Next, as shown in fig. 13, the CPU communicates with the FPGA, and the CPU issues parameters of color adjustment to the FPGA, and the decoded original video data is processed by the video processing module to obtain adjusted video data, that is, display data on the final display screen; and simultaneously, the decoded video stream data of the plurality of input sources are respectively sent to the respective monitoring display screen correction LUT unit module and scaler module without video processing.

Next, the CPU communicates with the FPGA, and issues the correction LUT table data of the monitor display screen to the FPGA, as shown in fig. 5, the FPGA writes the correction LUT table data into the internal cache RAM, inputs the adjusted video data into the address of the correction LUT table processing unit, and reads the corrected display data, so that the color of the monitor display screen is close to the color finally displayed by the LED display screen, and when the user changes the monitor screen or the display screen, the CPU can issue the correction LUT table data of the corresponding monitor screen to the FPGA again, so that the monitor screen is corrected again, thereby improving the flexibility of the system.

Next, the CPU obtains the scaling ratio by obtaining the resolution of the monitor display, compares the resolution of the input source with the resolution of the monitor display screen, and transmits the input resolution, the output resolution and the scaling ratio to the Scaler module (the module is realized by the FPGA), and finally outputs the display size suitable for the monitor screen. Meanwhile, the function is realized in the FPGA without participation of a CPU in an actual operation process, so that the load of the CPU is reduced, and the frame rate of the echo is improved.

Finally, the FPGA inputs the scaled display data output by the Scaler module into a line buffer, after the buffer is full of one line, reads out the line buffer data and sends the line buffer data to a Burst Write transmission module (Burst Write DDR 4), and the Burst Write transmission module writes the line buffer data into a memory (for example, DDR 4) in a high-speed Burst mode and continuously writes one frame of data; the CPU reads out the display data in the memory, continuously reads out the display data of one frame, and displays the display data on the monitoring display screen, namely, the display is returned from the signal source and displayed on the terminal monitoring display. The complexity of CPU reading can be reduced, the load of the CPU is lightened, and the dominant energy is improved through the data format shown in the second table. The frame buffer blocks of the FPGA writing frame buffer and the frame buffer blocks of the CPU reading frame buffer need to be spaced apart, as shown in a state machine shown in fig. 10, so that the conflict between the transmission of the CPU reading frame buffer and the FPGA writing frame buffer is avoided, the situation of picture tearing is avoided, and the picture fluency is improved.

The image processing equipment supports that the display color of the LED display screen is matched with the display color of the monitoring screen, and the frame rate of the back display is increased through a dynamically configurable Scaler algorithm realized by the FPGA. The function of accurately and smoothly monitoring the play content of the LED display screen is realized, and a plurality of input pictures can be monitored in advance.

The embodiment of the application also provides an image processing system which comprises an image processing device, at least one signal source device connected with the image processing device, a display screen and a monitoring screen. The image processing device may be set with reference to the above embodiments, and will not be described in detail.

Based on the same inventive concept, the embodiments of the present application also provide an image processing apparatus for implementing the above-mentioned image processing method. The implementation of the solution provided by the apparatus is similar to the implementation described in the above method, so the specific limitation of one or more embodiments of the image processing apparatus provided below may refer to the limitation of the image processing method hereinabove, and will not be repeated herein.

In one embodiment, as shown in fig. 14, there is provided an image processing apparatus including: the device comprises a target image determining module 10, a transmitting module 20 and a back transmission processing module 30, wherein:

The target image determining module 10 is configured to acquire at least one path of video source image, and determine a target video image based on the video source image;

a transmission module 20 for outputting the target video image to the display screen so that the display screen displays the target video image;

the feedback processing module 30 is configured to perform color correction processing on the target video image based on the correction color parameter, obtain a feedback video image, and output the feedback video image to the monitor screen, so that the monitor screen displays the feedback video image; the correction color parameters are determined according to the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen.

In one embodiment, the backhaul processing module 30 is further configured to correct the color gamut parameter of the monitor screen according to the first color lookup table and the second color lookup table to obtain a corrected color lookup table; and determining correction color parameters according to the correction color lookup table.

In one embodiment, the backhaul processing module 30 is further configured to perform color correction on the target video image based on the first color correction parameter, the second color correction parameter, and the third color correction parameter, to obtain a backhaul video image.

In one embodiment, the backhaul processing module 30 is further configured to perform color correction processing on the video source image based on the corrected color parameter to obtain a monitoring video image; and outputting the monitoring video image to a monitoring screen so that the monitoring screen displays the monitoring video image.

In one embodiment, the image processing apparatus further includes: and the scaling module is used for scaling the returned video image.

The respective modules in the above-described image processing apparatus may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.

In one embodiment, a computer device is provided, which may be a server, and the internal structure of which may be as shown in fig. 15. The computer device includes a processor, a memory, an Input/Output interface (I/O) and a communication interface. The processor, the memory and the input/output interface are connected through a system bus, and the communication interface is connected to the system bus through the input/output interface. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer device is used for storing video processing related data such as correction LUT tables. The input/output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement an image processing method.

It will be appreciated by those skilled in the art that the structure shown in fig. 15 is merely a block diagram of a portion of the structure associated with the present application and is not limiting of the computer device to which the present application is applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.

In an embodiment, there is also provided a computer device comprising a memory and a processor, the memory having stored therein a computer program, the processor implementing the steps of the method embodiments described above when the computer program is executed.

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored which, when executed by a processor, carries out the steps of the method embodiments described above.

In an embodiment, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the steps of the method embodiments described above.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the various embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magnetic random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (Phase Change Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like. The databases referred to in the various embodiments provided herein may include at least one of relational databases and non-relational databases. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processors referred to in the embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic units, quantum computing-based data processing logic units, etc., without being limited thereto.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The above examples only represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the present application. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application shall be subject to the appended claims.

Claims

1. An image processing method, the method comprising:

2. The method of claim 1, wherein the display screen color parameters comprise a first color look-up table of the display screen and the monitor screen color parameters comprise a second color look-up table of the monitor screen; determining correction color parameters according to the display screen color parameters of the display screen and the monitor screen color parameters of the monitor screen, including:

3. The method of claim 2, wherein the corrected color parameters include a first color correction parameter, a second color correction parameter, and a third color correction parameter, wherein performing the color correction process on the target video image based on the corrected color parameters results in a return video image, comprising:

4. A method according to any one of claims 1 to 3, further comprising:

Performing color correction processing on the video source image based on the correction color parameters to obtain a monitoring video image;

5. A method according to any one of claims 1 to 3, wherein after obtaining the feedback video image, before outputting the feedback video image to the monitor screen, further comprising:

and scaling the returned video image.

6. An image processing apparatus, characterized in that the image processing apparatus comprises a main processor and a data processor;

7. The image processing apparatus according to claim 6, wherein,

the main processor is further configured to obtain a return display scaling parameter, and send the return display scaling parameter to the data processor;

8. An image processing system comprising an image processing device according to claim 6 or 7, at least one signal source device connected to the image processing device, a display screen and a monitor screen.

9. An image processing apparatus, characterized in that the apparatus comprises:

10. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 5.