WO2022007787A1

WO2022007787A1 - Image processing method and apparatus, device and medium

Info

Publication number: WO2022007787A1
Application number: PCT/CN2021/104709
Authority: WO
Inventors: 华路延
Original assignee: 广州虎牙科技有限公司
Priority date: 2020-07-07
Filing date: 2021-07-06
Publication date: 2022-01-13

Abstract

Disclosed in the embodiments of the present invention are an image processing method and apparatus, a device and a medium. The method comprises: obtaining a light source model of a target image; and processing a light source region of the target image according to the light source model.

Description

Image processing method, apparatus, device and medium

This application claims the priority of the Chinese patent application with the application number 202010647193.5 filed with the China Patent Office on July 7, 2020 and the Chinese patent application with the application number 202011043175.2 filed with the China Patent Office on September 28, 2020. The entire contents of are incorporated herein by reference.

technical field

The embodiments of the present application relate to the technical field of image processing, for example, to an image processing method, apparatus, device, and medium.

Background technique

With the progress of society and the development of economy, on the basis of realizing Internet surfing, the functions of capturing images and displaying images of mobile terminals have attracted more and more attention from users, and users have also put forward higher requirements for image processing of mobile terminals. .

When the mobile terminal captures an image in a scene with less light, the brightness of the captured image is dark, and the brightness enhancement solution in the related art can only improve the overall brightness of the image, and cannot adjust the brightness of the image or video. light source display effect.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an image processing method, apparatus, device, and medium, so as to adjust the display effect of a light source in a video or image, and improve the degree of freedom and diversity of the display effect of the video or image.

In a first aspect, an embodiment of the present application provides an image processing method, including:

Obtain the light source model of the target image;

The light source area of the target image is processed according to the light source model.

Optionally, acquiring the light source model of the target image includes: acquiring the target image, and determining a light source area in the target image; building a light source model in the light source area;

Processing the light source area of the target image according to the light source model includes: determining an opacity parameter of the light source area according to the light source model; The light source texture and the opacity parameter of the light source area are preselected to obtain the display texture in the light source area.

Optionally, the light source model for acquiring the target image includes: a light source model for acquiring an optical image; the light source model represents a light source shape and a light source position in the optical image;

The processing of the light source area of the target image according to the light source model includes: obtaining light source information to be added according to the light source model and a preset mapping curve; the light source information to be added represents the light source of the optical image The pixel added value of each pixel point in all the pixel points in the area, the light source area is the image area determined by the light source shape and the light source position; update the light source area according to the light source information to be added. The pixel value of each pixel point to get the target processed image.

In a second aspect, an embodiment of the present application further provides an image processing device, the device includes: a light source model acquisition module, configured to acquire a light source model of an optical image; a light source area processing module, configured to The light source area of the optical image is processed.

Optionally, the light source model acquisition module includes: a light source area determination unit, configured to acquire a target image and determine a light source area in the target image; a light source model construction unit, configured to construct a light source model in the light source area ;

The light source area processing module includes: an opacity parameter determination unit configured to determine an opacity parameter of the light source area according to the light source model; a light source area adjustment unit configured to The preselected light source texture in the light source area and the opacity parameter of the light source area are used to obtain the display texture in the light source area.

Optionally, the light source model obtaining module is a light source model configured to obtain an optical image; the light source model represents the light source shape and light source position in the optical image;

The light source area processing module includes: an information processing unit configured to obtain light source information to be added according to the light source model and a preset mapping curve; the light source information to be added represents each pixel in the light source area. The pixel added value of each pixel point, the light source area is the image area determined by the light source shape and the light source position; the image updating unit is configured to update each pixel in the light source area according to the light source information to be added The pixel value of the point to get the target processed image.

In a third aspect, an embodiment of the present application further provides a computer device, the computer device includes: one or more processors; a memory configured to store one or more programs, when the one or more programs are stored When executed by the one or more processors, the one or more processors are caused to implement the image processing method described in any embodiment.

In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium storing a computer program, and when the program is executed by a processor, the image processing method described in any of the embodiments is implemented.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present application, the accompanying drawings required in the embodiments will be briefly introduced below. The following drawings only show some embodiments of the present application, and therefore should not be regarded as compromising the scope of the application. limit.

1 is a flowchart of an image processing method provided by an embodiment of the present application;

2 is a flowchart of another image processing method provided by an embodiment of the present application;

3 is an example diagram of identification of a light source area provided by an embodiment of the present application;

4 is a flowchart of another image processing method provided by an embodiment of the present application;

5 is an exemplary diagram of a light source model provided by an embodiment of the present application;

6 is an example diagram of a calculation parameter of an opacity parameter provided by an embodiment of the present application;

7 is a flowchart of another image processing method provided by an embodiment of the present application;

8 is a flowchart of another image processing method provided by an embodiment of the present application;

FIG. 9A is a schematic diagram of an optical image before processing by the image processing method provided by an embodiment of the present application;

FIG. 9B is a schematic diagram of a target processed image obtained after processing the optical image in FIG. 9A by using the image processing method provided by the embodiment of the present application.

10 is a flowchart of a light source model for acquiring an optical image provided by an embodiment of the present application;

11 is a schematic diagram of the division of an optical image provided by an embodiment of the present application;

12 is a flowchart of another image processing method provided by an embodiment of the present application;

13 is a schematic diagram of obtaining transparency degree information according to an embodiment of the present application;

14 is a flowchart of updating the pixel value of each pixel in the light source area according to the light source information to be added, and obtaining a target processing image, according to an embodiment of the present application;

FIG. 15 is a schematic structural diagram of an image processing apparatus provided by an embodiment of the present application;

FIG. 16 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present application;

FIG. 17 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present application;

18 is a schematic structural diagram of a computer device provided by an embodiment of the present application;

FIG. 19 is a schematic structural diagram of an image processing device according to an embodiment of the present application.

detailed description

The present application will be described below with reference to the accompanying drawings and embodiments. The embodiments described here are only used to explain the present application, but not to limit the present application. For convenience of description, the drawings only show some but not all structures related to the present application.

Example 1

FIG. 1 is a flowchart of an image processing method provided by an embodiment of the present application. The method may be performed by the image processing apparatus provided in any embodiment of the present application, and the apparatus may be composed of hardware and/or software, and may generally be integrated in computer equipment, such as an intelligent mobile terminal.

As shown in FIG. 1 , the image processing method provided in this embodiment includes the following steps.

S10. Acquire a light source model of the target image.

Optionally, the light source model is a model for simulating the shape of the illumination range of the light source in the target image.

S20. Process the light source area of the target image according to the light source model.

Optionally, the light source area may be determined according to a light source model, or the light source area in the target image may be determined by detecting the brightness value of each pixel point in all the pixel points in the target image, for example, obtaining each pixel in the target image. The brightness value of each pixel point is screened out, and the pixel points whose brightness value is greater than the set brightness threshold value are selected, and the maximum connected area formed by these pixel points is used as the light source area.

The image processing method provided by this embodiment obtains the light source model of the image and uses the light source model to process the light source area of the image, so as to adjust the light source display effect of the light source area in the image, thereby improving the light source display effect.

Embodiment 2

With the continuous development of information technology, multimedia live broadcast has attracted people's attention because of its novel form and rich content. In order to improve the live video effect, multimedia live broadcast software usually has a video retouching function. If the multimedia live broadcast software can provide rich lighting display effects, it will improve the live video effect.

The image re-illumination method driven by big data can achieve the effect of re-illuminating the outdoor input image at a specified time. However, this method is complicated to implement and has a long image processing cycle, and is only suitable for image processing, not for video processing, such as real-time processing of live video, and this method has a single heavy lighting effect, which is not suitable for complex live scenes. Demand for display diversity in environments and live broadcast scenarios.

FIG. 2 is a flowchart of an image processing method provided by an embodiment of the present application. This embodiment can be applied to the case of adjusting the display effect of the light source in the image or video. The method can be executed by the image processing apparatus provided in any embodiment of the present application, and the apparatus can be composed of hardware and/or software, and can generally be integrated In the computer equipment, for example, it can be an intelligent mobile terminal.

As shown in FIG. 2 , the image processing method provided by this embodiment includes the following steps.

S110. Acquire a target image, and determine a light source area in the target image.

The target image refers to an image that needs to be adjusted for the display effect of the light source, and the target image may be an image or a video image frame in a video. Optionally, the video image frame obtained in real time by the live video software is used as the target image.

The light source area refers to the area where the light is displayed in the target image when the light source illuminates the object.

Exemplarily, the light source area in the target image may be determined by detecting the brightness value of each pixel point in all the pixel points in the target image. For example, the brightness value of each pixel in the target image is obtained, and the pixels whose brightness value is greater than the set brightness threshold are screened out, and the largest connected area formed by these pixels is used as the light source area.

As an optional implementation manner, determining the light source area in the target image includes: determining the light source area in the target image by using a light source detection model obtained by pre-training.

The training method of the light source detection model is as follows: an image sample set is obtained, the image sample set includes a large number of image samples, and each image sample is marked with a light source area. Optionally, the light source area is marked by the light source detection frame; the image sample set is trained by the target detection frame to obtain the light source detection model. Optionally, use the YOLO (You Only Look Once) target detection framework to train the image sample set.

Inputting the target image into the light source detection model can output the information of the light source area of the target image, for example, outputting the coordinate information of the light source target frame used to identify the light source area. As shown in FIG. 3 , the block 21 identifies the target image, the block 22 identifies the light source target frame, and the area within the block 22 includes the light source area of the target image.

S120. Build a light source model in the light source area, and determine an opacity parameter of the light source area according to the light source model.

The light source model refers to a model for simulating the shape of the illumination range of the light source, for example, a circular light source model, or an elliptical light source model.

Optionally, the light source model is constructed with the center point of the light source area as the center. As shown in FIG. 3 , a light source model 23 is constructed at the center point in the light source area 22 , and the shape parameters of the light source model 23 can be determined according to the display range of the light source in the light source area 22 .

Opacity parameter, used to indicate how opaque the pixels in the area are. If the opacity parameter of a pixel is 0%, then the pixel is completely transparent (that is, invisible), and the opacity parameter is 100%, which means a completely opaque pixel (that is, the display original pixels). A pixel's opacity parameter between 0% and 100% allows the pixel to show through the background as though it were through glass (translucency). The opacity parameter can be expressed as a percentage or a real number from 0 to 1.

According to the light source model, the opacity parameter of each pixel in all the pixels in the light source area is determined, that is, the transparency of the light source of each pixel in the light source area in the actual scene is simulated, and then the effect of light illuminating the object can be simulated. Optionally, set the opacity parameter of the pixels outside the light source model in the light source area to 0% or 0, according to the pixel position of each pixel in the light source model in the light source model according to the pixel position of each pixel point in the light source model in the light source area. to set the opacity parameter of each pixel.

S130. Obtain a display texture in the light source area according to the original image texture in the light source area, the preselected light source texture in the light source area, and the opacity parameter of the light source area.

The original image texture refers to the original texture of the target image.

Pre-selected light source textures refer to pre-selected light source textures used to provide light sources of different colors to simulate different light source effects within the light source area of the target image.

Optionally, the preselected light source texture in the light source area is implemented by filling with different pixel values. Assuming that the light source effect of normal light is simulated in the light source area, the pixel red, green and blue (RGB) values of all pixels of the preselected light source texture are (1,1,1).

The light source area is the superimposed area of the original image texture and the preselected light source texture, and the opacity parameter of the original image texture is 100% or 1, that is, it is completely opaque (the original pixels are displayed). The opacity parameter of the preselected light source texture is based on The opacity parameter of the light source area determined by the light source model is consistent.

Exemplarily, the preselected light source texture is adjusted using the matching opacity parameter, and the adjustment result is superimposed with the original image texture, so as to obtain the display texture in the light source area. However, in this scheme, the process of texture overlay may result in the overflow of the overlay result of pixel values, resulting in the inability to display the correct texture.

As an optional implementation manner, the display texture in the light source area is obtained according to the original image texture in the light source area, the preselected light source texture in the light source area, and the opacity parameter of the light source area, including: The pixel value of the image texture and the pre-selected light source texture in the light source area are superimposed, and the superposition result is corrected to obtain the superimposed texture in the light source area; use the opacity parameter of the light source area to adjust the superimposed texture to obtain the pending texture; use the light source area The original image texture inside is compensated for the to-be-determined texture to obtain the display texture in the light source area.

Take a pixel in the light source area as an example, record the pixel RGB value of the pixel in the original image texture is D (D≤1), and the pixel RGB value of the pixel in the preselected light source texture is S (S≤1) , and superimpose S and D. In the process of superposition, there may be cases where the pixel RGB value is superimposed and greater than 1, which in turn causes the pixel value to overflow, and the correct pixel RGB value cannot be obtained. Therefore, the superposition result of S and D is corrected so that the superposition sum of the pixel RGB values is always less than or equal to 1. For example, if the superposition sum of the pixel RGB values of a pixel point is greater than 1, the superposition sum of the pixel RGB values of the pixel point is set to 1. That is, the pixel RGB value T=S+D in the superimposed texture of the pixel in the light source area is obtained, and T≤1.

Use the opacity parameter A of the pixel to adjust the pixel RGB value of the pixel in the superimposed texture to obtain the pixel RGB value A*T of the pixel in the undetermined texture. Since the opacity parameter of the original image texture included in the overlay texture is 100% or 1, the original pixel value should be displayed, so it is necessary to use the pixel RGB value D of the pixel in the original image texture for the pixel in the pending texture. The pixel RGB value A*T is compensated to obtain the pixel RGB value F in the display texture of the pixel in the light source area.

Since the opacity parameter A of the pixel has been used to adjust the pixel RGB value D of the pixel in the original image texture, the pixel RGB value D of the pixel in the original image texture can be adjusted using (1-A) The result of (1-A)*D compensates the pixel RGB value A*T of the pixel in the undetermined texture.

That is, the calculation formula of the pixel RGB value F in the display texture of the pixel in the light source area is as follows:

T=S+D, T≤1;

F=A*T+(1-A)*D.

The opacity parameter A of the pixel point is the opacity parameter of the pixel point in the light source area determined according to the light source model. The pixel position of the pixel in the light source area is different, and the opacity parameter of the pixel is different.

In order to improve the processing speed of the target image, S130 includes: obtaining the light source area according to the original image texture in the light source area, the preselected light source texture in the light source area, and the opacity parameter of the light source area through a graphics processor (Graphics Processing Unit, GPU). Display texture inside.

Using the parallel processing capability of the GPU, multiple pixels in the light source area can be processed at the same time, so as to improve the rate of calculating the pixel RGB value F in the display texture of the multiple pixel points in the light source area.

Optionally, create two GPUs for processing the original texture and the preselected light texture.

Combining the display texture in the light source area and the original image texture outside the light source area, a processed image corresponding to the target image can be obtained, in which the display effect of the light source in the light source area has been adjusted.

In the technical solution provided by the embodiment of the present application, after the light source area in the target image is determined, a light source model is constructed in the light source area, which can simulate the illumination range of light sources with different shapes; the opacity of the light source area is determined according to the light source model parameter, which can simulate the effect of light illuminating the object; the display texture in the obtained light source area is determined according to the original image texture, pre-selected light source texture and opacity parameters of the light source area. The display texture is different, which realizes the adjustment of the display effect of the light source in the image, greatly enriches the application scene, and improves the degree of freedom and diversity of the image display effect. At the same time, the above technical solution is simple to implement and has a short processing period, and is suitable for application in online real-time video such as live video.

Embodiment 3

FIG. 4 is a flowchart of another image processing method provided by an embodiment of the present application. This embodiment is described on the basis of the above-mentioned embodiment, wherein constructing a light source model in the light source area includes: detecting the first length of the light source area in the horizontal direction and the second length in the vertical direction; When the first length is equal to the second length, in the light source area, take the center point of the light source area as the center and the first length as the diameter to construct a circular light source model; when the first length is not equal to the second length, In the light source area, with the center point of the light source area as the center, and the first length and the second length as the major and minor axes, an elliptical light source model is constructed.

As shown in FIG. 4 , the image processing method provided in this embodiment includes the following steps.

S210. Acquire a target image, and determine a light source area in the target image.

S220. Detect the first length of the light source region in the horizontal direction and the second length in the vertical direction.

The first length of the light source area in the horizontal direction and the second length in the vertical direction are detected, that is, the area span of the light source area in the horizontal direction and the vertical direction is detected, and then the shape of the light source model can be determined.

Optionally, the first length of the light source region in the horizontal direction and the second length in the vertical direction of the light source region are determined by detecting the luminance values of a plurality of pixel points. Referring to FIG. 5 , for example, the length of the line segment AB is the first length of the light source region in the horizontal direction, and the length of the line segment CD is the second length of the light source region in the vertical direction.

S230. Determine whether the first length and the second length are equal. If the first length and the second length are equal, execute S240. If the first length and the second length are not equal, execute S250.

S240. In the light source area, taking the center point of the light source area as the center and the first length as the diameter, construct a circular light source model, and execute S260.

When the first length is equal to the second length, a circular light source model can be constructed in the light source area, and the diameter of the light source model is the first length (or the second length). Set the center of the light source model (that is, the light source focus) at the center point of the light source area, such as point O as shown in Figure 5.

The expression of the circular light source model is as follows:

(x1, y1) are the coordinates of point O, and e is the diameter (first length or second length) of the light source model.

S250. In the light source area, taking the center point of the light source area as the center, and the first length and the second length as the major and minor axes, construct an elliptical light source model, and execute S260.

When the first length is not equal to the second length, an elliptical light source model can be constructed in the light source area, the axis length of the light source model in the horizontal direction is the first length, and the axis length in the vertical direction is the second length , the length of the long axis is the longer of the first length and the second length, and the length of the short axis is the shorter of the first length and the second length. Set the center of the light source model (that is, the light source focus) at the center point of the light source area, such as point O as shown in Figure 5.

As shown in FIG. 5 , the light source model 23 is an elliptical light source model constructed, and the expression is as follows:

(x1, y1) are the coordinates of point O, c is the length of the line segment AB (ie the first length), and d is the length of the line segment CD (ie the second length).

When the light source area is identified by a light source target frame (generally a box), the center of the light source model may also be set at the center point of the light source target frame. At this time, the first length and the second length are the range lengths of the light source area in the horizontal direction and the vertical direction in the light source target frame, respectively.

In this step, multiple light source models can be constructed to suit different image scenarios.

S260. Determine the opacity parameter of the light source area according to the light source model.

In this step, the opacity parameter of each pixel in the light source area is determined according to the light source model. The opacity parameter of each pixel is related to the positional relationship between each pixel and the light source model.

As an implementation manner, determining the opacity parameter of the light source area according to the light source model includes: setting the opacity parameter of the pixels outside the light source model in the light source area as a first target constant value, and the first target constant value is used for Indicates full transparency; according to the distance between each pixel in the light source model and the pixel in the center of the light source model, the opacity parameter of each pixel is set; The smaller the distance between the pixel point and the center pixel point, the smaller the value of the opacity parameter of the one pixel point.

In the light source area, in order to simulate the brightness distribution of the light source, the pixels are divided into two types: those outside the light source model and those inside the light source model. The opacity parameter of the pixels outside the light source model is set to the first target constant value representing full transparency, such as 0 or 0%, that is, the pixel values of these pixels are completely transparent; The opacity parameter is related to the coordinate position of the pixel point. The value of the opacity parameter of the pixel point closer to the center of the light source model is smaller, that is, the brighter the light source is displayed, and the opacity parameter of the pixel point in the light source model is in 0-1 or between 0%-100%.

As an optional implementation manner, the opacity parameter of the pixel point within the light source model in the light source area can be calculated according to the following formula:

Among them, A is the opacity parameter of the pixel point; a is the distance from the pixel point to the long axis or horizontal diameter of the light source model, b is the distance from the pixel point to the short axis or vertical diameter of the light source model, and a' is the pixel point along the The distance from the short axis direction or the vertical diameter direction to the boundary of the light source model, and b' is the distance from the pixel point to the boundary of the light source model along the long axis direction or the horizontal diameter direction.

This embodiment provides a simplified calculation method of the opacity parameter. The proportion of the distance between the horizontal diameter of the light source model and the distance between the pixel point and the vertical diameter of the light source model is calculated, and the value of the opacity parameter of the pixel point is calculated to simulate the transparency of the pixel point.

As shown in FIG. 6 , the light source target frame 22 is used to identify the light source area, and an elliptical light source model 23 is constructed in the light source target frame 22 (ie, the light source area). In the light source target frame 22, the opacity parameter of any pixel point M outside the light source model 23 is set to 0 or 0%, and the opacity parameter _AN of any pixel point N in the light source model 23 is calculated by the following formula:

Among them, NP1 is the distance from the pixel point N to the long axis of the light source model (that is, a), NQ1 is the distance from the pixel point N to the short axis of the light source model (that is, b), and NP2 is the pixel point N along the short axis direction to the light source model. The distance from the boundary of the pixel point (ie, a'), and NQ2 is the distance from the pixel point N to the boundary of the light source model (ie, b') along the long axis direction.

If a circular light source model is constructed in the light source target frame 22 (ie, the light source display area), NP1 is the distance from the pixel point N to the horizontal diameter of the light source model, and NQ1 is the vertical diameter from the target pixel point N to the light source model. NP2 is the distance from the target pixel N to the boundary of the light source model along the vertical diameter direction, and NQ2 is the distance from the target pixel N to the boundary of the light source model along the horizontal direction.

S270 , superimposing the pixel value of the original image texture in the light source area and the preselected light source texture in the light source area, and correcting the superimposition result to obtain the superimposed texture in the light source area.

S280. Use the opacity parameter of the light source area to adjust the superimposed texture to obtain a pending texture, and use the original image texture in the light source area to compensate for the pending texture to obtain a display texture in the light source area.

After obtaining the display texture in the light source area according to the original image texture in the light source area, the preselected light source texture in the light source area, and the opacity parameter of the light source area, the method further includes: setting an inconsistency of the original image texture outside the light source area The transparency parameter and the opacity parameter of the displayed texture in the light source area are both the second target constant value, and the second target constant value is used to represent opacity; according to the opacity of the original image texture outside the light source area and the original image texture outside the light source area parameters, the display texture in the light source area, and the opacity parameter of the display texture in the light source area to generate a target processing image corresponding to the target image.

In this embodiment, the target image is identified in the RGBA color space, R represents red (Red), G represents green (Green), B represents blue (Blue), and A represents an opacity parameter.

Since the area outside the light source area in the target image does not need to be adjusted for the light source display effect, the area outside the light source area still displays the RGB texture of the original image. After the display RGB texture in the light source area is obtained, the opacity parameter of the original image RGB texture outside the light source area and the opacity parameter of the display RGB texture in the light source area can be set as the second target constant value for representing opacity, Like 1 or 100%.

Combine the RGB texture of the original image outside the light source area and the display RGB texture in the light source area according to the opacity parameter to obtain the target processing image corresponding to the target image, and the display effect of the light source has been completed in the target processing image. adjustment.

The display effect texture obtained by combining the original image RGB texture outside the light source area and the display RGB texture in the light source area can be rendered by the pre-created GPU, and after the rendering is completed, the target processing image is generated for display.

For the parts not explained in this embodiment, please refer to the foregoing embodiments, and details are not repeated here.

In the above technical solution, the adjustment of the display effect of the light source in the video or image is realized, the degree of freedom and diversity of the display effect of the video or image is improved, and it is suitable for scenes with various light sources changing. At the same time, the above technical solution can also be combined with the method of the GPU rendering pipeline, so that the change of the display effect of the light source is suitable for real-time video processing.

Embodiment 4

FIG. 7 is a flowchart of another image processing method provided by an embodiment of the present application. This embodiment provides an implementation manner on the basis of the above-mentioned embodiment.

As shown in FIG. 7 , the image processing method provided in this embodiment includes the following steps.

S310. Acquire a video image frame in real time through live video software, and use the video image frame as a target image.

Video image frames are identified in the RGBA color space.

S320: Input the target image into a pre-trained light source detection model to obtain coordinate information of the light source target frame in the target image.

S330. Create a light source model in the light source target frame according to the coordinate information of the light source target frame and the range of the light source area in the horizontal direction and the vertical direction in the light source target frame.

According to the coordinate information of the light source target frame, the light source focus of the light source model is determined, that is, the center point (x1, y1) of the light source target frame, and the light source model is constructed based on the light source focus (x1, y1).

When the range of the light source area in the horizontal direction and the vertical direction in the light source target frame is equal, a circular light source model is constructed; when the range of the light source area in the horizontal direction and the vertical direction in the light source target frame is not equal, Build an elliptical light source model.

Taking building an elliptical light source model as an example, the expression is as follows:

c≠d.

S340. Set the opacity parameter of the pixels outside the light source model in the light source target frame to 0, and calculate the opacity parameters of the pixels in the light source model in the light source target frame according to the target formula.

The target formula is as follows:

The opacity parameters of multiple pixels in the light source target frame determined in this step will participate in the processing of pixels in the light source area.

S350. Render the original image texture and the preselected light source texture through two pre-created GPUs respectively.

The pre-selected light source texture can display the light source effects of different colors by filling different pixel RGB values, and then simulate different light source effects, and can fill the corresponding pixel RGB values of different light source effects according to actual needs.

S360 , superimposing pixel values of the original image texture in the light source area and the preselected light source texture in the light source area through the GPU, and correcting the superposition result to obtain the superimposed texture in the light source area; use the opacity parameter of the light source area to superimpose the superimposed texture Make adjustments to obtain the pending texture, and use the original image texture in the light source area to compensate the pending texture to obtain the display texture in the light source area.

The light source area (or the area within the light source target frame) is the superimposed area of the original image texture and the preselected light source texture, and the pixel RGB values need to be processed. The opacity parameters of multiple pixels in the light source area are determined by S340; The areas outside the light source area do not need to be processed, and the original image texture can be displayed, and the opacity parameter of these areas is set to 1.

In this step, based on the parallel computing capability of the GPU, the calculation rate of the superimposed texture in the light source area and the display texture in the light source area is improved.

Taking a pixel in the light source area as an example, the processing process of the pixel RGB value of the pixel is as follows: T=S+D, T≤1; F=A*T+(1-A)*D; where A is The opacity parameter of the pixel; S is the pixel RGB value of the pixel in the pre-selected light source texture, D is the pixel RGB value of the pixel in the original image texture, T is the pixel RGB value of the pixel in the superimposed texture, F is the pixel The RGB value of the pixel in the display texture.

S370. Set the opacity parameter of the original image texture outside the light source area and the opacity parameter of the display texture in the light source area to be 1, combine the original image texture outside the light source area and the display texture in the light source area, and render through the GPU pipeline The target processing image corresponding to the target image is then generated.

For the unexplained part of this embodiment, please refer to the foregoing embodiment, which will not be repeated here.

Embodiment 5

With the progress of society and the development of economy, on the basis of realizing Internet surfing, the functions of capturing images and displaying images of mobile terminals have attracted more and more attention from users, and users have also put forward higher requirements for image processing of mobile terminals. . When the mobile terminal captures an image in a scene with less light, the brightness of the captured image is dark. Although the related art has a brightness enhancement solution, it can only improve the overall brightness of the image, and cannot change the brightness of many images. The light source scene during shooting, that is, the technical solutions in the related art cannot add light sources to the visual data. Therefore, how to provide more abundant optical display information for visual data is an urgent problem to be solved.

The embodiments of the present application provide an image processing method. Please refer to FIG. 8 , which is a flowchart of another image processing method provided by an embodiment of the present application.

As shown in FIG. 8 , the image processing method may include the following steps.

S31, a light source model of the optical image is acquired.

The light source model characterizes the light source shape and light source location in the optical image. The shape of the light source can be a square, a circle, an ellipse, a semi-circle, etc. For example, the "non-black pixels" in the optical image (for example, the pixels whose RGB value (ie, the pixel RGB value) is not 0) can be used. The composed image area is fitted to obtain the light source shape. The position of the light source can be represented by the pixel coordinates determined by each of the plurality of pixels in the optical image corresponding to the shape of the light source; the optical image can also be divided into grids, and the optical image with "non-black pixels" can be divided into a grid. The coordinate position corresponding to at least one grid is used as the light source position.

S32, according to the light source model and the preset mapping curve, obtain the information of the light source to be added.

The light source information to be added represents the pixel added value of each pixel point in the light source area, and the light source area is an image area determined by the shape of the light source and the position of the light source.

For example, the pixel added value may be determined according to the light source intensity and the RGB value to be added of the pixel point, the light source intensity may determine the brightness information of each pixel point in the target image, and the RGB value to be added of the pixel point may determine the target image. The color information of each pixel in . For example, a light source is simulated, and the light source information to be added corresponding to the simulated light source is added to the light source area, so that the image display information (light source information to be added) corresponding to the simulated light source is added to the optical image, which is conducive to enriching the optical display information of the image, providing More visual presentations.

S33: Update the pixel value of each pixel in the light source area according to the light source information to be added to obtain a target image.

Since the pixels of the optical image outside the light source area are all "black pixels" (for example, pixels whose RGB values are all 0), there is no light source at the positions of the pixels outside the light source area. The image processing method is beneficial to enrich the optical display information of the image and provide more visual display effects.

To facilitate understanding of the processing effects of the image processing methods provided in the above embodiments, please refer to FIG. 9A and FIG. 9B . FIG. 9A is a schematic diagram of an optical image before processing by the image processing method provided by the embodiment of the present application. FIG. 9B is a schematic diagram of a target processed image obtained after processing the optical image in FIG. 9A by using the image processing method provided by the embodiment of the present application. The optical image and the target processing image can be compared, and the two have changed greatly in the image area with the light source (light source area), and the light source information to be added is added to the light source area of the optical image, so that the target image has richer optics. Display information. That is to say, by using the image processing method provided by the embodiments of the present application, more visual display effects are provided for the image.

Since the image may include target objects such as complex natural environments or people, these target objects may only be illuminated by a little light source during the image capture process, resulting in a dark optical image, which is inconvenient to observe these target objects. and identification. On the basis of FIG. 8 , this embodiment of the present application provides a possible implementation manner. Please refer to FIG. 10 . FIG. 10 is a flowchart of a light source model for acquiring an optical image provided by an embodiment of the present application. S31 : acquiring a light source model of the optical image, which may include the following steps.

S311 , dividing the optical image into a grid to obtain a grid image.

For example, the optical image may be meshed according to M*N to obtain a meshed image with M*N meshes, where M and N are both positive integers greater than or equal to 2. As shown in FIG. 11 , FIG. 11 is a schematic diagram of dividing an optical image according to an embodiment of the present application. The optical image is divided into grids to obtain a grid image with 6*7 grids shown in FIG. 11 .

S312: Acquire at least one grid having a light source in the grid image.

For example, please continue to refer to Fig. 11, the leg area of the "dog" shown in Fig. 11 is an image area with a light source (that is, the blank space outlined in Fig. 11), then the blank space in the grid image is regarded as a The above grid with light sources.

S313, taking the coordinate position of the box corresponding to at least one grid as the light source position.

That is to say, the position of the light source is the coordinate position of the box corresponding to at least one grid having the light source in the grid image. If there is only one grid with a light source in the grid image, the box coordinate position of the grid is used as the light source position. If there are multiple grids with light sources in the grid image, the frame coordinate positions corresponding to the multiple networks are taken as the light source positions, including two possible situations: In one case, if multiple grids are continuously distributed, then integrate the multiple grids to obtain a light source position; in the other case, if multiple grids are discretely distributed, obtain the light sources in the discretely distributed grid area. Location.

S314, at least one grid is detected to obtain the shape of the light source.

Taking the continuous distribution of multiple grids as an example, the area enclosed by the multiple grids may be a square area, but the shape of the light source may be a circle, a trapezoid, an ellipse, etc. in the square area.

S315 , constructing a light source model by using the light source shape and the light source position.

For example, if the shape of the light source determined by multiple grids is a perfect circle, and the brightness gradually decreases from the center point of the light source area to the edge point of the light source area, the virtual light source corresponding to the optical image may be a point light source. Using the image processing method provided in the embodiment of the present application, the point light source can be enhanced, and then the pixel value (light source information to be added) can be added to the light source area of the optical image, so as to improve the darker part in the optical image, which is beneficial to the optical image. Observation and recognition of target objects in images.

When adding pixel values to an optical image, if the same brightness and color are simply added to each pixel, the resulting image will be blurred. On the basis of FIG. 8 , this embodiment of the present application provides a possible implementation manner. Please refer to FIG. 12 . FIG. 12 is a flowchart of another image processing method provided by the embodiment of the present application. S32 : obtaining information about the light source to be added according to the light source model and the preset mapping curve, which may include the following steps.

S321: Match the transparency level information with a preset mapping curve to obtain the brightness information to be added of the light source area.

The transparency degree information represents the brightness information of the light source area, and the brightness information to be added represents the brightness addition value of each pixel in the light source area. For example, the degree of transparency information may be obtained according to the intensity of the light source corresponding to the optical image, and the intensity of the light source may be obtained by: obtaining the length of the first line segment between any pixel point in the light source area and the center point of the light source area, The length of the second line segment between the edge point and the center point of the light source region on the extension line of the first line segment, the edge point and the arbitrary pixel point are located on the same side of the center point, and the first The length of the line segment is divided by the length of the second line segment to obtain the light source intensity corresponding to any one pixel point. When the light source intensity of each pixel in the light source region (that is, the transparency of each pixel) is obtained, the above-mentioned transparency information is also obtained.

S322 , obtaining color information to be added in the light source area in response to the change requirement of the light source.

The color information to be added represents the color added value of each pixel in the light source area. For example, the light source change requirement may be identified according to different optical images, or may be set by the user through an operation instruction, for example, different RGB pixel values may be added to each pixel in the light source area.

S323, according to the brightness information to be added and the color information to be added, obtain the pixel addition value of each pixel point.

The brightness and color of each pixel in the light source area of the optical image are adjusted using the light source information to be added to obtain the target processing image. Compared with the optical image, the visual data of the target processed image will be clearer and brighter, making the target object recognition in the image more accurate.

For the above-mentioned transparency information, a possible acquisition method is given. Please refer to FIG. 13 . FIG. 13 is a schematic diagram of obtaining transparency degree information provided by an embodiment of the present application. The light source area shown in FIG. 13 is a rectangular area, and the above-mentioned transparency degree information can be obtained in the following manner.

(1) Obtain the center point O and the first edge point b of the light source area.

The first edge point is any pixel point on the boundary of the light source area.

(2) Obtain the first distance and the second distance.

The first distance is the distance between the center point O and the first edge point b, the second distance is the distance between the area center point O and the first area point a, and the first area point a is composed of the center point O and the first edge point b. Any pixel on the line segment. For example, continuing to refer to Figure 13, the first distance is Ob and the second distance is Oa.

(3) Divide the second distance Oa by the first distance Ob to obtain the transparency information of the point a in the first area.

For example, if U represents the degree of transparency of the point a in the first area, then U=Oa/Ob.

S321: Match the degree of transparency information with the preset mapping curve, and obtain the brightness information to be added in the light source area by using the following formula to determine the brightness addition information of the first area point a: U `=U ^α ; wherein, U is the above-mentioned The degree of transparency of the point a in the first area, α is the intensity of the light source determined by the preset mapping curve, α≥0, and U` is the added value of the brightness of the point a in the first area.

For example, if U=0.04 and α=2, then U`=0.04 ^2.0 =0.0016; if U=0.04 and α=0.5, then U`=0.04 ^0.5 =0.2.

Since the pixel value is directly added to the original image (in the optical image), it may cause errors in the visual data processing of the image. On the basis of Figure 12, for updating the pixel value of each pixel in the light source area, a For a possible implementation, please refer to FIG. 14 , which is a flowchart of updating the pixel value of each pixel in the light source area according to the light source information to be added to obtain a target processing image provided by an embodiment of the present application. The above S33: updating the pixel value of each pixel in the light source area according to the information of the light source to be added, to obtain the target image, may include the following steps.

S331 , obtaining the first pixel value of the first pixel point.

The first pixel is any pixel in the light source area. For example, the first pixel point may be the first area point a shown in FIG. 13 .

S332: Determine the first pixel addition value of the first pixel point according to the light source information to be added.

The first pixel addition value includes a first luminance addition value and a first color addition value. For example, the first color addition value may be (1, 1, 1); for each pixel in the light source area, setting different color addition values for each pixel can simulate different light source effects. For example, the first luminance addition value may be represented by the intensity of the light source.

S333 , adding the first pixel value and the first color addition value to obtain an intermediate pixel value.

For example, the value of the first pixel is V, the value of the first color addition is G, and the value of the intermediate pixel is H. In order to avoid the occurrence of "sudden bright spots" in the target image, the above-mentioned intermediate pixel value H, first color addition value G, and first pixel value V are all less than or equal to 1.

S334 , when the intermediate pixel value is less than or equal to the preset threshold, obtain the first target pixel value of the first pixel point by using the first luminance addition value, the intermediate pixel value, and the first pixel value.

For example, in the case where the intermediate pixel value H, the first color addition value G, and the first pixel value V are all less than or equal to 1, let the first brightness addition value U', then the first target pixel value I is:

I=U`*H+(1-U`)*V

Each pixel can have the same U` value, and some pixels in the light source area can also have different U` values.

S335 , after acquiring the target pixel value of each pixel in the light source area, update the pixel value of each pixel with the first target pixel value to obtain a target image.

That is to say, different light source effects can be simulated through the light source intensity and color addition value of each pixel point, which is beneficial to enrich the optical display information of the image and provide more visual display effects.

Using the image processing method provided by the embodiment of the present application, the light source information corresponding to the optical image can be adjusted, the optical display information of the image can be enriched, and more visual display effects can be provided. In an optional embodiment, the user can also manually set the newly added light source. Instead of detecting the light source, the coordinates, shape and color of the simulated light source can be set directly through the operation command, so as to add the set light source to the optical image, and the user can The target image can be viewed. For example, adding a red light source to an optical image means adding a red color channel value to each pixel in the optical image to obtain the target processing image.

Embodiment 6

FIG. 15 is a schematic structural diagram of an image processing apparatus provided by an embodiment of the present application. This embodiment may be applicable to the case of adjusting the display effect of the light source in the image or video, and the apparatus may be implemented by means of software and/or hardware, and may generally be integrated in computer equipment. As shown in FIG. 15 , the device has a light source model acquisition module 410 and a light source region processing module 420 .

The light source model obtaining module 410 is configured to obtain the light source model of the target image; the light source region processing module 420 is configured to process the light source region of the target image according to the light source model.

FIG. 16 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present application. As shown in FIG. 16 , the light source model acquisition module 410 includes: a light source area determination unit 411 and a light source model construction unit 412 , and the light source area processing module 420 includes an opacity parameter determination unit 421 and a light source area adjustment unit 422 .

The light source area determination unit 411 is configured to acquire a target image and determine the light source area in the target image; the light source model construction unit 412 is configured to construct a light source model in the light source area; the opacity parameter determination unit 421 is configured to The model determines the opacity parameter of the light source area; the light source area adjustment unit 422 is set to obtain the desired light source area according to the original image texture in the light source area, the preselected light source texture in the light source area, and the opacity parameter of the light source area. The display texture in the light source area.

In an optional implementation manner, the light source area adjustment unit 422 is configured to superimpose the pixel value of the original image texture in the light source area and the preselected light source texture in the light source area, and correct the superposition result, Obtain the superimposed texture in the light source area; use the opacity parameter of the light source area to adjust the superimposed texture to obtain a pending texture; use the original image texture in the light source area to compensate the pending texture to obtain Display texture within the light source area.

In an optional implementation manner, the light source area determining unit 411 is configured to acquire a target image, and determine the light source area in the target image through a pre-trained light source detection model.

The light source model building unit 412 is configured to detect the first length and the second length of the light source area in the horizontal direction and the vertical direction respectively; when the first length and the second length are equal, the light source area is In the light source area, a circular light source model is constructed with the center point of the light source area as the center and the first length as the diameter; when the first length is not equal to the second length, in the light source area , taking the center point of the light source area as the center, taking the longer of the first length and the second length as the long axis, and taking the shorter of the first length and the second length as the length For the short axis, construct an elliptical light source model.

The opacity parameter determining unit 421 is configured to set the opacity parameters of all the pixels in the light source area outside the light source model as a first target constant value, and the first target constant value is used to represent full transparency; according to The size of the distance between each pixel point in all the pixel points in the light source model in the light source area and the center pixel point of the light source model, and the opacity parameter of each pixel point is set; wherein , the smaller the distance between one pixel in the light source model and the central pixel, the smaller the value of the opacity parameter of the one pixel.

Optionally, the opacity parameter determining unit 421 is set to the size of the distance between each pixel point in the light source area and the central pixel point of the light source model according to the distance between each pixel point in the light source model in the light source model in the following manner: , set the opacity parameter of each pixel point: calculate the opacity parameter of each pixel point within the light source model in the light source area according to the following formula:

Among them, A is the opacity parameter of each pixel, a is the distance from each pixel to the long axis or horizontal diameter of the light source model, and b is the distance from each pixel to the light source model The distance from the short axis or the vertical diameter of , a' is the distance from the short axis direction or the vertical diameter direction of each pixel to the boundary of the light source model, b' is the long axis direction of each pixel Or the distance from the horizontal diameter direction to the boundary of the light source model.

In a specific implementation manner, the light source area adjustment unit 422 is configured to obtain through the GPU, according to the original image texture in the light source area, the preselected light source texture in the light source area, and the opacity parameter of the light source area Display texture within the light source area.

The above-mentioned device further includes: a target processing image generation module, which is configured to, in the light source area adjustment unit, according to the original image texture in the light source area, the preselected light source texture in the light source area, and the opacity parameter of the light source area, After obtaining the display texture in the light source area, set the opacity parameter of the original image texture outside the light source area and the opacity parameter of the display texture in the light source area to be the second target constant value, the second target constant value. The target constant value is used to represent opacity; according to the original image texture outside the light source area, the opacity parameter of the original image texture outside the light source area, the display texture in the light source area, and the display in the light source area The opacity parameter of the texture to generate the target processing image corresponding to the target image.

FIG. 17 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present application. As shown in FIG. 17 , the light source area processing module 420 may include: an information processing unit 423 and an image updating unit 424 .

The light source model acquisition module 410 is a light source model configured to acquire optical images. The light source model characterizes the light source shape and light source location in the optical image.

The information processing unit 423 is configured to obtain the information of the light source to be added according to the light source model and the preset mapping curve. The light source information to be added represents the pixel added value of each pixel point in all the pixel points in the light source area of the optical image, and the light source area is an image area determined by the shape of the light source and the position of the light source.

The image updating unit 424 is configured to update the pixel value of each pixel in the light source area according to the light source information to be added, so as to obtain the target processing image.

In an optional embodiment, the information processing unit 423 is configured to match the brightness information with the preset mapping curve to obtain the brightness information to be added in the light source area, the brightness information represents the brightness information of the light source area, and the brightness information to be added Characterize the added value of the brightness of each pixel in the light source area; in response to the changing requirements of the light source, obtain the color information to be added in the light source area, and the color information to be added represents the added color value of each pixel in the light source area; according to the brightness to be added information and the color information to be added to obtain the pixel added value of each pixel in the light source area of the optical image.

The light source model determination module 410 , the information processing unit 423 and the image updating unit 424 may cooperate to implement the image processing method of Embodiment 1 or Embodiment 5 and possible sub-steps of the method.

The image processing apparatus provided by the embodiment of the present application can execute the image processing method provided by any embodiment of the present application, and has functional modules corresponding to the execution method.

Embodiment 7

FIG. 18 is a schematic structural diagram of a computer device provided by an embodiment of the present application. As shown in FIG. 18 , the computer device includes a processor 50, a memory 51, an input device 52 and an output device 53; the number of processors 50 in the computer device can be one or more, and one processor 50 is taken as an example in FIG. 18 ; The processor 50, the memory 51, the input device 52 and the output device 53 in the computer equipment may be connected by a bus or in other ways. In FIG. 18, the connection by a bus is taken as an example.

As a computer-readable storage medium, the memory 51 can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the image processing method in the embodiments of the present application (for example, the image processing method shown in FIG. 15 ). The light source model acquisition module 410 and the light source area processing module 420 in the device). The processor 50 executes various functional applications and data processing of the computer device by running the software programs, instructions and modules stored in the memory 51 , ie, implements the above-mentioned image processing method.

The memory 51 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of computer equipment, and the like. The memory 51 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 51 may include memory located remotely from processor 50, which may be connected to a computer device through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The input device 52 may be configured to receive input numerical or character information and to generate key signal input related to user settings and function control of the computer device. The output device 53 may include a display device such as a display screen.

Embodiment 8

An embodiment of the present application provides an image method, which is applied to an image processing device. Referring to FIG. 19 , FIG. 19 is a schematic structural diagram of an image processing device provided by an embodiment of the present application. The image processing device 10 includes a memory 11 , a processor 12 and a communication interface 13 . The memory 11 , the processor 12 and the communication interface 13 are directly or indirectly electrically connected to each other to realize data transmission or interaction. For example, these elements may be electrically connected to each other through one or more communication buses or signal lines. The memory 11 may be configured to store software programs and modules, such as program instructions/modules corresponding to the image processing methods provided in the embodiments of the present application, and the processor 12 executes various functions by executing the software programs and modules stored in the memory 11. applications and data processing. The communication interface 13 can be used for signaling or data communication with other node devices. The image processing apparatus 10 may have a plurality of communication interfaces 13 in the present application.

The memory 11 can be, but is not limited to, random access memory (Random Access Memory, RAM), read only memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only Memory, PROM), erasable only memory Read memory (Erasable Programmable Read-Only Memory, EPROM), Electrical Erasable Programmable Read-Only Memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc.

The processor 12 may be an integrated circuit chip with signal processing capability. The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; it may also be a digital signal processor (Digital Signal Processing, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

The image processing device 10 may also implement a display function through a GPU, a display screen, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 12 may include one or more GPUs that execute program instructions to generate or alter display information.

The above-mentioned image processing device 10 can be, but is not limited to, a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an Augmented Reality (AR)/Virtual Reality (VR) device, a notebook computer, a super mobile personal computer (Ultra-Mobile Personal Computer, UMPC), netbook, personal digital assistant (Personal Digital Assistant, PDA) and other terminals, the embodiment of the present application does not impose any restrictions on the specific type of the image processing device.

The structures illustrated in the embodiments of the present application do not constitute a limitation on the image processing apparatus 10 . In other embodiments of the present application, the image processing apparatus 10 may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Embodiment ten

Embodiments of the present application also provide a computer-readable storage medium storing a computer program, where the computer program is used to execute an image processing method when executed by a computer processor. The method includes: acquiring a light source model of an optical image; and processing the light source area of the optical image according to the light source model. .

The computer-readable storage medium storing the computer program provided by the embodiment of the present application is not limited to the above method operations, and can also perform related operations in the image processing method provided by any embodiment of the present application.

From the above description of the embodiments, those skilled in the art can understand that the present application can be implemented by means of software and general hardware, and can also be implemented by hardware. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a floppy disk, ROM, RAM, flash memory (FLASH), hard disk of a computer. Or CD, etc., including a plurality of instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods of the various embodiments of the present application.

In the above embodiment of the image processing apparatus, the multiple units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be realized; the names of the multiple functional units are also It is only for the convenience of distinguishing from each other, and is not intended to limit the protection scope of the present application.

Claims

An image processing method, comprising:

Obtain the light source model of the target image;

The light source area of the target image is processed according to the light source model.
The method according to claim 1, wherein the acquiring a light source model of the target image comprises: acquiring the target image and determining a light source area in the target image; constructing the light source model in the light source area ;

The processing of the light source area of the target image according to the light source model includes: determining an opacity parameter of the light source area according to the light source model; according to the original image texture in the light source area, the light source area The preselected light source texture in the light source area and the opacity parameter of the light source area are obtained to obtain the display texture in the light source area.
The method according to claim 2, wherein, according to the original image texture in the light source area, the pre-selected light source texture in the light source area, and the opacity parameter of the light source area, obtaining the light source area in the light source area display textures, including:

superimposing the pixel value of the original image texture in the light source area and the preselected light source texture in the light source area, and correcting the superimposed result to obtain the superimposed texture in the light source area;

Using the opacity parameter of the light source area to adjust the superimposed texture to obtain a pending texture;

Compensating the pending texture by using the original image texture in the light source area to obtain a display texture in the light source area.
The method according to claim 2, wherein the determining the light source area in the target image comprises:

The light source area in the target image is determined by using the light source detection model obtained by pre-training.
The method according to claim 4, wherein the constructing the light source model in the light source area comprises:

detecting a first length of the light source area in the horizontal direction, and a second length of the light source area in the vertical direction;

In the case that the first length is equal to the second length, in the light source area, with the center point of the light source area as the center, and the first length as the diameter, a circular light source model is constructed;

In the case where the first length and the second length are not equal, in the light source area, the center point of the light source area is taken as the center, and the first length and the second length are longer than the first length and the second length. The long length is the long axis and the shorter of the first length and the second length is the short axis, and an elliptical light source model is constructed.
The method according to claim 5, wherein the determining the opacity parameter of the light source region according to the light source model comprises:

setting the opacity parameter of all the pixels in the light source area outside the light source model as a first target constant value, and the first target constant value is used to represent full transparency;

Set the opacity parameter of each pixel point according to the size of the distance between each pixel point in all the pixel points in the light source model in the light source area and the pixel point in the center of the light source model; Wherein, the smaller the distance between one pixel in the light source model and the central pixel, the smaller the value of the opacity parameter of the one pixel.
The method according to claim 2, wherein, according to the original image texture in the light source area, the preselected light source texture in the light source area, and the opacity parameter of the light source area, obtain the light source area in the light source area. Display textures, including:

Through the graphics processor GPU, the display texture in the light source area is obtained according to the original image texture in the light source area, the preselected light source texture in the light source area, and the opacity parameter of the light source area.
The method according to claim 2, wherein the display in the light source area is obtained according to the original image texture in the light source area, the preselected light source texture in the light source area, and the opacity parameter of the light source area After the texture, also include:

Setting the opacity parameter of the original image texture outside the light source area and the opacity parameter of the display texture in the light source area are both the second target constant value, and the second target constant value is used to represent opacity;

According to the original image texture outside the light source area, the opacity parameter of the original image texture outside the light source area, the display texture in the light source area, and the opacity parameter of the display texture in the light source area, a The target processing image corresponding to the target image.
The method of claim 1, wherein the acquiring a light source model of the target image comprises: acquiring a light source model of an optical image; the light source model characterizes the light source shape and the light source position in the optical image;

The processing of the light source area of the target image according to the light source model includes:

According to the light source model and the preset mapping curve, the light source information to be added is obtained; the light source information to be added represents the pixel added value of each pixel point in all the pixel points in the light source area of the optical image, the light source The area is an image area determined by the shape of the light source and the position of the light source;

The pixel value of each pixel in the light source area is updated according to the light source information to be added to obtain a target processing image.
The method according to claim 9, wherein the acquiring the light source model of the optical image comprises:

performing grid division on the optical image to obtain a grid image;

acquiring at least one grid with light sources in the grid image;

Taking the coordinate position of the box corresponding to the at least one grid as the light source position;

Detecting the at least one grid to obtain the light source shape;

Using the light source shape and the light source position, the light source model is constructed.
The method according to claim 9, wherein the obtaining information of the light source to be added according to the light source model and the preset mapping curve comprises:

Matching the brightness information with the preset mapping curve to obtain brightness information of the light source area to be added; the brightness information represents the brightness information of the light source area, and the brightness information to be added represents the light source area The brightness of each pixel in the added value;

Obtaining color information to be added in the light source area in response to a change in the light source; the color information to be added represents the color addition value of each pixel in the light source area;

According to the to-be-added brightness information and the to-be-added color information, a pixel added value of each pixel in the light source area is obtained.
The method according to claim 11, wherein the transparency information is obtained by:

obtaining the length of the first line segment between each pixel in the light source area and the center point of the light source area;

Obtain the length of the second line segment between the boundary point of the light source region and the center point on the extension of the first line segment, wherein the boundary point of the light source region and each pixel point are located at the same side of the center;

Divide the length of the first line segment by the length of the second line segment to obtain the transparency information of each pixel point.
The method according to claim 11, wherein the updating the pixel value of each pixel in the light source area according to the light source information to be added to obtain the target processing image comprises:

obtaining the pixel value of each pixel in the light source area;

The pixel added value of each pixel is determined according to the light source information to be added; the pixel added value of each pixel includes the brightness added value of each pixel and the color added value of each pixel value;

adding the pixel value of each pixel point and the color addition value of each pixel point to obtain an intermediate pixel value;

In the case that the intermediate pixel value is less than or equal to a preset threshold, using the brightness addition value of each pixel point, the intermediate pixel value, and the pixel value of each pixel point to obtain the each pixel point The target pixel value of the pixel point;

The pixel value of each pixel is updated with the target pixel value of each pixel to obtain the target processed image.
The method according to claim 13, wherein the brightness addition value of each pixel point, the intermediate pixel value, and the pixel value of each pixel point are used to obtain the brightness value of each pixel point. Target pixel values, including:

The target pixel value of each pixel is obtained according to the following formula:

I=U`*H+(1-U`)*V

Wherein, the target pixel value of each pixel point is 1, the brightness added value of each pixel point is U', the intermediate pixel value is H, and the pixel value of each pixel point is V.
An image processing device, comprising:

The light source model acquisition module is set to acquire the light source model of the target image;

The light source area processing module is configured to process the light source area of the target image according to the light source model.
The apparatus of claim 15, wherein the light source model obtaining module comprises:

a light source area determination unit, configured to acquire a target image and determine a light source area in the target image;

a light source model building unit, configured to build a light source model in the light source area;

The light source area processing module includes:

an opacity parameter determining unit, configured to determine an opacity parameter of the light source region according to the light source model;

The light source area adjustment unit is configured to obtain the display texture in the light source area according to the original image texture in the light source area, the preselected light source texture in the light source area and the opacity parameter of the light source area.
The device of claim 15, wherein the light source model acquisition module is a light source model configured to acquire an optical image; the light source model characterizes the light source shape and light source position in the optical image;

The light source area processing module includes:

an information processing unit, configured to obtain light source information to be added according to the light source model and a preset mapping curve; the light source information to be added represents the pixel addition value of each pixel point in all the pixel points in the light source area, The light source area is an image area determined by the shape of the light source and the position of the light source;

The image updating unit is configured to update the pixel value of each pixel in the light source area according to the light source information to be added to obtain a target processing image.
The apparatus of claim 17, wherein the information processing unit is configured to:

Matching the brightness information with the preset mapping curve to obtain brightness information of the light source area to be added; the brightness information represents the brightness information of the light source area, and the brightness information to be added represents the light source area The brightness of each pixel in the added value;

Obtaining color information to be added in the light source area in response to a change in the light source; the color information to be added represents the color addition value of each pixel in the light source area;

According to the to-be-added brightness information and the to-be-added color information, a pixel added value of each pixel in the light source area is obtained.
A computer device, wherein the computer device comprises:

at least one processor;

memory, arranged to store at least one program,

When the at least one program is executed by the at least one processor, the at least one processor is caused to implement the image processing method according to any one of claims 1-14.
A computer-readable storage medium storing a computer program, which implements the image processing method according to any one of claims 1-14 when the program is executed by a processor.