CN105991987A - Image processing method, equipment and system - Google Patents

Abstract

The embodiment of the invention provides an image processing method, equipment and system. The method comprises the steps that a target image is acquired, and the target image is an image photographed by a camera; color data of a main light source are acquired from photographing auxiliary equipment, wherein the color data of the main light source are acquired through a color sensor arranged in the photographing auxiliary equipment, the main light source is a light source of which the emitted light rays have target light rays, the target light rays are light rays of which the inclined angle of the rays along the irradiation direction and the target rays is less than or equal to 90 degrees, the target rays are rays of the optical axis of the camera along the photographing direction, and the time difference of the acquisition time of the color data of the main light source and the photographing time of the target image is less than a preset value; and color correction is performed on the target image according to the color data of the main light source. With application of the image processing method, equipment and system, color correction can be accurately performed on the color image.

Description

Image processing method, device and system

Technical Field

The invention relates to the technical field of multimedia, in particular to an image processing method, equipment and a system.

Background

With the continuous development of electronic technology, cameras have become indispensable components in terminals such as mobile phones and tablet computers, and users can record drips in life through the cameras in the terminals. In the process of photographing, a user often finds that when a scene is photographed, the difference between the photographed color effect and the real color effect is large. The main reason is that human beings have a psychological tendency of not changing the color judgment of a certain specific object due to light sources or external environmental factors, and the psychological tendency is the color constancy. The reflection spectrum of a specific object can be different due to the change of the environment (especially the lighting environment). The human visual recognition system can recognize the change and judge that the change is generated by the change of the illumination environment, and when the illumination change is changed within a certain range, the human recognition mechanism considers that the surface color data of the object is constant within the change range.

In the prior art, a perfect emission method is adopted to realize white balance, and the theoretical basis is as follows: the color of light that is specularly reflected to the camera is the color of the light source, but specular reflection typically results in pixel overexposure in high areas of the image. Although the pixels of the exposed area are usually not perfectly specular. In addition, some scenes may not have specular reflection, such as shooting a blue T-shirt, and perfect emission may not have obvious color correction effect on a color image because of the difficulty in forming a mirror surface due to the much fluff on the T-shirt.

Disclosure of Invention

The embodiment of the invention provides an image processing method, equipment and a system, which can accurately correct the color of a color image.

A first aspect of an embodiment of the present invention provides an image processing method, including:

acquiring a target image, wherein the target image is an image shot by a camera;

acquiring color data of a main light source from shooting auxiliary equipment, wherein the color data is acquired through a color sensor arranged in the shooting auxiliary equipment, the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with included angles of rays along an irradiation direction and the target rays being smaller than or equal to 90 degrees, the target rays are rays of an optical axis of a camera along a shooting direction, and the time difference between the acquisition time of the color data and the shooting time of a target image is smaller than a preset value;

and performing color correction on the target image according to the color data.

A second aspect of the embodiments of the present invention provides an information processing method, including:

establishing connection with a terminal;

collecting color data of a main light source through a color sensor, and recording collection time, wherein the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between a ray along an irradiation direction and the target ray being smaller than or equal to 90 degrees, and the target ray is a ray of an optical axis of the camera along a shooting direction;

and sending the color data and the acquisition time to the terminal.

A third aspect of the embodiments of the present invention provides an information processing method, including:

the shooting auxiliary equipment establishes connection with the terminal;

the terminal acquires a target image, wherein the target image is an image shot by a camera;

the shooting auxiliary equipment collects color data of a main light source through a color sensor and records collection time, the main light source is a light source which emits light rays when a target image is obtained at the terminal, the target light rays are light rays with an included angle of a ray along an irradiation direction and a target ray being smaller than or equal to 90 degrees, and the target ray is a ray of an optical axis of the camera along a shooting direction;

the shooting auxiliary equipment sends the color data and the acquisition time to the terminal;

and the terminal corrects the color of the target image according to the color data, and the time difference between the acquisition time and the shooting time of the target image is smaller than a preset value.

A fourth aspect of the present invention discloses a terminal, including:

a first acquisition unit configured to acquire a target image, which is an image captured by a camera;

the second acquisition unit is used for acquiring color data of a main light source from the shooting auxiliary equipment, wherein the color data is acquired through a color sensor arranged in the shooting auxiliary equipment, the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between a ray along an irradiation direction and the target ray being smaller than or equal to 90 degrees, the target ray is a ray of the optical axis of the camera along a shooting direction, and the time difference between the acquisition time of the color data and the shooting time of the target image is smaller than a preset value;

and the first correcting unit is used for correcting the color of the target image acquired by the first acquiring unit according to the color data acquired by the second acquiring unit.

A fifth aspect of the embodiments of the present invention discloses a shooting assistance apparatus, including:

an establishing unit for establishing a connection with a terminal;

the device comprises a collecting unit, a color sensor and a control unit, wherein the collecting unit is used for collecting color data of a main light source through the color sensor, the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between a ray along an irradiation direction and the target ray being smaller than or equal to 90 degrees, and the target ray is a ray of an optical axis of the camera along a shooting direction;

a recording unit for recording the collection time of the color data collected by the collection unit,

and the communication unit is used for sending the color data acquired by the acquisition unit and the acquisition time recorded by the recording unit to the terminal.

A sixth aspect of the present invention discloses a shooting system, including a terminal and a shooting assistance device, wherein:

the shooting auxiliary equipment is used for establishing connection with the terminal;

the terminal is used for acquiring a target image, and the target image is an image shot by a camera;

the shooting auxiliary equipment is also used for collecting color data of a main light source through a color sensor and recording the collection time, the main light source is a light source which emits light rays when a target image is obtained at the terminal, the target light rays are light rays with an included angle of a ray along the irradiation direction and a target ray being smaller than or equal to 90 degrees, and the target ray is a ray of the optical axis of the camera along the shooting direction;

the shooting auxiliary equipment is further used for sending the color data and the acquisition time to the terminal;

and the terminal is further used for carrying out color correction on the target image according to the color data, and the time difference between the acquisition time and the shooting time of the target image is smaller than a preset value.

In the embodiment of the invention, the terminal acquires the target image, acquires the color data of the main light source from the shooting auxiliary equipment, and then corrects the target image according to the color data of the main light source, so that the main light source irradiating the shot object can be used for correcting the color of the image to be processed, and the color image can be accurately corrected.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a schematic diagram of a network architecture according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a color sensor and spectral curve;

FIG. 3 is a flowchart illustrating an image processing method according to an embodiment of the present invention;

FIG. 4 is a flow chart of another image processing method according to an embodiment of the present invention;

FIG. 5 is a flowchart illustrating a further image processing method according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a terminal according to an embodiment of the present invention;

fig. 7 is a schematic structural diagram of another terminal according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of a shooting assistance apparatus according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of another shooting assistance apparatus provided by an embodiment of the present invention;

fig. 10 is a schematic structural diagram of an image processing system according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The embodiment of the invention provides an image processing method, equipment and a system, which can accurately correct the color of a color image. The following are detailed below.

In order to better understand an image processing method, device, and system provided by the embodiments of the present invention, an application scenario of the embodiments of the present invention is described below. In order to pursue color constancy, a user hopes that an image acquired by a terminal provided with a camera can meet the color constancy, however, the color of a flash lamp is fixed and unchanged when the user takes a picture, the color of the flash lamp cannot be changed along with the difference of environmental colors, and light is always supplemented with the fixed color in the process of taking a picture, so that the light supplementing effect of the flash lamp is not good under certain conditions, the color constancy cannot be achieved, and the image needs to be processed subsequently. Among them, some of the ambient light sources have a large influence on the collected image, for example: the light source irradiating on the front side of the object to be shot has little influence on the collected image by some environmental light sources, such as: a light source for irradiating the back of the object. Therefore, a light source having a large influence on the captured image among the ambient light sources may be referred to as a primary light source, that is, a light source capable of illuminating the front surface of the subject may be referred to as a primary light source, and a light source having a small influence on the captured image among the ambient light sources may be referred to as a secondary light source, that is, a light source illuminating the back surface of the subject may be referred to as a secondary light source. As the main light source has larger influence on the collected image, the color of the image can be corrected according to the color of the main light source.

In order to better understand an image processing method, device, and system provided by the embodiments of the present invention, a network architecture according to the embodiments of the present invention is described below. Referring to the drawings, fig. 1 is a schematic diagram of a network architecture according to an embodiment of the present invention. As shown in fig. 1, the network architecture may include a terminal 101 and a shooting auxiliary device 102, the terminal 101 may be a smartphone (e.g., an Android Phone, an iOS Phone, a Windows Phone, etc.), a tablet pc, etc. provided with a camera, the shooting auxiliary device 102 may be a selfie stick, the selfie stick may include a stick body 1021 and a support 1022, the support 1022 may be connected to the stick body 1021 through a connection manner such as a rotating connection, a fixed connection, a sliding connection, etc., the stick body 1021 may include a handle, a color sensor is located on the stick body near the handle side, a distance between the color sensor and a shot object is smaller than a distance between the color sensor and the terminal, so as to collect color data of a main light source as much as possible, and the support 1022 is used for fixing the terminal 101 so as to shoot an image. In one embodiment, the fill light source is disposed on the terminal 101. In one embodiment, the light supplement light source is disposed on the support 1022 of the selfie stick 102. The terminal 101 and the shooting auxiliary device 102 can be connected through a USB, a Bluetooth, a WIFI or other modes.

In the embodiment of the present invention, the light source may be different types of natural light, for example: different weather, different time, different season, different longitude and latitude, sunlight facing and sunlight back facing light source or moonlight. The light source may also be: different kinds of artificial light sources, such as: fluorescent, incandescent, candle, high pressure mercury, sodium, LED, TL84, a light source, uv, D65, street, flashlight, and the like. The light source may also be other light sources, for example: a light source formed by firefly, a light source formed by luminous powder, a light source formed by luminous beads and the like.

It should be noted that, when the camera of the terminal takes a picture of the preset color card, if the preset color card is gray, a gray card image is obtained, and if the preset color card is a color card, a color card image is obtained.

It should be noted that the calibration data according to the embodiment of the present invention mainly refers to a mapping relationship between two images. Specifically, it refers to a correspondence between color data between two images. For example, taking a gray card as an example, color data of a main light source a obtained under the main light source a (the color data of the main light source a can be collected by a color sensor) and a gray card image obtained under the main light source a (the gray card image is captured by a camera), then a mapping relationship between the color data of the main light source a and the gray card image under the main light source a can be established, that is, the main light source a and the gray card are calibrated, and can be expressed by the following formula:

sc_AM＝gray_A

wherein, sc_ARepresenting color data, gray, under a primary light source A_AThe color data of the main light source a is a gray card image of the main light source a, and M is calibration data between the color data of the main light source a and the gray card image of the main light source a, which is also called a mapping relationship. Alternatively, calibration data for the primary light source and the gray card image under the primary light source is established by a table lookup method, e.g., A represents color data under the primary light source, B represents the gray card, then A1 represents color data under the first primary light source, B1 represents the gray card image under the first primary light source, then one of A1 and B1The mapping relationship between the calibration data and the calibration data can be called a first set of calibration data; a2 represents the color data under the second main light source, B2 represents the gray card image under the second main light source, then the mapping relationship between A2 and B2, which can be called as the second set of calibration data, can directly get the corresponding gray card image B1 by looking up the table under the condition that A1 is known, and similarly, can directly get the corresponding gray card image B2 by looking up the table under the condition that A2 is known, which is the table look-up mode. Generally, since there are more light sources and more colors of the light sources, each of the plurality of main light sources needs to be calibrated, and the more calibration data is obtained, the more accurate the color correction is obtained in the embodiment of the present invention. Meanwhile, various calibration data can form a calibration database. It can be understood that each main light source corresponds to a gray card image, and the mapping relationship between the color data under the main light source and the gray card image under the main light source is calibration data. In the same way, calibration data between the primary light source and the color target can still be obtained in the case of color target.

The color sensor is generally composed of light spot conversion units of RGBW four channels, which can be RGBW sensors, chromatographic sensors, etc., and the spectral response characteristics of R, G, B are respectively close to the spectral response characteristics of three cone-shaped photosensitive cells L, S, M of human eyes retina. The spectral response characteristic of the W channel is close to that of the rod-shaped photoreceptor cells of the human visual retina. Wherein, RGBW includes 4 color data acquisition channels, so that different color data can be acquired by using the 4 channels, respectively, and the 4 color data acquisition channels can be color data of R (red) channel, color data of G (green) channel, color data of B (blue) channel, and color data of W (white) channel, respectively. Referring to fig. 2, fig. 2 is a schematic diagram of a color sensor and a spectrum curve. The light diffusion plate shown in fig. 2 is a physical phenomenon that light rays are refracted, reflected and scattered by a chemical or physical means when encountering two media with different refractive indexes (densities) in the traveling path, and the light rays are refracted, reflected and scattered in different directions by adding an inorganic or organic light diffuser to a base material such as polymethyl methacrylate (PMMA), bulletproof glue (PC), Polystyrene (PS), polypropylene (PP), or the like, or by adjusting the light rays by an array of micro-feature structures on the surface of the base material, so that the traveling path of the light rays is changed, and the incident light is fully dispersed to generate an optical diffusion effect.

Referring to fig. 3, fig. 3 is a schematic flow chart of an image processing method according to an embodiment of the present invention based on the network architecture shown in fig. 1. Wherein the image processing method is described from the perspective of the terminal 101. As shown in fig. 3, the image processing method may include the following steps.

301. And acquiring a target image.

In this embodiment, when the user is not satisfied with the target image acquired by the camera, the image processing application or the image processing client may obtain the target image by operating, that is, the image processing application or the image processing client loads the target image in the image processing application or the image processing client. The target image is an image collected by a camera on the terminal. Wherein the image processing application or the image processing client is an application or a client installed in the terminal.

302. Color data of the primary light source is acquired from the photographing assistant device.

In this embodiment, when the camera collects an image, the colors of the light sources irradiated on the object to be photographed are different, and the effect of the collected image is different. Therefore, the terminal can send a collecting instruction for collecting the color data of the main light source to the shooting auxiliary equipment when the camera collects the target image or before collecting the target image, so that the shooting auxiliary equipment collects the color data of the main light source through the color sensor and sends the color data to the terminal, and the frequency of collecting the color data of the main light source by the color sensor can be reduced; in addition, the shooting auxiliary device may also collect color data of the main light source in real time or periodically, the terminal may also send a color data acquisition instruction to the shooting auxiliary device, so that the shooting auxiliary device sends the collected color data of the main light source to the terminal, or the shooting auxiliary device actively sends the collected color data of the main light source to the terminal, and then the terminal may select, from the received color data of the main light source, the color data of the main light source with the smallest time difference between the collection time and the shooting time of the target image as the color data of the main light source for correcting the target image. The terminal may then store the color data of the primary light source and the target image for subsequent recall. The colour data of main light source is through setting up the colour sensor collection on shooing auxiliary assembly, there is the light source of target light in the main light source for sending light, target light is the light that is less than or equal to 90 degrees with the contained angle of target ray along the ray of direction of illumination, shine the light on being shot the object promptly, the target ray is the ray of camera optical axis along shooting the direction, main light source is positive for can shining being shot the object promptly, and can be by the light source that colour sensor gathered, when shooing auxiliary assembly for from rapping bar, can regard as the target ray with the pole body along the direction of being shot the object, the contained angle between the front at this moment terminal and the pole body can be 90 degrees, also can be less than 90 degrees. When the preset color card is a gray card, the color data of the main light source is acquired through each channel of the color sensor; when the preset color card is the color card, the color data of the main light source is directly collected through the color sensor.

In order to collect the color of the main light source as much as possible by the color sensor, the surface of the color sensor may be covered with a layer of diffusion material to increase the field of view (FOV) of the light source collected by the color sensor, so that the color sensor can collect light with a larger incident angle and the light intensity and spectrum sensed by each photoelectric sensing circuit are closer. In addition, due to the diffusion effect, the concentration degree of the measuring direction is weakened, the influence of local bright objects in the environment is not easy to receive, and the color of the main light source in the environment can be measured more accurately.

Also, in order to acquire as much of the current primary light source color as possible through the color sensor, the FOV of the color sensor is larger than the FOV of the camera.

In this embodiment, when the color sensor is an RGBW sensor and the preset color card is a gray card, the data of the gray card can be represented by data of only one channel because the color of the gray card is black and white, and therefore, the color data can be acquired for the main light source by respectively using 4 channels of the RGBW sensor; when the color sensor is an RGBW sensor and the preset color card is a color card, the color card is a color and includes data of three channels of RGB, so that the color data of the color can be directly collected by using 4 channels of the RGBW sensor.

303. And performing color correction on the target image according to the color data of the main light source.

In this embodiment, after the color data of the target image and the main light source are obtained, the color of the target image may be corrected according to the color data of the main light source through an image processing application on the terminal or an image processing client, or the color of the target image may be corrected according to the color data of the main light source through an image processing application outside the terminal or an image processing client. And performing color correction, namely acquiring calibration data between the light source and a preset color card, determining light source parameters according to the calibration data and the color data of the main light source, and performing color correction on the target image according to the light source parameters.

In this embodiment, after the color data of the light source and the image of the preset color card acquired by the camera are acquired, calibration data between the color data of the light source and the color card image of the preset color card acquired under the light source may be established. The preset color cards can be gray cards and color cards, the gray cards can only display black and white colors, and the color cards can display colors, such as 24 color cards and 144 color cards.

In this embodiment, the calibration data between the light source and the preset color card may be obtained in the following manner:

firstly, N color data under N different light sources collected by a color sensor are obtained.

In this embodiment, the N different light sources are different light sources in the environment, and the N color data under the N different light sources may be collected by the color sensor, where N is an integer not less than 3. Corresponding color data can be obtained under each light source. Measuring color data to sc under different light sources by using color sensor^kAnd k is more than 1 and less than or equal to N, wherein N is the number of the light source types, and k represents the kth light source.

${\mathrm{sc}}_k=\left(\begin{array}{c}{\mathrm{sred}}_k\\ {\mathrm{sgreen}}_k\\ {\mathrm{sblue}}_k\end{array}\right)=\left(\begin{array}{c}\frac{{\mathrm{SR}}_k}{{\mathrm{SW}}_k}\\ \frac{{\mathrm{SG}}_k}{{\mathrm{SW}}_k}\\ \frac{{\mathrm{SB}}_k}{{\mathrm{SW}}_k}\end{array}\right)$

Wherein, SR_k,SG_k,SB_k,SW_kIs color data, SR, obtained by 4-channel measurement of RGBW sensor_kColor data obtained for the Red channel, SG_kColor data obtained for the green channel, SB_kColor data obtained for the blue channel, SW_kColor data obtained for the white channel, sred_kFor normalized color data of the red channel, sgreen_kFor the normalized color data of the green channel, sblue_kIs the color data of the normalized blue channel. Wherein,

and secondly, acquiring N gray card images aiming at the gray card under N different light sources.

In this embodiment, under N different light sources, shooting may be performed by a camera to obtain N gray card images for the gray card under the N different light sources, where each light source of the N different light sources corresponds to one gray card image, and I_kAnd representing the kth gray card image, wherein k is more than 1 and less than or equal to N. Specifically, the terminal may be aligned to the gray card under N different light sources, i.e., the shooting range of the camera is occupied by the gray card. Under each light source, a gray card image for the gray card is available.

And finally, determining calibration data according to the N color data and the N gray card images.

In this embodiment, after the N color data and the N color card images are acquired, a mapping relationship between the N color data and the N gray card images may be established. The average gray level gray of the gray card image for the gray card under various light sources can be calculated_kAnd represents the average gray scale under the k-th light source. The average color of the gray card under different light sources was then calculated:

wherein R is_k、G_kAnd B_kThe average values R of R channel, G channel and B channel of the gray card image under the kth light source are respectively_kDenotes the mean value of the normalized R channel, g_kRepresents the average value of the normalized G channel and represents the average value of the normalized B channel. Finally, an sc is established_kAnd gray_kThe mapping relationship between the two is the calibration data. Specifically, an sc is established_kAnd gray_kThe mapping relationship between the two can be as follows:

sc_kM＝gray_k

namely:

$\left(\begin{array}{c}sre{d}_k\\ {\mathrm{sgreen}}_k\\ {\mathrm{sblue}}_k\end{array}\right)M=\left(\begin{array}{c}{r}_k\\ g_k\\ b_k\end{array}\right)$

m under each light source can be solved through the equation, wherein M is calibration data, the calibration data obtained under the N light sources are stored, and a calibration database is established.

Alternatively, sc may also be determined by a comparison method_kAnd gray_kThen, the mapping relation, i.e. the calibration data, is searched by a table look-up method. And each light source has a group of corresponding mapping relations, and the N mapping relations are fitted, so that a calibration database is obtained.

In this embodiment, a functional relationship between the color data and the calibration data may be constructed, for example, the color data may be used as the output data, the calibration data may be used as the input data, a mapping relationship may exist between the input data and the output data, and a function between the input data and the output data may be constructed based on the mapping relationship, so that the solution obtained may be used as the light source parameter. Alternatively, the color data may be used as input data, the calibration data may be used as output data, a mapping relationship may exist between the input data and the output data, and a function between the input data and the output data may be constructed based on the mapping relationship, whereby the solution obtained may be used as the light source parameter.

In this embodiment, the light source parameters may be determined by using the color data and the calibration data of the main light source, that is, the target calibration data matched with the main light source in the calibration data may be determined, and the light source parameters may be determined according to the target calibration data and the color data of the main light source. And calculating color data of the virtual gray card according to the light source parameters, and finally calculating white balance gain according to the color data of the virtual gray card. The light source parameters are proportional components of various light sources in the main light source. The specific solving method is as follows:

first, target calibration data matching the main light source in the calibration data may be determined, i.e., the colors (sc) corresponding to the three calibration light sources with the smallest Euclidean distance among the N light sources in the calibration data may be calculated_m1sc_m2sc_m3) Recorded as SC_m＝(sc_m1sc_m2sc_m3) And determining target calibration data matched with the main light source in the calibration data. That is, the euclidean distance between the color data in the main light source and each calibration data included in the calibration database is calculated, so that a plurality of euclidean distance values can be obtained, the minimum three euclidean distance values among the plurality of euclidean distance values are selected, and the color data of the light source corresponding to the three euclidean distance values is used as the color data of the main light source.

Secondly, determining light source parameters according to the target calibration data and the color data of the main light source, and enabling:

wherein p is_kRepresenting a light source parameter, k having a value of 1, or 2, or 3, sc_kRepresenting target calibration data and sc representing color data of the primary light source. The mapping relationship may be based on SC_mIs divided into 3 cases, and thus, the matrix SC is calculated_mIs determined. In 3 cases the following:

(1) if SC_mIs 1, then take sc_m1、sc_m2、sc_m3As the color data of the primary light source. Then, the color data of the virtual gray card is gray_virtual＝gray_m1I.e., P ═ I, I is the identity matrix;

(2) if SC_mIf the rank of (2) is greater, the main light sources are considered to be the linear combination of 2 light sources in the calibration light source. Therefore, makeWhere P is a weighting coefficient, i.e. a light source parameter. Record as matrix form:wherein

$sc=\left(\begin{array}{c}sr\\ sg\\ sb\end{array}\right)=\left(\begin{array}{c}\frac{SR}{SW}\\ \frac{SG}{SW}\\ \frac{SB}{SW}\end{array}\right)$

$P=\left(\begin{array}{c}p1\\ p2\end{array}\right)$

${\mathrm{SC}}_m=\left(\begin{array}{cc}{\mathrm{sc}}_{m1}& {\mathrm{sc}}_{m2}\end{array}\right)=\left(\begin{array}{cc}{\mathrm{sr}}_{m1}& {\mathrm{sr}}_{m2}\\ {\mathrm{sg}}_{m1}& {\mathrm{sg}}_{m2}\\ {\mathrm{sb}}_{m3}& {\mathrm{sb}}_{m3}\end{array}\right)$

Thus, solving the contradiction equationObtaining light source parametersSC⁺Is the Moore-Penrose inverse of SC. Then, the color data gray of the virtual gray card_virtualComprises the following steps:

(3) if SC_mIs 3, the main light source can be considered as a linear combination of 3 different light sources in the calibration light source. Therefore, makeWhere p is a weighting coefficient, i.e. a light source parameter. Record as matrix form:wherein

$sc=\left(\begin{array}{c}sr\\ sg\\ sb\end{array}\right)=\left(\begin{array}{c}\frac{SR}{SW}\\ \frac{SG}{SW}\\ \frac{SB}{SW}\end{array}\right)$

$P=\left(\begin{array}{c}{p}_1\\ p_2\\ p_3\end{array}\right)$

${\mathrm{SC}}_m=\left(\begin{array}{ccc}{\mathrm{sc}}_{m1}& {\mathrm{sc}}_{m2}& {\mathrm{sc}}_{m3}\end{array}\right)=\left(\begin{array}{ccc}{\mathrm{sr}}_{m1}& {\mathrm{sr}}_{m2}& {\mathrm{sr}}_{m3}\\ {\mathrm{sg}}_{m1}& {\mathrm{sg}}_{m2}& {\mathrm{sg}}_{m3}\\ {\mathrm{sb}}_{m1}& {\mathrm{sb}}_{m2}& {\mathrm{sb}}_{m3}\end{array}\right)$

Thus, solving the contradictory equationsObtaining light source parametersLet the obtained light source parameters be:

$P=\left(\begin{array}{c}{p}_1\\ p_2\\ p_3\end{array}\right)$

then, the color data gray of the virtual gray card_virtualComprises the following steps:

${\mathrm{gray}}_{virtual}=\left(\begin{array}{ccc}{\mathrm{gray}}_{m1}& {\mathrm{gray}}_{m2}& {\mathrm{gray}}_{m3}\end{array}\right)\left(\begin{array}{c}p1\\ p2\\ p3\end{array}\right)$

in this embodiment, the color correction of the target image may be performed by using the light source parameters, specifically: will gray_virtualColor data as a gray card, and the gray_virtualDivide into RGB three channel data, as follows:

${\mathrm{gray}}_{virtual}=\left(\begin{array}{c}{r}_{gray}\\ g_{gray}\\ b_{gray}\end{array}\right)$

for the gray_virtualThe white balance gain is obtained by normalization processing, as follows:

$\left\{\begin{array}{c}Rgain=\frac{r_{gray}}{g_{gray}},\\ Bgain=\frac{b_{gray}}{g_{gray}},\\ Ggain=1\end{array}\right.$

and correcting the target image by using the white balance gain:

wherein the target image I ═ { I ═ I_R,I_G,I_BH, the output picture is I '═ I'_R,I'_G,I'_B}。

Optionally, when the preset color card is a color card, the color data of the virtual color card may be determined based on the main light source, specifically as follows:

the virtual color chip can be written as:

taking the 24 color card as an example, then,

${\mathrm{color}}_{m1}=\left(\begin{array}{ccc}{R}_{m1,1}& G_{m1,1}& B_{m1,1}\\ R_{m1,2}& G_{m1,2}& B_{m1,2}\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ R_{m1,24}& G_{m1,24}& B_{m1,24}\end{array}\right)$

${\mathrm{color}}_{m2}=\left(\begin{array}{ccc}{R}_{m2,1}& G_{m2,1}& B_{m2,1}\\ R_{m2,2}& G_{m2,2}& B_{m2,2}\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ R_{m2,24}& G_{m2,24}& B_{m2,24}\end{array}\right)$

${\mathrm{color}}_{m3}=\left(\begin{array}{ccc}{R}_{m3,1}& G_{m3,1}& B_{m3,1}\\ R_{m3,2}& G_{m3,2}& B_{m3,2}\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ R_{m3,24}& G_{m3,24}& B_{m3,24}\end{array}\right)$

recording:

${\mathrm{color}}_{virtual}=\left(\begin{array}{ccc}{R}_1& G_1& B_1\\ R_2& G_2& B_2\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ R_{24}& G_{24}& B_{24}\end{array}\right)$

the color data of the standard color card, which may be defined by the manufacturer or a standard organization, is then obtained. And determining a color regeneration matrix according to the color data of the standard color card and the color data of the virtual color card. Recording the color vector of each color block of the standard color card as color_stdColor if there are N color blocks in the color card_stdThe matrix is N × 3 the data of the matrix is defined by the manufacturer or standard organization.

${\mathrm{color}}_{std}=\left(\begin{array}{ccc}{\stackrel{\‾}{R}}_1& {\stackrel{\‾}{G}}_1& {\stackrel{\‾}{B}}_1\\ {\stackrel{\‾}{R}}_2& {\stackrel{\‾}{G}}_2& {\stackrel{\‾}{B}}_2\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ {\stackrel{\‾}{R}}_{24}& {\stackrel{\‾}{G}}_{24}& {\stackrel{\‾}{B}}_{24}\end{array}\right)$

Taking a standard 24 color card as an example, the color data of the standard 24 color card is known and is recorded as:

${\mathrm{color}}_{std}=\left(\begin{array}{ccc}{\stackrel{\‾}{R}}_1& {\stackrel{\‾}{G}}_1& {\stackrel{\‾}{B}}_1\\ {\stackrel{\‾}{R}}_2& {\stackrel{\‾}{G}}_2& {\stackrel{\‾}{B}}_2\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ {\stackrel{\‾}{R}}_{24}& {\stackrel{\‾}{G}}_{24}& {\stackrel{\‾}{B}}_{24}\end{array}\right)$

the color reproduction matrix to be solved is M_3×3Obtaining an equation set:

the above equations hold for each color block due to errors, so this is a set of contradictory equations, and only a least squares solution needs to be solved. I.e. solving the optimization problem:i.e. is a linear optimization problem: the above formula is developed to obtain:

$\⇔\left(\begin{array}{ccc}{\stackrel{\‾}{R}}_1& {\stackrel{\‾}{G}}_1& {\stackrel{\‾}{B}}_1\\ {\stackrel{\‾}{R}}_2& {\stackrel{\‾}{G}}_2& {\stackrel{\‾}{B}}_2\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ {\stackrel{\‾}{R}}_{24}& {\stackrel{\‾}{G}}_{24}& {\stackrel{\‾}{B}}_{24}\end{array}\right)=\left(\begin{array}{ccc}{R}_1& G_1& B_1\\ R_2& G_2& B_2\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ R_{24}& G_{24}& B_{24}\end{array}\right)\left(\begin{array}{ccc}RR& GR& BR\\ RG& GG& BG\\ RB& GB& BB\end{array}\right)$

$\⇔\left\{\begin{array}{c}\left(\begin{array}{ccc}{R}_1& G_1& B_1\\ R_2& G_2& B_2\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ R_{24}& G_{24}& B_{24}\end{array}\right)\left(\begin{array}{c}RR\\ RG\\ RB\end{array}\right)=\left(\begin{array}{c}{\stackrel{\‾}{R}}_1\\ {\stackrel{\‾}{R}}_2\\ \mathrm{...}\\ {\stackrel{\‾}{R}}_{24}\end{array}\right)\\ \left(\begin{array}{ccc}{R}_1& G_1& B_1\\ R_2& G_2& B_2\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ R_{24}& G_{24}& B_{24}\end{array}\right)\left(\begin{array}{c}GR\\ GG\\ GB\end{array}\right)=\left(\begin{array}{c}{\stackrel{\‾}{G}}_1\\ {\stackrel{\‾}{G}}_2\\ \mathrm{...}\\ {\stackrel{\‾}{G}}_{24}\end{array}\right)\\ \left(\begin{array}{ccc}{R}_1& G_1& B_1\\ R_2& G_2& B_2\\ \mathrm{...}& \mathrm{...}& \mathrm{...}\\ R_{24}& G_{24}& B_{24}\end{array}\right)\left(\begin{array}{c}BR\\ BG\\ BB\end{array}\right)=\left(\begin{array}{c}{\stackrel{\‾}{B}}_1\\ {\stackrel{\‾}{B}}_2\\ \mathrm{...}\\ {\stackrel{\‾}{B}}_{24}\end{array}\right)\end{array}\right.$

thus, three are obtainedThe minimum 2 norm minimum 2 product of independent contradiction equation set Ax ═ b is solved into x ═ A⁺b, wherein A⁺Is the Moore-Penrose inverse of A. Can be obtained by the above method

$\left(\begin{array}{c}RR\\ RG\\ RB\end{array}\right),\left(\begin{array}{c}GR\\ GG\\ GB\end{array}\right),\left(\begin{array}{c}BR\\ BG\\ BB\end{array}\right)$

Thus, pair M can be completed_3×3And (4) solving. And finally, carrying out color correction on the target image according to the color reproduction matrix.

In this embodiment, the terminal may perform color correction on each pixel point in the target image according to the following equation, as follows:

the embodiment of the invention can be solved by using other color cards as preset color cards.

In this embodiment, the color data of the standard color card is known, and can be known through the production information of the standard color card. The color reproduction matrix can be written as follows:

wherein,is to output the color data of the color,in order to reproduce the matrix for the color,is the target image. The color reproduction matrix may be written as:

$M_{3\×3}=\left(\begin{array}{ccc}RR& GR& BR\\ RG& GG& BG\\ RB& GB& BB\end{array}\right)$

then, one can get:

in summary, in the matrix M_3×3When the color reproduction matrix can be accurately solved, the colors of the output image can be accurately restored according to the conversion of the color reproduction matrix.

In the image processing method described in fig. 3, the target image is acquired, and the color data of the primary light source is acquired from the photographing auxiliary device, and the target image is corrected based on the color data of the primary light source, so that the primary light source illuminating the photographed object can be used to perform color correction on the image to be processed, and the color image can be accurately color-corrected.

Referring to fig. 4, based on the network architecture shown in fig. 1, fig. 4 is a schematic flowchart of another image processing method according to an embodiment of the present invention. The image processing method is described from the perspective of the shooting assistance apparatus 102. As shown in fig. 4, the image processing method may include the following steps.

401. A connection is established with the terminal.

In this embodiment, when a user needs to capture an image through a terminal, the capture assisting apparatus may establish a connection with the terminal.

402. And collecting the color data of the main light source through a color sensor, and recording the collection time.

In this embodiment, after the shooting auxiliary device is connected to the terminal, the color data of the main light source may be collected in real time or periodically by the color sensor, and the collection time for collecting the color data of the main light source may be recorded. The main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between the rays along the irradiation direction and the target ray being smaller than or equal to 90 degrees, and the target ray is rays of the optical axis of the camera along the shooting direction. Wherein the rod body can be imaged as a target in the direction of the object to be imaged.

In this embodiment, after the shooting auxiliary device is connected to the terminal, the color data of the main light source may be collected by the color sensor only after the collection instruction for collecting the color data of the main light source sent by the terminal is received, and the collection time for collecting the color data may not be recorded at this time.

403. And sending the color data of the main light source and the acquisition time for acquiring the color data to the terminal.

In this embodiment, after the shooting auxiliary device collects the color data, the color data of the main light source and the collection time for collecting the color data of the main light source may be sent to the terminal. Or after receiving a color data acquisition instruction sent by the terminal, sending all or part of the color data acquired before receiving the instruction to the terminal.

In this embodiment, when the color data of the main light source is collected after receiving a collection instruction sent by the terminal for collecting the color data of the main light source, the shooting auxiliary device may directly send the color data of the main light source to the terminal.

In the image quantity method described in fig. 4, the auxiliary photographing apparatus may acquire color data of the primary light source through the color sensor and transmit the acquired color data to the terminal, so that the terminal performs correction processing on the image according to the color data, and thus, the primary light source irradiating the object to be photographed may be used to perform color correction on the image to be processed, and a color image may be accurately color-corrected.

Referring to fig. 5, based on the network architecture shown in fig. 1, fig. 5 is a schematic flowchart of another image processing method according to an embodiment of the present invention. Wherein the image processing method is described from the point of view of the terminal 101 and the shooting assistance apparatus 102. As shown in fig. 5, the image processing method may include the following steps.

501. The photographing auxiliary device establishes a connection with the terminal.

Step 501 is the same as step 401 in the previous embodiment, and is not described herein again in this embodiment of the present invention.

502. The terminal acquires a target image.

Step 502 is the same as step 301 in the previous embodiment, and is not described herein again in this embodiment of the present invention.

503. The shooting auxiliary equipment collects color data of the main light source through the color sensor and records collection time.

Step 503 is the same as step 402 in the previous embodiment, and is not described herein again in this embodiment of the present invention.

504. The shooting auxiliary equipment sends the color data and the acquisition time to the terminal.

Step 504 is the same as step 403 in the previous embodiment, and is not described herein again in this embodiment of the present invention.

505. And the terminal performs color correction on the target image according to the color data.

Step 505 is the same as step 303 in the previous embodiment, and is not described herein again in this embodiment of the present invention.

In the image processing method described in fig. 5, the primary light source illuminating the subject can be used to perform color correction on the image to be processed, and the color correction can be performed accurately on the color image.

Referring to fig. 6, fig. 6 is a schematic diagram illustrating a structure of a terminal according to an embodiment of the present invention. As shown in fig. 6, the terminal may include:

a first acquisition unit 601 configured to acquire a target image, which is an image captured by a camera;

a second obtaining unit 602, configured to obtain color data of a primary light source from the shooting auxiliary device, where the color data of the primary light source is collected by a color sensor arranged in the shooting auxiliary device, the primary light source is a light source that emits light rays in which a target light ray exists, the target light ray is a light ray in which an included angle between a ray in an irradiation direction and the target ray is smaller than or equal to 90 degrees, the target ray is a ray in which an optical axis of a camera is along a shooting direction, and a time difference between a collecting time of the color data of the primary light source and a shooting time of the target image obtained by the first obtaining unit 601 is smaller than a preset value;

a first correcting unit 603 configured to perform color correction on the target image acquired by the first acquiring unit 601 according to the color data acquired by the second acquiring unit 602.

In this embodiment, when the user is not satisfied with the target image captured by the camera, the first capturing unit 601 may be operated to capture the target image. The target image is an image collected by a camera on the terminal. Wherein the image processing application or the image processing client is an application or a client installed in the terminal.

In this embodiment, when the camera collects an image, the colors of the light sources irradiated on the object to be photographed are different, and the effect of the collected image is different. Therefore, the second obtaining unit 602 may send a collecting instruction for collecting the color data of the main light source to the auxiliary shooting device when or before the camera collects the target image, so that the auxiliary shooting device collects the color data of the main light source through the color sensor and sends the color data to the terminal, and the number of times that the color sensor collects the color data of the main light source may be reduced; in addition, the photographing auxiliary device may also acquire color data of the main light source in real time or periodically, the second acquiring unit 602 may also send a color data acquiring instruction to the photographing auxiliary device, so that the photographing auxiliary device sends the acquired color data of the main light source to the terminal, or the photographing auxiliary device actively sends the acquired color data of the main light source to the terminal, and then the second acquiring unit 602 may select, from the received color data of the main light source, the color data of the main light source whose acquiring time difference from the photographing time of the target image is the smallest as the color data of the main light source for correcting the target image. The terminal may then store the color data of the primary light source and the target image for subsequent recall.

In this embodiment, after the first acquiring unit 601 acquires the target image and the second acquiring unit 602 acquires the color data of the main light source, the first correcting unit 603 performs color correction on the target image according to the color data of the main light source.

As a possible embodiment, the first correcting unit 603 may include:

a third obtaining unit 6031, configured to obtain calibration data between the light source and a preset color card;

a determining unit 6032 configured to determine a light source parameter according to the calibration data acquired by the third acquiring unit 6031 and the color data acquired by the second acquiring unit 602;

a second rectification unit 6033 configured to perform color rectification on the target image acquired by the first acquisition unit 601 according to the light source parameter determined by the determination unit 6032.

In this embodiment, the first correction unit 603 performs color correction, that is, the third acquisition unit 6031 acquires calibration data between the light source and a preset color card, the determination unit 6032 determines a light source parameter according to the calibration data and color data of the main light source, and the second correction unit 6033 performs color correction on the target image according to the light source parameter.

As a possible implementation, the angle of view of the color sensor is larger than the angle of view of the camera.

In the terminal described in fig. 6, the target image is acquired, and the color data of the primary light source is acquired, and the target image is corrected based on the color data of the primary light source, so that the primary light source illuminating the object to be photographed can be used to perform color correction on the image to be processed, and the color correction on the color image can be accurately performed.

Referring to fig. 7, fig. 7 is a schematic structural diagram of another terminal according to an embodiment of the present invention. The terminal can be a mobile phone with a camera, a tablet computer and the like. As shown in fig. 7, the terminal may include: at least one processor 701, such as a CPU, memory 702, camera 703, screen 704, image processing apparatus 705, and at least one communication bus 706. The memory 702 may be a high-speed RAM memory or a non-volatile memory (e.g., at least one disk memory). Alternatively, the memory 702 may also be at least one storage device located remotely from the processor 701. Wherein:

a communication bus 706 for implementing connection communication between these components;

the memory 702 has a set of program codes stored therein, and the processor 701 is configured to call the program codes stored in the memory 702 to perform the following operations:

if a starting instruction for starting the terminal camera is detected, starting the camera;

the camera 703 is used for acquiring a target image and sending the target image to the processor 701;

a screen 704 for displaying the acquired target image;

the processor 701 is also configured to invoke the program code stored in the memory 702 to perform the following operations:

acquiring color data of a main light source from shooting auxiliary equipment, wherein the color data is acquired through a color sensor arranged in the shooting auxiliary equipment, the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with included angles of rays along an irradiation direction and the target rays being smaller than or equal to 90 degrees, the target rays are rays of a camera optical axis along a shooting direction, and the time difference between the acquisition time of the color data and the shooting time of a target image is smaller than a preset value;

storing the target image and the color data of the primary light source;

the image processing apparatus 701 is configured to:

acquiring a stored target image, wherein the target image is an image shot by a camera;

the method comprises the steps of obtaining stored color data of a main light source, wherein the color data of the main light source is color data collected through a color sensor before a target image is shot, the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between a ray along an irradiation direction and the target ray being smaller than or equal to 90 degrees, and the target ray is a ray of a camera optical axis along a shooting direction;

and performing color correction on the target image according to the color data.

As a possible implementation, the image processor 705 performs the color correction on the target image according to the color data by:

acquiring calibration data between a light source and a preset color card;

determining light source parameters according to the calibration data and the color data of the main light source;

and carrying out color correction on the target image according to the light source parameters.

As a possible implementation, the angle of view of the color sensor is larger than the angle of view of the camera.

The camera 703 may be a front camera or a rear camera.

In the terminal described in fig. 7, the target image is acquired, and the color data of the primary light source is acquired, and the target image is corrected based on the color data of the primary light source, so that the primary light source illuminating the object to be photographed can be used to perform color correction on the image to be processed, and the color correction on the color image can be accurately performed.

Referring to fig. 8, fig. 8 is a schematic structural diagram of a shooting assistance device according to an embodiment of the present invention. As shown in fig. 8, the photographing assistant apparatus may include:

an establishing unit 801, configured to establish a connection with a terminal;

the acquisition unit 802 is used for acquiring color data of the main light source through the color sensor, wherein the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between a ray along an irradiation direction and the target ray being smaller than or equal to 90 degrees, and the target ray is a ray of an optical axis of the camera along a shooting direction;

a recording unit 803 for recording the acquisition time of the color data acquired by the acquisition unit 802,

and a communication unit 804, configured to send the color data acquired by the acquisition unit 802 and the acquisition time recorded by the recording unit 803 to a terminal that establishes a connection with the establishment unit 801.

In this embodiment, when the user needs to capture an image through the terminal, the establishing unit 801 may establish a connection with the terminal.

In this embodiment, after the establishing unit 801 establishes a connection with the terminal, the collecting unit 802 may collect color data of the main light source through the color sensor in real time or periodically, and the recording unit 803 may record collection time for collecting the color data of the main light source. The main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between the rays along the irradiation direction and the target ray being smaller than or equal to 90 degrees, and the target ray is rays of the optical axis of the camera along the shooting direction. Wherein the rod body can be imaged as a target in the direction of the object to be imaged.

In this embodiment, after the collection unit 802 collects the color data, the communication unit 804 may send the color data of the main light source and the collection time for collecting the color data of the main light source to the terminal. Or after receiving a color data acquisition instruction sent by the terminal, the communication unit 804 sends all or part of the color data acquired before receiving the instruction to the terminal.

In the auxiliary photographing apparatus described in fig. 8, the auxiliary photographing apparatus may collect color data of the primary light source through the color sensor and transmit the collected color data to the terminal, so that the terminal performs correction processing on the image according to the color data, and thus, the primary light source irradiating the object to be photographed may be used to perform color correction on the image to be processed, and a color image may be accurately color-corrected.

Referring to fig. 9, fig. 9 is a schematic structural diagram of another shooting assisting apparatus according to an embodiment of the present invention. Wherein, this shooting auxiliary assembly can be for being provided with the selfie stick of colour sensor. As shown in fig. 9, the terminal may include: at least one processor 901, such as a CPU, memory 902, color sensor 903, transceiver 904, and at least one communication bus 905. The memory 902 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. Alternatively, the memory 902 may also be at least one storage device located remotely from the aforementioned processor 901. Wherein:

a communication bus 905 for implementing connection communication between these components;

the memory 902 has a set of program codes stored therein, and the processor 901 is configured to call the program codes stored in the memory 902 to perform the following operations:

establishing connection with a terminal;

the color sensor 903 is used for acquiring color data of a main light source through the color sensor and sending the color data to the processor 901, the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between a ray in the irradiation direction and the target ray being smaller than or equal to 90 degrees, and the target ray is a ray of the optical axis of the camera in the shooting direction;

the processor 901 is also configured to invoke the program code stored in the memory 902 to perform the following operations:

the acquisition time at which the color sensor 903 acquires color data of the primary light source is recorded,

a transceiver 904 for transmitting the color data and the acquisition time to the terminal.

In the auxiliary photographing apparatus described in fig. 9, the auxiliary photographing apparatus may collect color data of the primary light source through the color sensor and transmit the collected color data to the terminal, so that the terminal performs correction processing on the image according to the color data, and thus, the primary light source irradiating the object to be photographed may be used to perform color correction on the image to be processed, and a color image may be accurately color-corrected.

Referring to fig. 10, fig. 10 is a schematic structural diagram of an image processing system according to an embodiment of the present invention. The image processing system may include a terminal 1001 and a photographing assistant device 1002, wherein:

a shooting assistance apparatus 1002 for establishing a connection with the terminal 1001;

a terminal 1001 for acquiring a target image, which is an image photographed by a camera;

the shooting auxiliary device 1002 is further configured to collect color data of a main light source through a color sensor, and record collection time, where the main light source is a light source that emits light in which a target light ray exists when a target image is obtained at a terminal, the target light ray is a light ray in which an included angle between a ray in an irradiation direction and the target ray is smaller than or equal to 90 degrees, and the target ray is a ray in which an optical axis of a camera is along a shooting direction;

the shooting auxiliary device 1002 is further configured to send color data and acquisition time to the terminal 1001;

the terminal 1001 is further configured to perform color correction on the target image according to the color data, and a time difference between the acquisition time and the shooting time of the target image is smaller than a preset value.

As a possible implementation, the terminal 1001 performs color correction on the target image according to the color data by:

the method comprises the steps that a terminal obtains calibration data between a light source and a preset color card;

the terminal determines light source parameters according to the calibration data and the color data;

and the terminal corrects the color of the target image according to the light source parameters.

As a possible implementation, the angle of view of the color sensor is larger than the angle of view of the camera.

In the image processing system described in fig. 10, the primary light source illuminating the subject to be photographed can be used to perform color correction on the image to be processed, and the color correction can be performed accurately on the color image.

The order of the steps of the method of the embodiments of the present invention may be adjusted, combined, or deleted according to actual needs. The units of the terminal of the embodiment of the invention can be integrated, further divided or deleted according to actual needs.

The elements of the embodiments of the present invention may be implemented in a general purpose integrated circuit (e.g., a central processing unit CPU) or an Application Specific Integrated Circuit (ASIC).

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

The image processing method, device and system provided by the embodiment of the present invention are described in detail above, and the principle and the embodiment of the present invention are explained in the present document by applying specific examples, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (14)

1. An image processing method, comprising:

acquiring a target image, wherein the target image is an image shot by a camera;

acquiring color data of a main light source from shooting auxiliary equipment, wherein the color data is acquired through a color sensor arranged in the shooting auxiliary equipment, the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with included angles of rays along an irradiation direction and the target rays being smaller than or equal to 90 degrees, the target rays are rays of an optical axis of a camera along a shooting direction, and the time difference between the acquisition time of the color data and the shooting time of a target image is smaller than a preset value;

and performing color correction on the target image according to the color data.

2. The method of claim 1, wherein the color rectifying the target image according to the color data comprises:

acquiring calibration data between a light source and a preset color card;

determining light source parameters according to the calibration data and the color data;

and performing color correction on the target image according to the light source parameters.

3. The method of claim 1 or 2, wherein a field angle of the color sensor is greater than a field angle of the camera.

4. An image processing method, comprising:

establishing connection with a terminal;

collecting color data of a main light source through a color sensor, and recording collection time, wherein the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between a ray along an irradiation direction and the target ray being smaller than or equal to 90 degrees, and the target ray is a ray of an optical axis of the camera along a shooting direction;

and sending the color data and the acquisition time to the terminal.

5. An image processing method, comprising:

the shooting auxiliary equipment establishes connection with the terminal;

the terminal acquires a target image, wherein the target image is an image shot by a camera;

the shooting auxiliary equipment collects color data of a main light source through a color sensor and records collection time, the main light source is a light source which emits light rays when a target image is obtained at the terminal, the target light rays are light rays with an included angle of a ray along an irradiation direction and a target ray being smaller than or equal to 90 degrees, and the target ray is a ray of an optical axis of the camera along a shooting direction;

the shooting auxiliary equipment sends the color data and the acquisition time to the terminal;

and the terminal corrects the color of the target image according to the color data, and the time difference between the acquisition time and the shooting time of the target image is smaller than a preset value.

6. The method of claim 5, wherein the terminal performing color correction on the target image according to the color data comprises:

the terminal acquires calibration data between a light source and a preset color card;

the terminal determines light source parameters according to the calibration data and the color data;

and the terminal corrects the color of the target image according to the light source parameter.

7. The method of claim 5 or 6, wherein the color sensor has a field of view greater than a field of view of the camera.

8. A terminal, comprising:

a first acquisition unit configured to acquire a target image, which is an image captured by a camera;

the second acquisition unit is used for acquiring color data of a main light source from the shooting auxiliary equipment, wherein the color data is acquired through a color sensor arranged in the shooting auxiliary equipment, the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between a ray along an irradiation direction and the target ray being smaller than or equal to 90 degrees, the target ray is a ray of the optical axis of the camera along a shooting direction, and the time difference between the acquisition time of the color data and the shooting time of the target image is smaller than a preset value;

and the first correcting unit is used for correcting the color of the target image acquired by the first acquiring unit according to the color data acquired by the second acquiring unit.

9. The terminal of claim 8, wherein the first rectification unit comprises:

the third acquisition unit is used for acquiring calibration data between the light source and the preset color card;

the determining unit is used for determining light source parameters according to the calibration data acquired by the third acquiring unit and the color data acquired by the second acquiring unit;

and the second correcting unit is used for correcting the color of the target image acquired by the first acquiring unit according to the light source parameters determined by the determining unit.

10. A terminal according to claim 8 or 9, wherein the colour sensor has a field of view greater than that of the camera.

11. A shooting assistance apparatus characterized by comprising:

an establishing unit for establishing a connection with a terminal;

the device comprises a collecting unit, a color sensor and a control unit, wherein the collecting unit is used for collecting color data of a main light source through the color sensor, the main light source is a light source which emits light rays with target light rays, the target light rays are light rays with an included angle between a ray along an irradiation direction and the target ray being smaller than or equal to 90 degrees, and the target ray is a ray of an optical axis of the camera along a shooting direction;

a recording unit for recording the collection time of the color data collected by the collection unit,

and the communication unit is used for sending the color data acquired by the acquisition unit and the acquisition time recorded by the recording unit to the terminal.

12. An image processing system comprising a terminal and a shooting assistance apparatus, wherein:

the shooting auxiliary equipment is used for establishing connection with the terminal;

the terminal is used for acquiring a target image, and the target image is an image shot by a camera;

the shooting auxiliary equipment is also used for collecting color data of a main light source through a color sensor and recording the collection time, the main light source is a light source which emits light rays when a target image is obtained at the terminal, the target light rays are light rays with an included angle of a ray along the irradiation direction and a target ray being smaller than or equal to 90 degrees, and the target ray is a ray of the optical axis of the camera along the shooting direction;

the shooting auxiliary equipment is further used for sending the color data and the acquisition time to the terminal;

and the terminal is further used for carrying out color correction on the target image according to the color data, and the time difference between the acquisition time and the shooting time of the target image is smaller than a preset value.

13. The system according to claim 12, wherein the terminal performs color correction on the target image according to the color data by:

the terminal acquires calibration data between a light source and a preset color card;

the terminal determines light source parameters according to the calibration data and the color data;

and the terminal corrects the color of the target image according to the light source parameter.

14. The system of claim 12 or 13, wherein the color sensor has a field of view greater than a field of view of the camera.