CN106412416A - Image processing method, device and system - Google Patents
Image processing method, device and system Download PDFInfo
- Publication number
- CN106412416A CN106412416A CN201610429291.5A CN201610429291A CN106412416A CN 106412416 A CN106412416 A CN 106412416A CN 201610429291 A CN201610429291 A CN 201610429291A CN 106412416 A CN106412416 A CN 106412416A
- Authority
- CN
- China
- Prior art keywords
- color
- light source
- terminal
- color data
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 31
- 238000012937 correction Methods 0.000 claims abstract description 39
- 238000000034 method Methods 0.000 claims abstract description 20
- 238000012545 processing Methods 0.000 claims description 22
- 230000015654 memory Effects 0.000 description 24
- 238000013507 mapping Methods 0.000 description 17
- 230000000694 effects Effects 0.000 description 16
- 239000011159 matrix material Substances 0.000 description 15
- 238000010586 diagram Methods 0.000 description 14
- 230000001678 irradiating effect Effects 0.000 description 12
- 239000003086 colorant Substances 0.000 description 7
- 230000008859 change Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 6
- 241000282414 Homo sapiens Species 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000009792 diffusion process Methods 0.000 description 4
- 230000003595 spectral effect Effects 0.000 description 4
- 238000003860 storage Methods 0.000 description 4
- 230000008094 contradictory effect Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 239000004743 Polypropylene Substances 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 229920003229 poly(methyl methacrylate) Polymers 0.000 description 2
- 239000004926 polymethyl methacrylate Substances 0.000 description 2
- 229920001155 polypropylene Polymers 0.000 description 2
- 210000001525 retina Anatomy 0.000 description 2
- 230000001502 supplementing effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- DGAQECJNVWCQMB-PUAWFVPOSA-M Ilexoside XXIX Chemical compound C[C@@H]1CC[C@@]2(CC[C@@]3(C(=CC[C@H]4[C@]3(CC[C@@H]5[C@@]4(CC[C@@H](C5(C)C)OS(=O)(=O)[O-])C)C)[C@@H]2[C@]1(C)O)C)C(=O)O[C@H]6[C@@H]([C@H]([C@@H]([C@H](O6)CO)O)O)O.[Na+] DGAQECJNVWCQMB-PUAWFVPOSA-M 0.000 description 1
- 241000254158 Lampyridae Species 0.000 description 1
- 239000004793 Polystyrene Substances 0.000 description 1
- 239000011324 bead Substances 0.000 description 1
- 210000004027 cell Anatomy 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000003292 glue Substances 0.000 description 1
- 238000003702 image correction Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- QSHDDOUJBYECFT-UHFFFAOYSA-N mercury Chemical compound [Hg] QSHDDOUJBYECFT-UHFFFAOYSA-N 0.000 description 1
- 229910052753 mercury Inorganic materials 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 210000000608 photoreceptor cell Anatomy 0.000 description 1
- -1 polypropylene Polymers 0.000 description 1
- 239000000843 powder Substances 0.000 description 1
- 230000008929 regeneration Effects 0.000 description 1
- 238000011069 regeneration method Methods 0.000 description 1
- 229910052708 sodium Inorganic materials 0.000 description 1
- 239000011734 sodium Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Image Processing (AREA)
- Facsimile Image Signal Circuits (AREA)
Abstract
The embodiment of the invention provides an image processing method, device and system. The method comprises: obtaining an object image which is an image shot by a camera; obtaining the color data of the light source from a shooting auxiliary device, wherein the color data is collected through a color sensor arranged on the shooting auxiliary device, the collection angle of the color sensor is determined by the users, and the difference between the collection time of the color data and the time of the shooting time of the object image is smaller than a preset value; and performing color correction of the object image according to the color data. According to the embodiment of the invention, the image processing method, device and system can accurately perform color correction of the color image.
Description
Technical Field
The invention relates to the technical field of multimedia, in particular to an image processing method, equipment and a system.
Background
With the continuous development of electronic technology, cameras have become indispensable components in terminals such as mobile phones and tablet computers, and users can record drips in life through the cameras in the terminals. In the process of photographing, a user often finds that when a scene is photographed, the difference between the photographed color effect and the real color effect is large. The main reason is that human beings have a psychological tendency of not changing the color judgment of a certain specific object due to light sources or external environmental factors, and the psychological tendency is the color constancy. The reflection spectrum of a specific object can be different due to the change of the environment (especially the lighting environment). The human visual recognition system can recognize the change and judge that the change is generated by the change of the illumination environment, and when the illumination change is changed within a certain range, the human recognition mechanism considers that the surface color data of the object is constant within the change range.
In the prior art, a perfect emission method is adopted to realize white balance, and the theoretical basis is as follows: the color of light that is specularly reflected to the camera is the color of the light source, but specular reflection typically results in pixel overexposure in high areas of the image. Although the pixels of the exposed area are usually not perfectly specular. In addition, some scenes may not have specular reflection, such as shooting a blue T-shirt, and perfect emission may not have obvious color correction effect on a color image because of the difficulty in forming a mirror surface due to the much fluff on the T-shirt.
Disclosure of Invention
The embodiment of the invention provides an image processing method, equipment and a system, which can accurately correct the color of a color image.
A first aspect of an embodiment of the present invention provides an image processing method, including:
acquiring a target image, wherein the target image is an image shot by a camera;
acquiring color data of a light source from a shooting auxiliary device, wherein the color data is acquired through a color sensor arranged on the shooting auxiliary device, the acquisition angle of the color sensor is determined by a user, and the time difference between the acquisition time of the color data and the shooting time of the target image is smaller than a preset value;
and performing color correction on the target image according to the color data.
A second aspect of the embodiments of the present invention provides an image processing method, including:
establishing connection with a terminal;
collecting color data of a light source through a color sensor, and recording the collection time of the color data, wherein the collection angle of the color sensor is determined by a user;
and sending the color data and the acquisition time to the terminal.
A third aspect of the embodiments of the present invention provides an image processing method, including:
the shooting auxiliary equipment establishes connection with the terminal;
the terminal acquires a target image, wherein the target image is an image shot by a camera;
the shooting auxiliary equipment acquires color data of a light source through a color sensor and records the acquisition time of the color data, and the acquisition angle of the color sensor is determined by a user;
the shooting auxiliary equipment sends the color data and the acquisition time to the terminal;
and the terminal corrects the color of the target image according to the color data, and the time difference between the acquisition time and the shooting time of the target image is smaller than a preset value.
A fourth aspect of an embodiment of the present invention provides a terminal, including:
a first acquisition unit configured to acquire a target image, which is an image captured by a camera;
a second acquisition unit, configured to acquire color data of a light source from a shooting auxiliary device, where the color data is acquired by a color sensor provided on the shooting auxiliary device, an acquisition angle of the color sensor is determined by a user, and a time difference between an acquisition time of the color data and a shooting time of the target image is smaller than a preset value;
and the first correcting unit is used for correcting the color of the target image acquired by the first acquiring unit according to the color data acquired by the second acquiring unit.
A fifth aspect of an embodiment of the present invention provides a shooting assistance apparatus, including:
an establishing unit for establishing a connection with a terminal;
the acquisition unit is used for acquiring color data of the light source through a color sensor, and the acquisition angle of the color sensor is determined by a user;
the recording unit is used for recording the acquisition time of the color data acquired by the acquisition unit;
and the sending unit is used for sending the color data acquired by the acquisition unit and the acquisition time recorded by the recording unit to the terminal for establishing the connection by the establishing unit.
A sixth aspect of the embodiments of the present invention provides an image processing system, including a terminal and a shooting assistance apparatus, wherein:
the shooting auxiliary equipment is used for establishing connection with the terminal;
the terminal is used for acquiring a target image, and the target image is an image shot by a camera;
the shooting auxiliary equipment acquires color data of a light source through a color sensor and records the acquisition time of the color data, and the acquisition angle of the color sensor is determined by a user;
the shooting auxiliary equipment is further used for sending the color data and the acquisition time to the terminal;
and the terminal is further used for carrying out color correction on the target image according to the color data, and the time difference between the acquisition time and the shooting time of the target image is smaller than a preset value.
In the embodiment of the invention, the terminal acquires the target image, acquires the color data of the light source from the shooting auxiliary equipment, and then corrects the target image according to the color data of the light source, so that the light source irradiating the shot object can be used for correcting the color of the image to be processed, and the color image can be accurately corrected. In addition, because the collection angle of the color sensor is determined by the user, the user can adjust the collection angle of the color sensor, so that the light source collected by the color sensor is a light source which has a large influence on the image, and the effect of correcting the color of the image can be further improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic diagram of a network architecture according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a color sensor and a spectral curve according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating an image processing method according to an embodiment of the present invention;
FIG. 4 is a flow chart of another image processing method according to an embodiment of the present invention;
FIG. 5 is a flowchart illustrating a further image processing method according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a terminal according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of another terminal according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a shooting assistance apparatus according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of another shooting assistance apparatus provided by an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an image processing system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides an image processing method, equipment and a system, which can accurately correct the color of a color image. The following are detailed below.
In order to better understand an image processing method, device, and system provided by the embodiments of the present invention, an application scenario of the embodiments of the present invention is described below. In order to pursue color constancy, a user hopes that an image acquired by a terminal provided with a camera can meet the color constancy, however, the color of a flash lamp is fixed and unchanged when the user takes a picture, the color of the flash lamp cannot be changed along with the difference of environmental colors, and light is always supplemented with the fixed color in the process of taking a picture, so that the light supplementing effect of the flash lamp is not good under certain conditions, the color constancy cannot be achieved, and the image needs to be processed subsequently. Among them, some of the ambient light sources have a large influence on the collected image, for example: the light source irradiating on the front side of the object to be shot has little influence on the collected image by some environmental light sources, such as: a light source for irradiating the back of the object. Therefore, a light source having a large influence on the captured image among the ambient light sources may be referred to as a primary light source, that is, a light source capable of illuminating the front surface of the subject may be referred to as a primary light source, and a light source having a small influence on the captured image among the ambient light sources may be referred to as a secondary light source, that is, a light source illuminating the back surface of the subject may be referred to as a secondary light source.
In order to better understand an image processing method, device, and system provided by the embodiments of the present invention, a network architecture according to the embodiments of the present invention is described below. Referring to fig. 1, fig. 1 is a schematic diagram of a network architecture according to an embodiment of the present invention. As shown in fig. 1, the network architecture may include a terminal 101 and a shooting auxiliary device 102, where the terminal 101 may be a smartphone (such as an Android Phone, an iOS Phone, a Windows Phone, etc.) provided with a camera, a tablet computer, and the shooting auxiliary device 102 may be a device provided with a color sensor, and the terminal 101 and the shooting auxiliary device 102 may be connected through a USB, a bluetooth, a WIFI, or other manners. When an image is acquired, the placement position and the acquisition angle of the shooting auxiliary device 102 are determined by a user, and the shooting auxiliary device 102 can be placed between the terminal 101 and a shot object and close to the position of the shot object; when the light source illuminating the front surface of the subject has only one light source, the photographing assistant device 102 may be placed at a position close to the light source; when the light source illuminating the front surface of the subject is two light sources, the photographing assistant device 102 may be placed between the two light sources; the auxiliary photographing device 102 may also be placed at other positions capable of collecting the light source irradiating on the front surface of the object to be photographed, and the embodiment of the present invention is not limited thereto.
In the embodiment of the present invention, the light source may be different types of natural light, for example: different weather, different time, different season, different longitude and latitude, sunlight facing and sunlight back facing light source or moonlight. The light source may also be: different kinds of artificial light sources, such as: fluorescent, incandescent, candle, high pressure mercury, sodium, LED, TL84, a light source, uv, D65, street, flashlight, and the like. The light source may also be other light sources, for example: a light source formed by firefly, a light source formed by luminous powder, a light source formed by luminous beads and the like.
It should be noted that, when the camera of the terminal takes a picture of the preset color card, if the preset color card is gray, a gray card image is obtained, and if the preset color card is a color card, a color card image is obtained.
It should be noted that the calibration data according to the embodiment of the present invention mainly refers to a mapping relationship between two images. Specifically, it refers to a correspondence between color data between two images. For example, taking a gray card as an example for description, color data of a light source a obtained under the light source a (the color data of the light source a can be collected by a color sensor) and a gray card image obtained under the light source a (the gray card image is obtained by shooting with a camera), then a mapping relationship between the color data of the light source a and the gray card image under the light source a can be established, that is, the light source a and the gray card are calibrated, and can be expressed by the following formula:
scAM＝grayA
wherein, scARepresenting color data, gray, under light source AAThe color data of the light source a is a gray card image of the light source a, and the M is calibration data between the color data of the light source a and the gray card image of the light source a, which is also called a mapping relationship. Or, by a table look-up method, calibration data of the light source and the gray card image under the light source is established, for example, a represents color data under the light source, B represents the gray card, then a1 represents color data under the first light source, B1 represents the gray card image under the first light source, then a mapping relationship between a1 and B1 may be referred to as a first set of calibration data; a2 represents the color data under the second illuminant, B2 represents the gray card image under the second illuminant, and the mapping relationship between A2 and B2 can be called as the second set of calibration data, so that the corresponding gray card image B1 can be directly obtained by looking up the table under the condition that A1 is known, and similarly, the corresponding gray card image B2 can be directly obtained by looking up the table under the condition that A2 is known, which is a table look-up manner. Generally, since there are more light sources and more colors of the light sources, each of the light sources needs to be calibrated, and the more calibration data is obtained, the more accurate the color correction is obtained in the embodiment of the present invention. Meanwhile, various calibration data can form a calibration database. It can be understood that each light source corresponds to a gray card image, and the mapping relationship between the color data under the light source and the gray card image under the light source is calibration data. In the same way, calibration data between the light source and the color chart can still be obtained in the case of the color chart.
The color sensor is generally composed of light spot conversion units of RGBW four channels, which can be RGBW sensors, chromatographic sensors, etc., and the spectral response characteristics of R, G, B are respectively close to the spectral response characteristics of three cone-shaped photosensitive cells L, S, M of human eyes retina. The spectral response characteristic of the W channel is close to that of the rod-shaped photoreceptor cells of the human visual retina. Wherein, RGBW includes 4 color data acquisition channels, so that different color data can be acquired by using the 4 channels, respectively, and the 4 color data acquisition channels can be color data of R (red) channel, color data of G (green) channel, color data of B (blue) channel, and color data of W (white) channel, respectively. Referring to fig. 2, fig. 2 is a schematic diagram of a color sensor and a spectrum curve according to an embodiment of the invention. The light diffusion plate shown in fig. 2 is a physical phenomenon that light rays are refracted, reflected and scattered by a chemical or physical means when encountering two media with different refractive indexes (densities) in the traveling path, and the light rays are refracted, reflected and scattered in different directions by adding an inorganic or organic light diffuser to a base material such as polymethyl methacrylate (PMMA), bulletproof glue (PC), Polystyrene (PS), polypropylene (PP), or the like, or by adjusting the light rays by an array of micro-feature structures on the surface of the base material, so that the traveling path of the light rays is changed, and the incident light is fully dispersed to generate an optical diffusion effect.
Referring to fig. 3, fig. 3 is a schematic flow chart of an image processing method according to an embodiment of the present invention based on the network architecture shown in fig. 1. Wherein the image processing method is described from the perspective of the terminal 101. As shown in fig. 3, the image processing method may include the following steps.
301. And acquiring a target image.
In this embodiment, when the user is not satisfied with the target image acquired by the camera, the image processing application or the image processing client may obtain the target image by operating, that is, the image processing application or the image processing client loads the target image in the image processing application or the image processing client. The target image is an image collected by a camera on the terminal. Among them, the image processing application or the image processing client may be an application or a client installed in the terminal.
302. Color data of the light source is acquired from the photographing assistant device.
In this embodiment, when the camera collects an image, the colors of the light sources irradiated on the object to be photographed are different, and the effect of the collected image is different. Therefore, the terminal can send a collecting instruction for collecting the color data of the light source to the shooting auxiliary equipment when the camera collects the target image or before the target image is collected, so that the shooting auxiliary equipment collects the color data of the light source through the color sensor and sends the color data to the terminal, and the frequency of collecting the color data of the light source by the color sensor can be reduced; in addition, the shooting auxiliary device may also collect color data of the light source in real time or periodically, the terminal may also send a color data acquisition instruction to the shooting auxiliary device, so that the shooting auxiliary device sends the collected color data of the light source to the terminal, or the shooting auxiliary device actively sends the collected color data of the light source to the terminal, and then the terminal may select, from the color data of the received light source, the color data of the light source with the smallest time difference between the collection time and the shooting time of the target image as the color data of the light source for correcting the target image. The terminal may then store the color data of the light source and the target image for subsequent recall. The color data of the light source is acquired through a color sensor arranged on the shooting auxiliary device, the acquisition angle of the color sensor is determined by a user, and in order to further improve the image correction effect, the user can adjust the acquisition angle of the color sensor to enable the light source acquired by the color sensor to be a main light source, namely, the color data of the light source irradiating the front face of the shot object is acquired. In one embodiment, when an included angle between a ray of the viewing angle of the color sensor along the shooting direction and a ray of the axis of the camera along the shooting direction is less than 90 degrees, the light source collected by the color sensor is a light source irradiating on the front surface of the object to be shot. The shooting auxiliary equipment can be provided with a plurality of color sensors, the color sensors can simultaneously collect color data of the light sources, and then the light source with the maximum color brightness in the color data of the light sources collected by the color sensors can be used for adjusting the color of the light supplementing light source. When the preset color card is a gray card, the color data of the light source is collected through each channel of the color sensor; when the preset color card is the color card, the color data of the light source is directly collected through the color sensor.
In order to collect as much color data of the light source as possible by the color sensor, the surface of the color sensor may be covered with a layer of diffusion material so as to increase the field of view (FOV) of the light source collected by the color sensor, so that the color sensor can collect light with a larger incident angle, and the intensity and spectrum of the light sensed by each photoelectric sensing circuit are closer. In addition, due to the diffusion effect, the concentration degree of the measuring direction is weakened, the influence of local bright objects in the environment is not easy to receive, and the color data of the light source in the environment can be measured more accurately.
Also, in order to collect as much color data of the current light source as possible by the color sensor, the FOV of the color sensor is larger than the FOV of the camera.
In this embodiment, when the color sensor is an RGBW sensor and the preset color card is a gray card, the gray card is black and white, and therefore, data of the gray card can be represented by data of only one channel, and therefore, color data can be acquired for the light source by respectively using 4 channels of the RGBW sensor; when the color sensor is an RGBW sensor and the preset color card is a color card, the color card is a color and includes data of three channels of RGB, so that the color data of the color can be directly collected by using 4 channels of the RGBW sensor.
303. And performing color correction on the target image according to the color data.
In this embodiment, after the color data of the target image and the light source is obtained, the color of the target image may be corrected according to the color data by an image processing application or an image processing client on the terminal, or the color of the target image may be corrected according to the color data by an image processing application or an image processing client outside the terminal. And performing color correction, namely acquiring calibration data between the light source and a preset color card, then determining light source parameters according to the calibration data and the color data acquired from the shooting auxiliary equipment, and performing color correction on the target image according to the light source parameters.
In this embodiment, after the color data of the light source and the image of the preset color card acquired by the camera are acquired, calibration data between the color data of the light source and the color card image of the preset color card acquired under the light source may be established. The preset color cards can be gray cards and color cards, the gray cards can only display black and white colors, and the color cards can display colors, such as 24 color cards and 144 color cards.
In this embodiment, the calibration data between the light source and the preset color card may be obtained in the following manner:
firstly, N color data under N different light sources collected by a color sensor are obtained.
In this embodiment, the N different light sources are different light sources in the environment, and the N color data under the N different light sources may be collected by the color sensor, where N is an integer not less than 3. Corresponding color data can be obtained under each light source. Measuring color data to sc under different light sources by using color sensorkAnd k is more than 1 and less than or equal to N, wherein N is the number of the light source types, and k represents the kth light source.
Wherein, SRk,SGk,SBk,SWkIs color data, SR, obtained by 4-channel measurement of RGBW sensorkColor data obtained for the Red channel, SGkColor data obtained for the green channel, SBkColor data obtained for the blue channel, SWkThe color data obtained for the white channel,sredkfor normalized color data of the red channel, sgreenkFor the normalized color data of the green channel, sbluekIs the color data of the normalized blue channel. Wherein,
and secondly, acquiring N gray card images aiming at the gray card under N different light sources.
In this embodiment, under N different light sources, shooting may be performed by a camera to obtain N gray card images for the gray card under the N different light sources, where each light source of the N different light sources corresponds to one gray card image, and IkAnd representing the kth gray card image, wherein k is more than 1 and less than or equal to N. Specifically, the terminal may be aligned to the gray card under N different light sources, i.e., the shooting range of the camera is occupied by the gray card. Under each light source, a gray card image for the gray card is available.
And finally, determining calibration data according to the N color data and the N gray card images.
In this embodiment, after the N color data and the N color card images are acquired, a mapping relationship between the N color data and the N gray card images may be established. The average gray level gray of the gray card image for the gray card under various light sources can be calculatedkAnd represents the average gray scale under the k-th light source. The average color of the gray card under different light sources was then calculated:
wherein R isk、GkAnd BkThe average values R of R channel, G channel and B channel of the gray card image under the kth light source are respectivelykDenotes the mean value of the normalized R channel, gkRepresents the average value of the normalized G channel and represents the average value of the normalized B channel. Finally, asckAnd graykThe mapping relationship between the two is the calibration data. Specifically, an sc is establishedkAnd graykThe mapping relationship between the two can be as follows:
sckM＝grayk
namely:
m under each light source can be solved through the equation, wherein M is calibration data, the calibration data obtained under the N light sources are stored, and a calibration database is established.
Alternatively, sc may also be determined by a comparison methodkAnd graykThen, the mapping relation, i.e. the calibration data, is searched by a table look-up method. And each light source has a group of corresponding mapping relations, and the N mapping relations are fitted, so that a calibration database is obtained.
In this embodiment, a functional relationship between the color data and the calibration data may be constructed, for example, the color data may be used as the output data, the calibration data may be used as the input data, a mapping relationship may exist between the input data and the output data, and a function between the input data and the output data may be constructed based on the mapping relationship, so that the solution obtained may be used as the light source parameter. Alternatively, the color data may be used as input data, the calibration data may be used as output data, a mapping relationship may exist between the input data and the output data, and a function between the input data and the output data may be constructed based on the mapping relationship, whereby the solution obtained may be used as the light source parameter.
In this embodiment, the color data and the calibration data may be used to determine the light source parameters, that is, target calibration data matched with the light source in the calibration data may be determined, and the light source parameters may be determined according to the target calibration data and the color data. And calculating color data of the virtual gray card according to the light source parameters, and finally calculating white balance gain according to the color data of the virtual gray card. The light source parameters are proportional components of various light sources in the light source. The specific solving method is as follows:
first, target calibration data matching the light sources in the calibration data may be determined, i.e., the colors (sc) corresponding to the three calibration light sources with the smallest Euclidean distance among the N light sources in the calibration data may be calculatedm1scm2scm3) Recorded as SCm＝(scm1scm2scm3) And determining target calibration data matched with the light source in the calibration data. That is, the euclidean distance between the color data in the light source and each calibration data included in the calibration database is calculated, so that a plurality of euclidean distance values can be obtained, the smallest three euclidean distance values among the plurality of euclidean distance values are selected, and the color data of the light source corresponding to the three euclidean distance values is used as the color data of the light source.
Secondly, determining light source parameters according to the target calibration data and the color data of the light source, and enabling:
wherein p iskRepresenting a light source parameter, k having a value of 1, or 2, or 3, sckRepresenting target calibration data and sc representing color data of the light source. The mapping relationship may be based on SCmIs divided into 3 cases, and thus, the matrix SC is calculatedmIs determined. In 3 cases the following:
(1) if SCmIs 1, then take scm1、scm2、scm3As the color data of the light source. Then, the color data of the virtual gray card is grayvirtual＝graym1I.e., P ═ I, I is the identity matrix;
(2) if SCmIs of rankAnd 2, considering the light sources as 2 light source linear combinations in the calibration light sources. Therefore, makeWhere P is a weighting coefficient, i.e. a light source parameter. Record as matrix form: SC (Single chip computer)3×2P2×1＝sc3×1Wherein
Thus, the contradictory equation SC is solved3×2P3×1＝sc3×1Obtaining light source parameter P ═ SC+sc，SC+Is the Moore-Penrose inverse of SC. Then, the color data gray of the virtual gray cardvirtualComprises the following steps:
(3) if SCmIf the rank of (2) is 3, the light source can be considered as a linear combination of 3 different light sources in the calibration light source. Therefore, makeWhere p is a weighting coefficient, i.e. a light source parameter. Record as matrix form: SC (Single chip computer)3×3P3×1＝sc3×1Wherein
Thus, the contradiction equation SC is solved3×3P3×1＝sc3×1Obtaining the light source parameter P ═ SC+And sc, the obtained light source parameters are as follows:
then, the color data gray of the virtual gray cardvirtualComprises the following steps:
in this embodiment, the color correction of the target image may be performed by using the light source parameters, specifically: will grayvirtualColor data as a gray card, and the grayvirtualDivide into RGB three channel data, as follows:
for the grayvirtualThe white balance gain is obtained by normalization processing, as follows:
and correcting the target image by using the white balance gain:
wherein the target image I ═ { I ═ IR,IG,IBH, the output picture is I '═ I'R,I'G,I'B}。
Optionally, when the preset color card is a color card, the color data of the virtual color card may be determined on the basis of the light source, specifically as follows:
the virtual color chip can be written as:
colorvirtual＝p1colorm1+p2colorm2+p3colorm3，
taking the 24 color card as an example, then,
recording:
then obtaining the color data of the standard color card, wherein the color data of the standard color card can be obtained by manufacturers or standard organizationsAnd (4) defining. And determining a color regeneration matrix according to the color data of the standard color card and the color data of the virtual color card. Recording the color vector of each color block of the standard color card as colorstdColor if there are N color blocks in the color cardstdThe matrix is N × 3 the data of the matrix is defined by the manufacturer or standard organization.
Taking a standard 24 color card as an example, the color data of the standard 24 color card is known and is recorded as:
the color reproduction matrix to be solved is M3×3Obtaining an equation set:
colorstd＝colorvirtualM3×3
the above equations hold for each color block due to errors, so this is a set of contradictory equations, and only a least squares solution needs to be solved. I.e. solving the optimization problem: m3×3＝Argmin(||colorstd-M3×3colovrirtual| |) is a linear optimization problem: the above formula is developed to obtain:
thus, a minimum 2 norm minimum 2 product solution of three independent sets of contradictory equations Ax ═ b is obtained as x ═ a+b,
Wherein A is+Is the Moore-Penrose inverse of A. Can be obtained by the above method
Thus, pair M can be completed3×3And (4) solving. And finally, carrying out color correction on the target image according to the color reproduction matrix.
In this embodiment, the terminal may perform color correction on each pixel point in the target image according to the following equation, as follows:
the embodiment of the invention can be solved by using other color cards as preset color cards.
In this embodiment, the color data of the standard color card is known, and can be known through the production information of the standard color card. The color reproduction matrix can be written as follows:
wherein,is to output the color data of the color,in order to reproduce the matrix for the color,is the target image. The color reproduction matrix may be written as:
then, one can get:
in summary, in the matrix M3×3When the color reproduction matrix can be accurately solved, the colors of the output image can be accurately restored according to the conversion of the color reproduction matrix.
In the image processing method described in fig. 3, the terminal acquires the target image and acquires the color data of the light source from the photographing assistant device, and then corrects the target image according to the color data of the light source, so that the light source irradiating the photographed object can be used to perform color correction on the image to be processed, and the color correction on the color image can be accurately performed. In addition, because the collection angle of the color sensor is determined by the user, the user can adjust the collection angle of the color sensor, so that the light source collected by the color sensor is a light source which has a large influence on the image, and the effect of correcting the color of the image can be further improved.
Referring to fig. 4, based on the network architecture shown in fig. 1, fig. 4 is a schematic flowchart of another image processing method according to an embodiment of the present invention. The image processing method is described from the perspective of the shooting assistance apparatus 102. As shown in fig. 4, the image processing method may include the following steps.
401. A connection is established with the terminal.
In this embodiment, when a user needs to capture an image through a terminal, the capture assisting apparatus may establish a connection with the terminal.
402. And collecting color data of the light source through a color sensor, and recording the collection time of the color data.
In this embodiment, after the shooting auxiliary device is connected to the terminal, color data of the light source may be collected by the color sensor in real time or periodically, and the collection time of the color data may be recorded. Wherein the collection angle of the color sensor is determined by the user.
In this embodiment, after the shooting auxiliary device is connected to the terminal, the color data of the light source may be collected by the color sensor after receiving a collection instruction sent by the terminal and used for collecting the color data of the light source, or when a collection target image is monitored, and the collection time for collecting the color data may not be recorded.
403. And sending the color data and the acquisition time of the color data to a terminal.
In this embodiment, after the shooting assistance device collects the color data, the color data and the collection time of the color data may be actively sent to the terminal. Or after receiving a color data acquisition instruction sent by the terminal, sending all or part of the color data acquired when the instruction is received or before the instruction is received to the terminal.
In this embodiment, when the color data of the light source is collected after receiving the collection instruction sent by the terminal and used for collecting the color data of the light source, the shooting auxiliary device can directly send the color data to the terminal without recording the collection time as the collection is only required once.
In the image processing method described in fig. 4, the photographing assisting device may acquire color data of the light source through the color sensor and transmit the acquired color data to the terminal, so that the terminal performs a correction process on the image according to the color data, and thus, the light source irradiating the photographed object may be used to perform a color correction on the image to be processed, and thus, a color image may be accurately color-corrected. In addition, because the collection angle of the color sensor is determined by the user, the user can adjust the collection angle of the color sensor, so that the light source collected by the color sensor is a light source which has a large influence on the image, and the effect of correcting the color of the image can be further improved.
Referring to fig. 5, based on the network architecture shown in fig. 1, fig. 5 is a schematic flowchart of another image processing method according to an embodiment of the present invention. Wherein the image processing method is described from the point of view of the terminal 101 and the shooting assistance apparatus 102. As shown in fig. 5, the image processing method may include the following steps.
501. The photographing auxiliary device establishes a connection with the terminal.
Step 501 is the same as step 401 in the previous embodiment, and is not described herein again in this embodiment of the present invention.
502. The terminal acquires a target image.
Step 502 is the same as step 301 in the previous embodiment, and is not described herein again in this embodiment of the present invention.
503. The shooting auxiliary equipment collects the color data of the light source through the color sensor and records the collection time of the color data.
Step 503 is the same as step 402 in the previous embodiment, and is not described herein again in this embodiment of the present invention.
504. The shooting auxiliary equipment sends the color data and the acquisition time to the terminal.
Step 504 is the same as step 403 in the previous embodiment, and is not described herein again in this embodiment of the present invention.
505. The terminal corrects the color of the target image according to the color data.
Step 505 is the same as step 303 in the previous embodiment, and is not described herein again in this embodiment of the present invention.
In the image processing method described in fig. 5, the light source illuminating the object to be photographed can be used to perform color correction on the image to be processed, so that the color correction can be accurately performed on the color image. In addition, because the collection angle of the color sensor is determined by the user, the user can adjust the collection angle of the color sensor, so that the light source collected by the color sensor is a light source which has a large influence on the image, and the effect of correcting the color of the image can be further improved.
Referring to fig. 6 based on the network architecture shown in fig. 1, fig. 6 is a schematic structural diagram of a terminal according to an embodiment of the present invention. As shown in fig. 6, the terminal may include:
a first acquisition unit 601 configured to acquire a target image, which is an image captured by a camera;
a second obtaining unit 602, configured to obtain color data of the light source from the shooting assistance apparatus, where the color data is collected by a color sensor provided on the shooting assistance apparatus, a collection angle of the color sensor is determined by a user, and a time difference between a collection time of the color data and a shooting time of the target image is smaller than a preset value;
a first correcting unit 603 configured to perform color correction on the target image acquired by the first acquiring unit 601 according to the color data acquired by the second acquiring unit 602.
As a possible embodiment, the first correcting unit 603 may include:
a third obtaining unit 6031, configured to obtain calibration data between the light source and a preset color card;
a determining unit 6032 configured to determine a light source parameter according to the calibration data acquired by the third acquiring unit 6031 and the color data acquired by the second acquiring unit 602;
a second rectification unit 6033 configured to perform color rectification on the target image acquired by the first acquisition unit 601 according to the light source parameter determined by the determination unit 6032.
As a possible implementation, the determination of the collection angle of the color sensor by the user includes:
the collection angle of the color sensor is adjusted by a user, and the included angle between the ray of the axis of the field angle of the color sensor along the shooting direction and the ray of the axis of the camera along the shooting direction is kept to be smaller than 90 degrees.
In the terminal described in fig. 6, the terminal acquires the target image and the color data of the light source from the photographing assistant device, and then corrects the target image according to the color data of the light source, so that the light source irradiating the photographed object can be used to perform color correction on the image to be processed, and the color correction on the color image can be accurately performed. In addition, because the collection angle of the color sensor is determined by the user, the user can adjust the collection angle of the color sensor, so that the light source collected by the color sensor is a light source which has a large influence on the image, and the effect of correcting the color of the image can be further improved.
Referring to fig. 7 based on the network architecture shown in fig. 1, fig. 7 is a schematic structural diagram of another terminal according to an embodiment of the present invention. The terminal can be a mobile phone with a camera, a tablet computer and the like. As shown in fig. 7, the terminal may include: the at least one processor 701, such as a CPU, memory 702, camera 703, screen 704, transceiver 705, image processing device 706 and at least one communication bus 707 memory 702 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. Alternatively, the memory 702 may also be at least one storage device located remotely from the processor 701. Wherein:
a communication bus 707 for realizing connection communication between these components;
the memory 702 has a set of program codes stored therein, and the processor 701 is configured to call the program codes stored in the memory 702 to perform the following operations:
if a starting instruction for starting the terminal camera is detected, starting the camera;
the camera 703 is used for acquiring a target image and sending the target image to the processor 701;
a screen 704 for displaying the acquired target image;
the transceiver 705 acquires color data of the light source from the shooting auxiliary equipment and sends the color data to the processor 701, wherein the color data is acquired by a color sensor arranged on the shooting auxiliary equipment, the acquisition angle of the color sensor is determined by a user, and the time difference between the acquisition time of the color data and the shooting time of the target image is smaller than a preset value;
the processor 701 is also configured to invoke the program code stored in the memory 702 to perform the following operations:
storing the target image and the color data;
the image processing means 706 is configured to:
acquiring a stored target image, wherein the target image is an image shot by a camera;
acquiring the stored color data;
and performing color correction on the target image according to the color data.
As a possible implementation, the image processor 706 performs color correction on the target image according to the color data by:
acquiring calibration data between a light source and a preset color card;
determining light source parameters according to the calibration data and the color data;
and carrying out color correction on the target image according to the light source parameters.
As a possible implementation, the determination of the collection angle of the color sensor by the user includes:
the collection angle of the color sensor is adjusted by a user, and the included angle between the ray of the axis of the field angle of the color sensor along the shooting direction and the ray of the axis of the camera along the shooting direction is kept to be smaller than 90 degrees.
The camera 703 may be a front camera or a rear camera.
The first obtaining unit 601 and the first correcting unit 603 may be implemented by the processor 701 and the memory 702 in the terminal, and the second obtaining unit 602 may be implemented by the transceiver 705 in the terminal.
In the terminal described in fig. 7, the terminal acquires the target image and the color data of the light source from the photographing assistant device, and then corrects the target image according to the color data of the light source, so that the light source irradiating the photographed object can be used to perform color correction on the image to be processed, and the color correction on the color image can be accurately performed. In addition, because the collection angle of the color sensor is determined by the user, the user can adjust the collection angle of the color sensor, so that the light source collected by the color sensor is a light source which has a large influence on the image, and the effect of correcting the color of the image can be further improved.
Referring to fig. 8, based on the network architecture shown in fig. 1, fig. 8 is a schematic structural diagram of a shooting assistance device according to an embodiment of the present invention. As shown in fig. 8, the photographing assistant apparatus may include:
an establishing unit 801, configured to establish a connection with a terminal;
an acquisition unit 802 for acquiring color data of the light source through a color sensor, an acquisition angle of the color sensor being determined by a user;
a recording unit 803 for recording the acquisition time of the color data acquired by the acquisition unit 802;
a sending unit 804, configured to send the color data collected by the collecting unit 802 and the collecting time recorded by the recording unit 803 to a terminal that is connected by the establishing unit 801.
In the photographing assisting apparatus described in fig. 8, the photographing assisting apparatus may transmit color data of the light source collected by the color sensor to the terminal so that the terminal performs a correction process on the image according to the color data, and thus, the light source irradiating the photographed object may be used to perform a color correction on the image to be processed, so that a color image may be accurately color-corrected. In addition, because the collection angle of the color sensor is determined by the user, the user can adjust the collection angle of the color sensor, so that the light source collected by the color sensor is a light source which has a large influence on the image, and the effect of correcting the color of the image can be further improved.
Referring to fig. 9 based on the network architecture shown in fig. 1, fig. 9 is a schematic structural diagram of another shooting assistance device according to an embodiment of the present invention. As shown in fig. 9, the photographing assistant apparatus may include: at least one processor 901, such as a CPU, memory 902, color sensor 903, transceiver 904, and at least one communication bus 905. The memory 902 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. Alternatively, the memory 902 may also be at least one storage device located remotely from the aforementioned processor 901. Wherein:
a communication bus 905 for implementing connection communication between these components;
the memory 902 has a set of program codes stored therein, and the processor 901 is configured to call the program codes stored in the memory 902 to perform the following operations:
establishing connection with a terminal;
a color sensor 903 for collecting color data of the light source and sending the collected color data to the processor 901, wherein the collection angle of the color sensor is determined by a user;
the processor 901 is also configured to invoke the program code stored in the memory 902 to perform the following operations:
the time of acquisition of the color data is recorded,
a transceiver 904 for transmitting the color data and the acquisition time to a terminal.
The establishing unit 801 and the adjusting unit recording unit 803 may be implemented by a processor 901 and a memory 902 in the shooting assistance device, the transmitting unit 804 may be implemented by a transceiver 904 in the shooting assistance device, and the acquiring unit 802 may be implemented by a color sensor 903 in the shooting assistance device.
In the photographing assisting apparatus described in fig. 9, the photographing assisting apparatus may transmit color data of the light source collected by the color sensor to the terminal so that the terminal performs a correction process on the image according to the color data, and thus, the light source irradiating the photographed object may be used to perform a color correction on the image to be processed, so that a color image may be accurately color-corrected. In addition, because the collection angle of the color sensor is determined by the user, the user can adjust the collection angle of the color sensor, so that the light source collected by the color sensor is a light source which has a large influence on the image, and the effect of correcting the color of the image can be further improved.
Referring to fig. 10, based on the network architecture shown in fig. 1, fig. 10 is a schematic structural diagram of an image processing system according to an embodiment of the present invention. The image processing system may include a terminal 1001 and a photographing assistant device 1002, wherein:
a shooting assistance apparatus 1002 for establishing a connection with the terminal 1001;
a terminal 1001 for acquiring a target image, which is an image photographed by a camera;
the shooting auxiliary device 1002 is further configured to collect color data of the light source through a color sensor, and record collection time of the color data, where a collection angle of the color sensor is determined by a user;
the shooting auxiliary device 1002 is further configured to send the color data and the acquisition time to the terminal 1001;
the terminal 1001 is further configured to perform color correction on the target image according to the color data, and a time difference between the acquisition time and the shooting time of the target image is smaller than a preset value.
As a possible implementation, the terminal 1001 performs color correction on the target image according to the color data by:
the method comprises the steps that a terminal obtains calibration data between a light source and a preset color card;
the terminal determines light source parameters according to the calibration data and the color data;
and the terminal corrects the color of the target image according to the light source parameters.
As a possible implementation, the determination of the collection angle of the color sensor by the user includes:
the collection angle of the color sensor is adjusted by a user, and the included angle between the ray of the axis of the field angle of the color sensor along the shooting direction and the ray of the axis of the camera along the shooting direction is kept to be smaller than 90 degrees.
In the image processing system described in fig. 10, the light source that irradiates the subject to be photographed can be used to perform color correction on the image to be processed, so that color correction can be performed accurately on a color image. In addition, because the collection angle of the color sensor is determined by the user, the user can adjust the collection angle of the color sensor, so that the light source collected by the color sensor is a light source which has a large influence on the image, and the effect of correcting the color of the image can be further improved.
The order of the steps of the method of the embodiments of the present invention may be adjusted, combined, or deleted according to actual needs. The units of the terminal of the embodiment of the invention can be integrated, further divided or deleted according to actual needs.
The elements of the embodiments of the present invention may be implemented in a general purpose integrated circuit (e.g., a central processing unit CPU) or an Application Specific Integrated Circuit (ASIC).
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The image processing method, device and system provided by the embodiment of the present invention are described in detail above, and the principle and the embodiment of the present invention are explained in the present document by applying specific examples, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (14)
1. An image processing method, comprising:
acquiring a target image, wherein the target image is an image shot by a camera;
acquiring color data of a light source from a shooting auxiliary device, wherein the color data is acquired through a color sensor arranged on the shooting auxiliary device, the acquisition angle of the color sensor is determined by a user, and the time difference between the acquisition time of the color data and the shooting time of the target image is smaller than a preset value;
and performing color correction on the target image according to the color data.
2. The method of claim 1, wherein the color rectifying the target image according to the color data comprises:
acquiring calibration data between a light source and a preset color card;
determining light source parameters according to the calibration data and the color data;
and performing color correction on the target image according to the light source parameters.
3. The method of claim 1 or 2, wherein the determination of the acquisition angle of the color sensor by the user comprises:
the acquisition angle of the color sensor is adjusted by a user, and the included angle between the ray of the axis of the field angle of the color sensor along the shooting direction and the ray of the axis of the camera along the shooting direction is kept to be less than 90 degrees.
4. An image processing method, comprising:
establishing connection with a terminal;
collecting color data of a light source through a color sensor, and recording the collection time of the color data, wherein the collection angle of the color sensor is determined by a user;
and sending the color data and the acquisition time to the terminal.
5. An image processing method, comprising:
the shooting auxiliary equipment establishes connection with the terminal;
the terminal acquires a target image, wherein the target image is an image shot by a camera;
the shooting auxiliary equipment acquires color data of a light source through a color sensor and records the acquisition time of the color data, and the acquisition angle of the color sensor is determined by a user;
the shooting auxiliary equipment sends the color data and the acquisition time to the terminal;
and the terminal corrects the color of the target image according to the color data, and the time difference between the acquisition time and the shooting time of the target image is smaller than a preset value.
6. The method of claim 5, wherein the terminal performing color correction on the target image according to the color data comprises:
the terminal acquires calibration data between a light source and a preset color card;
the terminal determines light source parameters according to the calibration data and the color data;
and the terminal corrects the color of the target image according to the light source parameter.
7. The method of claim 5 or 6, wherein the determining by the user the collection angle of the color sensor comprises:
the acquisition angle of the color sensor is adjusted by a user, and the included angle between the ray of the axis of the field angle of the color sensor along the shooting direction and the ray of the axis of the camera along the shooting direction is kept to be less than 90 degrees.
8. A terminal, comprising:
a first acquisition unit configured to acquire a target image, which is an image captured by a camera;
a second acquisition unit, configured to acquire color data of a light source from a shooting auxiliary device, where the color data is acquired by a color sensor provided on the shooting auxiliary device, an acquisition angle of the color sensor is determined by a user, and a time difference between an acquisition time of the color data and a shooting time of the target image is smaller than a preset value;
and the first correcting unit is used for correcting the color of the target image acquired by the first acquiring unit according to the color data acquired by the second acquiring unit.
9. The terminal of claim 8, wherein the first rectification unit comprises:
the third acquisition unit is used for acquiring calibration data between the light source and the preset color card;
the determining unit is used for determining light source parameters according to the calibration data acquired by the third acquiring unit and the color data acquired by the second acquiring unit;
and the second correcting unit is used for correcting the color of the target image acquired by the first acquiring unit according to the light source parameters determined by the determining unit.
10. The terminal according to claim 8 or 9, wherein the determination of the collection angle of the color sensor by the user comprises:
the acquisition angle of the color sensor is adjusted by a user, and the included angle between the ray of the axis of the field angle of the color sensor along the shooting direction and the ray of the axis of the camera along the shooting direction is kept to be less than 90 degrees.
11. A shooting assistance apparatus characterized by comprising:
an establishing unit for establishing a connection with a terminal;
the acquisition unit is used for acquiring color data of the light source through a color sensor, and the acquisition angle of the color sensor is determined by a user;
the recording unit is used for recording the acquisition time of the color data acquired by the acquisition unit;
and the sending unit is used for sending the color data acquired by the acquisition unit and the acquisition time recorded by the recording unit to the terminal for establishing the connection by the establishing unit.
12. An image processing system comprising a terminal and a shooting assistance apparatus, wherein:
the shooting auxiliary equipment is used for establishing connection with the terminal;
the terminal is used for acquiring a target image, and the target image is an image shot by a camera;
the shooting auxiliary equipment is also used for acquiring color data of a light source through a color sensor and recording the acquisition time of the color data, and the acquisition angle of the color sensor is determined by a user;
the shooting auxiliary equipment is further used for sending the color data and the acquisition time to the terminal;
and the terminal is further used for carrying out color correction on the target image according to the color data, and the time difference between the acquisition time and the shooting time of the target image is smaller than a preset value.
13. The system of claim 12, wherein the terminal performing color correction on the target image according to the color data comprises:
the terminal acquires calibration data between a light source and a preset color card;
the terminal determines light source parameters according to the calibration data and the color data;
and the terminal corrects the color of the target image according to the light source parameter.
14. The system of claim 12 or 13, wherein the determination of the collection angle of the color sensor by the user comprises:
the acquisition angle of the color sensor is adjusted by a user, and the included angle between the ray of the axis of the field angle of the color sensor along the shooting direction and the ray of the axis of the camera along the shooting direction is kept to be less than 90 degrees.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610429291.5A CN106412416A (en) | 2016-06-16 | 2016-06-16 | Image processing method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610429291.5A CN106412416A (en) | 2016-06-16 | 2016-06-16 | Image processing method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106412416A true CN106412416A (en) | 2017-02-15 |
Family
ID=58006604
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610429291.5A Withdrawn CN106412416A (en) | 2016-06-16 | 2016-06-16 | Image processing method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106412416A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108416782A (en) * | 2018-04-19 | 2018-08-17 | 云南佳叶现代农业发展有限公司 | View-based access control model identifies and the tobacco leaf ranking method and system of illumination correction |
| CN111294576A (en) * | 2020-02-13 | 2020-06-16 | 展讯通信（上海）有限公司 | Automatic white balance processing method and device and electronic equipment |
| CN111524111A (en) * | 2020-04-17 | 2020-08-11 | 北京古今盛世文化传播有限公司 | Printing processing method and device based on artwork |
| CN114359114A (en) * | 2022-03-16 | 2022-04-15 | 宁波杜比医疗科技有限公司 | Mononuclear focus hue reduction method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1627317A (en) * | 2003-12-12 | 2005-06-15 | 北京阳光奥森科技有限公司 | Method for obtaining image of human faces by using active light source |
| US20100182625A1 (en) * | 2007-10-01 | 2010-07-22 | Kabushiki Kaisha Toshiba | Image forming apparatus, image quality control method |
| CN105430366A (en) * | 2015-12-24 | 2016-03-23 | 广东欧珀移动通信有限公司 | Control method, control device and photographing system |
| CN105577982A (en) * | 2015-12-31 | 2016-05-11 | 深圳市金立通信设备有限公司 | Image processing method and terminal |
| CN105678710A (en) * | 2016-01-14 | 2016-06-15 | 佛山华芯微特科技有限公司 | Color correction and restoration system and color correction and restoration method |
-
2016
- 2016-06-16 CN CN201610429291.5A patent/CN106412416A/en not_active Withdrawn
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1627317A (en) * | 2003-12-12 | 2005-06-15 | 北京阳光奥森科技有限公司 | Method for obtaining image of human faces by using active light source |
| US20100182625A1 (en) * | 2007-10-01 | 2010-07-22 | Kabushiki Kaisha Toshiba | Image forming apparatus, image quality control method |
| CN105430366A (en) * | 2015-12-24 | 2016-03-23 | 广东欧珀移动通信有限公司 | Control method, control device and photographing system |
| CN105577982A (en) * | 2015-12-31 | 2016-05-11 | 深圳市金立通信设备有限公司 | Image processing method and terminal |
| CN105678710A (en) * | 2016-01-14 | 2016-06-15 | 佛山华芯微特科技有限公司 | Color correction and restoration system and color correction and restoration method |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108416782A (en) * | 2018-04-19 | 2018-08-17 | 云南佳叶现代农业发展有限公司 | View-based access control model identifies and the tobacco leaf ranking method and system of illumination correction |
| CN108416782B (en) * | 2018-04-19 | 2023-09-26 | 云南佳叶现代农业发展有限公司 | Tobacco leaf grading method and system based on visual identification and illumination correction |
| CN111294576A (en) * | 2020-02-13 | 2020-06-16 | 展讯通信（上海）有限公司 | Automatic white balance processing method and device and electronic equipment |
| CN111294576B (en) * | 2020-02-13 | 2021-11-09 | 展讯通信（上海）有限公司 | Automatic white balance processing method and device and electronic equipment |
| CN111524111A (en) * | 2020-04-17 | 2020-08-11 | 北京古今盛世文化传播有限公司 | Printing processing method and device based on artwork |
| CN111524111B (en) * | 2020-04-17 | 2023-06-16 | 北京古今盛世文化传播有限公司 | Printing processing method and device based on artwork |
| CN114359114A (en) * | 2022-03-16 | 2022-04-15 | 宁波杜比医疗科技有限公司 | Mononuclear focus hue reduction method and device, electronic equipment and storage medium |
| CN114359114B (en) * | 2022-03-16 | 2022-08-23 | 宁波杜比医疗科技有限公司 | Mononuclear focus hue reduction method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Pierson et al. | Tutorial: luminance maps for daylighting studies from high dynamic range photography | |
| CN106416226B (en) | Image processing system, imaging device, image processing method and computer readable recording medium | |
| CN100550053C (en) | Determine the scene distance in the digital camera images | |
| CN105577982A (en) | Image processing method and terminal | |
| US10949958B2 (en) | Fast fourier color constancy | |
| Nixon et al. | Accurate device-independent colorimetric measurements using smartphones | |
| CN108702437A (en) | High dynamic range depth for 3D imaging systems generates | |
| CN113170028B (en) | Method for generating image data of machine learning based imaging algorithm | |
| CN105306916A (en) | Image pickup apparatus that performs white balance control and method of controlling the same | |
| CN105765967A (en) | Using second camera to adjust settings of first camera | |
| CN105635593A (en) | Multiple exposure imaging system and white balance method thereof | |
| US20150131902A1 (en) | Digital Image Analysis | |
| CN106412416A (en) | Image processing method, device and system | |
| KR102397924B1 (en) | Electronic device and method for correcting images based on image feature information and image correction scheme | |
| CN104581104A (en) | White balance color temperature measurement device for image pick-up devices | |
| KR102285756B1 (en) | Electronic system and image processing method | |
| WO2022067762A1 (en) | Image processing method and apparatus, photographic device, movable platform, and computer-readable storage medium | |
| US11457189B2 (en) | Device for and method of correcting white balance of image | |
| WO2022067761A1 (en) | Image processing method and apparatus, capturing device, movable platform, and computer readable storage medium | |
| CN111492653B (en) | Method and device for quickly adjusting white balance of camera and computer readable storage medium | |
| JPH027010B2 (en) | ||
| Wannous et al. | Improving color correction across camera and illumination changes by contextual sample selection | |
| CN105991987A (en) | Image processing method, equipment and system | |
| CN206042074U (en) | Terminal | |
| WO2018028165A1 (en) | Terminal and manufacturing process thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20170215 |
|
| WW01 | Invention patent application withdrawn after publication |