WO2018028165A1

WO2018028165A1 - Terminal and manufacturing process thereof

Info

Publication number: WO2018028165A1
Application number: PCT/CN2017/073953
Authority: WO
Inventors: 黄晓峰
Original assignee: 深圳市金立通信设备有限公司
Priority date: 2016-08-11
Filing date: 2017-02-17
Publication date: 2018-02-15
Also published as: CN106101322A

Abstract

Provided in the embodiments of the present invention are a terminal and a manufacturing process thereof, the terminal comprising: an outer shell, a camera and an optical window being arranged on the outer shell, the optical window comprising a first lens and a second lens, a flash lamp being arranged below the first lens and a colour sensor being arranged below the second lens, the first lens being used for diffusing the light rays of the flash lamp, and the second lens being used for helping the colour sensor to collect ambient light, the second lens being a lens having undergone atomisation treatment. As atomisation treatment is performed on the second lens, the embodiments of the present invention enable the colour sensor to accurately collect ambient light.

Description

Terminal and manufacturing process thereof

The present application claims priority to Chinese Patent Application No. Serial No. No. No. No. No. No. No. No. No. No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No

Technical field

The present invention relates to the field of electronic devices, and in particular to a terminal and a manufacturing process thereof.

Background technique

With the rapid development of information technology, terminals (such as mobile phones, tablets, etc.) have become a part of the user's life. For the user, the camera function of the terminal has become an important measure for selecting the terminal. Therefore, the terminal manufacturer is also committed to making the camera function of the terminal more perfect. At present, the camera technology in the dark vision environment mainly collects ambient light and performs image processing on the acquired image based on the ambient light. However, in the prior art, ambient light cannot be accurately obtained, thus resulting in Subsequent image processing is not effective.

Summary of the invention

Embodiments of the present invention provide a terminal and a manufacturing process thereof, which can accurately collect ambient light based on the terminal.

A first aspect of the embodiment of the present invention provides a terminal, including:

a housing, the housing is provided with a camera and an optical window, wherein the optical window comprises a first lens and a second lens, a flash is disposed under the first lens, and a color sensor is disposed under the second lens, A first lens is used to diffuse light from the flash lamp, and a second lens is used to assist the color sensor in collecting ambient light, wherein the second lens is an atomized lens.

A second aspect of the embodiments of the present invention provides a terminal manufacturing process, including:

Providing a PCB soldering plate soldered with a flash lamp and a color sensor;

Providing a first lens and a second lens;

Providing a housing, the housing comprising a bore;

Inserting the first lens and the second lens in a position at the borehole;

The PCB pad and the housing are assembled such that the first lens is disposed opposite the flash and the second lens is disposed opposite the color sensor.

Embodiments of the present invention have the following beneficial effects:

It can be seen that the terminal housing described in the embodiment of the present invention is provided with a camera and an optical window, wherein the optical window includes a first lens and a second lens, a flash is disposed under the first lens, and a color is disposed under the second lens. The sensor, the first lens is used to diffuse the light of the flash lamp, and the second lens is used to assist the color sensor to collect ambient light, wherein the second lens is an atomized lens. Thereby, since the second lens is subjected to the atomization process, the color sensor can be made to accurately collect the ambient light.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are some embodiments of the present invention, Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.

1 is a schematic structural diagram of an embodiment of a terminal according to an embodiment of the present invention;

2 is a schematic structural diagram of an optical window of the terminal described in FIG. 1 according to an embodiment of the present invention;

Figure 3 is a side elevational view of the terminal depicted in Figure 1 provided by an embodiment of the present invention;

4 is a comparison diagram of ambient light collected by two color sensors under the lens according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of still another embodiment of a terminal according to an embodiment of the present disclosure;

6 is a schematic structural diagram of an optical window of the terminal described in FIG. 5 according to an embodiment of the present invention;

Figure 7 is a side elevational view of the terminal depicted in Figure 5 provided by an embodiment of the present invention;

FIG. 8 is a schematic flowchart of a terminal manufacturing process according to an embodiment of the present invention; FIG.

FIG. 9 is a schematic flowchart diagram of an embodiment of a method for image processing according to an embodiment of the present disclosure;

FIG. 10 is a schematic flowchart diagram of still another embodiment of a method for image processing according to an embodiment of the present disclosure;

FIG. 11 is a schematic flowchart diagram of still another embodiment of a method for image processing according to an embodiment of the present disclosure;

FIG. 12 is a schematic structural diagram of still another embodiment of a terminal according to an embodiment of the present disclosure;

FIG. 13 is a schematic structural diagram of still another embodiment of a terminal according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The terminal described in the embodiment of the present invention may include a smart phone (such as an Android mobile phone, an iOS mobile phone, a Windows Phone mobile phone, etc.), a tablet computer, a palmtop computer, a notebook computer, a mobile Internet device (MID, Mobile Internet Devices), or a wearable device. The above terminals are merely examples, not exhaustive, and include but are not limited to the above terminals.

1-3 is a schematic structural diagram of a terminal according to an embodiment of the present invention. The terminal described in this embodiment is specifically as follows:

As shown in FIG. 1, FIG. 1 includes a housing 10 provided with a camera 11 and an optical window 12, wherein the optical window 12 includes a first lens 121 and a second lens 122, and the first lens 121 is disposed below A flash lamp 13 is disposed under the second lens 122. The first lens 121 is used to diffuse the light of the flash lamp 13. The second lens 122 is used to assist the color sensor 14 to collect ambient light to measure the ambient light by the color sensor 14. The color, wherein the second lens 122 is a lens that has been atomized.

Specifically, as shown in FIG. 2, the optical window 12 includes a first lens 121 and a second lens 122. The first lens 121 and the second lens 122 are arranged in parallel, and the distance between the first lens 121 and the second lens 122 is less than 1 cm.

Specifically, as shown in FIG. 3, FIG. 3 is a side view of the above terminal. As shown in FIG. 3, a flash 13 and a color sensor 14 are soldered to the PCB soldering plate 15, wherein the distance between the flash 13 and the color sensor 14 is Less than 2 cm, of course, the smaller the distance between the two, the smaller the size of the opening in the outer casing 10, which not only contributes to the aesthetics of the outer casing, but also saves the cost in manufacturing the optical window. (The smaller the distance between the flash 13 and the color sensor 14, the smaller the area of the corresponding optical window). Of course, there may be a distance between the flash lamp 13 and the first lens 121. The color sensor 14 and the second lens 122 may be spaced apart by a distance. Generally, the distance is within 0.5 cm.

Of course, the terminal described in the embodiment of the present invention may further include a front cover, a display screen (touch screen), and other function buttons (such as: HOME button, volume +, volume -), and may also include other holes (such as a microphone). Holes, earphone holes, etc.).

Optionally, the haze of the first lens 121 is smaller than the haze of the second lens 122. During the manufacturing process, the first lens 121 and the second lens 122 may uniformly mix the light diffusion material inside, thereby realizing the atomization process of the second lens, or the first lens may be atomized, but It is ensured that the haze of the first lens after the atomization treatment is smaller than the haze of the second lens. Wherein, the light diffusing material is a physical phenomenon of refraction, reflection and scattering when a medium having two refractive indices (density) is encountered on the way of the path by chemical or physical means, through the polymethyl methacrylate Adding inorganic or organic light diffusing agents to the substrate base of ester (PMMA), polycarbonate (Polycarbonate, PC), polystyrene (PS), polypropylene (PP), etc. The array of structures adjusts the light, causes the light to refract, reflect, and scatter in different directions, thereby changing the traveling path of the light, and achieving the effect of optical diffusion by sufficiently diffusing the incident light. In the application, when the light diffusing material is covered on the color sensor, the light of the incident angle can be increased, and the light intensity and the spectrum sensed by the light spot sensing units of the color sensor are relatively close. Due to the diffusion effect, the directivity of the measurement is weaker and is not easily affected by the local bright objects in the environment. Based on the above structure, the color sensor 14 can more accurately measure the ambient light information.

It should be noted that, as shown in FIG. 4, FIG. 4 is a comparison diagram of ambient light collected by two color sensors under the lens. In the figure, the internal components of the lens do not include the light diffusing material, and thus, when the light passes through the lens, Direct direct shooting, therefore, the ability to collect ambient light is limited, and it is possible to miss part of the light source, and the lens in the figure b contains the light diffusing material inside, so when the light enters the lens, the light will be refracted, scattered, etc. Phenomenon, therefore, can divide a beam of light into multiple beams, and some light from different light sources can be mixed (so that the light response sensitivity of light sources in different directions is relatively close), the color sensor can fully collect ambient light, therefore, Receiving light from different sources, you can get more ambient light data, which can be used to accurately collect ambient light. b The effect of collecting ambient light is better than that of Figure a. The effect of light is good.

Optionally, the field of view (FOV) of the first lens 121 is smaller than the FOV of the second lens 122.

Further optionally, the FOV of the second lens 122 may be greater than the FOV of the camera 11. For example, during the photographing process, the FOV of the camera may be limited. Therefore, a part of the light source may be missing in the field of view during the photographing process, and the FOV of the second lens 122 may be larger than the FOV of the camera 11, and the FOV of the second lens 122 is larger. It has a light source other than the FOV of the acquisition camera, so that the color sensor can collect ambient light more accurately.

Optionally, the FOV of the camera 11 and the flash 13 can be generally designed to be relatively close, that is, the difference between the angle of view of the camera 11 and the FOV of the flash 13 is less than a certain threshold, thereby enabling the brightness of the screen when the flash 13 is photographed. More uniform. The threshold value may be 5 degrees, 4 degrees, 3 degrees, 1 degree, and 0.1 degrees. Specifically, it is determined according to specific practical application requirements, and is not limited herein. Of course, when the ambient light source does not fall within the field of view of the camera, ambient light can be transmitted through the second lens 122 to collect ambient light by the color sensor 14. Therefore, the FOV of the second lens 122 is larger than the FOV of the camera 11, and the accuracy of measuring ambient light can be further improved.

Alternatively, the first lens 121 may be a Finn lens and the second lens 122 may be a flat transmissive mirror.

Alternatively, the first lens 121 may be a Finn lens, and the second lens 122 may be a Finn lens, but the haze of the first lens 121 is smaller than the haze of the second lens 122. Further, the focal length of the first lens 121 is smaller than the focal length of the second lens 122.

With reference to FIG. 5, FIG. 7 is a schematic structural diagram of still another embodiment of a terminal according to an embodiment of the present invention. The terminal described in this embodiment includes:

5-7, a housing 20 is provided with a camera 21 and an optical window 22, wherein the optical window 22 includes a first lens 221 and a second lens 222, below the first lens 221. A flash lamp 23 is disposed, and a color sensor 24 is disposed under the second lens 222. The first lens 221 is used to diffuse the light of the flash 23, and the second lens 222 is used to assist the color sensor 24 to collect ambient light to be measured by the color sensor 24. The ambient light color, wherein the first lens 221 is a Finn lens and the second lens 222 is a planar transmissive mirror, wherein the second lens 222 is an atomized lens. Generally, the viewing angle of the plane light transmissive lens is larger than that of the Fresnel lens (since the surface of the flat light transmitting mirror is flat, and the surface of the flat lens is convex, the viewing angle of the flat light transmitting mirror is larger than that of the Philippine lens. The viewing angle of the Neil lens can be ensured that the viewing angle of the second lens 222 is greater than the viewing angle of the first lens 221, so that the second lens 222 can assist the color sensor 24 to comprehensively collect ambient light during the photographing process, of course, At the time of the flash, color sensor 24 captures ambient light outside of the flash viewing angle.

Specifically, as shown in FIG. 7, FIG. 7 is a side view of the above terminal. As shown in FIG. 7, the flash pad 23 and the color sensor 24 are soldered to the PCB pad 25, wherein the distance between the flash 23 and the color sensor 24 is Less than 2 cm, of course, the smaller the distance between the two, the smaller the size of the opening on the outer casing 20, which not only contributes to the aesthetics of the outer casing, but also saves the cost in manufacturing the optical window (flash 23 and color sensor). The smaller the distance between 24, the smaller the area of the corresponding optical window).

It can be seen that the terminal housing described in the embodiment of the present invention is provided with a camera and an optical window, wherein the optical window includes a first lens and a second lens, a flash is disposed under the first lens, and a color is disposed under the second lens. a sensor, a first lens for diffusing the light of the flash lamp, and a second lens for assisting the color sensor to collect ambient light, wherein the first lens 221 is a Finn lens, the second lens 222 is a flat light mirror, and the second lens is A lens that has been atomized. Thereby, since the second lens is subjected to the atomization process, the color sensor can be made to accurately collect the ambient light.

Based on the structure of the terminal, refer to FIG. 8 , which is a schematic flowchart of an embodiment of a terminal manufacturing process according to an embodiment of the present invention. The manufacturing process described in this embodiment includes the following steps:

801. Providing a PCB soldering board, wherein the PCB soldering board is soldered with a flash lamp and a color sensor;

802, providing a first lens and a second lens;

803. Providing a casing, the casing comprising a borehole;

804. The first lens and the second lens are embedded in a position of the drilled hole;

805. Assemble the PCB soldering plate and the outer casing such that the first lens is disposed opposite to the flash and the second lens is disposed opposite to the color sensor.

Wherein, the first lens is disposed opposite to the flash lamp to realize the light diffused by the first lens, and the second lens is disposed opposite to the color sensor, and the second lens assists the color sensor to collect the ambient light.

Optionally, providing the first lens and the second lens includes:

A mold is provided on which the first lens and the second lens are arranged in parallel; the first lens and the second lens are injection molded using PMMA. Of course, the first lens and the second lens are paired with polymethyl methacrylate (PMMA), then fired at a certain temperature, and finally, cooled and molded, the first lens and the second lens are integrated into together. Wherein, the first lens and the second lens are arranged separately in parallel, and the distance between the first lens and the second lens is less than 1 cm.

Alternatively, the first lens may be a Finn lens and the second lens may be a flat transmissive mirror.

Alternatively, the first lens may be a Finn lens and the second lens may be a Finn lens.

Optionally, the light diffusing material component of the first lens is less than a preset threshold, and the light diffusing material component of the second lens is greater than the predetermined threshold. Of course, the first lens may contain little or no light diffusing material, and the second lens may contain a light diffusing material. The preset threshold can be set according to user requirements or actual applications, and is not limited herein.

Of course, the outer casing of the above terminal may further comprise another drilling hole, that is, for locating the camera. This technology belongs to the prior art and will not be described herein.

Optionally, the viewing angle of the first lens may be smaller than the FOV of the second lens.

Further optionally, the FOV of the second lens may be greater than the FOV of the camera.

Optionally, the focal length of the first lens is smaller than the focal length of the second lens.

Based on the structure and manufacturing process of the foregoing terminal, please refer to FIG. 9 , which is a schematic flowchart of an embodiment of a method for image processing according to an embodiment of the present invention. The method for image processing described in this embodiment includes the following steps:

901. Determine calibration data between the ambient light and the preset color card.

In the embodiment of the present invention, the color sensor can more comprehensively collect ambient light by using the terminal of the optical window. The color data about the ambient light can be collected based on the color sensor of the above structure, and the image of the preset color card is acquired by the camera of the terminal. Among them, the color sensor can be an RGBW sensor or a chromatographic sensor. The RGBW includes four color data acquisition channels. Therefore, the four channels can be used to collect different color data, and the four color data acquisition channels can respectively be the color data of the R (red) channel and the G (green) channel. Color data, color data for B (blue) channels, and color data for W (white) channels. Among them, the preset color card can be gray card and color card, the gray card can only display black and white color, the color card can display color, and the commonly used color card, such as 24 color card, 144 color card. Optionally, in the embodiment of the present invention, calibration data between the color data of the ambient light and the color card image of the acquired preset color card in the ambient light may be established.

902. Obtain color data of current ambient light.

In the embodiment of the present invention, since the light in the environment is different every moment, the terminal can use the color sensor to acquire the color data of the current ambient light.

It should be noted that, when the preset color card is a gray card, color data can be collected from the current ambient light by using each channel of the color sensor. When the preset color card is a color card, the color sensor can be used to directly collect color data from the current ambient light.

Further, if the color sensor is an RGBW sensor, when the preset color card is a gray card, since the gray card is black and white, its data only needs one channel of data to be represented, and thus, the terminal can be separately The color data is collected by ambient light using the four channels of the RGBW sensor; when the preset color card is a color card, since the color card is colored and contains data of three channels of RGB, the terminal can directly utilize 4 of the RGBW sensors. The channel collects color data directly.

903. Determine an ambient light parameter according to the calibration data and color data of the current ambient light.

In the embodiment of the present invention, the terminal can construct a functional relationship between the color data and the calibration data. For example, the color data can be used as the output data, and the calibration data is used as the input data, and the mapping relationship between the input data and the output data can exist. A function between the input data and the output data is constructed based on the mapping relationship, so that the obtained solution can be used as an ambient light parameter. Alternatively, the color data may be used as input data, and the calibration data may be used as output data, and a mapping relationship may exist between the input data and the output data, and a function between the input data and the output data may be constructed according to the mapping relationship, thereby The solution is taken as an ambient light parameter.

904. Perform color correction on the image to be processed according to the ambient light parameter.

In the embodiment of the present invention, the terminal may perform color correction on the image to be processed by using the ambient light parameter. For example, the ambient light parameter may be the specific gravity of light of different light sources in the ambient light, and the image to be processed is color corrected according to the ambient light parameter.

Determining, by the embodiment of the present invention, calibration data between the ambient light and the preset color card; acquiring color data of the current ambient light; determining ambient light parameters according to the calibration data and the color data; and performing color processing on the image according to the ambient light parameter Correction. Therefore, the calibration data and the ambient light parameter in the current environment can be used to perform color correction on the image to be processed according to the ambient light parameter. Since the color is corrected by the ambient light in the embodiment of the present invention, the color image can be accurately compared. Make corrections.

With reference to FIG. 10, it is a schematic flowchart of still another embodiment of a method for image processing according to an embodiment of the present invention. The method for image processing described in this embodiment includes the following steps:

1001. Collecting N color data in an environment of N different light sources by using a color sensor, wherein the N is an integer not less than 3.

In the embodiment of the present invention, the N different light sources are different light sources in the environment, and the terminal may use the color sensor to collect N color data in the N different light source environments. The N is an integer not less than 3, that is, in the implementation of step 1001, it is required to collect color data of not less than 3 kinds of light sources. Corresponding color data is obtained under each light source.

For example, the color sensor can be used to separately collect the color data of the morning ambient light, the color data of the noon ambient light, and the color data of the evening ambient light. Alternatively, the color sensor can be used to collect the color data of the ambient light under the street lamp, the color data of the ambient light under the flashlight, and the color data of the ambient light under the desk lamp.

First, a color sensor is used to measure the color data sc _k under different light sources, 1 < _k ≤ N, where N is the number of light source types, where k represents the kth light source.

Where SR _k , SG _k , SB _k , SW _k are the color data measured by the four channels of the RGBW sensor, where SR _k is the color data obtained by the red channel, SG _k is the color data obtained by the green channel, SB _k For the color data obtained for the blue channel, SW _k is the color data obtained by the white channel. Further, sred _k is the color data of the normalized red channel, sgreen _k is the color data of the normalized green channel, and sblue _k is the color data of the normalized blue channel. among them,

1002. Obtain N gray card images for gray cards in the N different light source environments.

In the embodiment of the present invention, the N cameras of the terminal can be used to obtain the N gray card images in the N different light source environments for the gray card in the N different light source environments, and in the N different light source environments. Each light source environment corresponds to a gray card image, and I _k represents the kth gray card image, where 1<k≤N.

Specifically, the terminal can align the gray card in N different light source environments, that is, the shooting range of the camera is occupied by the gray card. In each light source environment, a gray card image for the gray card is obtained.

1003. Determine calibration data according to the N color data and the N gray card images.

In the embodiment of the present invention, the terminal can establish a mapping relationship between N color data and N gray card images. In the specific implementation process, it is required to make the light source type cover the type of light source that may appear in the shooting scene as much as possible.

First, calculate the grayscale image average grayscale gray _k for the gray card under various light source types, indicating the average grayscale in the kth light source environment.

Then, calculate the average color of the gray card in each scene;

R _k , G _k and B _k are the average values of the R channel, the G channel, and the B channel of the gray card image under the kth light source, respectively. r _k represents the average value of the normalized R channel, and g _k represents the average value of the normalized G channel and the average value of the normalized B channel.

Finally, the mapping relationship between sc _k and gray _k is established, and the mapping relationship between the two is the calibration data.

Specifically, the mapping relationship between sc _k and gray _k can be established as follows:

Sc _k M=gray _k

which is:

Through this equation, M under each light source can be solved, wherein M is the calibration data, the calibration data obtained under the N light source environment is saved, and a calibration database is established.

Optionally, the mapping relationship between sc _k and gray _k is also determined by a comparison method, and then the mapping relationship is found by looking up the table, that is, the calibration data. Each of the light source environments has a corresponding mapping relationship, and the N mapping relationships are fitted, thereby obtaining a calibration database.

1004. Obtain color data of the current ambient light.

In the embodiment of the present invention, the terminal may use the color sensor to acquire color data of the current ambient light. The terminal can use the RGBW color sensor to obtain the color data of the current ambient light.

1005. Determine an ambient light parameter according to the calibration data and color data of the current ambient light.

In the embodiment of the present invention, the terminal may determine the ambient light parameter by using the color data of the current ambient light and the calibration data, where the ambient light parameter is a proportional component of various light sources in the current environment.

Optionally, the terminal may determine target calibration data in the calibration data that matches the current environment, and determine an ambient light parameter according to the target calibration data and color data of the current ambient light. Specifically, the image to be processed can be taken while the color data of the current ambient light is measured using a color sensor, and then the ambient light parameters are solved. Further, the terminal may further calculate color data of the virtual gray card according to the ambient light parameter, and finally calculate a white balance gain according to the color data of the virtual gray card, wherein the virtual gray card means that the shooting scene does not exist, but The algorithm in the embodiment of the invention can estimate the color of the gray card in the current shooting scene according to the color sensor and prior knowledge.

The specific solution is as follows:

First, the terminal can determine the target calibration data in the calibration data that matches the current environment, that is, calculate the color of the three calibration light sources corresponding to the minimum Euclidean distance among the N kinds of light sources in the calibration data (sc _m1 sc _m2 sc _m3 ), denoted as SC _m =(sc _m1 sc _m2 sc _m3 ), that is, the target calibration data in the calibration data that matches the current environment is determined. Specifically, the terminal may determine three sets of data having the smallest Euclidean distance between the calibration data and the color data of the current ambient light as the target calibration data. That is, calculating the Euclidean distance between the color data in the current ambient light and each calibration data included in the calibration database, thereby obtaining a plurality of Euclidean distance values and determining the smallest three of the plurality of Euclidean distance values. The distance value is the color data of the light source corresponding to the three Euclidean distance values as the color data in the current environment.

Then, the terminal can determine the ambient light parameter according to the target calibration data and the color data of the current ambient light, which can make:

Where p _k represents the ambient light parameter, k is 1 or 2, or 3, sc _k represents the target calibration data, and sc represents the color data in the current environment.

This mapping relationship can be divided into three cases according to the rank of SC _m , and thus, the rank of the matrix SC _m is calculated.

(1) If the rank of SC _m is 1, color data of any of sc _m1 , sc _m2 , and sc _m3 is taken as color data of ambient light. Then, the color data of the virtual gray card is gray _virtual =gray _m1 , that is, P=I, and I is an identity matrix;

(2) If the rank of SC _m is 2, it is considered that the current ambient light is a linear combination of the two kinds of light sources in the calibration light source. Therefore, order

Where P is the weighting factor, ie the ambient light parameter.

Recorded as a matrix form: SC _{3 × 2} · P _{2 × 1} = sc _{3 × 1} , where

Thus, the contradiction equation SC _{3 × 2} · P _{3 × 1} = sc _{3 × 1 is} obtained to obtain an ambient light parameter P = SC ⁺ · sc, and SC ⁺ is the Moore-Penrose inverse matrix of SC.

Then, the virtual data of the virtual gray card is gray _virtual :

(3) If the rank of SC _m is 3, it can be considered that the current ambient light is a linear combination of three different light sources in the calibration light source.

Therefore, order

Where p is the weighting factor, ie the ambient light parameter.

Recorded as a matrix form: SC _{3 × 3} · P _{3 × 1} = sc _{3 × 1} , where:

Thus, the contradiction equation SC _3×3 · P _3×1 = sc _{3×1 is} obtained, and the ambient light parameter P=SC ⁺ ·sc is obtained, so that the obtained ambient light parameters are:

Then, the virtual data of the virtual gray card is gray _virtual :

1006. Perform color correction on the image to be processed according to the ambient light parameter.

In the embodiment of the present invention, the terminal may perform color correction on the image to be processed by using the ambient light parameter, as follows:

Specifically, the gray _virtual can be regarded as the color data of the gray card, and the gray _{virtual is} divided into RGB three-channel data, as follows:

Normalize the gray _virtual to get the white balance gain, as follows:

Use this white balance gain to correct the image to be processed:

Among them, the image to be processed I={I _R , I _G , I _B }, and the output image is I′={I′ _R , I′ _G , I′ _B }.

The N color data in the N different light source environments are respectively collected by using the color sensor, and the N color card images for the gray card in the N different light source environments are obtained, and according to the N color data and the N The gray card images determine calibration data; obtain color data of the current ambient light; determine ambient light parameters according to the calibration data and the color data; perform color correction on the image to be processed according to the ambient light parameters. Therefore, the calibration data and the ambient light parameter in the current environment can be used to perform color correction on the image to be processed according to the ambient light parameter. Since the color is corrected by the ambient light in the embodiment of the present invention, the color image can be accurately compared. Make corrections.

A flowchart of still another embodiment of a method for image processing according to an embodiment of the present invention is shown in FIG. The method for image processing described in this embodiment includes the following steps:

1101. Determine calibration data between ambient light and color card.

In the embodiment of the present invention, the terminal may collect color data about ambient light based on the color sensor, and use the camera of the terminal to collect an image of the preset color card. Among them, the color sensor can be RGBW Sensor, chromatographic sensor.

Optionally, the terminal separately collects N color data in N different light source environments by using a color sensor, wherein the N is an integer not less than 3, and acquires N color card images for the color card in the N different light source environments. Determining calibration data based on the N color data and the N color card images.

In a specific implementation process, first, a color sensor is used to measure color data sc _k under different light sources, 1 < _k ≤ N, where N is the number of light source types, where k represents the kth light source.

Then, in the N different light source environments, the camera of the terminal is used for shooting to obtain N color card images in the N different light source environments for the color card, and each of the N different light source environments Corresponding to one color card image respectively, I _k represents the kth color card image, where 1 < k ≤ N. The terminal can align the color card in N different light source environments, that is, the shooting range of the camera is occupied by the color card. In each light source environment, a color card image for the color card is available.

Finally, the terminal can establish a mapping relationship between N color data and N color card images. In the specific implementation process, it is required to make the light source type cover the type of light source that may appear in the shooting scene as much as possible.

(1) Calculate the average grayscale color _k of the color card image for the color card under various light source types, indicating the average gray level in the kth light source environment.

Then, calculate the average color of the color card in each scene;

R _k , G _k and B _k are the average values of the R channel, the G channel, and the B channel of the color card image under the kth light source, respectively. r _k represents the average value of the normalized R channel, and g _k represents the average value of the normalized G channel and the average value of the normalized B channel.

Finally, the mapping relationship between sc _k and color _k is established, and the mapping relationship between the two is the calibration data.

Specifically, the mapping relationship between sc _k and color _k can be established as follows:

Sc _k X=color _k

which is:

Through this equation, X under each light source can be solved, where X is the calibration data, the calibration data obtained under the N light source environment is saved, and a calibration database is established.

Optionally, the mapping relationship between sc _k and color _k is also determined by a comparison method, and then the mapping relationship is found by looking up the table, that is, the calibration data. Each of the light source environments has a corresponding mapping relationship, and the N mapping relationships are fitted, thereby obtaining a calibration database.

In the embodiment of the present invention, the terminal can establish a mapping relationship between color data and color _k . For example, let the color data be A, the color card image be B, the mapping relationship be C, AC=B, and C is the calibration data. Specifically, the terminal can construct a functional relationship between the color data and the color card image, and calculate the calibration data according to the function relationship. The specific implementation process can be described by taking a 24-color card as an example, that is, the calibration data between the ambient light and the 24-color card is determined according to the color sensor and the 24-color card.

It should be noted that color _k refers to the brightness normalized color data of the 24 color card under the kth light source. Since the brightness of the image may be different in different shooting scenes, after the color data is calculated, the color data is normalized according to the brightness, and the brightness of the 20th color block may be selected as a reference, and the color data is multiplied by a coefficient K. So that the 20th color block in the color data is the same as the 20th color block of the standard color card. The coefficient K is the ratio of the 20th color block of the standard color card to the 20th color block in the image taken under each scene.

1102. Obtain color data of the current ambient light.

1103. Determine an ambient light parameter according to the calibration data and color data of the current ambient light.

In the embodiment of the present invention, the method for the terminal to solve the ambient light parameter according to Embodiment 1 is as follows:

That is, the terminal may determine target calibration data that matches the current environment in the calibration data; and determine an ambient light parameter according to the target calibration data and color data of the current ambient light.

Specifically, first, three sets of data having the smallest Euclidean distance between the calibration data and the color data of the current ambient light are determined as the target calibration data. That is, calculating the Euclidean distance between the color data in the current ambient light and each calibration data included in the calibration database, thereby obtaining a plurality of Euclidean distance values and determining the smallest three of the plurality of Euclidean distance values. The distance value is the color data of the light source corresponding to the three Euclidean distance values as the color data in the current environment.

Second, calculate the color C _m =(c _m1 c _m2 c _m3 ) of the three calibration sources with the smallest c Euclidean distance, and then calculate the rank of C _m .

(1) If the rank of C _m is 1, take any one of c _m1 as the color data of the ambient light, and the color data of the virtual color card is color _virtual = color _m1 ;

(2) If the rank of C _m is 2, it is considered that the current ambient light is a linear combination of two kinds of light sources in the calibration light source.

make:

Where p is the weighting factor.

Recorded as a matrix form: C·P=c, where:

Solving the contradiction equation C·P=c gives the ambient light parameter P=C ⁺ ·c, and C ⁺ is the Moore-Penrose inverse matrix of C.

Color _virtual =p1·color _m1 +p2·color _m2

(3) If the rank of C _m is 3, it is considered that the current ambient light is a linear combination of the three kinds of light sources in the calibration light source.

make:

Among them, P is a weighting coefficient and is also an ambient light parameter.

Recorded as a matrix form: C·P=c, where:

Solve the equation C·P=c to get the ambient light parameters and solve for P. The form of P can be recorded as follows:

1104. Determine color data of the virtual color card according to the ambient light parameter.

In the embodiment of the present invention, the terminal may determine the color data of the virtual color card on the basis of the ambient light, as follows:

The virtual color card can be written as:

Color _virtual =p1·color _m1 +p2·color _m2 +p3·color _m3 ,

Take a 24-color card as an example, then,

Remember:

1105. Obtain color data of a standard color card.

In the embodiment of the present invention, the color data of the standard color card may be defined by a manufacturer or a standard organization.

1106. Determine a color reproduction matrix according to color data of the standard color card and color data of the virtual color card.

In the embodiment of the present invention, the color vector of each color block of the standard color card is color _std , and if there are N color blocks in the color card, the color _std is a matrix of N×3. The data for this matrix is defined by the manufacturer or standard organization.

Take the standard 24-color card as an example. The color data of the standard 24-color card is known as:

The color reproduction matrix of the solution is M _{3 × 3} equations:

Color _std =color _virtual ·M _3×3

Due to the error, the above equation holds for each color block, so this is a contradiction equation group, and only requires solving the least squares solution.

That is to solve the optimization problem: M _{3 × 3} = Argmin (| | color _{std -} M _{3 × 3} · color _virtual | |), which is a linear optimization problem:

Expand the above formula to get:

Thus, three independent sets of contradictory equations are obtained. The minimum 2 norm minimum 2 multiplication solution of the contradiction equation Ax=b is x=A ⁺ b, where A ⁺ is the Moore-Penrose inverse matrix of A.

Can be obtained separately by the above method,

Thereby, the solution of M _{3 × 3} can be completed.

1107. Perform color correction on the image to be processed according to the color reproduction matrix.

In the embodiment of the present invention, the terminal may perform color correction on each pixel in the image to be processed according to the following equation, as follows:

Optionally, other color cards may be used as the preset color card to solve the embodiment of the present invention.

In the embodiment of the present invention, the color data of the standard color card is known, and can be known by the production information of the standard color card. The color reproduction matrix can be recorded as follows:

among them,

Is output color data,

For the color reproduction matrix,

For the image to be processed.

The color reproduction matrix can be recorded as:

Then you can get:

In short, when the matrix M _3×3 can be accurately solved, the color of the output image is generally capable of color reproduction. The conversion of the matrix more accurately restores the color.

Determining calibration data between ambient light and color card by using an embodiment of the present invention; acquiring color data of current ambient light; determining ambient light parameters according to the calibration data and the color data; determining color data of the virtual color card according to the ambient light parameter Obtaining color data of the standard color card, determining a color reproduction matrix according to the color data of the standard color card and the color data of the virtual color card; performing color correction on the image to be processed according to the color reproduction matrix. Therefore, the calibration data and the ambient light parameter in the current environment can be used to perform color correction on the image to be processed according to the ambient light parameter. Since the color is corrected by the ambient light in the embodiment of the present invention, the color image can be accurately compared. Make corrections.

Consistent to the above, the following are virtual devices and physical devices that implement the above image processing methods, as follows:

FIG. 12 is a schematic structural diagram of still another embodiment of a terminal according to an embodiment of the present invention. The terminal described in this embodiment includes: a first determining unit 1201, a first obtaining unit 1202, a second determining unit 1203, and a first correcting unit 1204, as follows:

The first determining unit 1201 is configured to determine calibration data between the ambient light and the preset color card.

The first obtaining unit 1202 is configured to acquire color data of the current ambient light.

The second determining unit 1203 is configured to determine an ambient light parameter according to the calibration data determined by the first determining unit 1201 and the color data acquired by the first acquiring unit 1202.

The first correcting unit 1204 is configured to perform color correction on the image to be processed according to the ambient light parameter determined by the second determining unit 1203.

Optionally, the first determining unit 1201 includes:

The collecting unit (not shown) is configured to separately collect N color data in N different light source environments by using a color sensor, wherein the N is an integer not less than 3.

a second acquiring unit (not shown) for acquiring N color card images of preset color cards in the N different light source environments;

The third determining unit (not shown) determines the calibration data according to the N color data collected by the collecting unit and the N color card images acquired by the second acquiring unit.

Optionally, the second determining unit 1203 includes:

a fourth determining unit (not shown) for determining target calibration data in the calibration data that matches the current environment

And a fifth determining unit (not shown) configured to construct the target calibration data determined by the fourth determining unit and the color data of the current ambient light to determine an ambient light parameter.

Further optionally, the calibration data includes at least three sets of data, and the fourth determining unit is specifically configured to:

The three sets of data having the smallest Euclidean distance between the calibration data and the color data of the current ambient light are determined as the target calibration data.

Optionally, when the preset color card is a color card, the first correcting unit 1204 may include:

a sixth determining unit (not shown) for determining color data of the virtual color card according to the ambient light parameter;

a third obtaining unit (not shown) for obtaining color data of the standard color card;

a seventh determining unit (not shown) for determining color according to color data of the standard color card acquired by the third obtaining unit and color data of the virtual color card determined by the sixth determining unit Regeneration matrix

a second correcting unit (not shown) for performing color correction on the image to be processed according to the color reproduction matrix determined by the seventh determining unit.

Determining calibration data between the ambient light and the preset color card by using the terminal described in the embodiment of the present invention; acquiring color data of the current ambient light; determining an ambient light parameter according to the calibration data and the color data; and determining the ambient light parameter according to the ambient light parameter Color correction of the image to be processed. Thus, the calibration data and the ambient light parameters in the current environment can be utilized to perform color correction on the image to be processed according to the ambient light parameters, since the ambient light is used to correct the color in the embodiment of the present invention.

FIG. 13 is a schematic structural diagram of still another embodiment of a terminal according to an embodiment of the present invention. The terminal described in this embodiment includes: at least one input device 1000; at least one output device 2000; at least one processor 3000, such as a CPU; and a memory 4000, the input device 1000, the output device 2000, the processor 3000, and the memory 4000 is connected via bus 5000.

The input device 1000 may be a touch panel, a physical button, or a mouse.

The output device 2000 described above may specifically be a display screen.

The above memory 4000 may be a high speed RAM memory or a non-volatile memory such as a magnetic disk memory. The memory 4000 is used to store a set of program codes. The input device 1000, the output device 2000, and the processor 3000 are used to call the program code stored in the memory 4000, and the following operations are performed: the processor 3000 is configured to:

Determining calibration data between ambient light and a preset color card;

Obtain color data of the current ambient light;

Determining an ambient light parameter according to the calibration data and color data of the current ambient light;

Color correction is performed on the image to be processed according to the ambient light parameter.

Optionally, the processor 3000 determines calibration data between the ambient light and the preset color card, including:

N color data in N different light source environments are respectively collected by using a color sensor, wherein the N is an integer not less than 3;

Obtaining N color card images of preset color cards in the N different light source environments;

The calibration data is determined based on the N color data and the N color card images.

Optionally, the processor 3000 determines the ambient light parameter according to the calibration data and the color data of the current ambient light, including:

Determining target calibration data in the calibration data that matches the current environment;

Constructing a mapping relationship between the target calibration data and color data of the current ambient light;

The ambient light parameter is calculated according to the mapping relationship.

Optionally, the calibration data includes at least three sets of data, and the processor 3000 determines the target calibration data that matches the current environment in the calibration data, including:

Optionally, the processor 3000, when the preset color card is a color card, performs color correction on the image to be processed according to the ambient light parameter, including:

Determining color data of the virtual color card according to the ambient light parameter;

Get the color data of the standard color card;

Determining a color reproduction matrix according to color data of the standard color card and color data of the virtual color card;

Color correction is performed on the image to be processed according to the color reproduction matrix.

The units in all the embodiments of the present invention may be implemented by a general-purpose integrated circuit, such as a CPU (Central Processing Unit), or by an ASIC (Application Specific Integrated Circuit).

The steps in the method of the embodiment of the present invention may be sequentially adjusted, merged, and deleted according to actual needs.

The units in the terminal in the embodiment of the present invention may be combined, divided, and deleted according to actual needs.

One of ordinary skill in the art can understand that all or part of the process of implementing the foregoing embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

An image processing method, a terminal, and a manufacturing process thereof are provided in detail. The principles and embodiments of the present invention are described in the following. The description of the above embodiment is only used for To help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in specific embodiments and application scopes. It should not be construed as limiting the invention.

Claims

A terminal, comprising: a housing, the housing is provided with a camera and an optical window, wherein the optical window comprises a first lens and a second lens, and a flash is disposed under the first lens, A color sensor is disposed under the two lenses, the first lens is for diffusing light of the flash lamp, the second lens is for assisting the color sensor to collect ambient light, and the second lens is an atomized lens .
The terminal according to claim 1, wherein the first lens has a haze smaller than a haze of the second lens.
The terminal according to claim 2, wherein a viewing angle of the first lens is from a viewing angle of the second lens.
The terminal according to claim 3, wherein a viewing angle of the second lens is larger than a viewing angle of the camera.
The terminal according to any one of claims 1 to 4, wherein the first lens is a Finn lens and the second lens is a flat transmissive mirror.
The terminal according to any one of claims 1 to 4, wherein the first lens is a Finn lens and the second lens is a Finn lens.
The terminal according to claim 6, wherein a focal length of the first lens is smaller than a focal length of the second lens.
A terminal manufacturing process, comprising:

Providing a PCB soldering plate soldered with a flash lamp and a color sensor;

Providing a first lens and a second lens;

Providing a housing, the housing comprising a bore;

Inserting the first lens and the second lens in a position at the borehole;

The PCB pad and the housing are assembled such that the first lens is disposed opposite the flash and the second lens is disposed opposite the color sensor.
The manufacturing process according to claim 8, wherein the providing the first lens and the second lens comprises:

Providing a mold on which the first lens and the second lens are arranged in parallel;

The first lens and the second lens are injection molded using polymethyl methacrylate.
The manufacturing process according to any one of claims 8 or 9, wherein the light diffusing material component of the first lens is smaller than a predetermined threshold, and the light diffusing material component of the second lens is greater than the predetermined threshold .