WO2018058873A1

WO2018058873A1 - Photographing method and device

Info

Publication number: WO2018058873A1
Application number: PCT/CN2017/072583
Authority: WO
Inventors: 董德; 金武超
Original assignee: 宇龙计算机通信科技(深圳)有限公司
Priority date: 2016-09-29
Filing date: 2017-01-25
Publication date: 2018-04-05
Also published as: CN106454081A; CN106454081B

Abstract

Disclosed in an embodiment of the present invention are a photographing method and device, both of which are based on a terminal provided with a spectrum sensor, wherein the method comprises: acquiring an original image collected by a camera when entering a photographing preview interface; detecting the ambient light spectrum by the spectrum sensor; acquiring a pre-stored natural light reference spectrum, and calculating a difference between the ambient light spectrum and the natural light reference spectrum as a compensated spectrum; performing spectral superposition processing on the original image and/or spectrum filtering process by using the compensated spectrum to obtain a preview image; displaying the preview image in a preset first image preview area on the photographing preview interface. With the present invention, the white balance effect of the photographed image can be improved.

Description

Photographing method and device

The present application claims the priority of the Chinese Patent Application, filed on Sep. 29, 2016, the filing date of

Technical field

The present invention relates to the field of computer technologies, and in particular, to a photographing method and apparatus.

Background technique

In life, merchants often use lighting effects to create an atmosphere for the store, and color rendering the products, so that consumers can be more satisfied or like the color of the displayed products when viewing, so that consumers can not buy goods. Obtaining and judging the true color and quality of the product, it is easy to appear in the purchase and feel satisfied and satisfied. After buying home, the color and quality of the product are very different from those seen in the store. The things you buy are not what you really want. . The essential reason for the above problems is that the merchants use the specific ambient light on the scene to render the goods, thus misleading the consumers.

That is to say, because of the influence of ambient light, the color that the user sees with the naked eye or the photo taken by the camera or the color in the image loses the white balance, and cannot display its original color. In order to restore the display color of the subject, a series of white balance processing such as color reproduction or tone processing can be performed on the photo. However, the existing white balance processing is limited to the adjustment of the ratio of red, blue and green in the image after photographing or the manual use of the standard reference by the user, the former does not achieve the ideal white balance effect, the latter It is very inconvenient in the process of use, and the user cannot carry certain standard reference objects and prepared placement positions every time, so that the corresponding white balance effect is not satisfactory.

That is to say, the white balance method of color distortion in the case of the existing natural light is not a natural spectrum, and the stability and the effectiveness of the white balance effect are insufficient.

Summary of the invention

Based on this, in order to solve the problem of the stability and the insufficient effectiveness of the white balance effect of the white balance method for the color distortion in the case where the ambient light is not the natural spectrum in the conventional technology, A method of photographing is proposed.

A photographing method based on a terminal provided with a spectral sensor;

The method includes:

Obtain the original image captured by the camera when entering the shooting preview interface;

Detecting an ambient light spectrum by the spectral sensor;

Obtaining a pre-stored natural light reference spectrum, and calculating a difference between the ambient light spectrum and the natural light reference spectrum as a compensation spectrum;

Performing spectral superposition processing and/or spectral filtering processing on the original image on the compensation spectrum to obtain a preview image;

The preview image is displayed on the first image preview area preset on the shooting preview interface.

In addition, in order to solve the technical problem that the white balance method of the color distortion in the case where the ambient light is not the natural spectrum is stable and the effectiveness is insufficient, a photographing apparatus is proposed.

A photographing device based on a terminal provided with a spectral sensor;

The device includes:

An original image acquisition module, configured to acquire an original image acquired by the camera when entering the shooting preview interface;

An ambient light spectrum detecting module for detecting an ambient light spectrum by the spectral sensor;

a compensation spectrum acquisition module, configured to acquire a pre-stored natural light reference spectrum, and calculate a difference between the ambient light spectrum and the natural light reference spectrum as a compensation spectrum;

a preview image acquisition module, configured to perform spectral superposition processing and/or spectral filtering processing on the original image to obtain a preview image;

A preview image display module is configured to display a preview image in a first image preview area preset on the shooting preview interface.

Implementation of the embodiments of the present invention will have the following beneficial effects:

After adopting the above photographing method and device, the image displayed on the shooting preview interface is not the image directly captured by the camera, but the image after white balance processing on the image captured by the camera, and white balance is performed on the image captured by the camera. When processed, it is the ambient light obtained from the spectral sensor The difference between the spectrum and the standard white light spectrum determines the specific parameters and data of the processed white balance processing, so that the color displayed on the image displayed on the shooting preview interface and the image taken or captured is the color of the object. Not the color of the color distortion. That is to say, after adopting the above photographing method and device, the color distortion existing in the image can be automatically analyzed and the corresponding color distortion phenomenon is corrected, the operation convenience of the image white balance processing is improved, and the white balance processing is improved. Accuracy and effectiveness.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

among them:

1 is a schematic flow chart of a photographing method in an embodiment;

2 is a schematic structural view of a photographing device in an embodiment;

FIG. 3 is a schematic structural diagram of a computer device that runs the aforementioned photographing method in one embodiment.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

In order to solve the technical problem of the stability of the white balance effect and the insufficient effectiveness of the white balance method for the color distortion in the case where the ambient light is not the natural spectrum in the conventional art, in the present embodiment, a photograph is specially proposed. Method, the implementation of the method may rely on a computer program that can run on a computer system based on the von Neumann system, which can be an application for a camera application or a video application. The computer system may be a server or terminal such as a smartphone, tablet, personal computer or the like that runs the above computer program.

It should be noted that, in this embodiment, the terminal is based on the method for controlling the flash. A spectral sensor is placed. Specifically, the spectral sensor can detect the spectrum corresponding to the ambient light, that is, determine the distribution of the ambient light rays at various wavelengths or frequencies after performing the splitting, or the distribution under the respective colors after the splitting.

Specifically, as shown in FIG. 1 , the foregoing photographing method includes the following steps S102-S110:

Step S102: Acquire an original image acquired by the camera when entering the shooting preview interface.

In a specific implementation, when the user takes a photo, it is hoped that the photograph taken can present the real situation of the object being photographed, that is, the color of the photographed object in the photographed image is white balance, and there is no problem of color distortion or chromatic aberration. .

In this embodiment, the user can open the camera application by clicking the application icon corresponding to the camera and enter the shooting preview interface, and the image captured by the camera is displayed on the shooting preview interface. It should be noted that, in this embodiment, the original image captured by the camera is not displayed on the shooting preview interface, but the image after the white balance processing.

Step S104: detecting an ambient light spectrum by the spectral sensor;

Step S106: Acquire a pre-stored natural light reference spectrum, and calculate a difference between the ambient light spectrum and the natural light reference spectrum as a compensation spectrum.

As described above, the spectrum sensor can detect the spectrum corresponding to the ambient light, so that it is known whether there is any light source other than the natural light in the current ambient light, especially whether the white light balance is included in the light source existing in the ambient light. An external colored light source or other light source that affects the white balance. A natural light reference spectrum under standard natural light is prestored in the terminal, and the natural light reference spectrum corresponds to a standard white light spectrum in a white equilibrium state.

If there is a difference between the ambient light spectrum and the natural light reference spectrum, it indicates that there is currently a light source or other object that affects the white balance in the ambient light, that is, in the current environment, the object seen by the user's naked eye may have color distortion. The phenomenon, or the color of an image taken in the current environment may have a color difference from its true color.

The degree of color distortion or the magnitude of the chromatic aberration described above can be determined by the difference between the ambient light spectrum and the natural light reference spectrum. Moreover, since the present embodiment is for presenting the original color of the article under ambient light, it is necessary to determine what kind of pipeline should be added under the current environment in order to make the light in the current environment appear white balance.

Specifically, according to the difference between the ambient light spectrum and the natural light reference spectrum, specific parameters of the light that should be compensated for the ambient light in order to achieve white balance in the current environment may be determined, that is, the pair is determined. The specific compensation spectrum that ambient light should compensate.

Step S108: performing spectral superposition processing and/or spectral filtering processing on the original image on the compensation spectrum to obtain a preview image;

Step S110: displaying a preview image in a first image preview area preset on the shooting preview interface.

If there is a difference between the ambient light spectrum and the natural light reference spectrum, it means that the current ambient light causes the color difference exhibited by the object to be photographed, that is, if it is desired to obtain an image without chromatic aberration, it is necessary to The original image acquired by the camera is white balanced, and the final image after the white balance processing is the desired preview image, for example, a preview interface displayed on the shooting preview interface.

It should be noted that, in this embodiment, the white balance processing performed on the original image acquired by the camera is determined according to the compensation spectrum, that is, according to the difference between the natural light reference spectrum and the ambient light spectrum, The specific situation of the color difference existing on the original image, and then the color difference is specifically processed.

Specifically, in the embodiment, the spectral superposition is performed on the original image according to the compensation spectrum, and the spectrum under the natural light reference spectrum can be obtained by spectral superposition of the ambient light spectrum and the compensation spectrum, that is, finally, the spectral superposition is performed. The original image afterwards is white balanced, that is, there is no color distortion or chromatic aberration.

Further, in another embodiment, the processing of the original image may also be performed by spectral filtering. Specifically, according to the difference between the ambient light spectrum and the natural light reference spectrum, unnecessary data other than the natural light reference spectrum on the original image is determined, and the excess spectrum is adjusted, and finally the natural light is obtained. The image under the reference spectrum.

That is to say, through the ambient light spectrum and the natural light reference spectrum, it is determined that the spectral data missing from the white balance needs to be obtained on the original image or the spectral data that needs to reach the white balance, and then the corresponding spectral data is spectrally superimposed or spectrally filtered. In addition to the processing, the processed original image exhibits a white balance, that is, there is no color distortion or chromatic aberration in the color presented in the processed preview image.

After processing the original image and getting a preview image, it can be displayed in the corresponding shooting preview interface.

Further, in this embodiment, after the user opens the camera application, the row operation can be performed, and if the preview image displayed on the shooting preview interface is displayed, the preview image displayed by the user is desired. Or if the user's needs are met, the user can obtain the preview image as a photographed image by inputting a photographing instruction and store the photographed image.

Specifically, the method further includes: receiving an input photographing instruction, acquiring the preview image as a photographing image according to the photographing instruction, and storing the photographed image.

It should be noted that, in this embodiment, the foregoing method is not limited to the storage of a photograph or a single image, and is also applicable to the acquisition and display of an image frame during the recording process.

Although the color displayed by the image processed by the above white balance is the true color of the displayed object, the user may also have a desire to present a warm color, a cool color, or other requirements, so that when the user takes a photo, The original image acquired in step S102 can be selected.

Optionally, in an embodiment, the displaying the preview image on the shooting preview interface further includes: displaying the original image in a second image preview area preset on the shooting preview interface.

That is to say, on the shooting preview interface, both the original image without white balance processing and the preview image after white balance processing are displayed, so that the user can compare the two images, for example, which image is selected as the final save. Image.

Specifically, in an optional embodiment, after the displaying the original image in the second image preview area preset on the shooting preview interface, the method further includes: acquiring a target image selection instruction input by the user; The target image selection instruction acquires a preview image or an original image corresponding to the target image selection instruction as a target image; the target image is taken as a photographed image and stored.

That is to say, on the shooting preview interface, the user can select the original image and the preview image to be displayed, for example, select a target image by a click operation or other preset operation, and select the user during the process of taking a photo or recording. The target image is used as the final stored image.

Further, a white balance switch component is further displayed on the shooting preview interface, and the white balance switch component can be used by the user to select whether to perform white balance processing on the original image acquired by the camera.

A fine-tuning component is also displayed on the shooting preview interface, and the user can adjust the specific white balance effect through the fine-tuning component.

Specifically, the method further includes receiving an input white balance adjustment instruction by the fine adjustment component, and adjusting the white balance according to the instruction.

For example, the user needs to have a warmer hue, and the current display effect is white balance. The user can input a specific adjustment request by clicking the fine-tuning control page displayed by the fine-tuning component, that is, the corresponding adjustment data in the white balance adjustment command input by the user. And, according to the adjustment data input by the user, it can be determined In step S108, spectral data specifically added in the process of spectral filtering or spectral superposition or specifically filtered spectral data is performed.

When taking a photo, the user may be concerned with the presentation of the color corresponding to the subject being photographed, that is to say, for other parts of the color user, in the process of white balance processing, in order to save the white balance process The amount of calculation can be processed only for a partial area in the image, for example, only the foreground area or the area selected by the user can be processed.

Specifically, the step of performing spectral superposition processing and/or spectral filtering processing on the original image to obtain a preview image further includes: acquiring a foreground region of the original image; and corresponding to the compensation spectrum The foreground region of the original image is subjected to spectral superposition processing and/or spectral filtering processing to obtain a foreground region of the preview image; the preview image is obtained according to a foreground region of the preview image and a non-foreground region of the original image.

That is, after acquiring the original image, determining a corresponding foreground region or selected region in the original image, and performing spectral superposition processing and/or spectral filtering processing on the foreground region of the original image corresponding to the compensation spectrum. In the process, only the foreground area or the selected area is processed, and in the finally obtained preview image, the foreground area or the selected area corresponding to the original image is determined by the original image subjected to spectral superposition processing and/or spectral filtering processing, and other The area is the corresponding area in the original image.

In addition, in order to solve the technical problem of the white balance effect of the white balance method for the color distortion in the case where the ambient light is not the natural spectrum in the conventional art, and the technical problem of insufficient effectiveness, in one embodiment, as shown in FIG. 2 The present invention also provides a photographing apparatus, including an original image acquisition module 102, an ambient light spectrum detection module 104, a compensation spectrum acquisition module 106, a preview image acquisition module 108, and a preview image display module 110, wherein:

The device is based on a terminal provided with a spectral sensor;

The device includes:

The original image obtaining module 102 is configured to acquire an original image collected by the camera when entering the shooting preview interface;

An ambient light spectrum detecting module 104, configured to detect an ambient light spectrum by the spectral sensor;

a compensation spectrum acquisition module 106, configured to acquire a pre-stored natural light reference spectrum, and calculate a difference between the ambient light spectrum and the natural light reference spectrum as a compensation spectrum;

a preview image obtaining module 108, configured to perform spectral superposition processing and/or spectral filtering processing on the original image to obtain a preview image;

The preview image display module 110 is configured to display a preview image in a first image preview area preset on the shooting preview interface.

Optionally, in an embodiment, as shown in FIG. 2, the foregoing apparatus further includes a photographing image acquiring module 112, configured to receive an input photographing instruction, and obtain the preview image as a photographing image according to the photographing instruction and store the image.

Optionally, in an embodiment, the preview image display module 108 is further configured to display the original image in a second image preview area preset on the shooting preview interface.

Optionally, in an embodiment, as shown in FIG. 2, the foregoing apparatus further includes a target image selection module 114, configured to acquire a target image selection instruction input by a user, and acquire the target image according to the target image selection instruction. The preview image or the original image corresponding to the instruction is selected as the target image; the target image is taken as a photographed image and stored.

Optionally, in an embodiment, the preview image obtaining module 108 is further configured to acquire a foreground region of the original image, and perform spectral superposition processing and/or spectral filtering processing on a foreground region of the original image corresponding to the compensation spectrum. Obtaining a foreground area of the preview image; obtaining the preview image according to a foreground area of the preview image and a non-foreground area of the original image.

Optionally, in an embodiment, the shooting preview interface is provided with a fine adjustment component; as shown in FIG. 2, the apparatus further includes a fine adjustment module 116, configured to receive an input white balance adjustment instruction by the fine adjustment component, according to The instructions adjust the white balance.

After adopting the above photographing method and device, the image displayed on the shooting preview interface is not the image directly captured by the camera, but the image after white balance processing on the image captured by the camera, and white balance is performed on the image captured by the camera. In the processing, the specific parameters and data of the processed white balance processing are determined according to the difference between the ambient light spectrum acquired by the spectral sensor and the standard white light spectrum, so that the image displayed on the shooting preview interface and the photographing or acquiring are obtained. The color that the image presents is the color of the object's display rather than the color distortion. That is to say, after adopting the above photographing method and device, the color distortion existing in the image can be automatically analyzed and the corresponding color distortion phenomenon is corrected, the operation convenience of the image white balance processing is improved, and the white balance processing is improved. Accuracy And effectiveness.

In one embodiment, as shown in FIG. 3, FIG. 3 illustrates a terminal of a von Neumann system-based computer system that operates the above-described photographing method. The computer system may be a terminal device equipped with a spectrum sensor such as a smartphone, a tablet, a palmtop, a laptop, or a personal computer. Specifically, an external input interface 1001, a processor 1002, a memory 1003, and an output interface 1004 connected through a system bus may be included. The external input interface 1001 can optionally include at least a network interface 10012. The memory 1003 may include an external memory 10032 (eg, a hard disk, an optical disk, or a floppy disk, etc.) and an internal memory 10034. The output interface 1004 can include at least a device such as a display 10042.

In this embodiment, the operation of the method is based on a computer program whose program file is stored in the external memory 10032 of the aforementioned von Neumann system-based computer system, loaded into the internal memory 10034 at runtime, and then After being compiled into a machine code, it is passed to the processor 1002 for execution, so that the logical original image acquisition module 102, the ambient light spectrum detection module 104, the compensation spectrum acquisition module 106, and the preview are formed in the von Neumann system-based computer system. The image acquisition module, the preview image display module 110, the photographed image acquisition module 112, the target image selection module 114, and the fine adjustment module 116. During the execution of the above-mentioned photographing method, the input parameters are all received through the external input interface 1001, and transferred to the buffer in the memory 1003, and then input to the processor 1002 for processing, and the processed result data is cached in the memory 1003 for subsequent processing. The ground is processed or passed to the output interface 1004 for output.

Specifically, the processor 1002 is specifically configured to perform the following steps:

Detecting an ambient light spectrum by the spectral sensor;

Optionally, in an embodiment, the processor 1002 is further configured to execute a photographing instruction for receiving an input, and obtain the preview image as a photographing image according to the photographing instruction and store the image.

Optionally, in an embodiment, the processor 1002 is further configured to execute in the shooting preview field. The second image preview area preset on the surface displays the original image.

Optionally, in an embodiment, the processor 1002 is further configured to: execute a target image selection instruction for acquiring a user input; and acquire, according to the target image selection instruction, a preview image or an original image corresponding to the target image selection instruction. a target image; the target image is taken as a photographed image and stored.

Optionally, in an embodiment, the processor 1002 is further configured to perform acquiring a foreground area of the original image, and performing spectral superposition processing and/or spectral filtering processing on a foreground area of the original image corresponding to the compensation spectrum. Obtaining a foreground area of the preview image; obtaining the preview image according to a foreground area of the preview image and a non-foreground area of the original image.

Optionally, in an embodiment, the processor 1002 is further configured to execute a white balance adjustment instruction that receives an input through the fine adjustment component, and adjusts the white balance according to the instruction.

The above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, and thus equivalent changes made in the claims of the present invention are still within the scope of the present invention.

Claims

A photographing method, characterized in that the method is based on a terminal provided with a spectral sensor;

The method includes:

Obtain the original image captured by the camera when entering the shooting preview interface;

Detecting an ambient light spectrum by the spectral sensor;

Obtaining a pre-stored natural light reference spectrum, and calculating a difference between the ambient light spectrum and the natural light reference spectrum as a compensation spectrum;

Performing spectral superposition processing and/or spectral filtering processing on the original image on the compensation spectrum to obtain a preview image;

The preview image is displayed on the first image preview area preset on the shooting preview interface.
The photographing method according to claim 1, wherein the method further comprises:

Receiving the input photographing instruction, acquiring the preview image as a photographing image according to the photographing instruction and storing.
The photographing method according to claim 1 or 2, wherein the displaying the preview image on the photographing preview interface further comprises:

The original image is displayed on a second image preview area preset on the shooting preview interface.
The photographing method according to claim 3, wherein the displaying the original image after the second image preview area preset on the shooting preview interface further comprises:

Obtaining a target image selection instruction input by the user;

Acquiring a preview image or an original image corresponding to the target image selection instruction as a target image according to the target image selection instruction;

The target image is taken as a photographed image and stored.
The photographing method according to any one of claims 1 to 4, wherein the step of performing spectral superposition processing and/or spectral filtering processing on the original image to obtain a preview image further comprises the step of: :

Obtaining a foreground area of the original image;

Performing a spectral superposition process and/or a spectral filtering process on a foreground area of the original image corresponding to the compensation spectrum to obtain a foreground area of the preview image;

The preview image is obtained according to a foreground area of the preview image and a non-foreground area of the original image.
The photographing method according to any one of claims 1 to 5, wherein the photographing preview interface is provided with a fine adjustment component;

The method further includes:

An input white balance adjustment command is received by the fine adjustment component, and the white balance is adjusted according to the instruction.
A photographing device, characterized in that the device is based on a terminal provided with a spectral sensor;

The device includes:

An original image acquisition module, configured to acquire an original image acquired by the camera when entering the shooting preview interface;

An ambient light spectrum detecting module for detecting an ambient light spectrum by the spectral sensor;

a compensation spectrum acquisition module, configured to acquire a pre-stored natural light reference spectrum, and calculate a difference between the ambient light spectrum and the natural light reference spectrum as a compensation spectrum;

a preview image acquisition module, configured to perform spectral superposition processing and/or spectral filtering processing on the original image to obtain a preview image;

A preview image display module is configured to display a preview image in a first image preview area preset on the shooting preview interface.
The photographing apparatus according to claim 7, wherein the apparatus further comprises a photographing image acquiring module, configured to receive the input photographing instruction, and obtain the preview image as a photographing image according to the photographing instruction and store the image.
The photographing apparatus according to claim 7 or 8, wherein the preview image display module is further configured to display the original image in a second image preview area preset on the photographing preview interface.
The photographing apparatus according to claim 9, wherein the apparatus further comprises a target image selection module, configured to acquire a target image selection instruction input by the user, and acquire the target image selection instruction according to the target image selection instruction. A corresponding preview image or original image is used as the target image; the target image is taken as a photographed image and stored.
The photographing apparatus according to any one of claims 7 to 10, wherein the preview image acquisition module is further configured to acquire a foreground area of the original image; and a foreground area of the original image corresponding to the compensation spectrum Performing spectral superposition processing and/or spectral filtering processing to obtain a foreground region of the preview image; obtaining the preview image according to a foreground region of the preview image and a non-foreground region of the original image.
The photographing apparatus according to any one of claims 7 to 11, wherein the photographing preview interface is provided with a fine adjustment component; the apparatus further comprises a fine adjustment module for receiving an input white through the fine adjustment component The balance adjustment command adjusts the white balance according to the command.