WO2016011871A1

WO2016011871A1 - Shooting method, shooting device, and computer storage medium

Info

Publication number: WO2016011871A1
Application number: PCT/CN2015/082398
Authority: WO
Inventors: 魏强; 崔小辉; 苗雷; 里强; 谭焕清
Original assignee: 努比亚技术有限公司
Priority date: 2014-07-22
Filing date: 2015-06-25
Publication date: 2016-01-28
Also published as: CN104113693B; CN104113693A

Abstract

A shooting method, a shooting device, and a computer storage medium. The method comprises: acquiring a currently output image; determining whether the background of the currently output image is normal; determining a basic image if the background of the currently output image is normal; synthesizing the currently output image and the basic image into a synthetic image; and displaying the synthetic image.

Description

Shooting method, shooting device, and computer storage medium

Technical field

The present invention relates to the field of imaging technology, and in particular, to a photographing method, a photographing apparatus, and a computer storage medium.

Background technique

Star-track shooting refers to the shooting mode in which the shooting device captures the running trajectory of the star through continuous exposure for a long time. When shooting a star track, the exposure time usually takes 20 to 60 minutes, and the photosensitive hardware capable of supporting long-time exposure is expensive. Only professional camera devices such as SLR cameras are equipped with the aforementioned photosensitive hardware, and for digital cameras such as digital Cameras, mobile phones, tablets, etc. cannot be equipped with such expensive photosensitive hardware.

The Chinese Patent Application No. 201410112654.3 discloses a method for photographing a mobile terminal. The camera captures an image every preset time, and performs image synthesis according to the current image and the brightness information of the past image to generate a composite image. Thereby, the photographing device is made to perform long-time exposure without relying on the photosensitive hardware, and the technique of image synthesis is used to simulate long-time exposure, and the star-track photographing function is realized on the digital photographing device.

Due to the long duration of the star-track shooting, there are usually sudden disturbances during the star-track shooting. If a car passes through the shooting scene, the ambient light of the shooting scene suddenly becomes brighter, and it will be collected. The background is an abnormal image, which affects the quality of the final composite image and reduces the shooting effect.

Summary of the invention

In order to solve the existing technical problems, an embodiment of the present invention provides a photographing method, a photographing apparatus, and a computer storage medium, aiming at eliminating interference caused by sudden changes in ambient light on a photographing process. Improve the shooting effect.

The embodiment of the invention provides a shooting method, and the method includes:

Get the current output image;

Determining whether the background of the currently output image is normal;

Determining the base image if the background of the currently outputted image is normal;

Combining the currently output image with the base image into a composite image;

Display the composite image.

In the above solution, the synthesizing the currently output image and the base image into a composite image includes:

Determining whether the brightness of the pixel of the image currently outputted at the same position is greater than the brightness of the pixel of the base image;

If so, the pixels of the base image at the same position are replaced with the pixels of the currently output image to obtain the composite image.

In the above solution, the determining whether the background of the currently outputted image is normal includes:

Determining whether the brightness of the currently outputted image is greater than a preset value or exceeding a preset multiple of the statistical value;

If not, it is determined that the background of the currently output image is normal.

In the above solution, the determining whether the brightness of the currently outputted image exceeds a preset multiple of the statistical value includes:

Calculating a brightness of the currently output image, and acquiring a statistical value of brightness of the base image or a previously output background normal image;

It is judged whether the brightness of the currently outputted image exceeds the preset multiple of the statistical value.

Determining whether the number of bright points in the currently outputted image is greater than a preset value or exceeding a preset multiple of the statistical value;

In the above solution, when the first synthesis is performed, the base image is a first output normal background image or a preset image; when not first synthesized, the base image is a previously synthesized composite image.

In the above solution, when it is determined that the brightness of the currently output image is greater than a preset value or exceeds a preset multiple of the statistical value, the background abnormality of the currently output image is determined, and the image is discarded.

In the above solution, the number of bright spots is the number of pixel points in the image whose brightness value is greater than a predetermined threshold;

When it is determined that the number of bright spots is greater than a preset value or exceeds a preset multiple of the statistical value, it is determined that the background of the currently output image is abnormal, and the image is discarded.

In the above solution, the acquiring the currently outputted image includes: collecting one image at a preset time; or acquiring the image in real time.

The embodiment of the invention further provides a photographing device, which comprises an obtaining module, a judging module, a synthesizing module and a display module, wherein:

Obtaining a module configured to obtain an image of the current output;

a determining module configured to determine whether a background of the currently outputted image is normal;

a synthesis module configured to determine a base image, and if the background of the currently output image is normal, synthesize the currently output image and the base image into a composite image;

A display module configured to display a composite image.

In the above solution, the synthesizing module is configured to:

In the above solution, the determining module is configured to:

Calculating a brightness of the currently outputted image, and acquiring a statistical value of brightness of the base image or a background image of a normal background output in the past;

Determining whether the brightness of the currently outputted image exceeds a preset multiple of the statistical value;

In the above solution, the determining module is configured to:

In the above solution, when the synthesizing module performs the first synthesis, the base image is a first output normal background image or a preset image; when the synthesizing module is not first synthesized, the basic image is The composite image that was previously synthesized.

In the above solution, the determining module is configured to: when it is determined that the brightness of the currently output image is greater than a preset value or exceed a preset multiple of the statistical value, determine a background abnormality of the currently output image, and discard the image.

The determining module is configured to: when it is determined that the number of bright spots is greater than a preset value or exceed a preset multiple of the statistical value, determine a background abnormality of the currently output image, and discard the image.

In the above solution, the acquiring module is configured to collect one image at a preset time; or collect the image in real time.

The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the foregoing photographing method.

The photographing method, device and computer storage medium provided by the embodiments of the present invention detect the background of the currently outputted image, and only combine the image with the base image when the background is detected to be normal, thereby eliminating The abnormal image of the background prevents the image of the background anomaly from being synthesized into the final composite image and affects the photo quality, thereby eliminating the interference caused by the sudden change of the ambient light and improving the shooting effect.

DRAWINGS

1 is a flow chart of an embodiment of a photographing method of the present invention;

2 is a block diagram showing the structure of an embodiment of a photographing apparatus of the present invention;

Figure 3 is a flow chart showing another embodiment of the photographing method of the present invention.

The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

detailed description

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The photographing method of the embodiment of the invention is mainly applied to star-track shooting, and the star-track photographing is used for photographing the motion trajectory of the stars, and the formation of the motion trajectory is caused by the relative motion between the photographer and the photographing target, and therefore can also be applied. For a similar application scenario. The sudden change of ambient light in this embodiment mainly means that the ambient light suddenly becomes bright, and in other application scenarios, the ambient light may suddenly become dark. The following examples are described in detail by taking star track shooting as an example.

1 is a flowchart of an embodiment of a photographing method provided by the present invention. As shown in FIG. 1, the method includes:

Step S301: Acquire an image currently output;

In this step, after the start of the star track shooting, when the image is acquired by the camera and the image is output, the image is acquired; the collected image may be collected at intervals or collected in real time.

Step S302: determining whether the background of the currently outputted image is normal;

In this step, in order to prevent sudden changes in ambient light during shooting, such as when the car passes through the shooting scene, the lighting of the car causes the shooting scene to suddenly become brighter, and the background of the captured image will be brighter, resulting in overexposure. It is necessary to judge whether the currently output image is normal.

Step S303: determining a base image if the background of the currently outputted image is normal;

In this step, if the background of the currently output image is not normal, the image is discarded.

Step S304: synthesize the currently output image and the base image into a composite image;

In this step, when the first synthesis is performed, the base image is a first output normal background image or a preset image; when not first synthesized, the base image is a previously synthesized composite image.

Step S305: displaying a composite image;

In this step, it may be displayed in real time or at regular intervals.

3 is a flowchart of another embodiment of a photographing method provided by the present invention. The photographing method includes the following steps:

Step S101: collecting an image every preset time and outputting;

After the start of the star track shooting, the imaging device collects the image through the camera interval and outputs the image. The interval time is the exposure time, and can be set to 40S to 60S, 5S to 10S, and the like.

Step S102: determining whether the background of the currently outputted image is normal;

During the shooting, when the ambient light changes suddenly, such as when the car passes through the shooting scene, the lighting of the car causes the shooting scene to suddenly become brighter. At this time, the background of the captured image will be very bright, resulting in overexposure.

In some embodiments, the photographing device determines whether the brightness of the currently outputted image is greater than a preset value or exceeds a preset value of the statistical value; if so, determining that the background of the image is abnormal; otherwise, determining that the background of the image is normal. Specifically, a threshold value may be preset, the sum of the luminances of all the pixels in the currently output image, or the average brightness of the image is calculated, and then the calculation is obtained. The sum of the brightness, or the average brightness is compared with a preset threshold. If the threshold is higher than the threshold, the background is abnormal, otherwise the background is normal. Alternatively, it may be compared with a statistical value, and if the statistical value is exceeded by 1 to 2 times, the background abnormality is determined, otherwise the background is normal; the statistical value is obtained by the shooting device statistical base image or the brightness of the image of the background normal output in the past. Value, the statistical value can be the average value, the median, and the like.

In other embodiments, the photographing device may also determine whether the number of bright points in the currently outputted image is greater than a preset value or exceed a preset multiple of the statistical value; if yes, determine that the background of the image is abnormal; otherwise, determine the background of the image. normal. Specifically, the photographing device calculates the number of bright points in the currently output image, where the bright point is a pixel point whose brightness value is greater than the threshold value, and then compares the calculated number of bright points with the preset number of bright point numbers, if the preset value is compared If the size is large, the background is abnormal, otherwise the background is normal. Alternatively, it may be compared with a statistical value. If the statistical value is exceeded by 1 to 2 times, the background abnormality is determined, otherwise the background is normal; the statistical value is the number of bright spots in the image of the basic image of the photographing device or the image with normal background output in the past. The obtained value, which can be the average value, the median, and the like.

When it is determined that the background of the currently output image is abnormal, the process proceeds to step S103; otherwise, the process proceeds to step S104.

Step S103: discarding the currently outputted image;

If the background of the currently output image is abnormal, the image is discarded and not synthesized, so as not to affect the effect of the composite image. At the same time, returning to step S102, the detection of the next image output is continued.

Step S104: determining a base image, synthesizing the currently output image and the base image into a composite image, and using the composite image as a base image for the next synthesis;

If the currently outputted image is an image with a normal background, the image is synthesized.

Specifically, the base image is first determined. When the composition is first performed, the base image is the first output of the background normal image or the preset image. For example, the currently output image is the start of shooting After the first normal background image is output, the preset image before shooting can be used as the base image; or there is no preset image, the first image with normal background is not synthesized, and the second background with normal background is output. The composition processing is performed only at the time of image, and at this time, the image of the first output with a normal background is used as the base image. When the synthesis is performed thereafter, the composite image obtained by the previous synthesis is determined as the base image of the synthesis.

After the basic image is determined, the synthesis process is performed. Specifically, taking the star track shooting as an example, the photographing device determines whether the brightness of the pixel of the image currently outputted at the same position is greater than the brightness of the pixel of the base image; if so, replacing the pixel of the base image of the same position with the pixel of the currently output image According to this, image synthesis is performed, a composite image is generated, and the composite image is used as a base image for the next image synthesis.

Step S105: displaying the composite image in real time;

After the composite image is generated, the composite image is displayed on the display screen in real time, and the process returns to step S102 to continue detecting the next image to be output, and preparing for the next image synthesis.

In this embodiment, during image capture, image acquisition and image synthesis are performed synchronously to facilitate the user to view the currently generated composite image in real time; before each image is acquired and image synthesis is performed, it is detected whether the background of the currently output image is normal. If it is abnormal, discard the currently acquired image without synthesizing, and only combine the normal background image with the base image, thereby eliminating the background abnormal image and preventing the background abnormal image from being synthesized into the final composite image. The quality of the photos eliminates the interference caused by sudden changes in ambient light and improves the shooting effect.

Referring to FIG. 2, an embodiment of the photographing apparatus of the present invention is provided. The photographing apparatus may be a general digital camera such as a card camera, or may be a terminal device such as a mobile phone or a tablet computer having a camera function. The photographing device includes an output module, an obtaining unit 201, a judging module 202, and a synthesizing module. 203 and display module 204.

Output Module: Configured to capture images and output them. The image is collected by the camera interval, and the interval time is the exposure time. For example, it can be set to 40S to 60S, 5S to 10S, and the like.

The obtaining module 201 is configured to obtain an image currently output by the output module;

The determining module 202: configured to determine whether the background of the currently output image is normal. If the determination result is yes, the image is sent to the synthesis module; if the determination result is no, the image is discarded.

In some embodiments, the determining module 202 determines whether the brightness of the currently outputted image is greater than a preset value or exceeds a preset multiple of the statistical value; if so, determining that the background of the image is abnormal; otherwise, determining that the background of the image is normal. Specifically, a threshold value may be preset, and the determining module 202 calculates the sum of the brightness of all the pixels in the currently output image, or the average brightness of the image, and then calculates the sum of the obtained brightness, or the average brightness and the preset threshold. The limit is compared. If the threshold is higher than the threshold, the background is abnormal. Otherwise, the background is normal. Alternatively, it may be compared with a statistical value. If the statistical value is 1 to 2 times, the background abnormality is determined; otherwise, the background is normal; the statistical value is obtained by judging the brightness of the base image or the image of the normal background image output in the past. Value, the statistical value can be the average value, the median, and the like.

In other embodiments, the determining module 202 may also determine whether the number of bright points in the currently outputted image is greater than a preset value or exceed a preset multiple of the statistical value; if yes, determine that the background of the image is abnormal; otherwise, determine the image. The background is normal. Specifically, the determining module 202 calculates the number of bright points in the currently output image, where the bright point is a pixel point whose brightness value is greater than the threshold, and then compares the calculated number of bright points with the preset number of bright points, if the preset is compared If the value is large, the background is abnormal, otherwise the background is normal. Alternatively, it may be compared with a statistical value. If the statistical value is 1 to 2 times, the background abnormality is determined, otherwise the background is determined to be normal; the statistical value is the judgment module 202. A numerical value obtained by counting the number of bright spots in the base image or the image of the background normal output in the past, and the statistical value may be an average value, a median, or the like.

The synthesizing module 203 is configured to determine a base image, synthesize the currently output background normal image and the base image into a composite image, and use the composite image as a base image for the next synthesis.

Specifically, the synthesizing module 203 first determines the base image. When the composition is first performed, it is determined that the base image is the first output of the background normal image or the preset image. For example, if the currently outputted image is the first normal background image output after the start of shooting, the preset image before shooting may be used as the base image; or there is no preset image, and the image with the first background normal may not be synthesized. The synthesis processing is performed when the second image with the normal background is output, and at this time, the image of the first output with the normal background is used as the base image. When the synthesis is performed thereafter, the composite image obtained by the previous synthesis is determined as the base image of the synthesis.

After the basic image is determined, the synthesis process is performed. Specifically, taking the star track shooting as an example, the synthesizing module 203 determines whether the brightness of the pixel of the image currently outputted at the same position is greater than the brightness of the pixel of the base image; if so, replacing the pixel of the base image of the same position with the image of the current output. The pixels are subjected to image synthesis, a composite image is generated, and the composite image is used as a base image for the next image synthesis.

The display module 204 is configured to display a composite image synthesized during shooting in real time.

In the embodiment, during image capture, image acquisition and image synthesis are performed synchronously to facilitate the user to view the currently generated composite image in real time.

The technical features in the above method embodiments are applicable to the device, and are not repeated here.

In an actual application, the output module, the obtaining unit 201, the determining module 202, the synthesizing module 203, and the display module 204 may each be a central processing unit (CPU) or a digital signal processing (DSP). Or a microprocessor (MPU, Micro Processor Unit), or a Field Programmable Gate Array (FPGA); the CPU, DSP, MPU, and FPGA can be built in the data query system. Unified.

Therefore, the photographing apparatus of the present invention first detects whether the background of the currently outputted image is normal before each image is output and performs image synthesis. If the image is abnormal, the currently collected image is not synthesized, and only the background is normal. The image is combined with the base image to eliminate the background anomaly image, preventing the background anomaly image from being synthesized into the final composite image and affecting the photo quality, eliminating the interference caused by the sudden change of the ambient light, and improving the shooting. effect.

It should be noted that the photographing device provided in the above embodiment is only illustrated by the division of the above functional modules when performing the star-track shooting. In actual applications, the above-mentioned function assignment can be completed by different functional modules as needed. In addition, the imaging device provided by the foregoing embodiment is the same as the embodiment of the imaging method, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.

It will be understood by those skilled in the art that all or part of the steps of the foregoing embodiments may be implemented by a program to control related hardware, and the program may be stored in a computer readable storage medium, the storage medium. It can be ROM/RAM, magnetic disk, optical disk, and the like.

The preferred embodiments of the present invention have been described above with reference to the drawings, and are not intended to limit the scope of the invention. A person skilled in the art can implement the invention in various variants without departing from the scope and spirit of the invention. For example, the features of one embodiment can be used in another embodiment to obtain a further embodiment. Any modifications, equivalent substitutions and improvements made within the technical concept of the invention are intended to be included within the scope of the invention.

Claims

A method of photographing, the method comprising:

Get the current output image;

Determining whether the background of the currently output image is normal;

Determining the base image if the background of the currently outputted image is normal;

Combining the currently output image with the base image into a composite image;

Display the composite image.
The photographing method according to claim 1, wherein the synthesizing the currently output image and the base image into a composite image comprises:

Determining whether the brightness of the pixel of the image currently outputted at the same position is greater than the brightness of the pixel of the base image;

If so, the pixels of the base image at the same position are replaced with the pixels of the currently output image to obtain the composite image.
The photographing method according to claim 1 or 2, wherein the determining whether the background of the currently outputted image is normal includes:

Determining whether the brightness of the currently outputted image is greater than a preset value or exceeding a preset multiple of the statistical value;

If not, it is determined that the background of the currently output image is normal.
The photographing method according to claim 3, wherein the determining whether the brightness of the currently outputted image exceeds a preset multiple of the statistical value comprises:

Calculating a brightness of the currently output image, and acquiring a statistical value of brightness of the base image or a previously output background normal image;

It is judged whether the brightness of the currently outputted image exceeds the preset multiple of the statistical value.
The photographing method according to claim 1 or 2, wherein the determining whether the background of the currently outputted image is normal includes:

Determine whether the number of bright points in the currently output image is greater than a preset value or exceeds a preset value of the statistical value. number;

If not, it is determined that the background of the currently output image is normal.
The photographing method according to claim 1, wherein the base image is a first normal background image or a preset image when the composition is first performed;

When the synthesis is not performed for the first time, the base image is the composite image of the previous synthesis.
The photographing method according to claim 3, wherein when it is determined that the brightness of the currently outputted image is greater than a preset value or exceeds a preset value of the statistical value, the background abnormality of the currently outputted image is determined, and the image is discarded.
The photographing method according to claim 5, wherein the number of bright spots is a number of pixel points in the image whose brightness value is greater than a predetermined threshold;

When it is determined that the number of bright spots is greater than a preset value or exceeds a preset multiple of the statistical value, it is determined that the background of the currently output image is abnormal, and the image is discarded.
The photographing method according to claim 1, wherein the acquiring the currently outputted image comprises: acquiring one image at a preset time; or acquiring the image in real time.
A photographing apparatus, comprising: an acquisition module, a judgment module, a synthesis module, and a display module, wherein:

Obtaining a module configured to obtain an image of the current output;

a determining module configured to determine whether a background of the currently outputted image is normal;

a synthesis module configured to determine a base image, and if the background of the currently output image is normal, synthesize the currently output image and the base image into a composite image;

A display module configured to display a composite image.
The photographing apparatus according to claim 10, wherein the synthesizing module is configured to:

Determining whether the brightness of the pixel of the image currently outputted at the same position is greater than the brightness of the pixel of the base image;

If yes, replace the pixels of the base image in the same position with the image of the currently output image. The synthetic image is obtained.
The photographing apparatus according to claim 10 or 11, wherein the judging module is configured to:

Determining whether the brightness of the currently outputted image is greater than a preset value or exceeding a preset multiple of the statistical value;

If not, it is determined that the background of the currently output image is normal.
The photographing apparatus according to claim 12, wherein the judging module is configured to:

Calculating a brightness of the currently output image, and acquiring a statistical value of brightness of the base image or a previously output background normal image;

Determining whether the brightness of the currently outputted image exceeds a preset multiple of the statistical value;

If not, it is determined that the background of the currently output image is normal.
The photographing apparatus according to claim 10 or 11, wherein the judging module is configured to:

Determining whether the number of bright points in the currently outputted image is greater than a preset value or exceeding a preset multiple of the statistical value;

If not, it is determined that the background of the currently output image is normal.
The photographing apparatus according to claim 10, wherein, when the synthesizing module performs the first synthesis, the base image is a first output normal background image or a preset image;

When the synthesis module is not first synthesized, the base image is a composite image that was previously synthesized.
The photographing apparatus according to claim 12, wherein the determining module is configured to: determine that the background of the currently outputted image is abnormal when the brightness of the currently outputted image is greater than a preset value or exceeds a preset multiple of the statistical value, and discard The image.
The photographing apparatus according to claim 14, wherein the number of bright spots is a number of pixel points in the image whose brightness value is greater than a predetermined threshold;

The determining module is configured to: determine that the number of bright spots is greater than a preset value or exceed a statistical value When the multiple is set, the background abnormality of the currently output image is determined, and the image is discarded.
The photographing apparatus according to claim 10, wherein the acquiring module is configured to: collect one image at a preset time; or collect the image in real time.
A computer storage medium having stored therein computer executable instructions for performing the photographing method of any of the preceding claims 1 to 9.