WO2019174494A1 - Image capture method, device and storage medium - Google Patents

Image capture method, device and storage medium Download PDF

Info

Publication number
WO2019174494A1
WO2019174494A1 PCT/CN2019/077008 CN2019077008W WO2019174494A1 WO 2019174494 A1 WO2019174494 A1 WO 2019174494A1 CN 2019077008 W CN2019077008 W CN 2019077008W WO 2019174494 A1 WO2019174494 A1 WO 2019174494A1
Authority
WO
WIPO (PCT)
Prior art keywords
exposure time
current
output image
image
light source
Prior art date
Application number
PCT/CN2019/077008
Other languages
French (fr)
Chinese (zh)
Inventor
李飞
罗义军
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2019174494A1 publication Critical patent/WO2019174494A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/745Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/741Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/002Diagnosis, testing or measuring for television systems or their details for television cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time

Definitions

  • the present invention relates to, but is not limited to, the field of imaging, and in particular, to a photographing method, device and storage medium.
  • the photographing device for the scene of the motion is very demanding, and the key point is that a short exposure time is required to avoid motion blur, and it takes 1/500 s or even shorter exposure time for the sprint basketball badminton and the like. Solidify the movement moment to avoid blurring of the image.
  • the user may shoot outdoors or in the room.
  • the light source in the room may be a DC light source or a low-frequency AC light source.
  • the photos taken during a short exposure time will produce light and dark. Interwoven stripes.
  • the photosensitive component of the mobile phone camera adopts a complementary metal oxide semiconductor (CMOS) image sensor
  • the CMOS image sensor usually adopts a progressive scroll exposure method.
  • the first line is performed first. Exposure, the second line starts to expose after one line time, the third line starts to expose after one line time, and so on until all lines are exposed; the CMOS image sensor is used for image shooting, because the rolling exposure is often visible. Yellow bands or other bands between light and dark appear on the image, which seriously affects the quality and look of the image.
  • CMOS complementary metal oxide semiconductor
  • embodiments of the present invention are expected to provide a photographing method, apparatus, and storage medium, which can avoid banding effects in an image and ensure image quality.
  • An embodiment of the present invention provides a photographing method, including: determining that an exposure time is shortened in a case where there is motion of a camera photographing screen; acquiring an output image currently output by the camera after shortening the exposure time; determining, according to the output image, Whether there is a banding effect when shooting in the current shooting scene, adjust the exposure time according to the detection result; use the adjusted exposure time to shoot.
  • the embodiment of the present invention further provides a photographing apparatus, comprising: a determining module configured to reduce an exposure time when the camera photographing screen has motion; and an obtaining module configured to obtain a current output of the camera after the exposing time is shortened The image is output; the adjustment module is configured to determine, according to the output image, whether there is a striping effect in the current shooting scene, and adjust the exposure time according to the detection result; and the executing module is configured to use the adjusted exposure time for shooting.
  • the embodiment of the present invention further provides a storage medium in which a computer program is stored, wherein the computer program is executed to execute the photographing method provided by the embodiment of the present invention.
  • the embodiment of the present invention further provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the computer program during operation to implement the shooting provided by the embodiment of the present invention. method.
  • 1 is a schematic diagram showing the frequency of an alternating current in the related art
  • FIG. 3 is a schematic diagram showing light and dark stripes appearing in an image captured in an AC environment in the related art
  • FIG. 4 is a circuit diagram of a single pixel unit of a CMOS image sensor in the related art
  • FIG. 5 is a flowchart of a photographing method according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of an image sensor according to an embodiment of the present invention.
  • FIG. 7 is a flow chart of a method for reducing blurring of a photograph taken in an embodiment of the present invention.
  • FIG. 8 is a flow chart of a strategy for modifying an exposure time according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a method for determining an exposure time according to motion detection according to an embodiment of the present invention.
  • FIG. 10 is a flow chart showing a method of determining an exposure time according to motion detection according to an embodiment of the present invention.
  • FIG. 1 is a schematic diagram of the frequency of the alternating current in the related art. Referring to FIG. 1 , the corresponding source of the power source in the technical field is described as Sources of Electricity, and the corresponding English in the technical field is described as Dark. The corresponding English in the technical field of flicker bandwidth is described as Flicker band.
  • FIG. 2 is related art.
  • FIG. 3 is a schematic diagram showing the appearance of light and dark stripes in an image taken under an alternating current scene in the related art.
  • An image sensor is a semiconductor device that converts an optical signal into an electrical signal.
  • a conventional image sensor includes a charge coupled device (CCD) image sensor and a CMOS image sensor. Due to the advantages of low power consumption and high signal-to-noise ratio, CMOS image sensors are widely used in the field of image sensors.
  • CCD charge coupled device
  • CMOS image sensors Due to the advantages of low power consumption and high signal-to-noise ratio, CMOS image sensors are widely used in the field of image sensors.
  • FIG. 4 is a circuit diagram of a single pixel unit of a CMOS image sensor in the related art, as shown in FIG. 4, which mainly includes a photodetector (Pinned) PhotoDiode, PPD), transfer tube T1, reset tube T2, source follower T3, and selection tube T4.
  • the photodetector PPD is a photodiode that generates electric charge from light energy, and accumulates electric charge at point A, and the transfer tube T1 receives an enable/read signal tck at the gate, and carries the charge at A to the floating diffusion region B.
  • the reset transistor T2 is reset by receiving a reset signal rst through its gate, setting the voltages at A and B back to a desired level (such as VDD) and excluding the charge at B.
  • Source follower T3 receives the voltage at B at its gate and thus acts as a source follower, and the gate of select tube T4 receives the row select signal row_sel (which can be generated or executed by other circuitry of the CMOS image sensor), output The voltage from source follower T3.
  • CMOS image sensor employs a progressive scroll exposure method in which the exposure time of all lines is the same although the time at which each line starts to be exposed is different.
  • CMOS image sensors are often used indoors.
  • the illumination generally uses 50 Hz AC and fluorescent lamps.
  • the frame time is usually set to be an integer multiple of 10 ms (light intensity change period).
  • the frequency is high, and the exposure time is shorter than 10 ms, yellow bands or other bands of light and dark appear on the image, which seriously affects the image quality and perception.
  • the technical solution of the present application can be applied to a photographing device, such as a mobile phone, a tablet computer, a video camera, etc., and is of course not limited to the above device.
  • the striping effect of the captured image due to the change of the lighting of the shooting scene is called the striping effect.
  • FIG. 5 is a flowchart of a photographing method according to an embodiment of the present invention. As shown in FIG. 5, the flow includes the following steps:
  • Step S502 if it is determined that there is motion in the camera shooting screen, shorten the exposure time
  • Step S504 acquiring an output image of the current output of the camera after shortening the exposure time
  • Step S506 determining, according to the output image, whether there is a banding effect in the shooting in the current shooting scene, and adjusting the exposure time according to the detection result;
  • step S508 shooting is performed using the adjusted exposure time.
  • the exposure time is shortened, the output image of the current output after the exposure time is shortened, and whether the shooting effect is caused in the scene according to the current image is determined, and the detection result is adjusted in real time according to the detection result.
  • the exposure time allows the captured image to avoid the banding effect as much as possible.
  • the striping effect of the captured image due to the change of the lighting of the shooting scene may be referred to as a striping effect.
  • determining, according to the output image, whether there is a striping effect in the current shooting scene comprising: determining a light source type in a current shooting environment according to the output image; determining, according to the light source type, the current shooting scene Take a shot to see if there is a banding effect.
  • adjusting the exposure time according to the detection result including one of the following: determining that the light source type of the current shooting scene is a 50 Hz or 60 Hz light source, adjusting the exposure time to be an integer multiple of a half cycle; determining the current shooting scene In the case where the light source type is a DC flicker free light source, the exposure time is shortened.
  • adjusting the exposure time according to the detection result includes one of: increasing the exposure time in the case where it is determined that the output image has a strip effect; and reducing the exposure in the case where it is determined that the output image does not have a strip effect time.
  • the method further includes: acquiring a second output image output by the camera; determining, in the case that the strip effect is currently present, according to the second output image. Extending the current second exposure time to 1/120 s, wherein the second exposure time is less than 1/120 s.
  • the method further comprises: acquiring a third output image output by the camera; and determining, in the case that the strip effect is currently present, according to the third output image, extending the exposure time to 1/100s.
  • the method further comprises: acquiring a fourth output image output by the camera; and determining, according to the fourth output image, that the current strip effect is present, adjusting the exposure time to The second exposure time, or the extended exposure time, is greater than 1/100 s.
  • the extended exposure time is greater than 1/100 s, including: adjusting the exposure time to S1*G1, wherein S1 represents the exposure time before the current adjustment, and G1 represents the sensitivity before the current adjustment.
  • an exposure control method for a CMOS image sensor includes: performing a first progressive exposure and a second progressive exposure on a pixel array to obtain first image data and second image data, wherein The exposure time interval of the same row in the first progressive exposure and the second progressive exposure is an odd multiple of a half intensity variation period; the first image data is combined with the image data located in the same row in the second image data to The output image is derived.
  • the step of respectively performing the first progressive exposure and the second progressive exposure on the pixel array to obtain the first image data and the second image data comprises: performing a first row-by-line exposure on the pixel array to Deriving first image data; performing a second progressive exposure on the pixel array in the same exposure sequence as the first progressive exposure to obtain second image data; a start time of the first progressive exposure and a second The start time interval of the line exposure is an odd multiple of half the intensity change period.
  • the sensor sensor needs precise exposure synchronization control, the cost process is increased, and the feasibility is not good.
  • the short exposure time is required for the motion photography, and the shorter exposure time has the contradiction of the strips in the image under the low frequency alternating current light source, thereby realizing the automatic identification of the light source and obtaining better in the environment without the strip light source.
  • the motion picture effect, the method steps of the embodiment of the present invention are as follows:
  • Step 1 Identify if the light source will cause a banding effect.
  • Step 2 Determine whether there is a limit to shorten the exposure time for the above judgment result.
  • Step 3 if the image does not produce a stripe light source scene, shorten the exposure time, and no banding effect limits the exposure time to take a better picture.
  • step 3 if it is a 50 Hz or 60 Hz scene, the exposure time is shortened, and the exposure time must be an integral multiple of 1/100 s or 1/120 s.
  • an implementation method includes the following steps:
  • Step 1 Use the shortest exposure time to image according to the shooting scene
  • Step 2 Determine whether the image has a banding effect under this exposure time condition.
  • Step 3 According to step 2, if the image does not produce a banding effect, maintain this exposure time imaging
  • Step 4 if the image produces a banding effect, the exposure time is extended. Under certain conditions, try to extend the exposure time to an integral multiple of 1/100s or 1/120s respectively to see if there is a banding phenomenon. If one of the exposure times causes the image to have no banding effect, select the corresponding exposure time to image.
  • the embodiments of the present invention can be applied to an outdoor indoor scene, including an indoor and outdoor natural artificial light source environment.
  • the artificial light source environment it can be various types of lights, such as: fluorescent lamp, incandescent lamp, 400W metal halide lamp, LED high-power energy-saving lamp, high-frequency electrodeless lamp, T5 energy-saving lamp stadium row lamp, spiral U-shaped high-power energy-saving lamp 6U-60W high-frequency energy-saving lamps, these lights may be powered by DC power, no illuminating lights, may be high-frequency lights, or directly powered by 50hz, 60hz, with obvious periodicity.
  • FIG. 6 is a schematic diagram of an image sensor according to an embodiment of the present invention, as shown in FIG. 6, including the following parts:
  • the sensor included in the camera module is an input unit of the image, and the image optical signal is converted into an electrical signal by the photoelectric conversion principle, and transmitted to the back end processing.
  • the sensor used in the mobile phone of the related art is a CMOS sensor, which adopts a line exposure mode, and the start time of each line of exposure in one frame is different.
  • the image processor is responsible for receiving the original image information input by the module, and working through the modules of image correction and color correction on various raw fields and yuv fields, and the original image processing is an image that is substantially consistent with the human eye. Different image processors will have a slight difference.
  • the strip effect detection module is responsible for detecting the type of the light source and identifying whether the current scene light source will cause a banding effect. For example, if the ambient light source is a 50 hz light source, the output result is a 50 hz light source, and if the ambient light source is a 60 hz light source, the output result is It is a 60hz light source. If other sources such as DC flicker-free light source, the output is a flicker-free light source.
  • the control unit controls the camera senor to adopt different exposure times according to the result of the strip effect detection module.
  • the result of the strip effect detection module is a 50 hz light source. Then modify the current exposure time to an integral multiple of 10ms. If the result is a DC flicker-free light source, the exposure time is shortened, for example, shortened to 1/2 based on the current exposure time or changed to 5 ms if the exposure time is longer than 5 ms.
  • FIG. 7 is a flowchart of a method for reducing blurring of a photograph taken according to an embodiment of the present invention. As shown in FIG. 7, the method includes the following steps:
  • Step S701 The user turns on the camera.
  • Step S702 The camera module (sensor) outputs an image.
  • Step S703 Striping effect check.
  • the output result is a 50hz light source. If the ambient light source is a 60hz light source, the output result is a 60hz light source, such as other If the DC has no flickering light source, the output is a flicker free light source.
  • Decision S704 determining whether there is a striping effect, if there is an execution step 705; otherwise, performing step 706.
  • Step S705 The exposure time is changed to be an integral multiple of the half cycle of the light source.
  • the exposure time is modified according to different light source characteristics, such as a 50hz light source. If the current exposure time is not an integer multiple of 10 ms, the current exposure time is modified to be an integer multiple of 10 ms. If the result is a 60hz light source, it is similarly processed.
  • Step S706 shortening the exposure time according to the strategy.
  • the strategy can be a simple strategy to change the exposure time according to the strategy to shorten the exposure time, for example, shortening to 1/2 based on the current exposure time or if the exposure time is longer than 5ms will be changed to 5ms. It can also be a relatively complex strategy.
  • the strategy for adjusting the exposure time may be to select a change according to the ambient brightness.
  • FIG. 8 is a flowchart of a strategy for modifying the exposure time according to the embodiment of the present invention. As shown in FIG. 8, the method includes the following steps:
  • step 1 the current brightness is obtained.
  • the current brightness information can be characterized by the exposure index of the current exposure table.
  • Step 2 converts to the exposure time and the sensitivity of the camera module.
  • the exposure time and the sensor gain of the camera module can be correspondingly obtained through the exposure index.
  • step 3 the exposure time after the final conversion is confirmed based on the sensitivity value and the exposure time.
  • the exposure time after the final conversion is confirmed based on the gain value and the exposure time. For the same illumination scene of sensor, different exposure time and gain matching imaging noise will be different. You can choose a trade-off between exposure time and gain. For example, when the exposure time is 0.01s, the maximum gain can be set to 6 times. When the exposure time is 0.005 s, the gain can be set to 4 times or so.
  • FIG. 9 is a schematic diagram of a first method for determining an exposure time according to motion detection according to a preferred embodiment of the present invention. As shown in FIG. 9, the method includes the following steps:
  • step 1 the motion detection is performed, and it is determined whether there is motion, and if so, step 3 is performed, otherwise step 2 is performed.
  • the motion detection algorithm can use the inter-frame image comparison method in the related art to simply calculate the pixel difference between two frames, or perform inter-frame feature point matching to identify the inter-frame object movement information, and whether there is motion.
  • Step 2 keep the exposure time unchanged.
  • Step 3 shorten the exposure time.
  • the exposure time is increased by gain to reduce the image motion blur effect.
  • FIG. 10 is a schematic flowchart of a method for determining an exposure time according to motion detection according to an embodiment of the present invention. As shown in FIG. 10, the method flow includes the following steps:
  • Step 1 Select the shortest exposure time imaging according to the current scene.
  • imaging is performed using the shortest exposure time.
  • step 2 it is determined whether there is a strip, if it exists, step 4 is performed; otherwise, step 3 is performed.
  • Step 3 keep the exposure time unchanged.
  • This exposure time is imaged if the image does not produce a banding effect.
  • Step 4 according to the sensitivity value, extend the exposure time to 1/120 s.
  • step 5 it is judged whether there is a strip, and if it is, step 6 is performed; otherwise, the integral time of the exposure time of 1/120 s is kept unchanged.
  • step 4 try to extend the exposure time to 1/120s, and judge whether the image has a banding effect under the exposure time condition, if the image does not produce a banding effect to maintain the exposure time imaging;
  • Step 6 Extend the exposure time to 1/100s.
  • step 4 if the image produces a striping effect to see if there is a condition to try to extend the exposure time to 1/100s, the method is as follows:
  • step 7 it is judged whether there is a strip, and if it is, step 8 is performed; otherwise, the integral time of the exposure time of 1/120 s is kept unchanged.
  • step 6 the exposure time is extended to 1/100 s, and it is judged whether the image has a banding effect under the exposure time condition, and the image is maintained if the image does not produce a banding effect.
  • Step 8 Use the initial exposure time or the exposure time as long as possible.
  • the exposure time is extended to 1/100 s. If the image is strip effect, the initial exposure time imaging can be maintained, or the exposure time can be as long as possible to make the banding phenomenon as unobtrusive as possible.
  • the method is as follows: the current exposure time S1, the current gain is G1., the change gain value is 1 times gain, and the exposure time is extended to S1*G1.
  • the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in a form of a software product stored in a storage medium (such as a read-only memory (Read- Only Memory, ROM) / Random Access Memory (RAM), disk, CD-ROM, including a number of instructions to enable a terminal device (can be a mobile phone, computer, server, or network device, etc.)
  • a storage medium such as a read-only memory (Read- Only Memory, ROM) / Random Access Memory (RAM), disk, CD-ROM, including a number of instructions to enable a terminal device (can be a mobile phone, computer, server, or network device, etc.)
  • a terminal device can be a mobile phone, computer, server, or network device, etc.
  • the embodiment of the invention further provides a camera device, which is configured to implement the above-mentioned embodiments, and details have been omitted for description.
  • the term "module” may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and conceivable.
  • the photographing apparatus of the embodiment of the invention includes:
  • Obtaining a module configured to obtain an output image of a current output of the camera after shortening the exposure time
  • the adjusting module is configured to determine, according to the output image, whether there is a banding effect in the current shooting scene, and adjust the exposure time according to the detection result;
  • the execution module is configured to shoot with the adjusted exposure time.
  • the exposure time is shortened, the output image of the current output after the exposure time is shortened, and whether the shooting effect is caused in the scene according to the current image is determined, and the detection result is adjusted in real time according to the detection result.
  • the exposure time allows the captured image to avoid the banding effect as much as possible.
  • the striping effect of the captured image due to the change of the lighting of the shooting scene may be referred to as a striping effect.
  • the adjusting module is further configured to determine, according to the output image, a light source type in a current shooting environment; and determine, according to the light source type, whether a striping effect is performed in the current shooting scene.
  • the adjusting module adjusts the exposure time according to the detection result, including one of the following: determining that the light source type of the current shooting scene is a 50 Hz or 60 Hz light source, and adjusting the exposure time to be an integer multiple of a half cycle; In the case where it is determined that the light source type of the current shooting scene is a DC flicker-free light source, the exposure time is shortened.
  • the adjusting module adjusts the exposure time according to the detection result, including one of: increasing the exposure time in the case of determining that the output image has a striping effect; determining that the output image does not have a striping effect In case of reduction, the exposure time is reduced.
  • the determining module is further configured to acquire a second output image output by the camera; and determine a current existing strip according to the second output image.
  • the current second exposure time is extended to 1/120 s, wherein the second exposure time is less than 1/120 s.
  • the determining module is further configured to acquire a third output image output by the camera; and determine, in the case that the strip effect is currently present, according to the third output image. , extend the exposure time to 1/100s.
  • the determining module is further configured to acquire a fourth output image output by the camera; and determining, according to the fourth output image, that the current banding effect exists
  • the exposure time is adjusted to be the second exposure time, or the exposure time is extended by more than 1/100 s.
  • the determining module is further configured to adjust the exposure time to S1*G1, wherein S1 represents an exposure time before the current adjustment, and G1 represents a sensitivity gain before the current adjustment.
  • each of the above modules may be implemented by software or hardware.
  • the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination.
  • the forms are located in different processors.
  • the embodiment of the present invention further provides a storage medium, wherein the storage medium stores a computer program, wherein the computer program is configured to execute the photographing method described in any one of the above embodiments.
  • An embodiment of the present invention further provides an electronic device including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform any of the above embodiments. The shooting method described.
  • modules or steps of the embodiments of the present invention can be implemented by a general computing device, which can be concentrated on a single computing device or distributed in multiple computing devices.
  • they may be implemented by program code executable by a computing device such that they may be stored in a storage device by a computing device and, in some cases, may be different
  • the steps shown or described herein are performed sequentially, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Studio Devices (AREA)

Abstract

Disclosed by the present invention are an image capture method, device and storage medium, the method comprising: determining that a camera is capturing a moving picture, and then shortening exposure time; acquiring an output image currently outputted after shortening the exposure time; according to a current image, determining whether capturing in said scenario will cause a stripe effect; according to a detection result, adjusting the exposure time in real time such that a stripe effect is avoided as much as possible for a captured image.

Description

拍摄方法、装置及存储介质Shooting method, device and storage medium
相关申请的交叉引用Cross-reference to related applications
本申请基于申请号为201810206490.9、申请日为2018年03月13日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。The present application is filed on the basis of the Chinese Patent Application No. 20110020 649, the entire disclosure of which is hereby incorporated by reference.
技术领域Technical field
本发明涉及但不限于摄像领域,尤其涉及一种拍摄方法、装置及存储介质。The present invention relates to, but is not limited to, the field of imaging, and in particular, to a photographing method, device and storage medium.
背景技术Background technique
在相关技术中,针对运动场景的拍照对拍照器件要求非常高,其中比较关键的一点是需要很短的曝光时间才能避免运动模糊,针对短跑篮球羽毛球等需要1/500s甚至更短的曝光时间才能凝固住运动瞬间,避免图像运动模糊。用户可能在室外拍摄也可能在室内拍摄,室内拍摄的光源有可能是直流光源,也可能是低频的交流电光源,但是在交流电光源的情况下,过短的曝光时间拍出的照片上会产生明暗交织的条纹。In the related art, the photographing device for the scene of the motion is very demanding, and the key point is that a short exposure time is required to avoid motion blur, and it takes 1/500 s or even shorter exposure time for the sprint basketball badminton and the like. Solidify the movement moment to avoid blurring of the image. The user may shoot outdoors or in the room. The light source in the room may be a DC light source or a low-frequency AC light source. However, in the case of an AC light source, the photos taken during a short exposure time will produce light and dark. Interwoven stripes.
相关技术中,手机摄像头的感光元器件采用的是互补金属氧化物半导体(Complementary Metal Oxide Semiconductor,CMOS)图像传感器,CMOS图像传感器通常采用逐行滚动曝光的方法,简单来讲,先进行第一行的曝光,过一个行时间第二行开始曝光,再过一个行时间第三行开始曝光,依次类推直至所有行均实现曝光;采用CMOS图像传感器进行图像拍摄过程中,因为滚动曝光经常可见拍摄的图像上面出现黄带或其他明暗相间的条带,从而严重影响了图像的质量和观感。In the related art, the photosensitive component of the mobile phone camera adopts a complementary metal oxide semiconductor (CMOS) image sensor, and the CMOS image sensor usually adopts a progressive scroll exposure method. In brief, the first line is performed first. Exposure, the second line starts to expose after one line time, the third line starts to expose after one line time, and so on until all lines are exposed; the CMOS image sensor is used for image shooting, because the rolling exposure is often visible. Yellow bands or other bands between light and dark appear on the image, which seriously affects the quality and look of the image.
发明内容Summary of the invention
有鉴于此,本发明实施例期望提供一种拍摄方法、装置及存储介质,能够避免图像中的条带效应,保证图像质量。In view of this, embodiments of the present invention are expected to provide a photographing method, apparatus, and storage medium, which can avoid banding effects in an image and ensure image quality.
本发明实施例提供了一种拍摄方法,包括:确定摄像头拍摄画面存在运动的情况下,缩短曝光时间;获取缩短所述曝光时间后的摄像头当前输出的输出图像;依据所述输出图像确定,在当前拍摄场景下进行拍摄是否存在条带效应,依据检测结果调整曝光时间;使用调整后的曝光时间进行拍摄。An embodiment of the present invention provides a photographing method, including: determining that an exposure time is shortened in a case where there is motion of a camera photographing screen; acquiring an output image currently output by the camera after shortening the exposure time; determining, according to the output image, Whether there is a banding effect when shooting in the current shooting scene, adjust the exposure time according to the detection result; use the adjusted exposure time to shoot.
本发明实施例还提供了一种拍摄装置,包括:确定模块,配置为确定摄像头拍摄画面存在运动的情况下,缩短曝光时间;获取模块,配置为获取缩短所述曝光时间后的摄像头当前输出的输出图像;调整模块,配置为依据所述输出图像确定,在当前拍摄场景下进行拍摄是否存在条带效应,依据检测结果调整曝光时间;执行模块,配置为使用调整后的曝光时间进行拍摄。The embodiment of the present invention further provides a photographing apparatus, comprising: a determining module configured to reduce an exposure time when the camera photographing screen has motion; and an obtaining module configured to obtain a current output of the camera after the exposing time is shortened The image is output; the adjustment module is configured to determine, according to the output image, whether there is a striping effect in the current shooting scene, and adjust the exposure time according to the detection result; and the executing module is configured to use the adjusted exposure time for shooting.
本发明实施例还提供了一种存储介质,所述存储介质中存储有计算机程序,其中,所述计算机程序运行时执行本发明实施例提供的拍摄方法。The embodiment of the present invention further provides a storage medium in which a computer program is stored, wherein the computer program is executed to execute the photographing method provided by the embodiment of the present invention.
本发明实施例还提供了一种电子装置,包括存储器和处理器,所述存储器中存储有计算机程序,所述处理器配置为运行时执行所述计算机程序,以实现本发明实施例提供的拍摄方法。The embodiment of the present invention further provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the computer program during operation to implement the shooting provided by the embodiment of the present invention. method.
应用本发明实施例,确定摄像头在拍摄运动画面,则缩短曝光时间,获取缩短曝光时间后的当前输出的输出图像,依据当前图像确定在此种场景下拍摄是否会引起条带效应,依据检测结果实时调整曝光时间,使得拍摄的图像尽可能的避免条带效应。采用上述技术方案,解决了相关技术中图像传感器曝光时可能出现条带,影响图像效果的问题,通过调整曝光时间避免了图像中的条带效应,保证了图像质量。Applying the embodiment of the present invention, determining that the camera captures the motion picture, shortening the exposure time, obtaining the output image of the current output after shortening the exposure time, determining whether the shooting may cause a banding effect according to the current image, according to the detection result. Adjust the exposure time in real time so that the captured image avoids the banding effect as much as possible. The above technical solution solves the problem that the image sensor may appear in the related art when the image sensor is exposed, affecting the image effect, and the striping effect in the image is avoided by adjusting the exposure time to ensure the image quality.
附图说明DRAWINGS
图1是相关技术中交流电流的频率示意图;1 is a schematic diagram showing the frequency of an alternating current in the related art;
图2是相关技术中每行曝光时间内的得到的光能量的示意图;2 is a schematic diagram of the obtained light energy per line exposure time in the related art;
图3是相关技术中交流电场景下拍摄的图像出现明暗条纹的示意图;3 is a schematic diagram showing light and dark stripes appearing in an image captured in an AC environment in the related art;
图4是相关技术中CMOS图像传感器单个像素单元的电路图;4 is a circuit diagram of a single pixel unit of a CMOS image sensor in the related art;
图5是本发明实施例的一种拍摄方法的流程图;FIG. 5 is a flowchart of a photographing method according to an embodiment of the present invention; FIG.
图6是本发明实施例的图像传感器的示意图;6 is a schematic diagram of an image sensor according to an embodiment of the present invention;
图7是本发明实施例的减少拍摄照片模糊的方法流程图;7 is a flow chart of a method for reducing blurring of a photograph taken in an embodiment of the present invention;
图8是本发明实施例的修改曝光时间的策略的流程图;8 is a flow chart of a strategy for modifying an exposure time according to an embodiment of the present invention;
图9是本发明实施例的依据运动检测确定曝光时间的方法示意图;9 is a schematic diagram of a method for determining an exposure time according to motion detection according to an embodiment of the present invention;
图10是根据本发明实施例的依据运动检测确定曝光时间的方法流程示意图。FIG. 10 is a flow chart showing a method of determining an exposure time according to motion detection according to an embodiment of the present invention.
具体实施方式detailed description
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.
需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.
发明人在研究过程中发现,交流电光源的情况下,过短的曝光时间拍出的照片上会产生明暗交织的条纹原因如下:手机摄像头的感光元器件采用的是CMOS,其曝光采用的是行曝光,这样一帧图像中的不同行曝光开始和结束的时间是不相同的。而交流电源的频率有两种标准:50Hz(大陆,欧洲)和60Hz(台湾、日本、美国)的正弦波形,当然能量是没有方向性的,因此对应的能量是一个频率为100Hz和120Hz的波形;图1是相关技术中交流电流的频率示意图,参见图1,其中,电力来源在技术领域内的所 对应的英文描述为Sources of Electricity,黑暗在技术领域内的所对应的英文描述为Dark,闪烁带宽在技术领域内的所对应的英文描述为Flicker band。In the research process, the inventor found that in the case of an AC electric light source, the photo of the light and dark interlaced strips produced by the photo taken with too short exposure time is as follows: The photosensitive component of the mobile phone camera is CMOS, and the exposure is performed by the line. Exposure, such that the start and end times of different line exposures in a frame of image are not the same. The frequency of the AC power source has two standards: 50Hz (continental, European) and 60Hz (Taiwan, Japan, the United States) sinusoidal waveform, of course, the energy is not directional, so the corresponding energy is a waveform with a frequency of 100Hz and 120Hz FIG. 1 is a schematic diagram of the frequency of the alternating current in the related art. Referring to FIG. 1 , the corresponding source of the power source in the technical field is described as Sources of Electricity, and the corresponding English in the technical field is described as Dark. The corresponding English in the technical field of flicker bandwidth is described as Flicker band.
在使用交流电的光源环境中,如果曝光时间不是交流电的1/2周期的整数倍时,每行相同曝光时间内得到的光的能量是不同的,如图2所示,图2是相关技术中每行曝光时间内的得到的光能量的示意图,其中,1/80sec为1/80秒。In the light source environment using alternating current, if the exposure time is not an integral multiple of 1/2 cycle of the alternating current, the energy of the light obtained in the same exposure time of each row is different, as shown in FIG. 2, FIG. 2 is related art. A schematic diagram of the obtained light energy per exposure time, where 1/80 sec is 1/80 second.
在图像上会出现明暗的条纹,如图3所示,图3是相关技术中交流电场景下拍摄的图像出现明暗条纹的示意图。A light and dark stripe appears on the image, as shown in FIG. 3, which is a schematic diagram showing the appearance of light and dark stripes in an image taken under an alternating current scene in the related art.
相关技术中,市面量产的cmos sensor高亮度交流电光源下,会出现的条带(banding)问题。In the related art, a banding problem occurs in a mass-produced CMOS sensor with a high-brightness AC light source.
图像传感器是将光信号转换成电信号的半导体器件。相关技术中,传统的图像传感器包括电荷耦合器件(Charge Coupled Device,CCD)图像传感器、CMOS图像传感器。由于CMOS图像传感器具有低功耗和高信噪比的优点,因此在图像传感器领域应用比较广泛。An image sensor is a semiconductor device that converts an optical signal into an electrical signal. In the related art, a conventional image sensor includes a charge coupled device (CCD) image sensor and a CMOS image sensor. Due to the advantages of low power consumption and high signal-to-noise ratio, CMOS image sensors are widely used in the field of image sensors.
相关技术中的一种CMOS图像传感器的单个像素单元电路如图4所示,图4是相关技术中的CMOS图像传感器单个像素单元的电路图,如图4所示,其中主要包括光电检测器(Pinned PhotoDiode,PPD),传输管T1,复位管T2,源跟随器T3,以及选择管T4。光电检测器PPD为从光能生成电荷的光电二极管,并在A点积累电荷,传输管T1在栅极接收使能/读取信号tck,将A处的电荷运送到浮动扩散区B。复位管T2则通过其栅极接收复位信号rst,设置A以及B处的电压回复到期望电平(如VDD)并排除B处的电荷,以此来复位。源跟随器T3在其栅极接收B处的电压,并因此用作源跟随器,且选择管T4的栅极接收行选择信号row_sel(其可在CMOS图像传感器的其他电路生成或执行),输出来自源跟随器T3的电压。A single pixel unit circuit of a CMOS image sensor in the related art is shown in FIG. 4. FIG. 4 is a circuit diagram of a single pixel unit of a CMOS image sensor in the related art, as shown in FIG. 4, which mainly includes a photodetector (Pinned) PhotoDiode, PPD), transfer tube T1, reset tube T2, source follower T3, and selection tube T4. The photodetector PPD is a photodiode that generates electric charge from light energy, and accumulates electric charge at point A, and the transfer tube T1 receives an enable/read signal tck at the gate, and carries the charge at A to the floating diffusion region B. The reset transistor T2 is reset by receiving a reset signal rst through its gate, setting the voltages at A and B back to a desired level (such as VDD) and excluding the charge at B. Source follower T3 receives the voltage at B at its gate and thus acts as a source follower, and the gate of select tube T4 receives the row select signal row_sel (which can be generated or executed by other circuitry of the CMOS image sensor), output The voltage from source follower T3.
上述CMOS图像传感器采用逐行滚动曝光的方法,在这种方法中,虽然每一行开始曝光的时间不同,但是所有行的曝光时间长度都一样。The above CMOS image sensor employs a progressive scroll exposure method in which the exposure time of all lines is the same although the time at which each line starts to be exposed is different.
并且,由CMOS图像传感器构成的摄像机经常会在室内场合下使用。在室内场合,照明一般使用的是50Hz的交流电和日光灯,在这种光线条件下工作,为避免图像闪烁,通常设定帧时间为10ms(光强变化周期)的整数倍。但是当室内光线比较强,频率较高,曝光时间短于10ms的情况下,经常可见图像上出现黄带或其他明暗相间的条带,从而严重影响了图像的质量和观感。Also, cameras made up of CMOS image sensors are often used indoors. In indoor situations, the illumination generally uses 50 Hz AC and fluorescent lamps. Under such lighting conditions, in order to avoid image flicker, the frame time is usually set to be an integer multiple of 10 ms (light intensity change period). However, when the indoor light is relatively strong, the frequency is high, and the exposure time is shorter than 10 ms, yellow bands or other bands of light and dark appear on the image, which seriously affects the image quality and perception.
本申请文件的技术方案可以应用于拍摄设备,如手机,平板电脑,摄像机等设备,当然不局限于上述设备。The technical solution of the present application can be applied to a photographing device, such as a mobile phone, a tablet computer, a video camera, etc., and is of course not limited to the above device.
需要补充的是,由于拍摄场景灯光的变化导致拍摄图像出现条纹的情况,称为条带效应。It should be added that the striping effect of the captured image due to the change of the lighting of the shooting scene is called the striping effect.
本发明实施例提供了一种运行于上述拍摄设备的拍摄方法,图5是本发明实施例的一种拍摄方法的流程图,如图5所示,该流程包括如下步骤:An embodiment of the present invention provides a method for photographing the above-mentioned photographing device. FIG. 5 is a flowchart of a photographing method according to an embodiment of the present invention. As shown in FIG. 5, the flow includes the following steps:
步骤S502,确定摄像头拍摄画面存在运动的情况下,缩短曝光时间;Step S502, if it is determined that there is motion in the camera shooting screen, shorten the exposure time;
步骤S504,获取缩短该曝光时间后的摄像头当前输出的输出图像;Step S504, acquiring an output image of the current output of the camera after shortening the exposure time;
步骤S506,依据该输出图像确定,在当前拍摄场景下进行拍摄是否存在条带效应,依据检测结果调整曝光时间;Step S506, determining, according to the output image, whether there is a banding effect in the shooting in the current shooting scene, and adjusting the exposure time according to the detection result;
步骤S508,使用调整后的曝光时间进行拍摄。In step S508, shooting is performed using the adjusted exposure time.
通过上述步骤,确定摄像头在拍摄运动画面,则缩短曝光时间,获取缩短曝光时间后的当前输出的输出图像,依据当前图像确定在此种场景下拍摄是否会引起条带效应,依据检测结果实时调整曝光时间,使得拍摄的图像尽可能的避免条带效应。采用上述技术方案,解决了相关技术中图像传感器曝光时可能出现条带,影响图像效果的问题,通过调整曝光时间避免了图像中的条带效应,保证了图像质量。Through the above steps, it is determined that the camera captures the motion picture, the exposure time is shortened, the output image of the current output after the exposure time is shortened, and whether the shooting effect is caused in the scene according to the current image is determined, and the detection result is adjusted in real time according to the detection result. The exposure time allows the captured image to avoid the banding effect as much as possible. The above technical solution solves the problem that the image sensor may appear in the related art when the image sensor is exposed, affecting the image effect, and the striping effect in the image is avoided by adjusting the exposure time to ensure the image quality.
需要补充的是,由于拍摄场景灯光的变化,导致拍摄图像出现条纹的情况,可以称为条带效应。It should be added that the striping effect of the captured image due to the change of the lighting of the shooting scene may be referred to as a striping effect.
在一实施例中,依据该输出图像确定,在当前拍摄场景下进行拍摄是 否存在条带效应,包括:依据该输出图像确定当前拍摄环境中的光源类型;依据该光源类型,确定当前拍摄场景下进行拍摄是否存在条带效应。In an embodiment, determining, according to the output image, whether there is a striping effect in the current shooting scene, comprising: determining a light source type in a current shooting environment according to the output image; determining, according to the light source type, the current shooting scene Take a shot to see if there is a banding effect.
在一实施例中,依据检测结果调整曝光时间,包括以下之一:确定当前拍摄场景的光源类型为50Hz或60Hz光源的情况下,调整该曝光时间为半周期的整数倍;确定当前拍摄场景的光源类型为直流无闪烁光源的情况下,缩短该曝光时间。In an embodiment, adjusting the exposure time according to the detection result, including one of the following: determining that the light source type of the current shooting scene is a 50 Hz or 60 Hz light source, adjusting the exposure time to be an integer multiple of a half cycle; determining the current shooting scene In the case where the light source type is a DC flicker free light source, the exposure time is shortened.
在一实施例中,依据检测结果调整曝光时间包括以下之一:在确定该输出图像存在条带效应的情况下,增加曝光时间;在确定该输出图像不存在条带效应的情况下,减少曝光时间。In an embodiment, adjusting the exposure time according to the detection result includes one of: increasing the exposure time in the case where it is determined that the output image has a strip effect; and reducing the exposure in the case where it is determined that the output image does not have a strip effect time.
在一实施例中,确定摄像头拍摄画面存在运动的情况下,缩短曝光时间之后,该方法还包括:获取摄像头输出的第二输出图像;依据该第二输出图像确定当前存在条带效应的情况下,延长当前的第二曝光时间至1/120s,其中,该第二曝光时间小于1/120s。In an embodiment, after determining that there is motion in the camera shooting screen, after the exposure time is shortened, the method further includes: acquiring a second output image output by the camera; determining, in the case that the strip effect is currently present, according to the second output image. Extending the current second exposure time to 1/120 s, wherein the second exposure time is less than 1/120 s.
在一实施例中,延长该曝光时间至1/120s之前,通过以下方式确定是否有条件延长曝光时间至1/120s:获取K1=(1/120)/S1;在G1>=K1的情况下,确定有条件延长曝光时间至1/120s;其中,S1表示当前曝光时间,G1表示当前感光度(gain)。In an embodiment, before extending the exposure time to 1/120 s, it is determined whether there is a conditional extension of the exposure time to 1/120 s: obtaining K1=(1/120)/S1; in the case of G1>=K1 Determine to conditionally extend the exposure time to 1/120 s; where S1 represents the current exposure time and G1 represents the current sensitivity.
在一实施例中,延长该曝光时间至1/120s之后,该方法还包括:获取摄像头输出的第三输出图像;依据该第三输出图像确定当前存在条带效应的情况下,延长曝光时间至1/100s。In an embodiment, after extending the exposure time to 1/120 s, the method further comprises: acquiring a third output image output by the camera; and determining, in the case that the strip effect is currently present, according to the third output image, extending the exposure time to 1/100s.
在一实施例中,延长曝光时间至1/100s之前,该方法还包括:通过以下方式确定是否有条件延长曝光时间至1/100s:获取K1=(1/100)/S1;在G1>=K1的情况下,确定有条件延长曝光时间至1/100s;其中,S1表示当前曝光时间,G1表示当前感光度。In an embodiment, before the exposure time is extended to 1/100 s, the method further comprises: determining whether the condition is extended by the following method to 1/100 s: obtaining K1=(1/100)/S1; at G1>= In the case of K1, it is determined that the exposure time is conditionally extended to 1/100 s; wherein S1 represents the current exposure time and G1 represents the current sensitivity.
在一实施例中,延长该曝光时间至1/100s之后,该方法还包括:获取摄像头输出的第四输出图像;依据该第四输出图像确定当前存在条带效应 的情况下,调整曝光时间为该第二曝光时间,或者延长曝光时间大于1/100s。In an embodiment, after extending the exposure time to 1/100 s, the method further comprises: acquiring a fourth output image output by the camera; and determining, according to the fourth output image, that the current strip effect is present, adjusting the exposure time to The second exposure time, or the extended exposure time, is greater than 1/100 s.
在一实施例中,延长曝光时间大于1/100s,包括:调整曝光时间至S1*G1,其中,S1表示本次调整前的曝光时间,G1表示本次调整前的感光度(gain)。In an embodiment, the extended exposure time is greater than 1/100 s, including: adjusting the exposure time to S1*G1, wherein S1 represents the exposure time before the current adjustment, and G1 represents the sensitivity before the current adjustment.
在一实施例中,提供一种CMOS图像传感器的曝光控制方法,包括:对像素阵列分别进行第一逐行曝光和第二逐行曝光以得出第一图像数据和第二图像数据,其中,所述第一逐行曝光和第二逐行曝光中相同行的曝光时间间隔半个光强变化周期的奇数倍;将第一图像数据与第二图像数据中位于相同行的图像数据进行合成以得出输出图像。在一实施例中,所述对像素阵列分别进行第一逐行曝光和第二逐行曝光以得出第一图像数据和第二图像数据的步骤包括:对像素阵列进行第一逐行曝光以得出第一图像数据;采用与第一逐行曝光相同的曝光顺序对像素阵列进行第二逐行曝光以得出第二图像数据;所述第一逐行曝光的起始时间与第二逐行曝光的起始时间间隔半个光强变化周期的奇数倍。In an embodiment, an exposure control method for a CMOS image sensor includes: performing a first progressive exposure and a second progressive exposure on a pixel array to obtain first image data and second image data, wherein The exposure time interval of the same row in the first progressive exposure and the second progressive exposure is an odd multiple of a half intensity variation period; the first image data is combined with the image data located in the same row in the second image data to The output image is derived. In an embodiment, the step of respectively performing the first progressive exposure and the second progressive exposure on the pixel array to obtain the first image data and the second image data comprises: performing a first row-by-line exposure on the pixel array to Deriving first image data; performing a second progressive exposure on the pixel array in the same exposure sequence as the first progressive exposure to obtain second image data; a start time of the first progressive exposure and a second The start time interval of the line exposure is an odd multiple of half the intensity change period.
上述参考文件的技术方案解决条纹问题存在有如下缺陷:The technical solution of the above reference file solves the stripe problem and has the following defects:
1.需要传感器sensor精确的曝光同步控制,成本工艺增加,可行性不佳。1. The sensor sensor needs precise exposure synchronization control, the cost process is increased, and the feasibility is not good.
2.目前量产sensor无可用产品,必须有更加现实的解决方案。2. At present, there is no usable product for mass production sensor, and there must be a more realistic solution.
为解决相关技术中运动摄影需要更短的曝光时间,而更短的曝光时间在低频交流电光源下图像出现条带的矛盾,来实现自动识别光源,并在无条带光源环境下得到更好的运动图片效果,本发明实施例方法步骤如下:In order to solve the related art, the short exposure time is required for the motion photography, and the shorter exposure time has the contradiction of the strips in the image under the low frequency alternating current light source, thereby realizing the automatic identification of the light source and obtaining better in the environment without the strip light source. The motion picture effect, the method steps of the embodiment of the present invention are as follows:
步骤1.识别光源是否会引起条带效应。Step 1. Identify if the light source will cause a banding effect.
步骤2.针对上述判断结果来决定是否有缩短曝光时间的限制Step 2. Determine whether there is a limit to shorten the exposure time for the above judgment result.
步骤3.根据步骤2,如果图像不产生条带的光源场景,缩短曝光时间,无条带效应限制曝光时间以拍出更好的照片。Step 3. According to step 2, if the image does not produce a stripe light source scene, shorten the exposure time, and no banding effect limits the exposure time to take a better picture.
另外第3步中,根据步骤2,如果是50Hz或60Hz场景,缩短曝光时间,曝光时间必须为1/100s或1/120s的整数倍。In addition, in step 3, according to step 2, if it is a 50 Hz or 60 Hz scene, the exposure time is shortened, and the exposure time must be an integral multiple of 1/100 s or 1/120 s.
另外以一种实现方法包括以下步骤:In addition, an implementation method includes the following steps:
步骤1.根据拍摄场景使用尽量短的曝光时间成像Step 1. Use the shortest exposure time to image according to the shooting scene
步骤2.判断在此曝光时间条件下,图像是否存在条带效应Step 2. Determine whether the image has a banding effect under this exposure time condition.
步骤3.根据步骤2,如果图像不产生条带效应维持此曝光时间成像Step 3. According to step 2, if the image does not produce a banding effect, maintain this exposure time imaging
步骤4.根据步骤2,如果图像产生条带效应延长曝光时间。有条件情况下尝试延长曝光时间分别到1/100s或1/120s的整数倍,看是否存在条带现象,如果其中一个曝光时间使得图像不存在条带效应,则选择相应曝光时间成像。Step 4. According to step 2, if the image produces a banding effect, the exposure time is extended. Under certain conditions, try to extend the exposure time to an integral multiple of 1/100s or 1/120s respectively to see if there is a banding phenomenon. If one of the exposure times causes the image to have no banding effect, select the corresponding exposure time to image.
本发明实施例可以应用于室外室内场景,包含室内外自然人工光源环境。人工光源环境下,可以是各种类型灯光,例如:日光灯、白炽灯、400W金卤灯、LED大功率节能灯、高频无极灯、T5节能灯球场排灯、螺旋型U型大功率节能灯、6U-60W高频节能灯,这些灯光可能是直流电源供电,无发光物闪烁,可能是高频的灯光,也可能直接用50hz,60hz直接供电,有明显周期性。The embodiments of the present invention can be applied to an outdoor indoor scene, including an indoor and outdoor natural artificial light source environment. In the artificial light source environment, it can be various types of lights, such as: fluorescent lamp, incandescent lamp, 400W metal halide lamp, LED high-power energy-saving lamp, high-frequency electrodeless lamp, T5 energy-saving lamp stadium row lamp, spiral U-shaped high-power energy-saving lamp 6U-60W high-frequency energy-saving lamps, these lights may be powered by DC power, no illuminating lights, may be high-frequency lights, or directly powered by 50hz, 60hz, with obvious periodicity.
图6是本发明实施例的图像传感器的示意图,如图6所示,包括以下部分:6 is a schematic diagram of an image sensor according to an embodiment of the present invention, as shown in FIG. 6, including the following parts:
摄像头模组包含的sensor是图像的输入单元,利用光电转换原理把图像光信号转换为电信号,传输给后端处理。相关技术中的手机上采用的sensor是cmos sensor,采用行曝光方式,一帧中每行曝光的起始时间是不同的。The sensor included in the camera module is an input unit of the image, and the image optical signal is converted into an electrical signal by the photoelectric conversion principle, and transmitted to the back end processing. The sensor used in the mobile phone of the related art is a CMOS sensor, which adopts a line exposure mode, and the start time of each line of exposure in one frame is different.
图像处理器负责接收模组输入的原始图像信息,通过各种raw域和yuv域上的图像矫正和颜色矫正等模块的工作,原始图像处理为和人眼观看时表现基本一致的图像。不同的图像处理器会有稍微的差别。The image processor is responsible for receiving the original image information input by the module, and working through the modules of image correction and color correction on various raw fields and yuv fields, and the original image processing is an image that is substantially consistent with the human eye. Different image processors will have a slight difference.
条带效应检测模块,负责检测光源的类型,识别出当前场景光源是否会引起条带效应,如:环境光源为50hz的光源,则输出结果是50hz光源, 如果环境光源是60hz光源,则输出结果是60hz光源,如其他如直流无闪烁光源,则输出结果是无闪烁光源。The strip effect detection module is responsible for detecting the type of the light source and identifying whether the current scene light source will cause a banding effect. For example, if the ambient light source is a 50 hz light source, the output result is a 50 hz light source, and if the ambient light source is a 60 hz light source, the output result is It is a 60hz light source. If other sources such as DC flicker-free light source, the output is a flicker-free light source.
控制单元根据条带效应检测模块的结果控制摄像头senor采用不同的曝光时间,例如条带效应检测模块的结果为50hz光源。则修改当前曝光时间为10ms的整数倍。如结果为直流无闪烁光源,缩短曝光时间,例如在当前曝光时间基础上缩短为1/2或如果曝光时间长于5ms就改为5ms。The control unit controls the camera senor to adopt different exposure times according to the result of the strip effect detection module. For example, the result of the strip effect detection module is a 50 hz light source. Then modify the current exposure time to an integral multiple of 10ms. If the result is a DC flicker-free light source, the exposure time is shortened, for example, shortened to 1/2 based on the current exposure time or changed to 5 ms if the exposure time is longer than 5 ms.
图7是本发明实施例的减少拍摄照片模糊的方法流程图,如图7所示,包括以下步骤:FIG. 7 is a flowchart of a method for reducing blurring of a photograph taken according to an embodiment of the present invention. As shown in FIG. 7, the method includes the following steps:
步骤S701:用户打开摄像头。Step S701: The user turns on the camera.
步骤S702:摄像头模组(sensor)输出图像。Step S702: The camera module (sensor) outputs an image.
步骤S703:条带效应检查。Step S703: Striping effect check.
负责检测光源的类型,识别出当前场景光源是否会引起条带效应,如:环境光源为50hz的光源,则输出结果是50hz光源,如果环境光源是60hz光源,则输出结果是60hz光源,如其他如直流无闪烁光源,则输出结果是无闪烁光源。Responsible for detecting the type of light source, identifying whether the current scene light source will cause banding effect. For example, if the ambient light source is a 50hz light source, the output result is a 50hz light source. If the ambient light source is a 60hz light source, the output result is a 60hz light source, such as other If the DC has no flickering light source, the output is a flicker free light source.
判断S704:判断是否存在条带效应,如果存在执行步骤705;否则,执行步骤706。Decision S704: determining whether there is a striping effect, if there is an execution step 705; otherwise, performing step 706.
判断当前光源环境下sensor输出的图像是否可能存在条带效应。It is judged whether the image output by the sensor under the current light source environment may have a banding effect.
步骤S705:更改曝光时间为光源半周期的整数倍。Step S705: The exposure time is changed to be an integral multiple of the half cycle of the light source.
如果可能存在带效应则根据不同光源特性修改曝光时间,如结果为50hz光源。而当前曝光时间不是10ms的整数倍,则修改当前曝光时间为10ms的整数倍。如结果为60hz光源,也是类似处理。If there is a possible band effect, the exposure time is modified according to different light source characteristics, such as a 50hz light source. If the current exposure time is not an integer multiple of 10 ms, the current exposure time is modified to be an integer multiple of 10 ms. If the result is a 60hz light source, it is similarly processed.
步骤S706:根据策略缩短曝光时间。Step S706: shortening the exposure time according to the strategy.
如果不可能存在带效应的光源,如为直流无闪烁光源,根据策略缩短曝光时间,策略可以是简单的改变曝光时间的策略,例如在当前曝光时间基础上缩短为1/2或如果曝光时间长于5ms就改为5ms。也可以相对复杂的 策略。If it is not possible to have a light source with a effect, such as a DC flicker-free light source, the strategy can be a simple strategy to change the exposure time according to the strategy to shorten the exposure time, for example, shortening to 1/2 based on the current exposure time or if the exposure time is longer than 5ms will be changed to 5ms. It can also be a relatively complex strategy.
其中曝光时间修改的策略可以是根据环境亮度来选择改变,图8是本发明实施例的修改曝光时间的策略的流程图,如图8所示,包括以下步骤:The strategy for adjusting the exposure time may be to select a change according to the ambient brightness. FIG. 8 is a flowchart of a strategy for modifying the exposure time according to the embodiment of the present invention. As shown in FIG. 8, the method includes the following steps:
步骤1,得到当前亮度。In step 1, the current brightness is obtained.
在实际应用中,可以通过当前的曝光表的exposure index表征当前亮度信息,In practical applications, the current brightness information can be characterized by the exposure index of the current exposure table.
步骤2,转换为曝光时间及摄像头模组的感光度。Step 2 converts to the exposure time and the sensitivity of the camera module.
这里,通过exposure index可以对应的得出当前使用的曝光时间和摄像头模组的感光度(sensor gain)。Here, the exposure time and the sensor gain of the camera module can be correspondingly obtained through the exposure index.
步骤3,根据感光度值和曝光时间确认最终转换后的曝光时间。In step 3, the exposure time after the final conversion is confirmed based on the sensitivity value and the exposure time.
这里,根据gain值和曝光时间确认最终转换后的曝光时间。对sensor来说相同照度场景下,不同的曝光时间和gain的搭配成像噪声会有差异,可以在曝光时间和gain采用一定规则来选择权衡,如曝光时间0.01s时gain最大的可以设置到6倍,曝光时间为0.005s时,gain最大可以设置为4倍等。Here, the exposure time after the final conversion is confirmed based on the gain value and the exposure time. For the same illumination scene of sensor, different exposure time and gain matching imaging noise will be different. You can choose a trade-off between exposure time and gain. For example, when the exposure time is 0.01s, the maximum gain can be set to 6 times. When the exposure time is 0.005 s, the gain can be set to 4 times or so.
曝光时间修改的策略也可以是根据运动物体检测来选择改变,图9是根据本发明优选实施例的依据运动检测确定曝光时间的方法一的示意图,如图9所示,包括以下步骤:The exposure time modification strategy may also be to select a change according to the moving object detection. FIG. 9 is a schematic diagram of a first method for determining an exposure time according to motion detection according to a preferred embodiment of the present invention. As shown in FIG. 9, the method includes the following steps:
步骤1,进行运动检测,并判断是否存在运动,如果是,执行步骤3,否则执行步骤2。In step 1, the motion detection is performed, and it is determined whether there is motion, and if so, step 3 is performed, otherwise step 2 is performed.
对当前场景进行运动检测,运动检测算法可以采用相关技术中的帧间图像比较法,简单计算两帧间像素差异,或进行帧间特征点匹配识别出帧间物体移动信息,是否存在运动。For the current scene motion detection, the motion detection algorithm can use the inter-frame image comparison method in the related art to simply calculate the pixel difference between two frames, or perform inter-frame feature point matching to identify the inter-frame object movement information, and whether there is motion.
步骤2,保持曝光时间不变。Step 2, keep the exposure time unchanged.
步骤3,缩短曝光时间。Step 3, shorten the exposure time.
这里,如果存在运动,则缩短曝光时间增大gain,以达到减少图像运 动模糊效应。Here, if there is motion, the exposure time is increased by gain to reduce the image motion blur effect.
图10是本发明实施例的依据运动检测确定曝光时间的方法流程示意图,如图10所示,方法流程包括以下步骤:FIG. 10 is a schematic flowchart of a method for determining an exposure time according to motion detection according to an embodiment of the present invention. As shown in FIG. 10, the method flow includes the following steps:
步骤1,根据当前场景选择尽量短的曝光时间成像。Step 1. Select the shortest exposure time imaging according to the current scene.
在检测到当前场景存在运动的情况下,使用尽量短的曝光时间成像。In the case where motion is detected in the current scene, imaging is performed using the shortest exposure time.
步骤2,判断是否存在条带,如果存在,执行步骤4;否则执行步骤3。In step 2, it is determined whether there is a strip, if it exists, step 4 is performed; otherwise, step 3 is performed.
判断在此曝光时间条件下,图像是否存在条带效应。It is judged whether or not the image has a banding effect under this exposure time condition.
步骤3,保持曝光时间不变。Step 3, keep the exposure time unchanged.
如果图像不产生条带效应维持此曝光时间成像。This exposure time is imaged if the image does not produce a banding effect.
步骤4,根据感光度值,延长曝光时间到1/120s。Step 4, according to the sensitivity value, extend the exposure time to 1/120 s.
如果图像产生条带效应维持此曝光时间成像。看是否有条件下尝试延长曝光时间到1/120s,方法如下:If the image produces a banding effect, this exposure time is maintained. See if there are conditions to try to extend the exposure time to 1/120s, as follows:
当前曝光时间S1,当前gain为G1.Current exposure time S1, current gain is G1.
K1=(1/120)/S1K1=(1/120)/S1
比较K1和G1,如果G1>=K1,则说明有条件下尝试延长曝光时间到1/120s,gain值设置为G1/K1.Compare K1 and G1. If G1>=K1, it means that the exposure time is extended to 1/120s under conditions, and the gain value is set to G1/K1.
步骤5,判断是否存在条带,如果存在,执行步骤6;否则,保持曝光时间1/120s的整数倍不变。In step 5, it is judged whether there is a strip, and if it is, step 6 is performed; otherwise, the integral time of the exposure time of 1/120 s is kept unchanged.
根据步骤4,尝试延长曝光时间到1/120s,判断在此曝光时间条件下,图像是否存在条带效应,如果图像不产生条带效应维持此曝光时间成像;According to step 4, try to extend the exposure time to 1/120s, and judge whether the image has a banding effect under the exposure time condition, if the image does not produce a banding effect to maintain the exposure time imaging;
步骤6,延长曝光时间到1/100s。Step 6. Extend the exposure time to 1/100s.
根据步骤4,如果图像产生条带效应看是否有条件下尝试延长曝光时间到1/100s,方法如下:According to step 4, if the image produces a striping effect to see if there is a condition to try to extend the exposure time to 1/100s, the method is as follows:
当前曝光时间S1,当前gain为G1.Current exposure time S1, current gain is G1.
K1=(1/100)/S1K1=(1/100)/S1
比较K1和G1,如果G1>=K1,则说明有条件下尝试延长曝光时间到 1/100s,gain值设置为G1/K1。Comparing K1 and G1, if G1>=K1, it means that under the condition, try to extend the exposure time to 1/100s, and the gain value is set to G1/K1.
步骤7,判断是否存在条带,如果存在,执行步骤8;否则,保持曝光时间1/120s的整数倍不变。In step 7, it is judged whether there is a strip, and if it is, step 8 is performed; otherwise, the integral time of the exposure time of 1/120 s is kept unchanged.
根据步骤6,延长曝光时间到1/100s,判断在此曝光时间条件下,图像是否存在条带效应,如果图像不产生条带效应维持此曝光时间成像。According to step 6, the exposure time is extended to 1/100 s, and it is judged whether the image has a banding effect under the exposure time condition, and the image is maintained if the image does not produce a banding effect.
步骤8,使用初始曝光时间或尽量长的曝光时间。Step 8. Use the initial exposure time or the exposure time as long as possible.
根据步骤6,延长曝光时间到1/100s,如果图像产生条带效则可以维持最初始的曝光时间成像,也可以采用尽量长的曝光时间使条带banding现象尽量不明显。方法如下:当前曝光时间S1,当前gain为G1.,改变gain值为1倍gain,曝光时间延长为S1*G1。According to step 6, the exposure time is extended to 1/100 s. If the image is strip effect, the initial exposure time imaging can be maintained, or the exposure time can be as long as possible to make the banding phenomenon as unobtrusive as possible. The method is as follows: the current exposure time S1, the current gain is G1., the change gain value is 1 times gain, and the exposure time is extended to S1*G1.
采用上述技术方案,既能保证在无条带效应可能的场景下,提高曝光时间,使得拍摄的运动物体更加清晰,减少运动模糊,又能在有条带效应的场景下,保证最大可能不产生条带效应。By adopting the above technical solution, it is possible to ensure that the exposure time is improved in the scene without the banding effect, the moving object to be photographed is more clear, the motion blur is reduced, and the maximum possible possibility is not generated in the scene with the banding effect. Striping effect.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明实施例的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如只读存储器(Read-Only Memory,ROM)/随机存取存储器(Random Access Memory,RAM)、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本发明实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in a form of a software product stored in a storage medium (such as a read-only memory (Read- Only Memory, ROM) / Random Access Memory (RAM), disk, CD-ROM, including a number of instructions to enable a terminal device (can be a mobile phone, computer, server, or network device, etc.) The method described in the embodiments of the present invention.
本发明实施例还提供了一种拍摄装置,该装置配置为实现上述实施例,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软 件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。The embodiment of the invention further provides a camera device, which is configured to implement the above-mentioned embodiments, and details have been omitted for description. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and conceivable.
在一实施例中,本发明实施例的拍摄装置,包括:In an embodiment, the photographing apparatus of the embodiment of the invention includes:
确定模块,配置为确定摄像头拍摄画面存在运动的情况下,缩短曝光时间;Determining a module configured to reduce exposure time in the case where there is motion in the camera shooting screen;
获取模块,配置为获取缩短所述曝光时间后的摄像头当前输出的输出图像;Obtaining a module configured to obtain an output image of a current output of the camera after shortening the exposure time;
调整模块,配置为依据所述输出图像确定,在当前拍摄场景下进行拍摄是否存在条带效应,依据检测结果调整曝光时间;The adjusting module is configured to determine, according to the output image, whether there is a banding effect in the current shooting scene, and adjust the exposure time according to the detection result;
执行模块,配置为使用调整后的曝光时间进行拍摄。The execution module is configured to shoot with the adjusted exposure time.
通过上述步骤,确定摄像头在拍摄运动画面,则缩短曝光时间,获取缩短曝光时间后的当前输出的输出图像,依据当前图像确定在此种场景下拍摄是否会引起条带效应,依据检测结果实时调整曝光时间,使得拍摄的图像尽可能的避免条带效应。采用上述技术方案,解决了相关技术中图像传感器曝光时可能出现条带,影响图像效果的问题,通过调整曝光时间避免了图像中的条带效应,保证了图像质量。Through the above steps, it is determined that the camera captures the motion picture, the exposure time is shortened, the output image of the current output after the exposure time is shortened, and whether the shooting effect is caused in the scene according to the current image is determined, and the detection result is adjusted in real time according to the detection result. The exposure time allows the captured image to avoid the banding effect as much as possible. The above technical solution solves the problem that the image sensor may appear in the related art when the image sensor is exposed, affecting the image effect, and the striping effect in the image is avoided by adjusting the exposure time to ensure the image quality.
需要补充的是,由于拍摄场景灯光的变化,导致拍摄图像出现条纹的情况,可以称为条带效应。It should be added that the striping effect of the captured image due to the change of the lighting of the shooting scene may be referred to as a striping effect.
在一实施例中,所述调整模块,还配置为依据所述输出图像确定当前拍摄环境中的光源类型;依据所述光源类型,确定当前拍摄场景下进行拍摄是否存在条带效应。In an embodiment, the adjusting module is further configured to determine, according to the output image, a light source type in a current shooting environment; and determine, according to the light source type, whether a striping effect is performed in the current shooting scene.
在一实施例中,所述调整模块依据检测结果调整曝光时间,包括以下之一:确定当前拍摄场景的光源类型为50Hz或60Hz光源的情况下,调整所述曝光时间为半周期的整数倍;确定当前拍摄场景的光源类型为直流无闪烁光源的情况下,缩短所述曝光时间。In an embodiment, the adjusting module adjusts the exposure time according to the detection result, including one of the following: determining that the light source type of the current shooting scene is a 50 Hz or 60 Hz light source, and adjusting the exposure time to be an integer multiple of a half cycle; In the case where it is determined that the light source type of the current shooting scene is a DC flicker-free light source, the exposure time is shortened.
在一实施例中,所述调整模块依据检测结果调整曝光时间包括以下之一:在确定所述输出图像存在条带效应的情况下,增加曝光时间;在确定 所述输出图像不存在条带效应的情况下,减少曝光时间。In an embodiment, the adjusting module adjusts the exposure time according to the detection result, including one of: increasing the exposure time in the case of determining that the output image has a striping effect; determining that the output image does not have a striping effect In case of reduction, the exposure time is reduced.
在一实施例中,确定摄像头拍摄画面存在运动的情况下,缩短曝光时间之后,所述确定模块,还配置为获取摄像头输出的第二输出图像;依据所述第二输出图像确定当前存在条带效应的情况下,延长当前的第二曝光时间至1/120s,其中,所述第二曝光时间小于1/120s。In an embodiment, in a case where it is determined that there is motion in the camera shooting screen, after the exposure time is shortened, the determining module is further configured to acquire a second output image output by the camera; and determine a current existing strip according to the second output image. In the case of an effect, the current second exposure time is extended to 1/120 s, wherein the second exposure time is less than 1/120 s.
在一实施例中,延长所述曝光时间至1/120s之前,所述确定模块,还配置为通过以下方式确定是否有条件延长曝光时间至1/120s:获取K1=(1/120)/S1;在G1>=K1的情况下,确定有条件延长曝光时间至1/120s;其中,S1表示当前曝光时间,G1表示当前感光度gain。In an embodiment, before the exposing the exposure time to 1/120 s, the determining module is further configured to determine whether to conditionally extend the exposure time to 1/120 s by: obtaining K1=(1/120)/S1 In the case of G1>=K1, it is determined that the exposure time is conditionally extended to 1/120 s; wherein S1 represents the current exposure time and G1 represents the current sensitivity gain.
在一实施例中,延长所述曝光时间至1/120s之后,所述确定模块,还配置为获取摄像头输出的第三输出图像;依据所述第三输出图像确定当前存在条带效应的情况下,延长曝光时间至1/100s。In an embodiment, after the exposing the exposure time to 1/120 s, the determining module is further configured to acquire a third output image output by the camera; and determine, in the case that the strip effect is currently present, according to the third output image. , extend the exposure time to 1/100s.
在一实施例中,延长曝光时间至1/100s之前,所述确定模块,还配置为通过以下方式确定是否有条件延长曝光时间至1/100s:获取K1=(1/100)/S1;在G1>=K1的情况下,确定有条件延长曝光时间至1/100s;其中,S1表示当前曝光时间,G1表示当前感光度gain。In an embodiment, before the exposure time is extended to 1/100 s, the determining module is further configured to determine whether to conditionally extend the exposure time to 1/100 s by: obtaining K1=(1/100)/S1; In the case of G1>=K1, it is determined that the exposure time is conditionally extended to 1/100 s; wherein, S1 represents the current exposure time, and G1 represents the current sensitivity gain.
在一实施例中,延长所述曝光时间至1/100s之后,所述确定模块,还配置为获取摄像头输出的第四输出图像;依据所述第四输出图像确定当前存在条带效应的情况下,调整曝光时间为所述第二曝光时间,或者延长曝光时间大于1/100s。In an embodiment, after the exposing the exposure time to 1/100 s, the determining module is further configured to acquire a fourth output image output by the camera; and determining, according to the fourth output image, that the current banding effect exists The exposure time is adjusted to be the second exposure time, or the exposure time is extended by more than 1/100 s.
在一实施例中,所述确定模块,还配置为调整曝光时间至S1*G1,其中,S1表示本次调整前的曝光时间,G1表示本次调整前的感光度gain。In an embodiment, the determining module is further configured to adjust the exposure time to S1*G1, wherein S1 represents an exposure time before the current adjustment, and G1 represents a sensitivity gain before the current adjustment.
需要说明的是,上述各个模块是可以通过软件或硬件来实现的,对于后者,可以通过以下方式实现,但不限于此:上述模块均位于同一处理器中;或者,上述各个模块以任意组合的形式分别位于不同的处理器中。It should be noted that each of the above modules may be implemented by software or hardware. For the latter, the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination. The forms are located in different processors.
本发明实施例还提供了一种存储介质,所述存储介质中存储有计算机程序,其中,所述计算机程序被设置为运行时执行上述实施例任一项中所述的拍摄方法。The embodiment of the present invention further provides a storage medium, wherein the storage medium stores a computer program, wherein the computer program is configured to execute the photographing method described in any one of the above embodiments.
本发明实施例还提供了一种电子装置,包括存储器和处理器,其中,所述存储器中存储有计算机程序,所述处理器被设置为运行所述计算机程序以执行上述实施例任一项中所述的拍摄方法。An embodiment of the present invention further provides an electronic device including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform any of the above embodiments. The shooting method described.
显然,本领域的技术人员应该明白,上述的本发明实施例的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,在一实施例中,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。Obviously, those skilled in the art should understand that the above modules or steps of the embodiments of the present invention can be implemented by a general computing device, which can be concentrated on a single computing device or distributed in multiple computing devices. On a network, in an embodiment, they may be implemented by program code executable by a computing device such that they may be stored in a storage device by a computing device and, in some cases, may be different The steps shown or described herein are performed sequentially, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims (13)

  1. 一种拍摄方法,包括:A method of shooting, including:
    确定摄像头拍摄画面存在运动的情况下,缩短曝光时间;When it is determined that there is motion in the camera shooting screen, the exposure time is shortened;
    获取缩短所述曝光时间后的摄像头当前输出的输出图像;Obtaining an output image of the current output of the camera after shortening the exposure time;
    依据所述输出图像确定,在当前拍摄场景下进行拍摄是否存在条带效应,依据检测结果调整曝光时间;Determining, according to the output image, whether there is a banding effect in the current shooting scene, and adjusting the exposure time according to the detection result;
    使用调整后的曝光时间进行拍摄。Shoot with the adjusted exposure time.
  2. 根据权利要求1所述的方法,其中,依据所述输出图像确定,在当前拍摄场景下进行拍摄是否存在条带效应,包括:The method according to claim 1, wherein determining whether there is a banding effect in the current shooting scene according to the output image comprises:
    依据所述输出图像确定当前拍摄环境中的光源类型;Determining a type of light source in a current shooting environment according to the output image;
    依据所述光源类型,确定当前拍摄场景下进行拍摄是否存在条带效应。According to the type of the light source, it is determined whether there is a banding effect when shooting in the current shooting scene.
  3. 根据权利要求2所述的方法,其中,依据检测结果调整曝光时间,包括以下之一:The method according to claim 2, wherein the exposure time is adjusted according to the detection result, including one of the following:
    确定当前拍摄场景的光源类型为50Hz或60Hz光源的情况下,调整所述曝光时间为半周期的整数倍;When it is determined that the light source type of the current shooting scene is a 50 Hz or 60 Hz light source, the exposure time is adjusted to be an integral multiple of a half cycle;
    确定当前拍摄场景的光源类型为直流无闪烁光源的情况下,缩短所述曝光时间。In the case where it is determined that the light source type of the current shooting scene is a DC flicker-free light source, the exposure time is shortened.
  4. 根据权利要求1所述的方法,其中,依据检测结果调整曝光时间包括以下之一:The method according to claim 1, wherein the adjusting the exposure time according to the detection result comprises one of the following:
    在确定所述输出图像存在条带效应的情况下,增加曝光时间;In the case of determining that the output image has a striping effect, increasing the exposure time;
    在确定所述输出图像不存在条带效应的情况下,减少曝光时间。In the case where it is determined that the output image does not have a banding effect, the exposure time is reduced.
  5. 根据权利要求1所述的方法,其中,确定摄像头拍摄画面存在运动的情况下,缩短曝光时间之后,所述方法还包括:The method according to claim 1, wherein, after determining that there is motion in the camera shooting screen, after the exposure time is shortened, the method further includes:
    获取摄像头输出的第二输出图像;Obtaining a second output image of the camera output;
    依据所述第二输出图像确定当前存在条带效应的情况下,延长当前的 第二曝光时间至1/120s,其中,所述第二曝光时间小于1/120s。The current second exposure time is extended to 1/120 s in the case where it is determined that the current band effect is present according to the second output image, wherein the second exposure time is less than 1/120 s.
  6. 根据权利要求5所述的方法,其中,延长所述曝光时间至1/120s之前,所述方法还包括:通过以下方式确定是否有条件延长曝光时间至1/120s:The method according to claim 5, wherein before the exposing the exposure time to 1/120 s, the method further comprises: determining whether the exposure time is extended to 1/120 s by the following means:
    获取K1=(1/120)/S1;Get K1=(1/120)/S1;
    在G1>=K1的情况下,确定有条件延长曝光时间至1/120s;In the case of G1>=K1, it is determined that the exposure time is extended to 1/120 s;
    其中,S1表示当前曝光时间,G1表示当前感光度。Among them, S1 represents the current exposure time, and G1 represents the current sensitivity.
  7. 根据权利要求5所述的方法,其中,延长所述曝光时间至1/120s之后,所述方法还包括:The method of claim 5, wherein after the exposing the exposure time to 1/120 s, the method further comprises:
    获取摄像头输出的第三输出图像;Obtaining a third output image of the camera output;
    依据所述第三输出图像确定当前存在条带效应的情况下,延长曝光时间至1/100s。In the case where it is determined that the current banding effect exists according to the third output image, the exposure time is extended to 1/100 s.
  8. 根据权利要求7所述的方法,其中,延长曝光时间至1/100s之前,所述方法还包括:通过以下方式确定是否有条件延长曝光时间至1/100s:The method according to claim 7, wherein the method further comprises: determining whether the condition is extended by the following method to 1/100 s by extending the exposure time to 1/100 s:
    获取K1=(1/100)/S1;Get K1=(1/100)/S1;
    在G1>=K1的情况下,确定有条件延长曝光时间至1/100s;In the case of G1>=K1, it is determined that the exposure time is extended to 1/100 s;
    其中,S1表示当前曝光时间,G1表示当前感光度。Among them, S1 represents the current exposure time, and G1 represents the current sensitivity.
  9. 根据权利要求7所述的方法,其中,延长所述曝光时间至1/100s之后,所述方法还包括:The method of claim 7, wherein after extending the exposure time to 1/100 s, the method further comprises:
    获取摄像头输出的第四输出图像;Obtaining a fourth output image of the camera output;
    依据所述第四输出图像确定当前存在条带效应的情况下,调整曝光时间为所述第二曝光时间,或者延长曝光时间大于1/100s。In the case where it is determined that the strip effect is currently present according to the fourth output image, the exposure time is adjusted to be the second exposure time, or the exposure time is extended by more than 1/100 s.
  10. 根据权利要求7所述的方法,其中,延长曝光时间大于1/100s,包括:The method of claim 7 wherein extending the exposure time by more than 1/100 s comprises:
    调整曝光时间至S1*G1,其中,S1表示本次调整前的曝光时间,G1表示本次调整前的感光度。Adjust the exposure time to S1*G1, where S1 represents the exposure time before this adjustment, and G1 represents the sensitivity before this adjustment.
  11. 一种拍摄装置,包括:A photographing device comprising:
    确定模块,配置为确定摄像头拍摄画面存在运动的情况下,缩短曝光时间;Determining a module configured to reduce exposure time in the case where there is motion in the camera shooting screen;
    获取模块,配置为获取缩短所述曝光时间后的摄像头当前输出的输出图像;Obtaining a module configured to obtain an output image of a current output of the camera after shortening the exposure time;
    调整模块,配置为依据所述输出图像确定,在当前拍摄场景下进行拍摄是否存在条带效应,依据检测结果调整曝光时间;The adjusting module is configured to determine, according to the output image, whether there is a banding effect in the current shooting scene, and adjust the exposure time according to the detection result;
    执行模块,配置为使用调整后的曝光时间进行拍摄。The execution module is configured to shoot with the adjusted exposure time.
  12. 一种存储介质,所述存储介质中存储有计算机程序,其中,所述计算机程序被设置为运行时执行所述权利要求1至10任一项中所述的方法。A storage medium having stored therein a computer program, wherein the computer program is arranged to execute the method of any one of claims 1 to 10 at runtime.
  13. 一种电子装置,包括存储器和处理器,其中,所述存储器中存储有计算机程序,所述处理器被设置为运行所述计算机程序以执行所述权利要求1至10任一项中所述的方法。An electronic device comprising a memory and a processor, wherein the memory stores a computer program, the processor being arranged to execute the computer program to perform the method of any one of claims 1 to 10 method.
PCT/CN2019/077008 2018-03-13 2019-03-05 Image capture method, device and storage medium WO2019174494A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810206490.9A CN108462837B (en) 2018-03-13 2018-03-13 Shooting method and device
CN201810206490.9 2018-03-13

Publications (1)

Publication Number Publication Date
WO2019174494A1 true WO2019174494A1 (en) 2019-09-19

Family

ID=63216879

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/077008 WO2019174494A1 (en) 2018-03-13 2019-03-05 Image capture method, device and storage medium

Country Status (2)

Country Link
CN (1) CN108462837B (en)
WO (1) WO2019174494A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108462837B (en) * 2018-03-13 2022-06-21 中兴通讯股份有限公司 Shooting method and device
CN109120863B (en) * 2018-10-23 2021-01-01 Oppo广东移动通信有限公司 Shooting method, shooting device, storage medium and mobile terminal
CN109547704A (en) * 2018-12-29 2019-03-29 与德科技有限公司 A kind of photographic method, device, terminal and the storage medium of anti-splashette
CN110636229B (en) * 2019-10-24 2021-06-22 重庆紫光华山智安科技有限公司 Image light supplement adjusting method and device and electronic equipment
CN110784658B (en) * 2019-10-31 2021-12-07 Oppo广东移动通信有限公司 Exposure control method, device, storage medium and terminal equipment
CN110855901B (en) * 2019-11-28 2021-06-18 维沃移动通信有限公司 Camera exposure time control method and electronic equipment
CN112565637B (en) * 2020-11-20 2022-07-29 中国航空工业集团公司洛阳电光设备研究所 Method for removing stripe noise under low illumination in monochromatic sCMOS camera
CN112738414B (en) * 2021-04-06 2021-06-29 荣耀终端有限公司 Photographing method, electronic device and storage medium
CN113163128B (en) * 2021-05-08 2023-09-12 维沃移动通信(杭州)有限公司 Image exposure method and electronic device
CN117692786A (en) * 2024-02-01 2024-03-12 荣耀终端有限公司 Shooting method, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105657288A (en) * 2015-10-28 2016-06-08 乐视移动智能信息技术(北京)有限公司 Camera shooting exposure processing method and terminal
CN105959590A (en) * 2016-05-27 2016-09-21 广东欧珀移动通信有限公司 Optical interference resisting photographing method and device, and intelligent terminal
CN106131445A (en) * 2016-07-08 2016-11-16 深圳天珑无线科技有限公司 A kind of image pickup method and device
CN107635101A (en) * 2017-10-27 2018-01-26 广东欧珀移动通信有限公司 Image pickup method, device, storage medium and electronic equipment
CN108462837A (en) * 2018-03-13 2018-08-28 中兴通讯股份有限公司 Image pickup method and device

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3826904B2 (en) * 2003-07-08 2006-09-27 ソニー株式会社 Imaging apparatus and flicker reduction method
JP4335849B2 (en) * 2005-06-13 2009-09-30 富士通マイクロエレクトロニクス株式会社 Imaging device capable of flicker detection
JP5106283B2 (en) * 2008-07-15 2012-12-26 三洋電機株式会社 Video camera
JP6370134B2 (en) * 2014-07-02 2018-08-08 キヤノン株式会社 Imaging device, control method thereof, and control program
JP6460829B2 (en) * 2015-02-20 2019-01-30 キヤノン株式会社 IMAGING DEVICE, ELECTRONIC DEVICE, AND METHOD FOR CALCULATION OF LIGHT CHANGE CHARACTERISTICS
JP6300118B2 (en) * 2015-09-24 2018-03-28 カシオ計算機株式会社 Imaging apparatus, flicker detection method, and program
KR102615091B1 (en) * 2016-01-13 2023-12-19 삼성전자주식회사 Photographing apparatus and method for operating thereof
CN109247067B (en) * 2016-06-08 2021-02-12 华为技术有限公司 Image processing apparatus and image processing method
CN107395997A (en) * 2017-08-18 2017-11-24 维沃移动通信有限公司 A kind of image pickup method and mobile terminal
KR20200016559A (en) * 2018-08-07 2020-02-17 삼성전자주식회사 Apparatus and method for generating a moving image data including multiple sections image of the electronic device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105657288A (en) * 2015-10-28 2016-06-08 乐视移动智能信息技术(北京)有限公司 Camera shooting exposure processing method and terminal
CN105959590A (en) * 2016-05-27 2016-09-21 广东欧珀移动通信有限公司 Optical interference resisting photographing method and device, and intelligent terminal
CN106131445A (en) * 2016-07-08 2016-11-16 深圳天珑无线科技有限公司 A kind of image pickup method and device
CN107635101A (en) * 2017-10-27 2018-01-26 广东欧珀移动通信有限公司 Image pickup method, device, storage medium and electronic equipment
CN108462837A (en) * 2018-03-13 2018-08-28 中兴通讯股份有限公司 Image pickup method and device

Also Published As

Publication number Publication date
CN108462837B (en) 2022-06-21
CN108462837A (en) 2018-08-28

Similar Documents

Publication Publication Date Title
WO2019174494A1 (en) Image capture method, device and storage medium
TWI222215B (en) Driving method for solid-state imaging device and camera using the same
US9794493B2 (en) Image capturing apparatus, image capturing method, and control method
TWI242370B (en) Photographing environment determination method and image pickup device
US20110255786A1 (en) Method and apparatus for determining flicker in the illumination of a subject
TW201212644A (en) Image processing apparatus, image taking apparatus, image processing method and image processing program
US8462229B2 (en) Detection of flicker within captured imaged frames
KR20130138340A (en) White balance optimization with high dynamic range images
JP2015108778A (en) Image capturing device and control method therefor
JP2009077057A (en) Imaging apparatus, and control method for imaging apparatus
US8115860B2 (en) LED flash control
CN106131445A (en) A kind of image pickup method and device
TWI486057B (en) Image pickup device and image synthesis method thereof
CN103369252A (en) Image processing apparatus and control method therefor
JPWO2012093519A1 (en) Imaging apparatus and light emission amount control method thereof
CN116320771B (en) Shooting method and electronic equipment
JP7263626B2 (en) Reduce flickering of multiple light sources in images
US20140354859A1 (en) Automatic banding correction in an image capture device
JP2012119788A (en) Imaging device, image processing device, imaging method and image processing method
JP2010011153A (en) Imaging apparatus, imaging method and program
JP6214229B2 (en) Imaging apparatus, imaging apparatus control method, image processing apparatus, and image processing method
JP2006171315A (en) Stroboscope controller, stroboscope control program, and stroboscope control method
KR20130011201A (en) Apparatus and method for adjusting auto focus in image taking device
JP2011188186A (en) Device for calculating white balance gain
JP5118165B2 (en) Camera photographed image color correction device and portable terminal device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19767395

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26.01.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19767395

Country of ref document: EP

Kind code of ref document: A1