WO2019196009A1 - Method for detecting defective pixel of image sensor, and photography apparatus, unmanned aerial vehicle and storage medium - Google Patents

Method for detecting defective pixel of image sensor, and photography apparatus, unmanned aerial vehicle and storage medium Download PDF

Info

Publication number
WO2019196009A1
WO2019196009A1 PCT/CN2018/082502 CN2018082502W WO2019196009A1 WO 2019196009 A1 WO2019196009 A1 WO 2019196009A1 CN 2018082502 W CN2018082502 W CN 2018082502W WO 2019196009 A1 WO2019196009 A1 WO 2019196009A1
Authority
WO
WIPO (PCT)
Prior art keywords
dead
image sensor
image
point
pixel
Prior art date
Application number
PCT/CN2018/082502
Other languages
French (fr)
Chinese (zh)
Inventor
孙旭斌
白高平
杨豪
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201880017736.6A priority Critical patent/CN110463199A/en
Priority to PCT/CN2018/082502 priority patent/WO2019196009A1/en
Publication of WO2019196009A1 publication Critical patent/WO2019196009A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/81Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/68Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects

Definitions

  • Embodiments of the present application relate to a method for detecting a dead pixel of an image sensor in an imaging device, an imaging device, a drone, and a storage medium.
  • Image sensors such as CCD and CMOS of cameras and other cameras have a certain number of bad pixels.
  • the brightness values of these pixels do not reflect the captured image, which is usually called a dead pixel.
  • Static dead points are bad points that must occur under certain conditions (such as long enough exposure time and image sensor reaches a certain temperature); 2)
  • the dynamic dead point is a bad point that appears probabilistic even if certain conditions are reached (ie, the bad point appears in this photo, the next shot may be normal; in the frame of the video, the next frame may be normal; or the image sensor This power-on has been appearing all the time, and the next power-up may have been normal.)
  • the bad point brightness can also be divided into two types, that is, bright point and dark point: (1) The bright point is when the overall brightness of the photo or video is dark, the brightness value is higher than the original brightness of the image, and the image is the position. The original brightness does not have a corresponding relationship; (2) the dark point is that when the overall brightness of the photo or video is bright, the brightness value is lower than the original brightness of the image, and there is no corresponding relationship with the original brightness of the image. .
  • One is static dead pixel correction, in which static dead pixel correction is further divided into two types, namely static bright spot correction and static dark point correction.
  • Static bright spot correction Before leaving the factory, the camera lens is blacked out, and the RAW format photo of all the effective pixels of the image sensor is taken for specific exposure parameters, and then all the pixels are analyzed by software to find that the brightness is higher than the average value of the surrounding pixels. The coordinates of a certain threshold pixel, mark these pixels as bright spots, and save their coordinates. In normal photographing and recording, the value of the pixel marked as a bright spot is not used, but the value of the pixel marked as a bright point is replaced by a value obtained by calculating the value of the same kind of pixel around it;
  • Static dark spot correction Before leaving the factory, the camera shoots a RAW format photo of a specific exposure parameter against a uniform light source, and then analyzes all the pixels through software to find a pixel whose brightness is lower than the average value of the surrounding pixels. The coordinates of the pixels are marked as dark points and their coordinates are saved. In normal photographing and recording, the value of the pixel marked as a dark spot is not taken, but the value of the pixel marked as a dark dot is replaced by a value obtained by a certain calculation of the value of the same kind of pixel around it.
  • Static dead-point correction is to analyze the dead-point position under ideal test conditions (blackout the lens at the camera factory or use a high-quality uniform light plane source with fixed exposure parameters), and the coordinate position of the dead point is reliable. Therefore, it can be considered that the static dead point is "image sensor dead point".
  • Fig. 5 is a schematic diagram showing a conventional calculation method employed in static dead point correction.
  • c is a green pixel dead pixel, and there are nine pixels around c, wherein a, b, d, and e are normal green pixels, and c is a similar pixel; c is directly above and below Red pixels, the left and right are blue pixels, and c is a different type of pixel.
  • the value obtained by the above calculation for the value of the same type of pixel around the dead point c can be utilized.
  • Dynamic bad point correction is to analyze and compare the difference between each pixel and the surrounding pixels in the normal picture or video. If the surrounding pixel values are consistent and the pixel value is different, then The pixel is marked as a dead pixel. For this photo or video frame, the value of the pixel is not used, but the value of the pixel marked as a dead pixel is replaced by a value calculated by the value of the similar pixel around it. .
  • the dynamic bad point correction is to calculate the normal taken photo or video frame, the condition for finding the bad point position is not ideal (the exposure parameters of the normally taken photo or video are uncertain, and the picture content is complicated, the dynamic bad point correction is very It may leak or catch some noise points, so the dynamic dead pixels are not necessarily reliable, and the position of the pixel will not be saved. Dynamic dead-point correction detects both bright and dark spots. In the present application, the dynamic bad point is sometimes referred to as "image dead point".
  • the camera After the camera is shipped, as the usage time increases, the number of dead pixels also increases, and some pixels on the image sensor that are not originally dead pixels may also become dead pixels. These added dead pixels will be a problem for cameras.
  • the camera now generally adopts two strategies: (1) no processing, this method is usually used for lower-end cameras that do not require high image quality; (2) adding users to the camera software Cover the camera with a lens cover, etc., and do a static highlight correction procedure to eliminate the new bright spots.
  • no processing this method is usually used for lower-end cameras that do not require high image quality
  • adding users to the camera software Cover the camera with a lens cover, etc. and do a static highlight correction procedure to eliminate the new bright spots.
  • it is necessary to prepare a high-quality uniform light plane light source, so that it is difficult for ordinary consumers to realize, so the correction of new dark point dead pixels is generally abandoned.
  • the first (1) will not reduce the image quality; the second (2) requires the user to trigger the operation and participate in it.
  • the correction function may not be triggered or The calibration failed, and the dark spots were not corrected, and the function was one-sided.
  • Embodiments of the present application provide a method, a photographing device, a drone, and a storage medium for detecting (calibrating) a dead pixel of an image sensor.
  • the main technical idea is to capture static dead pixels by analyzing dynamic dead pixels, and to determine the bad points by detecting multiple photos or points captured in the same position in multiple video frames.
  • a method for detecting a dead pixel of an image sensor including:
  • the position of the image dead point appearing in each of a certain number of photos or video frames in a plurality of photos or video frames that meet certain conditions is determined as the position of the image sensor dead point.
  • a photographing apparatus comprising:
  • An image sensor that converts optical information acquired by the lens group into image data
  • Storage media storing various data and programs
  • the processor executes:
  • the position of the image dead point appearing in each of a certain number of photos or video frames in a plurality of photos or video frames that meet certain conditions is determined as the position of the image sensor dead point.
  • a drone which wirelessly communicates with a smart terminal, and the smart terminal remotely controls the drone, the drone includes:
  • PTZ used to fix the camera.
  • a fourth aspect provides a computer readable storage medium storing an executable program that, when executed by a processor, causes the processor to perform the image sensor dead point detection method of the first aspect described above.
  • the image sensor dead center detecting method, the photographing device, the drone, and the storage medium according to the embodiment of the present application it is possible to realize the user operation as much as possible (reducing the problem caused by the user operation error), and simultaneously calibrate the newly added bright spot dead pixels. And dark spots are bad points to correct these dead pixels.
  • FIG. 1 is a schematic block diagram of a photographing apparatus of an embodiment of the present application.
  • FIG. 2 is a schematic structural view of a drone according to an embodiment of the present application.
  • FIG. 3 is a schematic flowchart of a method for detecting a dead pixel of an image sensor according to an embodiment of the present application
  • FIG. 4 is a schematic diagram of a specific example of an image sensor dead center detecting method according to an embodiment of the present application.
  • Fig. 5 is a schematic diagram showing a conventional calculation method employed in static dead point correction.
  • FIG. 1 is a schematic block diagram of a photographing apparatus 100 of an embodiment of the present application.
  • the photographing apparatus 100 includes at least a lens group 101, an image sensor 102 that converts optical information acquired by the lens group 101 into image data, a processor 103 that controls the entire photographing apparatus 100, and a storage medium 104 that stores There are various data and programs, and when the program is executed, the processor 103 can execute the detection method of the image sensor dead pixels of the embodiment of the present application.
  • the processor 103 may be a central processing unit (Central Processing Unit (CPU), or other general-purpose processor, digital signal processor (DSP), dedicated. Integrated Circuits (ASICs), Field Programmable Gate Arrays ("FPGAs”) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, and the like.
  • the above general purpose processor may be a microprocessor or may be any conventional processor or the like.
  • the image sensor 102 in the embodiment of the present application may include a charge-coupled device (CCD) and a complementary metal oxide semiconductor (CMOS).
  • CCD charge-coupled device
  • CMOS complementary metal oxide semiconductor
  • the storage medium 104 in the embodiment of the present application includes, but is not limited to, cloud storage, U disk, hard disk, SD card, NandFlash, NorFlash, Read-Only Memory (ROM), and random.
  • cloud storage U disk, hard disk, SD card, NandFlash, NorFlash, Read-Only Memory (ROM), and random.
  • ROM Read-Only Memory
  • a variety of media that can store data and program code such as a random access memory (RAM), a disk, or an optical disk.
  • the above-described photographing apparatus 100 may be, for example, a camera, a video camera, or a terminal device (for example, a mobile phone, a tablet computer, or a notebook computer) having an image capturing function.
  • a camera for example, a camera, a video camera, or a terminal device (for example, a mobile phone, a tablet computer, or a notebook computer) having an image capturing function.
  • a terminal device for example, a mobile phone, a tablet computer, or a notebook computer having an image capturing function.
  • the above-described imaging device 100 may be used in a drone or the like.
  • Unmanned Aerial Vehicle UAV
  • UAV Unmanned Aerial Vehicle
  • the UAV can carry payloads for performing specific tasks through the carrier.
  • the UAV can carry the shooting device through the pan/tilt.
  • FIG. 2 is a schematic structural diagram of a drone 1000 according to an embodiment of the present application.
  • the drone 1000 performs wireless communication with the smart terminal 2000, and the smart terminal 2000 remotely controls the drone 1000.
  • the drone includes at least the photographing device 100 of the embodiment of the present application; and the pan/tilt head 200 for fixing the photographing device 100.
  • the smart terminal 2000 can be a terminal such as a smart phone or a tablet computer.
  • the smart terminal 2000 is configured to: when receiving the triggering operation on the control interface displayed on the screen, the command signal is wirelessly forwarded to the drone 1000, thereby performing flight operations and shooting on the drone 1000.
  • the shooting operation of the device 100 is controlled.
  • FIG. 3 is a schematic flowchart of a method for detecting a dead pixel of an image sensor according to an embodiment of the present application.
  • an algorithm based on the dynamic dead point correction idea described in the background art section may be built in the photographing apparatus 100 as needed.
  • An example of this algorithm can be given, as shown in Fig. 5, if c>((a+d)/2+(b+e)/2)/2+x, or c ⁇ ((a+d)/2 +(b+e)/2)/2-y, the pixel pointed to by c is considered to be a dead pixel, where x and y are threshold values and are positive integers.
  • the dynamic dead pixel correction algorithm performs a dead pixel position (pixel position) detection (including bright spots and dark spots) for each frame of each photo or video, for a photo or video.
  • the frame is analyzed to compare the difference between each pixel and the surrounding pixels. If the surrounding pixel values are relatively consistent and the pixel value is different, the pixel is marked as a dynamic dead pixel (ie, an image dead point).
  • step S1 the position of the image dead point is detected for the photographed photo or video frame.
  • step S2 the position of the image dead point of a plurality of photos or video frames in a photo or video frame that meet certain conditions is recorded and stored.
  • step S3 the position of the recorded image dead point is counted, and then, in step S4, a certain number or more (for example, 80% or more) of the plurality of photos or video frames satisfying the certain condition are used.
  • the position of the image dead point appearing in each of the photo or video frames is determined as the position of the image sensor dead point.
  • the image sensor dead pixels include a bright point dead point and a dark point dead point
  • the certain condition means that the RAW format picture brightness and the exposure parameter of the photo or video frame are specified.
  • the range is different, and the certain conditions are different for the bright point and the dark point.
  • the certain condition is that the RAW format picture brightness of the photo or video frame is lower than the first brightness value, the exposure time is greater than the first duration, and the sensitivity value is higher than the first a sensitivity value
  • the certain condition is that the RAW format picture brightness of the photo or video frame is higher than the second brightness value greater than the first brightness value and less than the highest value
  • the exposure time is less than a second time length shorter than the first time length, and the sensitivity value is lower than the second sensitivity value smaller than the first sensitivity value.
  • the image sensor dead point is a dead point that must occur under a predetermined condition, and the image dead point is a bad point that occurs probabilistically even if the predetermined condition is reached, and the predetermined condition is, for example, that the exposure time is greater than The specified value and the image sensor reach the specified temperature.
  • the location of the recorded image dead pixels is triggered to be counted when the recorded photo or video frame reaches a predetermined number (eg, 100).
  • the location of the previously stored image dead point is deleted after the location of the image sensor dead point is determined.
  • the value obtained by calculating the value of the surrounding pixels of its kind is substituted for its value.
  • FIG. 4 is a schematic diagram of a specific example of an image sensor dead center detecting method according to an embodiment of the present application.
  • the position of the dynamic dead point of the photo or video frame that meets certain conditions is recorded (here, "certain condition” refers to, for example, the RAW format brightness of the photo or video frame, and the exposure parameter is Within a certain range, and the conditions for the bright spots and the dark spots are different, and these locations are saved to the storage medium 104 in the same photo or the same frame.
  • certain condition refers to, for example, the RAW format brightness of the photo or video frame, and the exposure parameter is Within a certain range, and the conditions for the bright spots and the dark spots are different, and these locations are saved to the storage medium 104 in the same photo or the same frame.
  • the recorded dynamic dead point positions are analyzed and counted.
  • points A to I indicate dynamic bad.
  • Point if point A appears in most photos or frames (ie, the number of photos or frames containing the point A exceeds a certain percentage, for example, can be set to 80%), the position of the point A is marked as a static dead point ( That is, the image sensor is a dead pixel).
  • the position data of each of the previously stored dynamic dead pixels is deleted, thereby leaving more storage space for the subsequent detection. Since the dynamic dead-point correction algorithm may capture noise or a point that is different from the surrounding in the actual image, the noise may randomly appear on one or a few adjacent pixels of the image sensor.
  • the conditions of photos or frames generally require a lower brightness of the RAW format (for example, less than 40 (in the range of 0-255 brightness)), and the exposure time is relatively long (for example) More than 2 seconds, generally close to the maximum exposure time that the camera can support), high ISO (generally high ISO (sensitivity) starts at 800, ⁇ 800).
  • high ISO generally high ISO (sensitivity) starts at 800, ⁇ 800.
  • the condition of the photo or frame generally requires a higher brightness in the RAW format (usually higher than a certain value, but lower than the highest value, such as higher than 120 and lower than 255 (with a brightness range of 0-255) Calculate)), the exposure time can not be too long (for example, less than 1/100 seconds), low ISO (generally take ISO100).
  • the above numerical values are merely examples, and the present application is not limited thereto, and may be any condition that can detect bright spots or dark spots.
  • a new dead point (static dead pixel, that is, an image sensor dead point) can be caught in the background without a user operation, and includes a bright point dead point and a dark point dead point, compared with the conventional method. Not only is the function more comprehensive, but it also reduces the risk of bad mark error due to user unprofessionality, and also reduces the trouble of user operation. Since the software in the photographing device operates automatically and in real time as long as the photographing device takes a photo or video, it is possible to increase the appearance of a dead pixel.
  • the embodiment of the present application further provides a computer readable storage medium 104, which stores an executable program, and when executed by the processor 103, the processor 103 executes the image of the embodiment of the present application.
  • Method for detecting sensor dead pixels is provided.
  • the embodiment of the present application further provides another method for marking the new dead point (bright spot): triggering through the menu or virtual button of the App on the mobile phone or the Pad, the command signal
  • the remote control wirelessly forwards to the camera on the drone, the camera closes the mechanical shutter to create a black environment for the image sensor, and the camera sets a long exposure time, high ISO shooting one or more RAW Format photo, the software reads all the photos and detects all the bad points on the photo; then the software reads the dead spots that the camera has been calibrated before leaving the factory, by comparing the original dead spots and detecting this time.
  • the bad point position pick out the bad points of this detection and store it as a new bad point to store in the storage medium.
  • the factory has a bad point position and a new dead point corrected at the same time.
  • the RAW format photo is also taken.
  • the software compares the position of this dead pixel and all previous calibrations (including the factory and the user's own calibration), and calibrates the newly added dead pixels and the previous users themselves.
  • the bad points are stored together as a new dead point.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of cells is only a logical function division.
  • multiple units or components may be combined or integrated. Go to another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, mechanical or otherwise.
  • the units described as separate components may or may not be physically separated, and the components represented as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • the techniques of this disclosure may be implemented in the form of hardware and/or software (including firmware, microcode, etc.). Additionally, the techniques of this disclosure may take the form of a computer program product on a computer readable medium storing instructions for use by or in connection with an instruction execution system (eg, one or more processors) .
  • an instruction execution system eg, one or more processors
  • a computer readable medium can be any medium that can contain, store, communicate, propagate or transport the instructions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Studio Devices (AREA)

Abstract

A method for detecting a defective pixel of an image sensor. The method comprises: detecting positions of image defective pixels of taken pictures or video frames; recording and storing positions of image defective pixels of a plurality of pictures or video frames that meet certain conditions among from the pictures or video frames; compiling statistics on the recorded positions of the image defective pixels; and determining the position of an image defective pixel, which appears in each of more than a certain number of pictures or video frames from among the plurality of pictures or video frames that meet the certain conditions, as the position of a defective pixel of an image sensor. Further disclosed are a photography apparatus, an unmanned aerial vehicle and a storage medium. Thus, a bright spot defective pixel and a dark spot defective pixel which are newly added can be simultaneously corrected without a user operation.

Description

图像传感器坏点检测方法、拍摄装置、无人机及存储介质Image sensor dead pixel detection method, photographing device, drone, and storage medium 技术领域Technical field
本申请实施例涉及一种对拍摄装置中的图像传感器的坏点的进行检测的方法、拍摄装置、无人机及存储介质。Embodiments of the present application relate to a method for detecting a dead pixel of an image sensor in an imaging device, an imaging device, a drone, and a storage medium.
背景技术Background technique
相机等拍摄装置的图像传感器(包括CCD和CMOS等),均存在一定数量的坏的像素,这些像素的亮度值不能反映所拍摄的图像,通常称之为坏点。Image sensors (such as CCD and CMOS) of cameras and other cameras have a certain number of bad pixels. The brightness values of these pixels do not reflect the captured image, which is usually called a dead pixel.
坏点按出现概率分成两种,即静态坏点和动态坏点:(1)静态坏点是在一定条件下(如曝光时间足够长、图像传感器达到一定温度)必定会出现的坏点;(2)动态坏点是即使达到一定条件也是概率性出现的坏点(即该坏点在这次拍照出现,下次拍照可能正常;在视频的这帧出现,下一帧可能正常;或图像传感器这次上电一直出现,下次上电可能一直正常)。There are two kinds of bad points according to the probability of occurrence, namely static dead points and dynamic dead points: (1) Static dead points are bad points that must occur under certain conditions (such as long enough exposure time and image sensor reaches a certain temperature); 2) The dynamic dead point is a bad point that appears probabilistic even if certain conditions are reached (ie, the bad point appears in this photo, the next shot may be normal; in the frame of the video, the next frame may be normal; or the image sensor This power-on has been appearing all the time, and the next power-up may have been normal.)
坏点按亮度也可分成两种,即亮点和暗点:(1)亮点是在照片或视频整体亮度比较暗的情况下,其亮度值高于图像该位置本来的亮度,且和图像该位置本来的亮度没有一定对应关系;(2)暗点是在照片或视频整体亮度比较亮的情况下,其亮度值低于图像该位置本来的亮度,且和图像该位置本来的亮度没有一定对应关系。The bad point brightness can also be divided into two types, that is, bright point and dark point: (1) The bright point is when the overall brightness of the photo or video is dark, the brightness value is higher than the original brightness of the image, and the image is the position. The original brightness does not have a corresponding relationship; (2) the dark point is that when the overall brightness of the photo or video is bright, the brightness value is lower than the original brightness of the image, and there is no corresponding relationship with the original brightness of the image. .
针对坏点的校正,一般采用下面两种校正方法。For the correction of the dead pixels, the following two correction methods are generally used.
(1)一种是静态坏点校正,其中静态坏点校正又分成两种,即静态亮点校正和静态暗点校正。(1) One is static dead pixel correction, in which static dead pixel correction is further divided into two types, namely static bright spot correction and static dark point correction.
静态亮点校正:在出厂前,将相机镜头遮黑,拍摄特定曝光参数的包括图像传感器全部有效像素的RAW格式照片,然后通过软件分析所有像素,找出其中亮度比周围同类像素的平均值高出一定阈值的像素的坐标,将这些像素标记为亮点,并将其坐标存下来。在正常拍照 和录像时,被标记为亮点的像素的值不会被采用,而是用其周围同类像素的值经过一定计算而得出的值来代替被标记为亮点的像素的值;Static bright spot correction: Before leaving the factory, the camera lens is blacked out, and the RAW format photo of all the effective pixels of the image sensor is taken for specific exposure parameters, and then all the pixels are analyzed by software to find that the brightness is higher than the average value of the surrounding pixels. The coordinates of a certain threshold pixel, mark these pixels as bright spots, and save their coordinates. In normal photographing and recording, the value of the pixel marked as a bright spot is not used, but the value of the pixel marked as a bright point is replaced by a value obtained by calculating the value of the same kind of pixel around it;
静态暗点校正:在出厂前,相机对着匀光平面光源,拍摄特定曝光参数的RAW格式照片,然后通过软件分析所有像素,找出其中亮度比周围同类像素的平均值低出一定阈值的像素的坐标,将这些像素标记为暗点,并将其坐标存下来。在正常拍照和录像时,被标记为暗点的像素的值不会被采用,而是用其周围同类像素的值经过一定计算而得出的值来代替被标记为暗点的像素的值。Static dark spot correction: Before leaving the factory, the camera shoots a RAW format photo of a specific exposure parameter against a uniform light source, and then analyzes all the pixels through software to find a pixel whose brightness is lower than the average value of the surrounding pixels. The coordinates of the pixels are marked as dark points and their coordinates are saved. In normal photographing and recording, the value of the pixel marked as a dark spot is not taken, but the value of the pixel marked as a dark dot is replaced by a value obtained by a certain calculation of the value of the same kind of pixel around it.
静态坏点校正是在理想的测试条件下(在相机工厂将镜头遮黑或使用品质高的匀光平面光源,曝光参数固定)来分析坏点位置,坏点的坐标位置是可靠的。因此,可以认为静态坏点就是“图像传感器坏点”。Static dead-point correction is to analyze the dead-point position under ideal test conditions (blackout the lens at the camera factory or use a high-quality uniform light plane source with fixed exposure parameters), and the coordinate position of the dead point is reliable. Therefore, it can be considered that the static dead point is "image sensor dead point".
下面,对上述静态亮点校正以及静态暗点校正过程中提到的“一定计算”进行简单说明。图5是表示静态坏点校正中采用的现有的计算方法的示意图。如图5所示,假设c是一个绿色像素坏点,c的周围共有九个像素,其中a、b、d、e是正常的绿色像素,与c为同类像素;c的正上方和正下方为红色像素,左方和右方为蓝色像素,与c为不同类像素。则c的值用a、b、d、e计算表示:c=((a+d)/2+(b+e)/2)/2。由此,可以利用对坏点c周围同类像素的值经过上述计算得到的值,来代替坏点c的像素值。In the following, a brief description will be given of the "certain calculation" mentioned in the above static bright spot correction and static dark spot correction process. Fig. 5 is a schematic diagram showing a conventional calculation method employed in static dead point correction. As shown in FIG. 5, it is assumed that c is a green pixel dead pixel, and there are nine pixels around c, wherein a, b, d, and e are normal green pixels, and c is a similar pixel; c is directly above and below Red pixels, the left and right are blue pixels, and c is a different type of pixel. Then the value of c is calculated by a, b, d, e: c = ((a + d) / 2 + (b + e) / 2) / 2. Thus, instead of the pixel value of the dead point c, the value obtained by the above calculation for the value of the same type of pixel around the dead point c can be utilized.
(2)另一种是动态坏点校正。(2) The other is dynamic dead pixel correction.
动态坏点校正是在正常拍照或录像时,针对照片或视频的一帧,分析比较每个像素同周围同类像素的差值,如果周围像素值较一致,而该像素值差别较大,则把该像素标记为坏点,对于此照片或视频帧,该像素的值不会被采用,而是用其周围同类像素的值经过一定计算而得出的值代替被标记为坏点的像素的值。由于动态坏点校正是在对正常拍摄的照片或视频帧进行计算,查找坏点位置的条件不是理想条件(正常拍摄的照片或视频的曝光参数不确定,且图片内容复杂,动态坏点校正很可能漏抓坏点或误抓一些噪声点),所以动态坏点不是一定可靠,该像素的位置也不会被存下来。动态坏点校正能同时探测亮 点和暗点。在本申请中,有时也将动态坏点称作“图像坏点”。Dynamic bad point correction is to analyze and compare the difference between each pixel and the surrounding pixels in the normal picture or video. If the surrounding pixel values are consistent and the pixel value is different, then The pixel is marked as a dead pixel. For this photo or video frame, the value of the pixel is not used, but the value of the pixel marked as a dead pixel is replaced by a value calculated by the value of the similar pixel around it. . Since the dynamic bad point correction is to calculate the normal taken photo or video frame, the condition for finding the bad point position is not ideal (the exposure parameters of the normally taken photo or video are uncertain, and the picture content is complicated, the dynamic bad point correction is very It may leak or catch some noise points, so the dynamic dead pixels are not necessarily reliable, and the position of the pixel will not be saved. Dynamic dead-point correction detects both bright and dark spots. In the present application, the dynamic bad point is sometimes referred to as "image dead point".
在相机出厂后,随着使用时间增加,坏点的数量也会增加,图像传感器上原本不是坏点的部分像素也可能变成坏点。这些增加的坏点将成为相机使用的一个问题。针对增加的坏点,现在相机一般采用两种策略:(1)不做处理,这种方法通常用于对图像质量要求不高的较低端相机;(2)在相机软件中增加让用户自己用镜头盖等把镜头遮黑,做一次静态亮点校正的程序,消除新增的亮点坏点。但是,要检测暗点坏点,需要准备品质高的匀光平面光源,因此普通消费者难以实现,故一般会放弃新增的暗点坏点的校正。After the camera is shipped, as the usage time increases, the number of dead pixels also increases, and some pixels on the image sensor that are not originally dead pixels may also become dead pixels. These added dead pixels will be a problem for cameras. For the added dead pixels, the camera now generally adopts two strategies: (1) no processing, this method is usually used for lower-end cameras that do not require high image quality; (2) adding users to the camera software Cover the camera with a lens cover, etc., and do a static highlight correction procedure to eliminate the new bright spots. However, in order to detect dark spots, it is necessary to prepare a high-quality uniform light plane light source, so that it is difficult for ordinary consumers to realize, so the correction of new dark point dead pixels is generally abandoned.
对于上面两种策略,第(1)种不做处理显然会降低图像质量;第(2)种需要用户触发操作并参与其中,当用户不够专业或操作不当时,可能导致校正功能没被触发或校正失败,而且也不能校正暗点坏点,功能片面。For the above two strategies, the first (1) will not reduce the image quality; the second (2) requires the user to trigger the operation and participate in it. When the user is not professional or the operation is not correct, the correction function may not be triggered or The calibration failed, and the dark spots were not corrected, and the function was one-sided.
发明内容Summary of the invention
本申请实施例提供一种对图像传感器的坏点进行检测(标定)的方法、拍摄装置、无人机及存储介质。其主要的技术思想是通过分析动态坏点来抓取静态坏点,通过侦测多张照片或多个视频帧中同一位置抓到的点确定为坏点。Embodiments of the present application provide a method, a photographing device, a drone, and a storage medium for detecting (calibrating) a dead pixel of an image sensor. The main technical idea is to capture static dead pixels by analyzing dynamic dead pixels, and to determine the bad points by detecting multiple photos or points captured in the same position in multiple video frames.
第一方面,提供一种图像传感器坏点的检测方法,包括:In a first aspect, a method for detecting a dead pixel of an image sensor is provided, including:
对拍摄到的照片或视频帧检测图像坏点的位置;Detecting the position of the image dead point on the captured photo or video frame;
记录并存储照片或视频帧中符合一定条件的多个照片或视频帧的图像坏点的位置;Recording and storing the location of image dead pixels of a plurality of photos or video frames in a photo or video frame that meet certain conditions;
对被记录的图像坏点的位置进行统计;Counting the position of the recorded image dead pixels;
将在符合一定条件的多个照片或视频帧中一定数量以上的照片或视频帧的每一个中都出现的图像坏点的位置确定为图像传感器坏点的位置。The position of the image dead point appearing in each of a certain number of photos or video frames in a plurality of photos or video frames that meet certain conditions is determined as the position of the image sensor dead point.
第二方面,提供一种拍摄装置,包括:In a second aspect, a photographing apparatus is provided, comprising:
透镜组;Lens group
图像传感器,将由透镜组获取的光学信息转换成图像数据;An image sensor that converts optical information acquired by the lens group into image data;
处理器,对拍摄装置整体进行控制;a processor that controls the entire imaging device;
存储介质,存储各种数据以及程序,Storage media, storing various data and programs,
处理器执行:The processor executes:
对拍摄到的照片或视频帧检测图像坏点的位置;Detecting the position of the image dead point on the captured photo or video frame;
在存储介质中记录并存储照片或视频帧中符合一定条件的多个照片或视频帧的图像坏点的位置;Recording and storing the location of image dead pixels of a plurality of photos or video frames in a photo or video frame that meet certain conditions in a storage medium;
对被记录的图像坏点的位置进行统计;Counting the position of the recorded image dead pixels;
将在符合一定条件的多个照片或视频帧中一定数量以上的照片或视频帧的每一个中都出现的图像坏点的位置确定为图像传感器坏点的位置。The position of the image dead point appearing in each of a certain number of photos or video frames in a plurality of photos or video frames that meet certain conditions is determined as the position of the image sensor dead point.
第三方面,提供一种无人机,与智能终端无线通信,智能终端对无人机进行远程控制,该无人机包括:In a third aspect, a drone is provided, which wirelessly communicates with a smart terminal, and the smart terminal remotely controls the drone, the drone includes:
上述第二方面所述的拍摄装置;The photographing device of the above second aspect;
云台,用来固定拍摄装置。PTZ, used to fix the camera.
第四方面,提供一种计算机可读的存储介质,存储有可执行的程序,该程序被处理器执行时使该处理器执行上述第一方面所述的图像传感器坏点的检测方法。A fourth aspect provides a computer readable storage medium storing an executable program that, when executed by a processor, causes the processor to perform the image sensor dead point detection method of the first aspect described above.
根据本申请实施例的图像传感器坏点检测方法、拍摄装置、无人机及存储介质,能够实现尽量不需要用户操作(减少用户操作失误导致的问题),而且能够同时标定新增的亮点坏点和暗点坏点,来对这些坏点进行校正。According to the image sensor dead center detecting method, the photographing device, the drone, and the storage medium according to the embodiment of the present application, it is possible to realize the user operation as much as possible (reducing the problem caused by the user operation error), and simultaneously calibrate the newly added bright spot dead pixels. And dark spots are bad points to correct these dead pixels.
附图说明DRAWINGS
为了更清楚地说明本申请实施例的技术方案,下面将对实施例所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings to be used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present application. For ordinary technicians, other drawings can be obtained based on these drawings without paying for creative labor.
图1是本申请实施例的拍摄装置的示意性方框图;1 is a schematic block diagram of a photographing apparatus of an embodiment of the present application;
图2是本申请实施例的无人机的示意性结构图;2 is a schematic structural view of a drone according to an embodiment of the present application;
图3是本申请实施例的图像传感器坏点检测方法的示意性流程图;3 is a schematic flowchart of a method for detecting a dead pixel of an image sensor according to an embodiment of the present application;
图4是本申请实施例的图像传感器坏点检测方法的具体示例的示意图。FIG. 4 is a schematic diagram of a specific example of an image sensor dead center detecting method according to an embodiment of the present application.
图5是表示静态坏点校正中采用的现有的计算方法的示意图。Fig. 5 is a schematic diagram showing a conventional calculation method employed in static dead point correction.
具体实施方式detailed description
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请的一部分实施例,而不是全部实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例,都应属于本申请保护的范围。The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. It is obvious that the described embodiments are a part of the embodiments of the present application, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope shall fall within the scope of the application.
首先,结合图1对本申请实施例的拍摄装置100的结构进行说明。First, the configuration of the imaging apparatus 100 of the embodiment of the present application will be described with reference to FIG.
图1是本申请实施例的拍摄装置100的示意性方框图。如图1所示,拍摄装置100至少包括:透镜组101;图像传感器102,将由透镜组101获取的光学信息转换成图像数据;处理器103,对拍摄装置100整体进行控制;存储介质104,存储有各种数据以及程序,该程序被执行时,处理器103可以执行本申请实施例的图像传感器坏点的检测方法。FIG. 1 is a schematic block diagram of a photographing apparatus 100 of an embodiment of the present application. As shown in FIG. 1, the photographing apparatus 100 includes at least a lens group 101, an image sensor 102 that converts optical information acquired by the lens group 101 into image data, a processor 103 that controls the entire photographing apparatus 100, and a storage medium 104 that stores There are various data and programs, and when the program is executed, the processor 103 can execute the detection method of the image sensor dead pixels of the embodiment of the present application.
作为示例而非限定,在本申请实施例中,处理器103可以是中央处理单元(Central Processing Unit,简称为“CPU”),也可以是其他通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(Field Programmable Gate Array,简称为“FPGA”)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。并且,上述通用处理器可以是微处理器或者也可以是任何常规的处理器等。另外,作为示例而非限定,在本申请实施例的图像传感器102可以包括电荷耦合元件(Charge-coupled Device,CCD)和互补金属氧化物半导体(Complementary Metal Oxide Semiconductor,CMOS)。另外,作为示例而非限定,在本申请实施例的存储介质104包括但不限于:云存储、U盘、硬盘、SD卡、NandFlash、NorFlash、 只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储数据和程序代码的介质。By way of example and not limitation, in the embodiment of the present application, the processor 103 may be a central processing unit (Central Processing Unit (CPU), or other general-purpose processor, digital signal processor (DSP), dedicated. Integrated Circuits (ASICs), Field Programmable Gate Arrays ("FPGAs") or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, and the like. Also, the above general purpose processor may be a microprocessor or may be any conventional processor or the like. In addition, the image sensor 102 in the embodiment of the present application may include a charge-coupled device (CCD) and a complementary metal oxide semiconductor (CMOS). In addition, the storage medium 104 in the embodiment of the present application includes, but is not limited to, cloud storage, U disk, hard disk, SD card, NandFlash, NorFlash, Read-Only Memory (ROM), and random. A variety of media that can store data and program code, such as a random access memory (RAM), a disk, or an optical disk.
另外,在本申请实施例中,上述拍摄装置100可以例如是,照相机、摄像机或具有图像拍摄功能的终端设备(例如,手机、平板电脑或笔记本电脑)等。In addition, in the embodiment of the present application, the above-described photographing apparatus 100 may be, for example, a camera, a video camera, or a terminal device (for example, a mobile phone, a tablet computer, or a notebook computer) having an image capturing function.
或者,上述拍摄装置100也可以用于无人机等中。无人机(Unmanned Aerial Vehicle,简称为“UAV)”,已经从军用发展到越来越广泛的民用,例如,UAV植物保护、UAV航空拍摄、UAV森林火警监控等等,而民用化也是UAV未来发展的趋势。在有些场景下,UAV可以通过载体携带用于执行特定任务的负载。例如,在利用UAV进行航空拍摄时,UAV可以通过云台携带拍摄设备。Alternatively, the above-described imaging device 100 may be used in a drone or the like. Unmanned Aerial Vehicle (UAV) has been developed from military to more and more civilian applications, such as UAV plant protection, UAV aerial photography, UAV forest fire alarm monitoring, etc., and civilization is also the future of UAV. The trend of development. In some scenarios, the UAV can carry payloads for performing specific tasks through the carrier. For example, when using UAV for aerial photography, the UAV can carry the shooting device through the pan/tilt.
下面,结合图2对本申请实施例的无人机1000进行说明。图2是本申请实施例的无人机1000的示意性结构图。无人机1000与智能终端2000进行无线通信,智能终端2000对无人机1000进行远程控制。无人机至少包括:本申请实施例的拍摄装置100;云台200,用来固定拍摄装置100。Next, the drone 1000 of the embodiment of the present application will be described with reference to FIG. FIG. 2 is a schematic structural diagram of a drone 1000 according to an embodiment of the present application. The drone 1000 performs wireless communication with the smart terminal 2000, and the smart terminal 2000 remotely controls the drone 1000. The drone includes at least the photographing device 100 of the embodiment of the present application; and the pan/tilt head 200 for fixing the photographing device 100.
所述智能终端2000可以为智能手机、平板电脑等终端。其中,所述智能终端2000,用于当接收到在屏幕显示的操控界面上的触发操作时,命令信号便通过无线转发给无人机1000,由此来对无人机1000的飞行动作以及拍摄装置100的拍摄动作进行控制。The smart terminal 2000 can be a terminal such as a smart phone or a tablet computer. The smart terminal 2000 is configured to: when receiving the triggering operation on the control interface displayed on the screen, the command signal is wirelessly forwarded to the drone 1000, thereby performing flight operations and shooting on the drone 1000. The shooting operation of the device 100 is controlled.
下面,结合图3对本申请实施例的图像传感器坏点的检测方法进行说明。图3是本申请实施例的图像传感器坏点检测方法的示意性流程图。Hereinafter, a method for detecting a dead pixel of an image sensor according to an embodiment of the present application will be described with reference to FIG. FIG. 3 is a schematic flowchart of a method for detecting a dead pixel of an image sensor according to an embodiment of the present application.
在本申请实施例中,根据需要可以在拍摄装置100中内置基于背景技术部分所述的动态坏点校正思想的算法。可以举一个该算法的例子,如图5所示,如果c>((a+d)/2+(b+e)/2)/2+x、或者c<((a+d)/2+(b+e)/2)/2-y,就认为c所指的像素是坏点,其中x、y是阈值,且为正整数。当用户使用拍摄装置100拍摄照片或视频时,动态坏点校正算法会对每张照片或视频的每帧进行坏点位置(像素位 置)检测(包括亮点和暗点),针对照片或视频的一帧,分析比较每个像素同周围同类像素的差值,如果周围像素值较一致,而该像素值差别较大,则把该像素标记为动态坏点(即,图像坏点)。In the embodiment of the present application, an algorithm based on the dynamic dead point correction idea described in the background art section may be built in the photographing apparatus 100 as needed. An example of this algorithm can be given, as shown in Fig. 5, if c>((a+d)/2+(b+e)/2)/2+x, or c<((a+d)/2 +(b+e)/2)/2-y, the pixel pointed to by c is considered to be a dead pixel, where x and y are threshold values and are positive integers. When a user takes a photo or video using the photographing device 100, the dynamic dead pixel correction algorithm performs a dead pixel position (pixel position) detection (including bright spots and dark spots) for each frame of each photo or video, for a photo or video. The frame is analyzed to compare the difference between each pixel and the surrounding pixels. If the surrounding pixel values are relatively consistent and the pixel value is different, the pixel is marked as a dynamic dead pixel (ie, an image dead point).
如图3所示,首先在步骤S1中,对拍摄到的照片或视频帧检测图像坏点的位置。在步骤S2中,记录并存储照片或视频帧中符合一定条件的多个照片或视频帧的图像坏点的位置。在步骤S3中,对被记录的图像坏点的位置进行统计,接下来,在步骤S4中,将在所述符合一定条件的多个照片或视频帧中一定数量以上(例如80%以上)的照片或视频帧的每一个中都出现的图像坏点的位置确定为图像传感器坏点的位置。As shown in FIG. 3, first, in step S1, the position of the image dead point is detected for the photographed photo or video frame. In step S2, the position of the image dead point of a plurality of photos or video frames in a photo or video frame that meet certain conditions is recorded and stored. In step S3, the position of the recorded image dead point is counted, and then, in step S4, a certain number or more (for example, 80% or more) of the plurality of photos or video frames satisfying the certain condition are used. The position of the image dead point appearing in each of the photo or video frames is determined as the position of the image sensor dead point.
通过上述方法,能够实现不需要用户操作的情况下就可定期自动地标定新增的坏点。Through the above method, it is possible to automatically and automatically calibrate new dead pixels on a regular basis without requiring user operations.
作为示例而非限定,在本申请实施例中,所述图像传感器坏点包括亮点坏点和暗点坏点,所述一定条件是指照片或视频帧的RAW格式图亮度以及曝光参数均在规定的范围内,并且针对所述亮点坏点和暗点坏点,所述一定条件不同。具体而言,在检测所述亮点坏点的情况下,所述一定条件是指照片或视频帧的RAW格式图亮度低于第一亮度值,曝光时间大于第一时长,感光度值高于第一感光度值,在检测所述暗点坏点的情况下,所述一定条件是指照片或视频帧的RAW格式图亮度高于比第一亮度值大的第二亮度值且小于最高值,曝光时间小于比第一时长短的第二时长,感光度值低于比第一感光度值小的第二感光度值。另外,所述图像传感器坏点是在规定条件下必定会出现的坏点,所述图像坏点是即使达到所述规定条件也是概率性出现的坏点,所述规定条件例如是指曝光时间大于规定值且图像传感器达到规定温度。By way of example and not limitation, in the embodiment of the present application, the image sensor dead pixels include a bright point dead point and a dark point dead point, and the certain condition means that the RAW format picture brightness and the exposure parameter of the photo or video frame are specified. The range is different, and the certain conditions are different for the bright point and the dark point. Specifically, in the case of detecting the bright spot dead point, the certain condition is that the RAW format picture brightness of the photo or video frame is lower than the first brightness value, the exposure time is greater than the first duration, and the sensitivity value is higher than the first a sensitivity value, in the case of detecting the dark spot dead point, the certain condition is that the RAW format picture brightness of the photo or video frame is higher than the second brightness value greater than the first brightness value and less than the highest value, The exposure time is less than a second time length shorter than the first time length, and the sensitivity value is lower than the second sensitivity value smaller than the first sensitivity value. In addition, the image sensor dead point is a dead point that must occur under a predetermined condition, and the image dead point is a bad point that occurs probabilistically even if the predetermined condition is reached, and the predetermined condition is, for example, that the exposure time is greater than The specified value and the image sensor reach the specified temperature.
在一些实施方式中,当被记录的照片或视频帧达到预定数量(例如100张),才触发对被记录的图像坏点的位置进行统计。In some embodiments, the location of the recorded image dead pixels is triggered to be counted when the recorded photo or video frame reaches a predetermined number (eg, 100).
在一些实施方式中,在确定出图像传感器坏点的位置之后,将之前存储的图像坏点的位置删除。In some embodiments, the location of the previously stored image dead point is deleted after the location of the image sensor dead point is determined.
在一些实施方式中,针对被标记为图像传感器坏点的像素,用其 周围同类像素的值经过计算而得到的值代替其值。In some embodiments, for a pixel that is marked as a dead pixel of an image sensor, the value obtained by calculating the value of the surrounding pixels of its kind is substituted for its value.
下面,结合图4对本申请实施例的图像传感器坏点的检测方法的一个具体示例进行说明。图4是本申请实施例的图像传感器坏点检测方法的具体示例的示意图。A specific example of the method for detecting an image sensor dead pixel in the embodiment of the present application will be described below with reference to FIG. FIG. 4 is a schematic diagram of a specific example of an image sensor dead center detecting method according to an embodiment of the present application.
在用户使用拍摄装置100进行拍摄的过程中,记录符合一定条件的照片或视频帧的动态坏点的位置(这里的“一定条件”例如是指照片或视频帧的RAW格式图亮度、曝光参数在一定的范围内,且针对亮点和暗点坏点的条件不一样),并将这些位置按同一照片或同一帧保存到存储介质104中。如图4所示,当被记录的照片或帧达到一定数量(100张:P1至P100)时,对记录的动态坏点位置进行分析统计,在图4中,点A至点I表示动态坏点,如果点A出现在大多数照片或帧中(即包含该点A的照片或帧的数量超过一定百分比,例如可以设为80%),则把该点A的位置标记为静态坏点(即,图像传感器坏点)。另外,考虑到存储空间的问题,在上述一系列检测动作结束后,将之前所存储的各动态坏点的位置数据删除,以此为后面的检测留出更多存储空间。由于动态坏点校正算法除了可能抓到坏点外,还可能抓到噪点或者实际图像中与周围差别较大的点,而噪点是随机出现在图像传感器的某个或相邻几个像素上,不会总固定在某个或某几个像素上,而实际图像中与周围差别较大的点也会随着拍摄装置或被摄物体移动,在不同照片或帧上出现在的不同位置。这样,在大多数照片或帧的同一个像素位置抓到的点,就可以确定是静态坏点(之所以不是在所有照片上出现,是因为用户拍的照片,不是整个照片所有区域的亮度都符合暴露坏点的条件)。In the process of shooting by the user using the photographing device 100, the position of the dynamic dead point of the photo or video frame that meets certain conditions is recorded (here, "certain condition" refers to, for example, the RAW format brightness of the photo or video frame, and the exposure parameter is Within a certain range, and the conditions for the bright spots and the dark spots are different, and these locations are saved to the storage medium 104 in the same photo or the same frame. As shown in FIG. 4, when a recorded number of photos or frames reaches a certain number (100 sheets: P1 to P100), the recorded dynamic dead point positions are analyzed and counted. In FIG. 4, points A to I indicate dynamic bad. Point, if point A appears in most photos or frames (ie, the number of photos or frames containing the point A exceeds a certain percentage, for example, can be set to 80%), the position of the point A is marked as a static dead point ( That is, the image sensor is a dead pixel). In addition, considering the problem of the storage space, after the above-mentioned series of detection operations are completed, the position data of each of the previously stored dynamic dead pixels is deleted, thereby leaving more storage space for the subsequent detection. Since the dynamic dead-point correction algorithm may capture noise or a point that is different from the surrounding in the actual image, the noise may randomly appear on one or a few adjacent pixels of the image sensor. It will not always be fixed on one or a few pixels, and the points in the actual image that differ greatly from the surroundings will also appear at different positions on different photos or frames as the camera or subject moves. In this way, at the point captured by the same pixel position of most photos or frames, it can be determined that it is a static dead pixel (the reason why it does not appear on all photos is because the photos taken by the user, not the brightness of all areas of the entire photo. Meet the conditions for exposing dead pixels).
另外,关于上面提到的“一定条件”,针对亮点,照片或帧的条件一般需要RAW格式亮度较低(例如低于40(以亮度范围为0-255算)),曝光时间比较长(例如大于2秒,一般接近于拍摄装置可支持的最大曝光时间),高ISO(一般高ISO(感光度)从800开始,≥800)。而针对暗点,照片或帧的条件一般需要RAW格式亮度较高(通常高于某个值,但又要比最高值低一些,例如高于120且低于255(以亮度范围为0-255算)),曝光时间不能太长(例如小于1/100秒),低ISO (一般取ISO100)。上述数值只是示例,本申请并非限定于此,只要是能够检测出亮点或暗点的条件即可。In addition, with regard to the "certain conditions" mentioned above, for bright spots, the conditions of photos or frames generally require a lower brightness of the RAW format (for example, less than 40 (in the range of 0-255 brightness)), and the exposure time is relatively long (for example) More than 2 seconds, generally close to the maximum exposure time that the camera can support), high ISO (generally high ISO (sensitivity) starts at 800, ≥ 800). For dark spots, the condition of the photo or frame generally requires a higher brightness in the RAW format (usually higher than a certain value, but lower than the highest value, such as higher than 120 and lower than 255 (with a brightness range of 0-255) Calculate)), the exposure time can not be too long (for example, less than 1/100 seconds), low ISO (generally take ISO100). The above numerical values are merely examples, and the present application is not limited thereto, and may be any condition that can detect bright spots or dark spots.
根据本申请实施例的上述方法,不需要用户操作即可在后台抓到新增的坏点(静态坏点,即图像传感器坏点),且包括亮点坏点和暗点坏点,比传统方法不仅功能更全面,而且减少了由于用户不专业导致坏点标错的风险,也减少了用户操作的麻烦。由于只要拍摄装置拍摄照片或视频,拍摄装置内的软件就会自动且实时地操作,因此能够起到新增坏点出现即被抓取的效果。According to the above method of the embodiment of the present application, a new dead point (static dead pixel, that is, an image sensor dead point) can be caught in the background without a user operation, and includes a bright point dead point and a dark point dead point, compared with the conventional method. Not only is the function more comprehensive, but it also reduces the risk of bad mark error due to user unprofessionality, and also reduces the trouble of user operation. Since the software in the photographing device operates automatically and in real time as long as the photographing device takes a photo or video, it is possible to increase the appearance of a dead pixel.
基于与上述方法同样的构思,本申请实施例还提供一种计算机可读存储介质104,存储有可执行的程序,该程序被处理器103执行时使该处理器103执行本申请实施例的图像传感器坏点的检测方法。Based on the same concept as the above method, the embodiment of the present application further provides a computer readable storage medium 104, which stores an executable program, and when executed by the processor 103, the processor 103 executes the image of the embodiment of the present application. Method for detecting sensor dead pixels.
另外,对于有拍摄功能的无人机,本申请实施例还提供另一种新增坏点(亮点坏点)标定的方法:通过手机或Pad上的App的菜单或虚拟按钮进行触发,命令信号由遥控器(智能终端)通过无线转发给无人机上的拍摄装置,拍摄装置关闭机械快门给图像传感器营造一个全黑的环境,拍摄装置设置较长曝光时间、高ISO拍摄一张或多张RAW格式照片,软件读取所有照片,侦测出照片上的所有坏点;然后软件读取拍摄装置原本在出厂前已经标定的坏点位置,通过比较原有的坏点位置和本次侦测出的坏点位置,挑出本次侦测多出的坏点存储下来,作为新增的坏点存储到存储介质中。在实际拍摄时,把出厂已有坏点位置和新增的坏点同时校正。当用户不止一次进行操作标定时,同样拍RAW格式照片,软件比较本次坏点和以往所有标定(包括出厂和用户自己标定的)的位置,把本次新增的坏点和以往用户自己标定的坏点一起存储作为新增坏点。In addition, for the drone having the shooting function, the embodiment of the present application further provides another method for marking the new dead point (bright spot): triggering through the menu or virtual button of the App on the mobile phone or the Pad, the command signal The remote control (smart terminal) wirelessly forwards to the camera on the drone, the camera closes the mechanical shutter to create a black environment for the image sensor, and the camera sets a long exposure time, high ISO shooting one or more RAW Format photo, the software reads all the photos and detects all the bad points on the photo; then the software reads the dead spots that the camera has been calibrated before leaving the factory, by comparing the original dead spots and detecting this time. The bad point position, pick out the bad points of this detection and store it as a new bad point to store in the storage medium. In the actual shooting, the factory has a bad point position and a new dead point corrected at the same time. When the user performs the operation calibration more than once, the RAW format photo is also taken. The software compares the position of this dead pixel and all previous calibrations (including the factory and the user's own calibration), and calibrates the newly added dead pixels and the previous users themselves. The bad points are stored together as a new dead point.
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一 些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元表示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of cells is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or integrated. Go to another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, mechanical or otherwise. The units described as separate components may or may not be physically separated, and the components represented as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
应理解,在本申请的各种实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。附图中示出了一些方框图和/或流程图。应理解,方框图和/或流程图中的一些方框或其组合可以由计算机程序指令来实现。这些计算机程序指令可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器,从而这些指令在由该处理器执行时可以创建用于实现这些方框图和/或流程图中所说明的功能/操作的装置。因此,本公开的技术可以硬件和/或软件(包括固件、微代码等)的形式来实现。另外,本公开的技术可以采取存储有指令的计算机可读介质上的计算机程序产品的形式,该计算机程序产品可供指令执行系统(例如,一个或多个处理器)使用或者结合指令执行系统使用。在本公开的上下文中,计算机可读介质可以是能够包含、存储、传送、传播或传输指令的任意介质。It should be understood that, in the various embodiments of the present application, the size of the sequence numbers of the foregoing processes does not mean the order of execution sequence, and the order of execution of each process should be determined by its function and internal logic, and should not be applied to the embodiment of the present application. The implementation process constitutes any limitation. Some block diagrams and/or flowcharts are shown in the drawings. It will be understood that some blocks or combinations of the block diagrams and/or flowcharts can be implemented by computer program instructions. These computer program instructions may be provided to a general purpose computer, a special purpose computer or a processor of other programmable data processing apparatus such that when executed by the processor, the instructions may be used to implement the functions illustrated in the block diagrams and/or flowcharts. / operating device. Thus, the techniques of this disclosure may be implemented in the form of hardware and/or software (including firmware, microcode, etc.). Additionally, the techniques of this disclosure may take the form of a computer program product on a computer readable medium storing instructions for use by or in connection with an instruction execution system (eg, one or more processors) . In the context of the present disclosure, a computer readable medium can be any medium that can contain, store, communicate, propagate or transport the instructions.
最后应说明的是:以上各实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述各实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围,都应涵盖在本申请的保护范围之内。Finally, it should be noted that the above embodiments are only for explaining the technical solutions of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present application. The scope should be covered by the scope of protection of this application.

Claims (22)

  1. 一种图像传感器坏点的检测方法,包括:A method for detecting a dead pixel of an image sensor, comprising:
    对拍摄到的照片或视频帧检测图像坏点的位置;Detecting the position of the image dead point on the captured photo or video frame;
    记录并存储所述照片或视频帧中符合一定条件的多个照片或视频帧的图像坏点的位置;Recording and storing the location of image dead pixels of a plurality of photos or video frames in the photo or video frame that meet certain conditions;
    对被记录的图像坏点的位置进行统计;Counting the position of the recorded image dead pixels;
    将在所述符合一定条件的多个照片或视频帧中一定数量以上的照片或视频帧的每一个中都出现的图像坏点的位置确定为图像传感器坏点的位置。The position of the image dead point appearing in each of a certain number of photos or video frames in the plurality of photos or video frames that meet the certain conditions is determined as the position of the image sensor dead point.
  2. 根据权利要求1所述的图像传感器坏点的检测方法,其中,The method of detecting a dead pixel of an image sensor according to claim 1, wherein
    所述图像传感器坏点包括亮点坏点和暗点坏点。The image sensor dead pixels include bright spot dead pixels and dark spot dead pixels.
  3. 根据权利要求2所述的图像传感器坏点的检测方法,其中,The method of detecting a dead pixel of an image sensor according to claim 2, wherein
    所述一定条件是指照片或视频帧的RAW格式图亮度以及曝光参数均在规定的范围内,并且针对所述亮点坏点和暗点坏点,所述一定条件不同。The certain condition means that the RAW format picture brightness and the exposure parameter of the photo or video frame are within a prescribed range, and the certain conditions are different for the bright point dead point and the dark point dead point.
  4. 根据权利要求3所述的图像传感器坏点的检测方法,其中,The method of detecting a dead pixel of an image sensor according to claim 3, wherein
    在检测所述亮点坏点的情况下,所述一定条件是指照片或视频帧的RAW格式图亮度低于第一亮度值,曝光时间大于第一时长,感光度值高于第一感光度值,In the case of detecting the bright spot dead point, the certain condition means that the RAW format picture brightness of the photo or video frame is lower than the first brightness value, the exposure time is greater than the first time length, and the sensitivity value is higher than the first sensitivity value. ,
    在检测所述暗点坏点的情况下,所述一定条件是指照片或视频帧的RAW格式图亮度高于比第一亮度值大的第二亮度值且小于最高值,曝光时间小于比第一时长短的第二时长,感光度值低于比第一感光度值小的第二感光度值。In the case of detecting the dark spot dead point, the certain condition means that the RAW format picture brightness of the photo or video frame is higher than the second brightness value greater than the first brightness value and less than the highest value, and the exposure time is less than the first For a second duration of time, the sensitivity value is lower than the second sensitivity value that is less than the first sensitivity value.
  5. 根据权利要求1所述的图像传感器坏点的检测方法,其中,The method of detecting a dead pixel of an image sensor according to claim 1, wherein
    当被记录的照片或视频帧达到预定数量,才触发对被记录的图像坏点的位置进行统计。When the recorded photo or video frame reaches a predetermined number, the position of the recorded image dead point is triggered to be counted.
  6. 根据权利要求1所述的图像传感器坏点的检测方法,其中,The method of detecting a dead pixel of an image sensor according to claim 1, wherein
    所述一定数量相对于所述符合一定条件的多个照片或视频帧总数量的百分比为80%。The percentage of the certain number relative to the total number of the plurality of photos or video frames that meet certain conditions is 80%.
  7. 根据权利要求1所述的图像传感器坏点的检测方法,其中,The method of detecting a dead pixel of an image sensor according to claim 1, wherein
    在确定出图像传感器坏点的位置之后,将之前存储的图像坏点的位置删除。After the position of the image sensor dead point is determined, the position of the previously stored image dead point is deleted.
  8. 根据权利要求1所述的图像传感器坏点的检测方法,其中,The method of detecting a dead pixel of an image sensor according to claim 1, wherein
    所述图像传感器坏点是在规定条件下必定会出现的坏点,The image sensor dead point is a dead point that must occur under specified conditions.
    所述图像坏点是即使达到所述规定条件也是概率性出现的坏点。The image dead point is a bad point that occurs probabilistically even if the prescribed condition is reached.
  9. 根据权利要求8所述的图像传感器坏点的检测方法,其中,The method of detecting a dead pixel of an image sensor according to claim 8, wherein
    所述规定条件是指曝光时间大于规定值且图像传感器达到规定温度。The predetermined condition means that the exposure time is greater than a predetermined value and the image sensor reaches a predetermined temperature.
  10. 根据权利要求1至9中的任一项所述的图像传感器坏点的检测方法,其中,The method of detecting an image sensor dead pixel according to any one of claims 1 to 9, wherein
    针对被标记为图像传感器坏点的像素,用其周围同类像素的值经过计算而得到的值代替其值。For a pixel that is marked as a dead pixel of an image sensor, the value obtained by calculating the value of the same type of pixel around it is substituted for its value.
  11. 一种拍摄装置,包括:A photographing device comprising:
    透镜组;Lens group
    图像传感器,将由透镜组获取的光学信息转换成图像数据;An image sensor that converts optical information acquired by the lens group into image data;
    处理器,对拍摄装置整体进行控制;a processor that controls the entire imaging device;
    存储介质,存储有各种数据以及程序,a storage medium that stores various data and programs.
    所述处理器执行:The processor executes:
    对拍摄到的照片或视频帧检测图像坏点的位置;Detecting the position of the image dead point on the captured photo or video frame;
    在所述存储介质中记录并存储所述照片或视频帧中符合一定条件的多个照片或视频帧的图像坏点的位置;Recording and storing, in the storage medium, a position of an image dead point of a plurality of photos or video frames in the photo or video frame that meet certain conditions;
    对被记录的图像坏点的位置进行统计;Counting the position of the recorded image dead pixels;
    将在所述符合一定条件的多个照片或视频帧中一定数量以上的照片或视频帧的每一个中都出现的图像坏点的位置确定为图像传感器坏点的位置。The position of the image dead point appearing in each of a certain number of photos or video frames in the plurality of photos or video frames that meet the certain conditions is determined as the position of the image sensor dead point.
  12. 根据权利要求11所述的拍摄装置,其中,The photographing apparatus according to claim 11, wherein
    所述图像传感器坏点包括亮点坏点和暗点坏点。The image sensor dead pixels include bright spot dead pixels and dark spot dead pixels.
  13. 根据权利要求12所述的拍摄装置,其中,The photographing apparatus according to claim 12, wherein
    所述一定条件是指照片或视频帧的RAW格式图亮度以及曝光参 数均在规定的范围内,并且针对所述亮点坏点和暗点坏点,所述一定条件不同。The certain condition means that the RAW format picture brightness and the exposure parameter of the photo or video frame are within a prescribed range, and the certain conditions are different for the bright point dead point and the dark point dead point.
  14. 根据权利要求13所述的拍摄装置,其中,The photographing apparatus according to claim 13, wherein
    在检测所述亮点坏点的情况下,所述一定条件是指照片或视频帧的RAW格式图亮度低于第一亮度值,曝光时间大于第一时长,感光度值高于第一感光度值,In the case of detecting the bright spot dead point, the certain condition means that the RAW format picture brightness of the photo or video frame is lower than the first brightness value, the exposure time is greater than the first time length, and the sensitivity value is higher than the first sensitivity value. ,
    在检测所述暗点坏点的情况下,所述一定条件是指照片或视频帧的RAW格式图亮度高于比第一亮度值大的第二亮度值且小于最高值,曝光时间小于比第一时长短的第二时长,感光度值低于比第一感光度值小的第二感光度值。In the case of detecting the dark spot dead point, the certain condition means that the RAW format picture brightness of the photo or video frame is higher than the second brightness value greater than the first brightness value and less than the highest value, and the exposure time is less than the first For a second duration of time, the sensitivity value is lower than the second sensitivity value that is less than the first sensitivity value.
  15. 根据权利要求11所述的拍摄装置,其中,The photographing apparatus according to claim 11, wherein
    所述处理器进行控制,使得当被记录的照片或视频帧达到预定数量,才触发对被记录的图像坏点的位置进行统计。The processor controls such that when the recorded photo or video frame reaches a predetermined number, the location of the recorded image dead point is triggered to be counted.
  16. 根据权利要求11所述的拍摄装置,其中,The photographing apparatus according to claim 11, wherein
    所述一定数量相对于所述符合一定条件的多个照片或视频帧总数量的百分比为80%。The percentage of the certain number relative to the total number of the plurality of photos or video frames that meet certain conditions is 80%.
  17. 根据权利要求11所述的拍摄装置,其中,The photographing apparatus according to claim 11, wherein
    所述处理器进行控制,使得在确定出图像传感器坏点的位置之后,将之前存储在所述存储介质中的图像坏点的位置删除。The processor controls such that after determining the position of the image sensor dead point, the position of the image dead point previously stored in the storage medium is deleted.
  18. 根据权利要求11所述的拍摄装置,其中,The photographing apparatus according to claim 11, wherein
    所述图像传感器坏点是在规定条件下必定会出现的坏点,The image sensor dead point is a dead point that must occur under specified conditions.
    所述图像坏点是即使达到所述规定条件也是概率性出现的坏点。The image dead point is a bad point that occurs probabilistically even if the prescribed condition is reached.
  19. 根据权利要求18所述的拍摄装置,其中,The photographing apparatus according to claim 18, wherein
    所述规定条件是指曝光时间大于规定值且图像传感器达到规定温度。The predetermined condition means that the exposure time is greater than a predetermined value and the image sensor reaches a predetermined temperature.
  20. 根据权利要求11至19中的任一项所述的拍摄装置,其中,The photographing apparatus according to any one of claims 11 to 19, wherein
    所述处理器还执行:The processor also executes:
    针对被标记为图像传感器坏点的像素,用其周围同类像素的值经过计算而得到的值代替其值。For a pixel that is marked as a dead pixel of an image sensor, the value obtained by calculating the value of the same type of pixel around it is substituted for its value.
  21. 一种无人机,与智能终端无线通信,所述智能终端对无人机 进行远程控制,该无人机包括:A drone that wirelessly communicates with a smart terminal that remotely controls a drone, the drone including:
    权利要求11至20中的任一项所述的拍摄装置;The photographing apparatus according to any one of claims 11 to 20;
    云台,用来固定所述拍摄装置。A cloud platform for fixing the camera.
  22. 一种计算机可读的存储介质,存储有可执行的程序,该程序被处理器执行时使该处理器执行权利要求1至10中的任一项所述的图像传感器坏点的检测方法。A computer readable storage medium storing an executable program that, when executed by a processor, causes the processor to perform the image sensor dead pixel detection method according to any one of claims 1 to 10.
PCT/CN2018/082502 2018-04-10 2018-04-10 Method for detecting defective pixel of image sensor, and photography apparatus, unmanned aerial vehicle and storage medium WO2019196009A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880017736.6A CN110463199A (en) 2018-04-10 2018-04-10 Dead pixels of image sensor surveys method, filming apparatus, unmanned plane and storage medium
PCT/CN2018/082502 WO2019196009A1 (en) 2018-04-10 2018-04-10 Method for detecting defective pixel of image sensor, and photography apparatus, unmanned aerial vehicle and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/082502 WO2019196009A1 (en) 2018-04-10 2018-04-10 Method for detecting defective pixel of image sensor, and photography apparatus, unmanned aerial vehicle and storage medium

Publications (1)

Publication Number Publication Date
WO2019196009A1 true WO2019196009A1 (en) 2019-10-17

Family

ID=68162746

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/082502 WO2019196009A1 (en) 2018-04-10 2018-04-10 Method for detecting defective pixel of image sensor, and photography apparatus, unmanned aerial vehicle and storage medium

Country Status (2)

Country Link
CN (1) CN110463199A (en)
WO (1) WO2019196009A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112734719A (en) * 2021-01-06 2021-04-30 锐芯微电子股份有限公司 Dead pixel detection method of image sensor, storage medium and shooting device
CN115063342A (en) * 2022-04-27 2022-09-16 珠海视熙科技有限公司 Lens dead pixel detection method and device, electronic equipment and storage medium

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021134714A1 (en) * 2019-12-31 2021-07-08 深圳市大疆创新科技有限公司 Infrared image processing method, defective pixel marking method, and related device
CN110830795B (en) * 2020-01-09 2020-05-19 武汉精立电子技术有限公司 Image sensor dead pixel detection method and device and electronic equipment
WO2022036504A1 (en) * 2020-08-17 2022-02-24 深圳市大疆创新科技有限公司 Imaging method, imaging apparatus, movable object, and unmanned aerial vehicle
CN114095721B (en) * 2020-08-25 2023-04-28 京东方科技集团股份有限公司 Method and device for detecting video dead pixel and computer readable medium
CN112055199A (en) * 2020-09-22 2020-12-08 中国科学技术大学 Scientific grade CMOS camera performance test system and method
CN112656435A (en) * 2020-12-21 2021-04-16 明峰医疗系统股份有限公司 Method for automatically detecting detector dead pixel
CN116193281A (en) * 2021-11-25 2023-05-30 武汉高德智感科技有限公司 Method, device, terminal and computer readable storage medium for correcting dead pixel
CN114666575A (en) * 2022-04-27 2022-06-24 四川创安微电子有限公司 Dead pixel detection and compensation method based on image sensor
CN114727102A (en) * 2022-06-10 2022-07-08 江苏游隼微电子有限公司 Driving-assistant camera dead pixel correction optimization method
CN117671545B (en) * 2024-01-31 2024-04-19 武汉华测卫星技术有限公司 Unmanned aerial vehicle-based reservoir inspection method and system

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080151082A1 (en) * 2006-12-22 2008-06-26 Chen-Hung Chan Dead pixel real-time detection method for image
CN101212703A (en) * 2006-12-29 2008-07-02 华晶科技股份有限公司 Real-time bad image pixel detection method
CN101277385A (en) * 2007-03-27 2008-10-01 三星电子株式会社 Method and apparatus to detect a dead pixel of an image sensor and method and apparatus to capture an image from an image sensor
CN101715050A (en) * 2009-11-20 2010-05-26 北京中星微电子有限公司 Method and system for detecting dead pixels of image sensor
CN101895786A (en) * 2010-07-15 2010-11-24 杭州海康威视软件有限公司 Detection method and device for image sensor
US20120105648A1 (en) * 2010-10-29 2012-05-03 Hynix Semiconductor Inc. Dead pixel compensation testing apparatus
CN105163114A (en) * 2015-08-21 2015-12-16 深圳创维-Rgb电子有限公司 Method and system for detecting screen dead pixel based on camera
CN105430385A (en) * 2015-12-14 2016-03-23 上海富瀚微电子股份有限公司 Method and device for dead pixel detection and correction of image sensor
CN105991997A (en) * 2015-03-06 2016-10-05 成都方程式电子有限公司 Capacitive image sensor dead pixel real-time positioning method
CN107613229A (en) * 2017-09-30 2018-01-19 杭州雄迈集成电路技术有限公司 A kind of dead pixels of image sensor surveys means for correcting and method

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080151082A1 (en) * 2006-12-22 2008-06-26 Chen-Hung Chan Dead pixel real-time detection method for image
CN101212703A (en) * 2006-12-29 2008-07-02 华晶科技股份有限公司 Real-time bad image pixel detection method
CN101277385A (en) * 2007-03-27 2008-10-01 三星电子株式会社 Method and apparatus to detect a dead pixel of an image sensor and method and apparatus to capture an image from an image sensor
CN101715050A (en) * 2009-11-20 2010-05-26 北京中星微电子有限公司 Method and system for detecting dead pixels of image sensor
CN101895786A (en) * 2010-07-15 2010-11-24 杭州海康威视软件有限公司 Detection method and device for image sensor
US20120105648A1 (en) * 2010-10-29 2012-05-03 Hynix Semiconductor Inc. Dead pixel compensation testing apparatus
CN105991997A (en) * 2015-03-06 2016-10-05 成都方程式电子有限公司 Capacitive image sensor dead pixel real-time positioning method
CN105163114A (en) * 2015-08-21 2015-12-16 深圳创维-Rgb电子有限公司 Method and system for detecting screen dead pixel based on camera
CN105430385A (en) * 2015-12-14 2016-03-23 上海富瀚微电子股份有限公司 Method and device for dead pixel detection and correction of image sensor
CN107613229A (en) * 2017-09-30 2018-01-19 杭州雄迈集成电路技术有限公司 A kind of dead pixels of image sensor surveys means for correcting and method

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112734719A (en) * 2021-01-06 2021-04-30 锐芯微电子股份有限公司 Dead pixel detection method of image sensor, storage medium and shooting device
CN112734719B (en) * 2021-01-06 2023-08-11 锐芯微电子股份有限公司 Dead pixel detection method of image sensor, storage medium and shooting device
CN115063342A (en) * 2022-04-27 2022-09-16 珠海视熙科技有限公司 Lens dead pixel detection method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN110463199A (en) 2019-11-15

Similar Documents

Publication Publication Date Title
WO2019196009A1 (en) Method for detecting defective pixel of image sensor, and photography apparatus, unmanned aerial vehicle and storage medium
JP6065474B2 (en) Imaging control apparatus, imaging control method, and program
CN110933275B (en) Photographing method and related equipment
US10477106B2 (en) Control system, imaging device, and computer-readable medium
CN101277385B (en) Method and apparatus to detect a dead pixel of an image sensor and method and apparatus to capture an image from an image sensor
KR101374971B1 (en) Reduced position dependent noise in digital images
US11050987B2 (en) Method and apparatus for determining fisheye camera shadow correction parameter
KR102336030B1 (en) Electric vehicle charger fire detection and charger condition prediction system
US8311280B2 (en) Image processing apparatus and image processing method
US9544516B2 (en) Method and apparatus for sensor characterization
US10636174B2 (en) Abnormality detection system, abnormality detection method, and program
US20240320794A1 (en) Image processing method and related device thereof
CN107704798A (en) Image weakening method, device, computer-readable recording medium and computer equipment
WO2021022989A1 (en) Calibration parameter obtaining method and apparatus, processor, and electronic device
US20190289269A1 (en) Image white balance correction method and electronic device
JP2017059927A (en) User terminal, color correction system, and color correction method
US10200572B1 (en) Motion detection
US10887525B2 (en) Delivery of notifications for feedback over visual quality of images
US20200351488A1 (en) Three-dimensional information acquisition system using pitching practice, and method for calculating camera parameters
JP2013239772A (en) Image processing device and control method thereof
JP6041523B2 (en) Image processing apparatus and method
WO2020056629A1 (en) Bayer image detection method and device and machine-readable storage medium
JP2020088419A (en) Imaging apparatus, image correction method, and program
CN111488772B (en) Method and device for detecting smoke
JP6957374B2 (en) Image sensors, sensing systems, sensing methods and programs

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18914378

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18914378

Country of ref document: EP

Kind code of ref document: A1