WO2016003106A2 - Capteur matriciel pour caméra à ouvertures multiples - Google Patents

Capteur matriciel pour caméra à ouvertures multiples Download PDF

Info

Publication number
WO2016003106A2
WO2016003106A2 PCT/KR2015/006421 KR2015006421W WO2016003106A2 WO 2016003106 A2 WO2016003106 A2 WO 2016003106A2 KR 2015006421 W KR2015006421 W KR 2015006421W WO 2016003106 A2 WO2016003106 A2 WO 2016003106A2
Authority
WO
WIPO (PCT)
Prior art keywords
signal
sensor array
cell
white
processing
Prior art date
Application number
PCT/KR2015/006421
Other languages
English (en)
Korean (ko)
Other versions
WO2016003106A3 (fr
Inventor
박종호
최상길
경종민
Original Assignee
재단법인 다차원 스마트 아이티 융합시스템 연구단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 재단법인 다차원 스마트 아이티 융합시스템 연구단 filed Critical 재단법인 다차원 스마트 아이티 융합시스템 연구단
Publication of WO2016003106A2 publication Critical patent/WO2016003106A2/fr
Publication of WO2016003106A3 publication Critical patent/WO2016003106A3/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/131—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing infrared wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/133—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing panchromatic light, e.g. filters passing white light

Definitions

  • the present invention relates to a sensor array of a multi aperture camera, and more particularly, by configuring the sensor array to include at least one white cell and at least one IR (infrared) cell. It is a technique to improve the signal to noise ratio (SNR) of the signals processed in the sensor array.
  • SNR signal to noise ratio
  • the sensor array of a conventional dual aperture camera includes RGB cells and IR cells, whereby R cells, G cells, B cells, and IR cells (four cells) are formed in a set.
  • the existing sensor array is formed to include an IR cell 120 and an RGB cell 130 within the set 110. .
  • the RGB signal since the RGB signal selectively transmits only a specific wavelength band by the color filter, the optical power of incident light is limited so that the signal-to-noise ratio of the RGB signal processed by the RGB cell 130 may have a small value.
  • the signal-to-noise ratio of the IR signal since the IR signal is processed in one IR cell 120 in the set 110 in the conventional sensor array, the signal-to-noise ratio of the IR signal may have a small value because the area of the light receiving unit where the IR signal is sensed is small. .
  • the conventional sensor array uses an image composed of an RGB signal having a small signal-to-noise ratio value and an image composed of an IR signal having a small signal-to-noise ratio value between the subject and the sensor array from the sharpness of the image included in each image. In the process of determining the distance of P, the depth accuracy is poor.
  • the present specification proposes a technique for improving the signal-to-noise ratio of signals processed by the sensor array by configuring the sensor array of the dual aperture camera to include at least one white cell and at least one IR cell.
  • Embodiments of the present invention include at least one white cell and at least one IR cell, thereby providing a sensor array of a dual aperture camera that widens the light wavelength and the light receiving area of an incoming signal, and the distance between the object and the sensor array using the same. Provide a way to make decisions.
  • embodiments of the present invention by increasing the light wavelength and the light receiving area of the incoming signal, the sensor array of the dual aperture camera to improve the signal-to-noise ratio of the output signals from the sensor and the distance between the object and the sensor array using the same Provide a way to make decisions.
  • embodiments of the present invention by improving the signal-to-noise ratio of the output signals from the sensor, in the process of determining the distance between the subject and the sensor array, the sensor array and the subject using the dual aperture camera to improve the distance accuracy
  • a method of determining the distance between sensor arrays is provided.
  • embodiments of the present invention when a plurality of at least one white cell or at least one IR cell each includes a plurality of signals, by applying a binning technique that adds the charge of at least two pixels for each pixel of the same type A sensor array of a dual aperture camera that improves a noise ratio and a method of determining a distance between a subject and a sensor array using the same are provided.
  • a sensor array of a dual aperture camera includes at least one white cell for processing a black and white signal; And at least one IR cell for processing an infrared (IR) signal.
  • IR infrared
  • the at least one white cell and the at least one IR cell may be disposed in a single plane.
  • the plurality of the at least one white cell may be arranged to be connected to each other in a single plane.
  • the at least one IR cell may be arranged to be connected to each other in a single plane.
  • a dual aperture camera includes a lens; A lens iris for adjusting an inflow amount of at least one of a black and white signal or an infrared (IR) signal; An IR cut-off filter for adjusting an inflow wavelength of the IR signal; And a sensor array for processing the monochrome signal and the IR signal, wherein the sensor array comprises at least one white cell for processing the monochrome signal; And at least one IR cell for processing the IR signal.
  • IR infrared
  • the at least one white cell and the at least one IR cell may be disposed in a single plane.
  • the plurality of the at least one white cell may be arranged to be connected to each other in a single plane.
  • the at least one IR cell may be arranged to be connected to each other in a single plane.
  • an image including a black and white signal is obtained from at least one white cell included in the sensor array.
  • the at least one white cell and the at least one IR cell may be disposed in a single plane.
  • Embodiments of the present invention include at least one white cell and at least one IR cell, thereby providing a sensor array of a dual aperture camera that widens the light wavelength and the light receiving area of an incoming signal, and the distance between the object and the sensor array using the same. It may provide a way to make a decision.
  • embodiments of the present invention by increasing the light wavelength and the light receiving area of the incoming signal, the sensor array of the dual aperture camera to improve the signal-to-noise ratio of the output signals from the sensor and the distance between the object and the sensor array using the same It may provide a way to make a decision.
  • embodiments of the present invention by improving the signal-to-noise ratio of the output signals from the sensor, in the process of determining the distance between the subject and the sensor array, the sensor array and the subject using the dual aperture camera to improve the distance accuracy
  • a method of determining the distance between sensor arrays can be provided.
  • embodiments of the present invention improve the signal-to-noise ratio by applying a binning technique in which charges of at least two pixels are summed for each pixel of the same type when at least one white cell or at least one IR cell includes a plurality of cells.
  • a sensor array of a dual aperture camera and a method of determining a distance between a subject and a sensor array using the same may be provided.
  • FIG. 1 is a diagram illustrating a pixel structure of a sensor array of a conventional dual aperture camera.
  • FIG. 2 is a view showing the structure of a dual aperture camera according to an embodiment of the present invention.
  • FIG. 3 is a diagram illustrating a pixel structure of a sensor array according to a first exemplary embodiment of the present invention.
  • FIG. 4 is a diagram illustrating a pixel structure of a sensor array according to a second exemplary embodiment of the present invention.
  • FIG. 5 is a diagram illustrating a pixel structure of a sensor array according to a third exemplary embodiment of the present invention.
  • FIG. 6 is a flowchart illustrating a method of recognizing a subject using a sensor array according to an exemplary embodiment of the present invention.
  • FIG. 2 is a view showing the structure of a dual aperture camera according to an embodiment of the present invention.
  • a dual aperture camera includes a lens 210, a lens aperture 220, an IR cut-off filter 230, and a sensor array 240.
  • the dual aperture camera in the case of not including the ISP by performing the function of the image signal processor (ISP) in the sensor array 240, but is not limited to this, the dual aperture camera described above The same may apply to the case of including an ISP.
  • ISP image signal processor
  • the lens stop 220 adjusts the inflow of the optical signal (for example, the optical signal including the monochrome signal and the IR signal) incident through the lens 210.
  • the optical signal for example, the optical signal including the monochrome signal and the IR signal
  • the IR wavelength is controlled by the IR cut-off filter 230.
  • the IR cut-off filter 230 may filter the IR signal and introduce the IR signal into the sensor array 240 through the included pin hole 231.
  • the amount of light of the IR signal flowing through the pinhole 231 is 1/1 compared to the remaining light signal flowing through the lens aperture 220. Can be on the order of 10 to 1/6.
  • the sensor array 240 increases the number of pixels sensing the incoming IR signal, and furthermore, by applying the binning technique, it is possible to more efficiently sense the IR signal having a small amount of light. Therefore, the signal-to-noise ratio of the IR signal processed by the sensor array 240 can be improved compared to the conventional.
  • the sensor array 240 is configured to include at least one white cell instead of the RGB cell, so that instead of processing the RGB signal having a narrow light wavelength, a monochrome having a wide light wavelength You can process the signal.
  • sensor array 240 may be configured to include two or more white cells. Therefore, since the sensor array 240 processes a signal having a wider wavelength than the conventional sensor array, the signal-to-noise ratio of the signal to be processed may be improved as compared with the conventional one. Detailed description thereof will be described below.
  • FIG. 3 is a diagram illustrating a pixel structure of a sensor array according to a first exemplary embodiment of the present invention.
  • the sensor array according to the first embodiment of the present invention includes at least one white cell for processing a monochrome signal and at least one IR cell for processing an IR signal (eg, two sensor arrays). Or more white cells).
  • the sensor array may be formed by forming a set 330 with three white cells 310 and one IR cell 320, and including a plurality of sets 330.
  • three white cells 310 and one IR cell 320 may be disposed in a single plane.
  • the plurality of sets 330 may also be arranged in a single plane.
  • the sensor array according to the first embodiment of the present invention includes three white cells 310 in the set 330 instead of processing RGB signals having narrow optical wavelengths including the RGB cells. Since the monochrome signal having the wavelength is processed, the signal-to-noise ratio of the signal to be processed can be improved.
  • the three white cells 310 may be arranged to be connected to each other in a single plane.
  • each of the three white cells 310 may be arranged to be connected to each other left, right, and up and down. Therefore, since the binning technique of adding the black and white signal at the charge level is applied to the process of processing the black and white signal in the three white cells 310, the signal-to-noise ratio of the processed black and white signal can be efficiently improved. Detailed description of the binning technology will be omitted since it departs from the technical idea of the present invention.
  • the sensor array according to the first embodiment of the present invention includes three white cells 310 for processing a monochrome signal having a wide optical wavelength in the set 330, the signal-to-noise ratio of the monochrome signal to be processed is This has the advantage of maximizing the value.
  • FIG. 4 is a diagram illustrating a pixel structure of a sensor array according to a second exemplary embodiment of the present invention.
  • the sensor array according to the second embodiment of the present invention includes at least one white cell for processing a monochrome signal and at least one IR cell for processing an IR signal (eg, two sensor arrays). Or more white cells).
  • the sensor array may be formed by forming a set 430 with two white cells 410 and two IR cells 420, and including a plurality of sets 430.
  • two white cells 410 and two IR cells 420 may be disposed in a single plane.
  • the plurality of sets 430 may also be arranged in a single plane.
  • the sensor array according to the second embodiment of the present invention includes two white cells 410 in the set 430 instead of processing RGB signals having narrow optical wavelengths, including RGB cells. Since the monochrome signal having the wavelength is processed, the signal-to-noise ratio of the signal to be processed can be improved.
  • the sensor array according to the second embodiment of the present invention includes two IR cells 420 in the set 430, the number of pixels sensing the IR signal can be increased in comparison with the conventional sensor array. have. Therefore, the signal-to-noise ratio of the IR signal to be processed can be improved.
  • the two white cells 410 may be arranged to be connected to each other left and right or up and down in a single plane, and the two IR cells 420 may also be arranged to be connected to each other left and right or up and down in a single plane. Therefore, since the binning technique of adding the black and white signal at the charge level is applied to the processing of the black and white signal in the two white cells 410, the signal-to-noise ratio of the processed black and white signal can be efficiently improved. In addition, since the binning technique of adding the IR signal at the charge level is applied to the process of processing the IR signal in the two IR cells 420, the signal-to-noise ratio of the IR signal to be processed can be efficiently improved.
  • each of the two white cells 410 is disposed to be connected to each other from side to side, and each of the two IR cells 420 is shown to be arranged to be connected to each other from side to side, but the present invention is not limited thereto.
  • Each of the plurality of IR cells 420 may be arranged to be connected to each other vertically or diagonally.
  • the sensor array according to the second embodiment of the present invention includes two white cells 410 and two IR cells 420 in the set 430, a process of processing a monochrome signal and an IR signal may be performed. There is an advantage that can be applied to the binning technique in all the process of processing.
  • FIG. 5 is a diagram illustrating a pixel structure of a sensor array according to a third exemplary embodiment of the present invention.
  • a sensor array includes at least one white cell for processing a black and white signal and at least one IR cell for processing an IR signal.
  • the sensor array may be formed by forming a set 530 with one white cell 510 and three IR cells 520 and including a plurality of sets 530.
  • one white cell 510 and three IR cells 520 may be disposed in a single plane.
  • the plurality of sets 530 may also be arranged in a single plane.
  • the sensor array according to the third embodiment of the present invention includes one white cell 510 in the set 530 instead of processing an RGB signal having a narrow optical wavelength including the RGB cell. Since the monochrome signal having the wavelength is processed, the signal-to-noise ratio of the signal to be processed can be improved.
  • the sensor array according to the third embodiment of the present invention includes three IR cells 520 in the set 530, the number of pixels for sensing an IR signal can be increased in comparison with a conventional sensor array. have. Therefore, the signal-to-noise ratio of the IR signal to be processed can be improved.
  • the three IR cells 520 may be arranged to be connected to each other from left to right or up and down in a single plane. Therefore, since the binning technique of adding the IR signal at the charge level is applied to the process of processing the IR signal in the three IR cells 520, the signal-to-noise ratio of the IR signal to be processed can be efficiently improved.
  • the sensor array according to the third embodiment of the present invention includes three IR cells 520 in the set 530, the number of pixels for sensing the IR signal is increased, and thus the signal band of the IR signal to be processed is increased. There is an advantage to maximize the noise ratio value.
  • Such a sensor array may be optimized and used in an indoor environment lacking an IR signal.
  • FIG. 6 is a flowchart illustrating a method of recognizing a subject using a sensor array according to an exemplary embodiment of the present invention.
  • a dual aperture camera processes a black and white signal to obtain an image composed of a black and white signal in at least one white cell included in a sensor array (610).
  • the dual aperture camera processes the black and white signal having the wide light wavelength by using at least one white cell instead of processing the RGB signal having the narrow light wavelength by using the RGB cell.
  • Signal-to-noise ratio can be improved.
  • the dual aperture camera processes the IR signal to obtain an image composed of the IR signal in at least one IR (infrared) cell included in the sensor array (620).
  • the dual aperture camera may increase the area of the light receiving unit sensing the IR signal by increasing the number of at least one IR cell included in the sensor array. Therefore, the dual aperture camera can improve the signal-to-noise ratio of the IR signal to be processed.
  • At least one white cell and at least one IR cell may be arranged in a single plane.
  • the plurality of at least one white cell may be arranged to be connected to each other, and when the at least one IR cell is included in a plurality, the plurality of at least one IR cell may include It may be arranged to be connected to each other.
  • the dual aperture camera may apply a binning technique of adding an IR signal at a charge level in a process of processing a monochrome signal or processing an IR signal.
  • the dual aperture camera determines a distance between the sensor array and the subject based on a blur change for the subject included in each of the image composed of the monochrome signal and the image composed of the IR signal.
  • the dual aperture camera may use various conventional algorithms as an algorithm for determining the distance between the sensor array and the subject. For example, the dual aperture camera obtains a plurality of blur patches through predetermined processing on an image composed of an IR signal, and an image composed of a black and white signal for each of the obtained plurality of blur patches. By calculating the difference value with, the value having the least error among the plurality of difference values may be determined as the distance between the sensor array and the subject.
  • the dual aperture camera recognizes the subject using the distance between the sensor array and the subject based on at least one of an image composed of a black and white signal or an image composed of an IR signal (640).
  • the dual aperture camera that recognizes a subject uses an image composed of a black and white signal
  • the dual aperture camera may be used for a purpose such as gesture recognition that does not require an RGB image.

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Color Television Image Signal Generators (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

Capteur matriciel pour caméra à double ouverture, ledit capteur matriciel comprenant au moins un élément blanc pour le traitement d'un signal noir et blanc, et au moins un élément infrarouge (IR) pour le traitement d'un signal IR.
PCT/KR2015/006421 2014-07-01 2015-06-24 Capteur matriciel pour caméra à ouvertures multiples WO2016003106A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020140081893A KR101575964B1 (ko) 2014-07-01 2014-07-01 듀얼 애퍼처 카메라의 센서 어레이
KR10-2014-0081893 2014-07-01

Publications (2)

Publication Number Publication Date
WO2016003106A2 true WO2016003106A2 (fr) 2016-01-07
WO2016003106A3 WO2016003106A3 (fr) 2017-05-26

Family

ID=55020059

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/006421 WO2016003106A2 (fr) 2014-07-01 2015-06-24 Capteur matriciel pour caméra à ouvertures multiples

Country Status (2)

Country Link
KR (1) KR101575964B1 (fr)
WO (1) WO2016003106A2 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101764504B1 (ko) * 2015-12-15 2017-08-03 재단법인 다차원 스마트 아이티 융합시스템 연구단 블러 채널을 적응적으로 선택하는 멀티 애퍼처 카메라 및 그 동작 방법
KR101684194B1 (ko) * 2015-12-17 2016-12-07 재단법인 다차원 스마트 아이티 융합시스템 연구단 초점 맞는 피사체 거리 스캔(focusing distance scan)을 통하여 깊이 정확도를 향상시키는 멀티 애퍼처 카메라 시스템
DE102018222865A1 (de) * 2018-12-21 2020-06-25 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung mit einer Multiaperturabbildungsvorrichtung zur Erzeugung einer Tiefenkarte

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100858034B1 (ko) * 2007-10-18 2008-09-10 (주)실리콘화일 단일 칩 활력 이미지 센서
KR101475464B1 (ko) * 2008-05-09 2014-12-22 삼성전자 주식회사 적층형 이미지 센서
US20120154596A1 (en) * 2009-08-25 2012-06-21 Andrew Augustine Wajs Reducing noise in a color image

Also Published As

Publication number Publication date
WO2016003106A3 (fr) 2017-05-26
KR101575964B1 (ko) 2015-12-11

Similar Documents

Publication Publication Date Title
US10033949B2 (en) Imaging systems with high dynamic range and phase detection pixels
EP4398304A3 (fr) Capteur d'image comprenant un réseau de lentilles de séparation de couleurs et dispositif électronique comprenant le capteur d'image
EP2696570B1 (fr) Réseau de lentilles pour capteur d'images partitionnées avec filtres couleurs
US20170295332A1 (en) Image sensor, output method, phase focusing method, imaging device, and terminal
WO2014189232A1 (fr) Capteur électronique et méthode de commande de celui-ci
US20150381869A1 (en) Image processing methods for image sensors with phase detection pixels
KR20180133157A (ko) 위상 검출 픽셀을 포함하는 이미지 센서
WO2016003106A2 (fr) Capteur matriciel pour caméra à ouvertures multiples
CN112235494B (zh) 图像传感器、控制方法、成像装置、终端及可读存储介质
WO2015005672A1 (fr) Appareil et procédé de génération d'image et support enregistrable non transitoire
WO2013137637A1 (fr) Appareil d'imagerie et capteur d'image correspondant
CN104064577A (zh) 自动对焦的图像传感器
WO2023179527A1 (fr) Module de caméra, procédé de commande pour module de caméra et dispositif électronique
WO2015178509A1 (fr) Capteur d'image à structures de pixels hétérogènes
WO2021137555A1 (fr) Dispositif électronique comprenant un capteur d'image et son procédé de fonctionnement
WO2016098912A1 (fr) Réseau de capteurs pour caméra à ouvertures multiples, et son procédé de fonctionnement
WO2019088407A1 (fr) Module appareil photo comprenant une matrice de filtres colorés complémentaires et dispositif électronique le comprenant
US9847360B2 (en) Two-side illuminated image sensor
WO2014077475A1 (fr) Capteur d'image cmos comprenant une microlentille de couleur et son procédé de fabrication
KR102148128B1 (ko) 상보적인 픽슬렛 구조가 적용된 카메라 시스템
CN203350517U (zh) 阵列式镜头模组
WO2023277665A1 (fr) Dispositif électronique et son procédé de commande
CN104079903A (zh) 高动态范围的彩色及灰度图像传感器
WO2023038459A1 (fr) Dispositif électronique et son procédé de commande
WO2017034076A1 (fr) Capteur d'image, appareil de traitement d'image numérique à l'aide de ce dernier, et procédé de traitement de signal d'image correspondant

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15814671

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15814671

Country of ref document: EP

Kind code of ref document: A2