TW201841493A - Image Sensing Method and Image Sensor with Rolling Exposure Time Compensation - Google Patents

Image Sensing Method and Image Sensor with Rolling Exposure Time Compensation Download PDF

Info

Publication number
TW201841493A
TW201841493A TW106129510A TW106129510A TW201841493A TW 201841493 A TW201841493 A TW 201841493A TW 106129510 A TW106129510 A TW 106129510A TW 106129510 A TW106129510 A TW 106129510A TW 201841493 A TW201841493 A TW 201841493A
Authority
TW
Taiwan
Prior art keywords
image
exposure time
rolling
exposure
compensation
Prior art date
Application number
TW106129510A
Other languages
Chinese (zh)
Inventor
何闓廷
謝承恩
張櫸馨
狄敬隆
鄒伊秦
蔡惠民
余儒育
Original Assignee
曦威科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 曦威科技股份有限公司 filed Critical 曦威科技股份有限公司
Priority to US15/858,572 priority Critical patent/US20180191935A1/en
Publication of TW201841493A publication Critical patent/TW201841493A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/13—Sensors therefor
    • G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/725—Details of waveform analysis using specific filters therefor, e.g. Kalman or adaptive filters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—
    • G06T5/73—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/1347—Preprocessing; Feature extraction
    • G06V40/1359—Extracting features related to ridge properties; Determining the fingerprint type, e.g. whorl or loop
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/1365—Matching; Classification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/1382—Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/13—Sensors therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Cardiology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Biophysics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Physiology (AREA)
  • Artificial Intelligence (AREA)
  • Psychiatry (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Processing (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
  • Image Input (AREA)
  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

The present invention provides an image sensing method and an image sensor with rolling exposure time compensation. The image sensing method includes: emitting light to a sensed object to generate an image; providing a sensing device, which has plural sensing units arranged to plural columns and plural rows; receiving the image by the sensing device with a rolling exposure method; controlling a rolling shutter, such that when the sensing device receives the image with the rolling exposure method, adaptively determining exposure time of at least one exposure row.

Description

具有滾動曝光時間補償之影像感測方法與影像感測器Image sensing method and image sensor with rolling exposure time compensation

本發明係有關一種具有滾動曝光時間補償之影像感測方法與影像感測器，特別是指一種根據影像亮度訊號而適應性決定至少一曝光列之曝光時間的具有滾動曝光時間補償之影像感測方法與影像感測器。The present invention relates to an image sensing method and image sensor with rolling exposure time compensation, in particular to an image sensing with rolling exposure time compensation that adaptively determines the exposure time of at least one exposure row according to the image brightness signal. Method and image sensor.

先前技術以滾動式曝光方式之影像感測方法與影像感測器，其可分為利用機械式滾動快門與電子式滾動快門兩種方式。無論用機械式滾動快門或是電子式滾動快門，例如在指紋辨識的應用範圍，都有因為光源安排的方式，使得在不同列或在不同行在其曝光後感測影像而產生的影像照片，會有亮度不均勻的狀況，使得指紋難以辨識。In the prior art, the image sensing method and the image sensor using a rolling exposure method can be divided into two methods: using a mechanical rolling shutter and an electronic rolling shutter. Whether using a mechanical rolling shutter or an electronic rolling shutter, for example, in the application area of fingerprint recognition, there are image photos generated by sensing the image in different columns or in different rows after exposure, because of the way the light source is arranged. There will be uneven brightness, making fingerprints difficult to identify.

有鑑於此，本發明即針對上述先前技術之不足，提出一種根據影像亮度訊號而適應性決定至少一曝光列之曝光時間的具有滾動曝光時間補償之影像感測方法與影像感測器。In view of this, the present invention addresses the shortcomings of the foregoing prior art, and proposes an image sensing method and image sensor with rolling exposure time compensation that adaptively determines the exposure time of at least one exposure row according to the image brightness signal.

就其中一個觀點言，本發明提供了一種具有滾動曝光時間補償之影像感測方法，包含：發射光線至一待感測物以產生一影像；提供一感測元件，具有複數感測單元，排列為複數行(column)與複數列(row)；以滾動式曝光方式而使該感測元件接收該影像；控制一滾動快門，使得該感測元件以滾動式曝光方式接收該影像時，根據一影像亮度訊號而適應性決定至少一曝光列之曝光時間。According to one of the viewpoints, the present invention provides an image sensing method with rolling exposure time compensation, including: emitting light to an object to be sensed to generate an image; and providing a sensing element having a plurality of sensing units arranged. For a plurality of columns and a plurality of rows; using a rolling exposure method to cause the sensing element to receive the image; controlling a rolling shutter so that the sensing element receives the image in a rolling exposure manner, according to a The image brightness signal adaptively determines the exposure time of at least one exposure row.

在其中一種較佳的實施例中，該控制一滾動快門，使得該感測元件以滾動式曝光方式接收該影像時，根據一影像亮度訊號而適應性決定至少一曝光列之曝光時間之步驟，包括：控制該滾動快門，使得該感測元件於一準備期間，以滾動式曝光方式接收該影像時，該曝光列之一第一次曝光時間為一預設曝光時間，而完成一準備影像掃描，並據以產生該影像亮度訊號；以及於該準備期間之後一補償期間，根據該影像亮度訊號，而於該補償期間，決定該至少一曝光列之一第二次曝光時間；其中，該曝光時間包括該第二次曝光時間。In one of the preferred embodiments, the step of controlling a rolling shutter such that when the sensing element receives the image in a rolling exposure manner, adaptively determines the exposure time of at least one exposure row according to an image brightness signal, Including: controlling the rolling shutter so that when the sensing element receives the image in a rolling exposure manner during a preparation period, the first exposure time of one of the exposure columns is a preset exposure time, and a preparation image scan is completed , And generate the image brightness signal accordingly; and in a compensation period after the preparation period, based on the image brightness signal, and during the compensation period, determine a second exposure time of the at least one exposure column; wherein, the exposure Time includes this second exposure time.

在前述的實施例中，該根據該影像亮度訊號，而決定於該補償期間，該至少一曝光列之一第二次曝光時間之步驟，較佳地更包含：根據一預設目標值，而於該補償期間，決定該至少一曝光列之該第二次曝光時間。In the foregoing embodiment, the step of determining the second exposure time of one of the at least one exposure row based on the image brightness signal during the compensation period preferably further includes: according to a preset target value, and During the compensation period, the second exposure time of the at least one exposure row is determined.

在前述的實施例中，該影像亮度訊號，較佳地係根據一原始影像亮度訊號經由平滑化處理後之結果。In the foregoing embodiment, the image brightness signal is preferably the result of smoothing processing based on an original image brightness signal.

在其中一種較佳的實施例中，該光源鄰置於該複數列中之一第一列或/及一最後一列之外側。In one of the preferred embodiments, the light source is located adjacent to a first column or / and a last column of the plurality of columns.

就另一個觀點言，本發明提供了一種具有滾動曝光時間補償之影像感測方法，包含：發射光線至一待感測物以產生一影像；提供一感測元件，具有複數感測單元，排列為複數行(column)與複數列(row)；以滾動式曝光方式而使該感測元件接收該影像；控制一滾動快門，使得該感測元件於一準備期間，以滾動式曝光方式接收該影像時，設定至少一曝光列之一第一次曝光時間為一預設曝光時間，而完成一準備影像掃描，並據以產生一影像亮度訊號；以及於該準備期間之後一補償期間，根據該影像亮度訊號，決定至少一單元曝光時間，而完成至少一單元影像掃描，並根據該準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊。According to another aspect, the present invention provides an image sensing method with rolling exposure time compensation, including: emitting light to an object to be sensed to generate an image; providing a sensing element having a plurality of sensing units arranged For a plurality of columns and a plurality of rows; the rolling element is used for the sensing element to receive the image; and a rolling shutter is controlled so that the sensing element receives the rolling element for the rolling element during a preparation period. When imaging, set the first exposure time of at least one exposure row to a preset exposure time, complete a preparation image scan, and generate an image brightness signal accordingly; and a compensation period after the preparation period, according to the The image brightness signal determines at least one unit exposure time, completes at least one unit image scan, and generates a combined image information according to the prepared image scan and the at least one unit image scan.

在其中一種較佳的實施例中，該於該準備期間之後一補償期間，根據該影像亮度訊號，決定至少一單元曝光時間，而完成至少一單元影像掃描，並根據該準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊之步驟包括：根據該影像亮度訊號與一亮度閾值，而產生一亮度輪廓線，進而於該補償期間，根據該亮度輪廓線，決定該至少一單元曝光時間，而完成該至少一單元影像掃描。In a preferred embodiment, at least one unit exposure time is determined according to the image brightness signal in a compensation period after the preparation period, and at least one unit image scan is completed, and according to the preparation image scan and the at least one The step of generating a combined image information by scanning a unit image includes generating a brightness contour line according to the image brightness signal and a brightness threshold, and then determining the exposure time of the at least one unit during the compensation period based on the brightness contour line. And complete the at least one unit image scan.

在前述的實施例中，該於該準備期間之後一補償期間，根據該影像亮度訊號，決定至少一單元曝光時間，而完成至少一單元影像掃描，並根據該準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊之步驟包括：根據該影像亮度訊號中之一單列影像亮度訊號，決定該至少一單元曝光時間，而完成該至少一單元影像掃描。In the foregoing embodiment, in a compensation period after the preparation period, at least one unit exposure time is determined according to the image brightness signal, and at least one unit image scan is completed, and according to the preparation image scan and the at least one unit image The step of scanning to generate a combination of image information includes: determining the at least one unit exposure time according to a single-line image brightness signal in the image brightness signal, and completing the at least one unit image scan.

在前述的實施例中，該光源鄰置於該複數行中之一第一行或/及一最後一行之外側。In the foregoing embodiment, the light source is located adjacent to a first row or / and a last row of the plurality of rows.

在其中一種較佳的實施例中，該待感測物包括一手指，且該影像包括一指紋影像，該光源發射光線至該手指，以產生該指紋影像。In a preferred embodiment, the object to be sensed includes a finger, and the image includes a fingerprint image, and the light source emits light to the finger to generate the fingerprint image.

就另一個觀點言，本發明提供了一種具有滾動曝光時間補償之影像感測器，用以感測一影像，其包含：一感測元件，具有複數感測單元，排列為複數行(column)與複數列(row)，該感測元件以滾動式曝光方式而接收該影像；一光源，用以發射光線至一待感測物以產生該影像；以及一曝光時間補償電路，與該感測元件耦接，用以控制一滾動快門，使得該感測元件以滾動式曝光方式接收該影像時，根據一影像亮度訊號而適應性決定至少一曝光列之曝光時間。According to another aspect, the present invention provides an image sensor with rolling exposure time compensation for sensing an image, which includes: a sensing element having a plurality of sensing units arranged in a plurality of columns And a plurality of rows, the sensing element receives the image in a rolling exposure mode; a light source for emitting light to an object to be sensed to generate the image; and an exposure time compensation circuit for the sensing The element is coupled to control a rolling shutter, so that when the sensing element receives the image in a rolling exposure manner, the exposure time of at least one exposure row is adaptively determined according to an image brightness signal.

在其中一種較佳的實施例中，該曝光時間補償電路控制該滾動快門，使得該感測元件於一準備期間，以滾動式曝光方式接收該影像時，該曝光列之一第一次曝光時間為一預設曝光時間，而完成一準備影像掃描，並據以產生該影像亮度訊號；而於該準備期間之後一補償期間，該曝光時間補償電路根據該影像亮度訊號，而於該補償期間，決定該至少一曝光列之一第二次曝光時間；其中，該曝光時間包括該第二次曝光時間。In a preferred embodiment, the exposure time compensation circuit controls the rolling shutter so that when the sensing element receives the image in a rolling exposure manner during a preparation period, the first exposure time of one of the exposure columns For a preset exposure time, a preparation image scan is completed to generate the image brightness signal accordingly; and after a compensation period after the preparation period, the exposure time compensation circuit is based on the image brightness signal and during the compensation period, Determine a second exposure time of one of the at least one exposure row; wherein the exposure time includes the second exposure time.

在前述的實施例中，該曝光時間補償電路更根據一預設目標值，而於該補償期間，決定該至少一曝光列之該第二次曝光時間。In the foregoing embodiment, the exposure time compensation circuit further determines a second exposure time of the at least one exposure row during the compensation period according to a preset target value.

在前述的實施例中，該準備期間中之該影像亮度訊號，係根據一原始影像亮度訊號經由平滑化處理後之結果。In the foregoing embodiment, the image brightness signal during the preparation period is a result of smoothing processing based on an original image brightness signal.

在其中一種較佳的實施例中，該光源鄰置於該複數列中之一第一列或/及一最後一列之外側。In one of the preferred embodiments, the light source is located adjacent to a first column or / and a last column of the plurality of columns.

就另一個觀點言，本發明提供了一種具有滾動曝光時間補償之影像感測器，用以感測一影像，其包含：一感測元件，具有複數感測單元，排列為複數行(column)與複數列(row)，該感測元件以滾動式曝光方式而接收該影像；一光源，用以發射光線至一待感測物以產生該影像；以及一曝光時間補償電路，與該感測元件耦接，用以控制一滾動快門，使得該感測元件於一準備期間，以滾動式曝光方式接收該影像時，設定至少一曝光列之一第一次曝光時間為一預設曝光時間，而完成一準備影像掃描，並據以產生一影像亮度訊號，並於該準備期間之後一補償期間，根據該影像亮度訊號，決定至少一單元曝光時間，而完成至少一單元影像掃描，並根據該準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊。According to another aspect, the present invention provides an image sensor with rolling exposure time compensation for sensing an image, which includes: a sensing element having a plurality of sensing units arranged in a plurality of columns And a plurality of rows, the sensing element receives the image in a rolling exposure mode; a light source for emitting light to an object to be sensed to generate the image; and an exposure time compensation circuit for the sensing An element coupling for controlling a rolling shutter so that when the sensing element receives the image in a rolling exposure mode during a preparation period, setting the first exposure time of at least one exposure row to a preset exposure time, And a preparation image scan is completed, and an image brightness signal is generated accordingly, and at least one unit exposure time is determined according to the image brightness signal after a compensation period after the preparation period, and at least one unit image scan is completed, and according to the Prepare image scanning and the at least one unit image scanning to generate a combined image information.

在其中一種較佳的實施例中，該曝光時間補償電路根據該影像亮度訊號與一亮度閾值，而產生一亮度輪廓線，進而於該補償期間，根據該亮度輪廓線，決定該至少一單元曝光時間，而完成該至少一單元影像掃描。In one of the preferred embodiments, the exposure time compensation circuit generates a brightness contour line according to the image brightness signal and a brightness threshold, and further determines the at least one unit exposure according to the brightness contour line during the compensation period. Time to complete the at least one unit image scan.

在前述的實施例中，該曝光時間補償電路根據該影像亮度訊號中之一單列影像亮度訊號，決定該至少一單元曝光時間，而完成該至少一單元影像掃描。In the foregoing embodiment, the exposure time compensation circuit determines the at least one unit exposure time according to a single-line image brightness signal of the image brightness signals, and completes the scanning of the at least one unit image.

在前述的實施例中，該光源鄰置於該複數行中之一第一行或/及一最後一行之外側。In the foregoing embodiment, the light source is located adjacent to a first row or / and a last row of the plurality of rows.

在其中一種較佳的實施例中，該待感測物包括一手指，且該影像包括一指紋影像，該光源發射光線至該手指，以產生該指紋影像。In a preferred embodiment, the object to be sensed includes a finger, and the image includes a fingerprint image, and the light source emits light to the finger to generate the fingerprint image.

底下藉由具體實施例詳加說明，當更容易瞭解本發明之目的、技術內容、特點及其所達成之功效。Detailed descriptions will be provided below through specific embodiments to make it easier to understand the purpose, technical content, features and effects of the present invention.

本發明中的圖式均屬示意，主要意在表示各電路間之耦接關係，以及各訊號波形之間之關係，至於電路、訊號波形與頻率則並未依照比例繪製。The drawings in the present invention are schematic, and are mainly intended to represent the coupling relationship between various circuits and the relationship between signal waveforms. As for the circuits, signal waveforms and frequencies, they are not drawn to scale.

參照圖1，其中顯示根據一觀點，本發明提供了一種具有滾動曝光時間補償之影像感測方法，其中包含：發射光線至一待感測物以產生一影像(S1)；提供一感測元件，具有複數感測單元，排列為複數行(column)與複數列(row) (S2)；以滾動式曝光方式而使該感測元件接收該影像(S3)；以及控制一滾動快門，使得該感測元件以滾動式曝光方式接收該影像時，根據一影像亮度訊號而適應性決定至少一曝光列之曝光時間(S4)。Referring to FIG. 1, it is shown that according to an aspect, the present invention provides an image sensing method with rolling exposure time compensation, which includes: emitting light to an object to be sensed to generate an image (S1); and providing a sensing element. Having a plurality of sensing units arranged in a plurality of columns and a plurality of rows (S2); making the sensing element receive the image in a rolling exposure manner (S3); and controlling a rolling shutter such that the When the sensing element receives the image in a rolling exposure mode, the exposure time of at least one exposure row is adaptively determined according to an image brightness signal (S4).

滾動式曝光方式係利用電子式滾動快門或機械式滾動快門使感測元件曝光的方式。電子式滾動快門廣泛用於互補式金屬氧化物半導體(complementary metal oxide semiconductor, CMOS)影像感測器，是一種電子訊號掃描方式，但是其如機械式滾動快門的運作般，由上而下（或相反）逐列掃描，此為本領域中具有通常知識者所熟知，在此不予贅述。The rolling exposure method is a method for exposing the sensing element using an electronic rolling shutter or a mechanical rolling shutter. Electronic rolling shutter is widely used in complementary metal oxide semiconductor (CMOS) image sensors. It is an electronic signal scanning method, but it works like a mechanical rolling shutter from top to bottom (or On the contrary) column-by-column scanning, which is well known to those with ordinary knowledge in the art, will not be repeated here.

根據本發明，可以提供一光源，發射光線至待感測物，而產生影像。舉例而言，待感測物為手指，光源例如但不限於為發光二極體 (light emitting diode, LED)。當LED發射光線至手指內部，光線在手指中散射、折射、反射後產生之影像為指紋影像，此方式為一種｢光手指｣(light finger)的方式。感測元件例如但不限於為CMOS影像感測器，具有複數CMOS影像感測單元，排列為複數行(column)與複數列(row)。According to the present invention, a light source can be provided to emit light to an object to be sensed to generate an image. For example, the object to be sensed is a finger, and the light source is, for example, but not limited to, a light emitting diode (LED). When the LED emits light to the inside of the finger, the image produced by the light scattered, refracted, and reflected in the finger is a fingerprint image. This method is a light finger method. The sensing element is, for example but not limited to, a CMOS image sensor, and has a plurality of CMOS image sensing units arranged in a plurality of columns and a plurality of rows.

以滾動式曝光方式而使感測元件接收該影像例如利用滾動快門，使CMOS影像感測器中的CMOS影像感測單元逐列曝光，以接收指紋影像。所謂逐列曝光，不限僅有一列CMOS影像感測單元同時曝光，亦可以指數列同時曝光。接收指紋影像也不限於僅掃描一次，可以利用重複滾動式曝光方式而掃描複數次，以接收指紋影像。The rolling element is used to cause the sensing element to receive the image. For example, a rolling shutter is used to expose the CMOS image sensing unit in the CMOS image sensor row by row to receive a fingerprint image. The so-called row-by-row exposure is not limited to the exposure of only one row of CMOS image sensing units at the same time, and it can also be exposed simultaneously in the index row. Receiving a fingerprint image is not limited to scanning only once, and a repeated scroll exposure method can be used to scan multiple times to receive a fingerprint image.

控制滾動快門，使得該感測元件以滾動式曝光方式接收該影像時，根據該影像亮度訊號而適應性決定至少一曝光列之曝光時間。也就是說，不同列的曝光時間，可以根據影像亮度訊號而有所不同。其中影像亮度訊號將於後詳述。The rolling shutter is controlled so that when the sensing element receives the image in a rolling exposure mode, the exposure time of at least one exposure row is adaptively determined according to the image brightness signal. In other words, the exposure time of different columns can be different according to the image brightness signal. The image brightness signal will be detailed later.

本發明與先前技術不同的其中一個特徵，在於根據本發明，不同列的曝光時間，可以根據影像亮度訊號適應性調整而有所不同，使得根據本發明所產生的影像照片，其整體的亮度相對均勻，而使影像更清楚呈現。One of the features of the present invention that is different from the prior art is that according to the present invention, the exposure time of different columns can be differently adjusted according to the image brightness signal adaptive adjustment, so that the overall brightness of the image photos produced according to the present invention is relatively Uniform, which makes the image more clear.

第2A-2G圖顯示根據本發明之第一個實施例。如第2A圖所示，感測元件具有複數感測單元，排列為複數行(column)與複數列(row)，其中同一列的感測單元沿著水平方向排列，同一行的感測單元沿著垂直方向排列。在本實施例中，光源鄰置於複數列中之第一列及最後一列之外側，當然，光源也可以僅位於第一列及最後一列其中之一的外側。Figures 2A-2G show a first embodiment according to the present invention. As shown in FIG. 2A, the sensing element has a plurality of sensing units, which are arranged into a plurality of columns and a plurality of rows. The sensing units in the same column are arranged along the horizontal direction, and the sensing units in the same row are arranged along Arranged vertically. In this embodiment, the light source is adjacent to the outside of the first column and the last column in the plurality of columns. Of course, the light source may be located only outside one of the first column and the last column.

如第2B圖所示，曝光時間補償電路與感測元件耦接，用以控制一滾動快門(如圖中半透明區塊所示意)，使得感測元件以滾動式曝光方式接收影像時，根據影像亮度訊號而適應性決定至少一曝光列之曝光時間。需說明的是，曝光列係指在滾動式曝光方式中，正在曝光接收影像的列，可以為單一列，亦可以為如圖所示的複數列。As shown in FIG. 2B, the exposure time compensation circuit is coupled to the sensing element, and is used to control a rolling shutter (as shown in the semi-transparent block in the figure), so that when the sensing element receives the image in a rolling exposure mode, The image brightness signal adaptively determines the exposure time of at least one exposure row. It should be noted that the exposure row refers to the row in the rolling exposure method that is exposing the received image, which can be a single row or a plurality of rows as shown in the figure.

如第2C圖所示，舉例而言，光源鄰置於複數列中之第一列及最後一列之外側。如前所述，光源例如發射光線至手指內部，光線在手指中散射、折射、反射後產生之影像為指紋影像，即｢光手指｣(light finger)的方式。感測元件用以感測該指紋影像。需說明的是，在實際的實施方式中，手指例如可直接或隔著透光物質緊貼感測元件，在本圖中，為方便解說，並未將手指繪製於緊貼感測元件。當然，手指亦可以不緊貼感測元件。As shown in FIG. 2C, for example, the light source is adjacent to the outer side of the first column and the last column in the plurality of columns. As mentioned above, a light source, for example, emits light to the inside of a finger, and the image produced by the light scattered, refracted, and reflected in the finger is a fingerprint image, that is, a light finger method. The sensing element is used for sensing the fingerprint image. It should be noted that, in an actual implementation, for example, a finger may be directly attached to the sensing element directly or through a light-transmitting substance. In this figure, for convenience of explanation, the finger is not drawn on the sensing element. Of course, the finger may not stick to the sensing element.

在本實施例中，曝光時間補償電路例如控制滾動快門，使得感測元件於一準備期間，以滾動式曝光方式接收該影像時，該曝光列的感測元件之第一次曝光時間為一預設曝光時間，而完成一準備影像掃描，並據以產生該影像亮度訊號；而於該準備期間之後一補償期間，該曝光時間補償電路根據該影像亮度訊號，而於該補償期間，決定該至少一曝光列之第二次曝光時間。In this embodiment, the exposure time compensation circuit controls, for example, a rolling shutter, so that when the sensing element receives the image in a rolling exposure manner during a preparation period, the first exposure time of the sensing element of the exposure row is a predetermined time. Set the exposure time, complete a preparation image scan, and generate the image brightness signal accordingly; and after a compensation period after the preparation period, the exposure time compensation circuit determines the at least based on the image brightness signal during the compensation period. The second exposure time of an exposure column.

第2D圖顯示在本實施例中，於該準備期間，曝光時間補償電路控制滾動快門，使得感測元件以滾動式曝光方式接收該影像，且感測元件之每一曝光列的第一次曝光時間為該預設曝光時間，進而完成該準備影像掃描，並據以產生該影像亮度訊號。其中，預設曝光時間例如但不限於為固定的一個期間，也就是使每一曝光列的第一次曝光時間相同。接著，例如讀取所有的感測單元所感測到的原始影像亮度訊號，並將其平滑化處理，結果得到該影像亮度訊號。如第2D圖所示，在本實施例中，影像亮度訊號在靠近光源的第一列與最後一列相對較高，而在遠離光源的靠近中間列則相對較低。影像亮度訊號越高則越亮，影像亮度訊號越低則越暗。FIG. 2D shows that in this embodiment, during the preparation period, the exposure time compensation circuit controls the rolling shutter so that the sensing element receives the image in a rolling exposure manner, and the first exposure of each exposure column of the sensing element The time is the preset exposure time, and then the preparation image scanning is completed, and the image brightness signal is generated accordingly. The preset exposure time is, for example, but not limited to, a fixed period, that is, the first exposure time of each exposure column is the same. Then, for example, the original image brightness signals sensed by all the sensing units are read and smoothed to obtain the image brightness signals. As shown in FIG. 2D, in this embodiment, the image brightness signal is relatively high in the first column and the last column near the light source, and relatively low in the middle column near the light source. The higher the image brightness signal is, the brighter it is, and the lower the image brightness signal is, the darker it is.

第2E圖顯示影像亮度訊號ADC與曝光時間的關係，並舉例顯示決定該至少一曝光列之第二次曝光時間的方法。曝光列的曝光時間Tint與影像亮度訊號ADC大致上成正比。因此，考慮第 i 列在準備期間，其第一次曝光時間為時間 T，而其影像亮度訊號 adc(i) ；那麼，例如利用外插法，將影像亮度訊號的預設目標值 reg_perline_target 除以在準備期間的影像亮度訊號 adc(i)再乘以時間 T，可以得到第 i 列在補償期間，決定其第二次曝光時間為時間 Tint(i)=( reg_perline_target/ adc(i))* T。FIG. 2E shows the relationship between the image brightness signal ADC and the exposure time, and shows an example of a method for determining the second exposure time of the at least one exposure column. The exposure time Tint of the exposure column is roughly proportional to the image brightness signal ADC. Therefore, consider that the i-th column is in the preparation period, its first exposure time is time T, and its image brightness signal adc (i); then, for example, by using extrapolation, divide the preset target value reg_perline_target of the image brightness signal by The image brightness signal adc (i) during the preparation period is then multiplied by time T, and the i-th column can be obtained during the compensation period. The second exposure time is determined as time Tint (i) = (reg_perline_target / adc (i)) * T .

第2F圖與第2G圖分別顯示準備期間之準備影像掃描與補償期間之補償影像掃描後，產生的準備影像照片與補償影像照片。可以比較得知，根據本發明，經過補償期間之適應性決定曝光列之第二次曝光時間後所得到的補償影像照片，可以得到清楚的指紋影像。未經滾動曝光時間補償的先前技術，類似本實施例之準備期間的準備影像掃描後，產生的準備影像照片，由於照片亮度相對不均，無法完整取得清楚的指紋影像。此為本發明優於先前技術的特徵之一。Figures 2F and 2G show the prepared image scan and the compensated image photo generated after the preparation image scan during the preparation period and the compensation image scan during the compensation period, respectively. It can be known by comparison that according to the present invention, after the adaptiveness of the compensation period determines the second exposure time of the exposure column, a clear fingerprint image can be obtained. The prior art without the rolling exposure time compensation is similar to the preparation image photo generated after the preparation image is scanned during the preparation period of this embodiment. Due to the relatively uneven brightness of the photo, a clear fingerprint image cannot be obtained completely. This is one of the advantages of the present invention over the prior art.

第3A-3F圖顯示根據本發明之第二個實施例。如第3A圖所示，本實施與第一個實施例不同之處，在於本實施例中，光源鄰置於複數行中之最後一行之外側，當然，光源也可以位於第一行及最後一行的外側或是僅位於第一行之外側。Figures 3A-3F show a second embodiment according to the present invention. As shown in FIG. 3A, this embodiment is different from the first embodiment in that the light source is adjacent to the outer side of the last row in the plurality of rows in this embodiment. Of course, the light source may be located in the first and last rows. Or just outside the first row.

如第3B圖所示，在本實施例中，曝光時間補償電路例如控制滾動快門，使得感測元件於準備期間，以滾動式曝光方式接收該影像時，設定至少一曝光列之第一次曝光時間為預設曝光時間，而完成準備影像掃描，並據以產生影像亮度訊號。As shown in FIG. 3B, in this embodiment, the exposure time compensation circuit controls, for example, a rolling shutter, so that when the sensing element receives the image in a rolling exposure manner during the preparation period, the first exposure of at least one exposure row is set The time is the preset exposure time, and the image scanning is completed and the image brightness signal is generated accordingly.

第3C圖顯示在本實施例中，於該準備期間，曝光時間補償電路控制滾動快門，使得感測元件以滾動式曝光方式接收該影像，且感測元件之每一曝光列的第一次曝光時間為該預設曝光時間，進而完成該準備影像掃描，並據以產生該影像亮度訊號。其中，預設曝光時間例如但不限於為固定的一個期間，也就是使每一曝光列的第一次曝光時間相同。接著，例如讀取所有的感測單元所感測到的原始影像亮度訊號，並將其平滑化處理，結果得到該影像亮度訊號。如第3C圖所示，在本實施例中，影像亮度訊號在靠近光源的最後一行的亮度相對較高，而在遠離光源的靠近第一行列的亮度則相對較低。影像亮度訊號的亮度越高則越亮，影像亮度訊號的亮度越低則越暗。FIG. 3C shows that in this embodiment, during the preparation period, the exposure time compensation circuit controls the rolling shutter so that the sensing element receives the image in a rolling exposure manner, and the first exposure of each exposure column of the sensing element The time is the preset exposure time, and then the preparation image scanning is completed, and the image brightness signal is generated accordingly. The preset exposure time is, for example, but not limited to, a fixed period, that is, the first exposure time of each exposure column is the same. Then, for example, the original image brightness signals sensed by all the sensing units are read and smoothed to obtain the image brightness signals. As shown in FIG. 3C, in this embodiment, the brightness of the image brightness signal in the last row near the light source is relatively high, and the brightness of the image brightness signal near the first row and column far from the light source is relatively low. The higher the brightness of the image brightness signal, the brighter, and the lower the brightness of the image brightness signal, the darker.

第3D圖顯示準備期間之準備影像掃描後，產生的準備影像照片。在本實施例中，曝光時間補償電路於該準備期間之後的補償期間，根據第3C圖所示的影像亮度訊號，決定至少一單元曝光時間，而完成至少一單元影像掃描，並根據該準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊。Figure 3D shows the prepared image photos after the prepared image scan during the preparation period. In this embodiment, during the compensation period after the preparation period, the exposure time compensation circuit determines at least one unit exposure time according to the image brightness signal shown in FIG. 3C, completes at least one unit image scan, and according to the preparation image The scanning and the at least one unit image scanning generate a combined image information.

詳言之，由於在本實施例中，光源鄰置於複數行中之最後一行之外側，由於滾動快門的動作，使得依照逐列(或複數列)的掃描方向(及垂直方向)，與亮度高低的分布(沿水平方向升高)不同，因此以第一個實施例的補償方式，也就是逐列(或複數列)適應性調整曝光列的曝光時間，仍會有水平方向亮度不均勻的現象。因此，在本實施例中，根據影像亮度訊號，例如但不限於比較影像亮度訊號與一亮度閾值，舉例而言，沿著每一列的每一個感測單元的亮度訊號，比較該亮度閾值，將最後一個不大於(或第一個不小於，或大於)該亮度閾值的感測單元，選擇作為一亮度輪廓線的點，這些點的集合，組成亮度輪廓線。Specifically, in this embodiment, the light source is adjacent to the outer side of the last row of the plurality of rows. Due to the action of the rolling shutter, the scanning direction (and vertical direction) and brightness of the column-by-column (or complex column) and brightness The distribution of heights (increasing in the horizontal direction) is different. Therefore, the compensation method of the first embodiment, that is, adjusting the exposure time of the exposure column adaptively column by column (or complex columns), there will still be uneven brightness in the horizontal direction. phenomenon. Therefore, in this embodiment, according to the image brightness signal, such as but not limited to comparing the image brightness signal with a brightness threshold, for example, comparing the brightness signal of each sensing unit along each column, comparing the brightness threshold, The last sensing unit that is not greater than (or the first is not less than, or greater than) the brightness threshold value is selected as a brightness contour line, and the set of these points constitutes the brightness contour line.

接著，例如將本實施例中影像亮度訊號的亮度最高的點(在本實施例中例如但不限於最靠近光源的最後一行的感測單元之亮度)作為目標值，例如以前述的外插法，算出在亮度輪廓線的點所在的不同列，所需要的不同曝光時間，作為不同的單元曝光時間，而於補償期間，以不同的單元曝光時間，進行滾動曝光時間補償的單元影像掃描。接下來重複執行上述亮度輪廓線的步驟，可以得出至少一單元影像掃描，例如重複執行上述亮度輪廓線的步驟，直到所有感測單元的亮度，都達到上述目標值為止；最後例如但不限於利用高動態範圍成像（high dynamic range imaging, HDR）的方式，將準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊。其中，HDR的方式為本領域中具有通常知識者所熟知，在此不予贅述。Next, for example, the point with the highest brightness of the image brightness signal in this embodiment (such as, but not limited to, the brightness of the sensing unit closest to the last line of the light source in this embodiment) is used as the target value, such as the aforementioned extrapolation , Calculate the different exposure times required by the points of the brightness contour line as different unit exposure times, and during the compensation period, perform a unit exposure scan of the rolling exposure time compensation with different unit exposure times. Then repeat the steps of the above-mentioned brightness contour to obtain at least one unit of image scanning. For example, repeat the steps of the above-mentioned brightness contour until the brightness of all the sensing units reaches the above target value. Finally, for example, but not limited to By using a high dynamic range imaging (HDR) method, the prepared image scan and the at least one unit image scan are generated to generate a combined image information. Among them, the HDR method is well known to those having ordinary knowledge in the art, and will not be repeated here.

如第3E圖所示，在本實施例中，在例如代表HDR的箭頭左側的四張照片，示意每一次的單元影像掃描後產生的單元影像照片。經由HDR的方式，產生組合影像資訊所示意的頭右側的照片。相較於原始未經滾動曝光時間補償的照片，根據本發明可以得到清楚的指紋影像。As shown in FIG. 3E, in this embodiment, for example, the four photos on the left side of the arrow representing HDR indicate the unit image photos generated after each unit image scan. Through the HDR method, a photo on the right side of the head indicated by the combined image information is generated. Compared with the original photo without rolling exposure time compensation, a clear fingerprint image can be obtained according to the present invention.

並於該準備期間之後的補償期間，該曝光時間補償電路根據該影像亮度訊號，而於該補償期間，決定至少一單元曝光時間，而完成至少一單元影像掃描，並根據該準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊。And during the compensation period after the preparation period, the exposure time compensation circuit determines at least one unit exposure time according to the image brightness signal, and completes at least one unit image scan during the compensation period, and according to the preparation image scan and the At least one unit image is scanned to generate a combined image information.

第4圖顯示根據本發明之第三個實施例。如第4圖所示，本實施與第二個實施例不同之處，在於本實施例中，曝光時間補償電路根據影像亮度訊號中之一單列影像亮度訊號，而決定該至少一單元曝光時間，而完成該至少一單元影像掃描。在本實施中，為節省運算時間只選取影像亮度訊號中，其中一列(例如但不限於中間列)的單列影像亮度訊號，而不是如第二個實施例中，將所有的影像亮度訊號都與亮度閾值比較，而得到亮度輪廓線。在本實施例中，因為光源位置在最後一行的外側，因此亮度的大致上是逐行增加。因此，選取其中一列(而非如第二個實施例的每一列)的每一個感測單元的亮度訊號，比較該亮度閾值，將最後一個不大於(或第一個不小於，或大於)該亮度閾值的感測單元，選擇作為一亮度邊界的點。Fig. 4 shows a third embodiment according to the present invention. As shown in FIG. 4, this embodiment is different from the second embodiment in that in this embodiment, the exposure time compensation circuit determines the exposure time of the at least one unit according to a single row of image brightness signals among the image brightness signals. And complete the at least one unit image scan. In this implementation, in order to save computing time, only one image luminance signal is selected from one row (such as, but not limited to, the middle row), instead of all the image luminance signals that are related to the second embodiment. The brightness threshold is compared to obtain the brightness outline. In this embodiment, since the position of the light source is outside the last line, the brightness is increased substantially line by line. Therefore, the brightness signal of each sensing unit in one of the columns (instead of each column as in the second embodiment) is selected, the brightness threshold is compared, and the last one is not greater than (or the first one is not less than, or greater than) the The brightness threshold sensing unit selects a point as a brightness boundary.

接著，例如將本實施例中影像亮度訊號的亮度最高的點(在本實施例中例如但不限於最靠近光源的最後一行的感測單元之亮度)作為目標值，例如以前述的外插法，算出在亮度邊界的點所需要的曝光時間，作為單元曝光時間，而於補償期間，以該單元曝光時間，進行滾動曝光時間補償的單元影像掃描。接下來重複執行上述算出在亮度邊界的點的步驟，可以得出至少一單元影像掃描，例如重複執行上述算出在亮度邊界的點的步驟，直到所有感測單元的亮度，都達到上述目標值為止；最後例如但不限於利用HDR的方式，將準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊。Next, for example, the point with the highest brightness of the image brightness signal in this embodiment (such as, but not limited to, the brightness of the sensing unit closest to the last line of the light source in this embodiment) is used as the target value, such as the aforementioned extrapolation , Calculate the required exposure time at the point of the brightness boundary as the unit exposure time, and during the compensation period, use the unit exposure time to perform the unit image scan of the rolling exposure time compensation. Next, repeat the steps of calculating the points on the brightness boundary to obtain at least one unit of image scanning. For example, repeat the steps of calculating the points on the brightness boundary until the brightness of all the sensing units reaches the target value. ; Finally, for example, but not limited to, using HDR, the prepared image scan and the at least one unit image scan are generated to generate a combined image information.

以上已針對較佳實施例來說明本發明，唯以上所述者，僅係為使熟悉本技術者易於了解本發明的內容而已，並非用來限定本發明之權利範圍。在本發明之相同精神下，熟悉本技術者可以思及各種等效變化。例如，各實施例中圖示直接連接的兩電路或元件間，可插置不影響主要功能的其他電路或元件，因此「耦接」應視為包括直接和間接連接。又如，所有實施例中的變化，可以交互採用等等。凡此種種，皆可根據本發明的教示類推而得，因此，本發明的範圍應涵蓋上述及其他所有等效變化。The present invention has been described above with reference to the preferred embodiments, but the above is only for making those skilled in the art easily understand the content of the present invention, and is not intended to limit the scope of rights of the present invention. In the same spirit of the invention, those skilled in the art can think of various equivalent changes. For example, in the embodiments, two circuits or components that are directly connected can be inserted with other circuits or components that do not affect the main function. Therefore, "coupling" should be considered to include direct and indirect connections. For another example, the changes in all embodiments can be adopted interactively and so on. All these can be deduced by analogy according to the teachings of the present invention. Therefore, the scope of the present invention should cover the above and all other equivalent changes.

Reg_perline_target‧‧‧預設目標值Reg_perline_target‧‧‧Default target value

S1~S4‧‧‧步驟Steps S1 ~ S4‧‧‧‧

T, Tint, Tint(i)‧‧‧時間T, Tint, Tint (i) ‧‧‧time

［第1圖］顯示根據本發明之具有滾動曝光時間補償之影像感測方法之流程圖； ［第2A-2G圖］顯示根據本發明之第一個實施例； ［第3A-3E圖］顯示根據本發明之第二個實施例； ［第4圖］顯示根據本發明之第三個實施例。[Figure 1] A flowchart showing an image sensing method with rolling exposure time compensation according to the present invention; [Figure 2A-2G] showing the first embodiment according to the present invention; [Figure 3A-3E] showing A second embodiment according to the present invention; [FIG. 4] shows a third embodiment according to the present invention.

Claims (20)

一種具有滾動曝光時間補償之影像感測方法，包含： 發射光線至一待感測物以產生一影像； 提供一感測元件，具有複數感測單元，排列為複數行(column)與複數列(row)； 以滾動式曝光方式而使該感測元件接收該影像； 控制一滾動快門，使得該感測元件以滾動式曝光方式接收該影像時，根據一影像亮度訊號而適應性決定至少一曝光列之曝光時間。An image sensing method with rolling exposure time compensation includes: emitting light to an object to be sensed to generate an image; providing a sensing element having a plurality of sensing units arranged in a plurality of columns and a plurality of columns ( row); causing the sensing element to receive the image in a rolling exposure mode; controlling a rolling shutter such that when the sensing element receives the image in a rolling exposure mode, adaptively determine at least one exposure based on an image brightness signal The exposure time of the column. 如申請專利範圍第1項所述之具有滾動曝光時間補償之影像感測方法，其中該控制一滾動快門，使得該感測元件以滾動式曝光方式接收該影像時，根據一影像亮度訊號而適應性決定至少一曝光列之曝光時間之步驟，包括： 控制該滾動快門，使得該感測元件於一準備期間，以滾動式曝光方式接收該影像時，該曝光列之一第一次曝光時間為一預設曝光時間，而完成一準備影像掃描，並據以產生該影像亮度訊號；以及 於該準備期間之後一補償期間，根據該影像亮度訊號，而於該補償期間，決定該至少一曝光列之一第二次曝光時間； 其中，該曝光時間包括該第二次曝光時間。The image sensing method with rolling exposure time compensation according to item 1 of the scope of patent application, wherein the rolling shutter is controlled so that when the sensing element receives the image in a rolling exposure manner, it is adapted according to an image brightness signal The step of determining the exposure time of at least one exposure row includes: controlling the rolling shutter so that when the sensing element receives the image in a rolling exposure manner during a preparation period, the first exposure time of one of the exposure rows is A preset exposure time, complete a preparation image scan, and generate the image brightness signal accordingly; and in a compensation period after the preparation period, according to the image brightness signal, and during the compensation period, determine the at least one exposure row One of the second exposure times; wherein, the exposure time includes the second exposure time. 如申請專利範圍第2項所述之具有滾動曝光時間補償之影像感測方法，其中該根據該影像亮度訊號，而決定於該補償期間，該至少一曝光列之一第二次曝光時間之步驟，更包含：根據一預設目標值，而於該補償期間，決定該至少一曝光列之該第二次曝光時間。The image sensing method with rolling exposure time compensation as described in item 2 of the scope of the patent application, wherein the step of determining the second exposure time of the at least one exposure row during the compensation period according to the image brightness signal In addition, according to a preset target value, the second exposure time of the at least one exposure row is determined during the compensation period. 如申請專利範圍第3項所述之具有滾動曝光時間補償之影像感測方法，其中該影像亮度訊號，係根據一原始影像亮度訊號經由平滑化處理後之結果。The image sensing method with rolling exposure time compensation as described in item 3 of the scope of patent application, wherein the image brightness signal is a result of smoothing processing according to an original image brightness signal. 如申請專利範圍第1項所述之具有滾動曝光時間補償之影像感測方法，其中該光源鄰置於該複數列中之一第一列或/及一最後一列之外側。The image sensing method with rolling exposure time compensation as described in item 1 of the scope of the patent application, wherein the light source is adjacent to one of the plurality of columns or / and one of the last columns. 一種具有滾動曝光時間補償之影像感測方法，包含： 發射光線至一待感測物以產生一影像； 提供一感測元件，具有複數感測單元，排列為複數行(column)與複數列(row)； 以滾動式曝光方式而使該感測元件接收該影像； 控制一滾動快門，使得該感測元件於一準備期間，以滾動式曝光方式接收該影像時，設定至少一曝光列之一第一次曝光時間為一預設曝光時間，而完成一準備影像掃描，並據以產生一影像亮度訊號；以及 於該準備期間之後一補償期間，根據該影像亮度訊號，決定至少一單元曝光時間，而完成至少一單元影像掃描，並根據該準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊。An image sensing method with rolling exposure time compensation includes: emitting light to an object to be sensed to generate an image; providing a sensing element having a plurality of sensing units arranged in a plurality of columns and a plurality of columns ( row); causing the sensing element to receive the image in a rolling exposure manner; controlling a rolling shutter so that the sensing element receives the image in a rolling exposure manner during a preparation period, setting one of at least one exposure row The first exposure time is a preset exposure time, and a preparation image scan is completed to generate an image brightness signal; and at least one unit exposure time is determined based on the image brightness signal after a compensation period after the preparation period. And complete at least one unit image scan, and generate a combined image information according to the prepared image scan and the at least one unit image scan. 如申請專利範圍第6項所述之具有滾動曝光時間補償之影像感測方法，其中該於該準備期間之後一補償期間，根據該影像亮度訊號，決定至少一單元曝光時間，而完成至少一單元影像掃描，並根據該準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊之步驟包括：根據該影像亮度訊號與一亮度閾值，而產生一亮度輪廓線，進而於該補償期間，根據該亮度輪廓線，決定該至少一單元曝光時間，而完成該至少一單元影像掃描。The image sensing method with rolling exposure time compensation according to item 6 of the scope of patent application, wherein the compensation period after the preparation period is based on the image brightness signal to determine at least one unit exposure time and complete at least one unit Image scanning, and generating a combined image information according to the prepared image scanning and the at least one unit image scanning, comprising: generating a brightness contour line according to the image brightness signal and a brightness threshold, and then during the compensation period, according to The brightness contour line determines the exposure time of the at least one unit, and completes the scanning of the at least one unit image. 如申請專利範圍第6項所述之具有滾動曝光時間補償之影像感測方法，其中該於該準備期間之後一補償期間，根據該影像亮度訊號，決定至少一單元曝光時間，而完成至少一單元影像掃描，並根據該準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊之步驟包括：根據該影像亮度訊號中之一單列影像亮度訊號，決定該至少一單元曝光時間，而完成該至少一單元影像掃描。The image sensing method with rolling exposure time compensation according to item 6 of the scope of patent application, wherein the compensation period after the preparation period is based on the image brightness signal to determine at least one unit exposure time and complete at least one unit Image scanning, and generating a combined image information according to the prepared image scanning and the at least one unit image scanning, comprising: determining the exposure time of the at least one unit according to a single row image brightness signal in the image brightness signal, and completing the At least one unit image scan. 如申請專利範圍第6項所述之具有滾動曝光時間補償之影像感測方法，其中該光源鄰置於該複數行中之一第一行或/及一最後一行之外側。The image sensing method with rolling exposure time compensation as described in item 6 of the scope of the patent application, wherein the light source is adjacent to the outer side of one of the plurality of rows and / or one of the last rows. 如申請專利範圍第1或6項所述之具有滾動曝光時間補償之影像感測方法，其中該待感測物包括一手指，且該影像包括一指紋影像，該光源發射光線至該手指，以產生該指紋影像。The image sensing method with rolling exposure time compensation according to item 1 or 6 of the scope of patent application, wherein the object to be sensed includes a finger, and the image includes a fingerprint image, the light source emits light to the finger, and Generate the fingerprint image. 一種具有滾動曝光時間補償之影像感測器，用以感測一影像，其包含： 一感測元件，具有複數感測單元，排列為複數行(column)與複數列(row)，該感測元件以滾動式曝光方式而接收該影像； 一光源，用以發射光線至一待感測物以產生該影像；以及 一曝光時間補償電路，與該感測元件耦接，用以控制一滾動快門，使得該感測元件以滾動式曝光方式接收該影像時，根據一影像亮度訊號而適應性決定至少一曝光列之曝光時間。An image sensor with rolling exposure time compensation for sensing an image includes: a sensing element having a plurality of sensing units arranged in a plurality of columns and a plurality of rows; the sensing The component receives the image in a rolling exposure mode; a light source for emitting light to an object to be sensed to generate the image; and an exposure time compensation circuit coupled to the sensing element for controlling a rolling shutter When the sensing element receives the image in a rolling exposure mode, the exposure time of at least one exposure row is adaptively determined according to an image brightness signal. 如申請專利範圍第11項所述之具有滾動曝光時間補償之影像感測器，其中該曝光時間補償電路控制該滾動快門，使得該感測元件於一準備期間，以滾動式曝光方式接收該影像時，該曝光列之一第一次曝光時間為一預設曝光時間，而完成一準備影像掃描，並據以產生該影像亮度訊號；而於該準備期間之後一補償期間，該曝光時間補償電路根據該影像亮度訊號，而於該補償期間，決定該至少一曝光列之一第二次曝光時間；其中，該曝光時間包括該第二次曝光時間。The image sensor with rolling exposure time compensation according to item 11 of the scope of patent application, wherein the exposure time compensation circuit controls the rolling shutter so that the sensing element receives the image in a rolling exposure manner during a preparation period. , The first exposure time of one of the exposure columns is a preset exposure time, and a preparation image scan is completed to generate the image brightness signal accordingly; and the exposure time compensation circuit is followed by a compensation period after the preparation period. According to the image brightness signal, a second exposure time of one of the at least one exposure row is determined during the compensation period, wherein the exposure time includes the second exposure time. 如申請專利範圍第12項所述之具有滾動曝光時間補償之影像感測器，其中該曝光時間補償電路更根據一預設目標值，而於該補償期間，決定該至少一曝光列之該第二次曝光時間。The image sensor with rolling exposure time compensation as described in item 12 of the scope of patent application, wherein the exposure time compensation circuit is further based on a preset target value, and during the compensation period, determines the number of the at least one exposure row. Double exposure time. 如申請專利範圍第13項所述之具有滾動曝光時間補償之影像感測器，其中該準備期間中之該影像亮度訊號，係根據一原始影像亮度訊號經由平滑化處理後之結果。The image sensor with rolling exposure time compensation according to item 13 of the scope of patent application, wherein the image brightness signal during the preparation period is a result of smoothing processing according to an original image brightness signal. 如申請專利範圍第11項所述之具有滾動曝光時間補償之影像感測器，其中該光源鄰置於該複數列中之一第一列或/及一最後一列之外側。The image sensor with rolling exposure time compensation according to item 11 of the scope of the patent application, wherein the light source is adjacent to one of the plurality of columns or / and one of the last columns. 一種具有滾動曝光時間補償之影像感測器，用以感測一影像，其包含： 一感測元件，具有複數感測單元，排列為複數行(column)與複數列(row)，該感測元件以滾動式曝光方式而接收該影像； 一光源，用以發射光線至一待感測物以產生該影像；以及 一曝光時間補償電路，與該感測元件耦接，用以控制一滾動快門，使得該感測元件於一準備期間，以滾動式曝光方式接收該影像時，設定至少一曝光列之一第一次曝光時間為一預設曝光時間，而完成一準備影像掃描，並據以產生一影像亮度訊號，並於該準備期間之後一補償期間，根據該影像亮度訊號，決定至少一單元曝光時間，而完成至少一單元影像掃描，並根據該準備影像掃描與該至少一單元影像掃描，產生一組合影像資訊。An image sensor with rolling exposure time compensation for sensing an image includes: a sensing element having a plurality of sensing units arranged in a plurality of columns and a plurality of rows; the sensing The component receives the image in a rolling exposure mode; a light source for emitting light to an object to be sensed to generate the image; and an exposure time compensation circuit coupled to the sensing element for controlling a rolling shutter So that when the sensing element receives the image in a rolling exposure mode during a preparation period, the first exposure time of at least one exposure row is set to a preset exposure time, and a preparation image scan is completed, and accordingly An image brightness signal is generated, and at least one unit exposure time is determined based on the image brightness signal after a compensation period after the preparation period, and at least one unit image scan is completed, and according to the preparation image scan and the at least one unit image scan To generate a combined image information. 如申請專利範圍第16項所述之具有滾動曝光時間補償之影像感測器，其中該曝光時間補償電路根據該影像亮度訊號與一亮度閾值，而產生一亮度輪廓線，進而於該補償期間，根據該亮度輪廓線，決定該至少一單元曝光時間，而完成該至少一單元影像掃描。According to the image sensor with rolling exposure time compensation according to item 16 of the scope of patent application, wherein the exposure time compensation circuit generates a brightness contour line according to the image brightness signal and a brightness threshold, and then during the compensation period, According to the brightness contour line, the at least one unit exposure time is determined, and the at least one unit image scanning is completed. 如申請專利範圍第16項所述之具有滾動曝光時間補償之影像感測器，其中該曝光時間補償電路根據該影像亮度訊號中之一單列影像亮度訊號，決定該至少一單元曝光時間，而完成該至少一單元影像掃描。The image sensor with rolling exposure time compensation according to item 16 of the scope of patent application, wherein the exposure time compensation circuit determines the exposure time of the at least one unit according to a single-line image brightness signal in the image brightness signal, and is completed. The at least one unit image is scanned. 如申請專利範圍第16項所述之具有滾動曝光時間補償之影像感測器，其中該光源鄰置於該複數行中之一第一行或/及一最後一行之外側。The image sensor with rolling exposure time compensation as described in item 16 of the scope of the patent application, wherein the light source is adjacent to one of the plurality of rows and / or one of the last rows outside the last row. 如申請專利範圍第11或16項所述之具有滾動曝光時間補償之影像感測器，其中該待感測物包括一手指，且該影像包括一指紋影像，該光源發射光線至該手指，以產生該指紋影像。The image sensor with rolling exposure time compensation according to item 11 or 16 of the scope of patent application, wherein the object to be sensed includes a finger, and the image includes a fingerprint image, the light source emits light to the finger, and Generate the fingerprint image.
TW106129510A 2016-12-30 2017-08-30 Image Sensing Method and Image Sensor with Rolling Exposure Time Compensation TW201841493A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/858,572 US20180191935A1 (en) 2016-12-30 2017-12-29 Image sensing method and image sensor with rolling exposure time compensation

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662440746P 2016-12-30 2016-12-30
US62/440,746 2016-12-30

Publications (1)

Publication Number Publication Date
TW201841493A true TW201841493A (en) 2018-11-16

Family

ID=62770899

Family Applications (6)

Application Number Title Priority Date Filing Date
TW106124209A TW201822709A (en) 2016-12-30 2017-07-20 Real-time heart rate detection method and real-time heart rate detection system therefor
TW106125735A TWI629645B (en) 2016-12-30 2017-07-31 Optical identification method
TW106125696A TW201826164A (en) 2016-12-30 2017-07-31 Optical identification method and optical identification system
TW106129438A TWI629904B (en) 2016-12-30 2017-08-30 Image brightness non-uniformity correction method and image brightness correction device therefor
TW106129510A TW201841493A (en) 2016-12-30 2017-08-30 Image Sensing Method and Image Sensor with Rolling Exposure Time Compensation
TW106129519A TWI629643B (en) 2016-12-30 2017-08-30 Exposure time determination method of image sensing

Family Applications Before (4)

Application Number Title Priority Date Filing Date
TW106124209A TW201822709A (en) 2016-12-30 2017-07-20 Real-time heart rate detection method and real-time heart rate detection system therefor
TW106125735A TWI629645B (en) 2016-12-30 2017-07-31 Optical identification method
TW106125696A TW201826164A (en) 2016-12-30 2017-07-31 Optical identification method and optical identification system
TW106129438A TWI629904B (en) 2016-12-30 2017-08-30 Image brightness non-uniformity correction method and image brightness correction device therefor

Family Applications After (1)

Application Number Title Priority Date Filing Date
TW106129519A TWI629643B (en) 2016-12-30 2017-08-30 Exposure time determination method of image sensing

Country Status (2)

Country Link
CN (6) CN108268829B (en)
TW (6) TW201822709A (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110876055B (en) * 2018-08-30 2021-04-09 菱光科技股份有限公司 External triggering linear camera detection system and image uniformity processing method thereof
CN110443204A (en) * 2018-10-11 2019-11-12 神盾股份有限公司 Luminous signal intensity control method and electronic device
US10755065B2 (en) * 2018-12-03 2020-08-25 Novatek Microelectronics Corp. Sensor device and flicker noise mitigating method
CN109637505B (en) * 2018-12-21 2020-11-17 苏州依唯森电器有限公司 Four-string violin
CN109901754B (en) * 2019-02-20 2021-04-13 Oppo广东移动通信有限公司 Data self-calibration method and related device
CN110672621B (en) * 2019-10-10 2021-03-05 清华大学 Illumination brightness adjustment-based automobile coating surface defect image quality optimization method
TWI739431B (en) * 2019-12-09 2021-09-11 大陸商廣州印芯半導體技術有限公司 Data transmission system and data transmission method thereof
CN215647069U (en) * 2020-07-23 2022-01-25 神盾股份有限公司 Image sensing device
CN112272293A (en) * 2020-10-28 2021-01-26 业成科技（成都）有限公司 Image processing method

Family Cites Families (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003032453A (en) * 2001-07-12 2003-01-31 Canon Inc Image processor
US7505604B2 (en) * 2002-05-20 2009-03-17 Simmonds Precision Prodcuts, Inc. Method for detection and recognition of fog presence within an aircraft compartment using video images
EP1512123B1 (en) * 2002-06-12 2009-10-07 Silicon Optix Inc. System and method for electronic correction of optical anomalies
FI116246B (en) * 2003-06-30 2005-10-14 Nokia Corp Method and system for adjusting the exposure in digital imaging and the like
EP2151191B1 (en) * 2003-07-04 2017-02-22 Panasonic Intellectual Property Corporation of America Living eye judging method and device
CN1529277A (en) * 2003-10-16 2004-09-15 王立丰 Optical fingerprint collecting instrument for automatic inducing living-finger
CN1317671C (en) * 2003-11-26 2007-05-23 佳能株式会社 Signal processor and controlling method
JP2006230603A (en) * 2005-02-23 2006-09-07 Canon Inc Imaging apparatus, biometric identification system, and image acquisition method
CN1664847A (en) * 2005-03-17 2005-09-07 上海交通大学 Embedded system fingerprint identification and matching method
JP4247691B2 (en) * 2006-05-17 2009-04-02 ソニー株式会社 Registration device, verification device, registration method, verification method, and program
CN103902974A (en) * 2006-07-31 2014-07-02 光谱辨识公司 Biometrics with spatiospectral spoof detection
WO2008075136A1 (en) * 2006-12-20 2008-06-26 Nokia Corporation Exposure control based on image sensor cost function
CN100446036C (en) * 2006-12-27 2008-12-24 浙江大学 Non-linear brightness correcting method based on accumulative histogram
US8055070B2 (en) * 2007-01-05 2011-11-08 Geo Semiconductor Inc. Color and geometry distortion correction system and method
US8031925B2 (en) * 2007-01-09 2011-10-04 The Board Of Regents Of The University Of Texas System Method and computer-program product for detecting and quantifying protein spots
US7953256B2 (en) * 2007-09-21 2011-05-31 International Business Machines Corporation Method and system for detecting fingerprint spoofing
CN101399924B (en) * 2007-09-25 2010-05-19 展讯通信（上海）有限公司 Automatic exposure method and device based on brightness histogram
CN101494739B (en) * 2009-02-09 2011-09-28 胡燕翔 Method for determining exposure number and distributing exposure time in multi-exposure combination
CN101989156B (en) * 2010-10-08 2012-08-15 苏州佳世达电通有限公司 Method for calibrating sensing brightness of image sensor
US20120157791A1 (en) * 2010-12-16 2012-06-21 General Electric Company Adaptive time domain filtering for improved blood pressure estimation
CN104270582B (en) * 2011-03-03 2017-08-22 原相科技股份有限公司 Imaging sensor
CN102156868B (en) * 2011-03-31 2013-03-13 汉王科技股份有限公司 Image binaryzation method and device
JP2012222529A (en) * 2011-04-06 2012-11-12 Sony Corp Solid state imaging device, driving method, and electronic device
US9077917B2 (en) * 2011-06-09 2015-07-07 Apple Inc. Image sensor having HDR capture capability
CN102222225B (en) * 2011-06-24 2012-12-05 洛阳师范学院 Finger vein image anti-counterfeiting acquiring method
EP2739207B1 (en) * 2011-08-02 2017-07-19 Valencell, Inc. Systems and methods for variable filter adjustment by heart rate metric feedback
CN103083005B (en) * 2011-11-01 2015-05-13 北京瓦力网络科技有限公司 Method for testing heart rate of user
TWI476641B (en) * 2011-11-22 2015-03-11 Pixart Imaging Inc Remote controller and display system
WO2013128617A1 (en) * 2012-03-01 2013-09-06 株式会社日本マイクロニクス Display unevenness detection method and device for display device
US9191635B2 (en) * 2012-03-19 2015-11-17 Semiconductor Components Industries, Llc Imaging systems with clear filter pixels
US9743057B2 (en) * 2012-05-31 2017-08-22 Apple Inc. Systems and methods for lens shading correction
US20130332195A1 (en) * 2012-06-08 2013-12-12 Sony Network Entertainment International Llc System and methods for epidemiological data collection, management and display
TWI489865B (en) * 2012-11-13 2015-06-21 Pixart Imaging Inc Exposure adjusting apparatus, image normalizing apparatus and image normalizing method
CN103077377B (en) * 2012-12-31 2015-07-29 清华大学 Based on the fingerprint correction method of field of direction distribution
KR101883037B1 (en) * 2013-01-15 2018-07-27 아비질론 코포레이션 Imaging apparatus with scene adaptive auto exposure compensation
ITMI20130104A1 (en) * 2013-01-24 2014-07-25 Empatica Srl DEVICE, SYSTEM AND METHOD FOR THE DETECTION AND TREATMENT OF HEART SIGNALS
US9111125B2 (en) * 2013-02-08 2015-08-18 Apple Inc. Fingerprint imaging and quality characterization
CN103258156B (en) * 2013-04-11 2016-01-20 杭州电子科技大学 A kind of method generating key based on fingerprint characteristic
CN103530848A (en) * 2013-09-27 2014-01-22 中国人民解放军空军工程大学 Double exposure implementation method for inhomogeneous illumination image
CN104331683B (en) * 2014-10-17 2017-07-07 南京工程学院 A kind of facial expression recognizing method with noise robustness
TWI512270B (en) * 2015-01-13 2015-12-11 Pixart Imaging Inc Optical distance measurement system with dynamicexposure time
US9880634B2 (en) * 2015-03-20 2018-01-30 Optim Corporation Gesture input apparatus, gesture input method, and program for wearable terminal
TWI537875B (en) * 2015-04-08 2016-06-11 大同大學 Image fusion method and image processing apparatus
CN105635359B (en) * 2015-12-31 2018-10-26 宇龙计算机通信科技(深圳)有限公司 Method for measuring heart rate and device, terminal
CN105877730B (en) * 2016-03-21 2019-07-26 联想(北京)有限公司 A kind of heart rate detection method, device and electronic equipment
CN105847708B (en) * 2016-05-26 2018-09-21 武汉大学 Line-scan digital camera automatic exposure method of adjustment based on image histogram analysis and system
CN106060658B (en) * 2016-05-27 2019-06-14 青岛海信电器股份有限公司 A kind of image processing method and device
CN106127134B (en) * 2016-06-20 2019-07-26 联想(北京)有限公司 Optical devices, electronic equipment and its control method

Also Published As

Publication number Publication date
CN108261195B (en) 2020-12-11
CN108269239B (en) 2021-03-30
CN108261195A (en) 2018-07-10
CN108270975A (en) 2018-07-10
CN108269239A (en) 2018-07-10
CN108270976A (en) 2018-07-10
TW201824081A (en) 2018-07-01
CN108268829A (en) 2018-07-10
TWI629643B (en) 2018-07-11
TW201824857A (en) 2018-07-01
CN108270975B (en) 2020-09-15
TW201822709A (en) 2018-07-01
TW201826164A (en) 2018-07-16
CN108268830B (en) 2021-03-30
TWI629904B (en) 2018-07-11
CN108268830A (en) 2018-07-10
TWI629645B (en) 2018-07-11
TW201824068A (en) 2018-07-01
CN108268829B (en) 2021-03-30

Similar Documents

Publication Publication Date Title
TW201841493A (en) Image Sensing Method and Image Sensor with Rolling Exposure Time Compensation
EP3742389A1 (en) Predicting optimal values for parameters used in an operation of an image signal processor using machine learning
TWI498848B (en) Multi-exposure imaging system and white balance method
US8830227B2 (en) Depth-based gain control
JP6299983B2 (en) Motion sensor device having a plurality of light sources
JP6270813B2 (en) Motion sensor device having a plurality of light sources
CN107181918B (en) A kind of dynamic filming control method and system for catching video camera of optics
JP6302414B2 (en) Motion sensor device having a plurality of light sources
US20170278260A1 (en) Image processing apparatus, image processing method, and non-transitory recording medium storing program
TWI512270B (en) Optical distance measurement system with dynamicexposure time
CN107590791B (en) Image enhancement method and image processing apparatus
JP6890263B2 (en) Imaging control device, imaging control method, program and recording medium
TWI522968B (en) Hand-held electronic apparatus, image capturing apparatus and method for obtaining depth information
CN109743505B (en) Video shooting method and device based on laser ranging and electronic equipment
JP2023101522A (en) Imaging device, information processing device, imaging method, and program
JP2015119206A5 (en) Image processing apparatus, imaging apparatus, control method thereof, and program
JP2020077165A5 (en)
TW201617639A (en) Optical distance measurement system and method
US20180191935A1 (en) Image sensing method and image sensor with rolling exposure time compensation
JP6543067B2 (en) Projection system, projector device, imaging device, and program
CN108029185A (en) Illumination acquisition device, Lighting Control Assembly and program
JP6917796B2 (en) Image processing equipment, imaging equipment, image processing methods, and programs
JP2017138927A (en) Image processing device, imaging apparatus, control method and program thereof
JP5598712B2 (en) Vein pattern detection device, vein authentication device, and vein pattern detection method
TWI469089B (en) Image determining method and object coordinate computing apparatus