CN102572245B - Method and device for extending image dynamic ranges - Google Patents

Method and device for extending image dynamic ranges Download PDF

Info

Publication number
CN102572245B
CN102572245B CN201110434785.XA CN201110434785A CN102572245B CN 102572245 B CN102572245 B CN 102572245B CN 201110434785 A CN201110434785 A CN 201110434785A CN 102572245 B CN102572245 B CN 102572245B
Authority
CN
China
Prior art keywords
image
signal
light signal
exposure
digital electric
Prior art date
Application number
CN201110434785.XA
Other languages
Chinese (zh)
Other versions
CN102572245A (en
Inventor
王志强
陈涛
林波
Original Assignee
深圳市赛格导航科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市赛格导航科技股份有限公司 filed Critical 深圳市赛格导航科技股份有限公司
Priority to CN201110434785.XA priority Critical patent/CN102572245B/en
Publication of CN102572245A publication Critical patent/CN102572245A/en
Application granted granted Critical
Publication of CN102572245B publication Critical patent/CN102572245B/en

Links

Abstract

The invention discloses a method and a device for extending image dynamic ranges. The method includes A dividing an optical signal of image information of an identical scene into a first optical signal and a second optical signal, collecting the first optical signal at least once according to first exposure time, converting the collected first optical signal into at least one analog electric signal of a first image, simultaneously collecting the second optical signal at least once according to second exposure time, and converting the collected second optical signal into at least one analog electric signal of a second image; B respectively converting the at least one analog electric signal of the first image and the at least one analog electric signal of the second image into at least one digital electric signal of the first image and at least one digital electric signal of the second image; and C processing the at least one digital electric signal of the first image and the at least one digital electric signal of the second image so as to comprise an image. The method and the device can extend the dynamic ranges, improve signal to noise ratio, are rapid in real-time processing speed, and further can achieve synchronous exposure.

Description

A kind of method of expanded images dynamic range and device

Technical field

The present invention relates to image acquisition and process field, particularly relate to a kind of method and device of expanded images dynamic range.

Background technology

Imageing sensor is the important component part of digital camera, is a kind of semiconductor device optical imagery being converted to the signal of telecommunication.According to the difference of element, the large class of CCD and CMOS two can be divided into.

An important indicator of evaluation map image-position sensor quality is dynamic range.Dynamic range is defined as the ratio of maximum unsaturation signal and minimum detectable signal, which represent imageing sensor and differentiates ability with high brightness in piece image and low-light level details.The dynamic range of the imageing sensor of traditional structure is often much smaller than the dynamic range of natural environment, and this just makes the image resolution ratio taken by imageing sensor not enough.During exposure height, figure image height illumination region presents saturation condition because of over-exposed; And exposure low time, image low-light (level) region is unintelligible because of under-exposed, is difficult to the detailed information simultaneously obtaining high brightness and low-brightness scene.

The ordinary digital camera used in the daily photographic process of people is the scene that simultaneously can not obtain high brightness and low-light level.The scene obtaining high brightness will turn down the exposure of digital camera, and the scene of meanwhile low-light level also just can not clearly obtain; Equally, the scene that obtain low-light level will heighten the exposure of digital camera, and now the scene of high brightness will present saturation condition on digital camera.This phenomenon is that people are in daily life by the problem that digital camera often can run into.

Applying in high-tech area at present, as imaging system military reconnaissance satellite, meteorological satellite and data satellite being all equipped with imageing sensor, imaging being carried out to target and can run into same problem too.

Solve the problem, must the dynamic range of expanded images.In prior art, the method for the dynamic range of expanded images is mainly divided into two kinds.First method redesigns sensor chip on hardware, and to reach dynamic range expanded object, but this method substantially increases complexity and the system cost of image sensor design; Second method is the method for twice or multiexposure, multiple exposure, same imageing sensor is utilized to obtain the image of different exposure continuously, namely adopt expose the shorter time of integration, resolution image high illumination region, adopt expose the longer time of integration, resolution image low-light (level) region, then the image of twice or multiexposure, multiple exposure is carried out synthesis process to expand its dynamic range.But existing twice or method for multiple exposures with multiple also also exist significant shortcoming: processing speed is slow and can not realize synchronous exposure (namely synchronously can not realize the length twice exposure time of integration).Same imageing sensor is utilized to remove continuous acquisition multiple image, processing speed is slower, in addition, an imageing sensor can not gather the image of two width or several different exposures within the extremely short time simultaneously, imageing sensor all need when each collection the regular hour go reading images just can carry out on collection once, this can cause having regular hour skew between the collection of different width image, when taking the target of rapid movement, two width or multiple image can not be overlapping in space, and composograph is of poor quality.

Summary of the invention

The technical problem to be solved in the present invention is, for the above-mentioned defect of prior art, provides a kind of method and device of expanded images dynamic range.The image information of Same Scene was at least gathered once with the different time for exposure by two imageing sensors simultaneously, and the image after gathering is synthesized high dynamic range images through image processing algorithm, solve designed image sensor complex on hardware defect and solve twice or the method processing speed of multiexposure, multiple exposure slow and the defect of synchronous exposure can not be realized.

The technical solution adopted for the present invention to solve the technical problems is: a kind of method providing expanded images dynamic range, comprises step:

A, the first imageing sensor is utilized to gather the first light signal at least one times according to the first time for exposure preset, and the first gathered light signal is converted to the analog electrical signal of at least one the first image, utilize the second imageing sensor to gather the second light signal at least one times according to the second time for exposure preset simultaneously, and the second gathered light signal is converted to the analog electrical signal of at least one the second image, wherein:

First time for exposure was different from for the second time for exposure;

First light signal and the second light signal carry out light splitting by spectral module to the light signal of the image information of Same Scene respectively and obtain;

B, convert the analog electrical signal of the analog electrical signal of at least one the first image and at least one the second image to the digital electric signal of at least one the first image and the digital electric signal of at least one the second image respectively;

C, the digital electric signal of at least one the first image and the digital electric signal of at least one the second image carried out to process and composograph.

In the method for expanded images dynamic range of the present invention, in step C, carry out process and composograph by the digital electric signal of algorithmic formula below to the digital electric signal of at least one the first image and at least one the second image:

f ( x , y ) = ( 255 - A ) Σ n = 1 N g n ( x , y ) 255 - A * N + ( N - 1 ) Σ n = 1 N g n ( x , y ) / N

Wherein, f (x, y) is the gray value of image in (x, y) position after synthesis; g n(x, y) is the gray value of the n-th width image in (x, y) position; The number summation that N is the first collected image and the second image; A is the reference value preset, and A*N < 255.

The present invention also provides a kind of method of expanded images dynamic range, comprising:

Set of lenses, for assembling the light signal of the image information based on Same Scene;

Spectral module, for being divided into the first light signal and the second light signal by light signal;

Image capture module, comprise the first imageing sensor and the second imageing sensor, first imageing sensor gathers the first light signal at least one times according to the first time for exposure preset, and the first gathered light signal is converted to the analog electrical signal of at least one the first image, simultaneously, second imageing sensor gathers the second light signal at least one times according to the second time for exposure preset, and converts the second gathered light signal the analog electrical signal of at least one the second image to, wherein:

First time for exposure was different from for the second time for exposure;

First light signal and the second light signal carry out light splitting by spectral module to the light signal of the image information of Same Scene respectively and obtain;

A/D modular converter, comprise the first A/D converter and the second A/D converter, the first A/D converter converts the analog electrical signal of at least one the first image the digital electric signal of at least one the first image to; Second A/D converter converts the analog electrical signal of at least one the second image the digital electric signal of at least one the second image to;

Computer, for controlling image capture module, and for carrying out process to the digital electric signal of at least one the first image and the digital electric signal of at least one the second image and composograph.

In the device of expanded images dynamic range of the present invention, its computer carries out process and composograph by the digital electric signal of algorithmic formula below to the digital electric signal of at least one the first image and at least one the second image:

f ( x , y ) = ( 255 - A ) &Sigma; n = 1 N g n ( x , y ) 255 - A * N + ( N - 1 ) &Sigma; n = 1 N g n ( x , y ) / N

Wherein, f (x, y) is the gray value of image in (x, y) position after synthesis; g n(x, y) is the gray value of the n-th width image in (x, y) position; The number summation that N is the first collected image and the second image; A is the reference value preset, and A*N < 255.

Implement method and the device of a kind of expanded images dynamic range of the present invention, there is following beneficial effect: it is at least gathered once with the different time for exposure the image information of Same Scene by employing two imageing sensors simultaneously, and by the image after collection through image processing algorithm composograph, gather once, just can obtain two width images (comprising a panel height exposure image and the low exposure image of a width).In expanded images dynamic range with improve while signal noise ratio (snr) of image, can effectively improve view synthesis speed, and the length twice exposure sync time of integration can be realized carry out, can be applicable to the photographing process of fast-moving target.

Accompanying drawing explanation

Below in conjunction with drawings and Examples, the invention will be further described, in accompanying drawing:

Fig. 1 is the flow chart of the embodiment one of method according to expanded images dynamic range of the present invention;

Fig. 2 is the structured flowchart of the embodiment one of device according to expanded images dynamic range of the present invention.

Embodiment

In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.

The embodiment provides a kind of method and device of expanded images dynamic range, mainly realize high dynamic range images by following two aspects: one is utilize two imageing sensors at least to gather once the image information of Same Scene respectively simultaneously, and two imageing sensors arrange the different time for exposure, a time for exposure is longer, and another time for exposure is shorter; Two be will be collected and through A/D conversion after view data synthesize high dynamic range images by image processing algorithm, to reach dynamic range expanded object.

As shown in Figure 1, in the embodiment one of the method for expanded images dynamic range of the present invention, carry out image acquisition and image procossing, comprise step:

Step S1: utilize the first imageing sensor to gather the first light signal at least one times according to the first time for exposure preset, and the first gathered light signal is converted to the analog electrical signal of at least one the first image, utilize the second imageing sensor to gather the second light signal at least one times according to the second time for exposure preset simultaneously, and convert the second gathered light signal the analog electrical signal of at least one the second image to.

Wherein, the first imageing sensor and the second imageing sensor start to gather simultaneously.First time for exposure was long time for exposure T 1, the second time for exposure was short exposure time T 2, such as, long time for exposure T 1be redefined for 10ms, short exposure time T 2be redefined for 1ms.Certainly, above-mentioned numerical value can set different values in actual applications as required.Like this, the first image is the image of long time for exposure (i.e. high exposure), and it captures the detailed information in image low-light (level) region after enough time for exposure; And the second image is the image of short exposure time (i.e. low exposure), it captures the detailed information in high illumination region before saturation.

In addition, the first light signal and the second light signal carry out imaging by imaging object light (i.e. the light signal of the image information of Same Scene) scioptics group to carry out through Amici prism two light signals that beam splitting is divided into again, and these two light signals are identical.

Step S2: convert the analog electrical signal of the analog electrical signal of at least one the first image and at least one the second image to the digital electric signal of at least one the first image and the digital electric signal of at least one the second image respectively.

Step S3: process is carried out and composograph to the digital electric signal of at least one the first image and the digital electric signal of at least one the second image.Process is carried out and composograph by the digital electric signal of algorithmic formula below to the digital electric signal of at least one the first image and at least one the second image:

f ( x , y ) = ( 255 - A ) &Sigma; n = 1 N g n ( x , y ) 255 - A * N + ( N - 1 ) &Sigma; n = 1 N g n ( x , y ) / N

Wherein, f (x, y) is the gray value of image in (x, y) position after synthesis; g n(x, y) is the gray value of the n-th width image in (x, y) position; The number summation that N is the first collected image and the second image; A is the reference value preset, and A*N < 255.

The algorithm that embodiments of the invention one adopt has certain advantage in arithmetic speed, image after synthesis can keep original information well, its grey scale pixel value, all between 0-255, can not produce the problem of spilling, does not need to be normalized image.

In addition, can go according to actual conditions picture number N and the reference value A of determining required collection, to reach best effect, such as, get N=2, A=50.When N value is 2, namely gather two width view data, to gather once with long time for exposure respectively and with short exposure time collection once, and this twice collection is gathered simultaneously by two imageing sensors respectively.Therefore, when taking the target of rapid movement, can effectively avoid two width images overlap can not cause the ropy problem of composograph in space.

As shown in Figure 2, in the embodiment one of the device of expanded images dynamic range of the present invention, comprise set of lenses 1, spectral module 2, image capture module 3, A/D modular converter 4 and computer 5.

Set of lenses 1, for assembling the light signal of the image information based on Same Scene.

Spectral module 2, for being divided into the first light signal and the second light signal by light signal.

Image capture module 3, comprise the first imageing sensor 6 and the second imageing sensor 7, first imageing sensor 6 gathers the first light signal at least one times according to the first time for exposure preset, and the first gathered light signal is converted to the analog electrical signal of at least one the first image, simultaneously, second imageing sensor 7 gathers the second light signal at least one times according to the second time for exposure preset, and converts the second gathered light signal the analog electrical signal of at least one the second image to.

Wherein, the first imageing sensor is redefined for the long time for exposure, and the second imageing sensor is redefined for short exposure time, and simultaneously two imageing sensors start to gather.

A/D modular converter, comprise the first A/D converter and the second A/D converter, the first A/D converter converts the analog electrical signal of at least one the first image the digital electric signal of at least one the first image to; Second A/D converter converts the analog electrical signal of at least one the second image the digital electric signal of at least one the second image to.

Computer, for controlling image capture module, and for carrying out process to the digital electric signal of at least one the first image and the digital electric signal of at least one the second image and composograph.Wherein, computer by the collection of VC programming realization image, the algorithm process of image and the display of image.

The above; be only the present invention's preferably embodiment, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; the change that can expect easily or replacement, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of claim.

Claims (2)

1. the method for an expanded images dynamic range, it is characterized in that, the device of expanded images dynamic range realizes, the device of described expanded images dynamic range comprises set of lenses, spectral module, image capture module, A/D modular converter and computer, described image capture module comprises the first imageing sensor and the second imageing sensor, and described A/D modular converter comprises the first A/D converter and the second A/D converter;
The method of expanded images dynamic range comprises step:
A, the first imageing sensor is utilized to gather the first light signal at least one times according to the first time for exposure preset, and gathered described first light signal is converted to the analog electrical signal of at least one the first image, utilize the second imageing sensor to gather the second light signal at least one times according to the second time for exposure preset simultaneously, and convert gathered described second light signal the analog electrical signal of at least one the second image to;
Described first time for exposure is different from described second time for exposure;
Described first light signal and described second light signal carry out light splitting by spectral module to the light signal of the image information of Same Scene respectively and obtain, and described first light signal is identical with described second light signal; The optical signals set of lenses of the image information of Same Scene is assembled;
B, the first A/D converter and the second A/D converter convert the analog electrical signal of the first image described at least one and the analog electrical signal of the second image described at least one to the digital electric signal of at least one the first image and the digital electric signal of at least one the second image accordingly respectively;
C, computer carry out process and composograph to the digital electric signal of the first image described at least one and the digital electric signal of the second image described at least one;
In described step C, computer carries out process and composograph by algorithmic formula below to the digital electric signal of the first image described at least one and the digital electric signal of the second image described at least one:
Wherein, f (x, y) is the gray value of image in (x, y) position after synthesis; g n(x, y) is the gray value of the n-th width image in (x, y) position; The number summation that N is the first collected image and the second image; A is the reference value preset, and A*N<255.
2. a device for expanded images dynamic range, is characterized in that, comprising:
Set of lenses (1), for assembling the light signal of the image information based on Same Scene;
Spectral module (2), for being divided into the first light signal and the second light signal by described light signal;
Image capture module (3), comprise the first imageing sensor (6) and the second imageing sensor (7), described first imageing sensor (6) gathers the first light signal at least one times according to the first time for exposure preset, and gathered described first light signal is converted to the analog electrical signal of at least one the first image, simultaneously, described second imageing sensor (7) gathers the second light signal at least one times according to the second time for exposure preset, and gathered described second light signal is converted to the analog electrical signal of at least one the second image,
Described first time for exposure is different from described second time for exposure;
Described first light signal and described second light signal carry out light splitting by spectral module to the light signal of the image information of Same Scene respectively and obtain, and described first light signal is identical with described second light signal;
A/D modular converter (4), comprise the first A/D converter (8) and the second A/D converter (9), described first A/D converter (8) converts the analog electrical signal of the first image described at least one digital electric signal of at least one the first image to; Described second A/D converter (9) converts the analog electrical signal of the second image described at least one digital electric signal of at least one the second image to;
Computer (5), for controlling described image capture module (3), and carries out process and composograph for the digital electric signal to the first image described at least one and the digital electric signal of the second image described at least one;
Described computer (5) carries out process and composograph by algorithmic formula below to the digital electric signal of the first image described at least one and the digital electric signal of the second image described at least one:
Wherein, f (x, y) is the gray value of image in (x, y) position after synthesis; g n(x, y) is the gray value of the n-th width image in (x, y) position; The number summation that N is the first collected image and the second image; A is the reference value preset, and A*N<255.
CN201110434785.XA 2011-12-22 2011-12-22 Method and device for extending image dynamic ranges CN102572245B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110434785.XA CN102572245B (en) 2011-12-22 2011-12-22 Method and device for extending image dynamic ranges

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110434785.XA CN102572245B (en) 2011-12-22 2011-12-22 Method and device for extending image dynamic ranges

Publications (2)

Publication Number Publication Date
CN102572245A CN102572245A (en) 2012-07-11
CN102572245B true CN102572245B (en) 2014-12-17

Family

ID=46416621

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110434785.XA CN102572245B (en) 2011-12-22 2011-12-22 Method and device for extending image dynamic ranges

Country Status (1)

Country Link
CN (1) CN102572245B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103065324B (en) * 2012-12-13 2016-03-30 广东威创视讯科技股份有限公司 A kind of moving target detecting method and device
CN103973997B (en) * 2013-02-05 2017-09-26 浙江大华技术股份有限公司 A kind of image processing method and device
US20150116525A1 (en) * 2013-10-31 2015-04-30 Himax Imaging Limited Method for generating high dynamic range images
CN104103053B (en) * 2013-11-25 2017-10-20 北京华科创智健康科技股份有限公司 A kind of method and apparatus of fujinon electronic video endoscope image enhaucament
CN104917950B (en) * 2014-03-10 2018-10-12 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN105338338B (en) 2014-07-17 2018-01-02 诺基亚技术有限公司 Method and apparatus for image-forming condition detection
US9787909B1 (en) * 2016-03-31 2017-10-10 Stmicroelectronics (Research & Development) Limited Controlling signal-to-noise ratio in high dynamic range automatic exposure control imaging
KR20180036464A (en) * 2016-09-30 2018-04-09 삼성전자주식회사 Method for Processing Image and the Electronic Device supporting the same
CN106878618B (en) * 2017-03-07 2020-02-21 武汉华之洋科技有限公司 Image processing system and method based on FPGA
CN110035206B (en) * 2019-03-26 2020-12-11 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment and computer readable storage medium
CN111383206B (en) * 2020-06-01 2020-09-29 浙江大华技术股份有限公司 Image processing method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1915164A (en) * 2006-09-08 2007-02-21 浙江大学 Method and system for expanding dynamic range in tomography of optical coherent
CN101365071A (en) * 2007-09-27 2009-02-11 豪威科技有限公司 Double-model camera scheme, equipment, system and method
CN101441320A (en) * 2008-12-09 2009-05-27 东华大学 High dynamic image acquisition device based on microscopic imaging detection and method thereof
CN101494739A (en) * 2009-02-09 2009-07-29 天津市晶奇微电子有限公司 Method for determining exposure number and distributing exposure time in multi-exposure combination
CN101764959A (en) * 2008-12-25 2010-06-30 昆山锐芯微电子有限公司 Image pickup system and image processing method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7379094B2 (en) * 2002-04-18 2008-05-27 Olympus Corporation Electronic still imaging apparatus and method having function for acquiring synthesis image having wide-dynamic range
JP5439197B2 (en) * 2010-01-15 2014-03-12 オリンパスイメージング株式会社 Imaging apparatus, imaging method, and imaging program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1915164A (en) * 2006-09-08 2007-02-21 浙江大学 Method and system for expanding dynamic range in tomography of optical coherent
CN101365071A (en) * 2007-09-27 2009-02-11 豪威科技有限公司 Double-model camera scheme, equipment, system and method
CN101441320A (en) * 2008-12-09 2009-05-27 东华大学 High dynamic image acquisition device based on microscopic imaging detection and method thereof
CN101764959A (en) * 2008-12-25 2010-06-30 昆山锐芯微电子有限公司 Image pickup system and image processing method
CN101494739A (en) * 2009-02-09 2009-07-29 天津市晶奇微电子有限公司 Method for determining exposure number and distributing exposure time in multi-exposure combination

Also Published As

Publication number Publication date
CN102572245A (en) 2012-07-11

Similar Documents

Publication Publication Date Title
ES2743759T3 (en) Fusion processing system for visible light and infrared images and fusion method
TWI509569B (en) Object detecting device
US9124808B2 (en) Foveated imaging system and method
US9055181B2 (en) Solid-state imaging device, image processing apparatus, and a camera module having an image synthesizer configured to synthesize color information
JP4689620B2 (en) Image sensor
US10447950B2 (en) Single image sensor for capturing mixed structured-light images and regular images
CN101305397B (en) Method for forming image based on a plurality of image frames, image processing system and digital camera
US8150255B2 (en) Flash control for electronic rolling shutter
US8189057B2 (en) Camera exposure optimization techniques that take camera and scene motion into account
US8558913B2 (en) Capture condition selection from brightness and motion
US7839444B2 (en) Solid-state image-pickup device, method of driving solid-state image-pickup device and image-pickup apparatus
CN101399925B (en) Electronic camera
EP2410734B1 (en) Image synthesizing device, image synthesizing method and computer readable medium
EP1322108B1 (en) Image creating device and image creating method
US7176962B2 (en) Digital camera and digital processing system for correcting motion blur using spatial frequency
US7683964B2 (en) Image capturing apparatus and image capturing method
JP4835593B2 (en) Image processing apparatus, image processing method, program, and recording medium
CN101755463B (en) Multiple component readout of image sensor
JP5917054B2 (en) Imaging apparatus, image data processing method, and program
JP4466015B2 (en) Image processing apparatus and image processing program
EP2519001A2 (en) Structured light imaging system
CN105046668B (en) The method for producing high dynamic range images
CN100370811C (en) Digital still camera apparatus, video camera apparatus, and information terminal apparatus
US20100328490A1 (en) Imaging control apparatus, imaging apparatus and imaging control method
US7911505B2 (en) Detecting illuminant flicker

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
GR01 Patent grant
C14 Grant of patent or utility model