CN201393267Y - High dynamic range image acquisition device - Google Patents

High dynamic range image acquisition device Download PDF

Info

Publication number
CN201393267Y
CN201393267Y CN200920067553U CN200920067553U CN201393267Y CN 201393267 Y CN201393267 Y CN 201393267Y CN 200920067553 U CN200920067553 U CN 200920067553U CN 200920067553 U CN200920067553 U CN 200920067553U CN 201393267 Y CN201393267 Y CN 201393267Y
Authority
CN
China
Prior art keywords
dynamic range
high dynamic
range image
image
embedded processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN200920067553U
Other languages
Chinese (zh)
Inventor
朱建国
江兴智
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
WUXI JINTENG INTELLIGENT TECHNOLOGY Co Ltd
Original Assignee
WUXI JINTENG INTELLIGENT TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by WUXI JINTENG INTELLIGENT TECHNOLOGY Co Ltd filed Critical WUXI JINTENG INTELLIGENT TECHNOLOGY Co Ltd
Priority to CN200920067553U priority Critical patent/CN201393267Y/en
Application granted granted Critical
Publication of CN201393267Y publication Critical patent/CN201393267Y/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

The utility model provides a high dynamic range image acquisition device comprising an image collecting module, an embedded processor and a display module. The image collecting module is used for acquiring at least one picture; the embedded processor is electrically connected with the image collecting module and synthesizes a high dynamic range image according to the picture; and the display module is electrically connected with the embedded processor and displays the high dynamic range image. The high dynamic range image acquisition device can directly acquire and synthesize the high dynamic range image by utilizing the high performance embedded processor, thereby fully exerting the calculation and processing capability of the embedded processor so as to directly, rapidly and conveniently acquire the high dynamic range image, therefore, a user can see the effect of the acquired high dynamic image while directly shooting a picture.

Description

High dynamic range image acquisition device
Technical Field
The present invention relates to an image capturing device, and more particularly to a high dynamic range image capturing device.
Background
Many people use cameras and may have experienced such an experience: when a person stands in front of the window against the light, the illuminated face is dark, and if the person wants to illuminate the face clearly, the scenery outside the window may be overexposed. This is because the illumination dynamic range of the actual environment is larger than the dynamic range of the camera.
In many cases, the ratio of radiant light intensity in bright and dark portions of a scene is greater than 100000: 1. The reduced dynamic range is more than 100 db. However, the dynamic range of a common camera is only 60db, and the dynamic range of the whole scene cannot be covered, so that the irradiated image is overexposed at some bright parts or is too dark at some dark parts, and the situation causes the image to lose details, and the image content cannot be sufficiently restored for further analysis.
Another example of a high dynamic range is when there is both a direct sunlight portion and a shaded portion of the scene. The contrast of the bright and dark portions of the image is also large at this time.
The eye is the window where people feel the world, and from the viewpoint of acquiring an external image, the eye is equivalent to a camera. For human eyes, the dynamic range obtained by the system is higher than that of a common camera system due to the local automatic adjustment function of the system. Therefore, the scene directly seen by people is richer than the pictures taken by ordinary cameras, and has more details and richer colors. Whether a digital camera can be used to obtain a picture similar to the visual perception of people is a problem that many camera designers and users are concerned about when the resolution of the picture is improved.
Acquiring an image with a High Dynamic Range (HDR) is beneficial to acquiring an image with an optimal visual effect, and is of great use in medical image processing and other industrial analysis. In medical and industrial image control, high dynamic range situations are also frequently encountered. For the synthesis of high dynamic range images, some organizations have started research, but currently, mainly focus on the synthesis on computers. The current processing is mainly to shoot a group of pictures through a camera, then to synthesize the pictures on a computer through an algorithm, and to output a restored high dynamic range image. To obtain high dynamic range images, some companies design special cameras for this purpose, which increases the cost.
SUMMERY OF THE UTILITY MODEL
An object of the utility model is to provide a high dynamic range image acquisition device to improve prior art's disappearance.
To achieve the above objective, the present invention provides a high dynamic range image capturing device, which includes an image capturing module, an embedded processor and a display module. The image acquisition module is used for capturing at least one picture; the embedded processor is electrically connected with the image acquisition module and synthesizes a high dynamic range image according to the picture; and the display module is electrically connected with the embedded processor and displays the high dynamic range image.
The utility model discloses a high dynamic range image acquisition device utilizes the embedded treater of high performance, directly carries out acquireing and synthesizing of high dynamic range image, and calculation and the throughput that can the embedded treater of full play make acquireing of high dynamic range image more direct swift, make the user can be direct when shooing, see the effect of shooting.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
Fig. 1 is a schematic diagram of a high dynamic range image capturing apparatus according to an embodiment of the present invention.
Detailed Description
Fig. 1 is a schematic diagram of a high dynamic range image capturing apparatus according to an embodiment of the present invention. As shown in fig. 1, the high dynamic range image capturing apparatus 1 includes an image capturing module 11, an embedded processor 12, a display module 13, and a memory 14.
The image capturing module 11 captures a plurality of pictures of the same scene with different exposure coefficients. The embedded processor 12 is electrically connected to the image acquisition module 11, and synthesizes a high dynamic range image according to the picture. The display module 13 is electrically connected to the embedded processor 12 and displays a high dynamic range image.
In the present embodiment, the high dynamic range image capturing apparatus 1 further includes a memory 14 and a touch key 15. The storage 14 is used for storing a plurality of pictures of different exposure coefficients of the same scene and the synthesized high dynamic range image. The touch key 15 is used for inputting a shooting instruction, a processing instruction, a display instruction, and a system setting instruction of the image capturing module 11. In addition, the image capturing module 11 in this embodiment is a ccd camera, an cmos camera or an cmos camera, and the display module 13 is a touch-controlled lcd, but the present invention is not limited thereto.
Further, in the present embodiment, the embedded processor 12 is
Figure G2009200675533D00031
533 a processor.
Figure G2009200675533D00032
The processor is a novel 16-32 bit embedded processor designed to meet the computing requirements and power consumption constraints of current embedded audio, video and communication applications.
Figure G2009200675533D00033
Processor based onThe micro-signal architecture (MSA) developed by ADI and Intel corporation combines a 32-bit RISC type instruction set and dual 16-bit multiply-accumulate (MAC) signal processing functions with the ease of use provided by general-purpose microcontrollers. The combination of such processing features enables
Figure G2009200675533D00034
Processors can function well in both signal processing and control processing applications-in many cases eliminating the need to add separate heterogeneous processors, this capability greatly simplifies hardware and software design implementation tasks. At present, the number of the current day,
Figure G2009200675533D00035
processors can provide performance up to 756MHz in single core products.The novel symmetric multiprocessor members of the processor family achieve performance doubling at the same frequency.
Figure G2009200675533D00037
The processor family also provides industry leading power consumption performance down to 0.8V. This combination of high performance and low power consumption is essential to satisfy today's and future signal processing applications, including broadband wireless, internet appliances with audio/video capabilities, and mobile communications. Wherein,
Figure G2009200675533D00038
533 is ADI Corp
Figure G2009200675533D00039
The main frequency of a high-performance video processing chip in the series can reach 600MHz at most, 1200M times of multiply-add operation can be processed per second, a large number of special instructions for images are provided, and a plurality of instructions can be processed in parallel.
In the present embodiment, the image capturing moduleThe block 11 outputs pictures of different exposure coefficients of the same scene to the embedded processor 12 via the PPI interface (
Figure G2009200675533D000310
533 a processor). Embedded processor 12(
Figure G2009200675533D000311
533 processor) may obtain a Camera Response Function (CRF) of the image capturing module 11 according to the pictures of the same scene with different exposure coefficients. The camera response curve reflects the relationship between the gray level of the image and the exposure and illumination of each point in the scene.
The exposure of each point is recorded as X ═ E ═ T, (1)
Is the product of the illumination E and the exposure time T.
The relationship between the gray-scale value of the image and the exposure can be expressed by the following formula:
Zij=f(EiΔtj) (2)
where Zij is expressed as a gray value of the image.
Equation (2) is the CRF curve, which is an intrinsic characteristic curve of each camera and is a non-linear function.
Debevec proposes a method of recovering the response curve of a camera, which only needs to take a group of pictures at different exposure ratios for the same scene to take a group of pictures. The corresponding response curve can be recovered by analyzing the image data, the requirement on the environment is simple, and the CRF curve can be recovered under almost any scene. In the present embodiment, the embedded processor 12(
Figure G2009200675533D00041
533 processor) will calculate the CRF curve using Debevec's method.
According to the principle of sensitization of the image capturing device 11, f can beTo be regarded as a monotonically increasing function, so f has a reversible function f-1The formula (2) is rewritten as
f-1(Zij)=EiΔtj (3)
Taking logarithm on two sides to obtain:
lnf-1(Zij)=lnEi+lnΔtj (4)
let g be lnf-1(Zij) The above formula can be abbreviated as:
g(Zij)=lnEi+lnΔtj (5)
where i represents each point and j represents the exposure of each picture.
To restore the CRF curve, the condition is ZijAnd Δ tjThe illumination Ei and the function are known and unknown. We recover the illumination Ei value and the CRF function g (z) from the angle of least square error according to equation (3).
The problem may actually be converted to a solution equation, with the following quadratic equation taking the minimum.
<math> <mrow> <mi>O</mi> <mo>=</mo> <munderover> <mi>&Sigma;</mi> <mi>i</mi> <mi>N</mi> </munderover> <munderover> <mi>&Sigma;</mi> <mi>j</mi> <mi>P</mi> </munderover> <msup> <mrow> <mo>[</mo> <mi>g</mi> <mrow> <mo>(</mo> <msub> <mi>Z</mi> <mi>ij</mi> </msub> <mo>)</mo> </mrow> <mo>-</mo> <mi>ln</mi> <msub> <mi>E</mi> <mi>i</mi> </msub> <mo>-</mo> <mi>ln</mi> <mi>&Delta;</mi> <msub> <mi>t</mi> <mi>j</mi> </msub> <mo>]</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <mi>&lambda;</mi> <munderover> <mi>&Sigma;</mi> <mrow> <mi>z</mi> <mo>=</mo> <msub> <mi>Z</mi> <mi>min</mi> </msub> <mo>+</mo> <mn>1</mn> </mrow> <mrow> <msub> <mi>Z</mi> <mi>max</mi> </msub> <mo>-</mo> <mn>1</mn> </mrow> </munderover> <msup> <mi>g</mi> <mrow> <mo>&prime;</mo> <mo>&prime;</mo> </mrow> </msup> <msup> <mrow> <mo>(</mo> <mi>z</mi> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>6</mn> <mo>)</mo> </mrow> </mrow> </math>
The first term of the formula makes the solution meet the requirement of minimum variance, and the second term makes the square sum of the second reciprocal of g minimum, so that the curve meets the requirement of smoothness. By solving the system of equations defined by equation (4), the g (Z) function can be solved.
Note that Z has a finite value, and when the CRF curve is restored, only g (Z) values at finite points, such as g (0) to g (255), are restored.
When the camera response curve is determined, the illumination of the image can be restored by,
lnEi=g(Zij)-lnΔtj (7)
where Ei is the illumination intensity of the corresponding point in the scene to be restored. ZijIs the pixel value at a certain exposure time, Δ tjIs the exposure time.
Consider Zij and Δ t for each graphjThe values may contain some errors and noise, and the recovered Ei values of each graph may be weighted and averaged to recover the lnEi values, which results in a better signal-to-noise ratio.
<math> <mrow> <mi>ln</mi> <msub> <mi>E</mi> <mi>i</mi> </msub> <mo>=</mo> <mfrac> <mrow> <msubsup> <mi>&Sigma;</mi> <mrow> <mi>j</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>P</mi> </msubsup> <mi>w</mi> <mrow> <mo>(</mo> <msub> <mi>Z</mi> <mi>ij</mi> </msub> <mo>)</mo> </mrow> <mrow> <mo>(</mo> <mi>g</mi> <mrow> <mo>(</mo> <msub> <mi>Z</mi> <mi>ij</mi> </msub> <mo>)</mo> </mrow> <mo>-</mo> <mi>ln</mi> <mi>&Delta;</mi> <msub> <mi>t</mi> <mi>j</mi> </msub> <mo>)</mo> </mrow> </mrow> <mrow> <msubsup> <mi>&Sigma;</mi> <mrow> <mi>j</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>P</mi> </msubsup> <mi>w</mi> <mrow> <mo>(</mo> <msub> <mi>Z</mi> <mi>ij</mi> </msub> <mo>)</mo> </mrow> </mrow> </mfrac> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>8</mn> <mo>)</mo> </mrow> </mrow> </math>
Thus embedded processor 12: (
Figure G2009200675533D00052
533 processor) can restore the Ei value of each point to obtain the high dynamic range image.
For high dynamic range images, the Ei value of the image is obtained, and if the Ei value is directly sent to a common display, the display effect is often not good. If the simple linear mapping method is adopted, the contrast of the whole image display looks like washing, and in order to better display the high dynamic range image on a general display, the embedded processor 12(533 processor) must perform Tone Mapping processing (Tone Mapping) on the high dynamic range image so that it can realize display close to the human eye feeling on an ordinary display. At this time, the resulting image is a high dynamic range image that can be displayed on a normal display.
The utility model discloses a high dynamic range image acquisition device utilizes the embedded treater of high performance, directly carries out acquireing and synthesizing of high dynamic range image, and calculation and the throughput that can the embedded treater of full play make acquireing of high dynamic range image more direct swift, make the user can be direct when shooing, see the effect of shooting.
Although the present invention has been described with reference to the preferred embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (6)

1. A high dynamic range image pickup apparatus characterized by comprising:
the image acquisition module is used for capturing at least one picture;
the embedded processor is electrically connected with the image acquisition module and synthesizes a high dynamic range image according to the picture; and
and the display module is electrically connected with the embedded processor and displays the high dynamic range image.
2. The device of claim 1, further comprising a storage device electrically connected to the image capture module and the embedded processor, the storage device being configured to store the image and the high dynamic range image.
3. The device of claim 1, further comprising a touch button electrically connected to the embedded processor, wherein the touch button is used for inputting a shooting command, a processing command, a display command, and a system setting command of the image capturing module.
4. The high dynamic range image capturing device of claim 1, wherein said image capturing module is a ccd camera, a cmos camera or a cmos camera.
5. The high dynamic range image capturing device of claim 1, wherein said display module is a liquid crystal display.
6. The high dynamic range image capturing device of claim 5, wherein said liquid crystal display is a touch-sensitive liquid crystal display.
CN200920067553U 2009-02-06 2009-02-06 High dynamic range image acquisition device Expired - Fee Related CN201393267Y (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200920067553U CN201393267Y (en) 2009-02-06 2009-02-06 High dynamic range image acquisition device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200920067553U CN201393267Y (en) 2009-02-06 2009-02-06 High dynamic range image acquisition device

Publications (1)

Publication Number Publication Date
CN201393267Y true CN201393267Y (en) 2010-01-27

Family

ID=41600088

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200920067553U Expired - Fee Related CN201393267Y (en) 2009-02-06 2009-02-06 High dynamic range image acquisition device

Country Status (1)

Country Link
CN (1) CN201393267Y (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104881644A (en) * 2015-05-25 2015-09-02 华南理工大学 Face image acquisition method under uneven lighting condition
WO2016123850A1 (en) * 2015-02-02 2016-08-11 宇龙计算机通信科技(深圳)有限公司 Photographing control method for terminal, and terminal
CN106416225A (en) * 2014-05-30 2017-02-15 通用电气公司 Remote visual inspection image capture system and method
CN108141525A (en) * 2015-08-19 2018-06-08 谷歌有限责任公司 Smart image sensors with integrated memory and processor
US10079981B2 (en) 2014-10-09 2018-09-18 Zte Corporation Image dynamic range adjustment method, terminal, and storage medium
CN110445986A (en) * 2019-07-30 2019-11-12 Oppo广东移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN113395459A (en) * 2020-03-13 2021-09-14 西安诺瓦星云科技股份有限公司 Dynamic range adjusting system and method

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106416225A (en) * 2014-05-30 2017-02-15 通用电气公司 Remote visual inspection image capture system and method
CN106416225B (en) * 2014-05-30 2020-03-10 通用电气公司 Remote visual inspection image capture system and method
US10079981B2 (en) 2014-10-09 2018-09-18 Zte Corporation Image dynamic range adjustment method, terminal, and storage medium
WO2016123850A1 (en) * 2015-02-02 2016-08-11 宇龙计算机通信科技(深圳)有限公司 Photographing control method for terminal, and terminal
CN104881644A (en) * 2015-05-25 2015-09-02 华南理工大学 Face image acquisition method under uneven lighting condition
CN108141525A (en) * 2015-08-19 2018-06-08 谷歌有限责任公司 Smart image sensors with integrated memory and processor
US10547779B2 (en) 2015-08-19 2020-01-28 Google Llc Smart image sensor having integrated memory and processor
CN110445986A (en) * 2019-07-30 2019-11-12 Oppo广东移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN110445986B (en) * 2019-07-30 2021-03-23 Oppo广东移动通信有限公司 Image processing method, image processing device, storage medium and electronic equipment
CN113395459A (en) * 2020-03-13 2021-09-14 西安诺瓦星云科技股份有限公司 Dynamic range adjusting system and method

Similar Documents

Publication Publication Date Title
CN201393267Y (en) High dynamic range image acquisition device
CN111654594B (en) Image capturing method, image capturing apparatus, mobile terminal, and storage medium
WO2021179852A1 (en) Image detection method, model training method, apparatus, device, and storage medium
CN113706414B (en) Training method of video optimization model and electronic equipment
CN108510557B (en) Image tone mapping method and device
CN105306788B (en) A kind of noise-reduction method and device of image of taking pictures
CN101095078A (en) Exposure of digital imaging
CN104094312A (en) Control of video processing algorithms based on measured perceptual quality characteristics
Yan et al. Enhancing image visuality by multi-exposure fusion
KR20200117695A (en) Electronic device and method for controlling camera using external electronic device
CN112422798A (en) Photographing method and device, electronic equipment and storage medium
US20130318458A1 (en) Modifying Chrome Based on Ambient Conditions
CN113808066A (en) Image selection method and device, storage medium and electronic equipment
CN114298889A (en) Image processing circuit and image processing method
CN107395983B (en) Image processing method, mobile terminal and computer readable storage medium
CN116012262B (en) Image processing method, model training method and electronic equipment
CN115908618B (en) Method, device, equipment and medium for generating reconstructed image based on pulse data
CN111415308A (en) Ultrasonic image processing method and communication terminal
WO2020155072A1 (en) Mixed layer processing method and apparatus
CN115484384B (en) Method and device for controlling exposure and electronic equipment
CN112950516B (en) Method and device for enhancing local contrast of image, storage medium and electronic equipment
CN114244655A (en) Signal processing method and related device
CN115527501A (en) Backlight value adjusting method, processor, display terminal and storage medium
CN114125296B (en) Image processing method, device, electronic equipment and readable storage medium
CN114143448B (en) Shooting method, shooting device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100127

Termination date: 20170206