CN101888487B - High dynamic range video imaging system and image generating method - Google Patents
High dynamic range video imaging system and image generating method Download PDFInfo
- Publication number
- CN101888487B CN101888487B CN2010101902616A CN201010190261A CN101888487B CN 101888487 B CN101888487 B CN 101888487B CN 2010101902616 A CN2010101902616 A CN 2010101902616A CN 201010190261 A CN201010190261 A CN 201010190261A CN 101888487 B CN101888487 B CN 101888487B
- Authority
- CN
- China
- Prior art keywords
- image
- dynamic range
- high dynamic
- optimal information
- target pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to a high dynamic range video imaging system and an image generating method. The system comprises an optical lens, an image processing unit, at least an optical splitter and a plurality of sensitive chips. The optical splitter splits the incident light penetrating through the optical lens into a plurality of beams which enter the plurality of sensitive chips so as to obtain image data with different exposures. The image processing unit fuses the image data to generate high dynamic range images. Each sensitive chip used by the high dynamic range video imaging system fused by the plurality of sensitive chips has same specifications so that synchronization and instantaneity of photographing can be ensured. Meanwhile, the generated video image has obvious advantage in color and luminance uniformities and affluent visual information compared with single exposed image, can effectively solve the problems of underexposure, overexposure and color and luminance non-uniformities in traditional image pickup systems and has great market applicable foreground.
Description
[technical field]
The present invention relates to computer vision and image processing field, relate in particular to a kind of high dynamic range video imaging system and image generating method.
[background technology]
Traditional high-dynamics image generation method is normally utilized same sensitive chip; Through being set, different exposure time obtains different exposure photos; And then merging the image that generation has HDR, its essence has determined to be used for photography, and can not handle dynamic scene and object.
Along with the development of image sensing technology, video capture has also got into the high definition epoch, yet only is the needs of viewing and admiring that the raising of video capture device resolution has been difficult to satisfy people.In image and field of video processing; More be to pay close attention to how to obtain HDR and the real colour degree that similar human visual system can reach; Yet because technological means is limit; The conventional video collecting device can only obtain satisfied picture quality under the normal illumination environment, when unfavorable factor such as high light or shade in taking, occurring, its shooting effect often is difficult to accept.The operation principle of traditional image and video acquisition device roughly can be divided into following several kinds: (1) common single image is taken; Main shutter speed or f-number through the control camera is to produce single image; Its picture quality depends primarily on the manufacture craft with imageing sensor and camera lens, and the personnel's of shooting technical merit.(2) the high-quality single image is taken; Such camera mainly is through specific fast door control program; Same shot object and scene are carried out repeatedly the exposure of different time, make the image information that can obtain multiexposure, multiple exposure on the egative film, the image that generates like this has more rich illumination and color information amount; Dynamic range is significantly strengthened, and this technology is mainly used on the high-grade manually camera.(3) HDR video camera mainly through the built-in image processing software of video camera, through illumination and the COLOR COMPOSITION THROUGH DISTRIBUTION of analyzing each two field picture inner core, is adjusted through the specific image processing method, and then generates the video with better visual effect.
Traditional single width dynamic range based on the generation of different exposure time image strengthens the scheme of image, can only take to the single static scene, and higher to the illumination and the environmental requirement of scene, this kind equipment can't carry out dynamic shooting in real time to continuous scene.
Traditional handles the high dynamic video method that generates based on single-frame images; Pass through image processing method; The video independent frame is carried out brightness and color analysis; And then improve observation indexs such as its contrast, brightness, saturation, though visual effect makes moderate progress, then can't handle for the information dropout that causes because of Gao Guang, overexposure, shade etc. in the prophase shoot.
Traditional high dynamic range video based on different exposure time is taken; To strengthen principle described in the scheme of image similar with the single width dynamic range that generates based on the different exposure time image; But the high dynamic range video image taking that is used for dynamic scene, its subject matter are, owing to the time difference of adopting the multiexposure, multiple exposure time to cause; Cause smear, apprehensive; For high-speed motion and scene change cause easily that photographic subjects loses etc. serious problems, and aspect the image registration and fusion in later stage, the conventional images processing method still is difficult to realize effectively handling at a high speed.
[summary of the invention]
Based on this, be necessary the high dynamic range video imaging system that can be used for the dynamic synchronization shooting that provides a kind of visual information abundant.
Simultaneously, also be necessary to provide the image generating method of the abundant high dynamic range video imaging system that can be used for the dynamic synchronization shooting of a kind of visual information.
A kind of high dynamic range video imaging system comprises optical lens, in addition, also comprises at least one optical splitter, a plurality of sensitive chip and graphics processing unit; Said optical splitter is used for the incident light through said optical lens is divided into the identical equivalent light beam of multi beam; Said a plurality of sensitive chip is the sensitive chip of same size; Be used to receive the identical equivalent light beam of said multi beam and obtain the same different raw image data of many groups depth of exposure of being clapped scene with identical photographed frame speed, graphics processing unit will be organized the raw image data fusion treatment more and generate high dynamic range images.
Preferably, said optical splitter is a light splitting piece, and the branch optical wavelength range of said light splitting piece is a visible-range; Said sensitive chip is a kind of in cmos image sensor, charge coupled cell imageing sensor or the near-infrared image transducer.
Preferably, also comprise peripheral system, said peripheral system comprises a plurality of IMAQ passages, image storage chip, encoder and display screen; The collection of said a plurality of IMAQ passage is organized the different raw image data of depth of exposure more and is passed to the image storage chip storage; Graphics processing unit obtains said raw image data generation high dynamic range images and passes to encoder encodes from image storage chip, and finally on display screen, shows.
Preferably, said graphics processing unit comprises that calibration module, image-region are divided module, optimal information is selected module and image co-registration module; Said calibration module is corrected the position deviation that a plurality of sensitive chips in the assembling process exist; Said image-region is divided module will organize the matrix-block that the different original image of depth of exposure is divided into equal-sized M * N more, and M, N are the positive integer greater than 1; The matrix-block that said optimal information selects module from a plurality of matrix-blocks of dividing, to select to have comprised best texture information and optimum saturation infromation forms intermediate image as the optimal information piece; Said image co-registration module is chosen target pixel points arbitrarily on intermediate image; And be near a plurality of optimal information pieces the center is chosen with the optimal information piece at target pixel points place; Then; Successively with the central point of each optimal information piece as the centre coordinate that merges function; Centre coordinate is made as the reference axis initial point simultaneously; Promptly obtain the blend curve of a plurality of different centre coordinates, under the situation of each blend curve, in the corresponding blend curve of different coordinate figure substitutions with the target pixel points place; Promptly obtain a plurality of fusion coefficients; Again with each fusion coefficients respectively divided by these a plurality of fusion coefficients with obtain a plurality of weighted values, at last will the original image at above-mentioned a plurality of optimal information pieces place in the pixel value of target pixel points position multiply by the pixel value that the high dynamic range images of target pixel points was got and obtained to corresponding weighted value, pixel data and the final generation high dynamic range images through other pixels of middle image being handled the one group of high dynamic range images that obtains all pixels then;
Said fusion function is
P wherein, q is the constant between [0,1], k ∈ [1,2 ..., 9], (x, y) is the coordinate figure of target pixel points position, (x
i, y
i) be the center point coordinate value of the optimal information piece chosen.
Preferably, said target pixel points is the pixel in the non-optimal information piece all around on the intermediate image; It is said that to be a plurality of optimal information pieces of choosing of center with the optimal information piece under the target pixel points contact with optimal information piece under the target pixel points.
A kind of image generating method of high dynamic range video comprises the steps: the incident light through optical lens is divided into the identical equivalent light beam of multi beam; To every Shu Guang with same photographed frame speed but carry out sensitization with different sensitivity values and handle and obtain the same different raw image data of many groups depth of exposure of being clapped scene; Said raw image data is carried out fusion treatment generate high dynamic range images.
Preferably, saidly raw image data is carried out fusion treatment generate the matrix-block that the high dynamic range images process comprises the steps: the original image of many different depth of exposures is divided into successively equal-sized M * N, M, N are the positive integer greater than 1; Synthetic intermediate image with best texture information and optimum saturation infromation piece; On intermediate image, choose target pixel points arbitrarily; And be near a plurality of optimal information pieces the center is chosen with the optimal information piece at target pixel points place; Then; Successively with the central point of each optimal information piece as the centre coordinate that merges function, centre coordinate is made as the reference axis initial point simultaneously, promptly obtains the blend curve of a plurality of different centre coordinates; Under the situation of each blend curve; In the corresponding blend curve of different coordinate figure substitutions with target pixel points place, promptly obtain a plurality of fusion coefficients, again with each fusion coefficients respectively divided by these a plurality of fusion coefficients with obtain a plurality of weighted values; Pixel value with target pixel points position in the original image at above-mentioned a plurality of optimal information pieces place multiply by the pixel value that the high dynamic range images of target pixel points was got and obtained to corresponding weighted value at last, then pixel data and the final high dynamic range images that generates through other pixels of middle image being handled the one group of high dynamic range images that obtains all pixels;
Said fusion function is
P wherein, q is the constant between [0,1], k ∈ [1,2 ..., 9], (x, y) is the coordinate figure of target pixel points position, (x
i, y
i) be the center point coordinate value of the optimal information piece chosen.
Preferably, said target pixel points is the pixel in the non-optimal information piece all around.
It is preferably, said that to be near a plurality of optimal information pieces of center choosing contact with optimal information piece point under the target pixel points or line contacts with the optimal information piece under the target pixel points.
Preferably, the image generating method of said high dynamic range video also is included in original image is divided the process of before position deviation that exists in optical splitter and the sensitive chip assembling process being corrected.
High each sensitive chip of dynamic video imaging system that many sensitive chips merge has the same time for exposure, thus can guarantee to take synchronously and real-time; Simultaneously; The more single exposure image of the video image that is generated is having a clear superiority in aspect color and the brightness uniformity; Visual information is abundant, can also solve effectively that owing of existing in traditional camera system exposed to the sun, overexposure and the unequal problem of chroma-luminance, has good marketing prospect.
[description of drawings]
Fig. 1 is the high dynamic range video imaging system hardware structure diagram that many sensitive chips of one embodiment of the invention merge.
Fig. 2 is the image processing system sketch map that comprises graphics processing unit.
Fig. 3 generates method flow diagram for high dynamic range images.
Fig. 4 is the sketch map that high dynamic range images generates in the graphics processing unit.
Fig. 5 is for merging the three-dimensional waveform figure of function.
[embodiment]
Through the multiple light beams that optical splitter will get into the extraneous radiant light div in par aeq of optical lens is set; And a plurality of sensitive chips are arranged to different sensitivity values; Thereby generate the original image that several have different exposures simultaneously to the same scene that is taken; Realize real-time video two field picture fusion treatment through dynamic many sensitivity values image interfusion method then, make the video image of final generation have higher dynamic range characteristics.
Below main the accompanying drawings high dynamic range video imaging system and the image generating method thereof that merge by many sensitive chips.
High dynamic range video imaging system comprises optical lens, optical splitter, sensitive chip, graphics processing unit and peripheral system etc.
Optical splitter can adopt common light splitting piece, its minute optical wavelength range in visible wavelength range, preferred, can select the light splitting piece of wave band at 450-650nm.
Sensitive chip can be CMOS (Complementary Metal Oxide Semiconductor; Complementary metal oxide semiconductors (CMOS)) imageing sensor, CCD (Charge-coupled Device, charge coupled cell) imageing sensor or near-infrared image transducer.A plurality of sensitive chips have same specification, when Same Scene is carried out exposure image, identical shooting frame per second and different sensitivity values (ISO value) are set, like ISO100, ISO200, ISO400 and ISO800 etc.After built-in image calibrating method demarcation; A plurality of sensitive chips can be realized complete registration, and the extraneous scene of promptly absorbing is in full accord, and the original image size that obtains is identical; Pixel in each original image is corresponding fully, thereby has guaranteed the synchronous of shooting process.
In a preferred embodiment, adopt three to become the light splitting piece of 135 ° or 45 ° will get into extraneous radiant light div in par aeq four light beams of optical lens with the collimated light beam direction, and project on four built-in sensitive chips, as shown in Figure 1.The sensitivity value of the first, second, third and the 4th sensitive chip is set at 100,200,400 and 800 respectively; Four sensitive chips are cmos image sensor; Has same photographed frame speed; Shooting picture is synchronous, and each constantly can obtain four original images to the different depth of exposures of Same Scene simultaneously.
Each is in order to obtain more abundant image information of vision content through the different original image of several depth of exposures that generates Same Scene constantly, yet remains mutually independently between several original images.Thereby, be necessary several original images are carried out fusion treatment in order in piece image, to comprise the image that the abundant image information that is obtained generates HDR.
As shown in Figure 2, for comprising the image processing system of graphics processing unit.This system comprises graphics processing unit and peripheral system.
Graphics processing unit comprises that image-region is divided module, optimal information is selected module and image co-registration module.
Image-region divide module will organize more the different original image of depth of exposure respectively correspondence be divided into equal-sized M * N matrix-block, M, N are the positive integer greater than 1.
The matrix-block that optimal information selects module from a plurality of matrix-blocks that original image is divided, to select to have comprised information such as best texture information and optimum contrast forms intermediate image as the optimal information piece.
The image co-registration module is chosen target pixel points arbitrarily on intermediate image; And be near a plurality of optimal information pieces the center is chosen with the optimal information piece at target pixel points place; Then; Successively with the central point of each optimal information piece as the centre coordinate that merges function, centre coordinate is made as the reference axis initial point simultaneously, promptly obtains the blend curve of a plurality of different centre coordinates; Under the situation of each blend curve; In the corresponding blend curve of different coordinate figure substitutions with target pixel points place, promptly obtain a plurality of fusion coefficients, again with each fusion coefficients respectively divided by these a plurality of fusion coefficients with obtain a plurality of weighted values; Pixel value with target pixel points position in the original image at above-mentioned a plurality of optimal information pieces place multiply by the pixel value that the high dynamic range images of target pixel points was got and obtained to corresponding weighted value at last, then pixel data and the final high dynamic range images that generates through other pixels of middle image being handled the one group of high dynamic range images that obtains all pixels.
Since around general not in user's concern scope with the pixel in corner, therefore can dispense and not carry out fusion treatment, the target pixel points of also promptly generally choosing is the pixel in the non-optimal information piece all around on the intermediate image; And near a plurality of optimal information pieces the target pixel points of choosing contact with the affiliated optimal information piece of target pixel points, and the optimal information number of blocks of promptly generally choosing is 9 or 5, comprising the optimal information piece under the target pixel points.
Graphics processing unit is generally high-speed dsp (Digital Signal Processing) graphics processing unit; Can adopt TMS320C6415 (the 4th phase of volume in August, 2005 " infrared and laser engineering " the 34th " based on the design and the realization of the images match processor of TMS320C6415 "); Its dominant frequency is 720MHz; Disposal ability is 5760MIPS, can satisfy the real-time needs of system and image calibrating method.
In preferred embodiment, graphics processing unit also comprises calibration module, and calibration module can be corrected the position deviation that each optical splitter and sensitive chip in the assembling process exist fast.
Peripheral system comprise IMAQ passage, image storage chip (Video Random Access Memory, VRAM), encoder and display screen etc.
The raw image data with different depth of exposures of four sensitive chip outputs is carried out independent collection, and the first, second, third and the 4th IMAQ passage is gathered the raw image data stream that spreads out of from the first, second, third and the 4th sensitive chip respectively.Each IMAQ passage is stored in the raw image data stream of gathering on the corresponding image storage chip; Sending graphics processing unit again to handles; Graphics processing unit to original image divide, selection, fusion treatment; Generation has the video image pixel data of HDR, and this high dynamic range video image pixel data of encoder encodes shows on display screen.
Be illustrated in figure 3 as the flow chart of the image generating method of high dynamic range video, specifically comprise the steps:
S310: will be divided into the identical equivalent light beam of multi beam through the incident light of optical lens.
S320: to every Shu Guang with same photographed frame speed but carry out sensitization with different sensitivity values and handle and obtain the same different raw image data of many groups depth of exposure of being clapped scene.
The complete registration of a plurality of sensitive chips, the extraneous scene of promptly absorbing is in full accord, and several original image size that obtain are identical, and the pixel in each original image is corresponding fully, thereby can guarantee the synchronous of shooting process.
S330: said raw image data is carried out fusion treatment generate high dynamic range images.
Be illustrated in figure 4 as the sketch map that high dynamic range images generates in the graphics processing unit of above-mentioned preferred embodiment.The concrete steps of the image of different depth of exposures being carried out fusion treatment are following:
At first, the image of many different depth of exposures is divided into the matrix-block of equal-sized M * N successively, M, N are the positive integer greater than 1.
Four width of cloth original images to obtain in the foregoing description are example, and the original image that four width of cloth have different depth of exposures is denoted as A, B, C, D, and every width of cloth image all is divided into the matrix-block of M * N, and abscissa representes that with i ordinate is represented with j.Every width of cloth original image among Fig. 3 all is divided into 4 * 5 matrix-block.
Secondly, the matrix-block of from a plurality of matrix-blocks that these many original images are divided, selecting to have comprised information such as best texture information and optimum saturation infromation is as the optimal information piece and form intermediate image, and the optimal information piece all comes from corresponding original image.
At last; On intermediate image, choose target pixel points arbitrarily; And be near a plurality of optimal information pieces the center is chosen with the optimal information piece at target pixel points place, then, successively with the central point of each optimal information piece as the centre coordinate that merges function; Centre coordinate is made as the reference axis initial point simultaneously; Promptly obtain the blend curve of a plurality of different centre coordinates, under the situation of each blend curve, in the corresponding blend curve of different coordinate figure substitutions with the target pixel points place; Promptly obtain a plurality of fusion coefficients; Again with each fusion coefficients respectively divided by these a plurality of fusion coefficients with obtain a plurality of weighted values, at last will the original image at above-mentioned a plurality of optimal information pieces place in the pixel value of target pixel points position multiply by the pixel value that the high dynamic range images of target pixel points was got and obtained to corresponding weighted value, pixel data and the final generation high dynamic range images through other pixels of middle image being handled the one group of high dynamic range images that obtains all pixels then.
Among Fig. 4, known four width of cloth original image A, B, C, D are through choosing a target pixel points P arbitrarily on intermediate image; The optimal information piece at Fig. 4 mid point P place is assembled 9 pieces then from original image B near a zone at P place, comprise the piece that a P is affiliated; Each piece is the corresponding position optimal information piece in each corresponding width of cloth original image; Come from original image A like piece A11, piece B21 comes from original image B, and the like; Then, (xi, yi), centre coordinate is made as the reference axis initial point simultaneously as the centre coordinate that merges function with the central point of each optimum piece successively.So just can obtain the blend curve of 9 different centre coordinates, under the situation of each curve, the coordinate figure at some P place is different.In the corresponding blend curve of different coordinate figure substitutions with P point place, promptly obtain 9 different fusion coefficients.Concrete fusion function is following:
P wherein, q is a constant, determined to merge the height of function and merged the size of function in the horizontal plane projected area, k ∈ [1,2 ..., 9].For example, work as p=0.5, q=0.02, middle point coordinates are (x
i, y
i)=(0,0) time, the three-dimensional waveform that merges function is as shown in Figure 5.As for piece A
11The pixel value P that then selected point P position is located in original image A
1Be updated to merge in the function and obtain fusion coefficients f
1, for piece D
13The pixel value P of selected point P position in original image D then
7Be updated to merge in the function and obtain fusion coefficients f
7, obtain 9 fusion coefficients according to this, again with each fusion coefficients divided by 9 fusion coefficients with promptly obtain W as shown in Figure 4
1-W
99 weighted values, the pixel value of the high dynamic range images of maximal end point P position is each weighted value and the pixel value weighted sum at the original image mid point P place at corresponding optimum piece place, promptly
K=1,2...9.
High each sensitive chip of dynamic video imaging system that many sensitive chips merge has the same time for exposure, thus can guarantee to take synchronously and real-time; Simultaneously; The more single exposure image of the video image that is generated is having a clear superiority in aspect color and the brightness uniformity; Visual information is abundant, can also solve effectively that owing of existing in traditional camera system exposed to the sun, overexposure and the unequal problem of chroma-luminance, has good marketing prospect.
The above embodiment has only expressed several kinds of execution modes of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to claim of the present invention.Should be pointed out that for the person of ordinary skill of the art under the prerequisite that does not break away from the present invention's design, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection range of patent of the present invention should be as the criterion with accompanying claims.
Claims (8)
1. a high dynamic range video imaging system comprises optical lens, it is characterized in that, also comprises at least one optical splitter, a plurality of sensitive chip and graphics processing unit; Said optical splitter is used for the incident light through said optical lens is divided into the identical equivalent light beam of multi beam; Said a plurality of sensitive chip is the sensitive chip of same size; Be used to receive the identical equivalent light beam of said multi beam and obtain the same different raw image data of many groups depth of exposure of being clapped scene with identical photographed frame speed, graphics processing unit will be organized the raw image data fusion treatment more and generate high dynamic range images;
Said graphics processing unit comprises that calibration module, image-region are divided module, optimal information is selected module and image co-registration module;
Said calibration module is corrected the position deviation of optical splitter in the assembling process and sensitive chip existence;
Said image-region is divided module original image is divided into equal-sized M * N matrix-block, and M, N are the positive integer greater than 1;
The matrix-block that said optimal information selects module from a plurality of matrix-blocks of dividing, to select to have comprised optimum brightness and optimum saturation infromation forms intermediate image as the optimal information piece;
Said image co-registration module is chosen target pixel points arbitrarily on intermediate image; And be near a plurality of optimal information pieces the center is chosen with the optimal information piece at target pixel points place; Choose the pixel value of target pixel points position in the affiliated original image of these a plurality of optimal information pieces successively and be updated to merge in the function and obtain a plurality of fusion coefficients; Again with each fusion coefficients respectively divided by these a plurality of fusion coefficients with obtain a plurality of weighted values; Pixel value with target pixel points position in the original image at above-mentioned a plurality of optimal information pieces place multiply by the pixel value that the high dynamic range images of target pixel points was got and obtained to corresponding weighted value at last, then pixel data and the final high dynamic range images that generates through other pixels of middle image being handled the one group of high dynamic range images that obtains all pixels;
Said fusion function is
P wherein, q is the constant between [0,1], k ∈ [1,2 ..., 9], (x y) is the pixel value of target pixel points position in the original image, (x
i, y
i) be the central point pixel value of the optimal information piece chosen.
2. high dynamic range video imaging system as claimed in claim 1 is characterized in that, said optical splitter is a light splitting piece, and the branch optical wavelength range of said light splitting piece is a visible-range;
Said sensitive chip is a kind of in cmos image sensor, charge coupled cell imageing sensor or the near-infrared image transducer.
3. high dynamic range video imaging system as claimed in claim 1 is characterized in that, also comprises peripheral system, and said peripheral system comprises a plurality of IMAQ passages, image storage chip, encoder and display screen;
The collection of said a plurality of IMAQ passage is organized the different raw image data of depth of exposure more and is passed to the image storage chip storage; Graphics processing unit obtains said raw image data generation high dynamic range images and passes to encoder encodes from image storage chip, and finally on display screen, shows.
4. high dynamic range video imaging system as claimed in claim 1 is characterized in that, said target pixel points is the pixel in the non-optimal information piece all around on the intermediate image;
It is said that to be a plurality of optimal information pieces of choosing of center with the optimal information piece under the target pixel points contact with optimal information piece under the target pixel points.
5. the image generating method of a high dynamic range video is characterized in that, comprises the steps:
To be divided into the identical equivalent light beam of multi beam through the incident light of optical lens;
To every Shu Guang with same photographed frame speed but carry out sensitization with different sensitivity values and handle and obtain the same different raw image data of many groups depth of exposure of being clapped scene;
Said raw image data is carried out fusion treatment generate high dynamic range images; Saidly raw image data is carried out fusion treatment generate the high dynamic range images process and comprise the steps:
The original image of many different depth of exposures is divided into equal-sized M * N matrix-block successively, and M, N are the positive integer greater than 1;
The matrix-block of from a plurality of matrix-blocks of different original images, selecting to have optimum brightness and optimum saturation infromation forms intermediate image as the optimal information piece;
On intermediate image, choose target pixel points arbitrarily; And be near a plurality of optimal information pieces the center is chosen with the optimal information piece at target pixel points place; Choose the pixel value of target pixel points position in the affiliated original image of these a plurality of optimal information pieces successively and be updated to merge in the function and obtain a plurality of fusion coefficients; Again with each fusion coefficients respectively divided by these a plurality of fusion coefficients with obtain a plurality of weighted values; Pixel value with target pixel points position in the original image at above-mentioned a plurality of optimal information pieces place multiply by the pixel value that the high dynamic range images of target pixel points was got and obtained to corresponding weighted value at last, then pixel data and the final high dynamic range images that generates through other pixels of middle image being handled the one group of high dynamic range images that obtains all pixels;
Said fusion function is
P wherein, q is the constant between [0,1], k ∈ [1,2 ..., 9], x, y are the pixel value of target pixel points position in the original image.
6. the image generating method of high dynamic range video as claimed in claim 5 is characterized in that, said target pixel points is the pixel in the non-optimal information piece all around.
7. the image generating method of high dynamic range video as claimed in claim 5; It is characterized in that said to be near a plurality of optimal information pieces of center choosing contact with optimal information piece point under the target pixel points or line contacts with the optimal information piece under the target pixel points.
8. the image generating method of high dynamic range video as claimed in claim 5; It is characterized in that the image generating method of said high dynamic range video also is included in divides the process of before position deviation that exists in optical splitter and the sensitive chip assembling process being corrected to original image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101902616A CN101888487B (en) | 2010-06-02 | 2010-06-02 | High dynamic range video imaging system and image generating method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101902616A CN101888487B (en) | 2010-06-02 | 2010-06-02 | High dynamic range video imaging system and image generating method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101888487A CN101888487A (en) | 2010-11-17 |
| CN101888487B true CN101888487B (en) | 2012-03-14 |
Family
ID=43074180
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010101902616A Active CN101888487B (en) | 2010-06-02 | 2010-06-02 | High dynamic range video imaging system and image generating method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101888487B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2505276A (en) * | 2012-07-02 | 2014-02-26 | Zoran Corp | Device, system and method for real time generation of high dynamic range video |
Families Citing this family (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102843519A (en) * | 2011-06-23 | 2012-12-26 | 鸿富锦精密工业（深圳）有限公司 | Image processing system and method |
| UA116082C2 (en) * | 2011-09-27 | 2018-02-12 | Конінклійке Філіпс Н.В. | Apparatus and method for dynamic range transforming of images |
| US9307160B2 (en) * | 2013-08-13 | 2016-04-05 | Htc Corporation | Methods and systems for generating HDR images |
| CN103702036A (en) * | 2013-11-21 | 2014-04-02 | 苏州斯普锐智能系统有限公司 | Wide-dynamic range decoding method |
| CN104717404B (en) * | 2013-12-11 | 2018-10-19 | 深圳桑菲消费通信有限公司 | A kind of camera and electronic equipment |
| CN105472263B (en) * | 2014-09-12 | 2018-07-13 | 聚晶半导体股份有限公司 | Image acquisition method and the image capture equipment for using the method |
| CN104935796A (en) * | 2015-06-23 | 2015-09-23 | 浙江一舟电子科技股份有限公司 | Video camera capable of acquiring a plurality of exposed structure in once shooting |
| CN104935797A (en) * | 2015-06-23 | 2015-09-23 | 浙江一舟电子科技股份有限公司 | Video camera structure |
| US9686488B2 (en) * | 2015-09-30 | 2017-06-20 | Semiconductor Components Industries, Llc | Imaging systems with flicker mitigation and high dynamic range |
| CN105203159A (en) * | 2015-10-14 | 2015-12-30 | 武汉三江中电科技有限责任公司 | Single channel visible light and infrared image collecting, fusing and monitoring system |
| CN107347122B (en) * | 2016-05-05 | 2019-08-16 | 鹤立精工股份有限公司 | Wide area high-resolution lines scan method and its module |
| US9998720B2 (en) * | 2016-05-11 | 2018-06-12 | Mediatek Inc. | Image processing method for locally adjusting image data of real-time image |
| CN105812670B (en) * | 2016-05-12 | 2019-07-12 | 珠海市魅族科技有限公司 | A kind of method and terminal taken pictures |
| CN105933584A (en) * | 2016-05-18 | 2016-09-07 | 中山联合光电科技股份有限公司 | Shooting system |
| CN106060351B (en) * | 2016-06-29 | 2020-07-24 | 联想(北京)有限公司 | Image processing apparatus and image processing method |
| CN107370962B (en) | 2016-07-29 | 2019-10-15 | Oppo广东移动通信有限公司 | High dynamic range images image pickup method, device and terminal device |
| US9979906B2 (en) * | 2016-08-03 | 2018-05-22 | Waymo Llc | Beam split extended dynamic range image capture system |
| CN108881677A (en) * | 2017-08-14 | 2018-11-23 | 北京旷视科技有限公司 | Photographic device and image capture method |
| CN107395898B (en) * | 2017-08-24 | 2021-01-15 | 维沃移动通信有限公司 | Shooting method and mobile terminal |
| CN109474770B (en) * | 2017-09-07 | 2021-09-14 | 华为技术有限公司 | Imaging device and imaging method |
| CN107465882B (en) * | 2017-09-22 | 2019-11-05 | 维沃移动通信有限公司 | A kind of image capturing method and mobile terminal |
| CN107809576A (en) * | 2017-12-14 | 2018-03-16 | 信利光电股份有限公司 | A kind of multi-cam module |
| CN108184075B (en) * | 2018-01-17 | 2019-05-10 | 百度在线网络技术（北京）有限公司 | Method and apparatus for generating image |
| CN109462722A (en) * | 2018-12-06 | 2019-03-12 | Oppo广东移动通信有限公司 | Image collecting device and electronic equipment |
| CN110248105B (en) * | 2018-12-10 | 2020-12-08 | 浙江大华技术股份有限公司 | Image processing method, camera and computer storage medium |
| CN110191273B (en) * | 2019-06-28 | 2023-09-05 | 中山联合光电科技股份有限公司 | Double-light zooming shooting system |
| CN110636198A (en) * | 2019-10-15 | 2019-12-31 | 重庆金山医疗技术研究院有限公司 | Imaging method and device and endoscope equipment |
| CN110740238B (en) * | 2019-10-24 | 2021-05-11 | 华南农业大学 | Light splitting HDR camera applied to mobile robot SLAM field |
| CN110798624B (en) * | 2019-10-24 | 2021-05-11 | 华南农业大学 | HDR camera applied to outdoor SLAM field of mobile robot |
| CN110830702A (en) * | 2019-12-20 | 2020-02-21 | 湖南傲英创视信息科技有限公司 | Hundred million-level pixel array camera shooting device and camera shooting method thereof |
| CN112528944A (en) * | 2020-12-23 | 2021-03-19 | 杭州海康汽车软件有限公司 | Image identification method and device, electronic equipment and storage medium |
| CN115643811A (en) * | 2020-12-31 | 2023-01-24 | 华为技术有限公司 | Image processing method, data acquisition method and equipment |
| CN113596341B (en) * | 2021-06-11 | 2024-04-05 | 北京迈格威科技有限公司 | Image shooting method, image processing device and electronic equipment |
| CN116156081A (en) * | 2021-11-22 | 2023-05-23 | 哲库科技(上海)有限公司 | Image processing method and device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6346965B1 (en) * | 1995-02-07 | 2002-02-12 | Agilent Technologies, Inc | High resolution imaging system for simultaneous acquisition of two high aspect ratio object fields |
| CN1874499A (en) * | 2006-05-12 | 2006-12-06 | 北京理工大学 | High dynamic equipment for reconstructing image in high resolution |
| CN1954344A (en) * | 2004-04-23 | 2007-04-25 | 布赖特赛德科技有限公司 | Encoding, decoding and representing high dynamic range images |
| CN101193202A (en) * | 2006-12-22 | 2008-06-04 | 陈珉 | Method for display highly dynamic image on the traditional output device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1303140A4 (en) * | 2000-07-19 | 2007-01-17 | Matsushita Electric Ind Co Ltd | Monitoring system |
-
2010
- 2010-06-02 CN CN2010101902616A patent/CN101888487B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6346965B1 (en) * | 1995-02-07 | 2002-02-12 | Agilent Technologies, Inc | High resolution imaging system for simultaneous acquisition of two high aspect ratio object fields |
| CN1954344A (en) * | 2004-04-23 | 2007-04-25 | 布赖特赛德科技有限公司 | Encoding, decoding and representing high dynamic range images |
| CN1874499A (en) * | 2006-05-12 | 2006-12-06 | 北京理工大学 | High dynamic equipment for reconstructing image in high resolution |
| CN101193202A (en) * | 2006-12-22 | 2008-06-04 | 陈珉 | Method for display highly dynamic image on the traditional output device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2505276A (en) * | 2012-07-02 | 2014-02-26 | Zoran Corp | Device, system and method for real time generation of high dynamic range video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101888487A (en) | 2010-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101888487B (en) | High dynamic range video imaging system and image generating method | |
| US9615030B2 (en) | Luminance source selection in a multi-lens camera | |
| US10425638B2 (en) | Equipment and method for promptly performing calibration and verification of intrinsic and extrinsic parameters of a plurality of image capturing elements installed on electronic device | |
| Tocci et al. | A versatile HDR video production system | |
| US10511785B2 (en) | Temporally aligned exposure bracketing for high dynamic range imaging | |
| CN103501416B (en) | Imaging system | |
| CN104662887B (en) | Image processing equipment, image processing method and the picture pick-up device with the image processing equipment | |
| US20150222823A1 (en) | Multi-zone imaging sensor and lens array | |
| CN105120247B (en) | A kind of white balance adjustment method and electronic equipment | |
| CN103688536B (en) | Image processing apparatus, image processing method | |
| CN101233440A (en) | Adaptive optical plane formation with rolling shutter | |
| US11785322B2 (en) | Forming combined image by imaging system with rotatable reflector | |
| CN112991245B (en) | Dual-shot blurring processing method, device, electronic equipment and readable storage medium | |
| CN107431755A (en) | Image processing equipment, picture pick-up device, image processing method, program and storage medium | |
| CN103843320B (en) | Imageing sensor and imaging device | |
| Erhardt-Ferron | Theory and applications of digital image processing | |
| CN110930440B (en) | Image alignment method, device, storage medium and electronic equipment | |
| CN108432233A (en) | Photographic device and image-data generating method | |
| US20050254817A1 (en) | Autostereoscopic electronic camera | |
| TWI504936B (en) | Image processing device | |
| Georgiev | New results on the Plenoptic 2.0 camera | |
| Oliveira et al. | Lenslet light field panorama creation: a sub-aperture image stitching approach | |
| US4255033A (en) | Universal focus multiplanar camera | |
| WO2022153270A1 (en) | Imaging device | |
| CN107454294B (en) | Panorama beautifying camera mobile phone and implementation method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20101117 Assignee: Shenzhen Bohebaitai Polytron Technologies Inc Assignor: Shenzhen Institutes of Advanced Technology, Chinese Academy of Science Contract record no.: 2012440020434 Denomination of invention: High dynamic range video imaging system and image generating method Granted publication date: 20120314 License type: Exclusive License Record date: 20121227 |
|
| LICC | Enforcement, change and cancellation of record of contracts on the licence for exploitation of a patent or utility model |