CN201788354U - High-resolution real-time panoramic high-dynamic range image acquisition device - Google Patents

High-resolution real-time panoramic high-dynamic range image acquisition device Download PDF

Info

Publication number
CN201788354U
CN201788354U CN2010202981254U CN201020298125U CN201788354U CN 201788354 U CN201788354 U CN 201788354U CN 2010202981254 U CN2010202981254 U CN 2010202981254U CN 201020298125 U CN201020298125 U CN 201020298125U CN 201788354 U CN201788354 U CN 201788354U
Authority
CN
China
Prior art keywords
image acquisition
acquisition equipment
image
dynamic range
time panoramic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
CN2010202981254U
Other languages
Chinese (zh)
Inventor
王庆
周果清
肖照林
吴文杰
李磊
纪超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northwestern Polytechnical University
Original Assignee
Northwestern Polytechnical University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northwestern Polytechnical University filed Critical Northwestern Polytechnical University
Priority to CN2010202981254U priority Critical patent/CN201788354U/en
Application granted granted Critical
Publication of CN201788354U publication Critical patent/CN201788354U/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/06Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

The utility model discloses a high-resolution real-time panoramic high-dynamic range image acquisition device. N image acquisition units are fixed on a work table via L-shaped supports, a lens of each unit faces to the outer side of the circumference, optical axis extension lines of the lenses extend into the circumference and are jointed to the circle center of the circumference distributed with the L-shaped support, a lens of an N+1 image acquisition unit is vertically arranged on the work table, an optical axis extension line of the lens points to the circle center, the image acquisition device is arranged at the center of a scene to be shot and is connected with an image processing workstation, parameters of the image acquisition equipment are set by the image processing workstation, continuous shutters are triggered synchronously so as to acquire images, and the acquired images are synthesized into a high-resolution real-time panoramic high-dynamic range image. The image acquisition device can acquire high-resolution real-time panoramic high-dynamic images, generate orthoscopic HDR images and acquire high-definition panoramic video.

Description

High resolving power real time panoramic high dynamic range images deriving means
Technical field
The present invention relates to image processing field and virtual reality field, especially a kind of device that is used to obtain 360 ° of panoramic digital image.
Background technology
At present in whole audience scape high dynamic range digital image acquisition device, Jonas Unger, Stefan Gustavson has designed a kind of image-taking system that utilizes heritage optical device CMOS and quick multiple exposure technique to combine in document High Dynamic Range Video for Photometric Measurement of Illumination, utilize it to gather at a high speed high-quality high dynamic range (HDR) image.This system uses light upper sensor and the quick louver shutter with high-speed parallel processing power and steering logic.Because the restriction of shutter structure, vertical curtain effect can appear in the image that obtains when between equipment and the scene relative motion being arranged, and makes the quality of image descend.This equipment is by catching the image that obtains whole audience scape to the reflection ray of circular glass sphere, thus can't eliminate the imaging of capture apparatus in image, and since equipment and photographer at the center section of image, it is more to make effective sunlight block.Jessi Stumpfel, Andrew Jones, Paul Debevec etc. have designed the commercial number camera of a cover use standard and have joined fish-eye equipment in document Direct HDR Capture of the Sun and Sky.By shutter and the aperture that camera is set, and grey filter can be by the synthetic HDR image of the image of catching seven different exposures in increasing.The shortcoming of this equipment is that fish-eye optical property makes low more the closer to the light resolution of image border, and distortion in images is big more, and the restriction of camera subject can't be obtained high resolving power HDR image.
Summary of the invention
Not high in order to overcome prior art resolution, pattern distortion is serious, the dynamic range deficiency, deficiencies such as real-time difference, the invention provides a kind of high resolving power panorama real time high dynamic range image harvester, compare the acquisition high resolving power panorama high dynamic range images that this device can be real-time with existing device and method.
The technical solution adopted for the present invention to solve the technical problems is: comprise N platform image acquisition equipment, a N L type support and a worktable, N>5; Being circularly and evenly distributed on worktable of each L type support, the bottom of L type support is fixed on the worktable; Image acquisition equipment is separately fixed at L type support upper end, and the camera lens level of every image acquisition equipment is towards periphery, the optical axis extended line of every image acquisition equipment camera lens is intersected in circumference a bit, and this is in the center of circle that is projected as L type circumference that support distributes of worktable.N+1 platform image acquisition equipment is placed on the worktable, its camera lens vertically upward, the optical axis extended line of camera lens is by the center of circle of L type circumference that support distributes.This device places the center that needs photographed scene.Image acquisition equipment is connected with the Flame Image Process workstation with control line by data line, by the Flame Image Process workstation image acquisition equipment is carried out the parameter setting, shutter synchronization is obtained image with triggering continuously, will obtain image and be stored in the Flame Image Process workstation and synthetic high resolving power panorama high dynamic range images.
One piece of horizontal view angle of described image acquisition equipment configuration is more than or equal to 150 ° bugeye lens, to reduce image acquisition equipment quantity, reduction means volume.The vertical angle of view of every image acquisition equipment is more than or equal to 100 °, the visual angle of the N platform digital camera of horizontal positioned is overlapping must to be beneficial to later image more than or equal to 14 ° and to handle, and the visual angle of the image acquisition equipment of horizontal positioned and N+1 platform image acquisition equipment is overlapping more than or equal to 20 °.
Described image acquisition equipment adopts the digital camera of resolution more than or equal to 1,230 ten thousand pixels.
By 9000mA/h, the 7.4V power module is the image acquisition equipment power supply, makes that once the continuously shot images quantity of charging back digital camera is no less than 6600 fully.
Use is according to the base of image acquisition equipment base shape processing and the fixedly camera of L bracket fast and stable.
When working, the present invention may further comprise the steps:
(1) described high resolving power panorama real time high dynamic range image harvester is placed on the object centers position of taking the photograph.
(2) use any image acquisition equipment to carry out photometry, obtain the diaphragm shutter parameter of current scene correct exposure automatically, with this correct diaphragm shutter parameter as other cameras.For all image acquisition equipments, be center reference with the correct exposure data, generate 9 groups of diaphragm shutter argument sequence (8/3EV ,-2EV automatically with same intervals exposure value (EV),-4/3EV ,-2/3EV, 0EV ,+2/3EV, + 4/3EV ,+2EV ,+8/3EV).
(3) with the diaphragm shutter argument sequence that obtains image acquisition equipment is carried out shutter and trigger, obtain the image of several different exposure parameters and shooting angle and store.
(4) image that step (3) is obtained is proofreaied and correct, and the image that will proofread and correct different shooting angles under the back same exposure parameter splices, and obtains the panorama sketch of several different exposure parameters.
(5) by the synthetic high resolving power panorama high dynamic range images of the panorama sketch of several different exposure parameters.
The method of proofreading and correct is to take the gridiron pattern scaling board with image acquisition equipment, and the harris angle point in the extraction acquisition image is as image characteristic point.Theory characteristic point after obtaining proofreading and correct according to tessellated physical size and shape.According to the principle of lens distortion, take advantage of error can solve image acquisition equipment linear distortion coefficient by minimizing two.The image that can correcting camera photographs according to this coefficient.
The method of splicing be high-ranking officers' image just in time according to the relative position relation between the image acquisition equipment, image by spatial relationship and utilize the Poisson fusion method to be stitched together, is obtained the N prismatic image of a no bottom surface.
The invention has the beneficial effects as follows: the present invention can obtain resolution up to the panoramic picture more than 4,000 ten thousand pixels, generates distortionless HDR image in real time, and can obtain resolution is the high definition whole audience scape video of 1024*768.This contrive equipment has stronger maneuverability, and suitable field works long hours.Because N (N>5) platform image acquisition equipment has obtained 9*N width of cloth image at least in 20 seconds, compared to existing technology, can obtain high dynamic range images in real time by image processing software.
The present invention is further described below in conjunction with drawings and Examples.
Description of drawings
Fig. 1 is the synoptic diagram of harvester of the present invention;
Fig. 2 is a D5000 camera base for supporting;
Fig. 3 is a harvester base disk;
Fig. 4 is a L type support;
Fig. 5 is that panorama sketch constitutes synoptic diagram how much;
Fig. 6 is the image acquisition unit distribution plan.
Embodiment
Device embodiment:
1, with the digital slr camera of 5 covers unit: comprise that resolution is the Nikon D5000 numeral slr camera and the Nikon AF DX Fisheye-Nikkor 10.5mm/z.8G ED camera lens of 1,230 ten thousand pixels and is installed in by on the aluminium alloy base of camera bottom shape processing (Fig. 2).
2, camera unit is fixed on the long limit of the L type support (Fig. 1) of aluminium alloy, the minor face of L support is fixed on the circular aluminium alloy worktable (Fig. 3) uniformly, making camera unit horizontal direction interval be radioactivity for 72 ° lays and is fixed on the table top, camera lens is towards periphery, the optical axis extended line of every camera is inwardly given a bit, and this is in its center of circle that is projected as of circular table.
3, the digital slr camera of the 6th cover unit is placed the circular table center, its camera lens makes progress, and its optical axis extended line is by the center of circle of circular table.With whole stationary table on hundred promise A-457M8 tripods.The vertical angle of view of every camera is 100 °, and the visual angle of 5 cameras of horizontal positioned is overlapping to be 14 °, and the overlapping minimum in visual angle of horizontal positioned camera and the 6th camera is 20 °.
4, use is 5 groups, and every group is formed voltage by 8 Sanyos, 18650 electric cores by two strings four mode also is 7.4V, and capacity is that 9600 milliamperes power supply unit is each camera unit power supply, can guarantee that each camera unit continues shooting and opens image more than 6400.
5, digital slr camera unit is connected by usb data line and the panoramic picture work of treatment DELL M6500 that stands.
By the Control Software among the present invention camera is carried out the parameter setting when the present invention works, shutter triggers, and obtains image synchronously, may further comprise the steps:
1, described high resolving power panorama real time high dynamic range image harvester is placed on the object centers position of taking the photograph.
2, select a D5000 camera to carry out photometry at random, obtain the parameters such as diaphragm shutter of current scene correct exposure automatically, with this parameter such as correct diaphragm shutter as other cameras.So for image acquisition equipment, be center reference with the correct exposure data, generate automatically 9 groups of exposure parameter sequences with same intervals exposure value (EV) (8/3EV ,-2EV ,-4/3EV ,-2/3EV, 0EV ,+2/3EV ,+4/3EV ,+2EV ,+8/3EV).
3, by synchronization control module, with above-mentioned exposure parameter sequence camera is advanced shutter row and trigger, obtain image and be stored in the Flame Image Process workstation.The shooting of a scene can obtain 64 images.
4, use every group of camera unit to take the gridiron pattern of 5*5, adopt the harris Corner Detection Algorithm to extract tessellated angle point as image characteristic point (x i, y i) i=1,2....36.With upper left corner image characteristic point is benchmark, the theory characteristic point after obtaining proofreading and correct according to tessellated physical size and shape
Figure BSA00000233166300041
I=1,2....36.δ x, δ yBe non-linear deformation value:
δ x(x,y)=k 1x(x 2+y 2)+(p 1(3x 2+y 2)+2p 2xy)+s 1(x 2+y 2)
δ y(x,y)=k 2x(x 2+y 2)+(p 2(3x 2+y 2)+2p 2xy)+s 2(x 2+y 2)
Wherein first becomes coefficient of radial distortion, and second is centrifugal distortion, and the 3rd is thin prism distortion, the k in the formula 1, k 2, p 1, p 2, s 1, s 2Be called the linear distortion coefficient.
Principle according to distortion:
δ x ( x , y ) = x ‾ - x
δ y ( x , y ) = y ‾ - y
Bring the coordinate of 36 pairs of points into equation, take advantage of error can solve the linear distortion coefficient of every camera by descending most change two.According to coefficient the fault image that every camera obtains is proofreaied and correct.Subsequently image is spliced, splicing is carried out the geometry splicing according to the relative position relation between six cameras to image, obtains the pentagonal prism of a no bottom surface, again the image projection on the pentagonal prism face is arrived sphere, finishes the panoramic picture splicing.
5, synthetic HDR image.
The HDR building-up process is to utilize the image of the different exposures of several Same Scene, recover the illumination response curve of imaging system, in order to obtaining the mapping relations between camera exposure amount and the image pixel value, and then above-mentioned sequence image is fused into the HDR image of this scene of the width of cloth.The HDR image recording RGBE value of light, can reflect the relevant information of physical environment illumination really.We at first calculate the illumination response function by an image sequence, recover the intensity level of true illumination by pixel again, at last image are carried out the image sampling of different densities.

Claims (4)

1. high resolving power real time panoramic high dynamic range images deriving means, comprise N+1 platform image acquisition equipment, a N L type support and a worktable, N>5 is characterized in that: being circularly and evenly distributed on worktable of each L type support, and the bottom of L type support is fixed on the worktable; N platform image acquisition equipment is separately fixed at L type support upper end, and the camera lens level of every image acquisition equipment is towards periphery, the optical axis extended line of every image acquisition equipment camera lens is intersected in circumference a bit, and this is in the center of circle that is projected as L type circumference that support distributes of worktable; N+1 platform image acquisition equipment is placed on the worktable, its camera lens vertically upward, the optical axis extended line of camera lens is by the center of circle of L type circumference that support distributes; This device places the center that needs photographed scene; Image acquisition equipment is connected with the Flame Image Process workstation with control line by data line, by the Flame Image Process workstation image acquisition equipment is carried out the parameter setting, shutter synchronization is obtained image with triggering continuously, will obtain image and be stored in the Flame Image Process workstation and synthetic high resolving power panorama high dynamic range images.
2. high resolving power real time panoramic high dynamic range images deriving means according to claim 1, it is characterized in that: one piece of horizontal view angle of described image acquisition equipment configuration is more than or equal to 150 ° bugeye lens, the vertical angle of view of every image acquisition equipment is more than or equal to 100 °, the visual angle of the N platform digital camera of horizontal positioned is overlapping must be more than or equal to 14 °, and the visual angle of the image acquisition equipment of horizontal positioned and N+1 platform image acquisition equipment is overlapping more than or equal to 20 °.
3. high resolving power real time panoramic high dynamic range images deriving means according to claim 1 is characterized in that: described image acquisition equipment adopts the digital camera of resolution more than or equal to 1,230 ten thousand pixels.
4. high resolving power real time panoramic high dynamic range images deriving means according to claim 1 is characterized in that: adopt 9000mA/h, the 7.4V power module is the image acquisition equipment power supply.
CN2010202981254U 2010-08-19 2010-08-19 High-resolution real-time panoramic high-dynamic range image acquisition device Expired - Lifetime CN201788354U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010202981254U CN201788354U (en) 2010-08-19 2010-08-19 High-resolution real-time panoramic high-dynamic range image acquisition device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010202981254U CN201788354U (en) 2010-08-19 2010-08-19 High-resolution real-time panoramic high-dynamic range image acquisition device

Publications (1)

Publication Number Publication Date
CN201788354U true CN201788354U (en) 2011-04-06

Family

ID=43820312

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010202981254U Expired - Lifetime CN201788354U (en) 2010-08-19 2010-08-19 High-resolution real-time panoramic high-dynamic range image acquisition device

Country Status (1)

Country Link
CN (1) CN201788354U (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101963751A (en) * 2010-08-19 2011-02-02 西北工业大学 Device and method for acquiring high-resolution full-scene image in high dynamic range in real time
CN109600556A (en) * 2019-02-18 2019-04-09 武汉大学 A kind of high quality precision omnidirectional imaging system and method based on slr camera
WO2020103040A1 (en) * 2018-11-21 2020-05-28 Boe Technology Group Co., Ltd. A method for generating and displaying panorama images based on rendering engine and a display apparatus

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101963751A (en) * 2010-08-19 2011-02-02 西北工业大学 Device and method for acquiring high-resolution full-scene image in high dynamic range in real time
CN101963751B (en) * 2010-08-19 2011-11-30 西北工业大学 Device and method for acquiring high-resolution full-scene image in high dynamic range in real time
WO2020103040A1 (en) * 2018-11-21 2020-05-28 Boe Technology Group Co., Ltd. A method for generating and displaying panorama images based on rendering engine and a display apparatus
US11589026B2 (en) 2018-11-21 2023-02-21 Beijing Boe Optoelectronics Technology Co., Ltd. Method for generating and displaying panorama images based on rendering engine and a display apparatus
CN109600556A (en) * 2019-02-18 2019-04-09 武汉大学 A kind of high quality precision omnidirectional imaging system and method based on slr camera
CN109600556B (en) * 2019-02-18 2020-11-06 武汉大学 High-quality precise panoramic imaging system and method based on single lens reflex

Similar Documents

Publication Publication Date Title
CN101963751B (en) Device and method for acquiring high-resolution full-scene image in high dynamic range in real time
US10425638B2 (en) Equipment and method for promptly performing calibration and verification of intrinsic and extrinsic parameters of a plurality of image capturing elements installed on electronic device
CN103780840B (en) Two camera shooting image forming apparatus of a kind of high-quality imaging and method thereof
CN103945210B (en) A kind of multi-cam image pickup method realizing shallow Deep Canvas
CN107800979B (en) High dynamic range video image pickup method and filming apparatus
US20140226041A1 (en) Image processing apparatus, image pickup apparatus, image processing method, and non-transitory computer-readable storage medium
CN105530431A (en) Reflective panoramic imaging system and method
JP2017505004A (en) Image generation method and dual lens apparatus
CN109564376A (en) Time-multiplexed programmable view field imaging
CN107302668A (en) High dynamic range imaging module based on runner dynamic light splitting
JP2016054470A (en) Multi lens photographing instrument
CN201788354U (en) High-resolution real-time panoramic high-dynamic range image acquisition device
CN107613190A (en) A kind of photographic method and terminal
CN107800827B (en) Shooting method of multi-camera module and multi-camera module
US10419688B2 (en) Illuminating a scene whose image is about to be taken
CN108540720B (en) System and method for automatically selecting optimal image for bullet time
Ikeda et al. Calibration method for an omnidirectional multicamera system
CN108156395A (en) Panorama optical field acquisition device, processing method and computing device based on camera array
CN205982978U (en) Three -dimensional panorama shooting equipment
CN103546680B (en) A kind of deformation-free omni-directional fisheye photographic device and a method for implementing the same
CN104537677A (en) Omni-directional virtual photography device
CN108737808B (en) 3D model generation device and method
CN110086994A (en) A kind of integrated system of the panorama light field based on camera array
CN102890400A (en) Panoramic shooting and panoramic projecting device
CN112104796B (en) Image processing method and device, electronic equipment and computer readable storage medium

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
AV01 Patent right actively abandoned

Granted publication date: 20110406

Effective date of abandoning: 20111130

AV01 Patent right actively abandoned

Granted publication date: 20110406

Effective date of abandoning: 20111130