CN106873301A - Based on the system and method that array camera is imaged to remote aperture rear - Google Patents
Based on the system and method that array camera is imaged to remote aperture rear Download PDFInfo
- Publication number
- CN106873301A CN106873301A CN201710267269.XA CN201710267269A CN106873301A CN 106873301 A CN106873301 A CN 106873301A CN 201710267269 A CN201710267269 A CN 201710267269A CN 106873301 A CN106873301 A CN 106873301A
- Authority
- CN
- China
- Prior art keywords
- image
- camera
- aperture
- array camera
- array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title abstract description 8
- 238000003384 imaging method Methods 0.000 claims abstract description 19
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 claims abstract description 5
- 230000009466 transformation Effects 0.000 claims abstract description 4
- 230000000007 visual effect Effects 0.000 abstract description 10
- 239000011148 porous material Substances 0.000 abstract description 4
- 238000000605 extraction Methods 0.000 abstract description 2
- 230000003287 optical effect Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006854 communication Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 210000003644 lens cell Anatomy 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 244000144985 peep Species 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
- G03B37/04—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
-
- G06T3/147—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a kind of system and method being imaged to remote aperture rear based on array camera, multi-angled shooting is carried out to visual field limiting pore size rear scenery using array camera, multi-angle image is collected, then the image of the larger field scope at small-bore rear is obtained by subaperture image extraction, affine transformation projection and images match；Multi-angled shooting can be carried out to rear scenery through micro-aperture from a certain distance, obtain the panoramic picture at hole rear.If this imaging system is furtherd investigate, and fully apply to military field, it will bring great convenience to my army.
Description
Technical field
The invention belongs to photoelectronic imaging field, and in particular to one kind is carried out into based on array camera to remote aperture rear
The system and method for picture.
Background technology
Light field is that the parametrization in space simultaneously comprising the four-dimension light radiation of position and direction information is represented, light field data
Calculating parameter chemical conversion is retrieved as providing many new development spaces.
Optical field imaging is two-dimentional compared to only record by recording four-dimensional position and direction information of the light radiation in communication process
Traditional imaging mode have more 2 frees degree, thus in image reconstruction process, be obtained in that more abundant graphical information.
In optical field imaging, the acquisition modes of light field mainly have following two：
Microlens array.It refers to one microlens array of insertion at an image planes of common imaging system, and each is micro-
The scene image of the light correspondence same position different visual angles of lens cells record, thus to a four-dimensional light field.
Array camera.It refer to by camera space certain arrangement come while to capture a series of visual angles slightly differentiated
Scene image, the method so as to reconstruct light field data.
When military field, such as hostile takedown, it is sometimes necessary to go to peep through a narrow and small aperture at a distance
The situation in room where hostage is visited, thus effective rescue scenario is determined.It is simultaneously safe, it is necessary to compared with distant location to ensure
Observed, in this case, if directly telescopic observation, is limited, it is difficult to indoor situations by pore diameter range
Comprehensively observed.At this moment can utilize the principle of the invention that a series of scene of different visual angles is shot by a group pattern camera
Image, and this series of images is spliced and processed, so as to obtain through field relatively complete in the room of aperture observation
Scape image, obtains comprehensively interior information.
The content of the invention
The invention aims to solve the problems, such as remote micro-aperture limitation observation visual field, using array camera pair
Visual field limiting pore size rear scenery carries out multi-angled shooting, collects multi-angle image, then by subaperture image extraction, affine change
Change the image that projection and images match obtain the larger field scope at small-bore rear.
The purpose of the present invention is achieved through the following technical solutions.
It is a kind of based on array camera to the system of remote aperture rear Scenery Imaging, array camera is directed at the aperture,
Each camera is imaged respectively through aperture in array camera；Wherein, the distance of each array element camera to aperture is identical, and respectively
The field of view center line of individual array element camera meets at a bit.
Preferably, five rows of the array camera point, often arrange and put 5 cameras.
Preferably, square of the aperture for 5cm × 5cm, array camera is apart from aperture 5m.
One kind, to remote aperture rear Scenery Imaging method, is comprised the following steps based on array camera：
S1, be well placed array camera after, control each array camera to be shot to rear scenery through the small-bore；
S2 is processed each image that camera is gathered, and is extracted and is obtained the effective subaperture image that each camera shoots；
Image, the image that other cameras are obtained centered on S3, the image definition that will be shot positioned at array center's position camera
It is defined as edge image；
S4, edge image is projected to center image using affine transformation where image planes on；Then same characteristic features are extracted
Point makes edge image be matched with center image, finally obtains complete spliced panoramic image.
The present invention has the advantages that：
It is such as remote to go pry through a narrow and small aperture for the problem of remote micro-aperture limitation observation visual field
The problem of room conditions where hostage, common imaging system cannot be solved at all due to being limited by pore diameter range；In the present invention
Array camera system, multi-angled shooting can be carried out to rear scenery through micro-aperture from a certain distance, after obtaining hole
The panoramic picture of side.If this imaging system is furtherd investigate, and fully apply to military field, it will bring pole to my army
Convenience.
Brief description of the drawings
Fig. 1 puts principle schematic for array camera.
Fig. 2 is the array camera system simulation figure being imaged through remote aperture device to hole rear scenery.
Fig. 3 is the imaging system simulation drawing being imaged through remote aperture device to hole rear scenery.
Fig. 4 is the effective image of the transmission aperture that camera is photographed in array camera.
Fig. 5 is that the effective image that photographs of all cameras is spliced together the image to be formed in array camera.
Fig. 6 is whole invention experiment flow figure.
Wherein, a- viewing field of camera center line intersection point, 1- cameras, 2- supports, 3- array camera systems, 4- apertures.
Specific embodiment
Develop simultaneously embodiment below in conjunction with the accompanying drawings, and the present invention will be described in detail.
It is of the invention it is a kind of based on array camera to the system of remote aperture rear Scenery Imaging, it is whole as shown in Figure 3
Imaging system includes array camera system 3 and remote aperture 4.
As shown in Fig. 2 array camera is made up of a few row's cameras 1.Want to make adjacent visual field weight in array camera 1 used
Close perfect, and to avoid due to of different sizes, the definition difference of the object in the visual field of different cameral 1, so that what is occurred regards
Cannot perfect splicing problem, it is determined that needing the principle observed to be exactly during the putting position of the entirety of camera 1:Each phase
Machine 1 is consistent to the distance in hole 4 as far as possible, and each image has close magnifying power, so as to ensure the splicing matter of output image
Amount.
Also one key point is, if as shown in figure 1, being put according to arrangement method mentioned above, these visual fields of camera 1
Center line must meet at a bit (a points in Fig. 1), this point be this each sphere residing for the optical center of camera 1 sphere center position
Place.It will be apparent that this distance of point to each optical center of camera 1 is the same.
In imaging system of the invention 3,1 point of five row of array camera often arranges 5, is supported by support 2.Aperture 4 be 5cm ×
The square of 5cm, apart from aperture 5m, each camera carries out IMAQ to array camera through aperture 4 to rear scenery.
The invention provides a kind of method to the imaging of the rear of aperture 4 based on array camera, as shown in fig. 6, according to upper
State after requirement is well placed camera 1, it is possible to rear scenery is clapped through micro-aperture from a certain distance with array camera 1
Take the photograph.Each camera 1 can photograph piece image, because the part in each image only through micro-aperture is effective image,
Needs are processed every width camera acquired image, are extracted and are obtained the effective subaperture image that each camera 1 shoots.Relatively
Camera 1 in center, the edge image that other cameras 1 are obtained has necessarily relative to the image that central camera 1 is gathered
Angle skew, it is necessary in image planes where edge image is all projected into center image using affine transformation.Complete above-mentioned
After operation, extracting same characteristic features point makes edge image be matched with center image, finally obtains complete spliced panoramic image.
Flow chart is as shown in Figure 6.
As shown in figure 4, the 25 width effective images for having intersection that will be obtained are spliced, the complete scenery of a width is obtained
Image, as shown in Figure 5.
In sum, presently preferred embodiments of the present invention is these are only, is not intended to limit the scope of the present invention.
All any modification, equivalent substitution and improvements within the spirit and principles in the present invention, made etc., should be included in of the invention
Within protection domain.
Claims (4)
1. it is a kind of based on array camera to the system of remote aperture rear Scenery Imaging, it is characterized by：Array camera is directed at institute
Aperture is stated, each camera is imaged respectively through aperture in array camera；Wherein, distance phase of each array element camera to aperture
Together, and the field of view center line of each array element camera meets at a bit.
2. it is as claimed in claim 1 it is a kind of based on array camera to the system of remote aperture rear Scenery Imaging, its feature
It is that 5 cameras are put in five rows of the array camera point, often arrangement.
3. it is as claimed in claim 2 it is a kind of based on array camera to the system of remote aperture rear Scenery Imaging, its feature
It is that aperture is the square of 5cm × 5cm, and array camera is apart from aperture 5m.
4. a kind of imaging method based on system described in claim 1, it is characterised in that comprise the following steps：
S1, be well placed array camera after, control each array camera to be shot to rear scenery through the small-bore；
S2 is processed each image that camera is gathered, and is extracted and is obtained the effective subaperture image that each camera shoots；
Image, the image definition that other cameras are obtained centered on S3, the image definition that will be shot positioned at array center's position camera
It is edge image；
S4, edge image is projected to center image using affine transformation where image planes on；Then extracting same characteristic features point makes
Edge image is matched with center image, finally obtains complete spliced panoramic image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710267269.XA CN106873301A (en) | 2017-04-21 | 2017-04-21 | Based on the system and method that array camera is imaged to remote aperture rear |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710267269.XA CN106873301A (en) | 2017-04-21 | 2017-04-21 | Based on the system and method that array camera is imaged to remote aperture rear |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106873301A true CN106873301A (en) | 2017-06-20 |
Family
ID=59163425
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710267269.XA Pending CN106873301A (en) | 2017-04-21 | 2017-04-21 | Based on the system and method that array camera is imaged to remote aperture rear |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106873301A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108259726A (en) * | 2018-03-11 | 2018-07-06 | 中国海洋大学 | A kind of camera array device for underwater photograph technical |
| WO2019214568A1 (en) * | 2018-05-07 | 2019-11-14 | 清华大学深圳研究生院 | Depth-based light field splicing method |
-
2017
- 2017-04-21 CN CN201710267269.XA patent/CN106873301A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108259726A (en) * | 2018-03-11 | 2018-07-06 | 中国海洋大学 | A kind of camera array device for underwater photograph technical |
| WO2019214568A1 (en) * | 2018-05-07 | 2019-11-14 | 清华大学深圳研究生院 | Depth-based light field splicing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109272570A (en) | A kind of spatial point three-dimensional coordinate method for solving based on stereoscopic vision mathematical model | |
| US20180213218A1 (en) | Equipment and method for promptly performing calibration and verification of intrinsic and extrinsic parameters of a plurality of image capturing elements installed on electronic device | |
| CN105379264B (en) | The system and method with calibrating are modeled for imaging device | |
| WO2016037486A1 (en) | Three-dimensional imaging method and system for human body | |
| WO2016153100A1 (en) | Image processing apparatus having automatic compensation function for image obtained from camera, and method thereof | |
| CN103971375B (en) | A kind of panorama based on image mosaic stares camera space scaling method | |
| JP6398472B2 (en) | Image display system, image display apparatus, image display method, and program | |
| CN107578450B (en) | Method and system for calibrating assembly error of panoramic camera | |
| US20070273894A1 (en) | Method and apparatus for remote spatial calibration and imaging | |
| CN111815672B (en) | Dynamic tracking control method, device and control equipment | |
| CN103379267A (en) | Three-dimensional space image acquisition system and method | |
| CN108200312A (en) | A kind of light-field camera | |
| CN108444452B (en) | Method and device for detecting longitude and latitude of target and three-dimensional space attitude of shooting device | |
| CN103293845A (en) | Omni-directional imaging device and method | |
| CN106873301A (en) | Based on the system and method that array camera is imaged to remote aperture rear | |
| CN111279393A (en) | Camera calibration method, device, equipment and storage medium | |
| CN206100245U (en) | 360 camera is taken photograph to degree panorama degree of depth | |
| CN113079369B (en) | Method and device for determining image pickup equipment, storage medium and electronic device | |
| EP3066508A1 (en) | Method and system for creating a camera refocus effect | |
| CN104596486B (en) | Pose measuring method based on the rotationally symmetrical feature of target | |
| CN207051657U (en) | A kind of camera lens arrangement architecture of big visual field compound eye structural | |
| CN103546680B (en) | A kind of deformation-free omni-directional fisheye photographic device and a method for implementing the same | |
| CN110786008A (en) | Method for shooting image and mobile platform | |
| CN206848687U (en) | The system being imaged based on array camera to remote aperture rear | |
| JP2023062217A (en) | Data generation method, learning method, and estimation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170620 |
|
| WD01 | Invention patent application deemed withdrawn after publication |