CN105208373A - Universal integrated imaging recording device based on light field compression sampling - Google Patents
Universal integrated imaging recording device based on light field compression sampling Download PDFInfo
- Publication number
- CN105208373A CN105208373A CN201510589072.9A CN201510589072A CN105208373A CN 105208373 A CN105208373 A CN 105208373A CN 201510589072 A CN201510589072 A CN 201510589072A CN 105208373 A CN105208373 A CN 105208373A
- Authority
- CN
- China
- Prior art keywords
- module
- compression sampling
- light field
- dimensional
- lightfield
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a universal integrated imaging recording device based on light field compression sampling. The universal integrated imaging recording device comprises a lens module, a light field compression sampling module and a sensor module which are sequentially arranged. The sensor module is connected with a storage and output module. The storage and output module and the light field compression sampling module are both connected with a calculation module. Compression sampling is conducted on a three-dimensional scene through an optical mask and an imaging lens, and the requirements for the sampling data size and the light field information recovery are taken into consideration at the same time; compared with the situation that a large amount of information of the three-dimensional scene can be lose through a micro-lens array structure adopted for an existing integrated imaging recording end, the light field of the three-dimensional scene can be almost completely recovered from an image recorded by the universal integrated imaging recording device, a micro-unit image array suitable for being displayed by various integrated imaging three-dimensional display systems with different parameters can be conveniently generated through subsequent processing, no limitation on display end parameters exists, and a universal integrated imaging recording method is provided.
Description
Technical field
The invention belongs to 3 D stereo display field, relate to a kind of recording method of integration imaging three-dimensional display, particularly a kind of general integration imaging tape deck based on lightfield compression sampling.
Background technology
Integration imaging technology is a kind of emerging naked eye three-dimensional Display Technique with full parallax, continuously viewpoint, adopts path reversal principal, and system can be divided into record end and display end two parts.Record end primarily of microlens array, imaging is carried out to three-dimensional scenic, generate a series of tiny image comprising parallax information, this slightly image jointly constitute micro unit pattern matrix, recorded by optical pickocff.At display end, the micro unit pattern matrix obtained by record end is shown on a display panel, and by path reversal principal, the light that image sends, after holding with record the microlens array that parameter is identical, is assembled at display space, reappears three-dimensional scenic.When changing the parameter of microlens array in display system, namely when display system parameter is not mated with register system parameter, the direct micro unit pattern matrix using record end to obtain shows, the quality meeting degradation of reconstructed image, even cannot reconstruct correct 3-D view, therefore, in integrated imaging system, display end parameter holds parameter to need strictly to mate with record.
In current domestic and international existing research, two step record transformation approach are often adopted to solve the problems referred to above, the micro unit pattern matrix obtained by recording equipment carries out virtual display by virtual microlens array (parameter is held identical with record) in a computer, then virtual microlens array is organized by another or virtual pinhole array carries out record again, again through convergent-divergent or other processing method, finally obtain outputting to display end with the micro unit pattern matrix of display end match parameters; Two step record transformation approach exist following not enough: 1) the method needs the priori (such as: the depth information of object in scene) about three-dimensional scenic, and these prioris normally cannot obtain; 2) information source of the method is that the micro unit pattern matrix obtained held in record, but, in the recording process of record end, due to the sampling effect of microlens array, the bulk information of three-dimensional scenic is lost in the micro unit pattern matrix of record, therefore cannot recover three-dimensional scenic light field completely, the high-quality micro unit pattern matrix being applicable to various parameter display equipment cannot be synthesized.
Summary of the invention
For above-mentioned problems of the prior art and defect, the object of the invention is to, a kind of general integration imaging tape deck based on lightfield compression sampling is provided.
To achieve these goals, the present invention adopts following technical scheme:
Based on a general integration imaging tape deck for lightfield compression sampling, comprise the camera lens module, lightfield compression sampling module and the sensor assembly that set gradually;
Described sensor assembly connects storage and output module;
Described storage is all connected computing module with output module and lightfield compression module;
Described camera lens module is used for choosing three-dimensional scenic; Described lightfield compression sampling module is used for carrying out compression sampling to the light in three-dimensional scenic, obtains two-dimensional optical image; Described sensor assembly is for recording two-dimensional optical image; Described computing module, for generating random matrix, controls the optical mask of lightfield compression sampling module; Described storage and output module are for the random matrix stored or the image of output transducer module record and computing module generate.
Further, optical correction module is provided with between described lightfield compression sampling module and sensor assembly; Described optical correction module is for adjusting the light path of the two dimensional image of lightfield compression sampling module generation.
Particularly, described lightfield compression sampling module comprises the optical mask and imaging len that set gradually along light transmission direction.
Particularly, described optical correction module comprises the speculum and correcting lens that set gradually along light transmission direction.
Compared with prior art, the present invention has following technique effect:
1, the present invention utilizes optical mask and imaging len to carry out compression sampling to three-dimensional scenic, sampled data output and field information recovery requirement are taken into account, the microlens array structure adopted relative to existing integration imaging record end can cause a large amount of loss of three-dimensional scene information, can be similar to from the image that the present invention records and recover three-dimensional scenic light field completely, be convenient to the micro unit pattern matrix that subsequent treatment generates the integration imaging three-dimensional display system display being applicable to various different parameters, not limiting display end parameter, is a kind of general integration imaging recording method.
2, recording method structure of the present invention is simple, adopts the lightfield compression sampling module of optical mask and imaging len composition, is convenient to directly expand existing two-dimensional imaging equipment, significant in actual applications.
Accompanying drawing explanation
Fig. 1 is structural representation of the present invention;
Fig. 2 is the structural representation of embodiments of the invention;
Fig. 3 is the fundamental diagram of lightfield compression sampling module;
Below in conjunction with drawings and Examples the solution of the present invention done and explain in further detail and illustrate.
Embodiment
Embodiment
Defer to technique scheme, see Fig. 1 and 2, the general integration imaging tape deck based on lightfield compression sampling of the present embodiment comprises the camera lens module, lightfield compression sampling module and the sensor assembly that set gradually; Described sensor assembly connects storage and output module; Described storage is all connected computing module with output module and lightfield compression sampling module.
Further, optical correction module is provided with between described lightfield compression sampling module and sensor assembly.
The tape deck of application the present embodiment, the light in three-dimensional scenic light field passes through described camera lens module, optical compression module, optical correction module and sensor assembly successively; Described camera lens module is used for three-dimensional scenic and chooses, and makes the lightfield compression sampling module that it is focused thereafter; Described lightfield compression sampling module is used for carrying out compression sampling to the light in three-dimensional scenic, obtains two-dimensional optical image; Described optical correction module is used for changing light path according to the relative position of lightfield compression sampling module and sensor assembly, enables by the two-dimensional optical image focal imaging on sensor assembly obtained after compression sampling; Described sensor assembly is for recording two-dimensional optical image; Described computing module, for generating random matrix, controls the optical mask of lightfield compression sampling module; Described storage and output module are for the random matrix stored or the image of output transducer module record and computing module generate.
The present invention carries out compression sampling to three-dimensional scenic, take into account the recovery requirement of sampled data output and field information, the microlens array structure adopted relative to existing integration imaging record end can cause a large amount of loss of three-dimensional scene information, the image that the present invention records can be similar to and recover three-dimensional scenic light field completely, be convenient to the micro unit pattern matrix that subsequent treatment generates the integration imaging three-dimensional display system display being applicable to various different parameters, not limiting display end parameter, is a kind of general integration imaging recording method.
Described camera lens module comprises the set of lenses and aperture that set gradually, can select existing two-dimensional imaging camera lens.Described camera lens module for selecting three-dimensional scene area to be recorded, and makes three-dimensional scenic to be recorded focus on lightfield compression sampling module, is convenient to three-dimensional scenic selected by subsequent module record.
Described lightfield compression sampling module comprises the optical mask and imaging len that set gradually along light transmission direction.Described optical mask can adopt transmissive optical device, as electrically-controlled liquid crystal screen, or reflection-type optical device, as digital micromirror chip DMD.In order to effectively utilize mask and imaging len, mask is centrally located on the primary optical axis of imaging len.Transmissive mask placement parallel with imaging len, when need ensure that in mask, corresponding point value is set to 1 when reflection-type mask is placed, reflection ray can arrive imaging len, and when value is 0, reflection ray can not arrive imaging len.Optical mask generates random mask according to the random matrix that computing module calculates, and regulate light path, make a part of light arrived in light field in the light of mask to arrive imaging len, another part light then can not arrive.
Optical mask is according to reflective optic, the random matrix of its correspondence is two-value random matrix (in matrix, numerical value is 0 or 1), when in matrix, certain point value is 0, in dmd chip, corresponding micro mirror minute surface direction makes reflection ray arrive imaging len; Otherwise if certain point value is 1 in matrix, then corresponding micro mirror minute surface direction makes reflection ray arrive imaging len; If optical mask selective transmission type optics, then corresponding random matrix can select two-value random matrix or gray scale random matrix, and (in matrix, number range is [0,1]), the transmissivity of corresponding points in the corresponding transmissive type devices of the numerical value of often in matrix, if value is 0, then this point is opaque, light not by, if value is 1, then this transmissivity is 1, and light can, completely by rear arrival imaging len, be certain the value τ within the scope of 0-1 if be worth, then value τ is the transmitance of this point, light portion through.
Light after optical mask is after arrival imaging len, the identical light in direction is imaged lens and converges at same point on focal plane, like this, the light of different directions is through imaging len, focal plane is formed a width two dimensional image, and the every bit on this image all contains the information along imaging len photocentre to all directional lights in this direction.
See Fig. 3, three-dimensional scenic light field to be recorded is made up of the light of different directions, represents with matrix X, and the direction of propagation of the light of different directions is θ
1, θ
2, then X=(X
θ 1, X
θ 2...); Dotted line in Fig. 3 and solid line represent two groups of light X of different directions respectively
θ 1and X
θ 2.Mask in lightfield compression sampling module have employed transmissive optical mask, and shows two-value random matrix Φ thereon.After light arrives optical mask, in optical mask, value is the some transmitance of 1 is 1, and this point of light-transmissive arrives imaging len; On mask, value is the some transmitance of 0 is 0, light impermeable.Therefore two groups of light X
θ 1and X
θ 2, after respectively through mask, be equivalent to do point multiplication operation with mask random matrix Φ.
Two groups of light Φ X after mask
θ 1with Φ X
θ 2, arrive imaging len, it is θ that these two groups of light are respectively the direction of propagation
1and θ
2two groups of directional lights, after imaging len, be imaged lens and converge at 2 points on focal plane (some A and some B) respectively.Therefore, Y is respectively at an A and the value of some B
a=<X
θ 1, Φ > and Y
b=<X
θ 2, Φ >.Wherein, Y
aand Y
bcontain two groups of parallel rays X respectively
θ 1and X
θ 2information.If record M time, then corresponding random matrix Φ
1, Φ
2... Φ
mobserving matrix Φ=(Φ can be formed
1, Φ
2... Φ
m), the value of the some A recorded and some B forms M dimensional vector, is respectively Y
a=Φ X
θ 1and Y
b=Φ X
θ 2.
Described optical correction module comprises the speculum and correcting lens that set gradually along light transmission direction, and light, successively through speculum and correcting lens, can be selected to arrange speculum and correcting lens according to the relative position of imaging len and transducer.When transducer in system is not on imaging len focal plane, adopt this module, described speculum, for changing the direction of the light penetrated by light field sampling module, enables light arrive transducer; Described correcting lens makes for focusing by the two-dimensional optical image blur-free imaging on a sensor obtained after compression sampling.
Described sensor assembly adopts the imageing sensors such as charge coupled device ccd (ICX409AK as Sony) or metal oxide semiconductor device CMOS (as MICRONMT9T012).
Described sensor assembly is for recording all picture point after correcting lens corrects, and each picture point contains the information of the parallel rays on its corresponding direction of propagation, and above-mentioned information transmission is carried out storing or exporting to storage and output module.Above-mentioned Information Availability compressed sensing algorithm recovers the information of this direction parallel rays group from each pixel, combines to be similar to fully to recover whole light X=(X in three-dimensional scenic light field to be recorded
θ 1, X
θ 2...) information, the micro unit pattern matrix with display device match parameters can be generated after resampling.
Described computing module comprises the chip that STM32F407 single-chip microcomputer or TMS320C6713 digital signal processor (DSP) etc. can calculate random number, for according to mask ranks number, (reflection-type optical device is the ranks number of micro mirror, transmissive optical device is the ranks number of pixel) (reflective type device is two-value random matrix to calculate the equal random matrix of generation ranks number, transmissive type devices both can generate two-value random matrix, also can generate gray scale random matrix).The random matrix that described computing module generates outputs in optical mask, for realizing lightfield compression sampling.
Described storage and output circuit comprise storage chip and output interface, described storage chip adopts Samsung K9F8G08UXM, this chip is 1Gbyte memory, be used for storing the random matrix information that view data and the computing module of sensor assembly output export, and output in computer and adopt compressed sensing algorithm completely or approximately fully recover three-dimensional scenic light field, and generate the micro unit pattern matrix being applicable to the integration imaging display end of different parameters through resampling.
Claims (4)
1., based on a general integration imaging tape deck for lightfield compression sampling, it is characterized in that, comprise the camera lens module, lightfield compression sampling module and the sensor assembly that set gradually;
Described sensor assembly connects storage and output module;
Described storage is all connected computing module with output module and lightfield compression module;
Described camera lens module is used for choosing three-dimensional scenic; Described lightfield compression sampling module is used for carrying out compression sampling to the light in three-dimensional scenic, obtains two-dimensional optical image; Described sensor assembly is for recording two-dimensional optical image; Described computing module, for generating random matrix, controls the optical mask of lightfield compression sampling module; Described storage and output module are for the random matrix stored or the image of output transducer module record and computing module generate.
2., as claimed in claim 1 based on the general integration imaging tape deck of lightfield compression sampling, it is characterized in that, between described lightfield compression sampling module and sensor assembly, be provided with optical correction module; Described optical correction module is for adjusting the light path of the two dimensional image of lightfield compression sampling module generation.
3., as claimed in claim 1 or 2 based on the general integration imaging tape deck of lightfield compression sampling, it is characterized in that, described lightfield compression sampling module comprises the optical mask and imaging len that set gradually along light transmission direction.
4., as claimed in claim 2 based on the general integration imaging tape deck of lightfield compression sampling, it is characterized in that, described optical correction module comprises the speculum and correcting lens that set gradually along light transmission direction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510589072.9A CN105208373B (en) | 2015-09-16 | 2015-09-16 | Universal integrated imaging recording device based on light field compression sampling |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510589072.9A CN105208373B (en) | 2015-09-16 | 2015-09-16 | Universal integrated imaging recording device based on light field compression sampling |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105208373A true CN105208373A (en) | 2015-12-30 |
| CN105208373B CN105208373B (en) | 2017-04-12 |
Family
ID=54955766
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510589072.9A Expired - Fee Related CN105208373B (en) | 2015-09-16 | 2015-09-16 | Universal integrated imaging recording device based on light field compression sampling |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105208373B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110099270A (en) * | 2019-03-12 | 2019-08-06 | 成都工业学院 | Integration imaging secondary imagery method based on light field resampling |
| CN111999616A (en) * | 2020-08-31 | 2020-11-27 | 南京工程学院 | Single-pixel solar blind ultraviolet imaging system based on space coding mask plate |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100265386A1 (en) * | 2007-02-06 | 2010-10-21 | Ramesh Raskar | 4D Light Field Cameras |
| CN102026011A (en) * | 2009-09-22 | 2011-04-20 | 三星电子株式会社 | Apparatus for acquiring light field data, apparatus and method for processing light field data |
| KR101294261B1 (en) * | 2013-01-08 | 2013-08-06 | 동서대학교산학협력단 | Three dimensional interal imagine display-using mask and time-multiplexing |
-
2015
- 2015-09-16 CN CN201510589072.9A patent/CN105208373B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100265386A1 (en) * | 2007-02-06 | 2010-10-21 | Ramesh Raskar | 4D Light Field Cameras |
| CN102026011A (en) * | 2009-09-22 | 2011-04-20 | 三星电子株式会社 | Apparatus for acquiring light field data, apparatus and method for processing light field data |
| KR101294261B1 (en) * | 2013-01-08 | 2013-08-06 | 동서대학교산학협력단 | Three dimensional interal imagine display-using mask and time-multiplexing |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110099270A (en) * | 2019-03-12 | 2019-08-06 | 成都工业学院 | Integration imaging secondary imagery method based on light field resampling |
| CN111999616A (en) * | 2020-08-31 | 2020-11-27 | 南京工程学院 | Single-pixel solar blind ultraviolet imaging system based on space coding mask plate |
| CN111999616B (en) * | 2020-08-31 | 2023-03-10 | 南京工程学院 | Single-pixel solar blind ultraviolet imaging system based on spatial coding mask plate |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105208373B (en) | 2017-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5877803A (en) | 3-D image detector | |
| US8290358B1 (en) | Methods and apparatus for light-field imaging | |
| CN101911671B (en) | Imaging device and optical axis control method | |
| TW201728155A (en) | Apparatus and method to maximize the display area of a mobile device | |
| Dansereau et al. | A wide-field-of-view monocentric light field camera | |
| KR20160090373A (en) | Photographing method for dual-camera device and dual-camera device | |
| EP2008445A1 (en) | Improved plenoptic camera | |
| US9532030B2 (en) | Integrated three-dimensional vision sensor | |
| US20120230549A1 (en) | Image processing device, image processing method and recording medium | |
| JP7312185B2 (en) | Camera module and its super-resolution image processing method | |
| US20120307132A1 (en) | Imaging module, imaging apparatus, image processing apparatus, and image processing method | |
| US20030048416A1 (en) | Stereoscopic imaging using a single image sensor | |
| Kagawa et al. | A three‐dimensional multifunctional compound‐eye endoscopic system with extended depth of field | |
| CN103888641A (en) | Image Processing Apparatus And Image Refocusing Method | |
| CN105208373A (en) | Universal integrated imaging recording device based on light field compression sampling | |
| CN111127379B (en) | Rendering method of light field camera 2.0 and electronic equipment | |
| US20140354777A1 (en) | Apparatus and method for obtaining spatial information using active array lens | |
| JP4523538B2 (en) | 3D image display device | |
| Kuo et al. | Perspective-Correct VR Passthrough Without Reprojection | |
| JP2000222116A (en) | Position recognition method for display image, position recognition device therefor and virtual image stereoscopic synthesis device | |
| TW201723635A (en) | An apparatus and a method for encoding an image captured by an optical acquisition system | |
| CN103828362A (en) | Imaging apparatus and video recording and reproducing system | |
| JP2007129436A (en) | Image processing method, image processor and image display employing it | |
| CN102314067A (en) | Three-dimensional photographing device | |
| Lin et al. | Single-view-point omnidirectional catadioptric cone mirror imager |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170412 Termination date: 20190916 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |