CN202485671U - Compression perception theory based imaging device of aerospace camera - Google Patents

Compression perception theory based imaging device of aerospace camera Download PDF

Info

Publication number
CN202485671U
CN202485671U CN 201020626836 CN201020626836U CN202485671U CN 202485671 U CN202485671 U CN 202485671U CN 201020626836 CN201020626836 CN 201020626836 CN 201020626836 U CN201020626836 U CN 201020626836U CN 202485671 U CN202485671 U CN 202485671U
Authority
CN
China
Prior art keywords
lens
dmd
single pixel
matrix
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 201020626836
Other languages
Chinese (zh)
Inventor
张智
刘兆军
周峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Space Research Mechanical and Electricity
Original Assignee
Beijing Institute of Space Research Mechanical and Electricity
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Space Research Mechanical and Electricity filed Critical Beijing Institute of Space Research Mechanical and Electricity
Priority to CN 201020626836 priority Critical patent/CN202485671U/en
Application granted granted Critical
Publication of CN202485671U publication Critical patent/CN202485671U/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Abstract

The utility model relates to a compression perception theory based imaging device of an aerospace camera. The device comprises a first lens, a second lens, a DMD (Digital Micromirror Device) array, a single pixel detector, an A/D (Analog/Digital) converter and an image reconstruction module, wherein the first lens is used for converging scene incident light to the DMD array; the second lens is used for converging reflection light on the DMD array to the single pixel detector; the DMD array is used for reflecting the light converged from the first lens to the second lens through a micromirror of a measuring matrix; the single pixel detector is used for receiving the light reflected from the DMD array and converting an optical signal into an electric signal; and the image reconstruction module is used for reconstructing a digital signal received from the A/D converter into an image, particularly including the steps of selecting the measuring matrix of the DMD, carrying out sparse representation to the digital signal, calculating a transit matrix in the sparse representation, and calculating the constrained minimum to the 1-norm so as to obtain the reconstructed image. The device is applicable for deep space exploration in a severe environment; the camera is lighter and smaller; and the volume and the power consumption cost are small.

Description

Based on the theoretical camera space imaging device of compressed sensing
Technical field
The utility model belongs to the optical remote sensing technology field, particularly relates to based on the theoretical camera space imaging device of compressed sensing.
Background technology
Shannon's sampling theorem is satisfied in existing camera space sampling strictness, and the sample information amount receives the restriction of sampling thheorem, and picture element is difficult to improve.Detector area is excessive, is not easy to refrigeration.The tradition remote sensing camera can be collected lot of data when earth observation for a long time, on star, be difficult to carry out the high capacity storage.
The utility model content
The purpose of the utility model is to overcome the above-mentioned deficiency of prior art; Provide based on the theoretical camera space imaging device of compressed sensing; This device adopts the detector of unit picture element size to replace the extensive planar array detector of tradition; Be applicable to the survey of deep space that environment is abominable, make camera gentlier little, volume and power consumption cost are little.
The above-mentioned purpose of the utility model is achieved through following technical scheme:
Based on the theoretical camera space imaging device of compressed sensing, comprise first lens, second lens, dmd array, single pixel detector, A/D and image reconstruction module, wherein:
First lens: the scene incident light is converged on the dmd array;
Second lens: the reflection ray on the dmd array is converged on single pixel detector;
Dmd array: comprise addressing integrated chip and the micromirror of measuring matrix, will reflex to light on second lens through the micromirror of measuring matrix from the light that first lens converge;
Single pixel detector: receive the light of dmd array reflection, convert light signal into electric signal, export to A/D;
A/D: receive the electric signal of single pixel detector output, carry out mould/number conversion, digital signal is exported to image reconstruction module;
Image reconstruction module: the digital signal that receives A/D output; Digital signal to receiving is carried out image reconstruction; Concrete grammar is: select the measurement matrix of DMD, the digital signal that receives is carried out rarefaction representation, and obtain the transition matrix in the rarefaction representation; Ask constraint minimum to 1 norm, thus the image that obtains rebuilding.
In the above-mentioned camera space imaging device theoretical based on compressed sensing; Image reconstruction module comprises that measuring matrix selects module, rarefaction representation module, transition matrix module and norm least commitment module; Wherein measuring matrix selects module to be used to select the measurement matrix of DMD; The rarefaction representation module is used for the digital signal that receives is carried out rarefaction representation, and the transition matrix module is used for obtaining the transition matrix of rarefaction representation, and norm least commitment module is used for asking constraint minimum to 1 norm.
The utility model compared with prior art has following advantage:
(1) the utility model has adopted the compressed sensing principle of signal rarefaction representation in image reconstruction module; Before sampling, carry out signal compression; Broken through the traditional sampling theorem and got constraint condition, the quantity of information that obtains is bigger, is applicable to multispectral, Hyper spectral Imaging that amount of image information is bigger;
(2) the utility model adopts the detector of unit picture element size to replace the extensive planar array detector of tradition, has solved the gordian technique difficult problem of detector (especially infrared) dimension-limited, can make the device refrigeration be easy to realize simultaneously;
(3) the utility model imaging device volume and power consumption cost are little, make camera gentlier little, are applicable to survey of deep space or the extremely abominable interstellar space detection of other environment that environment is abominable; Be fit to microsensor (space resources is most deficient);
(4) the utility model imaging device is particularly useful for the low light level and the spectral coverage outside visible spectrum carries out work, such as infrared, the microwave that is used in the sensor dimension-limited, low light level (snowslide pipe) etc., has stronger practicality.
Description of drawings
Fig. 1 is the utility model camera space imaging device structural representation;
Fig. 2 is the structural representation of image reconstruction module in the utility model imaging device.
Embodiment
Below in conjunction with accompanying drawing and specific embodiment the utility model is described in further detail:
Be illustrated in figure 1 as the utility model camera space imaging device structural representation; Can know that by figure this imaging device comprises first lens, second lens, dmd array, single pixel detector, A/D and image reconstruction module; Wherein dmd array adopts the HD3+DMD chip of American TI Company, and resolution is 1280 * 720, and micromirror is a square; Its length of side is 13-16um, is in respectively+12 ° and-12 ° of two duties.System relies on static random-access reservoir (SRAM) unit that each micro mirror is carried out addressing, and the electrostatic force that uses cmos circuit to provide drives the rotation of micro mirror stationary shaft.DMD (digital micromirror device) device is a kind of fast digital photoswitch reflective array that is integrated on the addressing integrated chip, uses it can be used for producing the random measurement matrix.Single pixel detector generally can be processed with the bigger photodiode of single dynamic range.Single detector before the camera lens be single pixel camera be with traditional C CD/CMOS camera between structurally maximum different.Certainly, also can make the small-scale array of forming by small number of pixels (its pixel cell is less than traditional C CD/CMOS detector) to detector.According to the measured value of gained repeatedly, reconstituting initial image information.Because the detector scale is less, be easy to the infrared eye refrigeration.
What single pixel camera was different with traditional C CD/CMOS camera is that single pixel camera has been put into ground high performance parallel Distributed Calculation processing to the work of treatment of big data quantity, thereby accomplishes the ground integrated system of star.Like this, required power consumption reduces greatly on the star, reduces the camera size.Because camera detector sampled value is that the measured value dimension is quite low through the matrix of original signal after the conversion of two kinds of orthogonal basiss, negligible amounts makes things convenient for data-storing and transmission on the star.Compressed sensing can be converted into the cost that forms images on traditional star the ground recovery work of off-line.
The concrete course of work of this imaging device is following:
First lens converge to the scene incident light on the dmd array; Second lens converge to the reflection ray on the dmd array on single pixel detector; Dmd array will reflex to light on second lens through the micromirror of measuring matrix from the light that first lens converge; Single pixel detector receives the light of dmd array reflection, converts light signal into electric signal, exports to A/D; A/D receives the electric signal of single pixel detector output, carries out mould/number conversion, and digital signal is exported to image reconstruction module; Image reconstruction module receives the digital signal of A/D output; Digital signal to receiving is carried out image reconstruction; Concrete grammar is: select the measurement matrix of DMD, the digital signal that receives is carried out rarefaction representation, and obtain the transition matrix in the rarefaction representation; Ask constraint minimum to 1 norm, thus the image that obtains rebuilding.
Image reconstruction module comprises that measuring matrix selects module, rarefaction representation module, transition matrix module and norm least commitment module; Wherein measuring matrix selects module to be used to select the measurement matrix of DMD; The rarefaction representation module is used for the digital signal that receives is carried out rarefaction representation; The transition matrix module is used for obtaining the transition matrix of rarefaction representation, and norm least commitment module is used for asking constraint minimum to 1 norm, and the detailed operation principle of image reconstruction module is following:
(1) at first selects suitable measurement matrix.In encoding measurement, select stable projection matrix, in order to ensure the linear projection of signal can holding signal prototype structure, (sign of approximation ratio between measurement result and the original image just), projection matrix must satisfy constraint isometry condition.The linear projection measured value is made up of original signal and the product form of measuring matrix.
Measure matrix Φ and must satisfy constraint isometry condition.For any K sparse signal c and constant, σ K∈ (0,1) if
( 1 - σ K ) | | c | | 2 2 ≤ | | Φ T c | | 2 2 ≤ ( 1 + δ K ) | | c | | 2 2 , ∀ c ∈ R | T | - - - ( 1 )
Set up, wherein | T|≤K, Φ TFor the size that constitutes by the indicated related column of index T among the Φ be K * | the submatrix of T|, claim that then matrix Φ satisfies the constraint isometry.Usually, for a k-factor signal x (position of its K nonzero value is unknown), formula (5) can be that matrix Φ is for 3K sparse signal c and constant δ from the adequate condition that y accurately reconstructs x 3K∈ (0,1) has 3K rank constraint isometry, promptly
( 1 - σ 3 K ) | | c | | 2 2 ≤ | | Φ T c | | 2 2 ≤ ( 1 + δ 3 K ) | | c | | 2 2 , ∀ c ∈ R | T | - - - ( 2 )
Set up wherein
Figure BSA00000361830400044
| T|≤3K.Can obtain through the Gauss measurement matrix that to select a size be M * N, wherein each value all satisfy N (0, independent normal distribution 1/N).
(2) prerequisite of compressed sensing is that the hypothesis signal has sparse property and compressibility, and promptly signal can have succinct expression formula under suitable base.Rarefaction representation has surmounted traditional Shannon's sampling theorem, and sampled signal can precisely be rebuild original signal on the basis of Ya Nai Qwest sample mode.The rarefaction representation of signal shows that having only the minority element in this signal is non-zero.In most of the cases all right and wrong are sparse for the natural sign in the time domain, but it possibly be sparse on transform domain.Be transformed to sparse signal, can effectively represent whole signal with the coefficient of minority.
Theoretical according to harmonic analysis, the one-dimensional discrete time signal f that length is N can be expressed as the linear combination of one group of orthonormal basis
f = Σ i = 1 N x i ψ i - - - ( 3 )
Can be reduced to
f=xψ,ψ=[ψ 12|…ψ N] (4)
In the formula (3), ψ iBe column vector.If x has only K element non-zero, claim that then x is the K rarefaction representation of signal f.Briefly, rarefaction representation is exactly that the absolute value of most conversion coefficients was very little when signal projection was arrived the orthogonal transformation base, and resulting conversion vector is sparse or approximate sparse, can it be regarded as a kind of succinct expression of original signal.Rarefaction representation is the theoretical foundation of compressed sensing, and natural sign is inevitable can be similar to rarefaction representation under certain conversion.
(3) the measurement result matrix of y representation signal M; S represents the matrix of reconstruction signal N, has so
y j=<x, Φ j>, and y=Φ x=Φ ψ s=Θ s (5)
Wherein, Φ is for measuring matrix, and ψ is the wavelet basis that projects to.
(4) reconstructed image, as follows
The thought of promptly minimizing with 1 norm is come reconstructed image S.
The content of not doing to describe in detail in the utility model instructions belongs to this area professional and technical personnel's known technology.

Claims (1)

1. based on the theoretical camera space imaging device of compressed sensing, it is characterized in that: comprise first lens, second lens, dmd array, single pixel detector, A/D and image reconstruction module, wherein:
First lens: the scene incident light is converged on the dmd array;
Second lens: the reflection ray on the dmd array is converged on single pixel detector;
Dmd array: comprise addressing integrated chip and the micromirror of measuring matrix, will reflex to light on second lens through the micromirror of measuring matrix from the light that first lens converge;
Single pixel detector: receive the light of dmd array reflection, convert light signal into electric signal, export to A/D;
A/D: receive the electric signal of single pixel detector output, carry out mould/number conversion, digital signal is exported to image reconstruction module;
Image reconstruction module: the digital signal that receives A/D output; Digital signal to receiving is carried out image reconstruction; Concrete grammar is: select the measurement matrix of DMD, the digital signal that receives is carried out rarefaction representation, and obtain the transition matrix in the rarefaction representation; Ask constraint minimum to 1 norm, thus the image that obtains rebuilding.
CN 201020626836 2010-11-26 2010-11-26 Compression perception theory based imaging device of aerospace camera Expired - Fee Related CN202485671U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201020626836 CN202485671U (en) 2010-11-26 2010-11-26 Compression perception theory based imaging device of aerospace camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201020626836 CN202485671U (en) 2010-11-26 2010-11-26 Compression perception theory based imaging device of aerospace camera

Publications (1)

Publication Number Publication Date
CN202485671U true CN202485671U (en) 2012-10-10

Family

ID=46960088

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201020626836 Expired - Fee Related CN202485671U (en) 2010-11-26 2010-11-26 Compression perception theory based imaging device of aerospace camera

Country Status (1)

Country Link
CN (1) CN202485671U (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102914367A (en) * 2012-10-25 2013-02-06 浙江大学 Multispectral imaging device and multispectral imaging method based on compressed sensing
CN103969693A (en) * 2014-04-30 2014-08-06 中国科学院长春光学精密机械与物理研究所 Photoelectric detection imaging system and method
CN103983253A (en) * 2014-03-21 2014-08-13 北京空间飞行器总体设计部 Mutual-shooting imaging system for deep-space exploration lander and deep-space exploration rover
CN104301634A (en) * 2014-10-24 2015-01-21 四川大学 Short wave infrared single pixel camera based on random sampling
CN104483025A (en) * 2014-12-19 2015-04-01 中国科学院长春光学精密机械与物理研究所 Single-point mid-wave infrared imaging system based on compressive sensing theory
CN104702828A (en) * 2015-03-13 2015-06-10 四川大学 Compressed sensing point-by-point scanning camera for inside of divided array blocks
CN105227815A (en) * 2015-09-29 2016-01-06 郑州大学 A kind of passive type list pixel is looked in the distance imaging system and formation method
CN105791643A (en) * 2016-03-07 2016-07-20 四川大学 DMD-based multi-element detecting and imaging system
CN106019274A (en) * 2016-05-24 2016-10-12 西安深穹光电科技有限公司 Novel Doppler radar imaging device and method
CN106066481A (en) * 2016-05-24 2016-11-02 西安深穹光电科技有限公司 A kind of four-dimensional laser infrared radar imaging device and method based on DMD
CN106840109A (en) * 2017-01-20 2017-06-13 长沙全度影像科技有限公司 A kind of single pixel imaging hardware system based on difference
CN107317956A (en) * 2017-07-26 2017-11-03 中国船舶重工集团公司第七〇九研究所 A kind of video monitoring device, system and method applied to reactor room
CN108844899A (en) * 2018-04-04 2018-11-20 中国科学院长春光学精密机械与物理研究所 A kind of parallelly compressed perception imaging system

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102914367B (en) * 2012-10-25 2015-02-25 浙江大学 Multispectral imaging device and multispectral imaging method based on compressed sensing
CN102914367A (en) * 2012-10-25 2013-02-06 浙江大学 Multispectral imaging device and multispectral imaging method based on compressed sensing
CN103983253A (en) * 2014-03-21 2014-08-13 北京空间飞行器总体设计部 Mutual-shooting imaging system for deep-space exploration lander and deep-space exploration rover
CN103983253B (en) * 2014-03-21 2015-06-10 北京空间飞行器总体设计部 Mutual-shooting imaging system for deep-space exploration lander and deep-space exploration rover
CN103969693A (en) * 2014-04-30 2014-08-06 中国科学院长春光学精密机械与物理研究所 Photoelectric detection imaging system and method
CN104301634A (en) * 2014-10-24 2015-01-21 四川大学 Short wave infrared single pixel camera based on random sampling
CN104483025A (en) * 2014-12-19 2015-04-01 中国科学院长春光学精密机械与物理研究所 Single-point mid-wave infrared imaging system based on compressive sensing theory
CN104702828A (en) * 2015-03-13 2015-06-10 四川大学 Compressed sensing point-by-point scanning camera for inside of divided array blocks
CN105227815B (en) * 2015-09-29 2018-07-13 郑州大学 A kind of passive type single pixel is looked in the distance imaging method
CN105227815A (en) * 2015-09-29 2016-01-06 郑州大学 A kind of passive type list pixel is looked in the distance imaging system and formation method
CN105791643A (en) * 2016-03-07 2016-07-20 四川大学 DMD-based multi-element detecting and imaging system
CN106019274A (en) * 2016-05-24 2016-10-12 西安深穹光电科技有限公司 Novel Doppler radar imaging device and method
CN106066481A (en) * 2016-05-24 2016-11-02 西安深穹光电科技有限公司 A kind of four-dimensional laser infrared radar imaging device and method based on DMD
CN106066481B (en) * 2016-05-24 2019-01-18 西安深穹光电科技有限公司 A kind of four-dimensional laser infrared radar imaging device and method based on DMD
CN106019274B (en) * 2016-05-24 2019-01-22 西安深穹光电科技有限公司 A kind of novel Doppler radar imagery device and method
CN106840109A (en) * 2017-01-20 2017-06-13 长沙全度影像科技有限公司 A kind of single pixel imaging hardware system based on difference
CN107317956A (en) * 2017-07-26 2017-11-03 中国船舶重工集团公司第七〇九研究所 A kind of video monitoring device, system and method applied to reactor room
CN107317956B (en) * 2017-07-26 2023-07-11 中国船舶重工集团公司第七一九研究所 Video monitoring device, system and method applied to reactor compartment
CN108844899A (en) * 2018-04-04 2018-11-20 中国科学院长春光学精密机械与物理研究所 A kind of parallelly compressed perception imaging system
CN108844899B (en) * 2018-04-04 2020-12-01 中国科学院长春光学精密机械与物理研究所 Parallel compressed sensing imaging system

Similar Documents

Publication Publication Date Title
CN202485671U (en) Compression perception theory based imaging device of aerospace camera
Ma et al. Deblurring from highly incomplete measurements for remote sensing
Ma Single-pixel remote sensing
CN104121990B (en) Compressed sensing broadband Hyperspectral imager based on random grating
CN103592026B (en) Time flight imaging spectrum system and method based on compressed sensing and coding transformation
CN102818631B (en) Compression spectral imaging system based on random wavefront phase modulation
CN103453993B (en) Active hyperspectral imaging system and method based on sparse aperture compression calculation correlation
CN102608619B (en) Three-dimensional laser imaging method based on photon counting compressive sampling phased array
CN103471718B (en) Hyperspectral imaging system and method based on sparse aperture compressing calculation correlation
CN103913228B (en) Coding templet multiple target super-resolution time flight imaging system and method
CN101464190A (en) Varifocal full-polarization spectrum imaging detection system
CN103913229B (en) Coding template multi-target active imaging spectrum system and method
CN104301634A (en) Short wave infrared single pixel camera based on random sampling
CN104019898B (en) Ultrasensitive spectral imaging astronomical telescope and astronomical spectral imaging method
CN104168429A (en) Multi-aperture multi-band high-resolution-ratio imaging device and method
CN107966210B (en) Hyperspectral image-based thermal infrared fusion reconstruction method
CN106872951A (en) A kind of darkroom WB-RCS measuring method based on compressed sensing
Coluccia et al. Optical compressive imaging technologies for space big data
Guzzi et al. Optical compressive sensing technologies for space applications: instrumental concepts and performance analysis
CN114739511A (en) Snapshot type hyperspectral imaging chip structure based on spectrum modulation array
Barducci et al. Compressive sensing and hyperspectral imaging
CN102768070B (en) System and method for counting and imaging single photons by aid of complementary measurement
CN107580164A (en) The compressed sensing super-resolution imaging system and its imaging method of a kind of single measurement
Li et al. A brief review on 2D and 3D image reconstruction using single-pixel imaging
Li et al. Efficient compressed imaging method for a microsatellite optical camera

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20121010

Termination date: 20161126