CN109118460A - A kind of light splitting polarization spectrum synchronizing information processing method and system - Google Patents
A kind of light splitting polarization spectrum synchronizing information processing method and system Download PDFInfo
- Publication number
- CN109118460A CN109118460A CN201810677743.0A CN201810677743A CN109118460A CN 109118460 A CN109118460 A CN 109118460A CN 201810677743 A CN201810677743 A CN 201810677743A CN 109118460 A CN109118460 A CN 109118460A
- Authority
- CN
- China
- Prior art keywords
- polarization
- image
- information processing
- parameter
- light splitting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000010287 polarization Effects 0.000 title claims abstract description 171
- 230000010365 information processing Effects 0.000 title claims abstract description 25
- 238000001228 spectrum Methods 0.000 title claims abstract description 23
- 238000003672 processing method Methods 0.000 title claims abstract description 15
- 238000000034 method Methods 0.000 claims abstract description 36
- 230000004927 fusion Effects 0.000 claims abstract description 28
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 14
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 14
- 238000006073 displacement reaction Methods 0.000 claims abstract description 11
- 230000008859 change Effects 0.000 claims abstract description 10
- 238000012937 correction Methods 0.000 claims abstract description 6
- 230000003287 optical effect Effects 0.000 claims abstract description 6
- 239000013598 vector Substances 0.000 claims description 9
- 239000011159 matrix material Substances 0.000 claims description 6
- 238000003062 neural network model Methods 0.000 claims description 6
- 238000003860 storage Methods 0.000 claims description 6
- 239000011229 interlayer Substances 0.000 claims description 4
- 210000002569 neuron Anatomy 0.000 claims description 4
- 239000010410 layer Substances 0.000 claims description 3
- 230000000638 stimulation Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims description 2
- 238000001845 vibrational spectrum Methods 0.000 claims 1
- 238000003384 imaging method Methods 0.000 description 11
- 238000001514 detection method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000002401 inhibitory effect Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 210000004027 cell Anatomy 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000013178 mathematical model Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000002146 bilateral effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000005764 inhibitory process Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
- G06F18/2135—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/10—Image enhancement or restoration using non-spatial domain filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/145—Illumination specially adapted for pattern recognition, e.g. using gratings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20056—Discrete and fast Fourier transform, [DFT, FFT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Spectrometry And Color Measurement (AREA)
Abstract
The invention discloses a kind of light splitting polarization spectrum synchronizing information processing method and system, which includes slave computer and host computer, and wherein slave computer, which is connected by light splitting with three CMOS, obtains the polarization image of three different directions under the same primary optical axis of the same band；Host computer is connected by USB port with slave computer, the polarization image for three different directions that slave computer obtains is stored, change in displacement correction is carried out to three width polarization images using phase correlation method, polarization parameter is carried out using Linear Tuning method, four width polarization parameter images are calculated, finally based on PCA method fusion polarization parameter image and degree of polarization image, polarization characteristic image is obtained, and are carried out by fusion and is shown for polarization characteristic image and synthesis intensity image based on binary channels PCNN.Effectively obtaining and can be improved image quality for polarization spectrum information may be implemented through the invention.
Description
Technical field
The invention belongs to Image Acquisition and processing technology field, and in particular to a kind of light splitting polarization spectrum synchronizing information processing
Method and system.
Background technique
Polarization imaging is to carry out object reconstruction using obtained information on the basis of obtaining target polarization information in real time
The process of enhancing, it is capable of providing the target information of more various dimensions, is the cutting edge technology with huge applications value, especially
It is suitable for stealthy, camouflage, the detection of false target identification, photoelectric detection equipment can be improved in harsh environments such as smog and smoke
Target acquisition recognition capability.
Polarization is one of fundamental characteristics of light, and any target can all be shown during reflecting and emitting electromagnetic radiation
The polarization characteristic determined by its own characteristic and optics philosophy.Scene is obtained under different polarization state by imaging
Information can effectively be distinguished to polarization-light-intensity difference target and background, and then realize weak signal target under complex background
Detection and identification.Therefore, in recent years polarization imaging detection weather environment scientific research, the development and utilization of ocean, space exploration,
Biomedical and Military Application etc. receives more and more attention.
There are mainly three types of the polarization imaging detection devices being applied at present: (1) mode of timesharing imaging.Which passes through
Polarizing film and wave plate before being rotatably mounted on camera lens are to obtain the image in different polarization direction.Its structure is simple, easily realizes, still
It is difficult to realize to moving target polarization imaging.(2) divide the mode of focal plane.Which uses the imager of special process production
Part, each pixel thereon respectively correspond different polarization direction, and according to RGB distribution in similar color image sensor
Bayer format is arranged.Which not only may be implemented while polarization imaging, but also is not necessarily to additional light-splitting device, is easy to
It realizes the miniaturization of instrument, but divides the complex manufacturing technology of focal plane device and commercialization is not implemented.(3) side of channel modulation
Formula.Which forms triple channel synchronous imaging system using three cameras, acquires the polarization image of different directions respectively, then passes through
The overlapping region of different directions polarization image is carried out pixel alignment by image space registration Algorithm.Which can real time imagery and
Hardware complexity is low with lower；But the distortion parameter and shooting visual angle due to triple channel have differences, such as cannot reasonably school
Just, making polarization image, there are errors, influence subsequent processing.(4) divide the mode of amplitude.Which will be entered by optical splitter
It penetrates light and is divided into several roads, each road light enters corresponding detector after the polarizing film in different polarization direction.Which is realized more
The synchronous acquisition of direction polarization information, but equipment is excessively huge.
Summary of the invention
Goal of the invention: aiming at the problems existing in the prior art, the present invention provides a kind of light splitting polarization spectrum synchronizing information
Processing method and system obtain three width different directions under some wave band of target by control light splitting polarization spectrum acquisition device
Polarization image, and last fusion is calculated by change in displacement and polarization and shows final imaging results.
Technical solution: for achieving the above object, the present invention adopts the following technical scheme:
A kind of light splitting polarization spectrum synchronizing information processing method, includes the following steps:
(1) 0 ° of direction of target, 45 ° of directions and the 90 ° of directions for acquiring and storing three cmos image sensors while obtaining
Three width polarization images；
(2) using phase correlation method to three width polarization images carry out change in displacement correction, and using Linear Tuning method into
Row polarization parameter calculates, and obtains four width polarization parameter images；
(3) based on PCA method fusion polarization parameter image and degree of polarization image, polarization characteristic image is obtained, and based on double
Channel PCNN carries out fusion and shows to polarization characteristic image and synthesis intensity image.
Preferably, the method that polarization parameter calculates in the step (2) are as follows:
Sv=k1I90°-k2I0°-cvI45°
Sh=k3I0°-k4I90°-chI135°
Sd=(k5+k6)*I45°-k6*(I0°+I90°)-cdI90°
Sr=k7*(I0°+I90°)-(k7+k8)*I45°-crI0°
Wherein Sv、Sh、Sd、SrRespectively vertical direction, horizontal direction, 45 ° of directions and 135 ° of directions polarization parameter, k1,
k2……k8For interlayer oppositional factor, meet kJj=1,3,5,7The < of > 1 and 0 kJj=2,4,6,8<=1, cv、ch、cd、crTo inhibit outside layer
The factor, I indicate polarized light intensity, under be designated as corresponding polarization direction.
Preferably, degree of polarization and synthesis light intensity are calculated according to following formula in the step (3):
Degree of polarization
Synthesize light intensity
Preferably, being obtained partially in the step (3) based on PCA method fusion polarization parameter image and degree of polarization image
The method of vibration characteristic image are as follows: all elements point in the polarization parameter image and degree of polarization image of four direction is formed one
These column vectors are lined up matrix X by column vector；Retain the main component of matrix X as polarization characteristic image.
Preferably, based on binary channels PCNN fusion polarization characteristic image and synthesizing intensity image in the step (3)
Method includes:
(3.1) neural network model parameter is initialized, intensity image and polarization characteristic image will be synthesized as bilateral
Two inputs of road PCNNWithAnd according toRespectively obtain overall stimulation；Formula
Middle βIAnd βDTo couple coefficient；N indicates the number of iterations；Subscript I and D are respectively intended to labelled synthesis intensity image and polarization characteristic figure
Picture, subscript j indicate pixel in image；WithIt is total feedback of neighborhood neuron；
(3.2) neural network model parameter is updated, according toWith
Pulse output is generated, whereinWithFor the threshold value at each channel current time；
(3.3) basisIt updates pulse and generates number, and make iteration variable n=n+1,
InWithPulse total degree is generated for last moment；
(3.4) if the number of iterations is less than maximum number of iterations, return step (3.2), otherwise, iteration terminate and switch to walk
Suddenly (3.5)；
(3.5) iteration terminates to obtain each point torch battle arrayWithAnd pass through different channel ignition times maximum values
Mode carries out fusion output:
Preferably, the connection coefficient of binary channels PCNN is the joint part of the image of respective channel in the step (3)
The product of entropy E and contrast σ；Wherein
H (i, j) indicates point
Gray value at (i, j), N*M indicate the size of image.
A kind of light splitting polarization spectrum synchronizing information for realizing the light splitting polarization spectrum synchronizing information processing method
Processing system, including two parts of upper computer and lower computer；The slave computer include filter plate, Amici prism group, polarizing film and
Cmos image sensor, for acquiring the polarization image in three width different polarization directions under the same band；
The host computer includes image storage unit, polarization information processing unit and fusion display unit；
Described image storage unit is handled for storing polarization information in the collected polarization image of slave computer and host computer
Image afterwards；
The polarization information processing unit is rectified for carrying out change in displacement to three width polarization images using phase correlation method
Just, and using Linear Tuning method polarization parameter calculating is carried out, obtains four width polarization parameter images；
The fusion display unit, for being polarized based on PCA method fusion polarization parameter image and degree of polarization image
Characteristic image, and are carried out by fusion and is shown for polarization characteristic image and synthesis intensity image based on binary channels PCNN.
Preferably, the slave computer and host computer are carried out data transmission by USB port.
Preferably, the Amici prism group obtains the three-beam under the same primary optical axis of the same band by beam-splitting structure,
And the polarization image of three different directions is obtained by polarizing film and CMOS respectively.
The utility model has the advantages that compared with prior art, the present invention the advantage is that: present invention setting by upper computer and lower computer
Meter can be with the polarization image in three width different polarization direction of synchronous acquisition, and designs the step of polarization spectrum synchronizing information is handled.
This method design slave computer is compact-sized, simple process, moving target can be imaged, and it is quick to obtain image, line
Property tuning mode to carry out the polarization parameter information content that polarization is calculated maximum, and merged by way of classification so that
Calculation amount reduces and information is more complete.
Detailed description of the invention
In order to make the content of the present invention more clearly understood, below according to specific embodiment and in conjunction with attached drawing,
The present invention is described in further detail, in which:
Fig. 1 is system framework of embodiment of the present invention schematic diagram；
Fig. 2 is present invention method flow diagram；
Fig. 3 is the mathematical model schematic diagram that Linear Tuning of embodiment of the present invention polarization calculates.
Specific embodiment
In conjunction with attached drawing, that the invention will be further described is as follows:
Fig. 1 is system framework of embodiment of the present invention schematic diagram.As shown in Figure 1, a kind of light splitting disclosed by the embodiments of the present invention
Polarization spectrum synchronizing information processing system, mainly includes two parts of upper computer and lower computer, and upper computer and lower computer passes through USB
Mouth is communicated.Slave computer includes filter plate, Amici prism group, polarizing film, cmos image sensor, for acquiring the same band
Under three width different polarization directions polarization picture；Host computer includes image storage unit, polarization information processing unit and fusion
Display unit；Wherein image storage unit is handled for storing polarization information in the collected polarization image of slave computer and host computer
Image afterwards；The algorithm that polarization information processing unit is built-in with change in displacement and polarization calculates, for collected to slave computer
Image is handled；Fusion display is for by polarization information, treated that image carries out fusion shows.
Cmos image sensor is using the black white image sensor for selecting OmniVision company in the system of the present embodiment
For OV2710 as image device, which is 2,000,000, and format optical is 1/2.7 inch, effective resolution 1920H
×1080V；Complicated camera function, including snap technology, the ranks jump acquisition technique of sensor scaling are combined on piece
And the window of area-of-interest intercepts technology, when can be programmed modification dimension of picture, exposure by two universal serial bus
Between, the parameters such as gain；Spectral response range is 450-1050nm, and imaging signal to noise ratio (39dB) and dynamic range are increased to respectively
40dB and 69dB；With 3 μ m, 3 μm of Pixel Dimensions, there can be better responding ability (2.0V/lux-sec)；Full@30fps
Frame rate can continuously capture image, can basically meet the detection demand of moving target.
Amici prism group service band is 425~1050nm, and polarizing film service band is 400~1200nm.Amici prism
Group obtains the three-beam under the same primary optical axis of the same band by beam-splitting structure, and obtains three by polarizing film and CMOS respectively
The polarization image of different directions.
Fig. 2 is that the embodiment of the present invention is divided polarization spectrum message processing flow figure, as shown in Fig. 2, the embodiment of the present invention is public
A kind of light splitting polarization spectrum synchronizing information processing method opened, mainly comprises the steps that
Step 1: acquiring and store three cmos image sensors and meanwhile obtain 0 ° of direction of target, 45 ° of directions and 90 °
The three width polarization images in direction.It specifically includes:
1. establishing host computer by USB to connect with slave computer；
2. host computer can arbitrarily select CMOS in slave computer after confirmation, and send the control word of imaging parameters, including image
Resolution ratio, time for exposure and electron gain；
3. host computer send synchronous acquisition signal make three CMOS while exposing, acquisition 0 ° of direction of target, 45 ° of directions and
The polarization image in 90 ° of directions.
4. three width polarization images are transferred to host computer and stored by slave computer.
Step 2: change in displacement correction is carried out to three width polarization images using phase correlation method, and uses Linear Tuning side
Method carries out polarization parameter calculating, obtains four width polarization parameter images.It specifically includes:
1. carrying out change in displacement correction to three width polarization images based on phase correlation method on host computer, i.e., with width polarization
On the basis of image, change in displacement is carried out to other two width polarization image, the specific steps are as follows:
(1) two images f is selected1(x, y) and f2(x, y), there are translational movement (Δ x, Δ y), with f between them1(x,y)
For reference picture, f2(x, y) is to displacement images, i.e. f2(x, y)=f1(x-Δx,y-Δy)；
(2) to f1(x, y) and f2(x, y) carries out Fourier transform: F respectively2(u, v)=F1(u,v)·exp[-j2π(uΔ
X+v Δ y)] and F1(u,v)；
(3) normalized power is composed:Wherein F2 *(u, v) is F2
The conjugate function of (u, v)；
(4) normalized power is composed and carries out inverse fourier transform: f (x, y)=δ (x- Δ x, y- Δ y)；
(5) peak point calculated in (4) finds out translation parameters (Δ x, Δ y).
2. carrying out polarization calculating based on Linear Tuning mode, 4 width polarization parameter images are obtained.
Fig. 3 is the mathematical model schematic diagram that Linear Tuning of embodiment of the present invention polarization calculates.Linear Tuning as shown in Figure 3 is inclined
Vibration is calculated as linearly calculating, and may be expressed as:
In formula,IθFor the polarised light light intensity on different polarization direction, and meet θ1⊥θ2, this guarantees θ1And θ2It is
It is a pair of Polarization-Sensitive right；Sv,h,d,rIndicate Polarization-Sensitive parameter；WithFor oppositional factor, andWith
cv,h,d,rIθIndicate neighbouring inhibition overall response of the photosensory cell group to the channel, cv,h,d,rFor photosensory cell group neighbouring in the channel
To Polarization-Sensitive pair of inhibiting factor, pass through changeAnd cv,h,d,rAmplitude regulate and control different directions polarised light in channel
Strong effect size.The value of tuner parameters is counted the quality of the polarization parameter directly affected in the following manner
It calculates.Tuning factor is divided into interlayer oppositional factor and the outer inhibiting factor c of layerv,h,d,r, and interlayer oppositional factor is divided into enhancement factor
kJj=1,3,5,7With inhibiting factor kJj=2,4,6,8.Because the effect of each tuning factor in a model is different, setting is taken
It is also different to be worth range.Enable enhancement factor kJj=1,3,5,7Value range be [1,10], step-length 0.04 enables inhibiting factor
kJj=2,4,6,8Value range is [0.1,1], and step-length 0.01 enables inhibiting factor cv,h,d,rValue range is [0.001,0.05],
Step-length is 0.0002, then calculates the comentropy of each channel of polarization, and be compared with the comentropy under previous tuning factor,
If more value stopping when comentropy is maximum value of tuning factor is just updated, tuning factor at this moment is exactly best
Solution.
Polarization parameter is carried out using Linear Tuning method in this step and calculates step are as follows:
1. calculating vertical direction polarization parameter Sv, Sv=k1I90°-k2I0°-cvI45°。
2. calculating horizontal direction polarization parameter Sh, Sh=k3I0°-k4I90°-chI135°。
3. calculating 45 ° of direction polarization parameter Sd, Sd=(k5+k6)*I45°-k6*(I0°+I90°)-cdI90°。
4. calculating 135 ° of direction polarization parameter Sr, Sr=k7*(I0°+I90°)-(k7+k8)*I45°-crI0°。
Based on above-mentioned polarization parameter, degree of polarization image and synthesis intensity image are calculated according to following formula:
Degree of polarization
Synthesize light intensity
Step 3: calculating degree of polarization image and synthesis intensity image on host computer, by four width polarization parameter images, polarization
Degree image and synthesis intensity image carry out fusion and show.Include:
1. obtaining polarization characteristic image based on PCA method fusion polarization parameter image and degree of polarization image.
2. calculating joint local entropyIn formulaH (i, j) table
Show gray value at point (i, j).
3. calculating contrastIn formula,The ruler of N*M expression image
Very little, H (i, j) indicates gray value at point (i, j).
4. joint local entropy is multiplied with contrast, connection factor beta=E* σ is obtained.
5. improving picture contrast, and show based on binary channels PCNN fusion polarization characteristic image and synthesis intensity image.
Primary fusion is wherein carried out to polarization parameter image and degree of polarization image using PCA and obtains polarization characteristic image, is had
Body is as follows:
All elements point in the polarization parameter image and degree of polarization image of four direction is formed into a column vector, by this
A little column vectors line up matrix X, i.e.,
R∈Rn×nIt is the correlation matrix of X, and R=RT, acquire R=E [XXT] characteristic value and feature vector are as follows:
Rqi=λiqi, i=1,2....n
Q in formulaiIt is feature vector, λiIt is characterized value, is sorted to characteristic value, λ1> λ2... > λn, enable characteristic value collection D=
[λ1,λ2......,λn], corresponding set of eigenvectors V=[q1,q2......,qn], then RV=VD.Principal component is sought in linear transformation:It enables
C in formulaiThe vector C of composition is the projection in X principal direction, is principal component, obtains: C=VTX.Since V is orthogonal moment
Battle array, i.e. VT=V-1, therefore
L main component before retaining, i.e.,
X' is polarization characteristic image.
Specific step is as follows for the method merged based on binary channels PCNN:
(1) initialize neural network model in each parameter, including connection coefficient, the number of iterations, initial neuron feedback,
Pulse threshold etc. will synthesize intensity image and polarization characteristic image as two inputs of binary channels PCNNWithAnd according toRespectively obtain overall stimulation；β in formulaIAnd βDTo couple coefficient；N table
Show the number of iterations；Subscript I and D are respectively intended to labelled synthesis intensity image and polarization characteristic image, and subscript j indicates pixel in image
Point；WithIt is total feedback of neighborhood neuron.
(2) parameter for updating neural network model, according toWith
Pulse output is generated, whereinWithFor the threshold value at each channel current time.
(3) basisThe pulse for updating pixel j generates number, and makes iteration variable n=
n+1。
(4) if the number of iterations is less than maximum number of iterations, return step (2), otherwise, iteration terminates and switchs to step
(5)。
(5) iteration terminates to obtain each point torch battle arrayWithAnd pass through the side of different channel ignition times maximum values
Formula carries out fusion output:
Obviously, the above embodiment is merely an example for clearly illustrating the present invention, and is not to of the invention
The restriction of embodiment.For those of ordinary skill in the art, it can also be made on the basis of the above description
Its various forms of variation or variation.There is no necessity and possibility to exhaust all the enbodiments.And these belong to this hair
The obvious changes or variations that bright spirit is extended out still in protection scope of the present invention within.
Claims (9)
1. a kind of light splitting polarization spectrum synchronizing information processing method, characterized by the following steps:
(1) acquire and store the three of 0 ° of direction of target, 45 ° of directions and 90 ° of directions of the acquisition simultaneously of three cmos image sensors
Width polarization image；
(2) change in displacement correction is carried out to three width polarization images using phase correlation method, and is carried out partially using Linear Tuning method
Parameter of shaking calculates, and obtains four width polarization parameter images；
(3) based on PCA method fusion polarization parameter image and degree of polarization image, polarization characteristic image is obtained, and is based on binary channels
PCNN carries out fusion and shows to polarization characteristic image and synthesis intensity image.
2. light splitting polarization spectrum synchronizing information processing method according to claim 1, it is characterised in that: the step (2)
The method that middle polarization parameter calculates are as follows:
Sv=k1I90°-k2I0°-cvI45°
Sh=k3I0°-k4I90°-chI135°
Sd=(k5+k6)*I45°-k6*(I0°+I90°)-cdI90°
Sr=k7*(I0°+I90°)-(k7+k8)*I45°-crI0°
Wherein Sv、Sh、Sd、SrRespectively vertical direction, horizontal direction, 45 ° of directions and 135 ° of directions polarization parameter, k1,
k2……k8For interlayer oppositional factor, meet kJ | j=1,3,5,7The < of > 1 and 0 kJ | j=2,4,6,8<=1, cv、ch、cd、crTo inhibit outside layer
The factor, I indicate polarized light intensity, under be designated as corresponding polarization direction.
3. light splitting polarization spectrum synchronizing information processing method according to claim 2, it is characterised in that: the step (3)
Middle degree of polarization and synthesis light intensity are calculated according to following formula:
Degree of polarization
Synthesize light intensity
4. being divided polarization spectrum synchronizing information processing method according to claim 1, it is characterised in that: in the step (3)
Polarization parameter image and degree of polarization image, the method for obtaining polarization characteristic image are as follows: by four direction are merged based on PCA method
All elements point in polarization parameter image and degree of polarization image forms a column vector, these column vectors are lined up matrix；It protects
Stay the main component of matrix as polarization characteristic image.
5. light splitting polarization spectrum synchronizing information processing method according to claim 1, it is characterised in that: the step (3)
In based on binary channels PCNN fusion polarization characteristic image and synthesize intensity image method include:
(3.1) neural network model parameter is initialized, intensity image and polarization characteristic image will be synthesized as binary channels
Two inputs of PCNNWithAnd according toRespectively obtain overall stimulation；In formula
βIAnd βDTo couple coefficient；N indicates the number of iterations；Subscript I and D are respectively intended to labelled synthesis intensity image and polarization characteristic image,
Subscript j indicates pixel in image；WithIt is total feedback of neighborhood neuron；
(3.2) neural network model parameter is updated, according toWith
Pulse output is generated, whereinWithFor the threshold value at each channel current time；
(3.3) basisIt updates pulse and generates number, and make iteration variable n=n+1, whereinWithPulse total degree is generated for last moment；
(3.4) if the number of iterations is less than maximum number of iterations, return step (3.2), otherwise, iteration terminates and switchs to step
(3.5)；
(3.5) iteration terminates to obtain each point torch battle arrayWithAnd by way of different channel ignition times maximum values
Carry out fusion output:
6. light splitting polarization spectrum synchronizing information processing method according to claim 1, it is characterised in that: the step (3)
The connection coefficient of middle binary channels PCNN is the product of joint the local entropy E and contrast σ of the image of respective channel；Wherein
H (i, j) indicates that gray value at point (i, j), N*M indicate the size of image.
7. a kind of light splitting for realizing light splitting polarization spectrum synchronizing information processing method described in any one of claims 1-6 is inclined
Vibrational spectrum synchronizing information processing system, it is characterised in that: including two parts of upper computer and lower computer；The slave computer includes filter
Wave plate, Amici prism group, polarizing film and cmos image sensor, for acquiring three width different polarization directions under the same band
Polarization image；
The host computer includes image storage unit, polarization information processing unit and fusion display unit；
Described image storage unit, for storing, treated for polarization information in the collected polarization image of slave computer and host computer
Image；
The polarization information processing unit, for carrying out change in displacement correction to three width polarization images using phase correlation method, and
Polarization parameter calculating is carried out using Linear Tuning method, obtains four width polarization parameter images；
The fusion display unit, for obtaining polarization characteristic based on PCA method fusion polarization parameter image and degree of polarization image
Image, and are carried out by fusion and is shown for polarization characteristic image and synthesis intensity image based on binary channels PCNN.
8. light splitting polarization spectrum synchronizing information processing system according to claim 7, it is characterised in that: the slave computer and
Host computer is carried out data transmission by USB port.
9. light splitting polarization spectrum synchronizing information processing system according to claim 7, it is characterised in that: the Amici prism
Group obtains the three-beam under the same primary optical axis of the same band by beam-splitting structure, and obtains three by polarizing film and CMOS respectively
The polarization image of different directions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810677743.0A CN109118460B (en) | 2018-06-27 | 2018-06-27 | Method and system for synchronously processing light-splitting polarization spectrum information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810677743.0A CN109118460B (en) | 2018-06-27 | 2018-06-27 | Method and system for synchronously processing light-splitting polarization spectrum information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109118460A true CN109118460A (en) | 2019-01-01 |
| CN109118460B CN109118460B (en) | 2020-08-11 |
Family
ID=64821986
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810677743.0A Active CN109118460B (en) | 2018-06-27 | 2018-06-27 | Method and system for synchronously processing light-splitting polarization spectrum information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109118460B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117689545A (en) * | 2024-02-02 | 2024-03-12 | 荣耀终端有限公司 | Image processing method, electronic device, and computer-readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030062422A1 (en) * | 2001-09-10 | 2003-04-03 | Fateley William G. | System and method for encoded spatio-spectral information processing |
| CN103900696A (en) * | 2014-03-07 | 2014-07-02 | 河海大学 | Underwater polarization imaging method for simulating vision polarization antagonism sensing of mantis shrimps |
| US20140355861A1 (en) * | 2011-08-25 | 2014-12-04 | Cornell University | Retinal encoder for machine vision |
| CN104978724A (en) * | 2015-04-02 | 2015-10-14 | 中国人民解放军63655部队 | Infrared polarization fusion method based on multi-scale transformation and pulse coupled neural network |
| CN107340546A (en) * | 2017-07-24 | 2017-11-10 | 南京信息工程大学 | A kind of undersea detection divides the double CCD real-time polarizations imaging devices in aperture and method |
| CN107451984A (en) * | 2017-07-27 | 2017-12-08 | 桂林电子科技大学 | A kind of infrared and visual image fusion algorithm based on mixing multiscale analysis |
-
2018
- 2018-06-27 CN CN201810677743.0A patent/CN109118460B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030062422A1 (en) * | 2001-09-10 | 2003-04-03 | Fateley William G. | System and method for encoded spatio-spectral information processing |
| US20140355861A1 (en) * | 2011-08-25 | 2014-12-04 | Cornell University | Retinal encoder for machine vision |
| CN103900696A (en) * | 2014-03-07 | 2014-07-02 | 河海大学 | Underwater polarization imaging method for simulating vision polarization antagonism sensing of mantis shrimps |
| CN104978724A (en) * | 2015-04-02 | 2015-10-14 | 中国人民解放军63655部队 | Infrared polarization fusion method based on multi-scale transformation and pulse coupled neural network |
| CN107340546A (en) * | 2017-07-24 | 2017-11-10 | 南京信息工程大学 | A kind of undersea detection divides the double CCD real-time polarizations imaging devices in aperture and method |
| CN107451984A (en) * | 2017-07-27 | 2017-12-08 | 桂林电子科技大学 | A kind of infrared and visual image fusion algorithm based on mixing multiscale analysis |
Non-Patent Citations (2)
| Title |
|---|
| JIE SHEN ET AL: "Polarization and solar altitude correlation analysis and application in object detection", 《2017 INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC)》 * |
| 郭喆等: "一种红外偏振与光强图像的暗原色多特征分离融合方法", 《科学技术与工程》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117689545A (en) * | 2024-02-02 | 2024-03-12 | 荣耀终端有限公司 | Image processing method, electronic device, and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109118460B (en) | 2020-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Jia et al. | From RGB to spectrum for natural scenes via manifold-based mapping | |
| Fu et al. | Joint camera spectral response selection and hyperspectral image recovery | |
| CN113676628B (en) | Image forming apparatus and image processing method | |
| CN106572340B (en) | Camera system, mobile terminal and image processing method | |
| Zhang | Iterative closest point (ICP) | |
| Vollmer | Infrared thermal imaging | |
| CN109788170A (en) | It is a kind of based on infrared with video image processing system and method for visible light | |
| Ma et al. | Acquisition of high spatial and spectral resolution video with a hybrid camera system | |
| CN108055452A (en) | Image processing method, device and equipment | |
| CN109886883A (en) | Real-time polarization fog-penetrating imaging image enhancement processing method | |
| CN109712177A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN112113661B (en) | Deep learning type snapshot spectrum imaging device and detection method thereof | |
| Tan | Image-based modeling | |
| Cheng et al. | A mutually boosting dual sensor computational camera for high quality dark videography | |
| CN109118460A (en) | A kind of light splitting polarization spectrum synchronizing information processing method and system | |
| Guo et al. | Low-light color imaging via cross-camera synthesis | |
| CN108873366A (en) | Multi-band Polarization light splitting and integrated approach and system | |
| Huang et al. | High-Fidelity Hyperspectral Snapshot of Physical World: System Architecture, Dataset and Model | |
| Liu et al. | Optimal led spectral multiplexing for nir2rgb translation | |
| CN110460783A (en) | Array camera module and its image processing system, image processing method and electronic equipment | |
| Jayasuriya | Image sensors | |
| CN116982071A (en) | Image processing method, processing device, electronic equipment and storage medium | |
| CN114125319A (en) | Image sensor, camera module, image processing method and device and electronic equipment | |
| Sreedhar et al. | Image fusion-the pioneering technique for real-time image processing applications | |
| Zhang et al. | Long Range Imaging Using Multispectral Fusion of RGB and NIR Images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |