CN116309218A - Real-time synthesis method of polarization degree image - Google Patents
Real-time synthesis method of polarization degree image Download PDFInfo
- Publication number
- CN116309218A CN116309218A CN202310193248.3A CN202310193248A CN116309218A CN 116309218 A CN116309218 A CN 116309218A CN 202310193248 A CN202310193248 A CN 202310193248A CN 116309218 A CN116309218 A CN 116309218A
- Authority
- CN
- China
- Prior art keywords
- image
- images
- real
- time
- polarization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010287 polarization Effects 0.000 title claims abstract description 32
- 238000001308 synthesis method Methods 0.000 title claims abstract description 8
- 230000005540 biological transmission Effects 0.000 claims abstract description 18
- 238000000034 method Methods 0.000 claims abstract description 9
- 238000007499 fusion processing Methods 0.000 claims abstract 4
- 230000015572 biosynthetic process Effects 0.000 claims description 9
- 238000003786 synthesis reaction Methods 0.000 claims description 9
- 238000003384 imaging method Methods 0.000 claims description 3
- 230000002194 synthesizing effect Effects 0.000 claims 2
- 230000002159 abnormal effect Effects 0.000 claims 1
- 230000008030 elimination Effects 0.000 claims 1
- 238000003379 elimination reaction Methods 0.000 claims 1
- 238000001514 detection method Methods 0.000 abstract description 7
- 238000004364 calculation method Methods 0.000 abstract description 4
- 230000001133 acceleration Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000003746 surface roughness Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/35—Determination of transform parameters for the alignment of images, i.e. image registration using statistical methods
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Probability & Statistics with Applications (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
Abstract
The invention provides a real-time synthesis method of a polarization degree image. The experimental device comprises a lens (1), a polarization beam splitter (2), a polaroid (3), a CCD sensor (4), an Ethernet interface (5), an Ethernet cable (6), a switch (7) and an upper computer (8). The method comprises the following steps: image acquisition, image transmission and image fusion processing. The method and the device can realize real-time polarization degree video stream fusion processing of the polarization camera by collecting images of all channels passing through different polarizers in real time and performing parallel processing acceleration calculation so as to realize real-time polarization degree image detection.
Description
Field of the art
The invention relates to a real-time synthesis method of polarization degree images, which can carry out video detection and belongs to the technical field of real-time image processing.
(II) background art
The polarization characteristics of light contain a lot of unique information, generally described by two parameters, namely the degree of polarization and the angle of polarization. It is closely related to the properties of the target, such as material, shape characteristics, texture structure, surface roughness, etc. The polarization characteristics of the reflected light of the object are not easily hidden, and thus the object can be effectively detected. The method can be supplemented with the traditional intensity imaging, infrared imaging and other technologies to obtain the information of the target more comprehensively, and the target is easier to detect under the complex background environments such as low signal-to-noise ratio, low illumination and the like. The polarization information of the static image object is basically unchanged at a certain moment, the polarization information of the reflected light of the moving object can be changed due to the factors such as position deviation, shape change, illumination change and the like, the change of the polarization information of the object in an image sequence can be more obvious, and the static image object can be practically applied to scenes such as remote sensing detection, target detection in complex environments and the like.
The invention provides a real-time synthesis method of a polarization degree image based on the background technology. The imaging characteristics of the camera are analyzed, the transmission rate of the image data is adjusted, and the real-time processing result is achieved through the image parallel processing acceleration operation.
(III) summary of the invention
The invention aims to provide a real-time synthesis method of a polarization degree image.
In order to achieve the above purpose, the technical solution adopted by the present invention is as follows:
a real-time synthesis method of polarization degree images comprises an image acquisition stage, an image transmission stage and an image processing stage.
And in the image acquisition stage, setting parameters of each channel of the camera, and keeping the acquisition rate as high as possible with the maximum transmission speed.
Setting Ethernet jumbo frame and even larger frame, reducing transmission frame number as much as possible, reducing transmission time loss
In the image processing stage, the polarization degree image synthesis needs the fusion of a plurality of images, and the image registration is needed, so that the processing speed can be further improved through image pixel parallel calculation.
In order to achieve higher frame rate, the image acquisition rate and the image data transmission rate in the camera are high, and the data transmission rate is consistent with the receiving rate of the upper computer, so that reading errors are avoided. The multi-channel image pixel computation speed is increased to maintain a higher frame number.
Because of the structural features of the cameras, there is a field of view offset between the images of the channels, and image registration is required.
(IV) description of the drawings
FIG. 1 is a schematic view of the apparatus of the present invention. The device comprises a lens (1), a polarization beam splitter (2), a polaroid (3), a CCD sensor (4), an Ethernet interface (5), an Ethernet cable (6), a switch (7) and an upper computer (8).
FIG. 2 is a flow chart of an algorithm implementation of the present invention.
FIG. 3 (a) is a 48 th frame of a group of image sequences actually taken in the embodiment
FIG. 3 (b) is a 49 th frame of a group of image sequences actually taken in the embodiment
FIG. 3 (c) is a 50 th frame of a group of image sequences actually taken in the embodiment
FIG. 3 (d) is a 51 st frame of a group of image sequences actually taken in the embodiment
(fifth) detailed description of the invention
The technical scheme of the invention is further described below with reference to specific examples:
this embodiment:
FIG. 1 is a schematic diagram of the apparatus during the experiment. The lens (1) is an objective lens of a camera, and can be provided with a device such as a filter and the like in front to shoot images in a certain wave band. The incident light passes through the polarizing beam splitter (2) and can be equally divided into 3 parts, and a polarizing plate (3) is arranged in front of each CCD (4). The polarization state of an object may be represented by a stokes vector. The light wave detection is to obtain the transmitted light intensity by devices such as a polarizing element, and the light intensity is the coherent superposition of the detected light with the x and y direction components. It can be seen that the transmitted light intensity formula (1-1) with the light intensity at an angle alpha to the x-axis
I is an intensity map obtained by polarization detection, wherein S 0 、S 1 、S 2 Equation I, Q, U for Stokes vector if alpha is given as the known quantity I, Q, U as the unknown quantity, the corresponding can be derived by measuring a minimum of three sets of anglesStokes component. The common directions are 0 degree, 45 degrees and 90 degrees, so that the formula (1-2) can be obtained
Then the detected image of each channel is transmitted in real time through the Ethernet interface (5), the three channels are connected with the switch (7) through the three Ethernet wires (6) for transmission, and the fourth interface of the switch (7) is connected with the upper computer (8) for acquiring the image in real time. Three channel images are acquired each time, and then the next acquisition is performed.
The field of view offset between camera channels is relatively fixed. If the parameters belong to fixed errors, the corresponding parameters are stored once in image registration, and the experiment is to store homography matrix parameters of 0 degree conversion to 45 degrees and 90 degrees to 45 degrees by taking 45-degree images as references. The specific image registration algorithm adopts SURF characteristic point detection, eliminates mismatched points through a RANSAC algorithm, calculates a homography matrix of the image, and synthesizes using parameters in the follow-up process.
Polarization degree synthesis formula (1-2)
Wherein I is 0 I is an intensity graph with an included angle of 0 degrees with the x-axis 45 I for an intensity pattern at 45 degrees to the x-axis 90 An included angle with the x-axis is a 90 degree intensity plot.
The polarization diagram synthesis can be performed through three images of 0 degree, 45 degrees and 90 degrees, and when the polarization degree synthesis is performed, as each pixel point synthesis of the image is not connected with other pixel points, the polarization degree synthesis result can be calculated through parallel calculation, so that the calculation speed is improved.
Claims (3)
1. A real-time synthesis method of polarization degree images. The method comprises the steps of image acquisition, image transmission and image fusion processing, and comprises the following specific implementation methods:
(1) Image acquisition: the polarized camera adopts an amplitude-division polarized imaging system. The principle is that the incident wide light can be divided into three parts with the same wave band, the same position and the same polarization by the polarization beam splitter, and is received by three CCD sensors. The parameters of exposure parameters, dark current and the like of each channel are respectively set, and the acquisition rate as high as possible with the maximum transmission speed is kept.
(2) Image transmission stage: the time for frequently encapsulating and analyzing the frame exceeds the time for encapsulating and analyzing the frame once, the sizes of Ethernet frames of the Ethernet switch and the computer are set, and the Ethernet frames are kept to be huge frames or larger, so that the transmission frame number is reduced as much as possible, and the time loss of transmission is reduced. The camera has 3 transmission channels. In the transmission process, 3 polarized images are obtained by collecting images of 3 different channels as one cycle.
(3) Image fusion processing stage: the transmitted picture images are registered first. The polarization degree synthesis formula requires the use of individual channel images. When the synthesis processing is carried out, the synthesis of each pixel point of the same image has no relation with other pixel points, so that the operation can be accelerated through image parallel processing, and then the operations such as abnormal point elimination, noise reduction and the like can be carried out to obtain a real-time processing result.
2. The method for synthesizing polarization degree images in real time according to claim 1. The method is characterized in that the image acquisition speed and the image data transmission speed are high, and the data transmission speed is consistent with the receiving speed of the upper computer, so that the reading error is avoided. The multi-channel image pixel computation speed is increased to maintain a higher frame number.
3. The method for synthesizing polarization degree images in real time according to claim 1, wherein images of all channels of the camera have field of view deviation and image registration is required.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310193248.3A CN116309218A (en) | 2023-03-02 | 2023-03-02 | Real-time synthesis method of polarization degree image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310193248.3A CN116309218A (en) | 2023-03-02 | 2023-03-02 | Real-time synthesis method of polarization degree image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116309218A true CN116309218A (en) | 2023-06-23 |
Family
ID=86782806
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310193248.3A Pending CN116309218A (en) | 2023-03-02 | 2023-03-02 | Real-time synthesis method of polarization degree image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116309218A (en) |
-
2023
- 2023-03-02 CN CN202310193248.3A patent/CN116309218A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8139823B2 (en) | Method for capturing images comprising a measurement of local motions | |
| WO2016101892A1 (en) | Computational multi-camera adjustment for smooth view switching and zooming | |
| CN110248048B (en) | Video jitter detection method and device | |
| EP2047426B1 (en) | Method for signal conditioning | |
| KR101524548B1 (en) | Apparatus and method for alignment of images | |
| WO2016095192A1 (en) | Optical-flow imaging system and method using ultrasonic depth sensing | |
| JP5472506B2 (en) | Tracking imaging system and imaging control method for a plurality of moving objects | |
| CN101742123A (en) | Image processing apparatus and method | |
| CN111696044B (en) | Large-scene dynamic visual observation method and device | |
| CN110766706A (en) | Image fusion method and device, terminal equipment and storage medium | |
| JP6087947B2 (en) | Method for 3D reconstruction of scenes that rely on asynchronous sensors | |
| CN108548603A (en) | Non-coaxial four-channel polarization imaging method and system | |
| CN112700502A (en) | Binocular camera system and binocular camera space calibration method | |
| CN114286024B (en) | Optical polarization information model construction method and device based on dynamic vision sensor | |
| CN102564924B (en) | Automatic scanning method of single-frame image of blood cell | |
| JP2002286433A (en) | Real-time shape measurement method and system of continuous traveling object | |
| CN111696143A (en) | Event data registration method and system | |
| CN116309218A (en) | Real-time synthesis method of polarization degree image | |
| CN105530419B (en) | Image acquisition system, image acquisition processing system and image acquisition processing method | |
| CN112396639A (en) | Image alignment method | |
| CN115984124A (en) | Method and device for de-noising and super-resolution of neuromorphic pulse signals | |
| CN112396633B (en) | Target tracking and track three-dimensional reproduction method and device based on single camera | |
| CN105628622A (en) | Polarization imaging system based on three cameras | |
| US11270412B2 (en) | Image signal processor, method, and system for environmental mapping | |
| CN112217978A (en) | Three-channel polarized image acquisition method and device based on bionic compound eye |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |