CN111537072A - Polarization information measuring system and method of array type polarization camera - Google Patents
Polarization information measuring system and method of array type polarization camera Download PDFInfo
- Publication number
- CN111537072A CN111537072A CN202010322634.4A CN202010322634A CN111537072A CN 111537072 A CN111537072 A CN 111537072A CN 202010322634 A CN202010322634 A CN 202010322634A CN 111537072 A CN111537072 A CN 111537072A
- Authority
- CN
- China
- Prior art keywords
- polarization
- array type
- camera
- type polarization
- polarization camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000010287 polarization Effects 0.000 title claims abstract description 265
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000003384 imaging method Methods 0.000 claims abstract description 36
- 230000004044 response Effects 0.000 claims abstract description 28
- 238000005316 response function Methods 0.000 claims abstract description 21
- 238000004364 calculation method Methods 0.000 claims abstract description 9
- 230000006870 function Effects 0.000 claims description 19
- 150000001875 compounds Chemical class 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 14
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000005259 measurement Methods 0.000 abstract description 10
- 230000008859 change Effects 0.000 abstract description 9
- 238000005286 illumination Methods 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 230000003595 spectral effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241000239223 Arachnida Species 0.000 description 1
- 241000238366 Cephalopoda Species 0.000 description 1
- 241000238631 Hexapoda Species 0.000 description 1
- 241000282412 Homo Species 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 241000251539 Vertebrata <Metazoa> Species 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000002310 reflectometry Methods 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J4/00—Measuring polarisation of light
Abstract
The application relates to a polarization information measuring system and method of an array type polarization camera, wherein the method comprises the following steps: establishing imaging models with corresponding quantity according to the quantity of the polarization channels of the array type polarization cameras; calibrating the response function of the array type polarization camera to obtain a response curve of the array type polarization camera; obtaining an HDR image of each polarization channel of the array type polarization camera by adopting a multi-exposure mode; high dynamic range polarization information is calculated from the response curve and the HDR image for each polarization channel. The method solves the problems that the traditional polarization camera is inaccurate in polarization information calculation or even incapable of calculating under the conditions of overexposure and underexposure in a real scene, improves the adaptability of the polarization camera to illumination change conditions, and has the advantages of simple principle, simplicity and convenience in operation, wide application range and the like; meanwhile, high-quality polarization measurement information is obtained, the dynamic range of measurement of the array type polarization camera is effectively improved, and the method has important significance for improving the applicability of the array type polarization camera.
Description
Technical Field
The invention relates to the technical field of polarization information measurement systems and methods, in particular to a polarization information measurement system and method of an array type polarization camera.
Background
Polarization is one of the fundamental properties of electromagnetic waves, and polarized light is an important property possessed by light waves. Most vertebrates (including humans) cannot perceive this light modality; in contrast, many invertebrates, including insects, arachnids, cephalopods, and stomata, have evolved to be able to detect light-sensitive cells with high dynamic range polarization information and to use this information in visually guided behavior. As with many animals, human vision is capable of visual perception over a wide range of brightness, allowing our eyes to function properly under disparate high contrast lighting conditions. However, digital cameras rely primarily on imaging sensors with 8-bit brightness, much narrower than the human visual range. For a long time, techniques have been sought to increase the dynamic range of images taken by cameras to better interpret and understand the scene.
The rapid development of imaging technology has brought us with new arrayed polarization sensors, such as deflection cameras, so that we can conveniently detect polarized light. Such cameras are widely used in 3D reconstruction, object detection, robotics. However, the conventional method cannot restore visual information in a High Dynamic Range (HDR) scene, so that the visibility of an image in a dark or bright area is greatly reduced. The polarization information calculation is inaccurate due to overexposure or underexposure in scenes with large-range illumination changes, for example, a shiny metal object reflects illumination light in a mirror surface mode, so that a camera is saturated and does not carry any information, and the application of the camera is influenced.
Therefore, it is necessary to design a new polarization information measuring system and method for the array type polarization camera.
Disclosure of Invention
The invention provides a polarization information measuring system and method of an array type polarization camera aiming at the problem of inaccurate polarization information calculation caused by overexposure or underexposure of the array type polarization camera in a real scene, improves the adaptability of the polarization camera to illumination change, and has the advantages of simple principle, simple and convenient operation, wide application range and the like.
In order to solve the technical problems, the invention is realized by the following technical scheme: a polarization information measuring method of an array type polarization camera, the method comprising the steps of:
s1, obtaining the number of polarization channels of the array type polarization cameras, and establishing imaging models with corresponding number according to the number of the polarization channels of the array type polarization cameras;
s2, calibrating the response function of the array type polarization camera according to the imaging model to obtain a response curve of the array type polarization camera;
s3, obtaining HDR images of each polarization channel of the array type polarization camera in a multi-exposure mode;
s4, polarization information of high dynamic range is calculated according to the response curve and the HDR image of each polarization channel.
Further, the array-type polarization camera comprises polarization channels which are uniformly distributed in four directions of 0 °, 45 °, 90 ° and 135 °, and imaging models of the four polarization channels are respectively:
in the formula (I), the compound is shown in the specification,
in order to obtain the image data that is finally obtained,
is the intensity of the incident light after it passes through the lens,
is the intensity of the incident light after passing through the polarizer,
、
、
、
for the role of the polarizer in each polarization channel,
in order to be a degree of polarization DOP,
is the angle of polarization of the light beam,
in order to be a function of the response of the camera,
is the time of exposure.
Further, the light intensity in the real scene is sequentially sensed by a lens, a polaroid and a shutter of the array type polarization camera through a chip of a CCD or a CMOS and converted into final image data through mode-electricity conversion.
Further, calibrating the array type polarization camera in a multi-exposure mode to obtain an anti-response function of the array type polarization camera
Optimizing a function
Comprises the following steps:
in the formula (I), the compound is shown in the specification,
is an anti-response function and
，
is a function of a polarizing plate and
there are four different types of polarizer plates,
is as follows
The sub-exposure is carried out for the first time,
as a result of the total number of exposures,
is in position of
The number of pixels of (a) is,
for the total number of sampled pixel points,
is as follows
The lower position of the sub-exposure time is
The pixel value of (c).
Further, the imaging principle of the polarization camera can be used as follows:
taking logarithm of two sides to obtain:
order to
Then, there are:
is provided with
Then, there are:
in the formula (I), the compound is shown in the specification,
to the regularization term to prevent over-fitting,
by optimising a function
To solve for
Further obtain the anti-response function of the camera
。
Further, the imaging principle of the polarization camera can be used as follows:
HDR images for each polarization channel are obtained through multiple exposures and are constructed to be used for each polarization channel
At each pixel position
Irradiation value of
：
In the formula (I), the compound is shown in the specification,
is as follows
Polarization channel under sub-exposure
The value of the pixel at the time of the next,
is a position of a pixel, and is,
is as follows
The setting of the exposure time of the next time,
for the weighting function for eliminating singular values, a gaussian function is used as the weighting function:
further, in step S4, the stokes amount of the polarization information may be calculated from the HDR image of each polarization channel:
the polarization angle AoP and the degree of polarization DoP are calculated on the basis of the calculated stokes quantities:
in the formula (I), the compound is shown in the specification,
、
、
are stokes vector parameters.
The present invention also provides a polarization information measuring system of an array type polarization camera, the system comprising:
the model establishing module is used for acquiring the number of the polarization channels of the array type polarization cameras and establishing imaging models with corresponding number according to the number of the polarization channels of the array type polarization cameras;
the calibration module is used for calibrating the response function of the array type polarization camera according to the parameter guidance of the imaging model to obtain a response curve of the array type polarization camera;
the image acquisition module is used for acquiring HDR images of each polarization channel of the array type polarization camera in a multi-exposure mode;
and the calculation module is used for calculating the polarization information with high dynamic range according to the response curve and the HDR image of each polarization channel.
The invention also provides a computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
s1, obtaining the number of polarization channels of the array type polarization cameras, and establishing imaging models with corresponding number according to the number of the polarization channels of the array type polarization cameras;
s2, calibrating the response function of the array type polarization camera according to the parameter guidance of the imaging model to obtain the response curve of the array type polarization camera;
s3, obtaining HDR images of each polarization channel of the array type polarization camera in a multi-exposure mode;
s4, polarization information of high dynamic range is calculated according to the response curve and the HDR image of each polarization channel.
The present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:
s1, obtaining the number of polarization channels of the array type polarization cameras, and establishing imaging models with corresponding number according to the number of the polarization channels of the array type polarization cameras;
s2, calibrating the response function of the array type polarization camera according to the parameter guidance of the imaging model to obtain the response curve of the array type polarization camera;
s3, obtaining HDR images of each polarization channel of the array type polarization camera in a multi-exposure mode;
s4, polarization information of high dynamic range is calculated according to the response curve and the HDR image of each polarization channel.
Compared with the prior art, the invention has the advantages that:
the polarization information measuring system and method of the array type polarization camera, the computer device and the readable storage medium provided by the invention establish an imaging model according to the number of polarization channels of the array type polarization camera, calibrate the response function of the array type polarization camera, construct HDR images of all polarization channels through multiple exposure, and then calculate polarization information on the basis of a response curve and the HDR images; the method solves the problems that the traditional polarization camera is inaccurate in polarization information calculation or even incapable of calculating under the conditions of overexposure and underexposure in a real scene, improves the adaptability of the polarization camera to illumination change conditions, and has the advantages of simple principle, simplicity and convenience in operation, wide application range and the like; the array polarization camera system has the advantages that the practicability of the array polarization camera is greatly improved, the high-quality polarization measurement information is obtained while the influence of illumination change is overcome, the dynamic range of measurement of the array polarization camera can be effectively improved, and the array polarization camera system has important significance in further improving the applicability of the array polarization camera.
Drawings
FIG. 1 is a diagram illustrating an exemplary application scenario of a method for measuring polarization information of an array-type polarization camera;
FIG. 2 is a block diagram of a polarization information measurement system of an array type polarization camera according to an embodiment;
FIG. 3 is a flow diagram of a method for measuring polarization information of an array polarization camera in one embodiment;
FIG. 4 is a schematic diagram of a method for measuring polarization information of an arrayed polarization camera in one embodiment;
FIG. 5 is a flowchart illustrating the imaging modeling of the array-type polarization camera in one embodiment;
FIG. 6 is a calculated polarization degree and polarization angle image of an under-exposed image;
FIG. 7 is a calculated polarization degree and polarization angle image of an overexposed image;
FIG. 8 is a polarization degree and angle image obtained using the method of the present invention;
FIG. 9 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The polarization information measuring system and method of the array type polarization camera provided by the application can be applied to the application environment shown in fig. 1. Wherein, the terminal 102 communicates with the server 104 through a network; the terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the server 104 may be implemented by an independent server or a server cluster formed by a plurality of servers.
In an embodiment, as shown in fig. 2, a polarization information measuring system of an array-type polarization camera is provided, which can be disposed in an application environment as shown in fig. 1, and the embodiment is based on a module concept, and includes a model building module 1, a calibration module 2, an image capturing module 3, and a calculating module 4; wherein the content of the first and second substances,
the model establishing module 1 is used for acquiring the number of polarization channels of the array type polarization cameras and establishing imaging models with corresponding number according to the number of the polarization channels of the array type polarization cameras;
the calibration module 2 is used for calibrating the response function of the array type polarization camera according to the parameter guidance of the imaging model to obtain a response curve of the array type polarization camera;
the image capturing module 3 is configured to obtain an HDR image of each polarization channel of the array type polarization camera by using a multiple exposure method; HDR refers to high dynamic range imaging, and is used to achieve a larger exposure dynamic range than the common digital image technology, so as to correctly represent the range brightness from sunlight to the darkest shadows in the real scene.
The calculation module 4 is configured to calculate polarization information with a high dynamic range from the response curve and the HDR image of each polarization channel. And writing a software program by using the stokes vector principle and a formula to process the received measurement information every time so as to obtain the polarization information of the position.
In one embodiment, as shown in fig. 5, the array type polarization camera at least comprises a lens 11, a polarizer 12, a shutter 13, a mirror and a CCD/CMOS14, wherein the lens 11 is a telephoto lens; the polaroid 12 is a neutral density polaroid, the spectral sensitivity range of the polaroid is 400 nm-700 nm, the polaroid has high polarization sensitivity to incident beams, and when the polaroid 12 rotates, light rays are changed; the response time of the shutter 13 is 1-3 microseconds; the chip sensing time of the CCD/CMOS14 is 1-2 microseconds, and an incident light beam is required to be vertically incident into the CCD/CMOS 14; the reflector is used for reflecting light beams, changes a light path and has high reflectivity for incident light beams; the light source for the incident beam may be a laser, and is more preferably a He — Ne gas laser light source.
The specific use process of the embodiment is as follows:
acquiring the number of polarization channels of an array type polarization camera, and establishing imaging models with corresponding number according to the number of the polarization channels of the array type polarization camera; calibrating the response function of the array type polarization camera according to the parameter guidance of the imaging model to obtain a response curve of the array type polarization camera; obtaining an HDR image of each polarization channel of the array type polarization camera by adopting a multi-exposure mode; high dynamic range polarization information is calculated from the response curve and the HDR image for each polarization channel. The method and the device solve the problems that the traditional polarization camera is inaccurate in polarization information calculation or even incapable of calculating under the conditions of overexposure and underexposure in a real scene, improve the adaptability of the polarization camera to illumination change conditions, and have the advantages of simple principle, simplicity and convenience in operation, wide application range and the like; the practicability of the array type polarization camera is greatly improved.
In one embodiment, as shown in fig. 3 to 4, a polarization information measuring method of an array type polarization camera is provided, which may be executed in the server shown in fig. 1, and specifically includes the following steps:
acquiring the number of polarization channels of an array type polarization camera, and establishing a corresponding number of imaging models based on a traditional camera imaging principle according to the number of the polarization channels of the array type polarization camera;
in one embodiment, the array-type polarization camera includes polarization channels in four directions of 0 °, 45 °, 90 °, and 135 ° which are uniformly distributed, the working band is 500-800 nm, and imaging models of the four polarization channels are respectively:
wherein
In order to obtain the image data that is finally obtained,
which is the intensity of the incident light after passing through the lens 11,
the intensity of the incident light after passing through the polarizing plate 12 is not more than the exposure value intensity of the CCD or CMOS,
、
、
、
for the role of the polarizer 12 in each polarization channel,
in order to be a degree of polarization DOP,
is the angle of polarization of the light beam,
in order to be a function of the response of the camera,
is the time of exposure. The incident beam is vector polarized light and has an arbitrary direction.
In another embodiment, the array type polarization camera comprises polarization channels which are uniformly distributed in three directions of 0 degree, 60 degrees and 120 degrees, and the working waveband is 600-750 nm; the light is transmitted to change the spectral range and the test direction, so that the polarization information of different azimuth angles, elevation angles and different spectral ranges can be obtained.
As shown in fig. 5, the light intensity in the real scene is sensed by the chip of the CCD/CMOS14 through the lens 11, the polarizer 12, and the shutter 13 of the array type polarization camera in order and is converted into final image data through the analog-to-digital conversion 15. In the first stage of image acquisition, exposure
Defined as the intensity of the incident light after passing through the polarizer 12 and the time of exposure
Is thus in units of
From this, it is assumed that the intensity of incident light after passing through the polarizing plate 12
Halving, exposure time
Doubling does not change the light intensity of the final exposure.
And step two, calibrating the response function of the array type polarization camera according to the parameter guidance of the imaging model to obtain the response curve of the array type polarization camera.
In one embodiment, the array type polarization camera can be calibrated only through a mode of multiple exposure without other tools to obtain the anti-response function of the array type polarization camera
Optimizing a function
Comprises the following steps:
in the formula (I), the compound is shown in the specification,
in order to optimize the function, the function is optimized,
is an anti-response function and
，
in order to be a function of the response of the camera,
is the intensity of the incident light after it passes through the lens,
is a function of a polarizing plate and
there are four different types of polarizer plates,
is as follows
The sub-exposure is carried out for the first time,
as a result of the total number of exposures,
is in position of
The number of pixels of (a) is,
for the total number of sampled pixel points,
is as follows
The lower position of the sub-exposure time is
The value of the pixel of (a) is,
is the time of exposure.
More specifically, the imaging principle by a polarization camera yields:
taking logarithm of two sides to obtain:
order to
Then, there are:
is provided with
Then, there are:
in the formula (I), the compound is shown in the specification,
to the regularization term to prevent over-fitting,
by optimising a function
To solve for
Further obtain the anti-response function of the camera
. The problem is a least square problem and can be solved by an optimization method which is a decomposition method of SVD (singular value).
Thirdly, obtaining an HDR image of each polarization channel of the array type polarization camera in a multi-exposure mode;
in one embodiment, the imaging principle by the polarization camera yields:
in practical application, HDR images of each polarization channel are obtained through multiple exposures and are constructed to correspond to each polarization channel
At each pixel position
Irradiation value of
：
In the formula (I), the compound is shown in the specification,
is as follows
Polarization channel under sub-exposure
The value of the pixel at the time of the next,
is a position of a pixel, and is,
is as follows
The setting of the exposure time of the next time,
as a result of the total number of exposures,
the method is a weight function for eliminating singular values, is used for eliminating the influence caused by overexposed and underexposed values, and enables the final result to be more robust. Here, a gaussian function is chosen as the weighting function:
wherein the content of the first and second substances,
the value is 0.2.
Step four, calculating polarization information with high dynamic range according to the response curve and the HDR image of each polarization channel;
in one embodiment, the stokes amount of the polarization information can be calculated from the HDR image of each polarization channel:
the polarization angle AoP and the degree of polarization DoP are calculated on the basis of the calculated stokes quantities:
in the formula (I), the compound is shown in the specification,
、
、
are stokes vector parameters.
If the digital image is overexposed or underexposed, the polarization result will be wrong, and the polarization degree and polarization angle image obtained by calculating the underexposed image is shown in FIG. 6; FIG. 7 shows a polarization degree and a polarization angle image calculated from an overexposed image; fig. 8 shows polarization degree and polarization angle images obtained by the method of the present invention. It has been demonstrated that using the method of the present invention, high quality polarization information can be created by fusing images through multiple exposures.
The principle of the polarization information measuring method of the array type polarization camera provided by the invention is simply that: firstly, establishing an imaging model of an array type polarization camera based on the imaging process of a traditional camera; then calibrating the response function of the array type polarization camera to obtain a response curve of the camera; obtaining an HDR image of each polarization channel through multiple exposure; polarization information is calculated based on the response curve and the HDR image for each polarization channel. The method can solve the problem that the polarization information calculation of the polarization camera is inaccurate due to overexposure or underexposure in a real scene, improves the adaptability of the polarization camera to illumination change conditions, and has the advantages of simple principle, simple and convenient operation, wide application range and the like; the array polarization camera system has the advantages that the practicability of the array polarization camera is greatly improved, the high-quality polarization measurement information is obtained while the influence of illumination change is overcome, the dynamic range of measurement of the array polarization camera can be effectively improved, and the array polarization camera system has important significance in further improving the applicability of the array polarization camera.
In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 9. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used to store base model component data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a polarization information measuring method of an array type polarization camera.
Those skilled in the art will appreciate that the architecture shown in fig. 9 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In an embodiment, a computer device is provided, comprising a memory storing a computer program and a processor implementing the steps of the method in the above embodiments when the processor executes the computer program.
In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of the method in the above-mentioned embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A polarization information measuring method of an array type polarization camera, the method comprising the steps of:
s1, obtaining the number of polarization channels of the array type polarization cameras, and establishing imaging models with corresponding number according to the number of the polarization channels of the array type polarization cameras;
s2, calibrating the response function of the array type polarization camera according to the imaging model to obtain a response curve of the array type polarization camera;
s3, obtaining HDR images of each polarization channel of the array type polarization camera in a multi-exposure mode;
s4, calculating polarization information of high dynamic range according to the response curve and the HDR image of each polarization channel.
2. The method for measuring polarization information of an array-type polarization camera according to claim 1, wherein in step S1, the array-type polarization camera comprises polarization channels in four directions of 0 °, 45 °, 90 °, 135 ° that are uniformly distributed, and imaging models of the four polarization channels are:
in the formula (I), the compound is shown in the specification,
in order to obtain the image data that is finally obtained,
is the intensity of the incident light after it passes through the lens,
is the intensity of the incident light after passing through the polarizer,
、
、
、
for the role of the polarizer in each polarization channel,
in order to be a degree of polarization DOP,
is the angle of polarization of the light beam,
in order to be a function of the response of the camera,
is the time of exposure.
3. The polarization information measuring method of the array type polarization camera according to claim 2, wherein the step S1 further comprises:
the light intensity in the real scene is sequentially sensed by a lens, a polaroid and a shutter of the array type polarization camera through a CCD or CMOS chip and is converted into final image data through mode-electricity conversion.
4. The method as claimed in claim 1, wherein in step S2, the array polarization camera is calibrated by multiple exposures to obtain the anti-response function of the array polarization camera
Optimizing a function
Comprises the following steps:
in the formula (I), the compound is shown in the specification,
is an anti-response function and
，
is a function of a polarizing plate and
there are four different types of polarizer plates,
is as follows
The sub-exposure is carried out for the first time,
as a result of the total number of exposures,
is in position of
The number of pixels of (a) is,
for the total number of sampled pixel points,
is as follows
The lower position of the sub-exposure time is
The pixel value of (c).
5. The polarization information measuring method of the array type polarization camera according to claim 4, wherein the step S2 further comprises:
the imaging principle by a polarization camera can be derived:
taking logarithm of two sides to obtain:
order to
Then, there are:
is provided with
Then, there are:
in the formula (I), the compound is shown in the specification,
to the regularization term to prevent over-fitting,
by optimising a function
To solve for
Further obtain the anti-response function of the camera
。
6. The polarization information measuring method of the array type polarization camera according to claim 1, wherein the step S3 further comprises:
the imaging principle by a polarization camera can be derived:
HDR images for each polarization channel are obtained through multiple exposures and are constructed to be used for each polarization channel
At each pixel position
Irradiation value of
：
In the formula (I), the compound is shown in the specification,
is as follows
Polarization channel under sub-exposure
The value of the pixel at the time of the next,
is a position of a pixel, and is,
is as follows
The setting of the exposure time of the next time,
for the weighting function for eliminating singular values, a gaussian function is used as the weighting function:
7. the method for measuring polarization information of an array type polarization camera according to claim 1, wherein in step S4, the stokes amount of the polarization information can be calculated from the HDR image of each polarization channel:
the polarization angle AoP and the degree of polarization DoP are calculated on the basis of the calculated stokes quantities:
in the formula (I), the compound is shown in the specification,
、
、
are stokes vector parameters.
8. A polarization information measuring system of an array type polarization camera, the system comprising:
the model establishing module is used for acquiring the number of the polarization channels of the array type polarization cameras and establishing imaging models with corresponding number according to the number of the polarization channels of the array type polarization cameras;
the calibration module is used for calibrating the response function of the array type polarization camera according to the parameter guidance of the imaging model to obtain a response curve of the array type polarization camera;
the image acquisition module is used for acquiring HDR images of each polarization channel of the array type polarization camera in a multi-exposure mode;
a calculation module to calculate high dynamic range polarization information from the response curve and the HDR image for each of the polarization channels.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010322634.4A CN111537072B (en) | 2020-04-22 | 2020-04-22 | Polarization information measuring system and method of array type polarization camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010322634.4A CN111537072B (en) | 2020-04-22 | 2020-04-22 | Polarization information measuring system and method of array type polarization camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111537072A true CN111537072A (en) | 2020-08-14 |
| CN111537072B CN111537072B (en) | 2022-11-11 |
Family
ID=71975276
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010322634.4A Active CN111537072B (en) | 2020-04-22 | 2020-04-22 | Polarization information measuring system and method of array type polarization camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111537072B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113537071A (en) * | 2021-07-19 | 2021-10-22 | 深圳龙岗智能视听研究院 | Static and dynamic target detection method and device based on event camera |
| CN113834570A (en) * | 2021-11-25 | 2021-12-24 | 北京航空航天大学 | Underwater polarization sensor multi-parameter optimization calibration method considering dark current |
| CN114766003A (en) * | 2019-10-07 | 2022-07-19 | 波士顿偏振测定公司 | Systems and methods for utilizing polarization-enhanced sensor systems and imaging systems |
| CN116295316A (en) * | 2023-05-26 | 2023-06-23 | 中国人民解放军国防科技大学 | Bionic polarized light compass self-adaptive exposure method for unmanned platform navigation |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011133361A (en) * | 2009-12-24 | 2011-07-07 | Fujifilm Corp | Polarization state acquiring device, polarization state acquisition method, and program |
| US20110176029A1 (en) * | 2010-01-15 | 2011-07-21 | Kenneth Wayne Boydston | Multispectral and Colorimetric Imaging System |
| CN103472592A (en) * | 2013-09-18 | 2013-12-25 | 北京航空航天大学 | Snapping type high-flux polarization imaging method and polarization imager |
| WO2019123795A1 (en) * | 2017-12-21 | 2019-06-27 | ソニー株式会社 | Image processing device, image processing method, and program |
-
2020
- 2020-04-22 CN CN202010322634.4A patent/CN111537072B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011133361A (en) * | 2009-12-24 | 2011-07-07 | Fujifilm Corp | Polarization state acquiring device, polarization state acquisition method, and program |
| US20110176029A1 (en) * | 2010-01-15 | 2011-07-21 | Kenneth Wayne Boydston | Multispectral and Colorimetric Imaging System |
| CN103472592A (en) * | 2013-09-18 | 2013-12-25 | 北京航空航天大学 | Snapping type high-flux polarization imaging method and polarization imager |
| WO2019123795A1 (en) * | 2017-12-21 | 2019-06-27 | ソニー株式会社 | Image processing device, image processing method, and program |
| CN111480057A (en) * | 2017-12-21 | 2020-07-31 | 索尼公司 | Image processing apparatus, image processing method, and program |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114766003A (en) * | 2019-10-07 | 2022-07-19 | 波士顿偏振测定公司 | Systems and methods for utilizing polarization-enhanced sensor systems and imaging systems |
| US11525906B2 (en) | 2019-10-07 | 2022-12-13 | Intrinsic Innovation Llc | Systems and methods for augmentation of sensor systems and imaging systems with polarization |
| CN114766003B (en) * | 2019-10-07 | 2024-03-26 | 波士顿偏振测定公司 | Systems and methods for enhancing sensor systems and imaging systems with polarization |
| CN113537071A (en) * | 2021-07-19 | 2021-10-22 | 深圳龙岗智能视听研究院 | Static and dynamic target detection method and device based on event camera |
| CN113537071B (en) * | 2021-07-19 | 2023-08-11 | 深圳龙岗智能视听研究院 | Static and dynamic target detection method and equipment based on event camera |
| CN113834570A (en) * | 2021-11-25 | 2021-12-24 | 北京航空航天大学 | Underwater polarization sensor multi-parameter optimization calibration method considering dark current |
| CN113834570B (en) * | 2021-11-25 | 2022-03-08 | 北京航空航天大学 | Underwater polarization sensor multi-parameter optimization calibration method considering dark current |
| CN116295316A (en) * | 2023-05-26 | 2023-06-23 | 中国人民解放军国防科技大学 | Bionic polarized light compass self-adaptive exposure method for unmanned platform navigation |
| CN116295316B (en) * | 2023-05-26 | 2023-08-29 | 中国人民解放军国防科技大学 | Bionic polarized light compass self-adaptive exposure method for unmanned platform navigation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111537072B (en) | 2022-11-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111537072B (en) | Polarization information measuring system and method of array type polarization camera | |
| CN108764208B (en) | Image processing method and device, storage medium and electronic equipment | |
| CN110428366B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN112258579B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| US11431915B2 (en) | Image acquisition method, electronic device, and non-transitory computer readable storage medium | |
| CN110213494B (en) | Photographing method and device, electronic equipment and computer readable storage medium | |
| US11223810B2 (en) | Color balance method and device, on-board equipment and storage medium | |
| CN108804658B (en) | Image processing method and device, storage medium and electronic equipment | |
| TWI709110B (en) | Camera calibration method and apparatus, electronic device | |
| CN111246100B (en) | Anti-shake parameter calibration method and device and electronic equipment | |
| US20100246940A1 (en) | Method of generating hdr image and electronic device using the same | |
| CN113538551B (en) | Depth map generation method and device and electronic equipment | |
| CN109685853B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN109559352B (en) | Camera calibration method, device, electronic equipment and computer-readable storage medium | |
| CN112651911B (en) | High dynamic range imaging generation method based on polarized image | |
| CN112470192A (en) | Dual-camera calibration method, electronic device and computer-readable storage medium | |
| CN109598763A (en) | Camera calibration method, device, electronic equipment and computer readable storage medium | |
| CN105430298A (en) | Method for simultaneously exposing and synthesizing HDR image via stereo camera system | |
| CN109584311B (en) | Camera calibration method, device, electronic equipment and computer-readable storage medium | |
| CN109697737B (en) | Camera calibration method, device, electronic equipment and computer-readable storage medium | |
| CN113411508A (en) | Non-vision field imaging method based on camera brightness measurement | |
| CN109658459B (en) | Camera calibration method, device, electronic equipment and computer-readable storage medium | |
| CN110727966B (en) | Image processing method and device, storage medium and electronic equipment | |
| CN115355887B (en) | Two-stage monocular depth measurement method, system and medium based on liquid bionic vision | |
| WO2019223538A1 (en) | Image processing method and apparatus, storage medium, and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |