CN111198445B - Equipment and method for light-splitting polarization imaging - Google Patents
Equipment and method for light-splitting polarization imaging Download PDFInfo
- Publication number
- CN111198445B CN111198445B CN201811372124.7A CN201811372124A CN111198445B CN 111198445 B CN111198445 B CN 111198445B CN 201811372124 A CN201811372124 A CN 201811372124A CN 111198445 B CN111198445 B CN 111198445B
- Authority
- CN
- China
- Prior art keywords
- image
- light
- polarization
- light beam
- polarization state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/28—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising
- G02B27/283—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising used for beam splitting or combining
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/28—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B41/00—Special techniques not covered by groups G03B31/00 - G03B39/00; Apparatus therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
Abstract
The present application provides an apparatus and method for polarized imaging of light. The imaging method divides the received light into two paths of light beams by adopting a film coating light splitting mode, and obtains the polarization state of one path of light beam by adopting a focal plane splitting method. And respectively generating images by using the two light beams, performing algorithm processing such as rain fog removal and reflection removal on the two images according to the polarization state, and fusing the two images to generate a final image. And the polarization angle of the reflected light can be determined according to the polarization state, and then the reflected light in the other light beam is removed by using the self-adaptive polarization mechanism, so that the purpose of removing the reflected light is achieved.
Description
Technical Field
The present application relates to the field of optical imaging, and in particular, to a method and an apparatus for polarization-separated imaging.
Background
In recent years, the requirements of imaging devices for outputting color images are higher and higher, and in some special scenes, the traditional imaging devices are more and more difficult to meet the requirements. The conventional imaging device adopts a mode of directly presenting all received light information in an output image, and when the illumination is low (such as dusk or night) or the interference light information is strong (such as rain and fog weather or high reflection of a photographed object), the output color image cannot effectively present the target object. However, the polarization characteristics of light are utilized to process and screen the light information received by the device in real time according to the polarization state of the received light, so as to form an image by using the screened light information, which is a main means for solving the problems.
In the prior art, a method for acquiring the polarization state of received light in real time and generating a color image is mainly to add a polarization sensor on an imaging light path. A common configuration of a polarization sensor is shown in fig. 1, and includes a microlens array, a polarizer array, and a physical pixel array. Each microlens corresponds to a polaroid and a physical pixel point, and light rays converged by the microlenses are irradiated on the corresponding physical pixel points through the corresponding polaroids, so that the polarization direction of light received by each physical pixel point is the polarization direction of the corresponding polaroid. As shown in fig. 2, four adjacent polarizers may be a group, which includes four polarization directions of 0 °, 45 °, 90 °, and 135 °, and four physical pixel points corresponding to the four adjacent polarizers are a virtual pixel point. Therefore, the respective light quantity of the light in four polarization directions in the light received by the virtual pixel point can be obtained through the respective light quantity of a group of four physical pixel points corresponding to the virtual pixel point, and then the polarization state of the light received by the virtual pixel point can be obtained. After the polarization states of all the virtual pixel points are determined, the polarization state of the light received by the sensor is obtained. Meanwhile, light rays irradiate on the pixel points, and the physical pixel array can generate a color image at the same time.
However, the loss of brightness of light passing through the polarizer structure is large, so the brightness of the image formed by the device after obtaining the polarization state of the light is often very low; meanwhile, because a plurality of physical pixel points are treated as a virtual pixel point, the resolution of the finally output image is obviously reduced, and the imaging quality is influenced. Therefore, how to acquire the polarization state of the imaging light in real time, generate an image, and avoid the apparent decrease of the imaging brightness and image resolution becomes a problem to be solved by those skilled in the art.
Disclosure of Invention
The application provides a light-splitting polarization imaging device and a light-splitting polarization imaging method applied to the device. By dividing the light into two paths, obtaining the polarization state of one path and fusing the images generated by the two paths of light beams, the condition that the brightness of the final image is too low due to the obtained polarization state is effectively improved.
In a first aspect, the present application provides a light-splitting polarization imaging apparatus, which may include a light-splitting module, a polarization state acquisition module, an image generation module, and an image synthesis module. The light splitting module may be configured to split the received light into a first light beam and a second light beam. The polarization state acquisition module can be used for acquiring the polarization state of the first light beam. The image generation module may be configured to generate a first image from the first light beam and a second image from the second light beam. The image synthesis module may synthesize the first image and the second image according to a polarization state obtained from the first light beam to generate a synthesized image. The light is divided into two paths, the polarization state of the light is obtained from one path, and the two paths of light beams are respectively generated into a plurality of images for synthesis, so that the influence of the obtained polarization state on the brightness of the light is effectively reduced, and the imaging quality is improved.
In a possible implementation manner of the first aspect, when the first image and the second image are synthesized according to a polarization state, the image synthesis module may determine the disturbing light information according to the polarization state, reduce the disturbing light information in the first image and the second image, and synthesize the first image and the second image after reducing the disturbing light information to generate a synthesized image. Optionally, the image synthesis module may also synthesize the first image and the second image to generate a synthesized image, and then reduce the interference light information in the synthesized image. Interference light information is reduced, a shooting target can be better presented, and imaging quality is improved.
In each possible implementation manner of the first aspect, the light splitting module may be configured to adaptively adjust the light splitting ratio during light splitting, and adjust the light quantity ratio of the two light beams according to actual needs. The light splitting module with the function of adaptively adjusting the light splitting proportion is adopted, so that the flexibility in imaging can be improved, and different use requirements can be met.
In each possible implementation manner of the first aspect, the polarization state obtaining module may be specifically configured to obtain the polarization state of the first light beam in a manner of a split focal plane. Compared with other methods for acquiring the polarization state, the method for acquiring the polarization state of the first light beam in real time by adopting the focal plane splitting method is relatively simple and portable.
In each possible implementation manner of the first aspect, the light splitting module may be specifically configured to split the received light into the first light beam and the second light beam by using a film-coated light splitting manner. By adopting a film coating light splitting mode, the original polarization state of the light beam is easier to maintain, and the accuracy of obtaining the polarization state subsequently is improved.
In each possible implementation manner of the first aspect, when the image synthesis module synthesizes the first image and the second image, the brightness of the first image and the brightness of the second image may be superimposed. The image synthesis module may first align the first image and the second image, and then superimpose the brightness of the corresponding positions to obtain the brightness information of the synthesized image. By superposing the brightness of the first image and the second image, the influence of the brightness reduction of the first image on the brightness of the composite image caused by the acquired polarization state is effectively reduced.
In various possible implementations of the first aspect, the image generation module may generate the second image in color and the first image in color. When the second image and the first image are both color images, the final composite image can achieve better effects on brightness and color.
In each possible implementation manner of the first aspect, the image generation module may generate the second image in color and the first image in black and white. Compared with a color image, the black-and-white image has better brightness, so that the first black-and-white image and the second color image are generated, the finally synthesized color synthetic image has better brightness, and the influence of obtaining the polarization state on the brightness of the synthetic image is further reduced.
In each possible implementation manner of the first aspect, the spectroscopic polarization imaging device may further include a light beam filtering module, configured to determine an interference polarization angle according to a polarization state of the first light beam, reduce light rays of the second light beam whose polarization angle is the interference polarization angle, and send the processed second light beam to the image generating module. The light beam filtering module can remove interference light rays of which the polarization directions are interference polarization angles in the second light beam, so that the imaging quality of the second image is improved, and the imaging quality of the synthesized image is further improved.
In a second aspect, the present application provides a polarized imaging apparatus of split light, which may include a lens, a light splitting device, a polarization sensor, an image sensor, and an image processor. The lens is used for converging the light rays on the light splitting device; the light splitting device is used for splitting the light received from the lens into a first light beam and a second light beam; the polarization sensor is used for generating a first image through the first light beam, and the first image is provided with polarization information; the image sensor is used for generating a second image through the second light beam; the image processor is used for determining the polarization state of the first light beam according to the polarization information, and synthesizing the first image and the second image according to the polarization state to generate a synthesized image. The light is divided into two paths, the polarization state of the light is obtained from one path, and the two paths of light beams are respectively generated into a plurality of images for synthesis, so that the influence of the obtained polarization state on the brightness of the light is effectively reduced, and the imaging quality is improved.
In one possible implementation manner of the second aspect, when the first image and the second image are synthesized according to the polarization state, the image processor may determine the disturbing light information according to the polarization state, reduce the disturbing light information in the first image and the second image, and synthesize the first image and the second image after reducing the disturbing light information to generate the synthesized image. In another possible implementation manner, the image processor may also combine the first image and the second image to generate a combined image, and then reduce the interference light information in the combined image. Interference light information is reduced, a shooting target can be better presented, and imaging quality is improved.
In each possible implementation manner of the second aspect, the light splitting device may be configured to adaptively adjust the light splitting ratio during light splitting, and adjust the light quantity ratio of the two light beams according to actual needs. The light splitting module with the function of adaptively adjusting the light splitting proportion is adopted, so that the flexibility in imaging can be improved, and different use requirements can be met.
In each possible implementation manner of the second aspect, the imaging device may acquire the polarization state of the first light beam in a manner of a focal plane. In particular, the polarization sensor may be configured to impart polarization information to the first image in a split focal plane manner, and the image processor may determine the polarization state of the first light beam based on the polarization information. Compared with other methods for acquiring the polarization state, the method for acquiring the polarization state of the first light beam in real time by adopting the focal plane splitting method is relatively simple and portable.
In each possible implementation manner of the second aspect, the light splitting device may be specifically configured to split the received light into the first light beam and the second light beam by using a coated light splitting manner. By adopting a film coating light splitting mode, the original polarization state of the light beam is easier to maintain, and the accuracy of obtaining the polarization state subsequently is improved.
In each possible implementation manner of the second aspect, the image processor may superimpose the brightness of the first image and the second image when the first image and the second image are synthesized. The image processor may first align the first image and the second image, and then superimpose the brightness of the corresponding positions to obtain the brightness information of the composite image. By superposing the brightness of the first image and the second image, the influence of the brightness reduction of the first image on the brightness of the composite image caused by the acquired polarization state is effectively reduced. Alternatively, the functions of the image processor may be implemented by hardware, or may be implemented by software.
In various possible implementations of the second aspect described above, the image sensor may generate a second image in color, and the polarization sensor may generate a first image in color. When the second image and the first image are both color images, the final composite image can achieve better effects on brightness and color.
In various possible implementations of the second aspect described above, the image sensor may generate the second image in color, and the polarization sensor may generate the first image in black and white. Compared with a color image, the black-and-white image has better brightness, so that the first black-and-white image and the second color image are generated, the finally synthesized color synthetic image has better brightness, and the influence of obtaining the polarization state on the brightness of the synthetic image is further reduced.
In each possible implementation manner of the second aspect, the spectroscopic polarization imaging apparatus may further include a polarizer control mechanism and a polarizer, and the polarizer is located on the optical path of the second light beam. An image processor may be used to determine an interference polarization angle based on the polarization state, and a polarizer control mechanism may be used to adjust the angle of the polarizer to reduce the polarization angle of the interfering polarization angle in the second beam. By removing the interference light with the polarization direction being the interference polarization angle in the second light beam, the imaging quality of the second image is improved, and further the imaging quality of the composite image is improved.
In a third aspect, the present application provides a method of polarized imaging of separated light, the method comprising: dividing the light into a first light beam and a second light beam; acquiring the polarization state of the first light beam; generating a first image from the first light beam and a second image from the second light beam; the first image and the second image are synthesized according to the polarization state to generate a synthesized image. The light is divided into two paths, the polarization state of the light is obtained from one path, and the two paths of light beams are respectively generated into a plurality of images for synthesis, so that the influence of the obtained polarization state on the brightness of the light is effectively reduced, and the imaging quality is improved.
In a possible implementation manner of the third aspect, when the first image and the second image are synthesized according to the polarization state, the disturbing light information may be determined according to the polarization state, the disturbing light information in the first image and the second image may be reduced, and the first image and the second image after the disturbing light information is reduced may be synthesized to generate a synthesized image; optionally, the first image and the second image may be synthesized to generate a synthesized image, and then, the interference light information in the synthesized image may be reduced. Interference light information is reduced, a shooting target can be better presented, and imaging quality is improved.
In each possible implementation manner of the third aspect, the splitting ratio can be adaptively adjusted during splitting, and the light quantity ratio of the two light beams is adjusted according to actual needs. By self-adaptively adjusting the light splitting ratio, the flexibility in imaging can be increased, and different use requirements can be met.
In each possible implementation manner of the third aspect, the polarization state of the first light beam may be obtained by a method of dividing a focal plane. Compared with other methods for acquiring the polarization state, the method for acquiring the polarization state of the first light beam in real time by adopting the focal plane splitting method is relatively simple and portable.
In each possible implementation manner of the third aspect, the received light may be split into the first light beam and the second light beam by using a coated light splitting manner. By adopting a film coating light splitting mode, the original polarization state of the light beam is easier to maintain, and the accuracy of obtaining the polarization state subsequently is improved.
In each possible implementation manner of the third aspect, when the first image and the second image are synthesized, the brightness of the first image and the brightness of the second image may be superimposed. The first image and the second image may be aligned first, and then the brightness of the corresponding positions may be superimposed to obtain the brightness information of the composite image. By superposing the brightness of the first image and the second image, the influence of the brightness reduction of the first image on the brightness of the composite image caused by the acquired polarization state is effectively reduced.
In each possible implementation manner of the third aspect, the first image and the second image may both be color images. When the first image and the second image are both color images, the final composite image can achieve better effects in brightness and color.
In each possible implementation manner of the third aspect, the first image may be a black-and-white image, and the second image may be a color image. Compared with a color image, the black-and-white image has better brightness, so that the first black-and-white image and the second color image are generated, the finally synthesized color synthetic image has better brightness, and the influence of obtaining the polarization state on the brightness of the synthetic image is further reduced.
In each possible implementation manner of the third aspect, the disturbing polarization angle may be determined according to the polarization state, and the light rays with the polarization angle as the disturbing polarization angle in the second light beam may be reduced. By removing the interference light with the polarization direction being the interference polarization angle in the second light beam, the imaging quality of the second image is improved, and further the imaging quality of the composite image is improved.
In a fourth aspect, the present application provides a terminal device, including the light-splitting polarization imaging module as described in any one of the possible implementations of the first to second aspects, and further including a main processing module for performing image processing on the composite image generated by the light-splitting polarization imaging module.
Optionally, the terminal device may further include a communication module, configured to send an image or video corresponding to the composite image to other devices through interface transmission or wireless transmission.
In a fifth aspect, the present application provides a camera, which includes the spectroscopic polarization imaging module as described in any one of the possible implementations of the first to second aspects, and may also include a communication module, configured to send an image or video corresponding to the composite image to other devices by way of interface transmission or wireless transmission.
In a sixth aspect, the present application provides a digital camera, including the spectral polarization imaging module as described in any one of the possible implementations of the first to second aspects, and further including a shutter for controlling whether light can enter the spectral polarization imaging module.
Drawings
FIG. 1 is a schematic diagram of a prior art polarization sensor;
FIG. 2 is a schematic diagram of a polarizer array arrangement of a dummy pixel in the prior art;
FIG. 3 is a schematic structural diagram of a polarized imaging apparatus according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a logic structure of another spectroscopic polarization imaging apparatus according to an embodiment of the present application;
FIG. 5 is a schematic flow chart of a polarized imaging method of a partial light according to an embodiment of the present application;
FIG. 6 is a schematic flow chart of another spectroscopic polarization imaging method according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a logical structure of a camera according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a logic structure of a digital camera according to an embodiment of the present application;
fig. 9 is a schematic diagram of a logical structure of a terminal device according to an embodiment of the present application.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
Fig. 3 is a schematic device diagram of a spectroscopic polarization imaging apparatus according to an embodiment of the present disclosure. As shown in fig. 3, the imaging apparatus 100 includes a lens 110, a light splitting device 120, a polarization sensor 130, an image sensor 140, and an image processor 150.
The lens 110 is used for collecting light and converging the light onto the light splitting device 120. The lens 110 may be composed of a plurality of lenses, or may be composed of a single lens, which is not limited herein.
The light splitting device 120 is used to split the light received from the lens 110 into a first light beam and a second light beam. The first light beam may be composed of light transmitted through the light splitting device 120, and the second light beam may be composed of light reflected from the light splitting device 120. In some possible embodiments, the first light beam may also be composed of light reflected from the light splitting device 120, and the second light beam may also be composed of light transmitted through the light splitting device 120, which is not limited herein. The light splitting device 120 may be implemented as a light splitting coated prism, which splits the light into a first light beam and a second light beam by means of coating light splitting. Wherein the first beam is irradiated on the polarization sensor 130 and the second beam is irradiated on the image sensor 140. The ratio of the transmitted and reflected light quantity of the light ray passing through the spectral coating prism can be 1: 1. in some possible embodiments, the ratio of the amount of light may be other ratios, such as 1: 2. 2: 1, etc., without limitation herein. In some possible embodiments, the light splitting device 120 may also be implemented as other types of light splitting devices such as a diffraction light splitting prism, a mechanical blocking device, and the like, which is not limited herein.
The polarization sensor 130 is used to generate a first image with polarization information of the first beam light by the first beam. The polarization sensor 130 may be implemented as a split-focus plane sensor, and for convenience of description, the polarization sensor in the embodiment of the present application adopts an implementation manner that the virtual pixel point is composed of four physical pixel points, and the polarization angles of the corresponding polarizers are respectively 0 °, 45 °, 90 °, and 135 °. The polarization sensor 130 may also be implemented as any sensor capable of acquiring the polarization state of light, and when a sub-focal plane sensor is adopted, the number of physical pixel points forming a virtual pixel point may be any, and the corresponding polarization angle of the polarizer may be any angle capable of achieving the purpose of the present invention, which is not limited in the present application. The polarization information in the first image refers to the light quantity of polarized light received by each virtual pixel point included in the first image in each direction (in this embodiment, 0 °, 45 °, 90 °, and 135 ° are taken as examples). Each virtual pixel point comprises four physical pixel points, the four physical pixel points respectively correspond to the polaroids with different polarization directions, and each physical pixel point receives light in the corresponding polarization direction of the polaroid. Therefore, four times of the light quantity of any one physical pixel point in the virtual pixel point can be approximately considered as the total quantity of the light in the polarization direction corresponding to the physical pixel point received by the virtual pixel point, and respectively recording the light quantity received by the four physical pixel points is equivalent to recording the total quantity of the light in each polarization direction in the light received by the virtual pixel point. The polarization sensor 130 converts the optical signal received by each physical pixel into an electrical signal to generate a first image, so that the first image includes polarization information of the first light beam. The first image may be a color image, and the polarization sensor 130 may convert the received lights with different colors into different electrical signals, respectively, to generate the color image. In some possible embodiments, the first image may also be a black-and-white image, and the polarization sensor 130 directly converts the received optical signal into an electrical signal, thereby generating a black-and-white image.
The image sensor 140 is used to generate a second image by the second light beam. The second image may be a color image, and the image sensor 140 may convert the received lights with different colors into different electrical signals, respectively, to generate the color image.
The image processor 150 is configured to determine a polarization state of the first light beam according to the polarization information, and combine the first image and the second image according to the polarization state to generate a combined image. The polarization state of the first light beam is a set of polarization states of all virtual pixels receiving the light of the first light beam, and the polarization state of one virtual pixel includes two aspects of a degree of polarization dolp (degree of linear polarization) and an angle of polarization aolp (angle of linear polarization). The specific way of determining the polarization state of a virtual pixel point is as follows:
the light quantity of light received by the four physical pixel points corresponding to the virtual pixel point is obtained, the brightness of the physical pixel points corresponding to the polaroids with the polarization angles of 0 degree, 45 degrees, 90 degrees and 135 degrees can be represented by I0, I45, I90 and I135 respectively, and the light quantity received by the physical pixel points is represented;
determining Stokes vectors S0, S1 and S2 of the virtual pixel point according to I0, I45, I90 and I135, wherein the specific formula is
Determining DoLP and AoLP according to S0, S1 and S2
After the polarization states of all the virtual pixel points are determined, the polarization states and the set of the corresponding virtual pixel point coordinates are the polarization states of the first light beam. In some possible embodiments, the polarization state of the first light beam may also be a set of polarization states and corresponding coordinates of partial virtual pixel points, such as a set of polarization states and corresponding coordinates of one or several specific virtual pixel points, or a set of polarization states and corresponding coordinates of a certain proportion (e.g., 40% or 60% or the like) of virtual pixel points among all virtual pixel points, which is not limited herein. The above-described method of acquiring the polarization state by the polarization sensor 130 and the image processor 150 belongs to the method of dividing the focal plane.
The first image and the second image are synthesized according to the polarization state, which may be by identifying the subject information and the interference light information in the acquired image through the polarization state, weakening the interference light information or enhancing the subject information when synthesizing the image, aligning the first image and the second image, and overlapping the brightness of the corresponding pixels to generate the synthesized image. Here, the first image and the second image may be combined after reducing the interference light information or enhancing the photographic subject information before combining the images; the first image and the second image may be synthesized to generate a synthesized image, and then the interference light information or the shooting object information may be reduced or enhanced for the synthesized image, which is not limited herein. The specific implementation function includes but is not limited to a rain and fog removing algorithm and the like.
In another possible embodiment, spectroscopic polarization imaging apparatus 100 includes adaptive filter 160 in addition to lens 110, spectroscopic device 120, polarization sensor 130, image sensor 140, and image processor 150. For the detailed functions of the lens 110, the light splitting device 120, the polarization sensor 130 and the image sensor 140, please refer to the foregoing description, and further description is omitted here.
The image processor 150 is configured to determine a polarization state of the first light beam based on the polarization information and determine an interference polarization angle based on the polarization state of the first light beam. The disturbing polarization angle here refers to the polarization angle of the disturbing (e.g. reflected) light rays in the first light beam.
the image processor 150 determines the polarization state of the first light beam according to the first light beam, for a specific determination, please refer to the related description above, which is not repeated herein;
selecting a light reflection region (such as an automobile window) for a specific scene, determining an average AoLP of virtual pixels meeting preset conditions in the light reflection region, and taking the average AoLP as an interference polarization angle. The virtual pixels meeting the preset condition may be the virtual pixels with the DoLP value ranked in the top 50% from high to low, may also be the virtual pixels with the DoLP value higher than a certain set value, or other similar conditions, and are not limited herein;
the disturbing polarization angle is fed back to the adaptive filter 160, and a micro-actuator in the adaptive filter 160 rotates the polarizer to the orthogonal direction of the disturbing polarization angle, thereby reducing the light rays in the second light beam whose polarization direction is the direction of the disturbing polarization angle, i.e., reducing the reflection. Therefore, in the second image generated by the second light beam, the reflection information is obviously reduced, and the imaging quality is improved.
The image processor 150 may algorithmically reduce the glint information in the first image based on the interference polarization angle. The image processor 150 may then align the first and second images and superimpose the intensities of the corresponding pixels to generate a composite image. In some possible embodiments, the reflective information in the synthesized image may also be reduced after the synthesized image, which is not limited herein.
Fig. 4 is a schematic device diagram of another possible embodiment of a spectroscopic and polarization imaging apparatus according to the present application. As shown in fig. 4, the imaging apparatus 200 includes a light splitting module 210, a polarization state acquisition module 220, an image generation module 230, and an image synthesis module 240. In some possible implementations, the imaging device 200 may also include a beam filtering module 250.
The light splitting module 210 is used for splitting the received light into a first light beam and a second light beam. The light splitting module 210 may split the light into a first light beam and a second light beam by using a coating light splitting method. The first light beam is sent to the polarization state obtaining module 220, and the second light beam is sent to the image generating module 230. The light splitting module 210 may split the light into the first light beam and the second light beam according to a ratio of light quantity to 1: 1. in some possible embodiments, the ratio of the amount of light may be other ratios, such as 1: 2. 2: 1, etc., without limitation herein. In some possible embodiments, the light splitting module 210 may also split light by using other types of light splitting methods, such as diffraction light splitting, mechanical blocking light splitting, and the like, which are not limited herein.
The polarization state obtaining module 220 is used for obtaining the polarization state of the first light beam. The polarization state obtaining module may obtain the polarization state in a manner of a focal plane, and for a specific obtaining method, please refer to the related description in fig. 3, which is not described herein again.
The image generation module 230 is configured to generate a first image by the first light beam and a second image by the second light beam. At least one of the first image and the second image is a color image.
The image synthesis module 240 is configured to synthesize the first image and the second image according to the polarization state of the first light beam, and generate a synthesized image. The first image and the second image are synthesized according to the polarization state of the first light beam, and the first image and the second image may be synthesized by identifying the subject information and the interference light information in the acquired image through the polarization state, weakening the interference light information or enhancing the subject information when synthesizing the image, aligning the first image and the second image, and overlapping the brightness of the corresponding pixels to generate the synthesized image. Here, the first image and the second image may be combined after reducing the interference light information or enhancing the photographic subject information before combining the images; the first image and the second image may be synthesized to generate a synthesized image, and then the interference light information or the shooting object information may be reduced or enhanced for the synthesized image, which is not limited herein. The specific implementation function includes but is not limited to a rain and fog removing algorithm and the like.
The beam filtering module 250 is configured to determine an interference polarization angle according to the polarization state of the first light beam, and reduce the light beam of the second light beam with the interference polarization angle. For the way of determining the interference polarization angle, please refer to the foregoing description, and the details are not repeated herein. After determining the interference polarization angle, the beam filtering module 250 reduces the light ray of the second light beam whose polarization angle is the interference polarization angle, which may be realized by a polarizer structure, or by other means capable of screening the polarized light ray, and is not limited herein.
Fig. 5 is a schematic flowchart of a spectroscopic polarization imaging method according to an embodiment of the present disclosure.
S310 splits the light into a first beam and a second beam. The light can be split into the first light beam and the second light beam by means of coating light splitting, diffraction light splitting, mechanical blocking light splitting and the like. The ratio of the amounts of light of the first and second light beams may be 1: 1. in some possible embodiments, the ratio of the amount of light may be other ratios, such as 1: 2. 2: 1, etc., without limitation herein.
S320 acquires a polarization state of the first beam. The polarization state of the first light beam can be obtained by a way of dividing the focal plane, and for a specific obtaining way, please refer to the foregoing description, which is not described herein again.
S330 generates a first image from the first light beam and a second image from the second light beam. At least one of the first image and the second image is a color image.
S340 synthesizes the first image and the second image according to the polarization state, and generates a synthesized image. The first image and the second image are synthesized according to the polarization state of the first light beam, and the first image and the second image may be synthesized by identifying the subject information and the interference light information in the acquired image through the polarization state, weakening the interference light information or enhancing the subject information when synthesizing the image, aligning the first image and the second image, and overlapping the brightness of the corresponding pixels to generate the synthesized image. Here, the first image and the second image may be combined after reducing the interference light information or enhancing the photographic subject information before combining the images; the first image and the second image may be synthesized to generate a synthesized image, and then the interference light information or the shooting object information may be reduced or enhanced for the synthesized image, which is not limited herein. The specific implementation function includes but is not limited to a rain and fog removing algorithm and the like.
Fig. 6 is a schematic flowchart of another possible embodiment of the spectroscopic polarization imaging method according to the present application.
S410 splits the light into a first beam and a second beam. S420 acquires a polarization state of the first beam. For details of S410 and S420, please refer to descriptions of S310 and S320 in fig. 5, which are not described herein again.
S430, determining an interference polarization angle according to the polarization state of the first light beam, and reducing the light ray with the polarization angle being the interference polarization angle in the second light beam. For determining the disturbing polarization angle and reducing the light with the disturbing polarization angle in the second light beam, please refer to the foregoing description, and details thereof are omitted here.
S440 generates a first image from the first light beam and a second image from the second light beam.
S450 synthesizes the first image and the second image according to the polarization state, and generates a synthesized image. The interference light information in the first image may be reduced according to the polarization state, and then the first image and the second image may be combined to generate a combined image.
Fig. 7 shows a possible embodiment of a camera using the spectroscopic polarization imaging method of the present application. The camera 500 includes a spectroscopic polarization imaging module 510 and a communication module 520. The spectroscopic polarization imaging module 510 can be implemented in any of the previously described embodiments of spectroscopic polarization imaging devices. The communication module 520 is configured to send the image or video corresponding to the synthesized image to other devices through interface transmission or wireless transmission.
Please refer to fig. 8, which is a possible embodiment of a digital camera using the spectroscopic polarization imaging method of the present application. The digital camera 600 includes a shutter 610 and a spectroscopic polarization imaging module 620. The shutter 610 is used to control whether light can enter the spectroscopic polarization imaging module 620. The spectroscopic polarization imaging module 620 may be implemented in any of the previously described spectroscopic polarization imaging device embodiments.
Please refer to fig. 9, which is a possible embodiment of a terminal device using the spectroscopic polarization imaging method of the present application. Terminal device 700 includes a spectroscopic polarization imaging module 710 and a main processing module 720, and in some possible implementations, a communication module 730. The spectroscopic polarization imaging module 710 may be implemented in any of the previously described spectroscopic polarization imaging device embodiments. The main processing module 720 is used to perform image processing on the composite image generated by the polarized light imaging module. The communication module 730 is used for transmitting the image or video corresponding to the synthesized image to other devices through interface transmission or wireless transmission.
The technical scheme of the application does not limit the color synthesis mode when the first image and the second image are synthesized, and the color in the first image and the color in the second image can be subjected to processing such as accepting, fusing and overlapping in any form.
In one or more examples, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium and executed by a hardware-based processing unit.
It should be appreciated that reference throughout this specification to "one embodiment," "an embodiment," or "some possible implementations" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment," "in an embodiment," or "in some possible implementations" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
The image fusion method in the present application can be implemented by hardware or software. In a hardware implementation, at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, and/or a microprocessor may be used to implement the embodiments of the present application. In the case of a software implementation, the embodiments such as procedures and functions may be implemented using a software module that performs at least one function and operation. The software modules may be implemented as software programs written in any suitable software language.
In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a from which B can be determined. It should also be understood that determining B from a does not mean determining B from a alone, but may be determined from a and/or other information.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the systems, apparatuses and units described above may refer to the corresponding processes in the method embodiments, and are not described herein again.
Claims (29)
1. A polarized light imaging apparatus, comprising:
the light splitting module is used for splitting the received light into a first light beam and a second light beam;
the polarization state acquisition module is used for acquiring the polarization state of the first light beam;
an image generation module for generating a first image by the first light beam;
the light beam filtering module is used for determining an interference polarization angle according to the polarization state of the first light beam, reducing light rays of which the polarization angle is the interference polarization angle in the second light beam, and sending the processed second light beam to the image generating module;
the image generation module is further used for generating a second image through the processed second light beam;
and the image synthesis module is used for synthesizing the first image and the second image according to the polarization state to generate a synthesized image.
2. The spectroscopic polarization imaging device of claim 1, wherein the polarization state acquisition module is specifically configured to acquire the polarization state of the first light beam in a manner of a split focal plane.
3. The spectroscopic polarization imaging device of claim 1, wherein the spectroscopic module is specifically configured to separate the received light into the first light beam and the second light beam by way of coated light splitting.
4. The spectroscopic polarization imaging device of any one of claim 1, the image synthesis module being specifically configured to: determining interference light information according to the polarization state, reducing the interference light information in the first image and the interference light information in the second image, and synthesizing the first image and the second image after reducing the interference light information to generate a synthesized image.
5. The spectroscopic polarization imaging device of claim 4, the image synthesis module being specifically configured to: determining interference light information according to the polarization state, reducing the interference light information in the first image and the interference light information in the second image, and overlapping the brightness of the first image and the second image after the interference light information is reduced to generate a composite image.
6. The spectroscopic polarization imaging device of any one of claim 1, wherein the image synthesis module is specifically configured to: and determining interference light information according to the polarization state, and combining the first image and the second image to generate a combined image, so as to reduce the interference light information in the combined image.
7. The spectroscopic polarization imaging device of claim 6, the image synthesis module being specifically configured to: and determining interference light information according to the polarization state, overlapping the brightness of the first image and the second image to generate a composite image, and reducing the interference light information in the composite image.
8. The spectroscopic polarization imaging device of any one of claims 1 to 7 wherein the image generation module is specifically configured to generate a second image in color from the second light beam and to generate a first image in color from the first light beam.
9. The spectroscopic polarization imaging device of any one of claims 1 to 7 wherein the image generation module is specifically configured to generate a second image in color by the second light beam and a first image in black and white by the first light beam.
10. A polarized light imaging apparatus, comprising:
the lens is used for converging the light rays on the light splitting device;
a light splitting device for splitting the light received from the lens into a first light beam and a second light beam;
a polarization sensor for generating a first image with polarization information through the first light beam;
an image sensor for generating a second image by the second light beam;
an image processor for determining a polarization state of the first light beam from the polarization information;
the image processor is further used for determining an interference polarization angle according to the polarization state;
the polaroid is positioned on the optical path of the second light beam, and the polaroid control mechanism is used for adjusting the angle of the polaroid so as to reduce the light rays with the polarization angle of the second light beam as the interference polarization angle;
the image processor is further configured to synthesize the first image and the second image according to the polarization state to generate a synthesized image.
11. The spectroscopic polarization imaging device of claim 10 wherein the polarization sensor is specifically configured to use a split focal plane approach to bring the polarization information to the first image.
12. The spectroscopic polarization imaging apparatus of claim 10, wherein the spectroscopic device is specifically configured to separate the received light into the first light beam and the second light beam by way of coated light splitting.
13. The spectroscopic polarization imaging device of any of claim 10, wherein the image processor is specifically configured to: determining interference light information according to the polarization state, reducing the interference light information in the first image and the interference light information in the second image, and synthesizing the first image and the second image after reducing the interference light information to generate a synthesized image.
14. The spectroscopic polarization imaging device of claim 13, wherein the image processor is specifically configured to: determining interference light information according to the polarization state, reducing the interference light information in the first image and the interference light information in the second image, and overlapping the brightness of the first image and the second image after the interference light information is reduced to generate a composite image.
15. The spectroscopic polarization imaging device of any of claim 10, wherein the image processor is specifically configured to: and determining interference light information according to the polarization state, and combining the first image and the second image to generate a combined image, so as to reduce the interference light information in the combined image.
16. The spectroscopic polarization imaging device of claim 15, wherein the image processor is specifically configured to: and determining interference light information according to the polarization state, overlapping the brightness of the first image and the second image to generate a composite image, and reducing the interference light information in the composite image.
17. Spectroscopic polarization imaging device according to one of claims 10 to 16, wherein the image sensor is in particular adapted to generate a colored second image by the second light beam and the polarization sensor is in particular adapted to generate a colored first image by the first light beam.
18. Spectroscopic polarization imaging device according to one of claims 10 to 16, wherein the image sensor is in particular adapted to generate a second image in color by the second light beam and the polarization sensor generates a first image in black and white by the first light beam.
19. A method of forming a polarized image of light, comprising:
dividing the light into a first light beam and a second light beam;
acquiring the polarization state of the first light beam;
determining an interference polarization angle according to the polarization state of the first light beam, and reducing light rays of which the polarization angle is the interference polarization angle in the second light beam;
generating a first image from the first light beam and a second image from the second light beam;
and synthesizing the first image and the second image according to the polarization state to generate a synthesized image.
20. The spectroscopic polarization imaging method of claim 19, wherein said obtaining the polarization state of the first light beam is in particular by obtaining the polarization state of the first light beam in a manner of a split focal plane.
21. The spectroscopic polarization imaging method of claim 19, wherein the splitting of the light into the first beam and the second beam is specifically: and dividing the light into the first light beam and the second light beam by adopting a film coating light splitting mode.
22. The spectroscopic polarization imaging method of any one of claim 19, wherein the combining the first image and the second image according to the polarization state is specifically: determining interference light information according to the polarization state, reducing the interference light information in the first image and the interference light information in the second image, and synthesizing the first image and the second image after reducing the interference light information to generate a synthesized image.
23. The spectroscopic polarization imaging method according to claim 22, wherein the combining the first image and the second image after the reduction of the interference light information to generate a combined image is specifically: superimposing the brightness of the first image and the second image after the reduction of the disturbing light information to generate a composite image.
24. The spectroscopic polarization imaging method of any one of claim 19, wherein the combining the first image and the second image according to the polarization state is specifically: and determining interference light information according to the polarization state, and combining the first image and the second image to generate a combined image, so as to reduce the interference light information in the combined image.
25. The spectroscopic polarization imaging method of claim 24, wherein the combining the first image and the second image to generate a combined image is specifically: and superposing the brightness of the first image and the second image to generate a composite image.
26. The spectroscopic polarization imaging method of any one of claims 19 to 25, wherein the first image and the second image are both color images.
27. The spectroscopic polarization imaging method of any one of claims 19 to 25 wherein the first image is a black and white image and the second image is a color image.
28. A terminal device comprising the spectroscopic polarization imaging module of any one of claims 1 to 7 or 9 to 16, wherein the terminal device further comprises a main processing module for image processing of the composite image.
29. The terminal device according to claim 28, wherein the terminal device further comprises a communication module, and the communication module is configured to send the image or video corresponding to the composite image to another device through an interface transmission or a wireless transmission.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811372124.7A CN111198445B (en) | 2018-11-16 | 2018-11-16 | Equipment and method for light-splitting polarization imaging |
| PCT/CN2019/117177 WO2020098608A1 (en) | 2018-11-16 | 2019-11-11 | Device and method for dispersive polarization imagin |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811372124.7A CN111198445B (en) | 2018-11-16 | 2018-11-16 | Equipment and method for light-splitting polarization imaging |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111198445A CN111198445A (en) | 2020-05-26 |
| CN111198445B true CN111198445B (en) | 2021-10-01 |
Family
ID=70731922
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811372124.7A Active CN111198445B (en) | 2018-11-16 | 2018-11-16 | Equipment and method for light-splitting polarization imaging |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111198445B (en) |
| WO (1) | WO2020098608A1 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114077102B (en) * | 2020-08-14 | 2023-03-17 | 华为技术有限公司 | Polarizer, polarizer array, polarization control method, polarization control device and electronic equipment |
| CN115134480A (en) * | 2021-03-24 | 2022-09-30 | 华为技术有限公司 | Camera module, terminal equipment and imaging method |
| CN113491497B (en) * | 2021-07-27 | 2022-08-12 | 重庆西山科技股份有限公司 | Polarized light endoscope device |
| CN114176484A (en) * | 2021-12-16 | 2022-03-15 | 重庆西山科技股份有限公司 | Polarized light endoscope device, camera and camera optical system |
| CN114650373A (en) * | 2022-03-21 | 2022-06-21 | 维沃移动通信有限公司 | Imaging method and device, image sensor, imaging device and electronic device |
| CN115265781B (en) * | 2022-07-14 | 2024-04-09 | 长春理工大学 | System and method for rapidly acquiring plane array polarized spectrum image |
| CN117137433A (en) * | 2023-07-10 | 2023-12-01 | 深圳信息职业技术学院 | Multi-wavelength confocal speckle imaging system, method, storage medium and equipment |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6222631B1 (en) * | 1998-01-08 | 2001-04-24 | Minolta Co., Ltd. | Two-dimensional spectral characteristic measuring apparatus |
| CN104216135A (en) * | 2014-09-05 | 2014-12-17 | 西北工业大学 | Micro-polarizing film array used for acquiring full-polarization parameters and production method and application thereof |
| CN106127134A (en) * | 2016-06-20 | 2016-11-16 | 联想(北京)有限公司 | Optical devices, electronic equipment and control method thereof |
| CN107014490A (en) * | 2017-04-17 | 2017-08-04 | 大连理工大学 | One kind point focal plane type real-time polarization imaging system |
| CN107548502A (en) * | 2015-02-25 | 2018-01-05 | 脸谱公司 | Object in characteristic identification volume elements based on the light by object reflection |
| CN206865574U (en) * | 2017-03-30 | 2018-01-09 | 成都通甲优博科技有限责任公司 | Color image pickup device under a kind of low-light (level) environment |
| CN107592465A (en) * | 2017-10-10 | 2018-01-16 | 联想(北京)有限公司 | A kind of imaging system and imaging method |
| CN108107003A (en) * | 2017-12-15 | 2018-06-01 | 哈尔滨工业大学 | Fast illuminated light field-polarization imager and imaging method based on microlens array |
| JPWO2017081925A1 (en) * | 2015-11-10 | 2018-08-23 | ソニー株式会社 | Image processing apparatus and image processing method |
| CN108731810A (en) * | 2018-06-07 | 2018-11-02 | 合肥工业大学 | Divide focal plane polarization imaging measurement method and device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100149519A1 (en) * | 2008-06-12 | 2010-06-17 | Mehrdad Toofan | Polarization contrast imager (pci) |
| CN101960859B (en) * | 2008-07-08 | 2013-04-10 | 松下电器产业株式会社 | Image processing method, image processing device, image synthesis method, and image synthesis device |
| CN206650741U (en) * | 2017-02-14 | 2017-11-17 | 浙江大华技术股份有限公司 | A kind of coaxial image fusion device |
| CN206671690U (en) * | 2017-04-11 | 2017-11-24 | 中国科学技术大学 | Light-dividing device based on polarization spectroscope |
-
2018
- 2018-11-16 CN CN201811372124.7A patent/CN111198445B/en active Active
-
2019
- 2019-11-11 WO PCT/CN2019/117177 patent/WO2020098608A1/en active Application Filing
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6222631B1 (en) * | 1998-01-08 | 2001-04-24 | Minolta Co., Ltd. | Two-dimensional spectral characteristic measuring apparatus |
| CN104216135A (en) * | 2014-09-05 | 2014-12-17 | 西北工业大学 | Micro-polarizing film array used for acquiring full-polarization parameters and production method and application thereof |
| CN107548502A (en) * | 2015-02-25 | 2018-01-05 | 脸谱公司 | Object in characteristic identification volume elements based on the light by object reflection |
| JPWO2017081925A1 (en) * | 2015-11-10 | 2018-08-23 | ソニー株式会社 | Image processing apparatus and image processing method |
| CN106127134A (en) * | 2016-06-20 | 2016-11-16 | 联想(北京)有限公司 | Optical devices, electronic equipment and control method thereof |
| CN206865574U (en) * | 2017-03-30 | 2018-01-09 | 成都通甲优博科技有限责任公司 | Color image pickup device under a kind of low-light (level) environment |
| CN107014490A (en) * | 2017-04-17 | 2017-08-04 | 大连理工大学 | One kind point focal plane type real-time polarization imaging system |
| CN107592465A (en) * | 2017-10-10 | 2018-01-16 | 联想(北京)有限公司 | A kind of imaging system and imaging method |
| CN108107003A (en) * | 2017-12-15 | 2018-06-01 | 哈尔滨工业大学 | Fast illuminated light field-polarization imager and imaging method based on microlens array |
| CN108731810A (en) * | 2018-06-07 | 2018-11-02 | 合肥工业大学 | Divide focal plane polarization imaging measurement method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111198445A (en) | 2020-05-26 |
| WO2020098608A1 (en) | 2020-05-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111198445B (en) | Equipment and method for light-splitting polarization imaging | |
| CN107948519B (en) | Image processing method, device and equipment | |
| JP7145208B2 (en) | Method and Apparatus and Storage Medium for Dual Camera Based Imaging | |
| KR102279436B1 (en) | Image processing methods, devices and devices | |
| US20170330053A1 (en) | Color night vision system and operation method thereof | |
| US8890942B2 (en) | Camera module, image processing apparatus, and image processing method | |
| CN101884222B (en) | The image procossing presented for supporting solid | |
| CN108462830B (en) | Image pickup apparatus and control method of image pickup apparatus | |
| US10630920B2 (en) | Image processing apparatus | |
| CN103780840A (en) | High-quality imaging double camera shooting and imaging device and method thereof | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| KR20200031169A (en) | Image processing method and device | |
| US9294663B2 (en) | Imaging apparatus and imaging method for generating increased resolution images, hyperspectral images, steroscopic images, and/or refocused images | |
| US11729500B2 (en) | Lowpass filter control apparatus and lowpass filter control method for controlling variable lowpass filter | |
| WO2013027504A1 (en) | Imaging device | |
| CN106506939B (en) | Image acquisition device and acquisition method | |
| CN108566504A (en) | A kind of dual camera module, electronic equipment and its image acquiring method | |
| US11184553B1 (en) | Image signal processing in multi-camera system | |
| WO2021184362A1 (en) | Photographing device | |
| WO2013058085A1 (en) | Stereo imaging device | |
| WO2011095026A1 (en) | Method and system for photography | |
| CN107872631B (en) | Image shooting method and device based on double cameras and mobile terminal | |
| JP2016219974A (en) | Imaging apparatus and imaging method, image processing apparatus and image processing method, and program | |
| CN109688317A (en) | A kind of video camera and image generating method | |
| CN110930440B (en) | Image alignment method, device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |