CN110969581B - Method, device, equipment and medium for imaging liquid crystal optical element without polaroid - Google Patents
Method, device, equipment and medium for imaging liquid crystal optical element without polaroid Download PDFInfo
- Publication number
- CN110969581B CN110969581B CN201811155163.1A CN201811155163A CN110969581B CN 110969581 B CN110969581 B CN 110969581B CN 201811155163 A CN201811155163 A CN 201811155163A CN 110969581 B CN110969581 B CN 110969581B
- Authority
- CN
- China
- Prior art keywords
- image
- texture
- value
- liquid crystal
- optical element
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000004973 liquid crystal related substance Substances 0.000 title claims abstract description 59
- 230000003287 optical effect Effects 0.000 title claims abstract description 49
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000003384 imaging method Methods 0.000 title claims abstract description 40
- 238000012545 processing Methods 0.000 claims abstract description 37
- 238000001914 filtration Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 10
- 230000002146 bilateral effect Effects 0.000 claims description 8
- 239000011159 matrix material Substances 0.000 claims description 7
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000000926 separation method Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 238000005259 measurement Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000009471 action Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012634 optical imaging Methods 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000005684 electric field Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000010410 layer Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000002356 single layer Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
Abstract
The embodiment of the invention discloses a method, a device, equipment and a medium for imaging a liquid crystal optical element without a polaroid. The method comprises the following steps: acquiring an original gray image obtained by processing after shooting a scene in an in-focus state through a liquid crystal optical element and at least one reference gray image obtained by processing after shooting the scene in an out-of-focus state; calculating a local standard deviation value of an original gray level image to obtain a standard deviation image; distinguishing a background image and a texture image from the standard deviation image; selecting a reference gray level image, and performing enhanced texture processing on the texture image to obtain a texture enhanced image; and generating a target image according to the texture enhanced image and the background image. According to the invention, on the premise of no polaroid, the image shot by the liquid crystal optical element in the focusing state and the shot image in the non-focusing state are utilized, and the imaging speed is improved and the obtained target image is clearer by carrying out enhanced texture processing on the texture image distinguished after the standard variance value is calculated.
Description
Technical Field
The present invention relates to the field of optical imaging technologies, and in particular, to an optical imaging method, apparatus, device, and storage medium.
Background
In recent years, a liquid crystal lens has been attracting attention in a focus variable lens technology typified by electric control. Under the action of the electric field, the liquid crystal molecules deflect, causing the abnormal light refractive index to change. The abnormal light can be focused and defocused by changing the voltage. However, the refractive index of the ordinary ray does not change with the deflection of the liquid crystal molecules. Therefore, in a liquid crystal lens imaging system, a polarizing plate is required to remove the ordinary light that cannot be modulated. However, the polarizer greatly reduces the amount of light incident on the image sensor, resulting in an influence on the imaging quality.
At present, several solutions have been proposed to avoid using a polarizer, one is to manufacture a liquid crystal lens using blue phase liquid crystal, but the industrial practical level has not been reached yet due to the small birefringence of blue phase liquid crystal, the narrow operating temperature range and the high driving voltage. Another method uses a multi-layer liquid crystal instead of a single-layer structure, but this method increases the cost and thickness of the liquid crystal lens, and is greatly limited in application. The last method acquires images using a non-lens state and a lens state, respectively, and improves sharpness by image processing, but this method introduces excessive noise to deteriorate image quality.
Disclosure of Invention
In view of the above, embodiments of the present invention provide a method, an apparatus, a device, and a medium for imaging a liquid crystal optical element without a polarizer, so as to solve the technical problem in the prior art that the imaging quality is degraded due to more noise when no polarizer is imaged.
In a first aspect, an embodiment of the present invention provides a method for imaging a liquid crystal optical element without a polarizing plate, where the method includes:
acquiring an original gray image obtained by shooting a scene in an in-focus state through the liquid crystal optical element and at least one reference gray image obtained by shooting the scene in an out-of-focus state;
calculating the standard variance value of the original gray image to obtain a standard variance image with the same size as the original gray image;
distinguishing a background image and a texture image from the standard deviation image;
selecting a reference gray level image, and performing enhanced texture processing on the texture image to obtain a texture enhanced image;
and generating a target image according to the texture enhanced image and the background image.
Preferably, before said calculating the standard deviation value of the original gray image, the method further comprises, before obtaining the standard deviation image having the same size as the original gray image:
and carrying out mirror expansion on the original gray image according to the neighborhood size on the pixels on the boundary of the original gray image.
Preferably, the mirror-expanding the pixels on the boundary of the original gray-scale image according to the neighborhood size includes:
defining the size of the image subarea selected by the local standard deviation, setting the size of the subarea as (P, Q), setting the size of the original gray image matrix as (M, N), and expanding the boundary mirror image of the original gray image as (M+P-1, N+Q-1), wherein M, N, P, Q is a positive integer.
Preferably, the range of values of P and Q is: p is more than or equal to 7 and less than or equal to 11, Q is more than or equal to 7 and less than or equal to 11, and P and Q are odd numbers.
Preferably, p=11, q=11.
Preferably, the selecting a reference gray level image, performing enhanced texture processing on the texture image to obtain a texture enhanced image, includes:
setting a threshold I of a texture image 1 The original gray image has a value of I f The reference gray image has a value of I r The texture enhanced image obtained is divided into two cases: at a value greater than the threshold I 1 When the texture enhanced image is obtained by the following formula: (I) f (i，j)-a*I r (i, j))/(1-a); at less than or equal to the threshold I 1 When the I is taken f Wherein i and j take natural numbers greater than or equal to 1, the value of a is determined according to the blurring degree of the reference gray level image, and the value range of a is more than or equal to 0.1 and less than or equal to 0.9.
Preferably, when a is greater than or equal to a predetermined value, bilateral filtering processing is performed on the texture enhanced image.
In a second aspect, embodiments of the present invention provide a polarizer-less liquid crystal optical element imaging apparatus, wherein the apparatus includes:
the image acquisition module is used for acquiring an original gray image obtained by processing after shooting a scene in a focusing state through the liquid crystal optical element and at least one reference gray image obtained by processing after shooting the scene in a non-focusing state;
the calculation module is used for calculating the standard variance value of the original gray image to obtain a standard variance image with the same size as the original gray image;
a separation module for distinguishing a background image and a texture image from the standard deviation image;
the texture image enhancement processing module is used for selecting a reference gray level image, and enhancing texture processing is carried out on the texture image to obtain a texture enhanced image;
and the target image generation module is used for generating a target image according to the texture enhanced image and the background image.
In a third aspect, embodiments of the present invention provide a polarizer-less liquid crystal optical element imaging apparatus, wherein the apparatus includes: a liquid crystal optical element, at least one processor, at least one memory, and computer program instructions stored in the memory, which when executed by the processor, implement a method as claimed in any one of the preceding claims.
In a fourth aspect, embodiments of the present invention also provide a computer readable storage medium having stored thereon computer program instructions, characterized in that the method according to any of the preceding claims is implemented when said computer program instructions are executed by a processor.
According to the imaging method, device, equipment and medium of the liquid crystal optical element without the polaroid, on the premise that the camera does not have the polaroid, the image shot by the liquid crystal optical element in the focusing state and the image shot in the non-focusing state are utilized, and the imaging speed is improved and the obtained target image is clearer through the enhanced texture processing of the texture image distinguished after the standard variance value is calculated.
Drawings
In order to more clearly illustrate the technical solution of the embodiments of the present invention, the drawings that are needed to be used in the embodiments of the present invention will be briefly described, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a method for imaging a liquid crystal optical element without a polarizer according to an embodiment of the present invention.
Fig. 2 shows a reference gray scale image of the liquid crystal optical element imaging method of fig. 1 in an in-focus state.
Fig. 3 shows a gray-scale image after mirror-expansion of the gray-scale image in the in-focus state of fig. 1.
Fig. 4 shows a standard deviation image in the liquid crystal optical element imaging method of fig. 1.
Fig. 5 shows a reference gray image in a selected one of the non-focused states.
Fig. 6 shows a partial detail image after texture enhancement processing.
Fig. 7 shows a partial detail image of a texture enhanced image after filtering.
Fig. 8 shows a MTF measurement structure diagram in an in-focus state.
Fig. 9 shows an MTF measurement structure diagram of a texture enhanced image.
Fig. 10 shows a structure diagram of MTF measurement after the texture enhanced image is subjected to filtering processing.
Fig. 11 shows a schematic structural view of a liquid crystal optical element imaging device without a polarizing plate according to an embodiment of the present invention.
Fig. 12 is a schematic diagram showing the structure of a liquid crystal optical element imaging apparatus without a polarizing plate according to an embodiment of the present invention.
Detailed Description
Features and exemplary embodiments of various aspects of the present invention will be described in detail below, and in order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely configured to illustrate the invention and are not configured to limit the invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the invention by showing examples of the invention.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising" does not exclude the presence of additional identical elements in a process, method, article, or apparatus that comprises the element.
Referring to fig. 1 to 10, an embodiment of the present invention provides a method for imaging a liquid crystal optical element without a polarizer, wherein the method includes:
s1, acquiring an original gray image obtained by shooting a scene in an in-focus state through the liquid crystal optical element and at least one reference gray image obtained by shooting the scene in an out-of-focus state; the liquid crystal optical element here is a liquid crystal lens or a fly-eye liquid crystal lens. The original gray-scale image and the at least one reference gray-scale image may be part or all of the sequence images of the ISO1233 standard test card obtained under natural light using a liquid crystal lens. When imaging, before acquiring a sequence image, a clearer image is acquired under a specified object distance in a focusing state. If the acquired image is not a gray scale image (e.g., RGB image, etc.), it is converted into a gray scale image.
S2, calculating a local standard deviation value of the original gray image to obtain a local standard deviation image with the same size as the original gray image; based on the local standard deviation matrix size, from top to bottom, from left to right (from point X P/2+1，Q/2+1 To X M+P/2，N+Q/2 ) And (3) standard deviation calculation is carried out on the center point pixel and all the field pixels, and finally, a standard deviation image with the same size as the original image is obtained. Assume that all pixels in the subregion are a sequence { x } 1 ，x 2 ，x 3 …，x n }，Is the average value of the sequence, then the center pointThe standard deviation is:
s3, distinguishing a background image and a texture image from the standard deviation image; the background image is an area with slow change of the image gray level, the standard deviation is smaller, the standard deviation of the texture image part is relatively larger, and the background image or the texture image can be distinguished by analyzing the gray level value. There are many methods for extraction of texture images, such as variance, sobel operator, wavelet analysis, subtracting in-focus and out-of-focus images. The method is preferably realized by variance calculation, mainly has simple algorithm and higher image processing efficiency. The sharpness enhancement is performed on the image part of the texture part, so that the generated texture image and the background image need to be distinguished in the standard deviation image, and the average value of the whole original gray image can be obtained by adopting the average processing as a threshold value.
S4, selecting a reference gray level image, and performing enhanced texture processing on the texture image to obtain a texture enhanced image; and selecting one reference gray image from the reference gray images to be used as a reference of the texture image.
S5, generating a target image according to the texture enhanced image and the background image.
The imaging method of the liquid crystal optical element without the polaroid provided by the embodiment of the invention improves the image definition by an image processing method, only needs to acquire one image in a focusing state and one image in a non-focusing state, and carries out definition enhancement processing on the texture structure by extracting the texture structure of the image. As can be seen from fig. 2 to 7, the image clarity and display effect are significantly improved after the above-mentioned method for imaging a liquid crystal optical element without a polarizing plate according to an embodiment of the present invention. And the liquid crystal optical element does not need to work in a non-lens state, so that the time for imaging an image is saved.
In one embodiment, before said calculating the standard deviation value of the original gray image to obtain the standard deviation image with the same size as the original gray image, the method further comprises:
as shown in fig. 4, the pixels on the boundary of the original gray image are subjected to mirror expansion according to the neighborhood size, so as to generate a mirror expansion image. Preferably, the mirror-expanding the pixels on the boundary of the original gray-scale image according to the neighborhood size includes:
defining the size of an image area selected by calculating the local standard deviation, setting the size of the area as (P, Q), setting the size of a matrix on the boundary of an original gray image as (M, N), and expanding the boundary mirror image of the original gray image as (M+P-1, N+Q-1), wherein M, N, P, Q is a positive integer. The image is expanded according to the calculated area size of the preselected local standard deviation so as to ensure that the standard deviation image obtained by the final calculation and the original focusing image keep the same size.
Preferably, the range of values of P and Q is: p is more than or equal to 7 and less than or equal to 11, and Q is more than or equal to 7 and less than or equal to 1. Experiments prove that when p=11 and q=11, the size of the image after expansion is (m+10, n+10).
Preferably, the selecting a reference gray level image, performing enhanced texture processing on the texture image to obtain a texture enhanced image, includes:
setting a threshold I of a texture image 1 The original gray image has a value of I f The texture enhanced image obtained by referencing the gray image with Ir is divided into two cases: at a value greater than the threshold I 1 When the texture enhanced image is obtained by the following formula: ((i, j) -a (i, j))/(1-a); at less than or equal to the threshold I 1 When the I is taken f Wherein i and j take natural numbers greater than or equal to 1, the value of a is determined according to the blurring degree of the reference gray level image, and the value range of a is more than or equal to 0.1 and less than or equal to 0.9. PreferablyThe value of a is 0.6.
Preferably, when a is greater than or equal to a predetermined value, bilateral filtering processing is performed on the texture enhanced image. As the edge effect is excessively enhanced after the a is enlarged, bilateral filtering treatment can be used, and the effects of edge protection and noise filtering are achieved. The bilateral filtering processing mode provided by the embodiment of the invention is as follows:
the texture enhanced image is extended based on the template radius (r=3),
wherein sigma_d=3;
sigma_r＝50；
the image is processed with the distance as an independent variable gaussian filter W1 and the similarity as an independent variable gaussian filter W2:
obtaining a weighting coefficient through W=W1×W2;
obtaining a weighting matrix through P=image (i-r: i+r, j-r: j+r) w;
then, a weighted average of the center points is obtained by using the formula Image (i, j) =sum (sum (P))/sum (sum (w)).
Edge effects due to texture enhancement can be greatly improved by bilateral filtering while preserving detail, since edge effects are mainly due to edge noise introduced during texture extraction. And can improve MTF performance to a greater extent, where MTF (Modulation Transfer Function) represents the modulation transfer function. In the MTF representation diagrams 8 to 10, the MTF measurement structure diagram in the focusing state, the MTF measurement structure diagram after the texture enhancement treatment and the MTF measurement structure diagram after the texture enhancement image are filtered, obviously, the curves are more and more obvious, the curves are smoother, and the image definition and the display effect are obviously improved.
Referring to fig. 11, an embodiment of the present invention provides a liquid crystal optical element imaging device without a polarizing plate, wherein the device includes:
an image acquisition module 10, configured to acquire an original gray-scale image obtained by processing a scene captured in an in-focus state by the liquid crystal optical element and at least one reference gray-scale image obtained by processing the scene captured in an out-of-focus state;
a calculation module 20, configured to calculate a standard deviation value of the original gray image, and obtain a standard deviation image with the same size as the original gray image;
a separation module 30 for distinguishing a background image and a texture image from the standard deviation image;
a texture image enhancement processing module 40, configured to select a reference gray level image, and perform enhancement texture processing on the texture image to obtain a texture enhanced image;
a target image generating module 50, configured to generate a target image according to the texture enhanced image and the background image.
Preferably, the device further comprises:
the mirror image expansion module is used for mirror-expanding the original gray image according to the neighborhood size for the pixels on the boundary of the original gray image.
In one embodiment, the mirror extension module is specifically configured to:
defining the size of the image subarea selected by the local standard deviation, setting the size of the subarea as (P, Q), setting the size of the original gray image matrix as (M, N), and expanding the boundary mirror image of the original gray image as (M+P-1, N+Q-1), wherein M, N, P, Q is a positive integer.
Preferably, the range of values of P and Q is: p is more than or equal to 7 and less than or equal to 11, Q is more than or equal to 7 and less than or equal to 11, and P and Q are odd numbers.
Preferably, p=11 and q=11.
Preferably, the texture image enhancement processing module 40 is specifically configured to:
setting a threshold value I1 of the texture image, wherein the value of the original gray image is If, and the value of the reference gray image is Ir, the obtained texture enhancement image is divided into two cases: above the threshold I1, the texture enhanced image is obtained by the following formula: ((i, j) -a (i, j))/(1-a); and when the value is smaller than or equal to the threshold I1, taking the value of If, wherein I and j take natural numbers larger than or equal to 1, the value of a is determined according to the blurring degree of the reference gray level image, and the value range of a is more than or equal to 0.1 and less than or equal to 0.9.
Preferably, the texture image enhancement processing module 40 further includes: and the bilateral filtering processing unit is used for carrying out bilateral filtering processing on the texture enhanced image when the a is larger than or equal to a preset value.
In addition, the liquid crystal optical element imaging method without a polarizing plate of the embodiment of the present invention described in connection with fig. 1 to 10 may be implemented by a liquid crystal optical element imaging apparatus without a polarizing plate. Fig. 12 is a schematic diagram showing a hardware configuration of a liquid crystal optical element imaging device without a polarizing plate according to an embodiment of the present invention.
The liquid crystal optical element imaging device without a polarizer may include a liquid crystal optical element, a processor 401, and a memory 402 storing computer program instructions. Computer program instructions for invoking the memory by the processor control the liquid crystal optical element.
In particular, the processor 401 described above may include a Central Processing Unit (CPU), or an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or may be configured as one or more integrated circuits implementing embodiments of the present invention.
Memory 402 may include mass storage for data or instructions. By way of example, and not limitation, memory 402 may comprise a Hard Disk Drive (HDD), floppy Disk Drive, flash memory, optical Disk, magneto-optical Disk, magnetic tape, or universal serial bus (Universal Serial Bus, USB) Drive, or a combination of two or more of the foregoing. Memory 402 may include removable or non-removable (or fixed) media, where appropriate. Memory 402 may be internal or external to the data processing apparatus, where appropriate. In a particular embodiment, the memory 402 is a non-volatile solid state memory. In a particular embodiment, the memory 402 includes Read Only Memory (ROM). The ROM may be mask programmed ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory, or a combination of two or more of these, where appropriate.
The processor 401 reads and executes the computer program instructions stored in the memory 402 to implement any one of the polarizer-free liquid crystal optical element imaging methods of the above embodiments.
In one example, the polarizer-less liquid crystal optical element imaging device may further include a communication interface 403 and a bus 410. As shown in fig. 12, the processor 401, the memory 402, and the communication interface 403 are connected to each other by a bus 410 and perform communication with each other.
The communication interface 403 is mainly used to implement communication between each module, device, unit and/or apparatus in the embodiment of the present invention.
Bus 410 includes hardware, software, or both, coupling components of a polarizer-less based liquid crystal optical element imaging device to each other. By way of example, and not limitation, the buses may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a micro channel architecture (MCa) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus, or a combination of two or more of the above. Bus 410 may include one or more buses, where appropriate. Although embodiments of the invention have been described and illustrated with respect to a particular bus, the invention contemplates any suitable bus or interconnect.
In addition, in combination with the method for imaging a liquid crystal optical element without a polarizer in the above embodiments, embodiments of the present invention may be implemented by providing a computer-readable storage medium. The computer readable storage medium has stored thereon computer program instructions; the computer program instructions, when executed by a processor, implement any of the polarizer-free liquid crystal optical element imaging methods of the above embodiments.
It should be understood that the invention is not limited to the particular arrangements and instrumentality described above and shown in the drawings. For the sake of brevity, a detailed description of known methods is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present invention are not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between steps, after appreciating the spirit of the present invention.
The functional blocks shown in the above-described structural block diagrams may be implemented in hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, a plug-in, a function card, or the like. When implemented in software, the elements of the invention are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine readable medium or transmitted over transmission media or communication links by a data signal carried in a carrier wave. A "machine-readable medium" may include any medium that can store or transfer information. Examples of machine-readable media include electronic circuitry, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio Frequency (RF) links, and the like. The code segments may be downloaded via computer networks such as the internet, intranets, etc.
It should also be noted that the exemplary embodiments mentioned in this disclosure describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, or may be performed in a different order from the order in the embodiments, or several steps may be performed simultaneously.
In the foregoing, only the specific embodiments of the present invention are described, and it will be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the systems, modules and units described above may refer to the corresponding processes in the foregoing method embodiments, which are not repeated herein. It should be understood that the scope of the present invention is not limited thereto, and any equivalent modifications or substitutions can be easily made by those skilled in the art within the technical scope of the present invention, and they should be included in the scope of the present invention.
Claims (7)
1. A method of imaging a liquid crystal optical element without a polarizer, the method comprising:
acquiring an original gray image obtained by shooting a scene in an in-focus state through the liquid crystal optical element and at least one reference gray image obtained by shooting the scene in an out-of-focus state;
mirror-expanding the original gray image according to the neighborhood size for the pixels on the boundary of the original gray image, including: defining the size of an image subarea selected by the local standard deviation, setting the size of the subarea as (P, Q), setting the size of an original gray image matrix as (M, N), and expanding the boundary mirror image of the original gray image as (M+P-1, N+Q-1), wherein M, N, P, Q is a positive integer;
calculating the standard variance value of the original gray image to obtain a standard variance image with the same size as the original gray image;
distinguishing a background image and a texture image from the standard deviation image;
selecting a reference gray level image, and performing enhanced texture processing on the texture image to obtain a texture enhanced image, wherein the method comprises the following steps:
setting a threshold value I1 of the texture image, wherein the value of the original gray image is If, and the value of the reference gray image is Ir, the obtained texture enhancement image is divided into two cases: above the threshold I1, the texture enhanced image is obtained by the following formula: (I) f (i，j)-a*I r (i, j))/(1-a); when the value is smaller than or equal to the threshold I1, taking the value of If, wherein I and j take natural numbers larger than or equal to 1, the value of a is determined according to the blurring degree of the reference gray level image, and the value range of a is more than or equal to 0.1 and less than or equal to 0.9;
and generating a target image according to the texture enhanced image and the background image.
2. The method for imaging a liquid crystal optical element without a polarizing plate according to claim 1, wherein the values of P and Q are in the range of: p is more than or equal to 7 and less than or equal to 11, Q is more than or equal to 7 and less than or equal to 11, and P and Q are odd numbers.
3. The method of imaging a liquid crystal optical element without a polarizing plate according to claim 2, wherein p=11, q=11.
4. A method of imaging a liquid crystal optical element without a polarizing plate according to any one of claims 1 to 3, wherein when a is equal to or greater than a predetermined value, the texture enhanced image is subjected to bilateral filtering.
5. A liquid crystal optical element imaging apparatus without a polarizing plate, the apparatus comprising:
the image acquisition module is used for acquiring an original gray image obtained by processing after shooting a scene in a focusing state through the liquid crystal optical element and at least one reference gray image obtained by processing after shooting the scene in a non-focusing state;
the calculation module is used for calculating the standard variance value of the original gray image to obtain a standard variance image with the same size as the original gray image; mirror-expanding the original gray image by pixels on the boundary of the original gray image according to a neighborhood size before calculating the standard variance value of the original gray image, including: defining the size of an image subarea selected by the local standard deviation, setting the size of the subarea as (P, Q), setting the size of an original gray image matrix as (M, N), and expanding the boundary mirror image of the original gray image as (M+P-1, N+Q-1), wherein M, N, P, Q is a positive integer;
a separation module for distinguishing a background image and a texture image from the standard deviation image;
the texture image enhancement processing module is used for selecting a reference gray level image, carrying out enhancement texture processing on the texture image to obtain a texture enhancement image, and comprises the steps of setting a threshold value I1 of the texture image, wherein the value of an original gray level image is If, and the value of the reference gray level image is Ir, and the obtained texture enhancement image is divided into two cases: above the threshold I1, the texture enhanced image is obtained by the following formula：(I f (i，j)-a*I r (i, j))/(1-a); when the value is smaller than or equal to the threshold I1, taking the value of If, wherein I and j take natural numbers larger than or equal to 1, the value of a is determined according to the blurring degree of the reference gray level image, and the value range of a is more than or equal to 0.1 and less than or equal to 0.9;
and the target image generation module is used for generating a target image according to the texture enhanced image and the background image.
6. A liquid crystal optical element imaging apparatus without a polarizing plate, the imaging apparatus comprising: a liquid crystal optical element, at least one processor, at least one memory, and computer program instructions stored in the memory, which when executed by the processor, implement the method of any of claims 1-4.
7. A computer readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the method of any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811155163.1A CN110969581B (en) | 2018-09-30 | 2018-09-30 | Method, device, equipment and medium for imaging liquid crystal optical element without polaroid |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811155163.1A CN110969581B (en) | 2018-09-30 | 2018-09-30 | Method, device, equipment and medium for imaging liquid crystal optical element without polaroid |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110969581A CN110969581A (en) | 2020-04-07 |
| CN110969581B true CN110969581B (en) | 2023-10-20 |
Family
ID=70028658
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811155163.1A Active CN110969581B (en) | 2018-09-30 | 2018-09-30 | Method, device, equipment and medium for imaging liquid crystal optical element without polaroid |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110969581B (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH04263374A (en) * | 1991-02-18 | 1992-09-18 | Sumitomo Cement Co Ltd | Recognizing and classifying method for optical pattern |
| CN101170641A (en) * | 2007-12-05 | 2008-04-30 | 北京航空航天大学 | A method for image edge detection based on threshold sectioning |
| EP1947603A2 (en) * | 2007-01-22 | 2008-07-23 | Sharp Kabushiki Kaisha | Image upsampling technique |
| KR20110032997A (en) * | 2009-09-23 | 2011-03-30 | 삼성전자주식회사 | Wafer-level lenses module with an extended depth of field and imaging device including the lenses module |
| JP2012028964A (en) * | 2010-07-22 | 2012-02-09 | Seiko Epson Corp | Image display device, image supply device, and image processing method |
| CN102609906A (en) * | 2012-01-12 | 2012-07-25 | 北京理工大学 | Gas infrared image enhancing method based on anisotropic diffusion |
| CN103400343A (en) * | 2013-07-15 | 2013-11-20 | 中国航天科工集团第三研究院第八三五八研究所 | Method for compensating uneven brightness of bottom view image under nighttime infrared |
| CN105046658A (en) * | 2015-06-26 | 2015-11-11 | 北京大学深圳研究生院 | Low-illumination image processing method and device |
| CN105301863A (en) * | 2014-07-29 | 2016-02-03 | 深圳市墨克瑞光电子研究院 | Liquid crystal lens imaging device and liquid crystal lens imaging method |
| CN105334681A (en) * | 2014-06-25 | 2016-02-17 | 深圳市墨克瑞光电子研究院 | Liquid crystal lens imaging device and liquid crystal lens imaging method |
| CN105530502A (en) * | 2014-09-28 | 2016-04-27 | 株式会社理光 | Method and apparatus for generating disparity map based on image frames photographed by stereo camera |
| CN106683056A (en) * | 2016-12-16 | 2017-05-17 | 凯迈（洛阳）测控有限公司 | Airborne photoelectric infrared digital image processing method and apparatus thereof |
| CN107392866A (en) * | 2017-07-07 | 2017-11-24 | 武汉科技大学 | A kind of facial image local grain Enhancement Method of illumination robust |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9525802B2 (en) * | 2013-07-24 | 2016-12-20 | Georgetown University | Enhancing the legibility of images using monochromatic light sources |
-
2018
- 2018-09-30 CN CN201811155163.1A patent/CN110969581B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH04263374A (en) * | 1991-02-18 | 1992-09-18 | Sumitomo Cement Co Ltd | Recognizing and classifying method for optical pattern |
| EP1947603A2 (en) * | 2007-01-22 | 2008-07-23 | Sharp Kabushiki Kaisha | Image upsampling technique |
| CN101170641A (en) * | 2007-12-05 | 2008-04-30 | 北京航空航天大学 | A method for image edge detection based on threshold sectioning |
| KR20110032997A (en) * | 2009-09-23 | 2011-03-30 | 삼성전자주식회사 | Wafer-level lenses module with an extended depth of field and imaging device including the lenses module |
| JP2012028964A (en) * | 2010-07-22 | 2012-02-09 | Seiko Epson Corp | Image display device, image supply device, and image processing method |
| CN102609906A (en) * | 2012-01-12 | 2012-07-25 | 北京理工大学 | Gas infrared image enhancing method based on anisotropic diffusion |
| CN103400343A (en) * | 2013-07-15 | 2013-11-20 | 中国航天科工集团第三研究院第八三五八研究所 | Method for compensating uneven brightness of bottom view image under nighttime infrared |
| CN105334681A (en) * | 2014-06-25 | 2016-02-17 | 深圳市墨克瑞光电子研究院 | Liquid crystal lens imaging device and liquid crystal lens imaging method |
| CN105301863A (en) * | 2014-07-29 | 2016-02-03 | 深圳市墨克瑞光电子研究院 | Liquid crystal lens imaging device and liquid crystal lens imaging method |
| CN105530502A (en) * | 2014-09-28 | 2016-04-27 | 株式会社理光 | Method and apparatus for generating disparity map based on image frames photographed by stereo camera |
| CN105046658A (en) * | 2015-06-26 | 2015-11-11 | 北京大学深圳研究生院 | Low-illumination image processing method and device |
| CN106683056A (en) * | 2016-12-16 | 2017-05-17 | 凯迈（洛阳）测控有限公司 | Airborne photoelectric infrared digital image processing method and apparatus thereof |
| CN107392866A (en) * | 2017-07-07 | 2017-11-24 | 武汉科技大学 | A kind of facial image local grain Enhancement Method of illumination robust |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110969581A (en) | 2020-04-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10785412B2 (en) | Image processing apparatus and image capturing apparatus | |
| Alireza Golestaneh et al. | Spatially-varying blur detection based on multiscale fused and sorted transform coefficients of gradient magnitudes | |
| US8159552B2 (en) | Apparatus and method for restoring image based on distance-specific point spread function | |
| US8385678B2 (en) | Image restoration apparatus and method | |
| US10382684B2 (en) | Image processing apparatus and image capturing apparatus | |
| CN102369722B (en) | Camera head and image capture method and the image processing method for described camera head | |
| JP2003172873A (en) | Data correcting method and imaging unit | |
| EP3371741B1 (en) | Focus detection | |
| CN106651791B (en) | Single motion blurred image recovery method | |
| CN109214996B (en) | Image processing method and device | |
| CN108234826B (en) | Image processing method and device | |
| CN111311481A (en) | Background blurring method and device, terminal equipment and storage medium | |
| JP2015062270A (en) | Image processing apparatus | |
| CN110969581B (en) | Method, device, equipment and medium for imaging liquid crystal optical element without polaroid | |
| Bhagat et al. | Novel Approach to Estimate Motion Blur Kernel Parameters and Comparative Study of Restoration Techniques | |
| EP1522961A2 (en) | Deconvolution of a digital image | |
| Xu et al. | Removing out-of-focus blur from a single image | |
| JP6570406B2 (en) | Image processing apparatus, imaging apparatus, image processing method, and program | |
| Ledesma-Carrillo et al. | Extended depth of field in images through complex amplitude pre-processing and optimized digital post-processing | |
| CN111292232B (en) | Lens array image stitching method, device and storage medium | |
| CN111292233B (en) | Lens array image stitching method, device and storage medium | |
| US11803942B2 (en) | Blended gray image enhancement | |
| CN113055584B (en) | Focusing method based on fuzzy degree, lens controller and camera module | |
| CN116684721B (en) | Liquid lens rapid focusing method, device and equipment based on moving object | |
| US20200169668A1 (en) | Imaging control apparatus, imaging apparatus, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |